Cost-Effective Data Placement in Edge Storage Systems with Erasure Code

Article

Jin, Hai, Luo, Ruikun, He, Qiang, Wu, Song, Zeng, Zilai and Xia, Xiaoyu. 2022. "Cost-Effective Data Placement in Edge Storage Systems with Erasure Code." IEEE Transactions on Services Computing. 16 (2), pp. 1039-1050. https://doi.org/10.1109/TSC.2022.3152849

Article Title	Cost-Effective Data Placement in Edge Storage Systems with Erasure Code
ERA Journal ID	36548
Article Category	Article
Authors	Jin, Hai (Author), Luo, Ruikun (Author), He, Qiang (Author), Wu, Song (Author), Zeng, Zilai (Author) and Xia, Xiaoyu (Author)
Journal Title	IEEE Transactions on Services Computing
Journal Citation	16 (2), pp. 1039-1050
Number of Pages	12
Year	2022
Publisher	IEEE (Institute of Electrical and Electronics Engineers)
Place of Publication	United States
ISSN	1939-1374
Digital Object Identifier (DOI)	https://doi.org/10.1109/TSC.2022.3152849
Web Address (URL)	https://ieeexplore.ieee.org/document/9721137
Abstract	In this paper, we make the first attempt to investigate the use of erasure codes in cost-effective data storage at the edge. The focus is to find the optimal strategy for placing coded data blocks on the edge servers in an ESS, aiming to minimize the storage cost while serving all the users in the system. We first model this novel Erasure Coding based Edge Data Placement (EC-EDP) problem as a constrained optimization problem and prove that it is NP-hard. Then, we propose an optimal approach named EC-EDP-O based on integer programming. We also propose an approximation algorithm named EC-EDP-V for finding approximate solutions to large-scale EC-EDP problems efficiently. The results of experiments conducted on a widely-used real-world dataset demonstrate that EC-EDP-O and EC-EDP-V can save an average of 68.58% (and up to 81.16% in large-scale scenarios) storage cost compared with replica-based storage approaches.
Keywords	Approximation Algorithm; Cloud computing; Codes; Costs; Data Placement; Distributed databases; Edge Computing; Edge computing; Encoding; Erasure Code; Servers
ANZSRC Field of Research 2020	460612. Service oriented computing
Public Notes	Files associated with this item cannot be displayed due to copyright restrictions.
Byline Affiliations	Huazhong University of Science and Technology, China
	Swinburne University of Technology
	Deakin University
Institution of Origin	University of Southern Queensland

Permalink -

https://research.usq.edu.au/item/q7q70/cost-effective-data-placement-in-edge-storage-systems-with-erasure-code

93
total views
2
total downloads
1
views this month
0
downloads this month

Export as

Related outputs

Formulating Interference-aware Data Delivery Strategies in Edge Storage Systems

Xia, Xiaoyu, Chen, Feifei, He, Qiang, Cui, Guangming, Grundy, John, Abdelrazek, Mohamed and Dong, Fang. 2023. "Formulating Interference-aware Data Delivery Strategies in Edge Storage Systems." 51st International Conference on Parallel Processing (ICPP '22). Bordeaux, France 29 Aug - 01 Sep 2022 United States. Association for Computing Machinery (ACM). https://doi.org/10.1145/3545008.3545078

GraphTune: An Efficient Dependency-Aware Substrate to Alleviate Irregularity in Concurrent Graph Processing

Zhao, Jin, Zhang, Yu, He, Ligang, Li, Qikun, Zhang, Xiang, Jiang, Xinyu, Yu, Hui, Liao, Xiaofei, Jin, Hai, Gu, Lin, Liu, Haikun, He, Bingsheng, Zhang, Ji, Song, Xianzheng, Wang, Lin and Zhou, Jun. 2023. "GraphTune: An Efficient Dependency-Aware Substrate to Alleviate Irregularity in Concurrent Graph Processing." ACM Transactions on Architecture and Code Optimization. 20 (3), pp. 1-24. https://doi.org/10.1145/3600091

EGraph: Efficient Concurrent GPU-Based Dynamic Graph Processing

Zhang, Yu, Liang, Yuxuan, Zhao, Jin, Mao, Fubing, Gu, Lin, Liao, Xiaofei, Jin, Hai, Liu, Haikun, Guo, Song, Zeng, Yangqing, Hu, Hang, Li, Chen, Zhang, Ji and Wang, Biao. 2023. "EGraph: Efficient Concurrent GPU-Based Dynamic Graph Processing." IEEE Transactions on Knowledge and Data Engineering. 35 (6), pp. 5823-5836. https://doi.org/10.1109/TKDE.2022.3171588

An efficient hardware accelerator for monotonic graph algorithms on dynamic directed graphs

Yang, Yun, Yu, Hui, Zhao, Jin, Zhang, Yu, Liao, Xiaofei, Jiang, Xinyu, Jin, Hai, Liu, Haikun, Mao, Fubing, Zhang, Ji and Wang, Biao. 2023. "An efficient hardware accelerator for monotonic graph algorithms on dynamic directed graphs." Scientia Sinica Informationis. 53 (8), pp. 1575-1592. https://doi.org/10.1360/SSI-2022-0191

Data Caching Optimization in the Edge Computing Environment

Liu, Ying, He, Qiang, Zheng, Dequan, Xia, Xiaoyu, Chen, Feifei and Zhang, Bin. 2022. "Data Caching Optimization in the Edge Computing Environment." IEEE Transactions on Services Computing. 15 (4), pp. 2074-2085. https://doi.org/10.1109/TSC.2020.3032724

Spatial-Temporal Edge User Allocation: An Expectation Confirmation Perspective Approach

Zou, Guobing, Xu, Zhiwei, Xia, Xiaoyu, Liu, Ya, Gan, Yanglan, Zhang, Bofeng, Zhou, Min and He, Qiang. 2022. "Spatial-Temporal Edge User Allocation: An Expectation Confirmation Perspective Approach." IEEE Transactions on Network and Service Management. 19 (4), pp. 4918-4931. https://doi.org/10.1109/TNSM.2022.3193088

Auction-Promoted Trading for Multiple Federated Learning Services in UAV-Aided Networks

Cheng, Zhipeng, Liwang, Minghui, Xia, Xiaoyu, Min, Minghui, Wang, Xianbin and Du, Xiaojiang. 2022. "Auction-Promoted Trading for Multiple Federated Learning Services in UAV-Aided Networks." IEEE Transactions on Vehicular Technology. 71 (10), pp. 10960 - 10974. https://doi.org/10.1109/TVT.2022.3184026

Cost-Effective Edge Server Network Design in Mobile Edge Computing Environment

Luo, Ruikun, Jin, Hai, He, Qiang, Wu, Song and Xia, Xiaoyu. 2022. "Cost-Effective Edge Server Network Design in Mobile Edge Computing Environment." IEEE Transactions on Sustainable Computing. 7 (4), pp. 839-850. https://doi.org/10.1109/TSUSC.2022.3178661

Data Caching Optimization With Fairness in Mobile Edge Computing

Zhou, Jingwen, Chen, Feifei, He, Qiang, Xia, Xiaoyu, Wang, Rui and Xiang, Yong. 2023. "Data Caching Optimization With Fairness in Mobile Edge Computing." IEEE Transactions on Services Computing. 16 (3), pp. 1750 - 1762. https://doi.org/10.1109/TSC.2022.3197881

Interference-Aware SaaS User Allocation Game for Edge Computing

Cui, Guangming, He, Qiang, Xia, Xiaoyu, Lai, Phu, Chen, Feifei, Gu, Tao and Yang, Yun. 2022. "Interference-Aware SaaS User Allocation Game for Edge Computing." IEEE Transactions on Cloud Computing. 10 (3), pp. 1888-1899. https://doi.org/10.1109/TCC.2020.3008448

READ: Robustness-Oriented Edge Application Deployment in Edge Computing Environment

Li, Bo, He, Qiang, Cui, Guangming, Xia, Xiaoyu, Chen, Feifei, Jin, Hai and Yang, Yun. 2022. "READ: Robustness-Oriented Edge Application Deployment in Edge Computing Environment." IEEE Transactions on Services Computing. 15 (3), pp. 1746-1759. https://doi.org/10.1109/TSC.2020.3015316

Data, User and Power Allocations for Caching in Multi-Access Edge Computing

Xia, Xiaoyu, Chen, Feifei, He, Qiang, Cui, Guangming, Grundy, John C., Abdelrazek, Mohamed, Xu, Xiaolong and Jin, Hai. 2022. "Data, User and Power Allocations for Caching in Multi-Access Edge Computing." IEEE Transactions on Parallel and Distributed Systems. 33 (5), pp. 1144-1155. https://doi.org/10.1109/TPDS.2021.3104241

Formulating Cost-Effective Data Distribution Strategies Online for Edge Cache Systems

Xia, Xiaoyu, Chen, Feifei, He, Qiang, Grundy, John, Abdelrazek, Mohamed, Shen, Jun, Bouguettaya, Athman and Jin, Hai. 2022. "Formulating Cost-Effective Data Distribution Strategies Online for Edge Cache Systems." IEEE Transactions on Parallel and Distributed Systems. 33 (12), pp. 4270-4281. https://doi.org/10.1109/TPDS.2022.3185250

Older Persons’ and Their Caregivers’ Perspectives and Experiences of Research Participation With Impaired Decision-Making Capacity: A Scoping Review

Hosie, Annmarie, Kochovska, Slavica, Ries, Nola, Gilmore, Imelda, Parker, Deborah, Sinclair, Craig, Sheehan, Caitlin, Collier, Aileen, Caplan, Gideon A., Visser, Mandy, Xu, Xiaoyue, Lobb, Elizabeth, Sheahan, Linda, Brown, Linda, Lee, Wei, Sanderson, Christine R., Amgarth-Duff, Ingrid, Green, Anna, Edwards, Layla and Agar, Meera R.. 2022. "Older Persons’ and Their Caregivers’ Perspectives and Experiences of Research Participation With Impaired Decision-Making Capacity: A Scoping Review." The Gerontologist. 62 (2), pp. e112-e122. https://doi.org/10.1093/geront/gnaa118

An efficient storage system towards high throughput of concurrent graph processing jobs

Zhao, Jin, Jiang, Xinyu, Zhang, Yu, Zhu, Xiaofei, Jin, Hai, Liu, Haikun, Yang, Yun, Zhang, Ji, Wang, Biao and Yu, Ting. 2022. "An efficient storage system towards high throughput of concurrent graph processing jobs." Scientia Sinica Informationis. 52 (1), pp. 111-128.