Cost-Effective Data Placement in Edge Storage Systems with Erasure Code

Article


Jin, Hai, Luo, Ruikun, He, Qiang, Wu, Song, Zeng, Zilai and Xia, Xiaoyu. 2022. "Cost-Effective Data Placement in Edge Storage Systems with Erasure Code." IEEE Transactions on Services Computing. 16 (2), pp. 1039-1050. https://doi.org/10.1109/TSC.2022.3152849
Article Title

Cost-Effective Data Placement in Edge Storage Systems with Erasure Code

ERA Journal ID36548
Article CategoryArticle
AuthorsJin, Hai (Author), Luo, Ruikun (Author), He, Qiang (Author), Wu, Song (Author), Zeng, Zilai (Author) and Xia, Xiaoyu (Author)
Journal TitleIEEE Transactions on Services Computing
Journal Citation16 (2), pp. 1039-1050
Number of Pages12
Year2022
PublisherIEEE (Institute of Electrical and Electronics Engineers)
Place of PublicationUnited States
ISSN1939-1374
Digital Object Identifier (DOI)https://doi.org/10.1109/TSC.2022.3152849
Web Address (URL)https://ieeexplore.ieee.org/document/9721137
Abstract

In this paper, we make the first attempt to investigate the use of erasure codes in cost-effective data storage at the edge. The focus is to find the optimal strategy for placing coded data blocks on the edge servers in an ESS, aiming to minimize the storage cost while serving all the users in the system. We first model this novel Erasure Coding based Edge Data Placement (EC-EDP) problem as a constrained optimization problem and prove that it is NP-hard. Then, we propose an optimal approach named EC-EDP-O based on integer programming. We also propose an approximation algorithm named EC-EDP-V for finding approximate solutions to large-scale EC-EDP problems efficiently. The results of experiments conducted on a widely-used real-world dataset demonstrate that EC-EDP-O and EC-EDP-V can save an average of 68.58% (and up to 81.16% in large-scale scenarios) storage cost compared with replica-based storage approaches.

KeywordsApproximation Algorithm; Cloud computing; Codes; Costs; Data Placement; Distributed databases; Edge Computing; Edge computing; Encoding; Erasure Code; Servers
ANZSRC Field of Research 2020460612. Service oriented computing
Public Notes

Files associated with this item cannot be displayed due to copyright restrictions.

Byline AffiliationsHuazhong University of Science and Technology, China
Swinburne University of Technology
Deakin University
Institution of OriginUniversity of Southern Queensland
Permalink -

https://research.usq.edu.au/item/q7q70/cost-effective-data-placement-in-edge-storage-systems-with-erasure-code

  • 85
    total views
  • 2
    total downloads
  • 1
    views this month
  • 0
    downloads this month

Export as

Related outputs

Formulating Interference-aware Data Delivery Strategies in Edge Storage Systems
Xia, Xiaoyu, Chen, Feifei, He, Qiang, Cui, Guangming, Grundy, John, Abdelrazek, Mohamed and Dong, Fang. 2023. "Formulating Interference-aware Data Delivery Strategies in Edge Storage Systems." 51st International Conference on Parallel Processing (ICPP '22). Bordeaux, France 29 Aug - 01 Sep 2022 United States. Association for Computing Machinery (ACM). https://doi.org/10.1145/3545008.3545078
GraphTune: An Efficient Dependency-Aware Substrate to Alleviate Irregularity in Concurrent Graph Processing
Zhao, Jin, Zhang, Yu, He, Ligang, Li, Qikun, Zhang, Xiang, Jiang, Xinyu, Yu, Hui, Liao, Xiaofei, Jin, Hai, Gu, Lin, Liu, Haikun, He, Bingsheng, Zhang, Ji, Song, Xianzheng, Wang, Lin and Zhou, Jun. 2023. "GraphTune: An Efficient Dependency-Aware Substrate to Alleviate Irregularity in Concurrent Graph Processing." ACM Transactions on Architecture and Code Optimization. 20 (3), pp. 1-24. https://doi.org/10.1145/3600091
EGraph: Efficient Concurrent GPU-Based Dynamic Graph Processing
Zhang, Yu, Liang, Yuxuan, Zhao, Jin, Mao, Fubing, Gu, Lin, Liao, Xiaofei, Jin, Hai, Liu, Haikun, Guo, Song, Zeng, Yangqing, Hu, Hang, Li, Chen, Zhang, Ji and Wang, Biao. 2023. "EGraph: Efficient Concurrent GPU-Based Dynamic Graph Processing." IEEE Transactions on Knowledge and Data Engineering. 35 (6), pp. 5823-5836. https://doi.org/10.1109/TKDE.2022.3171588
An efficient hardware accelerator for monotonic graph algorithms on dynamic directed graphs
Yang, Yun, Yu, Hui, Zhao, Jin, Zhang, Yu, Liao, Xiaofei, Jiang, Xinyu, Jin, Hai, Liu, Haikun, Mao, Fubing, Zhang, Ji and Wang, Biao. 2023. "An efficient hardware accelerator for monotonic graph algorithms on dynamic directed graphs." Scientia Sinica Informationis. 53 (8), pp. 1575-1592. https://doi.org/10.1360/SSI-2022-0191
Data Caching Optimization in the Edge Computing Environment
Liu, Ying, He, Qiang, Zheng, Dequan, Xia, Xiaoyu, Chen, Feifei and Zhang, Bin. 2022. "Data Caching Optimization in the Edge Computing Environment." IEEE Transactions on Services Computing. 15 (4), pp. 2074-2085. https://doi.org/10.1109/TSC.2020.3032724
Spatial-Temporal Edge User Allocation: An Expectation Confirmation Perspective Approach
Zou, Guobing, Xu, Zhiwei, Xia, Xiaoyu, Liu, Ya, Gan, Yanglan, Zhang, Bofeng, Zhou, Min and He, Qiang. 2022. "Spatial-Temporal Edge User Allocation: An Expectation Confirmation Perspective Approach." IEEE Transactions on Network and Service Management. 19 (4), pp. 4918-4931. https://doi.org/10.1109/TNSM.2022.3193088
Auction-Promoted Trading for Multiple Federated Learning Services in UAV-Aided Networks
Cheng, Zhipeng, Liwang, Minghui, Xia, Xiaoyu, Min, Minghui, Wang, Xianbin and Du, Xiaojiang. 2022. "Auction-Promoted Trading for Multiple Federated Learning Services in UAV-Aided Networks." IEEE Transactions on Vehicular Technology. 71 (10), pp. 10960 - 10974. https://doi.org/10.1109/TVT.2022.3184026
Cost-Effective Edge Server Network Design in Mobile Edge Computing Environment
Luo, Ruikun, Jin, Hai, He, Qiang, Wu, Song and Xia, Xiaoyu. 2022. "Cost-Effective Edge Server Network Design in Mobile Edge Computing Environment." IEEE Transactions on Sustainable Computing. 7 (4), pp. 839-850. https://doi.org/10.1109/TSUSC.2022.3178661
Data Caching Optimization With Fairness in Mobile Edge Computing
Zhou, Jingwen, Chen, Feifei, He, Qiang, Xia, Xiaoyu, Wang, Rui and Xiang, Yong. 2023. "Data Caching Optimization With Fairness in Mobile Edge Computing." IEEE Transactions on Services Computing. 16 (3), pp. 1750 - 1762. https://doi.org/10.1109/TSC.2022.3197881
Interference-Aware SaaS User Allocation Game for Edge Computing
Cui, Guangming, He, Qiang, Xia, Xiaoyu, Lai, Phu, Chen, Feifei, Gu, Tao and Yang, Yun. 2022. "Interference-Aware SaaS User Allocation Game for Edge Computing." IEEE Transactions on Cloud Computing. 10 (3), pp. 1888-1899. https://doi.org/10.1109/TCC.2020.3008448
READ: Robustness-Oriented Edge Application Deployment in Edge Computing Environment
Li, Bo, He, Qiang, Cui, Guangming, Xia, Xiaoyu, Chen, Feifei, Jin, Hai and Yang, Yun. 2022. "READ: Robustness-Oriented Edge Application Deployment in Edge Computing Environment." IEEE Transactions on Services Computing. 15 (3), pp. 1746-1759. https://doi.org/10.1109/TSC.2020.3015316
Data, User and Power Allocations for Caching in Multi-Access Edge Computing
Xia, Xiaoyu, Chen, Feifei, He, Qiang, Cui, Guangming, Grundy, John C., Abdelrazek, Mohamed, Xu, Xiaolong and Jin, Hai. 2022. "Data, User and Power Allocations for Caching in Multi-Access Edge Computing." IEEE Transactions on Parallel and Distributed Systems. 33 (5), pp. 1144-1155. https://doi.org/10.1109/TPDS.2021.3104241
Formulating Cost-Effective Data Distribution Strategies Online for Edge Cache Systems
Xia, Xiaoyu, Chen, Feifei, He, Qiang, Grundy, John, Abdelrazek, Mohamed, Shen, Jun, Bouguettaya, Athman and Jin, Hai. 2022. "Formulating Cost-Effective Data Distribution Strategies Online for Edge Cache Systems." IEEE Transactions on Parallel and Distributed Systems. 33 (12), pp. 4270-4281. https://doi.org/10.1109/TPDS.2022.3185250
Older Persons’ and Their Caregivers’ Perspectives and Experiences of Research Participation With Impaired Decision-Making Capacity: A Scoping Review
Hosie, Annmarie, Kochovska, Slavica, Ries, Nola, Gilmore, Imelda, Parker, Deborah, Sinclair, Craig, Sheehan, Caitlin, Collier, Aileen, Caplan, Gideon A., Visser, Mandy, Xu, Xiaoyue, Lobb, Elizabeth, Sheahan, Linda, Brown, Linda, Lee, Wei, Sanderson, Christine R., Amgarth-Duff, Ingrid, Green, Anna, Edwards, Layla and Agar, Meera R.. 2022. "Older Persons’ and Their Caregivers’ Perspectives and Experiences of Research Participation With Impaired Decision-Making Capacity: A Scoping Review." The Gerontologist. 62 (2), pp. e112-e122. https://doi.org/10.1093/geront/gnaa118
An efficient storage system towards high throughput of concurrent graph processing jobs
Zhao, Jin, Jiang, Xinyu, Zhang, Yu, Zhu, Xiaofei, Jin, Hai, Liu, Haikun, Yang, Yun, Zhang, Ji, Wang, Biao and Yu, Ting. 2022. "An efficient storage system towards high throughput of concurrent graph processing jobs." Scientia Sinica Informationis. 52 (1), pp. 111-128.