Formulating Cost-Effective Data Distribution Strategies Online for Edge Cache Systems

Article

Xia, Xiaoyu, Chen, Feifei, He, Qiang, Grundy, John, Abdelrazek, Mohamed, Shen, Jun, Bouguettaya, Athman and Jin, Hai. 2022. "Formulating Cost-Effective Data Distribution Strategies Online for Edge Cache Systems." IEEE Transactions on Parallel and Distributed Systems. 33 (12), pp. 4270-4281. https://doi.org/10.1109/TPDS.2022.3185250
Article Title

Formulating Cost-Effective Data Distribution Strategies Online for Edge Cache Systems

ERA Journal ID20981
Article CategoryArticle
AuthorsXia, Xiaoyu (Author), Chen, Feifei (Author), He, Qiang (Author), Grundy, John (Author), Abdelrazek, Mohamed (Author), Shen, Jun (Author), Bouguettaya, Athman (Author) and Jin, Hai (Author)
Journal TitleIEEE Transactions on Parallel and Distributed Systems
Journal Citation33 (12), pp. 4270-4281
Number of Pages12
Year2022
Place of PublicationUnited States
ISSN1045-9219
1558-2183
Digital Object Identifier (DOI)https://doi.org/10.1109/TPDS.2022.3185250
Web Address (URL)https://ieeexplore.ieee.org/document/9804351
Abstract

Edge Computing (EC) enables a new kind of caching system in close geographic proximity to end-users by allowing app vendors to cache popular data on edge servers deployed at base stations. This edge cache system can better support latency-sensitive applications. However, transmitting data from the centralized cloud to the edge servers without proper transmission strategies may cost app vendors dearly. Cost-effective data distribution strategies are of particular importance for applications, whose data to be cached at the edge often changes dynamically. In this paper, we study this Online Edge Data Distribution (OEDD) problem, aiming to minimize app vendors’ total transmission cost, while ensuring low transmission latency in the long term. We first model this problem and prove its NP-hardness. We then combine Lyapunov optimization and game theory to propose a novel Latency-Aware Online (LAO) approach for solving this OEDD problem over time in a distributed manner with provable performance guarantees. The evaluation of LAO based on a real-world dataset demonstrates that it can help app vendors formulate cost-effective edge data distribution strategies in an online manner.

KeywordsAustralia; Cloud computing; Costs; Data communication; data distribution; edge cache system; online algorithm; optimization; Optimization; Servers; Videos
ANZSRC Field of Research 2020460503. Data models, storage and indexing
460605. Distributed systems and algorithms
460612. Service oriented computing
Public Notes

Files associated with this item cannot be displayed due to copyright restrictions.

Byline AffiliationsUniversity of Adelaide
Swinburne University of Technology
Monash University
Deakin University
University of Sydney
University of Wollongong
Huazhong University of Science and Technology, China
Institution of OriginUniversity of Southern Queensland
Permalink -

https://research.usq.edu.au/item/q78zz/formulating-cost-effective-data-distribution-strategies-online-for-edge-cache-systems

Log in to edit
  • 67
    total views
  • 3
    total downloads
  • 0
    views this month
  • 0
    downloads this month

Export as

Related outputs

Towards an integrated framework for developing blockchain systems
Fahmideh, Mahdi, Abedin, Babak and Shen, Jun. 2024. "Towards an integrated framework for developing blockchain systems." Decision Support Systems. 180. https://doi.org/10.1016/j.dss.2024.114181
Distributed agent-based deep reinforcement learning for large scale traffic signal control
Wu, Qiang, Wu, Jianqing, Shen, Jun, Du, Bo, Telikani, Akbar, Fahmideh, Mahdi and Liang, Chao. 2024. "Distributed agent-based deep reinforcement learning for large scale traffic signal control ." Knowledge-Based Systems. 241. https://doi.org/10.1016/j.knosys.2022.108304
Formulating Interference-aware Data Delivery Strategies in Edge Storage Systems
Xia, Xiaoyu, Chen, Feifei, He, Qiang, Cui, Guangming, Grundy, John, Abdelrazek, Mohamed and Dong, Fang. 2023. "Formulating Interference-aware Data Delivery Strategies in Edge Storage Systems." 51st International Conference on Parallel Processing (ICPP '22). Bordeaux, France 29 Aug - 01 Sep 2022 United States. Association for Computing Machinery (ACM). https://doi.org/10.1145/3545008.3545078
GraphTune: An Efficient Dependency-Aware Substrate to Alleviate Irregularity in Concurrent Graph Processing
Zhao, Jin, Zhang, Yu, He, Ligang, Li, Qikun, Zhang, Xiang, Jiang, Xinyu, Yu, Hui, Liao, Xiaofei, Jin, Hai, Gu, Lin, Liu, Haikun, He, Bingsheng, Zhang, Ji, Song, Xianzheng, Wang, Lin and Zhou, Jun. 2023. "GraphTune: An Efficient Dependency-Aware Substrate to Alleviate Irregularity in Concurrent Graph Processing." ACM Transactions on Architecture and Code Optimization. 20 (3), pp. 1-24. https://doi.org/10.1145/3600091
EGraph: Efficient Concurrent GPU-Based Dynamic Graph Processing
Zhang, Yu, Liang, Yuxuan, Zhao, Jin, Mao, Fubing, Gu, Lin, Liao, Xiaofei, Jin, Hai, Liu, Haikun, Guo, Song, Zeng, Yangqing, Hu, Hang, Li, Chen, Zhang, Ji and Wang, Biao. 2023. "EGraph: Efficient Concurrent GPU-Based Dynamic Graph Processing." IEEE Transactions on Knowledge and Data Engineering. 35 (6), pp. 5823-5836. https://doi.org/10.1109/TKDE.2022.3171588
An efficient hardware accelerator for monotonic graph algorithms on dynamic directed graphs
Yang, Yun, Yu, Hui, Zhao, Jin, Zhang, Yu, Liao, Xiaofei, Jiang, Xinyu, Jin, Hai, Liu, Haikun, Mao, Fubing, Zhang, Ji and Wang, Biao. 2023. "An efficient hardware accelerator for monotonic graph algorithms on dynamic directed graphs." Scientia Sinica Informationis. 53 (8), pp. 1575-1592. https://doi.org/10.1360/SSI-2022-0191
TreeNet Based Fast Task Decomposition for Resource-Constrained Edge Intelligence
Lu, Dong, Zhai, Yanlong, Shen, Jun, Fahmideh, Mahdi, Wu, Jianqing, Tchaye-Kondi, Jude and Zhu, Liehuang. 2023. "TreeNet Based Fast Task Decomposition for Resource-Constrained Edge Intelligence." IEEE Transactions on Services Computing. 16 (3), pp. 2254-2266. https://doi.org/10.1109/TSC.2022.3187118
Engineering Blockchain-based Software Systems: Foundations, Survey, and Future Directions
Fahmideh, Mahdi, Grundy, John, Ahmad, Aakash, Shen, Jun, Yan, Jun, Mougouei, Davoud, Wang, Peng, Ghose, Aditya, Gunawardana, Anuradha, Aickelin, Uwe and Abedin, Babak. 2023. "Engineering Blockchain-based Software Systems: Foundations, Survey, and Future Directions ." ACM Computing Surveys. 55 (6), pp. 1-44. https://doi.org/10.1145/3530813
Feasibility Analysis of Data Transmission in Partially Damaged IoT Networks of Vehicles
Wei, Wei, Shen, Jun, Telikani, Akbar, Fahmideh, Mahdi and Gao, Wei. 2023. "Feasibility Analysis of Data Transmission in Partially Damaged IoT Networks of Vehicles ." IEEE Transactions on Intelligent Transportation Systems. 24 (4), pp. 4577-4588. https://doi.org/10.1109/TITS.2022.3190668
Data Caching Optimization in the Edge Computing Environment
Liu, Ying, He, Qiang, Zheng, Dequan, Xia, Xiaoyu, Chen, Feifei and Zhang, Bin. 2022. "Data Caching Optimization in the Edge Computing Environment." IEEE Transactions on Services Computing. 15 (4), pp. 2074-2085. https://doi.org/10.1109/TSC.2020.3032724
Spatial-Temporal Edge User Allocation: An Expectation Confirmation Perspective Approach
Zou, Guobing, Xu, Zhiwei, Xia, Xiaoyu, Liu, Ya, Gan, Yanglan, Zhang, Bofeng, Zhou, Min and He, Qiang. 2022. "Spatial-Temporal Edge User Allocation: An Expectation Confirmation Perspective Approach." IEEE Transactions on Network and Service Management. 19 (4), pp. 4918-4931. https://doi.org/10.1109/TNSM.2022.3193088
Auction-Promoted Trading for Multiple Federated Learning Services in UAV-Aided Networks
Cheng, Zhipeng, Liwang, Minghui, Xia, Xiaoyu, Min, Minghui, Wang, Xianbin and Du, Xiaojiang. 2022. "Auction-Promoted Trading for Multiple Federated Learning Services in UAV-Aided Networks." IEEE Transactions on Vehicular Technology. 71 (10), pp. 10960 - 10974. https://doi.org/10.1109/TVT.2022.3184026
Cost-Effective Edge Server Network Design in Mobile Edge Computing Environment
Luo, Ruikun, Jin, Hai, He, Qiang, Wu, Song and Xia, Xiaoyu. 2022. "Cost-Effective Edge Server Network Design in Mobile Edge Computing Environment." IEEE Transactions on Sustainable Computing. 7 (4), pp. 839-850. https://doi.org/10.1109/TSUSC.2022.3178661
Cost-Effective Data Placement in Edge Storage Systems with Erasure Code
Jin, Hai, Luo, Ruikun, He, Qiang, Wu, Song, Zeng, Zilai and Xia, Xiaoyu. 2022. "Cost-Effective Data Placement in Edge Storage Systems with Erasure Code." IEEE Transactions on Services Computing. 16 (2), pp. 1039-1050. https://doi.org/10.1109/TSC.2022.3152849
Data Caching Optimization With Fairness in Mobile Edge Computing
Zhou, Jingwen, Chen, Feifei, He, Qiang, Xia, Xiaoyu, Wang, Rui and Xiang, Yong. 2023. "Data Caching Optimization With Fairness in Mobile Edge Computing." IEEE Transactions on Services Computing. 16 (3), pp. 1750 - 1762. https://doi.org/10.1109/TSC.2022.3197881
A model-driven approach to reengineering processes in cloud computing
Fahmideh, Mahdi, Grundy, John, Beydoun, Ghassan, Zowghi, Didar, Susilo, Willy and Mougouei, Davoud. 2022. "A model-driven approach to reengineering processes in cloud computing." Information and Software Technology. 144. https://doi.org/10.1016/j.infsof.2021.106795
Interference-Aware SaaS User Allocation Game for Edge Computing
Cui, Guangming, He, Qiang, Xia, Xiaoyu, Lai, Phu, Chen, Feifei, Gu, Tao and Yang, Yun. 2022. "Interference-Aware SaaS User Allocation Game for Edge Computing." IEEE Transactions on Cloud Computing. 10 (3), pp. 1888-1899. https://doi.org/10.1109/TCC.2020.3008448
READ: Robustness-Oriented Edge Application Deployment in Edge Computing Environment
Li, Bo, He, Qiang, Cui, Guangming, Xia, Xiaoyu, Chen, Feifei, Jin, Hai and Yang, Yun. 2022. "READ: Robustness-Oriented Edge Application Deployment in Edge Computing Environment." IEEE Transactions on Services Computing. 15 (3), pp. 1746-1759. https://doi.org/10.1109/TSC.2020.3015316
Data, User and Power Allocations for Caching in Multi-Access Edge Computing
Xia, Xiaoyu, Chen, Feifei, He, Qiang, Cui, Guangming, Grundy, John C., Abdelrazek, Mohamed, Xu, Xiaolong and Jin, Hai. 2022. "Data, User and Power Allocations for Caching in Multi-Access Edge Computing." IEEE Transactions on Parallel and Distributed Systems. 33 (5), pp. 1144-1155. https://doi.org/10.1109/TPDS.2021.3104241
Older Persons’ and Their Caregivers’ Perspectives and Experiences of Research Participation With Impaired Decision-Making Capacity: A Scoping Review
Hosie, Annmarie, Kochovska, Slavica, Ries, Nola, Gilmore, Imelda, Parker, Deborah, Sinclair, Craig, Sheehan, Caitlin, Collier, Aileen, Caplan, Gideon A., Visser, Mandy, Xu, Xiaoyue, Lobb, Elizabeth, Sheahan, Linda, Brown, Linda, Lee, Wei, Sanderson, Christine R., Amgarth-Duff, Ingrid, Green, Anna, Edwards, Layla and Agar, Meera R.. 2022. "Older Persons’ and Their Caregivers’ Perspectives and Experiences of Research Participation With Impaired Decision-Making Capacity: A Scoping Review." The Gerontologist. 62 (2), pp. e112-e122. https://doi.org/10.1093/geront/gnaa118
Software Engineering for Internet of Things: The Practitioners’ Perspective
Fahmideh, Mahdi, Ahmad, Aakash, Behnaz, Ali, Grundy, John and Susilo, Willy. 2022. "Software Engineering for Internet of Things: The Practitioners’ Perspective." IEEE Transactions on Software Engineering. 48 (8), pp. 2857-2878. https://doi.org/10.1109/TSE.2021.3070692
An efficient storage system towards high throughput of concurrent graph processing jobs
Zhao, Jin, Jiang, Xinyu, Zhang, Yu, Zhu, Xiaofei, Jin, Hai, Liu, Haikun, Yang, Yun, Zhang, Ji, Wang, Biao and Yu, Ting. 2022. "An efficient storage system towards high throughput of concurrent graph processing jobs." Scientia Sinica Informationis. 52 (1), pp. 111-128.
Blockchain Developments and Innovations – An Analytical Evaluation of Software Engineering Approaches
Fahmideh, Mahdi, Gunawardana, Anuradha, Chen, Shiping, Shen, Jun and Yecies, Brian. 2022. "Blockchain Developments and Innovations – An Analytical Evaluation of Software Engineering Approaches ." 2021 International Conference on Internet of Things (ICIOT 2021) . Online 10 - 14 Dec 2021 Switzerland . Springer. https://doi.org/10.1007/978-3-030-96068-1_5
Data Privacy and System Security for Banking and Financial Services Industry based on Cloud Computing Infrastructure
Mahalle, Abhishek, Yong, Jianming, Tao, Xiaohui and Shen, Jun. 2018. "Data Privacy and System Security for Banking and Financial Services Industry based on Cloud Computing Infrastructure." 2018 IEEE 22nd International Conference on Computer Supported Cooperative Work in Design. Nanjing, China 09 - 11 May 2018 United States. https://doi.org/10.1109/CSCWD.2018.8465318
Data Fusion for MaaS: Opportunities and Challenges
Wu, Jianqing, Zhou, Luping, Cai, Chen, Shen, Jun, Lau, Sim Kim and Yong, Jianming. 2018. "Data Fusion for MaaS: Opportunities and Challenges." 2018 IEEE 22nd International Conference on Computer Supported Cooperative Work in Design. Nanjing, China 09 - 11 May 2018 United States. https://doi.org/10.1109/CSCWD.2018.8465224
A Comprehensive Framework for Analyzing IoT Platforms: A Smart City Industrial Experience
Fahmideh, Mahdi, Yan, Jun, Shen, Jun, Mougouei, Davoud, Zhai, Yanlong and Ahmad, Aakash. 2021. "A Comprehensive Framework for Analyzing IoT Platforms: A Smart City Industrial Experience ." Smart Cities. 4 (2), pp. 588-622. https://doi.org/10.3390/smartcities4020031
MLaaS: a cloud-based system for delivering adaptive micro learning in mobile MOOC learning
Sun, Geng, Cui, Tingru, Yong, Jianming, Shen, Jun and Chen, Shiping. 2018. "MLaaS: a cloud-based system for delivering adaptive micro learning in mobile MOOC learning." IEEE Transactions on Services Computing. 11 (2), pp. 292-305. https://doi.org/10.1109/TSC.2015.2473854
A High Availability Application Service Platform for nuclear power enterprises
Sun, Zhe, Jin, He, Yong, Jianming, Al-Ismaili, Salim, Li, Changyin and Shen, Jun. 2016. "A High Availability Application Service Platform for nuclear power enterprises." 20th IEEE International Conference on Computer Supported Cooperative Work in Design (CSCWD 2016). Nanchang, China 04 - 06 May 2016 United States. https://doi.org/10.1109/CSCWD.2016.7566060
A local field correlated and Monte Carlo based shallow neural network model for nonlinear time series prediction
Zhou, Qingguo, Chen, Huaming, Zhao, Hong, Zhang, Gaofeng, Yong, Jianming and Shen, Jun. 2016. "A local field correlated and Monte Carlo based shallow neural network model for nonlinear time series prediction." EAI Endorsed Transactions on Scalable Information Systems. 16 (8), pp. 1-7. https://doi.org/10.4108/eai.9-8-2016.151634
Drawing micro learning into MOOC: using fragmented pieces of time to enable effective entire course learning experiences
Sun, Geng, Cui, Tingru, Shen, Jun, Yong, Jianming and Chen, Shiping. 2015. "Drawing micro learning into MOOC: using fragmented pieces of time to enable effective entire course learning experiences." Fortino, Giancarlo, Shen, Weiming, Barthes, Jean-Paul, Luo, Junzhou, Li, Wenfeng, Ochoa, Sergio, Abel, Marie-Helene, Guerrieri, Antonio and Ramos, Milton (ed.) 19th IEEE International Conference on Computer Supported Cooperative Work in Design (CSCWD 2015). Calabria, Italy 06 - 08 May 2015 https://doi.org/10.1109/CSCWD.2015.7230977
Evaluations of heuristic algorithms for teamwork-enhanced task allocation in mobile cloud-based learning
Sun, Geng, Shen, Jun, Luo, Junzhou and Yong, Jianming. 2013. "Evaluations of heuristic algorithms for teamwork-enhanced task allocation in mobile cloud-based learning ." Shen, Weiming, Li, Weidong, Barthes, Jean-Paul, Luo, Junzhou, Zhu, Haibin, Yong, Jianming and Li, Xiaoping (ed.) IEEE 17th International Conference on Computer Supported Cooperative Work in Design (CSCWD 2013). Whistler, Canada 27 - 29 Jun 2013 Piscataway, NJ. United States. https://doi.org/10.1109/CSCWD.2013.6580979
A paradigm shift in student experience: creating interconnections between student services, curriculum and technologies into a seamless place of learning
Kek, Megan and Grundy, John. 2013. "A paradigm shift in student experience: creating interconnections between student services, curriculum and technologies into a seamless place of learning." ATEM Student Service Centres Conference (SSCC 2013): Are We Truly Student-Centred?. Canberra, Australia 01 - 03 May 2013 Sydney, Australia.
A novel approach to data deduplication over the engineering-oriented cloud systems
Sun, Zhe, Shen, Jun and Yong, Jianming. 2013. "A novel approach to data deduplication over the engineering-oriented cloud systems ." Integrated Computer Aided Engineering. 20 (1), pp. 45-57. https://doi.org/10.3233/ICA-120418
A survey on bio-inspired algorithms for web service composition
Wang, Lijuan, Shen, Jun and Yong, Jianming. 2012. "A survey on bio-inspired algorithms for web service composition ." Gao, Liang, Shen, Weiming, Barthes, Jean-Paul and Luo, Junzhou (ed.) CSCWD 2012: 16th International Conference on Computer Supported Cooperative Work in Design. Wuhan, China 23 - 25 May 2012 Piscataway, NJ. United States. https://doi.org/10.1109/CSCWD.2012.6221875
A light weight approach for ontology generation and change synchronization between ontologies and source relational databases
Ahmed, Waqas, Aslam, Muhammad Ahtisham, Shen, Jun and Yong, Jianming. 2011. "A light weight approach for ontology generation and change synchronization between ontologies and source relational databases." Shen, Weiming, Barthes, Jean-Paul, Luo, Junzhou, Kropf, Peter, Pouly, Michel and Yong, Jianming (ed.) CSCWD 2011: 15th International Conference on Computer Supported Cooperative Work in Design. Lausanne, Switzerland 08 - 10 Jun 2011 Piscataway, NJ. United States. https://doi.org/10.1109/CSCWD.2011.5960076
DeDu: building a deduplication storage system over cloud computing
Sun, Zhe, Shen, Jun and Yong, Jianming. 2011. "DeDu: building a deduplication storage system over cloud computing." Shen, Weiming, Barthes, Jean-Paul, Luo, Junzhou and Kropf, Peter (ed.) CSCWD 2011: 15th International Conference on Computer Supported Cooperative Work in Design. Lausanne, Switzerland 08 - 10 Jun 2011 Piscataway, NJ. United States. https://doi.org/10.1109/CSCWD.2011.5960097
Web service management system for bioinformatics research: a case study
Xu, Kai, Yu, Qi, Liu, Qing, Zhang, Ji and Bouguettaya, Athman. 2011. "Web service management system for bioinformatics research: a case study." Service Oriented Computing and Applications. 5 (1), pp. 1-15. https://doi.org/10.1007/s11761-011-0076-9
Bio-SENSE: semantic web services for bioinformatics provenance
Bouguettaya, Athman, Hepburn, Mark, Liu, Qing, Xu, Kai and Zhang, Ji. 2008. "Bio-SENSE: semantic web services for bioinformatics provenance." Bird, Trevor (ed.) 2008 CSIRO ICT Centre Conference. Sydney, Australia 20 - 21 Nov 2008 Sydney, Australia.
Bio-Sense: a system for supporting sharing and exploration in bioinformatics using semantic web services
Bouguettaya, Athman, Hepburn, Mark, Liu, Qing, Xu, Kai and Zhang, Ji. 2008. "Bio-Sense: a system for supporting sharing and exploration in bioinformatics using semantic web services." 4th IEEE International Conference on eScience (eScience'08). Indianapolis, United States 10 - 12 Dec 2009 New York, United States.