Abstract
With the explosive growth of electronic information technology, mobile devices generate massive amounts of data and requirements, which poses a significant challenge to mobile devices with limited computing and battery capacity. Task offloading can transfer computing-intensive tasks from resource-constrained mobile devices to resource-rich servers, thereby significantly reducing the consumption of task execution. How to optimize the task offloading strategy in complex environments with multi-layers and multi-devices to improve efficiency becomes a challenge for the task offloading problem. We optimize the vertical assignment of tasks in a multi-layer system using deep reinforcement learning algorithms, which encompass the cloud, edge, and device layers. To balance the load among multiple devices, we employ the KNN algorithm. Subsequently, we introduce a task state discrimination method based on fuzzy control theory to enhance the performance of computing nodes under high load conditions. By optimizing task offloading policies and execution orders, we successfully reduce the average task execution time and energy consumption of mobile devices. We implemented the proposed algorithm in the PureEdgeSim simulator and performed simulations using different device densities to verify the algorithm’s scalability. The simulation results show that the method we proposed outperforms the methods in previous work. Our method can significantly improve performance in high-device density scenarios.
Similar content being viewed by others
Data availability
No datasets were generated or analysed during the current study.
References
Wang Y, Tao X, Zhang X, Zhang P, Hou YT (2019) Cooperative task offloading in three-tier mobile computing networks: an admm framework. IEEE Trans Veh Technol 68:2763–2776
Gao Z, Hao W, Yang S (2022) Joint offloading and resource allocation for multi-user multi-edge collaborative computing system. IEEE Trans Veh Technol 71:3383–3388
Yao Z, Xia S, Li Y, Wu G (2023) Cooperative task offloading and service caching for digital twin edge networks: A graph attention multi-agent reinforcement learning approach. IEEE J Sel Areas Commun
Liu J, Guo S, Wang Q, Pan C, Yang L (2023) Optimal multi-user offloading with resources allocation in mobile edge cloud computing. Comput Netw 221:109522
Munoz O, Pascual-Iserte A, Vidal J (2015) Optimization of radio and computational resources for energy efficiency in latency-constrained application offloading. IEEE Trans Veh Technol 64:4738–4755
Li Q, Tang B, Li J, Chen S (2023) User satisfaction-based energy-saving computation offloading in fog computing networks. J Supercomput
Chraibi A, Alla SB, Touhafi A, Ezzati A (2023) A novel dynamic multi-objective task scheduling optimization based on dueling dqn and per. J Supercomput 79:21368–21423
Xia S, Yao Z, Li Y, Xing Z, Mao S (2023) Distributed computing and networking coordination for task offloading under uncertainties. IEEE Trans Mobile Comput
Mahenge MPJ, Li C, Sanga CA (2022) Energy-efficient task offloading strategy in mobile edge computing for resource-intensive mobile applications. Digital Commun Netw 8:1048–1058
Tao M, Li X, Ota K, Dong M (2024) Single-cell multiuser computation offloading in dynamic pricing-aided mobile edge computing. IEEE Trans Comput Soc Syst 11:3004–3014
Li K, Wang X, He Q, Yang M, Huang M, Dustdar S (2023) Task computation offloading for multi-access edge computing via attention communication deep reinforcement learning. IEEE Trans Serv Comput 16:2985–2999
Zafar MH, Khan I, Alassafi MO (2022) An efficient resource optimization scheme for d2d communication. Digital Commun Netw 8:1122–1129
Zhang J, Chen J, Bao X, Liu C, Yuan P, Zhang X, Wang S (2023) Dependent task offloading mechanism for cloud-edge-device collaboration. J Netw Comput Appl 216:103656
Tang T, Li C, Liu F (2023) Collaborative cloud-edge-end task offloading with task dependency based on deep reinforcement learning. Comput Commun 209:78–90
Liu X, Liu J, Wu H (2021) Energy-efficient task allocation of heterogeneous resources in mobile edge computing. IEEE Access 9:119700–119711
Song S, Ma S, Yang L, Zhao J, Yang F, Zhai L (2022) Delay-sensitive tasks offloading in multi-access edge computing. Expert Syst Appl 198:116730
Xia S, Yao Z, Li Y, Mao S (2021) Online distributed offloading and computing resource management with energy harvesting for heterogeneous mec-enabled iot. IEEE Trans Wireless Commun 20(10):6743–6757
Xu J, Yu H, Fan G, Zhang J, Li Z, Tang Q (2023) Adaptive edge service deployment in burst load scenarios using deep reinforcement learning. J Supercomput
Zhou H, Jiang K, Liu X, Li X, Leung VCM (2022) Deep reinforcement learning for energy-efficient computation offloading in mobile-edge computing. IEEE Internet Things J 9:1517–1530
Sonmez C, Ozgovde A, Ersoy C (2019) Fuzzy workload orchestration for edge computing. TNSM 16:769–782
Robles-Enciso A, Skarmeta AF (2023) A multi-layer guided reinforcement learning-based tasks offloading in edge computing. Comput Netw 220:109476
Afzali M, Samani AMV, Naji HR (2023) An efficient resource allocation of iot requests in hybrid fog-cloud environment. J Supercomput
Feng G, Lv H, Li B, Wang C, Lv H, Wang H (2018) A near-optimal cloud offloading under multi-user multi-radio environments. Peer-to-Peer Netw Appl 12:1454–1465
Kai C, Zhou H, Yi Y, Huang W (2021) Collaborative cloud-edge-end task offloading in mobile-edge computing networks with limited communication capability. IEEE Trans Cognit Commun Netw 7:624–634
Wang J, Wei B, Zhang J, Yu X, Sharma PK (2021) An optimized transaction verification method for trustworthy blockchain-enabled iiot. Ad Hoc Netw 119:102526
Zhang J, Sun Y, Guo D, Luo L, Li L, Nian Q (2024) A reputation awareness randomization consensus mechanism in blockchain systems. IEEE Internet of Things J 1–1
Tao M, Ota K, Dong M, Yuan H (2022) Stackelberg game-based pricing and offloading in mobile edge computing. IEEE Wirel Commun Lett 11:883–887
Zhang LL, Han S, Wei J, Zheng N, Cao T, Yang Y, Liu Y (2021) nn-meter
Teng H, Li Z, Cao K, Long S, Guo S, Liu A (2022) Game theoretical task offloading for profit maximization in mobile edge computing. IEEE Trans Mobile Comput 1–1
Chen Y, Zhao F, Lu Y, Chen X (2023) Dynamic task offloading for mobile edge computing with hybrid energy supply. Tsinghua Sci Technol 28:421–432
Xing H, Liu L, Xu J, Nallanathan A (2019) Joint task assignment and resource allocation for d2d-enabled mobile-edge computing. IEEE Trans Commun 67:4193–4207
Kahn C, Viswanathan H (2015) Connectionless access for mobile cellular networks. Commun Mag IEEE 53(9):26–31
Mnih V, Kavukcuoglu K, Silver D, Rusu AA, Veness J, Bellemare MG, Graves A, Riedmiller M, Fidjeland AK, Ostrovski G (2015) Human-level control through deep reinforcement learning. Nature 518:529–533
Tang M, Wong VWS (2022) Deep reinforcement learning for task offloading in mobile edge computing systems. IEEE Trans Mob Comput 21:1985–1997
Singh N, Das AK (2022) Energy-efficient fuzzy data offloading for iomt. Comput Netw 213:109127
Mechalikh C, Taktak H, Moussa F (2021) Pureedgesim: A simulation framework for performance evaluation of cloud, edge and mist computing environments. Comput Sci Inf Syst 18(1):43–66
Gharehpasha S, Masdari M, Jafarian A (2020) Virtual machine placement in cloud data centers using a hybrid multi-verse optimization algorithm. Artif Intell Rev 54:2221–2257
Wang J, Hu J, Min G, Zomaya AY, Georgalas N (2021) Fast adaptive task offloading in edge computing based on meta reinforcement learning. IEEE Trans Parallel Distrib Syst 32:242–253
Wang J, Chen W, Wang L, Sherratt RS, Alfarraj O, Tolba A (2020) Data secure storage mechanism of sensor networks based on blockchain. Comput Mater Continua 65:2365–2384
Author information
Authors and Affiliations
Contributions
Bowen Ling (first author): He was responsible for this research project's overall design and planning and implemented the experimental design, data collection, and preliminary analysis. Meanwhile, Bowen Ling led the paper's writing, including the introduction's first draft, methods, results and discussion. Xiaohang Deng (corresponding author): provided theoretical guidance and technical support for this project, solved critical problems encountered during the research process, and thoroughly reviewed and revised the final paper's content to ensure the study's scientificity and rigour. Other authors made substantial contributions in their respective fields of specialization, including providing research ideas, assisting in experimental operations, participating in discussions, and providing valuable suggestions and improvements to some chapters of the paper.
Corresponding author
Ethics declarations
Conflict of interests
The authors declare no conflict of interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Ling, B., Deng, X., Huang, Y. et al. Multi-layer collaborative task offloading optimization: balancing competition and cooperation across local edge and cloud resources. J Supercomput 80, 26483–26511 (2024). https://doi.org/10.1007/s11227-024-06448-4
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-024-06448-4