Stochastic Long-Term Energy Optimization in Digital Twin-Assisted Heterogeneous Edge Networks
Authors: 
Yingsheng Peng, Jingpu Duan, Jinbei Zhang, Weichao Li, Yong Liu, Fuli JiangAuthors Info & Claims
Pages 3157 - 3171
Abstract
Mobile edge computing (MEC) and digital twin (DT) technologies have been recognized as key enabling factors for the next generation of industrial Internet of Things (IoT) applications. In existing works, DT-assisted edge network resource optimization solutions mostly focus on short-term performance optimization, and long-term resource optimization has not been well studied. Thus, this paper introduces a digital twin-assisted heterogeneous edge network (DTHEN), aiming to minimize long-term energy consumption by jointly optimizing transmit power and computing resource. To solve the stochastic optimization problem, we propose a long-term queue-aware energy minimization (LQEM) scheme for joint communication and computing resource management. The proposed scheme uses Lyapunov optimization to transform the original problem with long-term time constraints into a deterministic upper bound problem for each time slot, decouples it into three independent sub-problems, and solves each sub-problem separately. We then theoretically prove the asymptotic optimality of the LQEM scheme and the tradeoff between system energy consumption and task queue backlog. Finally, experimental results verify the performance analysis of the LQEM scheme, demonstrating its superiority over several benchmark schemes, and reveal the impact of various parameters on the system.
References
[1]
L. P. Qian, B. Shi, Y. Wu, B. Sun, and D. H. K. Tsang, “NOMA-enabled mobile edge computing for Internet of Things via joint communication and computation resource allocations,” IEEE Internet Things J., vol. 7, no. 1, pp. 718–733, Jan. 2020.
[2]
Y. Mao, C. You, J. Zhang, K. Huang, and K. B. Letaief, “A survey on mobile edge computing: The communication perspective,” IEEE Commun. Surveys Tuts., vol. 19, no. 4, pp. 2322–2358, 4th Quart., 2017.
[3]
S. Barbarossa, S. Sardellitti, and P. Di Lorenzo, “Communicating while computing: Distributed mobile cloud computing over 5G heterogeneous networks,” IEEE Signal Process. Mag., vol. 31, no. 6, pp. 45–55, Nov. 2014.
[4]
A. Mahmood, Y. Hong, M. K. Ehsan, and S. Mumtaz, “Optimal resource allocation and task segmentation in IoT enabled mobile edge cloud,” IEEE Trans. Veh. Technol., vol. 70, no. 12, pp. 13294–13303, Dec. 2021.
[5]
J. Liu et al., “RL/DRL meets vehicular task offloading using edge and vehicular cloudlet: A survey,” IEEE Internet Things J., vol. 9, no. 11, pp. 8315–8338, Jun. 2022.
[6]
Y. Zhang, M. A. Kishk, and M.-S. Alouini, “Computation offloading and service caching in heterogeneous MEC wireless networks,” IEEE Trans. Mobile Comput., vol. 22, no. 6, pp. 3241–3256, Jun. 2023.
[7]
C. Park and J. Lee, “Mobile edge computing-enabled heterogeneous networks,” IEEE Trans. Wireless Commun., vol. 20, no. 2, pp. 1038–1051, Feb. 2021.
[8]
Y. He, M. Yang, Z. He, and M. Guizani, “Resource allocation based on digital twin-enabled federated learning framework in heterogeneous cellular network,” IEEE Trans. Veh. Technol., vol. 72, no. 1, pp. 1149–1158, Jan. 2023.
[9]
Y. Dai, D. Xu, S. Maharjan, and Y. Zhang, “Joint computation offloading and user association in multi-task mobile edge computing,” IEEE Trans. Veh. Technol., vol. 67, no. 12, pp. 12313–12325, Dec. 2018.
[10]
A. Zhu, S. Guo, B. Liu, M. Ma, J. Yao, and X. Su, “Adaptive multiservice heterogeneous network selection scheme in mobile edge computing,” IEEE Internet Things J., vol. 6, no. 4, pp. 6862–6875, Aug. 2019.
[11]
E. El Haber, T. M. Nguyen, C. Assi, and W. Ajib, “Macro-cell assisted task offloading in MEC-based heterogeneous networks with wireless backhaul,” IEEE Trans. Netw. Service Manage., vol. 16, no. 4, pp. 1754–1767, Dec. 2019.
[12]
Y. Mao, J. Zhang, S. H. Song, and K. B. Letaief, “Stochastic joint radio and computational resource management for multi-user mobile-edge computing systems,” IEEE Trans. Wireless Commun., vol. 16, no. 9, pp. 5994–6009, Sep. 2017.
[13]
W. Sun, H. Zhang, R. Wang, and Y. Zhang, “Reducing offloading latency for digital twin edge networks in 6G,” IEEE Trans. Veh. Technol., vol. 69, no. 10, pp. 12240–12251, Oct. 2020.
[14]
T. Do-Duy, D. Van Huynh, O. A. Dobre, B. Canberk, and T. Q. Duong, “Digital twin-aided intelligent offloading with edge selection in mobile edge computing,” IEEE Wireless Commun. Lett., vol. 11, no. 4, pp. 806–810, Apr. 2022.
[15]
D. Van Huynh et al., “URLLC edge networks with joint optimal user association, task offloading and resource allocation: A digital twin approach,” IEEE Trans. Commun., vol. 70, no. 11, pp. 7669–7682, Nov. 2022.
[16]
T. Liu, L. Tang, W. Wang, Q. Chen, and X. Zeng, “Digital-twin-assisted task offloading based on edge collaboration in the digital twin edge network,” IEEE Internet Things J., vol. 9, no. 2, pp. 1427–1444, Jan. 2022.
[17]
B. Li, Y. Liu, L. Tan, H. Pan, and Y. Zhang, “Digital twin assisted task offloading for aerial edge computing and networks,” IEEE Trans. Veh. Technol., vol. 71, no. 10, pp. 10863–10877, Oct. 2022.
[18]
M. J. Neely, “Stochastic network optimization with application to communication and queueing systems,” Synth. Lectures Commun. Netw., vol. 3, no. 1, pp. 1–211, Jan. 2010.
[19]
X. Chen, W. Ni, T. Chen, I. B. Collings, X. Wang, and G. B. Giannakis, “Real-time energy trading and future planning for fifth generation wireless communications,” IEEE Wireless Commun., vol. 24, no. 4, pp. 24–30, Aug. 2017.
[20]
Y. Wang, W. Wang, V. K. N. Lau, T. Nakachi, and Z. Zhang, “Stochastic resource allocation and delay analysis for mobile edge computing systems,” IEEE Trans. Commun., vol. 71, no. 7, pp. 4018–4033, Jul. 2023.
[21]
M. Merluzzi, N. D. Pietro, P. Di Lorenzo, E. C. Strinati, and S. Barbarossa, “Discontinuous computation offloading for energy-efficient mobile edge computing,” IEEE Trans. Green Commun. Netw., vol. 6, no. 2, pp. 1242–1257, Jun. 2022.
[22]
Y. Xu, G. Gui, H. Gacanin, and F. Adachi, “A survey on resource allocation for 5G heterogeneous networks: Current research, future trends, and challenges,” IEEE Commun. Surveys Tuts., vol. 23, no. 2, pp. 668–695, 2nd Quart., 2021.
[23]
D. Shi, F. Tian, and S. Wu, “Energy efficiency optimization in heterogeneous networks based on deep reinforcement learning,” in Proc. IEEE Int. Conf. Commun. Workshops (ICC Workshops), Jun. 2020, pp. 1–6.
[24]
W. Fan et al., “Joint task offloading and service caching for multi-access edge computing in WiFi-cellular heterogeneous networks,” IEEE Trans. Wireless Commun., vol. 21, no. 11, pp. 9653–9667, Nov. 2022.
[25]
Y. Lan, X. Wang, D. Wang, Y. Zhang, and W. Wang, “Mobile-edge computation offloading and resource allocation in heterogeneous wireless networks,” in Proc. IEEE Wireless Commun. Netw. Conf. (WCNC), Apr. 2019, pp. 1–6.
[26]
J. Zhang, W. Xia, F. Yan, and L. Shen, “Joint computation offloading and resource allocation optimization in heterogeneous networks with mobile edge computing,” IEEE Access, vol. 6, pp. 19324–19337, 2018.
[27]
Y. Wu, K. Zhang, and Y. Zhang, “Digital twin networks: A survey,” IEEE Internet Things J., vol. 8, no. 18, pp. 13789–13804, Sep. 2021.
[28]
L. Zhao, G. Han, Z. Li, and L. Shu, “Intelligent digital twin-based software-defined vehicular networks,” IEEE Netw., vol. 34, no. 5, pp. 178–184, Sep. 2020.
[29]
Q. Guo, F. Tang, and N. Kato, “Federated reinforcement learning-based resource allocation for D2D-aided digital twin edge networks in 6G industrial IoT,” IEEE Trans. Ind. Informat., vol. 19, no. 5, pp. 7228–7236, May 2023.
[30]
X. Yuan, J. Chen, N. Zhang, J. Ni, F. R. Yu, and V. C. M. Leung, “Digital twin-driven vehicular task offloading and IRS configuration in the Internet of Vehicles,” IEEE Trans. Intell. Transp. Syst., vol. 23, no. 12, pp. 24290–24304, Dec. 2022.
[31]
Y. Hao, J. Wang, D. Huo, N. Guizani, L. Hu, and M. Chen, “Digital twin-assisted URLLC-enabled task offloading in mobile edge network via robust combinatorial optimization,” IEEE J. Sel. Areas Commun., vol. 41, no. 10, pp. 3022–3033, Oct. 2023.
[32]
J. Mei, L. Dai, Z. Tong, X. Deng, and K. Li, “Throughput-aware dynamic task offloading under resource constant for MEC with energy harvesting devices,” IEEE Trans. Netw. Service Manag., vol. 20, no. 3, pp. 3460–3473, Sep. 2023.
[33]
Y. Chen, N. Zhang, Y. Zhang, X. Chen, W. Wu, and X. Shen, “Energy efficient dynamic offloading in mobile edge computing for Internet of Things,” IEEE Trans. Cloud Comput., vol. 9, no. 3, pp. 1050–1060, Jul. 2021.
[34]
Z. Tong, J. Cai, J. Mei, K. Li, and K. Li, “Dynamic energy-saving offloading strategy guided by Lyapunov optimization for IoT devices,” IEEE Internet Things J., vol. 9, no. 20, pp. 19903–19915, Oct. 2022.
[35]
H. Wu, J. Chen, T. N. Nguyen, and H. Tang, “Lyapunov-guided delay-aware energy efficient offloading in IIoT-MEC systems,” IEEE Trans. Ind. Informat., vol. 19, no. 2, pp. 2117–2128, Feb. 2023.
[36]
H. Li, K. D. R. Assis, S. Yan, and D. Simeonidou, “DRL-based long-term resource planning for task offloading policies in multiserver edge computing networks,” IEEE Trans. Netw. Service Manage., vol. 19, no. 4, pp. 4151–4164, Dec. 2022.
[37]
S. Bi, L. Huang, H. Wang, and Y. A. Zhang, “Lyapunov-guided deep reinforcement learning for stable online computation offloading in mobile-edge computing networks,” IEEE Trans. Wireless Commun., vol. 20, no. 11, pp. 7519–7537, Nov. 2021.
[38]
T. M. Cover and J. A. Thomas, Elements of Information Theory. Hoboken, NJ, USA: Wiley, 1999.
[39]
C. You, K. Huang, H. Chae, and B.-H. Kim, “Energy-efficient resource allocation for mobile-edge computation offloading,” IEEE Trans. Wireless Commun., vol. 16, no. 3, pp. 1397–1411, Mar. 2017.
[40]
D. Huang, P. Wang, and D. Niyato, “A dynamic offloading algorithm for mobile computing,” IEEE Trans. Wireless Commun., vol. 11, no. 6, pp. 1991–1995, Jun. 2012.
[41]
Y. Ge, Y. Zhang, Q. Qiu, and Y.-H. Lu, “A game theoretic resource allocation for overall energy minimization in mobile cloud computing system,” in Proc. ACM/IEEE Int. Symp. Low Power Electron. Design, Jul. 2012, pp. 279–284.
[42]
K. Shen and W. Yu, “Fractional programming for communication systems—Part I: Power control and beamforming,” IEEE Trans. Signal Process., vol. 66, no. 10, pp. 2616–2630, May 2018.
[43]
S. M. Ross, Introduction to Probability Models. Cambridge, MA, USA: Academic Press, 2014.
[44]
W. Li, M.-L. Ku, Y. Chen, and K. J. Ray Liu, “On outage probability for two-way relay networks with stochastic energy harvesting,” IEEE Trans. Commun., vol. 64, no. 5, pp. 1901–1915, May 2016.
[45]
R. Dong, C. She, W. Hardjawana, Y. Li, and B. Vucetic, “Deep learning for hybrid 5G services in mobile edge computing systems: Learn from a digital twin,” IEEE Trans. Wireless Commun., vol. 18, no. 10, pp. 4692–4707, Oct. 2019.
[46]
C. Qiu, Y. Hu, Y. Chen, and B. Zeng, “Lyapunov optimization for energy harvesting wireless sensor communications,” IEEE Internet Things J., vol. 5, no. 3, pp. 1947–1956, Jun. 2018.
Index Terms
- Stochastic Long-Term Energy Optimization in Digital Twin-Assisted Heterogeneous Edge Networks
Index terms have been assigned to the content through auto-classification.
Recommendations
Energy-efficiency optimization for heterogeneous computing-assisted NOMA-MEC edge AI tasks
AbstractEdge artificial intelligence (AI) is an emerging paradigm that leverages edge computing to pave the last-mile delivery of AI. To satisfy the increasing demand for high-performance computing and low latency of edge service, heterogeneous computing ...
Improved binary marine predator algorithm-based digital twin-assisted edge-computing offloading method
AbstractA vast number of mobile internet-of-things (IoT) devices are connected to the internet, and they constantly generate new computing tasks. Owing to an IoT device’s limited resources and restricted computing power, heavy computing tasks are ...
Highlights- A new digital twin-assisted edge-computing plan for improved IoT device efficiency.
- A binary-enabled MPA that supports binary finds the offloading solution.
- A real time twin interaction process that accounts for delays caused by ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
0733-8716 © 2024 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See https://www.ieee.org/publications/rights/index.html for more information.
Publisher
IEEE Press
Publication History
Published: 22 July 2024
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 24 Nov 2024
Other Metrics
Citations
View Options
View options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in