Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

STAR-RIS-aided NOMA communication for mobile edge computing using hybrid deep reinforcement learning

Published: 20 February 2025 Publication History

Abstract

Reconfigurable intelligent surface (RIS) is expected to be able to significantly reduce task processing delay and energy consumptions of mobile users (MUs) in mobile edge computing (MEC) by intelligently adjusting its reflecting elements’ phase-shifts and amplitudes. Nevertheless, both the passive and active RISs have the disadvantage of only reflecting the received signals, which means that the transmitters and receivers must be located on the same side of the RIS. This may be unrealistic due to the movement of MUs. Simultaneously transmitting and reflecting (STAR) RIS, which can simultaneously transmit and reflect incident signals to achieve full-area coverage, has been recognized as a revolutionary technique to solve the above-mentioned problem. For the STAR-RIS-aided non-orthogonal multiple access (NOMA) communication MEC, we first formulate an optimization problem to minimize the sum of weighted delay and energy consumptions of all MUs which can move randomly at low speeds. Then, under the practical coupled phase-shift model of STAR-RIS, we propose a hybrid deep reinforcement learning (DRL) scheme, in which we determine the amplitudes and phase-shifts of STAR-RIS, task offloading decisions of MUs, and computation resource allocations of MEC servers by using the deep deterministic policy gradient (DDPG) and Dueling deep Q learning (DQN). Finally, we validate and evaluate the performances of our proposed scheme through extensive simulations, which show that our proposed scheme outperforms the existing baseline schemes and its performance can indeed be improved due to the use of STAR-RIS.

References

[1]
Y. Liu, Y. Li, Y. Niu, D. Jin, Joint optimization of path planning and resource allocation in mobile edge computing, IEEE Trans. Mob. Comput. 19 (2020) 2129–2144,.
[2]
J. Ren, G. Yu, Y. He, G.Y. Li, Collaborative cloud and edge computing for latency minimization, IEEE Trans. Veh. Technol. 68 (2019) 5031–5044,.
[3]
Z. Luo, G. Huang, Energy-efficient mobile edge computing in RIS-aided OFDM-NOMA relay networks, IEEE Trans. Veh. Technol. 72 (2023) 4654–4669,.
[4]
S. Mao, L. Liu, N. Zhang, M. Dong, J. Zhao, J. Wu, V.C.M. Leung, Reconfigurable intelligent surface-assisted secure mobile edge computing networks, IEEE Trans. Veh. Technol. 71 (2022) 6647–6660,.
[5]
B. Duo, M. He, Q. Wu, Z. Zhang, Joint dual-UAV trajectory and RIS design for ARIS-assisted aerial computing in IoT, IEEE Internet Things J. 10 (2023) 19584–19594,.
[6]
J. Xu, Y. Liu, X. Mu, O.A. Dobre, STAR-RISs: Simultaneous transmitting and reflecting reconfigurable intelligent surfaces, IEEE Commun. Lett. 25 (2021) 3134–3138,.
[7]
X. Mu, Y. Liu, L. Guo, J. Lin, R. Schober, Simultaneously transmitting and reflecting (STAR) RIS aided wireless communications, IEEE Trans. Wirel. Commun. 21 (2022) 3083–3098,.
[8]
X. Qin, Z. Song, T. Hou, W. Yu, J. Wang, X. Sun, Joint resource allocation and configuration design for STAR-RIS-enhanced wireless-powered MEC, IEEE Trans. Commun. 71 (2023) 2381–2395,.
[9]
Z. Liu, Z. Li, M. Wen, Y. Gong, Y.-C. Wu, STAR-RIS-aided mobile edge computing: Computation rate maximization with binary amplitude coefficients, IEEE Trans. Commun. 71 (2023) 4313–4327,.
[10]
J. Zhao, Y. Zhu, X. Mu, K. Cai, Y. Liu, L. Hanzo, Simultaneously transmitting and reflecting reconfigurable intelligent surface (STAR-RIS) assisted UAV communications, IEEE J. Sel. Areas Commun. 40 (2022) 3041–3056,.
[11]
Z. Zhang, Z. Wang, Y. Liu, B. He, L. Lv, J. Chen, Security enhancement for coupled phase-shift STAR-RIS networks, IEEE Trans. Veh. Technol. 72 (2023) 8210–8215,.
[12]
M. Katwe, K. Singh, B. Clerckx, C.-P. Li, Improved spectral efficiency in STAR-RIS aided uplink communication using rate splitting multiple access, IEEE Trans. Wirel. Commun. 22 (2023) 5365–5382,.
[13]
H. Niu, X. Liang, Weighted sum-rate maximization for STAR-RISs-aided networks with coupled phase-shifters, IEEE Syst. J. 17 (2023) 1083–1086,.
[14]
A.A. Al-Habob, O. Waqar, H. Tabassum, Latency minimization in phase-coupled STAR-RIS assisted multi-MEC server systems, in: 2023 IEEE 34th Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC, 2023, pp. 1–7,.
[15]
X. Li, J. Li, Y. Liu, Z. Ding, A. Nallanathan, Residual transceiver hardware impairments on cooperative NOMA networks, IEEE Trans. Wirel. Commun. 19 (2020) 680–695,.
[16]
K. Guo, R. Liu, M. Alazab, R.H. Jhaveri, X. Li, M. Zhu, STAR-RIS-empowered cognitive non-terrestrial vehicle network with NOMA, IEEE Trans. Intell. Veh. 8 (2023) 3735–3749,.
[17]
Q. Zhang, Y. Wang, H. Li, S. Hou, Z. Song, Resource allocation for energy efficient STAR-RIS aided MEC systems, IEEE Wirel. Commun. Lett. 12 (2023) 610–614,.
[18]
V.-T. Truong, D.-B. Ha, T.T. Vu, H.-A. Nguyen, STAR-RIS aided mobile edge computing networks with uplink NOMA scheme, in: 2023 International Conference on Advanced Technologies for Communications, ATC, 2023, pp. 474–479,.
[19]
H. Wen, A.M. Tota Khel, K.A. Hamdi, Phase shift configuration strategies for unbalanced T&R users in STAR-RIS-aided NOMA, IEEE Commun. Lett. 27 (2023) 3404–3408,.
[20]
S. Yang, J. Zhang, W. Xia, H. Gao, H. Zhu, Joint power and discrete amplitude allocation for STAR-RIS-aided NOMA system, IEEE Trans. Veh. Technol. 71 (2022) 13382–13386,.
[21]
Y. Guo, F. Fang, D. Cai, Z. Ding, Energy-efficient design for a NOMA assisted STAR-RIS network with deep reinforcement learning, IEEE Trans. Veh. Technol. 72 (2023) 5424–5428,.
[22]
L. Guo, J. Jia, J. Chen, A. Du, X. Wang, Joint task offloading and resource allocation in STAR-RIS assisted NOMA system, in: 2022 IEEE 96th Vehicular Technology Conference, VTC2022-Fall, 2022, pp. 1–5,.
[23]
R. Zhong, X. Mu, X. Xu, Y. Chen, Y. Liu, STAR-RISs assisted NOMA networks: A tile-based passive beamforming approach, in: 2022 International Symposium on Wireless Communication Systems, ISWCS, 2022, pp. 1–6,.
[24]
G. Chen, Q. Wu, R. Liu, J. Wu, C. Fang, IRS aided MEC systems with binary offloading: A unified framework for dynamic IRS beamforming, IEEE J. Sel. Areas Commun. 41 (2023) 349–365,.
[25]
X. Huang, G. Huang, Joint optimization of energy and task scheduling in wireless-powered IRS-assisted mobile-edge computing systems, IEEE Internet Things J. 10 (2023) 10997–11013,.
[26]
R. Zhong, Y. Liu, X. Mu, Y. Chen, X. Wang, L. Hanzo, Hybrid reinforcement learning for STAR-RISs: A coupled phase-shift model based beamformer, IEEE J. Sel. Areas Commun. 40 (2022) 2556–2569,.
[27]
L. Li, P. Fan, Latency and task loss probability for NOMA assisted MEC in mobility-aware vehicular networks, IEEE Trans. Veh. Technol. 72 (2023) 6891–6895,.
[28]
J. Yan, S. Bi, Y.J.A. Zhang, Offloading and resource allocation with general task graph in mobile edge computing: A deep reinforcement learning approach, IEEE Trans. Wirel. Commun. 19 (2020) 5404–5419,.
[29]
T. Zhang, H. Wen, Y. Jiang, J. Tang, Deep-reinforcement-learning-based IRS for cooperative jamming networks under edge computing, IEEE Internet Things J. 10 (2023) 8996–9006,.
[30]
H. Ke, J. Wang, L. Deng, Y. Ge, H. Wang, Deep reinforcement learning-based adaptive computation offloading for MEC in heterogeneous vehicular networks, IEEE Trans. Veh. Technol. 69 (2020) 7916–7929,.
[31]
N.H. Chu, D.T. Hoang, D.N. Nguyen, N. Van Huynh, E. Dutkiewicz, Joint speed control and energy replenishment optimization for UAV-assisted IoT data collection with deep reinforcement transfer learning, IEEE Internet Things J. 10 (2023) 5778–5793,.
[32]
L. Huang, S. Bi, Y.-J.A. Zhang, Deep reinforcement learning for online computation offloading in wireless powered mobile-edge computing networks, IEEE Trans. Mob. Comput. 19 (2020) 2581–2593,.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Computer Networks: The International Journal of Computer and Telecommunications Networking
Computer Networks: The International Journal of Computer and Telecommunications Networking  Volume 257, Issue C
Feb 2025
1062 pages

Publisher

Elsevier North-Holland, Inc.

United States

Publication History

Published: 20 February 2025

Author Tags

  1. Mobile edge computing
  2. STAR-RIS
  3. NOMA
  4. User mobility
  5. DDPG
  6. Dueling DQN

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 07 Mar 2025

Other Metrics

Citations

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media