Abstract
Heterogeneous cells have been emerged as the dominant design approach for the deployment of 5G wireless networks . In this context, inter-cell interferences are expected to drastically affect the 5G targets, especially in terms of throughput experienced by the mobile users. This work proposes a novel Deep Reinforcement Learning (DRL) scheme, targeting at minimizing the difference between the allocated and requested user throughput through power regulation . The developed algorithm is employed in heterogeneous cells that are controlled in a centralized manner and validated for 5G-compliant channel models. First, the proposed learning framework of the DRL method is presented, mainly including the stabilization of the learning-related hyperparameters. Then, the DRL method is evaluated for several simulation scenarios and compared to well-established optimization methods for power allocation, namely the Water-filling and Weighted Minimum Mean Squared Error (WMMSE) algorithms, as well as a fixed power control scheme. The evaluation outcomes demonstrate the ability of the DRL framework in accurately approaching the user requirements, whereas the Water-filling and WMMSE solutions present large deviations from the user demands since they aim at the total network-wide throughput maximization.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Andrews, J.G., et al.: What will 5G be? IEEE J. Sel. Areas Commun. 32, 1065–1082 (2014)
Trakadas, P., et al.: Hybrid clouds for data-intensive, 5G-enabled iot applications: an overview, key issues and relevant architecture. Sensors 19, 3591 (2019)
Trakadas, P., et al.: Comparison of management and orchestration solutions for the 5G era. J. Sens. Actuator Netw. 9, 4 (2020)
Calabrese, F.D., Wang, L., Ghadimi, E., Peters, G., Hanzo, L., Soldati, P.: Learning radio resource management in RANs: framework, opportunities, and challenges. IEEE Commun. Mag. 56, 138–145 (2018)
Morocho-Cayamcela, M.E., Lee, H., Lim, W.: Machine learning for 5G/B5G mobile and wireless communications: potential, limitations, and future directions. IEEE Access 7, 137184–137206 (2019)
Qi, Q., Minturn, A., Yang, Y.: An efficient water-filling algorithm for power allocation in OFDM-based cognitive radio systems. In: 2012 International Conference on Systems and Informatics, ICSAI 2012, pp. 2069–2073 (2012)
Shi, Q., Razaviyayn, M., Luo, Z.Q., He, C.: An iteratively weighted MMSE approach to distributed sum-utility maximization for a MIMO interfering broadcast channel. IEEE Trans. Sig. Process. 59, 4331–4340 (2011)
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (2018)
Zhang, C., Patras, P., Haddadi, H.: Deep learning in mobile and wireless networking: a survey. IEEE Commun. Surv. Tutor. 21, 2224–2287 (2019)
Balevi, E., Andrews, J.G.: A novel deep reinforcement learning algorithm for online antenna tuning. In: 2019 IEEE Global Communications Conference, GLOBECOM 2019 - Proceedings (2019)
Zhang, Y., Kang, C., Ma, T., Teng, Y., Guo, D.: Power allocation in multi-cell networks using deep reinforcement learning. In: IEEE Vehicular Technology Conference (2018)
Zhao, N., Liang, Y.C., Niyato, D., Pei, Y., Wu, M., Jiang, Y.: Deep reinforcement learning for user association and resource allocation in heterogeneous cellular networks. IEEE Trans. Wirel. Commun. 5141–5152 (2019)
Nasir, Y.S., Guo, D.: Multi-agent deep reinforcement learning for dynamic power allocation in wireless networks. IEEE J. Sel. Areas Commun. 37, 2239–2250 (2019)
Lei, L., Yuan, D., Ho, C.K., Sun, S.: Joint optimization of power and channel allocation with non-orthogonal multiple access for 5G cellular systems (2016)
Xu, Z., Wang, Y., Tang, J., Wang, J., Gursoy, M.C.: A deep reinforcement learning based framework for power-efficient resource allocation in cloud RANs. In: IEEE International Conference on Communications (2017)
Amiri, R., Mehrpouyan, H., Fridman, L., Mallik, R.K., Nallanathan, A., Matolak, D.: A machine learning approach for power allocation in HetNets considering QoS. In: IEEE International Conference on Communications (2018)
Zhang, M., Chen, M.: Power allocation in multi-cell system using distributed deep neural network algorithm. In: International Conference on Wireless and Mobile Computing, Networking and Communications. IEEE Computer Society (2019)
Zhao, G., Li, Y., Xu, C., Han, Z., Xing, Y., Yu, S.: Joint power control and channel allocation for interference mitigation based on reinforcement learning. IEEE Access 7, 177254–177265 (2019)
Palomar, D.P., Chiang, M.: Alternative distributed algorithms for network utility maximization: framework and applications. IEEE Trans. Automat. Contr. 52, 2254–2269 (2007)
Tang, M., Long, C., Guan, X.: Nonconvex optimization for power control in wireless CDMA networks. Wirel. Pers. Commun. 58, 851–865 (2011)
3GPP: Study on channel model for frequencies from 0.5 to 100 GHz. Technical report (TR) 38.901, 3rd Generation Partnership Project (2017)
Acknowledgment
This work has been partially supported by the Affordable5G project, funded by the European Commission under Grant Agreement H2020-ICT-2020–1, number 957317 through the Horizon 2020 and 5G-PPP programs (www.affordable5g.eu/).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 IFIP International Federation for Information Processing
About this paper
Cite this paper
Giannopoulos, A., Spantideas, S., Tsinos, C., Trakadas, P. (2021). Power Control in 5G Heterogeneous Cells Considering User Demands Using Deep Reinforcement Learning. In: Maglogiannis, I., Macintyre, J., Iliadis, L. (eds) Artificial Intelligence Applications and Innovations. AIAI 2021 IFIP WG 12.5 International Workshops. AIAI 2021. IFIP Advances in Information and Communication Technology, vol 628. Springer, Cham. https://doi.org/10.1007/978-3-030-79157-5_9
Download citation
DOI: https://doi.org/10.1007/978-3-030-79157-5_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-79156-8
Online ISBN: 978-3-030-79157-5
eBook Packages: Computer ScienceComputer Science (R0)