Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

A multi-agent federated reinforcement learning-based optimization of quality of service in various LoRa network slices

Published: 27 February 2024 Publication History

Abstract

The innovations heralded through the implementation of next-generation 5G (Fifth-Generation) networks provide an opportunity for the efficient coexistence of heterogeneous services distributed by a single physical virtualized infrastructure. Indeed, thanks to the possibility of virtualization of network functions implemented in 5G networks, the management of physical resources will be able to become more flexible and users will be able to benefit from a service customization to satisfy their demand in terms of energy efficiency, throughput and communication reliability. However, these advances are not without constraints. The management of physical and virtual resources will become more complex given the number of connected objects which will increase, generating a large volume of data to manage. This therefore requires the implementation of much more intelligent systems in the network controllers in order to guarantee the QoS (Quality of Service) of the communications. Thus, an important axis of research is now oriented towards artificial intelligence techniques, more precisely reinforcement learning to overcome this problem. Driven by this context, we are directing our research towards improving the QoS offered to users of connected objects by proposing an optimization model based on network slicing and federated reinforcement learning in order to minimize energy consumption, maximize user throughputs and reduce latency during communications between LoRa (Long Range) devices. The results obtained by the simulations carried out in a realistic framework clearly demonstrate that our proposal optimizes the traffic in each network slice and also for the individual user.

References

[1]
Dawaliby Samir, Bradai Abbas, Pousset Yannis, Adaptive dynamic network slicing in LoRa networks, Future Gener. Comput. Syst. 98 (2019) 697–707.
[2]
Wijethilaka Shalitha, Liyanage Madhusanka, Survey on network slicing for Internet of Things realization in 5G networks, IEEE Commun. Surv. Tutor. 23 (2) (2021) 957–994.
[3]
Kazmi S.M. Ahsan, Khan Latif U., Tran Nguyen H., Hong Choong Seon, Network Slicing for 5G and Beyond Networks, Vol. 1, Springer, 2019.
[4]
Aijaz Adnan, Hap-SliceR : A radio resource slicing framework for 5G networks with haptic communications, IEEE Syst. J. 12 (3) (2017) 2285–2296.
[5]
Bor Martin C., Roedig Utz, Voigt Thiemo, Alonso Juan M., Do LoRa low-power wide-area networks scale?, in: Proceedings of the 19th ACM International Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems, 2016, pp. 59–67.
[6]
OSSONGO Eric, Resource allocation with deep federated learning, 2022, https://github.com/ericossongo/Resource-Allocation-with-Deep-Federated-Learning.html. Accessed: 2022-04-12.
[7]
Du Ping, Nakao Akihiro, Deep learning-based application specific RAN slicing for mobile networks, in: 2018 IEEE 7th International Conference on Cloud Networking (CloudNet), IEEE, 2018, pp. 1–3.
[8]
Wu Huanzhuo, Tsokalo Ievgenii A., Kuss David, Salah Hani, Pingel Lukas, Fitzek Frank H.P., Demonstration of network slicing for flexible conditional monitoring in industrial IoT networks, in: 2019 16th IEEE Annual Consumer Communications & Networking Conference (CCNC), IEEE, 2019, pp. 1–2.
[9]
Ni Jianbing, Lin Xiaodong, Shen Xuemin Sherman, Efficient and secure service-oriented authentication supporting network slicing for 5G-enabled IoT, IEEE J. Sel. Areas Commun. 36 (3) (2018) 644–657.
[10]
Kalør Anders Ellersgaard, Guillaume René, Nielsen Jimmy Jessen, Mueller Andreas, Popovski Petar, Network slicing for ultra-reliable low latency communication in industry 4.0 scenarios, 2017, arXiv preprint arXiv:1708.09132.
[11]
Messaoud Seifeddine, Bradai Abbas, Ahmed Olfa Ben, Quang Pham Tran Anh, Atri Mohamed, Hossain M. Shamim, Deep federated q-learning-based network slicing for industrial iot, IEEE Trans. Ind. Inform. 17 (8) (2020) 5572–5582.
[12]
Messaoud Seifeddine, Bradai Abbas, Moulay Emmanuel, Online GMM clustering and mini-batch gradient descent based optimization for industrial IoT 4.0, IEEE Trans. Ind. Inform. 16 (2) (2020) 1427–1435.
[13]
Zheng Jingjing, Li Kai, Mhaisen Naram, Ni Wei, Tovar Eduardo, Guizani Mohsen, Exploring deep-reinforcement-learning-assisted federated learning for online resource allocation in privacy-preserving EdgeIoT, IEEE Internet Things J. 9 (21) (2022) 21099–21110.
[14]
Thantharate Anurag, Paropkari Rahul, Walunj Vijay, Beard Cory, DeepSlice: A deep learning approach towards an efficient and reliable network slicing in 5G networks, in: 2019 IEEE 10th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON), IEEE, 2019, pp. 0762–0767.
[15]
Kafle Ved P., Fukushima Yusuke, Martinez-Julia Pedro, Miyazawa Takaya, Harai Hiroaki, Adaptive virtual network slices for diverse IoT services, IEEE Commun. Stand. Mag. 2 (4) (2018) 33–41.
[16]
Khan Latif U., Pandey Shashi Raj, Tran Nguyen H., Saad Walid, Han Zhu, Nguyen Minh N.H., Hong Choong Seon, Federated learning for edge networks: Resource optimization and incentive mechanism, IEEE Commun. Mag. 58 (10) (2020) 88–93.
[17]
Park Gyubong, Lee Wooyeob, Joe Inwhee, Network resource optimization with reinforcement learning for low power wide area networks, EURASIP J. Wireless Commun. Networking 2020 (1) (2020) 1–20.
[18]
Raza Muhammad Rehan, Natalino Carlos, Öhlen Peter, Wosinska Lena, Monti Paolo, Reinforcement learning for slicing in a 5G flexible RAN, J. Lightwave Technol. 37 (20) (2019) 5161–5169.
[19]
Augustin Aloÿs, Yi Jiazi, Clausen Thomas, Townsley William Mark, A study of LoRa: Long range & low power networks for the internet of things, Sensors 16 (9) (2016) 1466.
[20]
Navarro-Ortiz Jorge, Sendra Sandra, Ameigeiras Pablo, Lopez-Soler Juan M., Integration of LoRaWAN and 4G/5G for the industrial internet of things, IEEE Commun. Mag. 56 (2) (2018) 60–67.
[21]
Pocs Mate, Beginner’s guide to custom environments in OpenAI’s Gym, 2021, https://towardsdatascience.com/beginners-guide-to-custom-environments-in-openai-s-gym-989371673952.html. Accessed: 2021-07-02.
[22]
Alliance LoRa, Regional parameters for Europe, 2023, https://www.thethingsnetwork.org/docs/lorawan/regional-parameters.html. Accessed: 2023-04-10.

Index Terms

  1. A multi-agent federated reinforcement learning-based optimization of quality of service in various LoRa network slices
              Index terms have been assigned to the content through auto-classification.

              Recommendations

              Comments

              Please enable JavaScript to view thecomments powered by Disqus.

              Information & Contributors

              Information

              Published In

              cover image Computer Communications
              Computer Communications  Volume 213, Issue C
              Jan 2024
              383 pages

              Publisher

              Elsevier Science Publishers B. V.

              Netherlands

              Publication History

              Published: 27 February 2024

              Author Tags

              1. Deep learning
              2. Federated reinforcement learning
              3. IoT
              4. LoRa
              5. LoRaWAN
              6. Network slicing
              7. NFV
              8. QoS
              9. SDN

              Qualifiers

              • Research-article

              Contributors

              Other Metrics

              Bibliometrics & Citations

              Bibliometrics

              Article Metrics

              • 0
                Total Citations
              • 0
                Total Downloads
              • Downloads (Last 12 months)0
              • Downloads (Last 6 weeks)0
              Reflects downloads up to 30 Sep 2024

              Other Metrics

              Citations

              View Options

              View options

              Get Access

              Login options

              Media

              Figures

              Other

              Tables

              Share

              Share

              Share this Publication link

              Share on social media