Nothing Special   »   [go: up one dir, main page]

Skip to main content

Mobility Management in Low Altitude Heterogeneous Networks Using Reinforcement Learning Algorithm

  • Conference paper
  • First Online:
Space Information Network (SINC 2020)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1353))

Included in the following conference series:

  • 487 Accesses

Abstract

Unmanned aerial vehicle (UAV) base station has been proposed as a promising solution in emergency communication and supplementary communication for terrestrial networks due to its flexible layout and good mobility support. However, the dense deployment of UAV base station and ground base station brings great challenges in the configuration of neighbor cell list (NCL) during handover process. This paper presents a Cascading Bandits based Mobility Management (CBMM) algorithm for NCL configuration in the low altitude heterogeneous networks, where online learning is used to exploiting the historical handover information. In addition to the received signal strength, the cell load of each base station is also considered in the handover procedure. We aim at optimizing the configuration of NCL, so as to improve handover performance by increasing the probability of selecting the best target base station while at the same time reducing the selection delay. It is proved that the signaling overhead can be effectively reduced, since the proposed CBMM algorithm can significantly cut down the number of candidate base stations in NCL. Moreover, by ranking the candidate base stations according to their historical performance, the number of measured base stations in handover preparation phase can be effectively reduced to avoid extra delay. The simulation results of the proposed algorithm and other two existing solutions are presented to illustrate that the CBMM algorithm can achieve efficient handover management.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Lu, J., Wan, S., Chen, X., Fan, P.: Energy-efficient 3D UAV-BS placement versus mobile users' density and circuit power. In: 2017 IEEE Globecom Workshops (GC Wkshps), Singapore, pp. 1–6 (2017)

    Google Scholar 

  2. Cicek, C.T., Gultekin, H., Tavli, B., Yanikomeroglu, H.: UAV Base station location optimization for next generation wireless networks: overview and future research directions. In: 2019 1st International Conference on Unmanned Vehicle Systems-Oman (UVS), Muscat, Oman, pp. 1–6 (201)

    Google Scholar 

  3. Lai, C., Chen, C., Wang, L.: On-demand density-aware UAV base station 3D placement for arbitrarily distributed users with guaranteed data rates. IEEE Wirel. Commun. Lett. 8(3), 913–916 (2019)

    Article  Google Scholar 

  4. Alzenad, M., El-Keyi, A., Lagum, F., Yanikomeroglu, H.: 3-D placement of an unmanned aerial vehicle base station (UAV-BS) for energy-efficient maximal coverage. IEEE Wirel. Commun. Lett. 6(4), 434–437 (2017)

    Article  Google Scholar 

  5. Yin, S., Zhao, S., Zhao, Y., Yu, F.R.: Intelligent trajectory design in UAV-aided communications with reinforcement learning. IEEE Trans. Veh. Technol. 68(8), 8227–8231 (2019)

    Article  Google Scholar 

  6. Xiao, Z., Dong, H., Bai, L., Wu, D.O., Xia, X.: Unmanned aerial vehicle base station (UAV-BS) deployment with millimeter-wave beamforming. IEEE Internet Things J. 7(2), 1336–1349 (2020)

    Article  Google Scholar 

  7. 3GPP, Evolved Universal Terrestrial Radio Access (E-UTRA) User Equipment (UE) Procedures in idle Mode Version 15.3.0 Release 15, May 2019

    Google Scholar 

  8. Sharma, V., Bennis, M., Kumar, R.: UAV-assisted heterogeneous networks for capacity enhancement. IEEE Commun. Lett. 20(6), 1207–1210 (2016)

    Article  Google Scholar 

  9. Lv, Z., et al.: Neighbor cell list optimization of LTE based on MR. In: 2018 International Conference on Signal and Information Processing, Networking And Computers, Singapore, pp. 290–295 (2018)

    Google Scholar 

  10. Chowdhury, M.Z., Bui, M.T., Jang, Y.M.: Neighbor cell list optimization for femtocell-to-femtocell Handover in dense femtocellular networks. In: 2011 Third International Conference on Ubiquitous and Future Networks (ICUFN), Dalian, pp. 241–245 (2011)

    Google Scholar 

  11. Watanabe, Y., Matsunaga, Y., Kobayashi, K., Sugahara, H., Hamabe, K.: Dynamic neighbor cell list management for handover optimization in LTE. In: 2011 IEEE 73rd Vehicular Technology Conference (VTC Spring), Budapest, Hungary, pp. 1–5 (2011)

    Google Scholar 

  12. Yang, H., Hu, B., Wang, L.: A deep learning based handover mechanism for UAV networks. In: 2017 20th International Symposium on Wireless Personal Multimedia Communications (WPMC), Bali, pp. 380-384 (2017)

    Google Scholar 

  13. Shen, C., Tekin, C., van der Schaar, M.: A non-stochastic learning approach to energy efficient mobility management. IEEE J. Sel. Areas Commun. 34(12), 3854–3868 (2016)

    Article  Google Scholar 

  14. Wang, C., Yang, J., He, H., Zhou, R., Chen, S., Jiang, X.: Neighbor cell list optimization in handover management using cascading bandits algorithm. IEEE Access 8, 134137–134150 (2020)

    Article  Google Scholar 

  15. 3GPP TS 23.502. Procedures for the 5G System; Stage 2 (2019)

    Google Scholar 

  16. Telecommunication management; Configuration Management (CM); Notification Integration Reference Point (IRP); Requirements (2015)

    Google Scholar 

  17. Al-Hourani, A., Kandeepan, S., Lardner, S.: Optimal LAP altitude for maximum coverage. IEEE Wirel. Commun. Lett. 3(6), 569–572 (2014)

    Article  Google Scholar 

  18. Becvar, Z., Mach, P., Vondra, M.: Self-optimizing neighbor cell list with dynamic threshold for handover purposes in networks with small cells. Wirel. Commun. Mobile Comput. 15, 1729–1743 (2015)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Huasen He .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hou, Y., Wang, C., He, H., Yang, J. (2021). Mobility Management in Low Altitude Heterogeneous Networks Using Reinforcement Learning Algorithm. In: Yu, Q. (eds) Space Information Network. SINC 2020. Communications in Computer and Information Science, vol 1353. Springer, Singapore. https://doi.org/10.1007/978-981-16-1967-0_9

Download citation

  • DOI: https://doi.org/10.1007/978-981-16-1967-0_9

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-16-1966-3

  • Online ISBN: 978-981-16-1967-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics