Abstract
In recent years, with the large-scale deployment of 5G network, research on 6G networks has gradually begun. In the 6G era, new service scenarios, such as Broad Coverage and High Latency Communication (BCHLC) will be introduced into the network, further increasing the complexity of network management. Furthermore, the development of edge computing and microservice architectures enables services to be deployed in a container on the edge clouds closer to the user side, significantly solving the problems. However, how to deploy services on edge clouds with limited resources is still an unresolved problem. In this paper, we model the problem as a Markov Decision Process (MDP), then propose a Deep Q Learning (DQN) based service deployment algorithm to optimize the delay and deployment cost of the services. Furthermore, a Multi-Category Joint Optimization Transfer Learning (MCJOTL) algorithm is proposed in this paper to address the problem of slow convergence of the DQN algorithm, which can adapt to different service scenarios in future networks faster. The simulation results show that the proposed algorithm can effectively improve training efficiency and service deployment effects.
Supported by the National Key R&D Program of China under Grant 2020YFB1806702.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Tomkos, I., Klonidis, D., Pikasis, E., Theodoridis, S.: Toward the 6G network era. Opportunities and challenges. IT Prof. 22(1), 34–38 (2020)
Wang, H.: 6G vision: unified network enabling intelligent megalopolis. ZTE Technol. J. 25(06), 55–58 (2019)
Guo, T., Zhang, H., Huang, H., Guo, J., He, C.: Multi-resource fair allocation for composited services in edge micro-clouds. In: 2019 IEEE International Conference on Parallel & Distributed Processing with Applications, Big Data & Cloud Computing, Sustainable Computing & Communications, Social Computing & Networking (ISPA/BDCloud/SocialCom/SustainCom), Xiamen, pp. 405–412 (2019)
Wang, S., Guo, Y., Zhang, N., Yang, P., Zhou, A., Shen, X.: Delay-aware microservice coordination in mobile edge computing: a reinforcement learning approach. IEEE Trans. Mob. Comput. 20(3), 939–951 (2021)
Badri, H., Bahreini, T., Grosu, D., Yang, K.: A sample average approximation-based parallel algorithm for application placement in edge computing systems. In: 2018 IEEE International Conference on Cloud Engineering (IC2E), Orlando, pp. 198–203 (2018)
Nguyen, T., Huh, E., Jo, M.: Decentralized and revised content-centric networking-based service deployment and discovery platform in mobile edge computing for IoT devices. IEEE Internet Things J. 6(3), 4162–4175 (2019)
Guo, S., Dai, Y., Xu, S., Qiu, X., Qi, F.: Trusted cloud-edge network resource management: DRL-driven service function chain orchestration for IoT. IEEE Internet Things J. 7(2), 6010–6022 (2020)
Wang, X., Xu, Y., Chen, J., Li, C., Xu, Y.: 2020 International Conference on Wireless Communications and Signal Processing (WCSP), pp. 195–200, Nanjing (2020)
Liu, L., Niyato, D., Wang, P., Han, Z.: Scalable traffic management for mobile cloud services in 5G networks. IEEE Trans. Netw. Serv. Manag. 15(4), 1560–1570 (2018)
Samanta, A., Tang, J.: Dyme: dynamic microservice scheduling in edge computing enabled IoT. IEEE Internet Things J. 7(7), 6164–6174 (2020)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Li, W., Liu, B., Gao, H., Su, X. (2022). Transfer Learning Based Algorithm for Service Deployment Under Microservice Architecture. In: Gao, H., Wun, J., Yin, J., Shen, F., Shen, Y., Yu, J. (eds) Communications and Networking. ChinaCom 2021. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 433. Springer, Cham. https://doi.org/10.1007/978-3-030-99200-2_5
Download citation
DOI: https://doi.org/10.1007/978-3-030-99200-2_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-99199-9
Online ISBN: 978-3-030-99200-2
eBook Packages: Computer ScienceComputer Science (R0)