KubeTwin: A Digital Twin Framework for Kubernetes Deployments at Scale
Authors: 
Davide Borsatti, Walter Cerroni, Luca Foschini, Genady Ya Grabarnik, Lorenzo Manca, Filippo Poltronieri, Domenico Scotece, Larisa Shwartz, Cesare Stefanelli, Mauro Tortonesi, Mattia ZaccariniAuthors Info & Claims
Pages 3889 - 3903
Abstract
Kubernetes is a well-known orchestration and management solution for complex and large-scale service architectures in the Cloud Continuum. While it provides very valuable functions from the operation perspective, the high number of control loops it implements significantly enlarges the already wide space of configuration parameters and policies to consider for management purposes. We argue that optimizing complex Kubernetes deployments considering a multi-cloud and edge computing environment would significantly benefit from a Digital Twin approach, enabling an accurate virtual representation of a Kubernetes application to optimize its deployment and management policies. Towards that goal, this work illustrates the design of KubeTwin, a framework to implement Digital Twins of Kubernetes deployments. Furthermore, we present a validation of KubeTwin in a Multi-access Edge Computing (MEC) scenario, which shows its soundness in reenacting realistic Digital Twins of complex and highly distributed Kubernetes deployments. We believe that KubeTwin can provide useful guidance to the research community working in this field.
References
[1]
A. Rasheed, O. San, and T. Kvamsdal, “Digital twin: Values, challenges and enablers from a modeling perspective,” IEEE Access, vol. 8, pp. 21980–22012, 2020.
[2]
I. Errandonea, S. Beltrán, and S. Arrizabalaga, “Digital twin for maintenance: A literature review,” Comput. Ind., vol. 123, Dec. 2020, Art. no. [Online]. Available: https://www.sciencedirect.com/ science/article/pii/S0166361520305509
[3]
P. Bellavista, C. Giannelli, M. Mamei, M. Mendula, and M. Picone, “Application-driven network-aware digital twin management in industrial edge environments,” IEEE Trans. Ind. Informat., vol. 17, no. 11, pp. 7791–7801, Nov. 2021.
[4]
L. Zhao, G. Han, Z. Li, and L. Shu, “Intelligent digital twin-based software-defined vehicular networks,” IEEE Netw., vol. 34, no. 5, pp. 178–184, Sep./Oct. 2020.
[5]
M. Balogh, A. Földvári, and P. Varga, “Digital twins in industry 5.0: Challenges in modeling and communication,” in Proc. IEEE/IFIP Netw. Oper. Manage. Symp. (NOMS), 2023, pp. 1–6.
[6]
Y. Wu, K. Zhang, and Y. Zhang, “Digital twin networks: A survey,” IEEE Internet Things J., vol. 8, no. 18, pp. 13789–13804, Sep. 2021.
[7]
W. Cerroni et al., “BDMaaS+: Business-driven and simulation-based optimization of IT services in the hybrid cloud,” IEEE Trans. Netw. Service Manag., vol. 19, no. 1, pp. 322–337, Mar. 2022.
[8]
F. Poltronieri, M. Tortonesi, and C. Stefanelli, “ChaosTwin: A chaos engineering and digital twin approach for the design of resilient IT services,” in Proc. 17th Int. Conf. Netw. Service Manage. (CNSM), 2021, pp. 234–238.
[9]
W. Wang, L. Tang, C. Wang, and Q. Chen, “Real-time analysis of multiple root causes for anomalies assisted by digital twin in NFV environment,” IEEE Trans. Netw. Service Manag., vol. 19, no. 2, pp. 905–921, Jun. 2022.
[10]
M. Zhu, R. Kang, F. He, and E. Oki, “Implementation of backup resource management controller for reliable function allocation in Kubernetes,” in Proc. IEEE 7th Int. Conf. Netw. Softwarization (NetSoft), 2021, pp. 360–362.
[11]
M. Fogli et al.,“Performance evaluation of Kubernetes distributions (K8s, K3s, KubeEdge) in an adaptive and federated cloud infrastructure for disadvantaged tactical networks,” in Proc. Int. Conf. Mil. Commun. Inf. Syst. (ICMCIS), 2021, pp. 1–7.
[12]
D. Borsatti et al., “Modeling digital twins of Kubernetes-based applications,” in Proc. 28th IEEE Symp. Comput. Commun. (ISCC), 2023, pp. 219–224.
[13]
“Multi-access edge computing (MEC); use cases and requirements; version 2.2.1,” ETSI Sophia Antipolis, France, Rep. GS MEC 002, 2022. [Online]. Available: https://www.etsi.org/deliver/etsi_gs/MEC/001_099/ 002/02.02.01_60/gs_MEC002v020201p.pdf
[14]
“Multi-access edge computing (MEC); framework and reference architecture,” ETSI Sophia Antipolis, France, Rep. GS MEC003, 2022. [Online]. Available: ``https://www.etsi.org/deliver/etsi_gs/MEC/ 001_099/003/02.02.01_60/gs_mec003v020201p.pdf
[15]
M. Fogli, C. Giannelli, F. Poltronieri, C. Stefanelli, and M. Tortonesi, “Chaos engineering for resilience assessment of digital twins,” IEEE Trans. Ind. Informat., vol. 20, no. 2, pp. 1134–1143, Feb. 2024.
[16]
S. Tuli, G. Casale, and N. R. Jennings, “DRAGON: Decentralized fault tolerance in edge federations,” IEEE Trans. Netw. Service Manag., vol. 20, no. 1, pp. 276–291, Mar. 2023.
[17]
L. Manca et al., “Characterization of microservice response time in Kubernetes: A mixture density network approach,” in Proc. 19th Int. Conf. Netw. Service Manage. (CNSM), 2023, pp. 1–9.
[18]
E. J. Ghomi, A. M. Rahmani, and N. N. Qader, “Applying queue theory for modeling of cloud computing: A systematic review,” Concurr. Comput. Pract. Exp, vol. 31, no. 17, 2019, Art. no. [Online]. Available: https://onlinelibrary.wiley.com/doi/abs/10.1002/cpe.5186
[19]
“Kubernetes: Scheduling framework.,” Accessed: Jan. 11, 2022. [Online]. Available: https://kubernetes.io/docs/concepts/scheduling-eviction/scheduling-framework/
[20]
C. Carrión, “Kubernetes scheduling: Taxonomy, ongoing issues and challenges,” ACM Comput. Surv., vol. 55, pp. 1–37, Dec. 2022. [Online]. Available: https://doi.org/10.1145/3539606
[21]
“Kubernetes: Horizontal pod Autoscaling.,” Accessed: Jan. 11, 2022. [Online]. Available: https://kubernetes.io/docs/tasks/run-application/horizontal-pod-autoscale/
[22]
Q.-V. Pham et al., “A survey of multi-access edge computing in 5G and beyond: Fundamentals, technology integration, and state-of-the-art,” IEEE Access, vol. 8, pp. 116974–117017, 2020.
[23]
“Sharpening the edge: Overview of the LF edge taxonomy and framework,” Linux Found., San Francisco, CA, USA, White paper, Accessed: Jan. 26, 2022. [Online]. Available: https://www. lfedge.org/resources/publications/
[24]
R. Sinha, C. Papadopoulos, and J. Heidemann, “Internet packet size distributions: Some observations,” Univ. Southern California, Los Angeles, CA, USA, Rep. ISI-TR-2007-643, May 2007. [Online]. Available: https://ant.isi.edu/simjohnh/PAPERS/Sinha07a.pdf
[25]
T. Subramanya and R. Riggio, “Centralized and federated learning for predictive VNF Autoscaling in multi-domain 5G networks and beyond,” IEEE Trans. Netw. Service Manag., vol. 18, no. 1, pp. 63–78, Mar. 2021.
[26]
I. Martínez-Casanueva, L. Bellido, C. Lentisco and D. Fernández, “An initial approach to a multi-access edge computing reference architecture implementation using Kubernetes,” in Broadband Communications, Networks, and Systems (Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering), vol. 355, Cham, Switzerland: Springer, 2021, pp. 185–193.
[27]
S. R. Chaudhry, A. Palade, A. Kazmi, and S. Clarke, “Improved QoS at the edge using serverless computing to deploy virtual network functions,” IEEE Internet Things J., vol. 7, no. 10, pp. 10673–10683, Oct. 2020.
[28]
J. Santos, T. Wauters, B. Volckaert, and F. De Turck, “Towards delay-aware container-based service function chaining in fog computing,” in Proc. IEEE/IFIP Netw. Oper. Manage. Symp. (NOMS), 2020, pp. 1–9.
[29]
M. Scazzariello, L. Ariemma, G. D. Battista, and M. Patrignani, “Megalos: A scalable architecture for the Virtualization of network scenarios,” in Proc. IEEE/IFIP Netw. Oper. Manage. Symp. (NOMS), 2020, pp. 1–7.
[30]
F. Ghirardini, A. Samir, I. Fronza, and C. Pahl, “Model-driven simulation for performance engineering of Kubernetes-style cloud cluster architectures,” Commun. Comput. Inf. Sci., vol. 1115, pp. 7–20, Dec. 2020.
[31]
M. G. Khan, J. Taheri, A. Al-dulaimy, and A. Kassler, “PerfSim: A performance simulator for cloud native microservice chains,” IEEE Trans. Cloud Comput., vol. 11, no. 2, pp. 1395–1413, Apr.–Jun. 2023.
[32]
“WS4—1st international workshop on technologies for network twins (TNT 2022),” presented at IEEE/IFIP Netw. Oper. Manag. Symp. (NOMS), Budapest, Hungary, Apr. 2022. [Online]. Available: https://noms2022.ieee-noms.org/ws4-1st-international-workshop-technologies-network-twins-tnt-2022
[33]
Z. Zhang, Y. Zeng, H. Liu, C. Zhao, F. Wang, and Y. Chen, “Smart DC: An AI and digital twin-based energy-saving solution for data centers,” in Proc. IEEE/IFIP Netw. Oper. Manag. Symp. (NOMS), 2022, pp. 1–6.
[34]
C. von Lengerke, A. Hefele, J. Cabrera, and F. Fitzek, “Stopping the data flood: Post-Shannon traffic reduction in digital-twins applications,” in Proc. 1st Int. Workshop Technol. Netw. Twins (TNT), 2022, pp. 1–5.
[35]
F. Poltronieri, M. Tortonesi, and C. Stefanelli, “A chaos engineering approach for improving the resiliency of IT services configurations,” in Proc. IEEE/IFIP Netw. Oper. Manag. Symp. (NOMS), 2022, pp. 1–6.
[36]
M. Polverini, I. Germini, A. Cianfrani, F. G. Lavacca, and M. Listanti, “A digital twin based framework to enable ``what-if,” analysis in BGP optimization,'' in Proc. IEEE/IFIP Netw. Oper. Manage. Symp. (NOMS), 2023, pp. 1–6.
[37]
P. Krämer, P. Diederich, C. Krämer, R. Pries, W. Kellerer, and A. Blenk, “D2A: Operating a service function chain platform with data-driven scheduling policies,” IEEE Trans. Netw. Service Manag., vol. 19, no. 3, pp. 2839–2853, Sep. 2022.
[38]
M. Groshev, C. Guimarães, A. De La Oliva, and R. Gazda, “Dissecting the impact of information and communication technologies on digital twins as a service,” IEEE Access, vol. 9, pp. 102862–102876, 2021.
[39]
F. Laamarti, H. F. Badawi, Y. Ding, F. Arafsha, B. Hafidh, and A. E. Saddik, “An ISO/IEEE 11073 Standardized digital twin framework for health and well-being in smart cities,” IEEE Access, vol. 8, pp. 105950–105961, 2020.
[40]
S. H. Khajavi, N. H. Motlagh, A. Jaribion, L. C. Werner, and J. Holmström, “Digital twin: Vision, benefits, boundaries, and creation for buildings,” IEEE Access, vol. 7, pp. 147406–147419, 2019.
[41]
Y. Liu et al., “A novel cloud-based framework for the elderly healthcare services using digital twin,” IEEE Access, vol. 7, pp. 49088–49101, 2019.
[42]
K. M. Alam and A. El Saddik, “C2PS: A digital twin architecture reference model for the cloud-based cyber-physical systems,” IEEE Access, vol. 5, pp. 2050–2062, 2017.
[43]
Q. Qi and F. Tao, “A smart manufacturing service system based on edge computing, fog computing, and cloud computing,” IEEE Access, vol. 7, pp. 86769–86777, 2019.
Index Terms
- KubeTwin: A Digital Twin Framework for Kubernetes Deployments at Scale
Index terms have been assigned to the content through auto-classification.
Recommendations
A Scalable Framework for Provisioning Large-Scale IoT Deployments
Internet of Things (IoT) devices are usually considered external application dependencies that only provide data or process and execute simple instructions. The recent emergence of IoT devices with embedded execution environments allows practitioners to ...
Self managing monitoring for highly elastic large scale cloud deployments
DIDC '14: Proceedings of the sixth international workshop on Data intensive distributed computingInfrastructure as a Service computing exhibits a number of properties, which are not found in conventional server deployments. Elasticity is among the most significant of these properties which has wide reaching implications for applications deployed in ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
1932-4537 © 2024 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See https://www.ieee.org/publications/rights/index.html for more information.
Publisher
IEEE Press
Publication History
Published: 01 August 2024
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 08 Mar 2025