Abstract
Cloud computing provides utility computing in which clients pay the cost according to their demands and service use. There are some challenges to this technology. One of these issues in data centers is virtual machine (VM) placement so that mapping of these VMs to hosts is executed for a variety of objectives such as load balancing, reducing energy consumption, increasing resource utilization, shortening response time, etc. In this paper, a strategy is presented based on machine learning for VM replacement which aims to balance the load in host machines (HM). In this proposed strategy, the learning agent, in each learning episode by selecting an action from among the permissible actions and executing it on the environment receives a reward according to the desirability of the solution obtained by doing that action in the environment. Receiving a reward from the environment and updating the action value table enable the learner agent to learn in the following episodes that in each environment state, selecting and executing which action is better in the environment and this leads to further enhancement. Our proposed algorithm has, on average, improved the inter-HM load balance in terms of processor, memory, and bandwidth by 25%, 34%, and 32%, respectively, prior to the implementation of the algorithm. Our strategy was compared from diffrent aspects in three scenarios to the MOVMrB strategy. Finally, it was concluded that our proposed algorithm can be more effective in load balancing by having much less runtime and turning off more HMs.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Li Y, Li W, Jiang C (2010) In: 2010 Third international symposium on electronic commerce and security, pp 332–336. https://doi.org/10.1109/ISECS.2010.80
Li R, Zheng Q, Li X, Yan Z (2017) Multi-objective optimization for rebalancing virtual machine placement. Future Gener Comput Syst. https://doi.org/10.1016/j.future.2017.08.027. http://www.sciencedirect.com/science/article/pii/S0167739X1731840X
Zheng Q, Li R, Li X, Shah N, Zhang J, Tian F, Chao KM, Li J (2016) Virtual machine consolidated placement based on multi-objective biogeography-based optimization. Future Gener Comput Syst 54:95. https://doi.org/10.1016/j.future.2015.02.010. http://www.sciencedirect.com/science/article/pii/S0167739X15000564
Masdari M, Nabavi SS, Ahmadi V (2016) An overview of virtual machine placement schemes in cloud computing. J Netw Comput Appl 66:106. https://doi.org/10.1016/j.jnca.2016.01.011. http://www.sciencedirect.com/science/article/pii/S1084804516000291
Sayeedkhan PN, Balaji S (2014) Virtual machine placement based on disk I/O load in cloud. (IJCSIT) Int J Comput Sci Inf Technol 5:5477
Wang S-H, Huang PP, Wen CH, Wang L (2014) In: The international conference on information networking 2014 (ICOIN2014), pp 220–225. https://doi.org/10.1109/ICOIN.2014.6799695
Fang W, Liang X, Li S, Chiaraviglio L, Xiong N (2013) VMPlanner: optimizing virtual machine placement and traffic flow routing to reduce network power costs in cloud data centers. Comput Netw 57(1):179. https://doi.org/10.1016/j.comnet.2012.09.008. http://www.sciencedirect.com/science/article/pii/S1389128612003301
Li X, Qian Z, Lu S, Wu J (2013) Energy efficient virtual machine placement algorithm with balanced and improved resource utilization in a data center. Math Comput Modell 58(5):1222. https://doi.org/10.1016/j.mcm.2013.02.003. http://www.sciencedirect.com/science/article/pii/S0895717713000319. The measurement of undesirable outputs: models development and empirical analyses and advances in mobile, ubiquitous and cognitive computing
Yapicioglu T, Oktug S, In: Proceedings of the 2013 IEEE/ACM 6th international conference on utility and cloud computing (IEEE Computer Society, Washington, DC, USA, 2013), UCC ’13, pp 299–301. https://doi.org/10.1109/UCC.2013.62
Pires L, Barán B (2017) Many-objective virtual machine placement. J Grid Comput 15:161–176. https://doi.org/10.1007/s10723-017-9399-x
Fu X, Zhou C (2017) Predicted affinity based virtual machine placement in cloud computing environments. IEEE Trans Cloud Comput. https://doi.org/10.1109/TCC.2017.2737624
Gao Y, Guan H, Qi Z, Hou Y, Liu L (2013) A multi-objective ant colony system algorithm for virtual machine placement in cloud computing. J Comput Syst Sci 79(8):1230. https://doi.org/10.1016/j.jcss.2013.02.004. http://www.sciencedirect.com/science/article/pii/S0022000013000627
Kang DJ, Hong-bo WANG, Yang-yang L, Shi-duan C (2013) Virtual machine placement optimizing to improve network performance in cloud data centers. J China Univ Posts Telecommun 21:62. https://doi.org/10.1016/S1005-8885(14)60302-2. www.sciencedirect.com/science/journal/10058885
Thiruvenkadam T, Teklu T (2018) In: International conference on intelligent data communication technologies and Internet of Things (ICICI) 2018, vol 26, pp 1391–1399. https://doi.org/10.1007/978-3-030-03146-6_163
Yang T, Lee YC, Zomaya AY (2014) In: 2014 IEEE 6th international conference on cloud computing technology and science, pp 284–291. https://doi.org/10.1109/CloudCom.2014.135
Wang S, Gu H, Wu G (2013) A new approach to multi-objective virtual machine placement in virtualized data center. In: 2013 IEEE eighth international conference on networking, architecture and storage, Xi’an, pp 331–335
Jamali S, Malektaji S (2014) In: 2014 4th international conference on computer and knowledge engineering (ICCKE), pp 328–333. https://doi.org/10.1109/ICCKE.2014.6993461
Prodan R, Torre E, Durillo JJ, Aujla GS, Kummar N, Fard HM, Benedikt S (2019) In: 2019 45th Euromicro conference on software engineering and advanced applications (SEAA), pp 92–99. https://doi.org/10.1109/SEAA.2019.00023
Dai X, Wang JM, Bensaou B (2014) In: 2014 IEEE 3rd international conference on cloud networking (CloudNet), pp 161–166. https://doi.org/10.1109/CloudNet.2014.6968986
Kanagavelu R, Lee BS, Le NTD, Mingjie LN, Aung KMM (2014) Virtual machine placement with two-path traffic routing for reduced congestion in data center networks. Comput Commun 53:1. https://doi.org/10.1016/j.comcom.2014.07.009. http://www.sciencedirect.com/science/article/pii/S0140366414002746
Zhou X, Wang K, Jia W, Guo M (2017) In: 2017 IEEE/ACM 25th international symposium on quality of service (IWQoS), pp 1–6. https://doi.org/10.1109/IWQoS.2017.7969161
Liu N, Li Z, Xu J, Xu Z, Lin S, Qiu Q, Tang J, Wang Y (2017) In: 2017 IEEE 37th international conference on distributed computing systems (ICDCS), pp 372–382. https://doi.org/10.1109/ICDCS.2017.123
Tong Z, Chen H, Deng X, Li K, Li K (2020) A scheduling scheme in the cloud computing environment using deep Q-learning. Inf Sci 512:1170. https://doi.org/10.1016/j.ins.2019.10.035. http://www.sciencedirect.com/science/article/pii/S0020025519309971
Tong Z, Deng X, Chen H, Mei J, Liu H (2019) QL-HEFT: a novel machine learning scheduling scheme base on cloud computing environment. Neural Comput Appl. https://doi.org/10.1007/s00521-019-04118-8. https://link.springer.com/article/10.1007/s00521-019-04118-8#citeas
Rasouli N, Meybodi MR, Morshedlou H (2013) In: 2013 13th Iranian conference on fuzzy systems (IFSC), pp 1–5. https://doi.org/10.1109/IFSC.2013.6675616
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Ghasemi, A., Toroghi Haghighat, A. A multi-objective load balancing algorithm for virtual machine placement in cloud data centers based on machine learning. Computing 102, 2049–2072 (2020). https://doi.org/10.1007/s00607-020-00813-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00607-020-00813-w