research-article

Inter-rack live migration of multiple virtual machines

Authors:

Umesh Deshpande,

Unmesh Kulkarni,

Kartik GopalanAuthors Info & Claims

VTDC '12: Proceedings of the 6th international workshop on Virtualization Technologies in Distributed Computing Date

Pages 19 - 26

https://doi.org/10.1145/2287056.2287062

Published: 18 June 2012 Publication History

Abstract

Within datacenters, often multiple virtual machines (VMs) need to be live migrated simultaneously for various reasons such as maintenance, power savings, and load balancing. Such mass simultaneous live migration of multiple VMs can trigger large data transfers across the core network links and switches, and negatively affect the cluster-wide performance of network-bound applications. In this paper, we present a distributed system for inter-rack live migration (IRLM), i.e., parallel live migration of multiple VMs across racks. The key performance objective of IRLM is to reduce the traffic load on the core network links during mass VM migration through distributed deduplication of VMs' memory images. We present an initial prototype of IRLM that migrates multiple QEMU/KVM VMs within a Gigabit Ethernet cluster with 10GigE core links. We also present preliminary evaluation on a small testbed having 6 hosts per rack and 4 VMs per host. Our evaluations show that, compared to the default live migration technique in QEMU/KVM, IRLM reduces the network traffic on core links by up to 44% and the total migration time by up to 26%. We also demonstrate that network-bound applications experience a smaller degradation during migration using IRLM.

References

[1]

Samer Al-Kiswany, Dinesh Subhraveti, Prasenjit Sarkar, and Matei Ripean. Vmflock: Virtual machine co-migration for the cloud. In Proc. of High Performance Distributed Computing, June 2011.

Digital Library

[2]

A. Arcangeli, I. Eidus, and C. Wright. Increasing memory density by using ksm. In Proc. of Linux Symposium, July 2009.

[3]

Netperf: Network Performance Benchmark. http://www.netperf.org/netperf.

[4]

Edouard Bugnion, Scott Devine, and Mendel Rosenblum. Disco: Running commodity operating systems on scalable multiprocessors. In ACM Transactions on Computer Systems, October 1997.

Digital Library

[5]

F. Chabaud and A. Joux. Differential collisions in sha-0. In Proc. of Annual International Cryptology Conference, August 1998.

Digital Library

[6]

C. Clark, K. Fraser, S. Hand, J.G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In Proc. of Network System Design and Implementation, May 2005.

Digital Library

[7]

Amazon Elastic Compute Cloud. http://aws.amazon.com/ec2.

[8]

U. Deshpande, X. Wang, and K. Gopalan. Live gang migration of virtual machines. In Proc. of High Performance Distributed Computing, June 2010.

Digital Library

[9]

D. Gupta, S. Lee, M. Vrable, S. Savage, A. C Snoeren, G. Varghese, G. M Voelker, and A. Vahdat. Difference engine: Harnessing memory redundancy in virtual machines. In Proc. of Operating Systems Design and Implementation, December 2010.

Digital Library

[10]

OpenSSL SHA1 hash. http://www.openssl.org/docs/crypto/sha.html.

[11]

M. Hines, U. Deshpande, and K. Gopalan. Post-copy live migration of virtual machines. SIGOPS Operating Syst. Review, 43(3):14--26, July 2009.

Digital Library

[12]

W. Huang, M. Koop, Q. Gao, and D.K. Panda. Virtual machine aware communication libraries for high performance computing. In Proc. of SuperComputing, November 2007.

Digital Library

[13]

H. Jin, L. Deng, S. Wu, X. Shi, and X. Pan. Live virtual machine migration with adaptive, memory compression. In Proc. of Cluster Computing and Workshops, August 2009.

[14]

A. Kivity, Y. Kamay, D. Laor, U. Lublin, and A. Liguori. Kvm: The linux virtual machine monitor. In Proc. of Linux Symposium, June 2007.

[15]

G. Milos, D.G. Murray, S. Hand, and M.A. Fetterman. Satori: Enlightened page sharing. In Proc. of USENIX Annual Technical Conference, June 2009.

Digital Library

[16]

M. Nelson, B. H Lim, and G. Hutchins. Fast transparent migration for virtual machines. In Proc. of USENIX Annual Technical Conference, April 2005.

Digital Library

[17]

D. Nurmi, R. Wolski, C. Grzegorczyk, G. Obertelli, S. Soman, L. Youseff, and D. Zagorodnov. The eucalyptus open-source cloud-computing system. In Proc. of Cluster, Cloud, and Grid Computing, May 2009.

Digital Library

[18]

P. Riteau, C. Morin, and T. Priol. Shrinker: Improving live migration of virtual clusters over wans with distributed data deduplication and content-based addressing. In Proc. of EUROPAR, September 2011.

Digital Library

[19]

C. P Sapuntzakis, R. Chandra, B. Pfaff, J. Chow, M. S Lam, and M. Rosenblum. Optimizing the migration of virtual computers. In Proc. of Operating Systems Design and Implementation, December 2002.

Digital Library

[20]

J. Sonnek, J. Greensky, R. Reutiman, and A. Chandra. Starling: Minimizing communication overhead in virtualized computing platforms using decentralized affinity-aware migration. In Proc. of International Conference on Parallel Processing, September 2010.

Digital Library

[21]

C. A. Waldspurger. Memory resource management in VMware ESX server. In Proc. of Operating Systems Design and Implementation, December 2002.

Digital Library

[22]

T. Wood, K. Ramakrishnan, J. van der Merwe, and P. Shenoy. CloudNet: a platform for optimized WAN migration of virtual machines. University of Massachusetts Technical Report TR-2010, 2, 2010.

[23]

Timothy Wood, Gabriel Tarasuk-Levin, Prashant Shenoy, Peter Desnoyers, Emmanuel Cecchet, and Mark D. Corner. Memory buddies: exploiting page sharing for smart colocation in virtualized data centers. In Proceedings of the 2009 ACM SIGPLAN/SIGOPS international conference on Virtual execution environments, VEE '09, March 2009.

Digital Library

[24]

X. Zhang, Z. Huo, J. Ma, and D. Meng. Exploiting data deduplication to accelerate live virtual machine migration. In Proc. of International Conference on Cluster Computing, September 2010.

Digital Library

Cited By

Haris RBarhamgi MNhlabatsi AKhan K(2024)Optimizing pre-copy live virtual machine migration in cloud computing using machine learning-based prediction modelComputing10.1007/s00607-024-01318-6106:9(3031-3062)Online publication date: 8-Jul-2024
https://doi.org/10.1007/s00607-024-01318-6
He TBuyya R(2023)A Taxonomy of Live Migration Management in Cloud ComputingACM Computing Surveys10.1145/361535356:3(1-33)Online publication date: 5-Oct-2023
https://dl.acm.org/doi/10.1145/3615353
Dinh Ngoc TTeabe BTchana AMuller GHagimont D(2023)HyperTPJournal of Parallel and Distributed Computing10.1016/j.jpdc.2023.104733181:COnline publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1016/j.jpdc.2023.104733
Show More Cited By

Index Terms

Inter-rack live migration of multiple virtual machines
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems

Recommendations

Post-copy live migration of virtual machines

We present the design, implementation, and evaluation of post-copy based live migration for virtual machines (VMs) across a Gigabit LAN. Post-copy migration defers the transfer of a VM's memory contents until after its processor state has been sent to ...
Live gang migration of virtual machines
HPDC '11: Proceedings of the 20th international symposium on High performance distributed computing

This paper addresses the problem of simultaneously migrating a group of co-located and live virtual machines (VMs), i.e, VMs executing on the same physical machine. We refer to such a mass simultaneous migration of active VMs as "live gang migration". ...
Pre-Copy and post-copy VM live migration for memory intensive applications
Euro-Par'12: Proceedings of the 18th international conference on Parallel processing workshops

Virtualization technology provides a means for server consolidation, reducing the number of physical servers required for running a given workload. Virtual Machine (VM) live migration facilitates the transfer of a running (VM) between physical hosts ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

VTDC '12: Proceedings of the 6th international workshop on Virtualization Technologies in Distributed Computing Date

June 2012

68 pages

ISBN:9781450313445

DOI:10.1145/2287056

General Chair:
Frédéric Desprez
INRIA, France
,
Program Chair:
Adrien Lèbre
Mines de Nantes, France

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

University of Arizona: University of Arizona
SIGARCH: ACM Special Interest Group on Computer Architecture

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 June 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HPDC'12

Sponsor:

University of Arizona
SIGARCH

HPDC'12: The 21st International Symposium on High-Performance Parallel and Distributed Computing

June 18, 2012

Delft, The Netherlands

Acceptance Rates

Overall Acceptance Rate 5 of 10 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

47
Total Citations
View Citations
500
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)2

Reflects downloads up to 13 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Haris RBarhamgi MNhlabatsi AKhan K(2024)Optimizing pre-copy live virtual machine migration in cloud computing using machine learning-based prediction modelComputing10.1007/s00607-024-01318-6106:9(3031-3062)Online publication date: 8-Jul-2024
https://doi.org/10.1007/s00607-024-01318-6
He TBuyya R(2023)A Taxonomy of Live Migration Management in Cloud ComputingACM Computing Surveys10.1145/361535356:3(1-33)Online publication date: 5-Oct-2023
https://dl.acm.org/doi/10.1145/3615353
Dinh Ngoc TTeabe BTchana AMuller GHagimont D(2023)HyperTPJournal of Parallel and Distributed Computing10.1016/j.jpdc.2023.104733181:COnline publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1016/j.jpdc.2023.104733
Singh GSingh A(2022)Optimization of SLA aware live migration of multiple virtual machines using Lagrange multiplierFuture Generation Computer Systems10.1016/j.future.2022.01.001130:C(279-291)Online publication date: 1-May-2022
https://dl.acm.org/doi/10.1016/j.future.2022.01.001
Hassannezhad Najjari APourhaji Kazem A(2022)A systematic overview of live virtual machine migration methodsConcurrency and Computation: Practice and Experience10.1002/cpe.691534:17Online publication date: 9-May-2022
https://doi.org/10.1002/cpe.6915
Ngoc TTeabe BTchana AMuller GHagimont DBarbalace ABhatotia PAlvisi LCadar C(2021)Mitigating vulnerability windows with hypervisor transplantProceedings of the Sixteenth European Conference on Computer Systems10.1145/3447786.3456235(162-177)Online publication date: 21-Apr-2021
https://dl.acm.org/doi/10.1145/3447786.3456235
Chapala YReddy B(2021)An Enhancement in Restructured Scatter-Gather for Live Migration of Virtual Machine2021 6th International Conference on Inventive Computation Technologies (ICICT)10.1109/ICICT50816.2021.9358505(90-96)Online publication date: 20-Jan-2021
https://doi.org/10.1109/ICICT50816.2021.9358505
Mukhija LSachdeva RSingh M(2021)Analytical Study of Virtual Machine Migration Techniques in Cloud ComputingSoft Computing for Intelligent Systems10.1007/978-981-16-1048-6_34(425-433)Online publication date: 23-Jun-2021
https://doi.org/10.1007/978-981-16-1048-6_34
Fati SJaradat AAbunadi IMohammed A(2020)Modelling Virtual Machine Workload in Heterogeneous Cloud Computing PlatformsJournal of Information Technology Research10.4018/JITR.20201001.oa113:4(156-170)Online publication date: 1-Oct-2020
https://dl.acm.org/doi/10.4018/JITR.20201001.oa1
Patil APatil R(2020)An Optimal Heuristic Model for Greedy and Efficient Consolidation Process in Cloud Datacenters2020 3rd International Conference on Intelligent Sustainable Systems (ICISS)10.1109/ICISS49785.2020.9316026(1308-1313)Online publication date: 3-Dec-2020
https://doi.org/10.1109/ICISS49785.2020.9316026
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten