research-article

Workload-aware live storage migration for clouds

Authors:

Tze Sing Eugene Ng,

Kunwadee SripanidkulchaiAuthors Info & Claims

VEE '11: Proceedings of the 7th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments

Pages 133 - 144

https://doi.org/10.1145/1952682.1952700

Published: 09 March 2011 Publication History

Abstract

The emerging open cloud computing model will provide users with great freedom to dynamically migrate virtualized computing services to, from, and between clouds over the wide-area. While this freedom leads to many potential benefits, the running services must be minimally disrupted by the migration. Unfortunately, current solutions for wide-area migration incur too much disruption as they will significantly slow down storage I/O operations during migration. The resulting increase in service latency could be very costly to a business. This paper presents a novel storage migration scheduling algorithm that can greatly improve storage I/O performance during wide-area migration. Our algorithm is unique in that it considers individual virtual machine's storage I/O workload such as temporal locality, spatial locality and popularity characteristics to compute an efficient data transfer schedule. Using a fully implemented system on KVM and a trace-driven framework, we show that our algorithm provides large performance benefits across a wide range of popular virtual machine workloads.

References

[1]

Michael Armbrust, Armando Fox, Rean Griffith, and et. al. Above the clouds: A berkeley view of cloud computing. Technical Report UCB/EECS-2009-28, EECS Department, University of California, Berkeley, Feb 2009.

[2]

M.G. Baker, J.H. Hartman, M.D. Kupfer, K.W. Shirriff, and J.K. Ousterhout. Measurements of a distributed file system. ACM SIGOPS Operating Systems Review, 25(5):212, 1991.

Digital Library

[3]

M. Blaze. NFS tracing by passive network monitoring. In Proceedings of the USENIX Winter 1992 Technical Conference, pages 333--343, 1992.

[4]

"Amazon Web Services Blog". Animoto - Scaling Through Viral Growth. http://aws.typepad.com/aws/2008/04/animoto-scali.html, April 2008.

[5]

Robert Bradford, Evangelos Kotsovinos, Anja Feldmann, and Harald Schioberg. Live wide-area migration of virtual machines including local persistent state. In ACM/Usenix VEE, June 2007.

Digital Library

[6]

Christopher Clark, Keir Fraser, Steven Hand, Jacob Gorm Hansen, Eric Jul, Christian Limpach, Ian Pratt, and Andrew Warfield. Live migration of virtual machines. In NSDI'05: Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation, pages 273--286, Berkeley, CA, USA, 2005. USENIX Association.

Digital Library

[7]

M.D. Dahlin, C.J. Mather, R.Y. Wang, T.E. Anderson, and D.A. Patterson. A quantitative analysis of cache policies for scalable network file systems. ACM SIGMETRICS Performance Evaluation Review, 22(1):150--160, 1994.

Digital Library

[8]

Derek Gottfrid. The New York Times Archives

[9]

Amazon Web Services = TimesMachine. http://open.blogs.nytimes.com/ 2008/05/21/the-new-york-times-archives-amazon-web-services-timesmachine/, May 2008.

[10]

James Hamilton. The Cost of Latency. http://perspectives.mvdirona.com/2009/10/31/TheCostOfLatency.aspx, October 2009.

[11]

Michael R. Hines and Kartik Gopalan. Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning. In VEE '09: Proceedings of the 2009 ACM SIGPLAN/SIGOPS international conference on Virtual execution environments, 2009.

Digital Library

[12]

Takahiro Hirofuchi, Hidemoto Nakada, Hirotaka Ogawa, Satoshi Itoh, and Satoshi Sekiguchi. A live storage migration mechanism over wan and its performance evaluation. In VIDC'09: Proceedings of the 3rd International Workshop on Virtualization Technologies in Distributed Computing, Barcelona, Spain, 2009. ACM.

Digital Library

[13]

Takahiro Hirofuchi, Hirotaka Ogawa, Hidemoto Nakada, Satoshi Itoh, and Satoshi Sekiguchi. A live storage migration mechanism over wan for relocatable virtual machine services on clouds. In CCGRID'09: Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, Shanghai, China, 2009. IEEE Computer Society.

Digital Library

[14]

Hai Jin, Li Deng, Song Wu, and Xuanhua Shi. Live virtual machine migration integrating memory compression with precopy. In IEEE International Conference on Cluster Computing, 2009.

[15]

KVM. QEMU-KVM code. http://sourceforge.net/projects/kvm/files, January 2010.

[16]

Yingwei Luo, Binbin Zhang, Xiaolin Wang, Zhenlin Wang, Yifeng Sun, and Haogang Chen. Live and Incremental Whole-System Migration of Virtual Machines Using Block-Bitmap. In IEEE International Conference on Cluster Computing, 2008.

[17]

Open Cloud Manifesto. Open Cloud Manifesto. http://www.opencloudmanifesto.org/, January 2010.

[18]

Michael Nelson, Beng-Hong Lim, and Greg Hutchins. Fast transparent migration for virtual machines. In USENIX'05: Proceedings of the 2005 Usenix Annual Technical Conference, Berkeley, CA, USA, 2005. USENIX Association.

Digital Library

[19]

J.K. Ousterhout, H. Da Costa, D. Harrison, J.A. Kunze, M. Kupfer, and J.G. Thompson. A trace-driven analysis of the UNIX 4.2 BSD file system. ACM SIGOPS Operating Systems Review, 19(5):24, 1985.

Digital Library

[20]

K.K. Ramakrishnan, Prashant Shenoy, and Jacobus Van der Merwe. Live data center migration across wans: A robust cooperative context aware approach. In ACM SIGCOMM Workshop on Internet Network Management (INM), Kyoto, Japan, Aug 2007.

Digital Library

[21]

IBM Redbooks. IBM Powervm Live Partition Mobility IBM International Technical Support Organization. Vervante, 2009.

Digital Library

[22]

D. Roselli, J.R. Lorch, and T.E. Anderson. A comparison of file system workloads. In Proceedings of the annual conference on USENIX Annual Technical Conference, page 4. USENIX Association, 2000.

Digital Library

[23]

Franco Travostino, Paul Daspit, Leon Gommans, Chetan Jog, Cees de Laat, Joe Mambretti, Inder Monga, Bas van Oudenaarde, Satish Raghunath, and Phil Yonghui Wang. Seamless live migration of virtual machines over the man/wan. Future Gener. Comput. Syst., 22(8):901--907, 2006.

Digital Library

[24]

VMWare. VMmark Virtualization Benchmarks. http://www.vmware.com/products/vmmark/, January 2010.

[25]

Timothy Wood, Prashant Shenoy, Alexandre Gerber, K.K. Ramakrishnan, and Jacobus Van der Merwe. The Case for Enterprise-Ready Virtual Private Clouds. In Proc. of HotCloud Workshop, 2009.

Digital Library

[26]

Timothy Wood, Prashant Shenoy, Arun Venkataramani, and Mazin Yousif. Black-box and gray-box strategies for virtual machine migration. In NSDI, 2007.

Digital Library

[27]

XEN. XEN Project. http://www.xen.org, January 2009.

Cited By

Nguetchouang KBitchebe SDubuc TCallau-Zori MHubert COlivier PTchana A(2024)SVD: A Scalable Virtual Machine Disk FormatIEEE Transactions on Cloud Computing10.1109/TCC.2024.339139012:2(684-696)Online publication date: Apr-2024
https://doi.org/10.1109/TCC.2024.3391390
Asanuma KYamada H(2024)DBMS-Assisted Live Migration of Virtual MachinesIEEE Transactions on Computers10.1109/TC.2023.332994373:2(380-393)Online publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1109/TC.2023.3329943
El Kafhali SEl Mir IHanini M(2021)Security Threats, Defense Mechanisms, Challenges, and Future Directions in Cloud ComputingArchives of Computational Methods in Engineering10.1007/s11831-021-09573-yOnline publication date: 7-Apr-2021
https://doi.org/10.1007/s11831-021-09573-y
Show More Cited By

Index Terms

Workload-aware live storage migration for clouds
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems

Recommendations

A live storage migration mechanism over wan and its performance evaluation
VTDC '09: Proceedings of the 3rd international workshop on Virtualization technologies in distributed computing

Live migration of virtual machines is a key technology for the next generation of IaaS cloud services, contributing to dynamic portability and mobility of VM-based services among datacenters. The practical use of live migration, however, is still ...
Workload-aware live storage migration for clouds
VEE '11

The emerging open cloud computing model will provide users with great freedom to dynamically migrate virtualized computing services to, from, and between clouds over the wide-area. While this freedom leads to many potential benefits, the running ...
Performance Analysis for Pareto-Optimal Green Consolidation Based on Virtual Machines Live Migration

Huge energy requirement of cloud data centers is prime concern. Dynamic Virtual Machine VM consolidation based on VM live migration to switched-off or put some of the under-loaded host Physical Machines PMs into a low power consumption mode can ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

VEE '11: Proceedings of the 7th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments

March 2011

250 pages

ISBN:9781450306874

DOI:10.1145/1952682

General Chair:
Erez Petrank
The Technion, Israel
,
Program Chair:
Doug Lea
SUNY Oswego, USA

ACM SIGPLAN Notices Volume 46, Issue 7
VEE '11
July 2011
231 pages
ISSN:0362-1340
EISSN:1558-1160
DOI:10.1145/2007477
Issue’s Table of Contents

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 March 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

VEE '11

Sponsor:

VEE '11: ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments

March 9 - 11, 2011

California, Newport Beach, USA

Acceptance Rates

Overall Acceptance Rate 80 of 235 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

64
Total Citations
View Citations
1,067
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)2

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Nguetchouang KBitchebe SDubuc TCallau-Zori MHubert COlivier PTchana A(2024)SVD: A Scalable Virtual Machine Disk FormatIEEE Transactions on Cloud Computing10.1109/TCC.2024.339139012:2(684-696)Online publication date: Apr-2024
https://doi.org/10.1109/TCC.2024.3391390
Asanuma KYamada H(2024)DBMS-Assisted Live Migration of Virtual MachinesIEEE Transactions on Computers10.1109/TC.2023.332994373:2(380-393)Online publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1109/TC.2023.3329943
El Kafhali SEl Mir IHanini M(2021)Security Threats, Defense Mechanisms, Challenges, and Future Directions in Cloud ComputingArchives of Computational Methods in Engineering10.1007/s11831-021-09573-yOnline publication date: 7-Apr-2021
https://doi.org/10.1007/s11831-021-09573-y
Sahid AMaleh YBelaissaoui M(2020)ReferencesStrategic Information System Agility: From Theory to Practices10.1108/978-1-80043-810-120211011(159-184)Online publication date: 4-Dec-2020
https://doi.org/10.1108/978-1-80043-810-120211011
Velpula PPamula R(2019)Analysis: Various Load Balancing Competencies for Data Centres2019 4th International Conference on Information Systems and Computer Networks (ISCON)10.1109/ISCON47742.2019.9036186(417-421)Online publication date: Nov-2019
https://doi.org/10.1109/ISCON47742.2019.9036186
Yang YMao BJiang HYang YLuo HWu S(2018)SnapMig: Accelerating VM Live Storage Migration by Leveraging the Existing VM Snapshots in the CloudIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2018.279038929:6(1416-1427)Online publication date: 1-Jun-2018
https://doi.org/10.1109/TPDS.2018.2790389
(2017)Live migration of virtual machines with their local persistent storage in a data intensive cloudInternational Journal of High Performance Computing and Networking10.5555/3070823.307083710:1-2(134-147)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.5555/3070823.3070837
Choudhary AGovil MSingh GAwasthi LPilli EKapil D(2017)A critical survey of live virtual machine migration techniquesJournal of Cloud Computing: Advances, Systems and Applications10.5555/3067917.31617126:1(1-41)Online publication date: 1-Dec-2017
https://dl.acm.org/doi/10.5555/3067917.3161712
Choudhary AGovil MSingh GAwasthi LPilli EKapil D(2017)A critical survey of live virtual machine migration techniquesJournal of Cloud Computing10.1186/s13677-017-0092-16:1Online publication date: 7-Nov-2017
https://doi.org/10.1186/s13677-017-0092-1
Chaufournier LSharma PLe FNahum EShenoy PTowsley DZhang JChiang MMaggs B(2017)Fast transparent virtual machine migration in distributed edge cloudsProceedings of the Second ACM/IEEE Symposium on Edge Computing10.1145/3132211.3134445(1-13)Online publication date: 12-Oct-2017
https://dl.acm.org/doi/10.1145/3132211.3134445
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents