research-article

Going back and forth: efficient multideployment and multisnapshotting on clouds

Authors:

Bogdan Nicolae,

John Bresnahan,

Gabriel AntoniuAuthors Info & Claims

HPDC '11: Proceedings of the 20th international symposium on High performance distributed computing

Pages 147 - 158

https://doi.org/10.1145/1996130.1996152

Published: 08 June 2011 Publication History

Abstract

Infrastructure as a Service (IaaS) cloud computing has revolutionized the way we think of acquiring resources by introducing a simple change: allowing users to lease computational resources from the cloud provider's datacenter for a short time by deploying virtual machines (VMs) on these resources. This new model raises new challenges in the design and development of IaaS middleware. One of those challenges is the need to deploy a large number (hundreds or even thousands) of VM instances simultaneously. Once the VM instances are deployed, another challenge is to simultaneously take a snapshot of many images and transfer them to persistent storage to support management tasks, such as suspend-resume and migration. With datacenters growing rapidly and configurations becoming heterogeneous, it is important to enable efficient concurrent deployment and snapshotting that are at the same time hypervisor independent and ensure a maximum compatibility with different configurations. This paper addresses these challenges by proposing a virtual file system specifically optimized for virtual machine image storage. It is based on a lazy transfer scheme coupled with object versioning that handles snapshotting transparently in a hypervisor-independent fashion, ensuring high portability for different configurations. Large-scale experiments on hundreds of nodes demonstrate excellent performance results: speedup for concurrent VM deployments ranges from a factor of 2 up to 25, with a reduction in bandwidth utilization of as much as 90%.

References

[1]

Amazon elastic block storage (ebs). http://aws.amazon.com/ebs/.

[2]

File system in userspace (fuse). http://fuse.sourceforge.net.

[3]

Nimbus. http://www.nimbusproject.org/.

[4]

Opennebula. http://www.opennebula.org/.

[5]

Amazon Elastic Compute Cloud (EC2). http://aws.amazon.com/ec2/.

[6]

Amazon Simple Storage Service (S3). http://aws.amazon.com/s3/.

[7]

M. Armbrust, A. Fox, R. Griffith, A. Joseph, R. Katz, A. Konwinski, G. Lee, D. Patterson, A. Rabkin, I. Stoica, and M. Zaharia. A view of cloud computing. Commun. ACM, 53:50--58, April 2010.

Digital Library

[8]

A. Bar-Noy and S. Kipnis. Designing broadcasting algorithms in the postal model for message-passing systems. In SPAA '92: Proceedings of the 4th Annual ACM Symposium on Parallel Algorithms and Architectures, pages 13--22, New York, 1992. ACM.

Digital Library

[9]

P. H. Carns, W. B. Ligon, R. B. Ross, and R. Thakur. Pvfs: A parallel file system for Linux clusters. In Proceedings of the 4th Annual Linux Showcase and Conference, pages 317--327, Atlanta, GA, 2000. USENIX Association.

Digital Library

[10]

B. Claudel, G. Huard, and O. Richard. Taktuk, adaptive deployment of remote executions. In HPDC '09: Proceedings of the 18th ACM International Symposium on High Performance Distributed Computing, pages 91--100, New York, 2009. ACM.

Digital Library

[11]

G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels. Dynamo: Amazon's highly available key-value store. In SOSP '07: Proceedings of 21st ACM SIGOPS Symposium on Operating Systems Principles, pages 205--220, New York, 2007. ACM.

Digital Library

[12]

M. Gagné. Cooking with Linux--still searching for the ultimate Linux distro? Linux J., 2007(161):9, 2007.

Digital Library

[13]

J. G. Hansen and E. Jul. Scalable virtual machine storage using local disks. SIGOPS Oper. Syst. Rev., 44:71--79, December 2010.

Digital Library

[14]

M. Hibler, L. Stoller, J. Lepreau, R. Ricci, and C. Barb. Fast, scalable disk imaging with Frisbee. In ATC '03: Proceedings of the 2003 USENIX Annual Technical Conference, pages 283--296, San Antonio, TX, 2003.

[15]

Y. Jégou, S. Lantéri, J. Leduc, M. Noredine, G. Mornet, R. Namyst, P. Primet, B. Quetier, O. Richard, E.-G. Talbi, and T. Iréa. Grid'5000: A large scale and highly reconfigurable experimental grid testbed. International Journal of High Performance Computing Applications, 20(4):481--494, November 2006.

Digital Library

[16]

K. Keahey and T. Freeman. Science clouds: Early experiences in cloud computing for scientific applications. In CCA'08: Proceedings of the 1st Conference on Cloud Computing and Its Applications, 2008.

[17]

K. Keahey, M. O. Tsugawa, A. M. Matsunaga, and J. A. B. Fortes. Sky computing. IEEE Internet Computing, 13(5):43--51, 2009.

Digital Library

[18]

H. A. Lagar-Cavilla, J. A. Whitney, A. M. Scannell, P. Patchin, S. M. Rumble, E. de Lara, M. Brudno, and M. Satyanarayanan. SnowFlock: Rapid virtual machine cloning for cloud computing. In EuroSys '09: Proceedings of the 4th ACM European Conference on Computer Systems, pages 1--12, New York, 2009. ACM.

Digital Library

[19]

X. Liu, J. Huai, Q. Li, and T. Wo. Network state consistency of virtual machine in live migration. In SAC '10: Proceedings of the 2010 ACM Symposium on Applied Computing, pages 727--728, New York, 2010. ACM.

Digital Library

[20]

P. Marshall, K. Keahey, and T. Freeman. Elastic site: Using clouds to elastically extend site resources. In CCGRID '10: Proceedings of the 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing, CCGRID '10, pages 43--52, Washington, DC, USA, 2010. IEEE Computer Society.

Digital Library

[21]

B. Martin. Using Bonnie++ for filesystem performance benchmarking. Linux.com, Online edition, 2008.

[22]

D. T. Meyer, G. Aggarwal, B. Cully, G. Lefebvre, M. J. Feeley, N. C. Hutchinson, and A. Warfield. Parallax: Virtual disks for virtual machines. SIGOPS Oper. Syst. Rev., 42(4):41--54, 2008.

Digital Library

[23]

B. Nicolae. BlobSeer: Towards Efficient Data Storage Management for Large-Scale, Distributed Systems. PhD thesis, University of Rennes 1, November 2010.

[24]

B. Nicolae, G. Antoniu, L. Bougé, D. Moise, and A. Carpen-Amarie. BlobSeer: Next-generation data management for large scale infrastructures. J. Parallel Distrib. Comput., 71:169--184, February 2011.

Digital Library

[25]

B. Nicolae, D. Moise, G. Antoniu, L. Bougé, and M. Dorier. Blobseer: Bringing high throughput under heavy concurrency to Hadoop map/reduce applications. In IPDPS '10: Proceedings of the 24th IEEE International Parallel and Distributed Processing Symposium, pages 1--12, Atlanta, GA, 2010.

[26]

D. Reimer, A. Thomas, G. Ammons, T. Mummert, B. Alpern, and V. Bala. Opening black boxes: Using semantic information to combat virtual machine image sprawl. In VEE '08: Proceedings of the 4th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments, pages 111--120, New York, 2008. ACM.

Digital Library

[27]

O. Rodeh. B-trees, shadowing, and clones. Trans. Storage, 3(4):1--27, 2008.

Digital Library

[28]

A. Rodriguez, J. Carretero, B. Bergua, and F. Garcia. Resource selection for fast large-scale virtual appliances propagation. In ISCC '09: Proceedings of 14th IEEE Symposium on Computers and Communications, pages 824--829, 5--8 2009.

[29]

M. Rosenblum and J. K. Ousterhout. The design and implementation of a log-structured file system. ACM Trans. Comput. Syst., 10(1):26--52, 1992.

Digital Library

[30]

L. M. Vaquero, L. Rodero-Merino, J. Caceres, and M. Lindner. A break in the clouds: Towards a cloud definition. SIGCOMM Comput. Commun. Rev., 39(1):50--55, 2009.

Digital Library

[31]

R. Wartel, T. Cass, B. Moreira, E. Roche, M. Guijarro, S. Goasguen, and U. Schwickerath. Image distribution mechanisms in large scale cloud providers. In CloudCom '10: Proceedings 2nd IEEE International Conference on Cloud Computing Technology and Science, Indianapolis, IN, 2010.

Digital Library

Cited By

Battulga DMiorandi DTedeschi C(2021)SpecK: Composition of Stream Processing Applications over Fog EnvironmentsDistributed Applications and Interoperable Systems10.1007/978-3-030-78198-9_3(38-54)Online publication date: 9-Jun-2021
https://doi.org/10.1007/978-3-030-78198-9_3
Shi XLiao XZheng DJin HLiu H(2019)VMBKSThe Journal of Supercomputing10.1007/s11227-015-1554-175:1(4-19)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.1007/s11227-015-1554-1
Zhang GZhu XBao WYan HTan D(2018)Local Storage-Based Consolidation With Resource Demand Prediction and Live Migration in CloudsIEEE Access10.1109/ACCESS.2018.28253546(26854-26865)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2825354
Show More Cited By

Index Terms

Going back and forth: efficient multideployment and multisnapshotting on clouds
1. Information systems
  1. Information storage systems
    1. Storage management
2. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        File systems management
        Memory management

Recommendations

Optimizing back-and-forth live migration
UCC '16: Proceedings of the 9th International Conference on Utility and Cloud Computing

Back-and-forth live migration, which means a running VM migrates between two physical machines back and forth, has several important applications. Traditional methods treat each migration as a single event, so the VM releases its system resources on the ...
Leveraging content similarity among VMI files to allocate virtual machines in cloud

To meet a myriad of customers demands, a large number of virtual machines (VMs) have to be provisioned simultaneously in cloud data centers. Provisioning is usually time consuming due to the large size of virtual machine image (VMI) file that needs to ...
New frontiers in cloud computing research
VTDC '13: Proceedings of the 7th international workshop on Virtualization technologies in distributed computing

Cloud computing is challenging conventional wisdom and practices in the management of IT resources and capabilities; at the same time, the technical underpinnings of cloud computing offer unique opportunities and levers for addressing these challenges. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HPDC '11: Proceedings of the 20th international symposium on High performance distributed computing

June 2011

296 pages

ISBN:9781450305525

DOI:10.1145/1996130

General Chair:
Arthur "Barney" Maccabe
Oak Ridge National Lab, USA
,
Program Chair:
Douglas Thain
University of Notre Dame, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

University of Arizona: University of Arizona
SIGARCH: ACM Special Interest Group on Computer Architecture

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 June 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HPDC '11

Sponsor:

University of Arizona
SIGARCH

HPDC '11: The 20th International Symposium on High-Performance Parallel and Distributed Computing

June 8 - 11, 2011

California, San Jose, USA

Acceptance Rates

Overall Acceptance Rate 166 of 966 submissions, 17%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

44
Total Citations
View Citations
421
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Battulga DMiorandi DTedeschi C(2021)SpecK: Composition of Stream Processing Applications over Fog EnvironmentsDistributed Applications and Interoperable Systems10.1007/978-3-030-78198-9_3(38-54)Online publication date: 9-Jun-2021
https://doi.org/10.1007/978-3-030-78198-9_3
Shi XLiao XZheng DJin HLiu H(2019)VMBKSThe Journal of Supercomputing10.1007/s11227-015-1554-175:1(4-19)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.1007/s11227-015-1554-1
Zhang GZhu XBao WYan HTan D(2018)Local Storage-Based Consolidation With Resource Demand Prediction and Live Migration in CloudsIEEE Access10.1109/ACCESS.2018.28253546(26854-26865)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2825354
Ha KAbe YEiszler TChen ZHu WAmos BUpadhyaya RPillai PSatyanarayanan MZhang JChiang MMaggs B(2017)You can teach elephants to danceProceedings of the Second ACM/IEEE Symposium on Edge Computing10.1145/3132211.3134453(1-14)Online publication date: 12-Oct-2017
https://dl.acm.org/doi/10.1145/3132211.3134453
Baek HJin CJiang GLumezanu CVan der Merwe JXia NXu Q(2017)PolygravityProceedings of the 2017 Symposium on Cloud Computing10.1145/3127479.3129258(309-322)Online publication date: 24-Sep-2017
https://dl.acm.org/doi/10.1145/3127479.3129258
Wu SWang YLuo WDi SChen HXu XZheng RJin H(2017)ACStor: Optimizing Access Performance of Virtual Disk Images in CloudsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2017.267598828:9(2414-2427)Online publication date: 1-Sep-2017
https://doi.org/10.1109/TPDS.2017.2675988
Cui LHao ZPeng YYun X(2017)Piccolo: A Fast and Efficient Rollback System for Virtual Machine ClustersIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2017.266840328:8(2328-2341)Online publication date: 1-Aug-2017
https://doi.org/10.1109/TPDS.2017.2668403
Li DDong MTang YYang LOta KZhao G(2017)Triple-L: Improving CPS Disk I/O Performance in a Virtualized NAS EnvironmentIEEE Systems Journal10.1109/JSYST.2015.245603811:1(152-162)Online publication date: Mar-2017
https://doi.org/10.1109/JSYST.2015.2456038
Nathan SGhosh RMukherjee TNarayanan K(2017)CoMICon: A Co-Operative Management System for Docker Container Images2017 IEEE International Conference on Cloud Engineering (IC2E)10.1109/IC2E.2017.24(116-126)Online publication date: Apr-2017
https://doi.org/10.1109/IC2E.2017.24
Du LWo TYang RHu C(2017)Cider: a Rapid Docker Container Deployment System through Sharing Network Storage2017 IEEE 19th International Conference on High Performance Computing and Communications; IEEE 15th International Conference on Smart City; IEEE 3rd International Conference on Data Science and Systems (HPCC/SmartCity/DSS)10.1109/HPCC-SmartCity-DSS.2017.44(332-339)Online publication date: Dec-2017
https://doi.org/10.1109/HPCC-SmartCity-DSS.2017.44
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten