Article

Virtual Clusters on the Fly - Fast, Scalable, and Flexible Installation

Authors:

Hideo Nishimura,

Naoya Maruyama,

Satoshi MatsuokaAuthors Info & Claims

CCGRID '07: Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid

Pages 549 - 556

https://doi.org/10.1109/CCGRID.2007.121

Published: 14 May 2007 Publication History

Publisher Site

Abstract

One of the advantages in virtualized computing clusters compared to traditional shared HPC environments is their ability to accommodate user-specific system customization. However, past attempts to providing virtual clusters are not scalable with increasing number of VMs, nor do they allow fine-grained customization of VMs, assuming that preconfigured VM images are always available on the Grid. We propose a new virtual cluster installation technique that achieves efficiency and scalability, and yet simultaneously fine-grained customizability. It allows the user to create VMs on the fly for fine-grained customization of VMs, and pipelined data transfer for scalable installation with increasing number of VMs. To achieve efficiency in the presence of such full customization, it automatically caches frequently-constructed virtual disk images to save software installation time in common cases. Our experimental studies using a prototype implementation show that installation of a 190-node virtual cluster can be done in 40 seconds. From this result along with a scalability study, we estimate that installation of a 1000-node virtual cluster could be done in less than two minutes.

Cited By

View all

(2017)Ant colony-based load balancing and fault recovery for cloud computing environmentInternational Journal of Advanced Intelligence Paradigms10.5555/3070666.30706729:2-3(204-219)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.5555/3070666.3070672
Korkhov VKobyshev SKrosheninnikov A(2015)Flexible Configuration of Application-Centric Virtualized Computing InfrastructureProceedings, Part IV, of the 15th International Conference on Computational Science and Its Applications -- ICCSA 2015 - Volume 915810.1007/978-3-319-21410-8_27(342-353)Online publication date: 22-Jun-2015
https://dl.acm.org/doi/10.1007/978-3-319-21410-8_27
Gankevich IKorkhov VBalyan SGaiduchok VGushchanskiy DTipikin YDegtyarev ABogdanov A(2014)Constructing Virtual Private Supercomputer Using Virtualization and Cloud TechnologiesProceedings of the 14th International Conference on Computational Science and Its Applications ICCSA 2014 - Volume 858410.1007/978-3-319-09153-2_26(341-354)Online publication date: 30-Jun-2014
https://dl.acm.org/doi/10.1007/978-3-319-09153-2_26
Show More Cited By

Index Terms

Virtual Clusters on the Fly - Fast, Scalable, and Flexible Installation

Recommendations

Fast Live Cloning of Virtual Machine Based on Xen
HPCC '09: Proceedings of the 2009 11th IEEE International Conference on High Performance Computing and Communications

Virtual Machine (VM) cloning is to create a replica of a source virtual machine (parent virtual machine); the replica, also called child virtual machine, owns exactly the same executing status as parent virtual machine. Fast live cloning guarantees that,...
Scalable virtual machine multiplexing
Optimizing Live Migration of Virtual Machines in SMP Clusters for HPC Applications
NPC '09: Proceedings of the 2009 Sixth IFIP International Conference on Network and Parallel Computing

Live migration is one of the most useful features provided by todays' virtual machine monitors (VMM). It enables seamless hardware upgrades, provides fault tolerance, achieves load balancing and saves power through server consolidation. These features ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CCGRID '07: Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid

May 2007

900 pages

ISBN:0769528333

Publisher

IEEE Computer Society

United States

Publication History

Published: 14 May 2007

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

(2017)Ant colony-based load balancing and fault recovery for cloud computing environmentInternational Journal of Advanced Intelligence Paradigms10.5555/3070666.30706729:2-3(204-219)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.5555/3070666.3070672
Korkhov VKobyshev SKrosheninnikov A(2015)Flexible Configuration of Application-Centric Virtualized Computing InfrastructureProceedings, Part IV, of the 15th International Conference on Computational Science and Its Applications -- ICCSA 2015 - Volume 915810.1007/978-3-319-21410-8_27(342-353)Online publication date: 22-Jun-2015
https://dl.acm.org/doi/10.1007/978-3-319-21410-8_27
Gankevich IKorkhov VBalyan SGaiduchok VGushchanskiy DTipikin YDegtyarev ABogdanov A(2014)Constructing Virtual Private Supercomputer Using Virtualization and Cloud TechnologiesProceedings of the 14th International Conference on Computational Science and Its Applications ICCSA 2014 - Volume 858410.1007/978-3-319-09153-2_26(341-354)Online publication date: 30-Jun-2014
https://dl.acm.org/doi/10.1007/978-3-319-09153-2_26
Sharifi MSalimi HSaberi AGharibshah J(2013)VMM detection using privilege rings and benchmark execution timesInternational Journal of Communication Networks and Distributed Systems10.1504/IJCNDS.2013.05622611:3(310-326)Online publication date: 1-Sep-2013
https://dl.acm.org/doi/10.1504/IJCNDS.2013.056226
Chen GWu YWu JZheng W(2013)TopClusterJournal of Computer and System Sciences10.1016/j.jcss.2012.05.01079:2(201-215)Online publication date: 1-Mar-2013
https://dl.acm.org/doi/10.1016/j.jcss.2012.05.010
Huang BLin RPeng KZou HYang F(2013)Efficient Service Deployment by Image-Aware VM Allocation StrategyProceedings of the 14th International Conference on Intelligent Data Engineering and Automated Learning --- IDEAL 2013 - Volume 820610.1007/978-3-642-41278-3_31(252-261)Online publication date: 20-Oct-2013
https://dl.acm.org/doi/10.1007/978-3-642-41278-3_31
Xia LDinda PDesprez FLèbre A(2012)A case for tracking and exploiting inter-node and intra-node memory content sharing in virtualized large-scale parallel systemsProceedings of the 6th international workshop on Virtualization Technologies in Distributed Computing Date10.1145/2287056.2287061(11-18)Online publication date: 18-Jun-2012
https://dl.acm.org/doi/10.1145/2287056.2287061
Fölling AHofmann M(2012)Improving scheduling performance using a q-learning-based leasing policy for cloudsProceedings of the 18th international conference on Parallel Processing10.1007/978-3-642-32820-6_34(337-349)Online publication date: 27-Aug-2012
https://dl.acm.org/doi/10.1007/978-3-642-32820-6_34
Villegas DSadjadi S(2011)DEVAProceedings of the 17th international conference on Parallel processing - Volume Part I10.5555/2033345.2033394(467-478)Online publication date: 29-Aug-2011
https://dl.acm.org/doi/10.5555/2033345.2033394
Lange JPedretti KDinda PBridges PBae CSoltero PMerritt A(2011)Minimal-overhead virtualization of a large scale supercomputerACM SIGPLAN Notices10.1145/2007477.195270546:7(169-180)Online publication date: 9-Mar-2011
https://dl.acm.org/doi/10.1145/2007477.1952705
Show More Cited By

Abstract

Cited By

Index Terms

Recommendations

Fast Live Cloning of Virtual Machine Based on Xen

Scalable virtual machine multiplexing

Optimizing Live Migration of Virtual Machines in SMP Clusters for HPC Applications

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations