Article

A Case For Grid Computing On Virtual Machines

Authors:

Renato J. Figueiredo,

Peter A. Dinda,

José A. B. FortesAuthors Info & Claims

ICDCS '03: Proceedings of the 23rd International Conference on Distributed Computing Systems

Page 550

Published: 19 May 2003 Publication History

Abstract

We advocate a novel approach to grid computing thatis based on a combination of "classic" operating systemlevel virtual machines (VMs) and middleware mechanismsto manage VMs in a distributed environment. The abstractionis that of dynamically instantiated and mobile VMs thatare a combination of traditional OS processes (the VM monitors)and files (the VM state). We give qualitative argumentsthat justify our approach in terms of security, isolation,customization, legacy support and resource control,and we show quantitative results that demonstrate the feasibilityof our approach from a performance perspective. Finally,we describe the middleware challenges implied by theapproach and an architecture for grid computing using virtualmachines.

References

[1]

B. Allcock, J. Bester, J. Breshanan, A. Chervenak, I. Foster, C. Kesselman, S. Meder, V. Nefedova, D. Quesnel, and S. Tuecke. Secure, efficient data transport and replica management for high-performance data-intensive computing. In IEEE Mass Storage Conference, 2001.

Digital Library

[2]

D. G. Andersen, H. Balakrishnan, F. Kaashoek, and R. Morris. Resilient overlay networks. In Proceedings of the 18th ACM SOSP, Banff, Canada, October 2001.

Digital Library

[3]

A. Bayucan, R. L. Henderson, C. Lesiak, B. Mann, T. Proett. and D. Tweten. Portable Batch System: External reference specification. Technical report, MRJ Technology Solutions, November 1999.

[4]

J. Bester, I. Foster, C. Kesselman, J. Tedesco, and S. Tuecke. GASS: A data movement and access service for wide area computing systems. In Proceedings of the Sixth Workshop on I/O in Parallel and Distributed Systems, May 1999.

Digital Library

[5]

G. Bollella, B. Brogsol, P. Dibble, S. Furr, J. Gosling, D. Hardin, M. Turnbull, R. Belliardi, D. Locke, S. Robbins, P. Solanki, and D. de Niz. The real-time specification for java. Addison-Wesley, November 2001. hup://www.rtj.org/rtsj-V1.0.pdf.

[6]

A. R. Butt, S. Adabala, N. H. Kapadia, R. J. Figueiredo, and J. A. B. Fortes. Fine-grain access control for securing shared resources in computational grids. In To appear, Proceedings of the International Parallel and Distributed Processing Symposium (IPDPS), April 2002.

Digital Library

[7]

K. Czajkowski, I. Foster, N. Karonis, C. Kesselman, S. Martin, W. Smith, and S. Teucke. A resource management architecture for metacomputing systems. In Proceedings of the Fourth Workshop on Job Scheduling Strategies for Parallel Processing, 1998. Held in conjunction with the International Parallel and Distributed Processing Symposium.

Digital Library

[8]

A. Demers, S. Keshav, and S. Shenker. Analysis and simulation of a fair queueing algorithm. Journal of Internetworking Research Research and Experience, pages 3-26, October 1990.

[9]

J. Dike. A user-mode port of the linux kernel. In Proceedings of the USENIX Annual Linux Showcase and Conference, Atlanta, GA, Oct 2000.

Digital Library

[10]

P. Dinda and B. Plale. A unified relational approach to grid information services. Technical Report GWD-GIS-012-1, Global Grid Forum, 2001.

[11]

P. A. Dinda and D. R. O'Hallaron. An extensible toolkit for resource prediction in distributed systems. Technical Report CMU-CS-99-138, School of Computer Science, Carnegie Mellon University, July 1999.

[12]

P. A. Dinda and D. R. O'Hallaron. Realistic CPU workloads through host load trace playback. In Proc. of 5th Workshop on Languages, Compilers, and Run-time Systems for Scalable Computers (LCR2000), volume 1915 of Lecture Notes in Computer Science, Rochester, New York, May 2000. Springer-Verlag.

Digital Library

[13]

N. G. Duffield, P. Goyal, A. G. Greenberg, P. P. Mishra, K. K. Ramakrishnan, and J. E. van der Merive. A flexible model for resource management in virtual private networks. In SIGCOMM, pages 95-108, 1999.

Digital Library

[14]

R. J. Figueiredo, N. H. Kapadia, and J. A. B. Fortes. The PUNCH virtual file system: Seamless access to decentralized storage services in a computational grid. In Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing (HPDC'01), San Francisco, California, August 2001.

Digital Library

[15]

S. Fitzgerald, I. Foster, C. Kesselman, G. v. Laszewski, W. Smith, and S. Tuecke. A directory service for configuring high-performance distributed computations. In Proceedings of the 6th IEEE International Symposium on High Performance Distributed Computing (HPDC'97), pages 365-375, 1997.

Digital Library

[16]

I. Foster and C. Kesselman. Globus: A metacomputing infrastructure toolkit. International Journal of Supercomputer Applications, 11(2), 1997.

[17]

I. Foster and C. Kesselman, editors. The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, 1999.

Digital Library

[18]

IBM Corporation. White paper: S/390 virtual image facility for linux, guide and reference. GC24-5930-03, Feb 2001.

[19]

N. H. Kapadia, R. J. O. Figueiredo, and J. A. B. Fortes. PUNCH: Web portal for running tools. IEEE Micro, pages 38-47, May-June 2000.

Digital Library

[20]

N. H. Kapadia, R. J. O. Figueiredo, and J. A. B. Fortes. Enhancing the scalability and usability of computational grids via logical user accounts and virtual file systems. In Proceedings of the Heterogeneous Computing Workshop (HCW) at the International Parallel and Distributed Processing Symposium (IPDPS), San Francisco, California, April 2001.

Digital Library

[21]

N. H. Kapadia and J. A. B. Fortes. On the design of a demand-based network-computing system: The Purdue University Network-Computing Hubs. In Proceedings of the 7th IEEE International Symposium on High Performance Distributed Computing (HPDC'98), pages 71-80, Chicago, Illinois, July 1998.

Digital Library

[22]

K. Lawton. Running multiple operating systems concurrently on an ia32 pc using virtualization techniques. www.plex86.org/research/paper.txt.

[23]

S. E. Madnick and J. J. Donovan. Application and analysis of the virtual machine approach to information system security and isolation. In Proc. ACM SIGARCH-SYSOPS Workshop on Virtual Computer Systems, pages 210-224, Boston, MA, March 1973.

Digital Library

[24]

R. A. Meyer and L. H. Seawright. A virtual machine time sharing system. IBM System Journal, 9(3):199-218, 1970.

Digital Library

[25]

A. Polze, G. Fohler, and M. Werner. Predictable network computing. In Proceedings of the 17th International Conference on Distributed Computing Systems (ICDCS'97), pages 423-431, May 1997.

Digital Library

[26]

R. Rajkumar, K. Juvva, A. Molano, and S. Oikawa. Resource kernels: A resource-centric approach to real-time systems. In Proceedings of the SPIE/ACM Conference on Multimedia Computing and Networking, January 1998.

[27]

B. K. Schmidt. Supporting Ubiquitous Computing with Stateless Consoles and Computation Caches. PhD thesis, Department of CS, Stanford University, Aug 2000.

Digital Library

[28]

D. C. Schmidt, A. Gokhale, T. H. Harrison, and G. Parulkar. A high-performance endsystem architecture for real-time CORBA. IEEE Communication Magazine, 14(2), February 1997.

Digital Library

[29]

J. E. Smith. An overview of virtual machine architectures. http://www.ece.wisc.edu/jes/papers/vms.pdf, Oct 2001.

[30]

J. Sugerman, G. Venkitachalan, and B.-H. Lim. Virtualizing I/O devices on VMware workstation's hosted virtual machine monitor. In Proceedings of the USENIX Annual Technical Conference, June 2001.

Digital Library

[31]

N. Suri, J. M. Bradshaw, M. R. Breedy, K. M. Ford, P. T. Groth, G. A. Hill, and R. Saavedra. State capture and resource control for java: The design and implementation of the aroma virtual machine. In Java Virtual Machine Research and Technology Symposium, USENIX, April 2001.

Digital Library

[32]

D. Thain, J. Basney, S.-C. Son, and M. Livny. The kangaroo approach to data movement on the grid. In Proceedings of the 2001 IEEE International Conference on High-Performance Distributed Computing (HPDC), pages 325- 333, Aug. 2001.

Digital Library

[33]

G. Vigna, editor. Mobile Agents and Security, volume 1419 of Lecture Notes in Computer Science. Springer-Verlag, June 1998.

Digital Library

[34]

C. A. Waldspurger and W. E. Weihl. Lottery scheduling: Flexible proportional-share resource management. In Proceedings of the First Symposium on Operating Systems Design and Implementation. Usenix, 1994.

Digital Library

[35]

Y.-C. Wang and K.-J. Lin. Implementing a general real-time scheduling framework in the RED-linux real-time kernel. In IEEE Real-Time Systems Symposium, pages 246-255, 1999.

Digital Library

[36]

A. Whitaker, M. Shaw, and S. Gribble. Denali: Lightweight virtual machines for distributed and networked applications. In Proceedings of the USENIX Technical Conference, Monterey, CA, June 2002.

[37]

B. S. White, A. S. Grimshaw, and A. Nguyen-Tuong. Grid-based file access: The Legion I/O model. In Proceedings of the 9th IEEE International Symposium on High Performance Distributed Computing (HPDC'00), pages 165-173, Pittsburgh, Pennsylvania, August 2000.

Digital Library

Cited By

Korkhov VKobyshev SKrosheninnikov A(2015)Flexible Configuration of Application-Centric Virtualized Computing InfrastructureProceedings, Part IV, of the 15th International Conference on Computational Science and Its Applications -- ICCSA 2015 - Volume 915810.1007/978-3-319-21410-8_27(342-353)Online publication date: 22-Jun-2015
https://dl.acm.org/doi/10.1007/978-3-319-21410-8_27
Moody WAnderson JWange KApon AYildirim EBalman MYildirim E(2014)Reconfigurable network testbed for evaluation of datacenter topologiesProceedings of the sixth international workshop on Data intensive distributed computing10.1145/2608020.2608023(11-20)Online publication date: 23-Jun-2014
https://dl.acm.org/doi/10.1145/2608020.2608023
Glatard TRousseau MRioux PAdalat REvans AReed DSun XFoster I(2014)Controlling the deployment of virtual machines on clusters and clouds for scientific computing in CBRAINProceedings of the 14th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing10.1109/CCGrid.2014.42(384-393)Online publication date: 26-May-2014
https://dl.acm.org/doi/10.1109/CCGrid.2014.42
Show More Cited By

Index Terms

A Case For Grid Computing On Virtual Machines

Recommendations

A case for high performance computing with virtual machines
ICS '06: Proceedings of the 20th annual international conference on Supercomputing

Virtual machine (VM) technologies are experiencing a resurgence in both industry and research communities. VMs offer many desirable features such as security, ease of management, OS customization, performance isolation, check-pointing, and migration, ...
Evaluating the performance and intrusiveness of virtual machines for desktop grid computing
IPDPS '09: Proceedings of the 2009 IEEE International Symposium on Parallel&Distributed Processing

We experimentally evaluate the performance overhead of the virtual environments VMware Player, QEMU, VirtualPC and VirtualBox on a dual-core machine. Firstly, we assess the performance of a Linux guest OS running on a virtual machine by separately ...
Traffic-sensitive live migration of virtual machines
CCGRID '15: Proceedings of the 15th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing

In this paper we address the problem of network contention between the migration traffic and the Virtual Machine (VM) application traffic for the live migration of co-located Virtual Machines. When VMs are migrated with pre-copy, they run at the source ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

ICDCS '03: Proceedings of the 23rd International Conference on Distributed Computing Systems

May 2003

ISBN:0769519202

Copyright © Copyright (c) 2003 Institute of Electrical and Electronics Engineers, Inc. All rights reserved.

Publisher

IEEE Computer Society

United States

Publication History

Published: 19 May 2003

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

102
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Korkhov VKobyshev SKrosheninnikov A(2015)Flexible Configuration of Application-Centric Virtualized Computing InfrastructureProceedings, Part IV, of the 15th International Conference on Computational Science and Its Applications -- ICCSA 2015 - Volume 915810.1007/978-3-319-21410-8_27(342-353)Online publication date: 22-Jun-2015
https://dl.acm.org/doi/10.1007/978-3-319-21410-8_27
Moody WAnderson JWange KApon AYildirim EBalman MYildirim E(2014)Reconfigurable network testbed for evaluation of datacenter topologiesProceedings of the sixth international workshop on Data intensive distributed computing10.1145/2608020.2608023(11-20)Online publication date: 23-Jun-2014
https://dl.acm.org/doi/10.1145/2608020.2608023
Glatard TRousseau MRioux PAdalat REvans AReed DSun XFoster I(2014)Controlling the deployment of virtual machines on clusters and clouds for scientific computing in CBRAINProceedings of the 14th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing10.1109/CCGrid.2014.42(384-393)Online publication date: 26-May-2014
https://dl.acm.org/doi/10.1109/CCGrid.2014.42
Xia LCui ZLange JTang YDinda PBridges P(2014)Fast VMM-based overlay networking for bridging the cloud and high performance computingCluster Computing10.1007/s10586-013-0274-717:1(39-59)Online publication date: 1-Mar-2014
https://dl.acm.org/doi/10.1007/s10586-013-0274-7
Gankevich IKorkhov VBalyan SGaiduchok VGushchanskiy DTipikin YDegtyarev ABogdanov A(2014)Constructing Virtual Private Supercomputer Using Virtualization and Cloud TechnologiesProceedings of the 14th International Conference on Computational Science and Its Applications ICCSA 2014 - Volume 858410.1007/978-3-319-09153-2_26(341-354)Online publication date: 30-Jun-2014
https://dl.acm.org/doi/10.1007/978-3-319-09153-2_26
Dang HHermenier FCachin Cvan Renesse R(2013)Higher SLA satisfaction in datacenters with continuous VM placement constraintsProceedings of the 9th Workshop on Hot Topics in Dependable Systems10.1145/2524224.2524226(1-6)Online publication date: 3-Nov-2013
https://dl.acm.org/doi/10.1145/2524224.2524226
Niu SZhai JMa XTang XChen WGropp WMatsuoka S(2013)Cost-effective cloud HPC resource provisioning by building semi-elastic virtual clustersProceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis10.1145/2503210.2503236(1-12)Online publication date: 17-Nov-2013
https://dl.acm.org/doi/10.1145/2503210.2503236
Stout LWalker MLauret JGoasguen SMurphy M(2013)Using Kestrel and XMPP to Support the STAR Experiment in the CloudJournal of Grid Computing10.1007/s10723-013-9253-811:2(249-264)Online publication date: 1-Jun-2013
https://dl.acm.org/doi/10.1007/s10723-013-9253-8
Xia LCui ZLange JTang YDinda PBridges PEpema DKielmann TRipeanu M(2012)VNET/PProceedings of the 21st international symposium on High-Performance Parallel and Distributed Computing10.1145/2287076.2287116(259-270)Online publication date: 18-Jun-2012
https://dl.acm.org/doi/10.1145/2287076.2287116
Hillenbrand MMauch VStoess JMiller KBellosa FPierre GCristea V(2012)Virtual InfiniBand clusters for HPC cloudsProceedings of the 2nd International Workshop on Cloud Computing Platforms10.1145/2168697.2168706(1-6)Online publication date: 10-Apr-2012
https://dl.acm.org/doi/10.1145/2168697.2168706
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Table of Contents