research-article

Integration of high-performance computing into a VCL cloud

Authors:

Patrick Dreher,

Mladen VoukAuthors Info & Claims

VHPC '13: Proceedings of the 8th Workshop on Virtualization in High-Performance Cloud Computing

Article No.: 1, Pages 1 - 6

https://doi.org/10.1145/2535800.2535802

Published: 17 November 2013 Publication History

Get Access

Abstract

High-Performance Computing (HPC) services can range from those on peta-flop supercomputers down to smaller computational clusters used for HPC application development, pilot runs and staging. What they all have in common is that traditionally HPC facilities tend to be isolated from the more general scientific computing services. Advent of the cloud computing has started changing that. In this paper we discuss a very successful production-level architecture and policy framework for supporting HPC services within a more general cloud computing infrastructure called VCL. This integrated environment has been operating at NC State since fall 2004. It typically delivers over 14 million HPC CPU hours per year to NC State faculty and students. Our experience is that integration of HPC and non-HPC services in a cloud can substantially reduce the cost of both services.

References

[1]

Mladen Vouk, "Cloud Computing - Issues, Research and Implementations," Journal of Computing and Information Technology, 16 (4), 2008, pp 235-246

Crossref

Google Scholar

[2]

Patrick Dreher, Mladen A. Vouk, Eric Sills, Sam Averitt, "Evidence for a Cost Effective Cloud Computing Implementation Based Upon the NC State Virtual Computing Laboratory Model," in Advances in Parallel Computing, High Speed and Large Scale Scientific Computing, Edited by Wolfgang Gentzsch, Lucio Grandinetti, Gerhard Joubert, ISBN 978-1-60750-073-5, Volume 18, 2009, pp. 236 -- 250

Google Scholar

[3]

Henry E. Schaffer, Samuel F. Averitt, Marc I. Hoit, Aaron Peeler, Eric D. Sills, and Mladen A. Vouk, "NCSUs Virtual Computing Laboratory: A Cloud Computing Solution," IEEE Computer, pp. 94-97, July 2009.

Digital Library

Google Scholar

[4]

Mladen Vouk, Andy Rindos, Sam Averitt, John Bass, Michael Bugaev, Aaron Peeler, Henry Schaffer, Eric Sills, Sarah Stein, Josh Thompson, Matthew P. Valenzisi, "Using VCL Technology to Implement Distributed Reconfigurable Data Centers and Computational Services for Educational Institutions," IBM Journal of Research and Development, Vol. 53, No. 4, pp. 2:1-18, 2009

Digital Library

Google Scholar

[5]

Cameron Seay, Gary Tucker, Virtual Computing Initiative at a Small Public University, Communications of the ACM, Vol 53 (3), March 2010, pp. 75-83

Digital Library

Google Scholar

[6]

Mladen A. Vouk, Eric Sills, and Patrick Dreher, "Integration of High-Performance Computing into Cloud Computing Services," Ch 11 in Handbook of Cloud Computing, editors B. Furht and A. Escalante, Springer, ISBN: 978-1-4419-6523-3, pp. 255-276, 2010

Google Scholar

[7]

Apache VCL, <url>http://vcl.apache.org, also http://vcl.ncsu.edu</url>

Google Scholar

[8]

Nikhil Talpallikar, "High-Performance Cloud Computing: VCL Case Study", NC State University M.S. Thesis, 2012

Google Scholar

[9]

Kaushal Didwania, "Performance Evaluation of Greenplumin VCL Cloud Computing Environment", NC State University M.S. Thesis, 2012

Google Scholar

[10]

Georgy Mathew Kallumkal, "A Micro-cloud Model for Adaptable High Performance Computing," NC State University M.S. Thesis, 2013.

Google Scholar

[11]

NSF-Sponsored Workshop Report: Sustainable Funding and Business Models for Academic Cyberinfrastructure Facilities, D. Lifka, ed (2010) <url>http://www.cac.cornell.edu/~lifka/Downloads/SRCC/NS F-sponsored-Sustainable-Cyberinfrastructure-Report.pdf</url>

Google Scholar

[12]

Patrick Dreher, Mladen Vouk, Georgy Kallumkal, "Toward Implementation of a Software Defined Cloud on a Supercomputer" submitted to IC2E 2014 International Conference on Cloud Engineering

Google Scholar

Cited By

View all

Desnoyers PHennessey JHolden BKrieger ORudolph LYoung A(2015)Using Open Stack for an Open Cloud Exchange(OCX)Proceedings of the 2015 IEEE International Conference on Cloud Engineering10.1109/IC2E.2015.40(48-53)Online publication date: 9-Mar-2015
https://dl.acm.org/doi/10.1109/IC2E.2015.40

Integration of high-performance computing into a VCL cloud
1. Computer systems organization
  1. Architectures

Recommendations

High-Performance Cloud Computing: A View of Scientific Applications
ISPAN '09: Proceedings of the 2009 10th International Symposium on Pervasive Systems, Algorithms, and Networks

Scientific computing often requires the availability of a massive number of computers for performing large scale experiments. Traditionally, these needs have been addressed by using high-performance computing solutions and installed facilities such as ...
Grid and cloud computing integration with NGN
ICCOM: Proceedings of the 13th WSEAS international conference on Communications

Over the past few years, Grid computing has become an increasingly hot topic in the world of new technologies. It is gradually also becoming familiar to the mass public through scientific and industrial field trials. Grid computing has been adopted and ...
Enhancing the Grid with Cloud Computing

Scientific computing has evolved considerably in recent years. Scientific applications have become more complex and require an increasing number of computing resources to perform on a large scale. Grid computing has become widely used and is the chosen ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

VHPC '13: Proceedings of the 8th Workshop on Virtualization in High-Performance Cloud Computing

November 2013

10 pages

ISBN:9781450325097

DOI:10.1145/2535800

Conference Chairs:
Michael Alexander
TU Wien, Austria
,
Gianluigi Zanetti
CRS4, Italy
,
Anastassios Nanos
NTUA, Greece

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 November 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

SC13

Sponsor:

SC13: International Conference for High Performance Computing, Networking, Storage and Analysis

November 17 - 21, 2013

Colorado, Denver

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
260
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Desnoyers PHennessey JHolden BKrieger ORudolph LYoung A(2015)Using Open Stack for an Open Cloud Exchange(OCX)Proceedings of the 2015 IEEE International Conference on Cloud Engineering10.1109/IC2E.2015.40(48-53)Online publication date: 9-Mar-2015
https://dl.acm.org/doi/10.1109/IC2E.2015.40

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

High-Performance Cloud Computing: A View of Scientific Applications

Grid and cloud computing integration with NGN

Enhancing the Grid with Cloud Computing