Abstract
Almost ten years after its premises, the Grid’5000 testbed has become one of the most complete testbed for designing or evaluating large-scale distributed systems. Initially dedicated to the study of High Performance Computing, the infrastructure has evolved to address wider concerns related to Desktop Computing, the Internet of Services and more recently the Cloud Computing paradigm. This paper present recent improvements of the Grid’5000 software and services stack to support large-scale experiments using virtualization technologies as building blocks. Such contributions include the deployment of customized software environments, the reservation of dedicated network domain and the possibility to isolate them from the others, and the automation of experiments with a REST API. We illustrate the interest of these contributions by describing three different use-cases of large-scale experiments on the Grid’5000 testbed. The first one leverages virtual machines to conduct larger experiments spread over 4000 peers. The second one describes the deployment of 10000 KVM instances over 4 Grid’5000 sites. Finally, the last use case introduces a one-click deployment tool to easily deploy major IaaS solutions. The conclusion highlights some important challenges of Grid’5000 related to the use of OpenFlow and to the management of applications dealing with tremendous amount of data.
The Grid’5000 experimental testbed and all development actions are supervised and financed by the INRIA ALADDIN framework with support from CNRS, RENATER, and several Universities as well as other funding bodies (see https://www.grid5000.fr). Grid’5000 experiments are partially supported by the INRIA large scale initiative Hemera. The IaaS deployment utility is a particular action developed with the support of the EIT ICT Labs.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Amazon ec2, http://aws.amazon.com/fr/ec2/
Bonfire, http://www.bonfire-project.eu/
Das-4, http://www.cs.vu.nl/das4/
Emulab, http://www.emulab.net/
Onelab, http://www.onelab.eu/
Open cirrus, https://opencirrus.org/
Openflow, http://www.openflow.org
Planetlab, http://www.planet-lab.org/
protogeni, http://www.protogeni.net/
Avetisyan, A., Campbell, R., Gupta, I., Heath, M., Ko, S., Ganger, G., Kozuch, M., O’Hallaron, D., Kunze, M., Kwan, T., Lai, K., Lyons, M., Milojicic, D., Lee, H.Y., Soh, Y.C., Ming, N.K., Luke, J.Y., Namgoong, H.: Open Cirrus: A Global Cloud Computing Testbed. IEEE Computer 43(4), 42–50 (2010)
Booting and using virtual machines on Grid’5000, https://www.grid5000.fr/mediawiki/index.php/Booting_and_Using_Virtual_Machines_on_Grid'5000/
Capit, N., Da Costa, G., Georgiou, Y., Huard, G., Martin, C., Mounié, G., Neyron, P., Richard, O.: A batch scheduler with high level components. In: Cluster Computing and Grid 2005 (CCGrid 2005), Cardiff. Royaume-Uni. (2005), http://hal.archives-ouvertes.fr/hal-00005106
Cappello, F., Caron, E., Dayde, M., Desprez, F., Jegou, Y., Primet, P., Jeannot, E., Lanteri, S., Leduc, J., Melab, N., Mornet, G., Namyst, R., Quetier, B., Richard, O.: Grid’5000: A large scale and highly reconfigurable grid experimental testbed. In: Proceedings of the 6th IEEE/ACM International Workshop on Grid Computing, GRID 2005, pp. 99–106. IEEE Computer Society, Washington, DC (2005), http://dx.doi.org/10.1109/GRID.2005.1542730
Claudel, B., Huard, G., Richard, O.: Taktuk, adaptive deployment of remote executions. In: Proceedings of the International Symposium on High Performance Distributed Computing, HPDC (May 2009)
Desprez, F., Fox, G., Jeannot, E., Keahey, K., Kozuch, M., Margery, D., Neyron, P., Nussbaum, L., Perez, C., Richard, O., Smith, W., von Laszewski, G., Voeckler, J.: Supporting Experimental Computer Science. Report, Argonne National Laboratory, Argonne (March 2012), http://www.nimbusproject.org/downloads/Supporting_Experimental_Computer_Science_final_draft.pdf
FutureGrid, https://portal.futuregrid.org/
Jeanvoine, E., Sarzyniec, L., Nussbaum, L.: Kadeploy3: Efficient and Scalable Operating System Provisioning for HPC Clusters. Rapport de recherche RR-8002, INRIA (June 2012), http://hal.inria.fr/hal-00710638
Keahey, K., Freeman, T.: Science Clouds: Early Experiences in Cloud Computing for Scientific Applications. In: Proceedings of the 2008 Conference on Cloud Computing and Its Applications (CCA), Chicago, IL, USA (2008)
Moreno-Vozmediano, R., Montero, R.S., Llorente, I.M.: Elastic management of cluster-based services in the cloud. In: Proceedings of the 1st Workshop on Automated Control for Datacenters and Clouds (ACDC), pp. 19–24. ACM, New York (2009)
One-click Cloud deployment tools, https://www.grid5000.fr/mediawiki/index.php/Deployment_Scripts_for_IaaS_Clouds_on_Grid%275000
OpenNebula, http://opennebula.org/
Opscode. Chef, http://www.opscode.com/chef/
Quesnel, F., Lèbre, A., Südholt, M.: Cooperative and Reactive Scheduling in Large-Scale Virtualized Platforms with DVMS. Concurrency and Computation: Practice and Experience, p. XX (December 2012), http://hal.archives-ouvertes.fr/hal-00675315
Riteau, P., Tsugawa, M., Matsunaga, A., Fortes, J., Keahey, K.: Large-Scale Cloud Computing Research: Sky Computing on FutureGrid and Grid’5000. ERCIM News (83), 41–42 (2010)
Sarzyniec, L., Badia, S., Jeanvoine, E., Nussbaum, L.: Scalability Testing of the Kadeploy Cluster Deployment System using Virtual Machines on Grid’5000. In: SCALE Challenge 2012, Held in Conjunction with CCGrid 2012, Ottawa, Canada (May 2012), http://hal.inria.fr/hal-00700962
SC11 Support for Experimental Computer Science Worskhop, http://graal.ens-lyon.fr/~desprez/SC11workshop.htm
Shvachko, K., Huang, H., Radia, S., Chansler, R.: The Hadoop distributed file system. In: MSST 2010: Proceedings of the 26th IEEE Symposium on Massive Storage Systems and Technologies, Incline Village, NV, USA, pp. 1–10 (May 2010)
The Nimbus Project, http://www.nimbusproject.org/
The OAR Project, http://oar.imag.fr/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer International Publishing Switzerland
About this paper
Cite this paper
Balouek, D. et al. (2013). Adding Virtualization Capabilities to the Grid’5000 Testbed. In: Ivanov, I.I., van Sinderen, M., Leymann, F., Shan, T. (eds) Cloud Computing and Services Science. CLOSER 2012. Communications in Computer and Information Science, vol 367. Springer, Cham. https://doi.org/10.1007/978-3-319-04519-1_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-04519-1_1
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-04518-4
Online ISBN: 978-3-319-04519-1
eBook Packages: Computer ScienceComputer Science (R0)