Abstract
Cloud computing is a paradigm that provides access to a flexible, elastic and on-demand computing infrastructure, allowing users to dynamically request virtual resources. However, researchers typically cannot experiment with critical parts of cloud systems such as the underlying cloud architecture, resource-provisioning policies and the configuration of resource virtualisation. This problem can be partially addressed through using simulations of cloud systems. Unfortunately, the problem of testing cloud systems is still challenging due to the many parameters that such systems typically have and the difficulty in determining whether an observed behaviour is correct. In order to alleviate these issues, we propose a methodology to semi-automatically test and validate cloud models by integrating simulation techniques and metamorphic testing.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Bertolino A, Grieskamp W, Hierons RM, Le Traon Y, Legeard B, Muccini H, Paradkar A, Rosenblum D, Tretmans J (2010) Model-based testing for the cloud. In: Practical Software Testing : Tool Automation and Human Factors, no. 10111 in Dagstuhl Seminar Proceedings. Schloss Dagstuhl - Leibniz-Zentrum fuer Informatik, Germany, pp 1–11
Buyya R, Beloglazov A, Abawajy J (2010) Energy-efficient management of data center resources for cloud computing: a vision, architectural elements, and open challenges. In: 16th Int. Conf. on Parallel and Distributed Processing Techniques and Applications, PDPTA’10. CSREA Press, pp 1–12
Buyya R, Ranjan R, Calheiros RN (2009) Modeling and simulation of scalable cloud computing environments and the CloudSim toolkit: challenges and opportunities. In: 7th High Performance Computing and Simulation Conference, HPCS’09. IEEE Computer Society, pp 1–11
Calheiros RN, Buyya R, De Rose CAF (2010) Building an automated and self-configurable emulation test bed for grid applications. Softw: Pract Experience 40(5):405–429
Casanova H, Legrand A, Quinson M (2008) SimGrid: a generic framework for large-scale distributed experiments. In: 10th Int. Conf. on Computer Modeling and Simulation, UKSIM’ 08
Castañé G, Núnez~ A, Llopis P, Carretero J (2013) E-mc2: a formal framework for energy modelling in cloud computing. Simul Model Pract Theor 39:56–75
Chen TY, Sun C, Wang G, Mu B, Liu H, Wang ZS (2012) A metamorphic relation-based approach to testing web services without oracles. Int J Web Serv. Res. 9(1):51–73
Garber L (2011) News briefs. IEEE Computer 44(6):18–20
Hierons RM, Merayo MG, Núñez M (2010) Mutation testing. In: Laplante P A (ed) Encyclopedia of Software Engineering. Taylor & Francis
Kim KH, Beloglazov A, Buyya R (2009) Power-aware provisioning of cloud resources for real-time services. In: Proceedings of the 7th International Workshop on Middleware for Grids, Clouds and e-Science. Urbana Champaign, Illinois, USA , pp 1–6
Kliazovich D, Bouvry P, Audzevich Y, Khan S (2012) Greencloud: a packet-level simulator of energy-aware cloud computing data centers. J Supercomput 62(3):1263–1283
Myers G (2004) The Art of Software Testing, 2nd edn. Wiley
Núñez A, Fernández J, Filgueira R, García F, Carretero J (2012) SIMCAN: a flexible, scalable and expandable simulation platform for modelling and simulating distributed architectures and applications. Simul Model Pract Theory 20(1):12–32
Núñez A, Vázquez-Poletti JL, Caminero AC, Castañé GG, Carretero J, Llorente IM (2012) iCanCloud: a flexible and scalable cloud infrastructure simulator. J Grid Comput 10(1):185– 209
Ried S, Kisker H, Matzke P, Bartels A, Lisserman M (2011) Sizing the cloud—a BT futures report. Understanding and quantifying the future of cloud computing. Forrester Research Report
Sulistio A, Cibej U, Venugopal S, Robic B, Buyya R (2008) A toolkit for modelling and simulating Data Grids: an extension to GridSim. Concurr Comput: Pract Experience 20(13):1591– 1609
The Network Simulator, NS-2: Web page at. Date of last access: 8th August, 2013. http://www.isi.edu/nsnam/ns/
Weyuker EJ (1982) On testing non-testable programs. Comput J 25(4):465–470
Acknowledgements
This research was partially supported by the Spanish MEC projects TESIS (TIN2009-14312-C02-01) and ESTuDIo (TIN2012-36812-C02-01).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Núñez, A., Hierons, R.M. A methodology for validating cloud models using metamorphic testing. Ann. Telecommun. 70, 127–135 (2015). https://doi.org/10.1007/s12243-014-0442-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12243-014-0442-7