Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3185768.3186409acmconferencesArticle/Chapter ViewAbstractPublication PagesicpeConference Proceedingsconference-collections
keynote

Software Performance Testing in Virtual Time

Published: 02 April 2018 Publication History

Abstract

We show how traditional unit testing frameworks can be extended to support the simultaneous testing of behaviour and performance, by embedding performance models in mock objects. Because such models are virtual, and therefore execute in virtual time, performance tests can often be performed substantially quicker than when real resources are involved. Performance models also facilitate testing before some or all of a unit»s intended collaborators have been implemented. A key technical challenge is to overcome the impedance mismatch which arises when code that is executing in real time has to communicate with performance models that execute in virtual time. Solutions to this problem naturally facilitate virtual time scaling of both real code and performance models. We also explore potential applications of such time scaling in software performance testing and optimisation.

References

[1]
M. Awad and D. A. Menasc. 2016. Performance Model Derivation of Operational Systems through Log Analysis. In 2016 IEEE 24th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS). 159--168.
[2]
N. Baltas and A.J. Field. 2011. Software Performance Prediction with a Time Scaling Scheduling Profiler. In IEEE 19th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS 2011). IEEE, 107--116.
[3]
Enrico Barbierato, Marco Gribaudo, and Mauro Iacono. 2013. Performance Evaluation of NoSQL Big-Data applications using multi-formalism models. To appear (01 2013).
[4]
Charlie Curtsinger and Emery D. Berger. 2015. Coz: Finding Code That Counts with Causal Profiling. In Proceedings of the 25th Symposium on Operating Systems Principles (SOSP '15). ACM, New York, NY, USA, 184--197.
[5]
Salvatore Dipietro, Giuliano Casale, and Giuseppe Serazzi. 2017. A Queueing Network Model for Performance Prediction of Apache Cassandra. In Proceedings of the 10th EAI International Conference on Performance Evaluation Methodologies and Tools on 10th EAI International Conference on Performance Evaluation Methodologies and Tools (VALUETOOLS'16). 186--193.
[6]
Tim Mackinnon, Steve Freeman, and Philip Craig. 2000. Endo-Testing: Unit Testing with Mock Objects. eXtreme Programming and Flexible Processes in Software Engineering (2000), 287--301.
[7]
Efi Papatheocharous and Andreas S. Andreou. 2014. Empirical evidence and state of practice of Software agile teams. Journal of Software: Evolution and Process 26, 9 (2014), 855--866.
[8]
Connie U. Smith. 1990. Performance Engineering of Software Systems. Addison- Wesley.
[9]
Petr Stefan, Vojtech Horky, Lubomir Bulej, and Petr Tuma. 2017. Unit Testing Performance in Java Projects: Are We there Yet?. In Proceedings of the 8th ACM/SPEC on International Conference on Performance Engineering (ICPE '17). ACM, New York, NY, USA, 401--412.
[10]
K.Wang and M. M. H. Khan. 2015. Performance Prediction for Apache Spark Platform. In 2015 IEEE 17th International Conference on High Performance Computing and Communications, 2015 IEEE 7th International Symposium on Cyberspace Safety and Security, and 2015 IEEE 12th International Conference on Embedded Software and Systems. 166--173.
[11]
Murray Woodside, Greg Franks, and Dorina C. Petriu. 2007. The Future of Software Performance Engineering. In 2007 Future of Software Engineering (FOSE '07). IEEE Computer Society, Washington, DC, USA, 171--187.

Cited By

View all
  • (2023)Comparing Decentralized File Storage on Ethereum with InterPlanetary File System2023 Eighth International Conference on Informatics and Computing (ICIC)10.1109/ICIC60109.2023.10381922(1-6)Online publication date: 8-Dec-2023
  • (2023)Manual and Automated Web-based Testing of the NPTEL Portal2023 International Conference on Artificial Intelligence and Knowledge Discovery in Concurrent Engineering (ICECONF)10.1109/ICECONF57129.2023.10084058(1-7)Online publication date: 5-Jan-2023
  • (2019)Microservice-Tailored Generation of Session-Based Workload Models for Representative Load Testing2019 IEEE 27th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS)10.1109/MASCOTS.2019.00043(323-335)Online publication date: Oct-2019

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
ICPE '18: Companion of the 2018 ACM/SPEC International Conference on Performance Engineering
April 2018
212 pages
ISBN:9781450356299
DOI:10.1145/3185768
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 April 2018

Check for updates

Author Tags

  1. performance
  2. test-driven development

Qualifiers

  • Keynote

Conference

ICPE '18

Acceptance Rates

Overall Acceptance Rate 252 of 851 submissions, 30%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)6
  • Downloads (Last 6 weeks)2
Reflects downloads up to 22 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Comparing Decentralized File Storage on Ethereum with InterPlanetary File System2023 Eighth International Conference on Informatics and Computing (ICIC)10.1109/ICIC60109.2023.10381922(1-6)Online publication date: 8-Dec-2023
  • (2023)Manual and Automated Web-based Testing of the NPTEL Portal2023 International Conference on Artificial Intelligence and Knowledge Discovery in Concurrent Engineering (ICECONF)10.1109/ICECONF57129.2023.10084058(1-7)Online publication date: 5-Jan-2023
  • (2019)Microservice-Tailored Generation of Session-Based Workload Models for Representative Load Testing2019 IEEE 27th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS)10.1109/MASCOTS.2019.00043(323-335)Online publication date: Oct-2019

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media