Article

Towards quality of model-based testing in the ioco framework

Authors:

Michele Volpato,

Jan TretmansAuthors Info & Claims

JAMAICA 2013: Proceedings of the 2013 International Workshop on Joining AcadeMiA and Industry Contributions to testing Automation

Pages 41 - 46

https://doi.org/10.1145/2489280.2489293

Published: 15 July 2013 Publication History

Abstract

Since testing is an expensive process, automatic testing with smart test selection has been proposed as a way to reduce such expense. Such a selection of tests can be done using specification coverage functions. Model-based ioco theory, however, uses test suites which are not suitable for easy computation of coverage because of interdependence of their test cases. We define a new test suite that overcomes such problems. Using such a test suite we cast the test selection problem to a specification selection problem that aims at transforming the model to which a system under test must conform, in order to reduce the set of test cases. We give a canonical representation for the newly defined test suite.

References

[1]

R. Alur, T. Henzinger, O. Kupferman, and M. Vardi. Alternating refinement relations. In CONCUR’98, LNCS 1466, pages 163–178. Springer Berlin / Heidelberg, 1998.

Digital Library

[2]

Axini. http://www.axini.com.

[3]

A. Belinfante. JTorX: A Tool for On-Line Model-Driven Test Derivation and Execution. In TACAS 2010, LNCS 6015, pages 266–270. Springer Berlin / Heidelberg, 2010.

Digital Library

[4]

D. Clarke, T. Jéron, V. Rusu, and E. Zinovieva. STG: A Symbolic Test Generation Tool. In TACAS 2002, LNCS 2280, pages 151–173. Springer, 2002.

Digital Library

[5]

L. M. G. Feijs, N. Goga, S. Mauw, and J. Tretmans. Test Selection, Trace Distance and Heuristics. In TestCom 2002, pages 267–282. Kluwer, B.V., 2002.

Digital Library

[6]

L. Frantzen and J. Tretmans. Model-Based Testing of Environmental Conformance of Components. In FMCO 2006, LNCS 4709, pages 1–25. Springer-Verlag, 2007.

Digital Library

[7]

N. Goga and F. Moldoveanu. Test selections and coverages. In 17th CCECE 2004, pages 707–710. IEEE Canada, 2004.

[8]

J. He and K. J. Turner. Protocol-Inspired Hardware Testing. In IWTCS XII, pages 131–147. Kluwer Academic Publishers, 1999.

Digital Library

[9]

A. Hessel, K. G. Larsen, M. Mikucionis, B. Nielsen, P. Pettersson, and A. Skou. Testing Real-Time Systems Using UPPAAL. In Formal Methods and Testing, LNCS 4949, pages 77–117. Springer-Verlag, 2008.

Digital Library

[10]

C. Jard and T. Jéron. TGV: Theory, Principles and Algorithms: A Tool for the Automatic Synthesis of Conformance Test Cases for Non-Deterministic Reactive Systems. International Journal on STTT, 7(4):297–315, 2005.

Digital Library

[11]

M. Krichen and S. Tripakis. Black-box conformance testing for real-time systems. In SPIN 2004, LNCS 2989, pages 109–126. Springer, 2004.

[12]

M. Timmer, H. Brinksma, and M. I. A. Stoelinga. Model-Based Testing. In Software and Systems Safety: Specification and Verification, NATO Science for Peace and Security Series D, pages 1–32. IOS Press, Apr. 2011.

[13]

J. Tretmans. Model-Based Testing and Some Steps towards Test-Based Modelling. In Formal Methods for Eternal Networked Software Systems, LNCS 6659, pages 297–326. Springer Berlin / Heidelberg, 2011.

[14]

M. van der Bijl, A. Rensink, and J. Tretmans. Compositional Testing with ioco. In FATES 2003, pages 86–100. Springer-Verlag, 2004.

[15]

T. Willemse. Heuristics for ioco-Based Test-Based Modelling. In Formal Methods: Applications and Technology, LNCS 4346, pages 132–147. Springer Berlin / Heidelberg, 2007.

Digital Library

Cited By

Tretmans JJanssen R(2022)Goodbye iocoA Journey from Process Algebra via Timed Automata to Model Learning10.1007/978-3-031-15629-8_26(491-511)Online publication date: 7-Sep-2022
https://doi.org/10.1007/978-3-031-15629-8_26
Janssen RTretmans JHung CPapadopoulos G(2019)Matching implementations to specificationsProceedings of the 34th ACM/SIGAPP Symposium on Applied Computing10.1145/3297280.3297496(2196-2205)Online publication date: 8-Apr-2019
https://dl.acm.org/doi/10.1145/3297280.3297496
Janssen RVaandrager FTretmans J(2019)Relating Alternating Relations for Conformance and RefinementIntegrated Formal Methods10.1007/978-3-030-34968-4_14(246-264)Online publication date: 22-Nov-2019
https://doi.org/10.1007/978-3-030-34968-4_14
Show More Cited By

Index Terms

Towards quality of model-based testing in the ioco framework

Recommendations

Symbolic Model-based Test Selection

This paper addresses the problem of model-based off-line selection of test cases for testing the conformance of a black-box implementation with respect to a specification, in the context of reactive systems. Efficient solutions to this problem have been ...
n-Complete test suites for IOCO

An n-complete test suite for automata guarantees to detect all faulty implementations with a bounded number of states. We propose a construction of such a test suite for ioco conformance on labeled transition systems, which we derive from construction ...
Model-based testing of stochastic systems with IOCO theory
A-TEST 2016: Proceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation

We present essential concepts of a model-based testing framework for probabilistic systems with continuous time. Markov automata are used as an underlying model. Key result of the work is the solid core of a probabilistic test theory, that incorporates ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

JAMAICA 2013: Proceedings of the 2013 International Workshop on Joining AcadeMiA and Industry Contributions to testing Automation

July 2013

76 pages

ISBN:9781450321617

DOI:10.1145/2489280

General Chair:
Gabriella Carrozza
SESM scarl,Italy
,
Program Chairs:
Roberto Pietrantuono
Universita' di Napoli Federico II (Naples, Italy)
,
Vittorio Manetti
SESM scarl,Italy

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

In-Cooperation

SIGPLAN: ACM Special Interest Group on Programming Languages

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 July 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ISSTA '13

Sponsor:

SIGSOFT

ISSTA '13: Iitsnternational Symposium on Software Testing and Analysis

July 15, 2013

Lugano, Switzerland

Upcoming Conference

ISSTA '25

Sponsor:
sigsoft

34th ACM SIGSOFT International Symposium on Software Testing and Analysis

June 25 - 28, 2025

Trondheim , Norway

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
121
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Tretmans JJanssen R(2022)Goodbye iocoA Journey from Process Algebra via Timed Automata to Model Learning10.1007/978-3-031-15629-8_26(491-511)Online publication date: 7-Sep-2022
https://doi.org/10.1007/978-3-031-15629-8_26
Janssen RTretmans JHung CPapadopoulos G(2019)Matching implementations to specificationsProceedings of the 34th ACM/SIGAPP Symposium on Applied Computing10.1145/3297280.3297496(2196-2205)Online publication date: 8-Apr-2019
https://dl.acm.org/doi/10.1145/3297280.3297496
Janssen RVaandrager FTretmans J(2019)Relating Alternating Relations for Conformance and RefinementIntegrated Formal Methods10.1007/978-3-030-34968-4_14(246-264)Online publication date: 22-Nov-2019
https://doi.org/10.1007/978-3-030-34968-4_14
Neider DSmetsers RVaandrager FKuppens H(2019)Benchmarks for Automata Learning and Conformance TestingModels, Mindsets, Meta: The What, the How, and the Why Not?10.1007/978-3-030-22348-9_23(390-416)Online publication date: 26-Jun-2019
https://doi.org/10.1007/978-3-030-22348-9_23
Tretmans J(2017)On the Existence of Practical TestersModelEd, TestEd, TrustEd10.1007/978-3-319-68270-9_5(87-106)Online publication date: 27-Sep-2017
https://doi.org/10.1007/978-3-319-68270-9_5
van den Bos PJanssen RMoerman J(2017)n-Complete Test Suites for IOCOTesting Software and Systems10.1007/978-3-319-67549-7_6(91-107)Online publication date: 15-Sep-2017
https://doi.org/10.1007/978-3-319-67549-7_6
Volpato MTretmans J(2014)Active Learning of Nondeterministic Systems from an ioco PerspectivePart I of the Proceedings of the 6th International Symposium on Leveraging Applications of Formal Methods, Verification and Validation. Technologies for Mastering Change - Volume 880210.1007/978-3-662-45234-9_16(220-235)Online publication date: 8-Oct-2014
https://dl.acm.org/doi/10.1007/978-3-662-45234-9_16

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents