Abstract
In this paper, the open source library libfsmtest is presented. It has been developed to support model-based testing with finite state machine (FSM) models. The library is provided as a collection of \(\mathtt{C}^{++}\) classes, each class supporting specific aspects of FSM creation and transformation, and test generation from FSM models. Additionally, the library provides main programs for test generation with the methods realised in the library and for testing ‘implementation FSMs’ with suites generated from ‘reference FSMs’. Moreover, a generic test harness is provided for running test suites against \(\mathtt{C}^{++}\) libraries. We explain the unique selling points of this library and compare it to competing approaches.
Funded by the Deutsche Forschungsgemeinschaft (DFG) – project number 407708394.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
Licensed according to MIT license https://opensource.org/licenses/MIT. Source code available under https://bitbucket.org/JanPeleska/libfsmtest.
- 2.
- 3.
States \(q,q'\) that are distinguishable in \(\alpha (A)\) are by construction also distinguishable in A, but not every pair of states distinguishable in A is distinguishable in \(\alpha (A)\).
- 4.
References
Ambrosio, A.M., Pinheiro, A.C., Simão, A.: FSM-based test case generation methods applied to test the communication software on board the ITASAT University satellite: a case study. J. Aerospace Technol. Manage. 6(4), 447–461 (2014). https://doi.org/10.5028/jatm.v6i4.369
Chen, W., Tang, C.Y., Vuong, S.T.: Improving the UIOV-method for protocol conformance testing. Comput. Commun. 18(9), 609–619 (1995). https://doi.org/10.1016/0140-3664(95)99804-L
Chow, T.S.: Testing software design modeled by finite-state machines. IEEE Trans. Softw. Eng. SE 4(3), 178–186 (1978)
Clarke, E.M., Grumberg, O., Peled, D.A.: Model Checking. The MIT Press, Cambridge (1999)
Dorofeeva, R., El-Fakih, K., Yevtushenko, N.: An improved conformance testing method. In: Wang, F. (ed.) FORTE 2005. LNCS, vol. 3731, pp. 204–218. Springer, Heidelberg (2005). https://doi.org/10.1007/11562436_16
Hierons, R.M.: Testing from a nondeterministic finite state machine using adaptive state counting. IEEE Trans. Comput. 53(10), 1330–1342 (2004). https://doi.org/10.1109/TC.2004.85, http://doi.ieeecomputersociety.org/10.1109/TC.2004.85
Hierons, R.M.: FSM quasi-equivalence testing via reduction and observing absences. Sci. Comput. Program. 177, 1–18 (2019). https://doi.org/10.1016/j.scico.2019.03.004
Huang, W., Özoguz, S., Peleska, J.: Safety-complete test suites. Softw. Qual. J. 27(2), 589–613 (2018). https://doi.org/10.1007/s11219-018-9421-y
Huang, W., Peleska, J.: Complete model-based equivalence class testing for nondeterministic systems. Formal Aspects Comput. 29(2), 335–364 (2016). https://doi.org/10.1007/s00165-016-0402-2
Huang, W., Peleska, J.: Complete requirements-based testing with finite state machines. CoRR abs/2105.11786 (2021). https://arxiv.org/abs/2105.11786
Hübner, F., Huang, W., Peleska, J.: Experimental evaluation of a novel equivalence class partition testing strategy. Softw. Syst. Modeling 18(1), 423–443 (2017). https://doi.org/10.1007/s10270-017-0595-8
Jorgensen, P.C.: The Craft of Model-Based Testing. CRC Press, Boca Raton (2017)
Luo, G., von Bochmann, G., Petrenko, A.: Test selection based on communicating nondeterministic finite-state machines using a generalized WP-method. IEEE Trans. Softw. Eng. 20(2), 149–162 (1994). https://doi.org/10.1109/32.265636
Machado, P.D.L., Silva, D.A., Mota, A.C.: Towards property oriented testing. Electron. Notes Theoret. Comput. Sci. 184(Suppl. C), 3–19 (2007). https://doi.org/10.1016/j.entcs.2007.06.001, http://www.sciencedirect.com/science/article/pii/S157106610700432X
Naito, S., Tsunoyama, M.: Fault detection for sequential machines by transition tours. In: Proceedings of IEEE Fault Tolerant Computing Conference, pp. 162–178 (1981)
Peleska, J.: Model-based avionic systems testing for the airbus family. In: 23rd IEEE European Test Symposium, ETS 2018, Bremen, Germany, May 28–June 1, 2018, pp. 1–10. IEEE (2018). https://doi.org/10.1109/ETS.2018.8400703, http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=8392663
Petrenko, A., Simao, A., Maldonado, J.C.: Model-based testing of software and systems: recent advances and challenges. Int. J. Softw. Tools Technol. Transf. 14(4), 383–386 (2012). https://doi.org/10.1007/s10009-012-0240-3
Petrenko, A., Yevtushenko, N., Lebedev, A., Das, A.: Nondeterministic state machines in protocol conformance testing. In: Rafiq, O. (ed.) Protocol Test Systems, VI, Proceedings of the IFIP TC6/WG6.1 Sixth International Workshop on Protocol Test systems, Pau, France, 28–30 September 1993. IFIP Transactions, vol. C-19, pp. 363–378. North-Holland (1993)
van de Pol, J., Meijer, J.: Synchronous or alternating? In: Margaria, T., Graf, S., Larsen, K.G. (eds.) Models, Mindsets, Meta: The What, the How, and the Why Not? LNCS, vol. 11200, pp. 417–430. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22348-9_24
Sachtleben, R., Peleska, J.: Effective grey-box testing with partial FSM models. CoRR abs/2106.14284 (2021). https://arxiv.org/abs/2106.14284
Shabaldina, N., Gromov, M.: Fsmtest-1.0: a manual for researches. In: 2015 IEEE East-West Design Test Symposium (EWDTS), pp. 1–4 (2015). https://doi.org/10.1109/EWDTS.2015.7493141
da Silva Simão, A.: Jplavisfsm (2021). https://github.com/adenilso/jplavisfsm. Accessed 27 Aug 2021
Soucha, M.: Fsmlib (2018). https://github.com/Soucha/FSMlib. Accessed 30 May 2021
Soucha, M., Bogdanov, K.: Spyh-method: An improvement in testing of finite-state machines. In: 2018 IEEE International Conference on Software Testing, Verification and Validation Workshops, ICST Workshops, Västerås, Sweden, 9–13 April 2018, pp. 194–203. IEEE Computer Society (2018). https://doi.org/10.1109/ICSTW.2018.00050
Soucha, M., Bogdanov, K.: Observation tree approach: active learning relying on testing. Comput. J. 63(9), 1298–1310 (2020). https://doi.org/10.1093/comjnl/bxz056
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 IFIP International Federation for Information Processing
About this paper
Cite this paper
Bergenthal, M., Krafczyk, N., Peleska, J., Sachtleben, R. (2022). libfsmtest An Open Source Library for FSM-Based Testing. In: Clark, D., Menendez, H., Cavalli, A.R. (eds) Testing Software and Systems. ICTSS 2021. Lecture Notes in Computer Science, vol 13045. Springer, Cham. https://doi.org/10.1007/978-3-031-04673-5_1
Download citation
DOI: https://doi.org/10.1007/978-3-031-04673-5_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-04672-8
Online ISBN: 978-3-031-04673-5
eBook Packages: Computer ScienceComputer Science (R0)