Article

Model-Based testing through a GUI

Authors:

Antti Kervinen,

Tuula Pääkkönen,

Mika KataraAuthors Info & Claims

FATES'05: Proceedings of the 5th international conference on Formal Approaches to Software Testing

Pages 16 - 31

https://doi.org/10.1007/11759744_2

Published: 11 July 2005 Publication History

Abstract

So far, model-based testing approaches have mostly been used in testing through various kinds of APIs. In practice, however, testing through a GUI is another equally important application area, which introduces new challenges. In this paper, we introduce a new methodology for model-based GUI testing. This includes using Labeled Transition Systems (LTSs) in conjunction with action word and keyword techniques for test modeling. We have also conducted an industrial case study where we tested a mobile device and were able to find previously unreported defects. The test environment included a standard MS Windows GUI testing tool as well as components implementing our approach. Assessment of the results from an industrial point of view suggests directions for future development.

References

[1]

Kaner, C., Bach, J., Pettichord, B.: Lessons Learned in Software Testing. Wiley (2001)

Digital Library

[2]

Fewster, M., Graham, D.: Software Test Automation. Addison-Wesley (1999)

[3]

Buwalda, H.: Action figures. STQE Magazine, March/April 2003 (2003) 42-47

[4]

Symbian: Symbian Operating System homepage. (At URL http://www.symbian.com)

[5]

Virtanen, H., Hansen, H., Nieminen, J., Erkkilä, T.: Tampere verification tool. In: Proceedings of TACAS 2004. Volume 2988 of LNCS. Springer-Verlag (2004)

[6]

Helovuo, J., Leppänen, S.: Exploration testing. In: Proc. 2nd IEEE International Conference on Application of Concurrency to System Design. (2001) 201-210

Digital Library

[7]

Karsisto, K.: A new parallel composition operator for verification tools. Doctoral dissertation, Tampere University of Technology (number 420 in publications) (2003)

[8]

Mercury Interactive: QuickTest Pro homepage. (At URL http://www.mercury.com)

[9]

Intuwave: m-Test homepage. (At URL http://www.intuwave.com)

[10]

Musa, J.D.: Software reliability engineering in industry. In: Proc. SAFECOMP'99. Number 1698 in LNCS, Springer-Verlag (1999)

Digital Library

[11]

Kervinen, A., Virolainen, P.: Heuristics for faster error detection with automated black box testing. In: Proc. International Workshop on Model Based Testing (MBT'04). Number 111 in Electronic Notes in Theoretical Computer Science, Elsevier (2004)

Digital Library

[12]

El-Far, I.K.: Enjoying the perks of model-based testing. In: Proc. Software Testing, Analysis, and Review Conference (STARWEST) 2001. (2001)

[13]

Robinson, H.: Obstacles and opportunities for model-based testing in an industrial software environment. (At URL http://www.geocities.com/harry_robinson_testing/ ObstaclesAndOpportunities.pdf)

[14]

Apfelbaum, L., Doyle, J.: Model based testing. Software Quality Week Conference (1997)

[15]

Robinson, H.: Finite state model-based testing on a shoestring. (Software Testing, Analysis, and Review Conference (STARWEST) 1999. At URL http://www.geocities.com/ model_based_testing/shoestring.htm)

[16]

Ostrand, T., Anodide, A., Foster, H., Goradia, T.: A visual test development environment for GUI systems. In: ISSTA '98: Proc. 1998 ACM SIGSOFT International Symposium on Software Testing and Analysis, New York, NY, USA, ACM Press (1998) 82-92

Digital Library

[17]

Memon, A.M.: A comprehensive framework for testing graphical user interfaces. PhD thesis, University of Pittsburgh (2001)

Digital Library

[18]

Belli, F.: Finite-state testing of graphical user interfaces. In: Proc. 12th International Symposium on Software Reliability Engineering (ISSRE 2001), (IEEE CS) 34-43

Digital Library

[19]

Conformiq Software: Conformiq Test Generator homepage. (At URL http://www. conformiq.com)

Cited By

Ramler RKlammer CWetzlmaier TVos TPrasetya WGetir S(2019)Lessons learned from making the transition to model-based GUI testingProceedings of the 10th ACM SIGSOFT International Workshop on Automating TEST Case Design, Selection, and Evaluation10.1145/3340433.3342823(22-27)Online publication date: 26-Aug-2019
https://dl.acm.org/doi/10.1145/3340433.3342823
Morgado IPaiva A(2019)The iMPAcT Tool for Android TestingProceedings of the ACM on Human-Computer Interaction10.1145/33009633:EICS(1-23)Online publication date: 13-Jun-2019
https://dl.acm.org/doi/10.1145/3300963
Kra MAktemur BSzer H(2018)VISORJournal of Systems and Software10.1016/j.jss.2017.06.023136:C(266-277)Online publication date: 1-Feb-2018
https://dl.acm.org/doi/10.1016/j.jss.2017.06.023
Show More Cited By

Recommendations

Comparing model-based and dynamic event-extraction based GUI testing techniques

HighlightsWe compare model-based and dynamic event-extraction based GUI testing techniques.We present a exible GUI testing framework that enables comparison of techniques.We show that nonexecutable events weaken effectiveness and increase costs of ...
Towards a pattern language for model-based GUI testing
EuroPLoP '14: Proceedings of the 19th European Conference on Pattern Languages of Programs

Graphical user interfaces (GUIs) have become popular as they appear in everydays' software. GUIs have become an ideal way of interacting with computer programs, making the software friendlier to its users. GUIs have grown, and so has the usage of UI ...
Coverage criteria for GUI testing

A widespread recognition of the usefulness of graphical user interfaces (GUIs) has established their importance as critical components of today's software. GUIs have characteristics different from traditional software, and conventional testing ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

FATES'05: Proceedings of the 5th international conference on Formal Approaches to Software Testing

July 2005

217 pages

ISBN:3540344543

Editors:
Wolfgang Grieskamp
Microsoft Research, Redmond, WA
,
Carsten Weise
Ericsson Deutschland GmbH, Herzogenrath, WA, Germany

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 11 July 2005

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ramler RKlammer CWetzlmaier TVos TPrasetya WGetir S(2019)Lessons learned from making the transition to model-based GUI testingProceedings of the 10th ACM SIGSOFT International Workshop on Automating TEST Case Design, Selection, and Evaluation10.1145/3340433.3342823(22-27)Online publication date: 26-Aug-2019
https://dl.acm.org/doi/10.1145/3340433.3342823
Morgado IPaiva A(2019)The iMPAcT Tool for Android TestingProceedings of the ACM on Human-Computer Interaction10.1145/33009633:EICS(1-23)Online publication date: 13-Jun-2019
https://dl.acm.org/doi/10.1145/3300963
Kra MAktemur BSzer H(2018)VISORJournal of Systems and Software10.1016/j.jss.2017.06.023136:C(266-277)Online publication date: 1-Feb-2018
https://dl.acm.org/doi/10.1016/j.jss.2017.06.023
Morgado IPaiva ALink CEloranta V(2015)Test patterns for android mobile applicationsProceedings of the 20th European Conference on Pattern Languages of Programs10.1145/2855321.2855354(1-7)Online publication date: 8-Jul-2015
https://dl.acm.org/doi/10.1145/2855321.2855354
Morgado IPaiva ACohen MGrunske LWhalen M(2015)The iMPAcT toolProceedings of the 30th IEEE/ACM International Conference on Automated Software Engineering10.1109/ASE.2015.96(876-881)Online publication date: 9-Nov-2015
https://dl.acm.org/doi/10.1109/ASE.2015.96
Moreira RPaiva AEloranta Vvan Heesch U(2014)Towards a pattern language for model-based GUI testingProceedings of the 19th European Conference on Pattern Languages of Programs10.1145/2721956.2721972(1-8)Online publication date: 9-Jul-2014
https://dl.acm.org/doi/10.1145/2721956.2721972
Hu CNeamtiu IBertolino AFoster HLi J(2011)Automating GUI testing for Android applicationsProceedings of the 6th International Workshop on Automation of Software Test10.1145/1982595.1982612(77-83)Online publication date: 23-May-2011
https://dl.acm.org/doi/10.1145/1982595.1982612
Nguyen DStrooper PSüß J(2010)Automated functionality testing through GUIsProceedings of the Thirty-Third Australasian Conferenc on Computer Science - Volume 10210.5555/1862199.1862216(153-162)Online publication date: 1-Jan-2010
https://dl.acm.org/doi/10.5555/1862199.1862216
Nguyen DStrooper PSuess JZhu HChan WBudnik CKapfhammer G(2010)Model-based testing of multiple GUI variants using the GUI test generatorProceedings of the 5th Workshop on Automation of Software Test10.1145/1808266.1808270(24-30)Online publication date: 3-May-2010
https://dl.acm.org/doi/10.1145/1808266.1808270
Jääskeläinen AKatara MKervinen AHeiskanen HMaunumaa MPääkkönen T(2008)Model-Based Testing Service on the WebProceedings of the 20th IFIP TC 6/WG 6.1 international conference on Testing of Software and Communicating Systems: 8th International Workshop10.1007/978-3-540-68524-1_5(38-53)Online publication date: 10-Jun-2008
https://dl.acm.org/doi/10.1007/978-3-540-68524-1_5
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents