article

Experiences evaluating the effectiveness of JML-JUnit testing

Authors:

Roy Patrick Tan,

Stephen H. EdwardsAuthors Info & Claims

ACM SIGSOFT Software Engineering Notes, Volume 29, Issue 5

Pages 1 - 4

https://doi.org/10.1145/1022494.1022545

Published: 01 September 2004 Publication History

Get Access

Abstract

This paper reports on the issues the authors encountered while evaluating the JML-JUnit unit testing strategy. Given a predefined set of parameter values, JML-JUnit can automatically provide unit tests for Java programs that have specifications. We present a mutation testing experiment that evaluates the effectiveness of this testing strategy, and the lessons learned from doing this experiment. We conclude that a benchmark will enable the testing research community to meaningfully assess testing approaches.

References

[1]

Kent Beck and Erich Gamma. Test-infected: programmers love writing tests. In More Java gems, pages 357--376. Cambridge University Press, 2000. http://junit.org/.

Digital Library

Google Scholar

[2]

Chandrasekhar Boyapati, Sarfraz Khurshid, and Darko Marinov. Korat: Automated testing based on Java predicates. In Proceedings of the International Symposium on Software Testing and Analysis, pages 123--133. ACM Press, 2002.

Digital Library

Google Scholar

[3]

Yoonsik Cheon and Gary T. Leavens. A simple and practical approach to unit testing: The JML and JUnit way. In Boris Magnusson, editor, ECOOP 2002--Object-Oriented Programming, 16th European Conference, Malaga, Spain, June 2002, Proceedings, volume 2374 of Lecture Notes in Computer Science, pages 231--255. Springer-Verlag, 2002.

Digital Library

Google Scholar

[4]

Roong-Ko Doong and Phyllis G. Frankl. The ASTOOT approach to testing object-oriented programs. ACM Trans. Softw. Eng. Methodol., 3(2):101--130, 1994.

Digital Library

Google Scholar

[5]

Stephen H. Edwards. Black-box testing using flow-graphs: an experimental assessment of effectiveness and automation potential. Software Testing, Verification and Reliability, 10(4):249--262, 2000.

Crossref

Google Scholar

[6]

Gary T. Leavens, Albert L. Baker, and Clyde Ruby. JML: A notation for detailed design. In Haim Kilov, Bernhard Rumpe, and Ian Simmonds, editors, Behavioral Specifications of Businesses and Systems, pages 175--188. Kluwer Academic Publishers, 1999.

Crossref

Google Scholar

[7]

I. Moore. Jester a JUnit test tester. In M. Marchesi and G. Succi, editors, Proceedings of the 2nd International Conference on Extreme Programming and Flexible Processes in Software Engineering, 2001.

Google Scholar

[8]

Mahesh Babu Mungara. A method for systematically generating tests from object-oriented class interfaces. Master's thesis, Virginia Tech, 2003. http://scholar.lib.vt.edu/theses/available/etd-10252003-144535/.

Google Scholar

Cited By

View all

Stepien BMallur KPeyton L(2015)Testing Business Processes Using TTCN-3Proceedings of the 17th International SDL Forum on SDL 2015: Model-Driven Engineering for Smart Cities - Volume 936910.1007/978-3-319-24912-4_18(252-267)Online publication date: 12-Oct-2015
https://dl.acm.org/doi/10.1007/978-3-319-24912-4_18
Stepien BPeyton L(2014)Innovation and evolution in integrated web application testing with TTCN-3International Journal on Software Tools for Technology Transfer (STTT)10.1007/s10009-013-0278-x16:3(269-283)Online publication date: 1-Jun-2014
https://dl.acm.org/doi/10.1007/s10009-013-0278-x
Jolly SGarousi VEskandar M(2012)Automated Unit Testing of a SCADA Control SoftwareProceedings of the 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation10.1109/ICST.2012.120(400-409)Online publication date: 17-Apr-2012
https://dl.acm.org/doi/10.1109/ICST.2012.120
Show More Cited By

Experiences evaluating the effectiveness of JML-JUnit testing
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis

Recommendations

Using testing and JUnit across the curriculum

While the usage of unit-testing frameworks such as JUnit has greatly increased over the last several years, it is not immediately apparent to students and instructors how to best use tools like JUnit and how to integrate testing across a computer ...
Junit with examples
A Static Approach to Prioritizing JUnit Test Cases

Test case prioritization is used in regression testing to schedule the execution order of test cases so as to expose faults earlier in testing. Over the past few years, many test case prioritization techniques have been proposed in the literature. Most ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM SIGSOFT Software Engineering Notes

ACM SIGSOFT Software Engineering Notes Volume 29, Issue 5

September 2004

321 pages

ISSN:0163-5948

DOI:10.1145/1022494

Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 2004

Published in SIGSOFT Volume 29, Issue 5

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
657
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Stepien BMallur KPeyton L(2015)Testing Business Processes Using TTCN-3Proceedings of the 17th International SDL Forum on SDL 2015: Model-Driven Engineering for Smart Cities - Volume 936910.1007/978-3-319-24912-4_18(252-267)Online publication date: 12-Oct-2015
https://dl.acm.org/doi/10.1007/978-3-319-24912-4_18
Stepien BPeyton L(2014)Innovation and evolution in integrated web application testing with TTCN-3International Journal on Software Tools for Technology Transfer (STTT)10.1007/s10009-013-0278-x16:3(269-283)Online publication date: 1-Jun-2014
https://dl.acm.org/doi/10.1007/s10009-013-0278-x
Jolly SGarousi VEskandar M(2012)Automated Unit Testing of a SCADA Control SoftwareProceedings of the 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation10.1109/ICST.2012.120(400-409)Online publication date: 17-Apr-2012
https://dl.acm.org/doi/10.1109/ICST.2012.120
Shrestha KRutherford M(2011)An Empirical Evaluation of Assertions as OraclesProceedings of the 2011 Fourth IEEE International Conference on Software Testing, Verification and Validation10.1109/ICST.2011.50(110-119)Online publication date: 21-Mar-2011
https://dl.acm.org/doi/10.1109/ICST.2011.50
Baharom SShukur Z(2011)An experimental assessment of module documentation-based testingInformation and Software Technology10.1016/j.infsof.2011.01.00553:7(747-760)Online publication date: 1-Jul-2011
https://dl.acm.org/doi/10.1016/j.infsof.2011.01.005
Wiederseiner CJolly SGarousi VEskandar M(2010)An open-source tool for automated generation of black-box xunit test code and its industrial evaluationProceedings of the 5th international academic and industrial conference on Testing - practice and research techniques10.5555/1885930.1885944(118-128)Online publication date: 3-Sep-2010
https://dl.acm.org/doi/10.5555/1885930.1885944
Wiederseiner CJolly SGarousi VEskandar M(2010)An Open-Source Tool for Automated Generation of Black-Box xUnit Test Code and Its Industrial EvaluationTesting – Practice and Research Techniques10.1007/978-3-642-15585-7_11(118-128)Online publication date: 2010
https://doi.org/10.1007/978-3-642-15585-7_11
Huth MGrumberg O(2009)Special section on advances in reachability analysis and decision proceduresInternational Journal on Software Tools for Technology Transfer (STTT)10.5555/3220882.322098711:2(85-94)Online publication date: 1-Apr-2009
https://dl.acm.org/doi/10.5555/3220882.3220987
Huth MGrumberg O(2009)Special section on advances in reachability analysis and decision procedures: contributions to abstraction-based system verificationInternational Journal on Software Tools for Technology Transfer10.1007/s10009-009-0100-y11:2(85-94)Online publication date: 4-Feb-2009
https://doi.org/10.1007/s10009-009-0100-y
Stepien BPeyton L(2009)Integration Testing of Web Applications and Databases Using TTCN-3E-Technologies: Innovation in an Open World10.1007/978-3-642-01187-0_26(306-318)Online publication date: 2009
https://doi.org/10.1007/978-3-642-01187-0_26
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Using testing and JUnit across the curriculum

Junit with examples

A Static Approach to Prioritizing JUnit Test Cases