extended-abstract

GATE: game-based testing environment

Author:

Ning ChenAuthors Info & Claims

ICSE '11: Proceedings of the 33rd International Conference on Software Engineering

Pages 1078 - 1081

https://doi.org/10.1145/1985793.1986000

Published: 21 May 2011 Publication History

Get Access

Abstract

In this paper, we propose a game-based public testing mechanism called GATE. The purpose of GATE is to make use of the rich human resource on the Internet to help increase effectiveness in software testing and improve test adequacy. GATE facilitates public testing in three main steps: 1) decompose the test criterion satisfaction problem into many smaller sub-model satisfaction problems; 2) construct games for each individual sub-models and presenting the games to the public through web servers; 3) collect and convert public users' action sequence data into real test cases which guarantee to cover not adequately tested elements.

A preliminary study on apache-commons-math library shows that 44% of the branches have not been adequately tested by state of the art automatic test generation techniques. Among these branches, at least 42% are decomposable by GATE into smaller sub-problems. These elements naturally become the potential targets of GATE for public game-based testing.

References

[1]

S. Cooper, A. Treuille, J. Barbero, A. Leaver-Fay, K. Tuite, F. Khatib, A. C. Snyder, M. Beenen, D. Salesin, D. Baker, and Z. Popovi . The challenge of designing scientific discovery games. In Proc. FDG, 2010.

Digital Library

Google Scholar

[2]

L. M. de Moura and N. Bjørner. Z3: An efficient SMT solver. In Proc. TACAS, pages 337--340, 2008.

Digital Library

Google Scholar

[3]

E. Dijkstra. A Discipline of Programming. Prentice Hall, Englewood Cliffs, 1976.

Digital Library

Google Scholar

[4]

B. Dutertre and L. de Moura. System description: Yices 1.0. In Proc. SMT-COMP, 2006.

Google Scholar

[5]

H. Jaygarl, S. Kim, T. Xie, and C. K. Chang. OCAT: Object Capture-based Automated Testing. In Proc. ISSTA, 2010.

Digital Library

Google Scholar

[6]

C. C. Michael, G. McGraw, and M. A. Schatz. Generating software test data by evolution. IEEE Trans. Softw. Eng., 27:1085--1110, December 2001.

Digital Library

Google Scholar

[7]

C. Pacheco, S. K. Lahiri, M. D. Ernst, and T. Ball. Feedback-directed random test generation. In Proc. ICSE, pages 75--84, Minneapolis, MN, USA, May 23--25, 2007.

Digital Library

Google Scholar

[8]

R. Pandita, T. Xie, N. Tillmann, and J. de Halleux. Guided test generation for coverage criteria. In Proc. ICSM, 2010.

Digital Library

Google Scholar

[9]

N. Tillmann and J. de Halleux. Pex-white box test generation for .NET. In Proc. TAP, pages 134--153, 2008.

Digital Library

Google Scholar

[10]

L. Zhang, T. Xie, L. Zhang, N. Tillmann, J. de Halleux, and H. Mei. Test generation via dynamic symbolic execution for mutation testing. In Proc. ICSM, 2010.

Digital Library

Google Scholar

Cited By

View all

Parizi R(2016)On the gamification of human-centric traceability tasks in software testing and coding2016 IEEE 14th International Conference on Software Engineering Research, Management and Applications (SERA)10.1109/SERA.2016.7516146(193-200)Online publication date: Jun-2016
https://doi.org/10.1109/SERA.2016.7516146
Chen JMao X(2012)BodhiProceedings of the 2012 IEEE Sixth International Conference on Software Security and Reliability Companion10.1109/SERE-C.2012.35(168-173)Online publication date: 20-Jun-2012
https://dl.acm.org/doi/10.1109/SERE-C.2012.35

Index Terms

GATE: game-based testing environment
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

Puzzle-based automatic testing: bringing humans into the loop by solving puzzles
ASE '12: Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering

Recently, many automatic test generation techniques have been proposed, such as Randoop, Pex and jCUTE. However, usually test coverage of these techniques has been around 50-60% only, due to several challenges, such as 1) the object mutation problem, ...
On automatic generation of RTL validation test benches using circuit testing techniques
GLSVLSI '03: Proceedings of the 13th ACM Great Lakes symposium on VLSI

In this paper, we examine how good validation test benches can be automatically generated starting from the RTL description of a circuit. We develop our methodology based on extensive experiments performed with several popular benchmarks as well as ...
Looking for More Confidence in Refactoring? How to Assess Adequacy of Your Refactoring Tests
QSIC '08: Proceedings of the 2008 The Eighth International Conference on Quality Software

Refactoring is an important technique in today's software development practice. If applied correctly, it can significantly improve software design without altering behavior. During refactoring, developers rely on regression testing. However, without ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ICSE '11: Proceedings of the 33rd International Conference on Software Engineering

May 2011

1258 pages

ISBN:9781450304450

DOI:10.1145/1985793

General Chair:
Richard N. Taylor
UC Irvine, USA
,
Program Chairs:
Harald Gall
University of Zurich, Switzerland
,
Nenad Medvidović
University of Southern California, USA

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 May 2011

Check for updates

Author Tags

Qualifiers

Extended-abstract

Conference

ICSE11

Sponsor:

SIGSOFT

ICSE11: International Conference on Software Engineering

May 21 - 28, 2011

HI, Waikiki, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
202
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Parizi R(2016)On the gamification of human-centric traceability tasks in software testing and coding2016 IEEE 14th International Conference on Software Engineering Research, Management and Applications (SERA)10.1109/SERA.2016.7516146(193-200)Online publication date: Jun-2016
https://doi.org/10.1109/SERA.2016.7516146
Chen JMao X(2012)BodhiProceedings of the 2012 IEEE Sixth International Conference on Software Security and Reliability Companion10.1109/SERE-C.2012.35(168-173)Online publication date: 20-Jun-2012
https://dl.acm.org/doi/10.1109/SERE-C.2012.35

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Puzzle-based automatic testing: bringing humans into the loop by solving puzzles

On automatic generation of RTL validation test benches using circuit testing techniques

Looking for More Confidence in Refactoring? How to Assess Adequacy of Your Refactoring Tests