Towards an automatic approach to estimating test effort: An Experience Report
Authors: 
Amanda Oliveira de Sousa, Ismayle de Sousa Santos, Bruno Sabóia Aragão, Rossana M. de Castro AndradeAuthors Info & Claims
Pages 305 - 314
Abstract
Testing is a key activity to increase the quality of a software development project. However, this activity presents challenges, such as estimating the effort required to test software. Test estimates are sometimes performed based on experience, which may make the estimation inaccurate. In this paper, an experiment report is presented on the application of a semiautomatic approach to the estimation of the test effort, with the objective of systematizing the process of estimating the test effort and, at the same time, generating estimates closer to the actual effort spent. The approach was applied in a test factory and the estimated times were close to the actual effort, indicating that the approach used is promising.
References
[1]
R. M. C. Andrade, V. Lelli, R. N. S. Castro, and I. S. Santos. 2017. Fifteen Years of Industry and Academia Partnership: Lessons Learned from a Brazilian Research Group. In 2017 IEEE/ACM 4th International Workshop on Software Engineering Research and Industrial Practice (SER IP). 10--16.
[2]
Prasanta Bhattacharya, Praveen Ranjan Srivastava, and Bhanu Prasad. 2012. Software test effort estimation using particle swarm optimization. In Proceedings of the International Conference on Information Systems Design and Intelligent Applications 2012 (INDIA 2012) held in Visakhapatnam, India, January 2012. Springer, 827--835.
[3]
Rossana M. de Castro Andrade, Ismayle de Sousa Santos, Valéria Lelli, Káthia Marçal de Oliveira, and Ana Regina Cavalcanti da Rocha. 2017. Software Testing Process in a Test Factory - From Ad hoc Activities to an Organizational Standard. In ICEIS.
[4]
Daniel G e Silva, Mario Jino, and Bruno T de Abreu. 2010. Machine learning methods and asymmetric cost function to estimate execution effort of software testing. In Software Testing, Verification and Validation (ICST), 2010 Third International Conference on. IEEE, 275--284.
[5]
Olga Fedotova, Leonor Teixeira, Helena Alvelos, et al. 2013. Software Effort Estimation with Multiple Linear Regression: Review and Practical Application. J. Inf. Sci. Eng. 29, 5 (2013), 925--945.
[6]
Shaiful Islam, Bishwajit B Pathik, Manzur H Khan, and Mamun Habib. 2013. Software test estimation tools using use cases and functions. In Industrial Engineering and Engineering Management (IEEM), 2013 IEEE International Conference on. IEEE, 390--394.
[7]
Shaiful Islam, Bishwajit B Pathik, Manzur H Khan, and Mamun Habib. 2016. Software test estimation tool: Comparable with COCOMOII model. In Industrial Engineering and Engineering Management (IEEM), 2016 IEEE International Conference on. IEEE, 204--208.
[8]
Kamala Ramasubramani Jayakumar and Alain Abran. 2013. A survey of software test estimation techniques. Journal of Software Engineering and Applications 6, 10 (2013), 47.
[9]
Divya Kumar and KK Mishra. 2016. The Impacts of Test Automation on Software's Cost, Quality and Time to Market. Procedia Computer Science 79 (2016), 8--15.
[10]
Vu Nguyen, Vu Pham, and Vu Lam. 2013. qEstimation: A Process for Estimating Size and Effort of Software Testing. In Proceedings of the 2013 International Conference on Software and System Process (ICSSP 2013). ACM, New York, NY, USA, 20--28.
[11]
Alessandro Orso and Gregg Rothermel. 2014. Software testing: a research travelogue (2000--2014). In Proceedings of the on Future of Software Engineering. ACM, 117--132.
[12]
Madhukar Pai, Michael McCulloch, Jennifer D Gorman, Nitika Pai, Wayne Enanoria, Gail Kennedy, Prathap Tharyan, and John M Colford. 2004. Systematic reviews and meta-analyses: an illustrated, step-by-step guide. The National medical journal of India 17, 2 (2004), 86--95. http://europepmc.org/abstract/MED/15141602
[13]
Ismayle De Sousa Santos, Wellington Franco, Bruno S. Aragão, and Rossana Andrade. 2015. Definição e Apliçãao de um Processo de Testes Ágeis: um Relato de Experiência. (01 2015).
[14]
Ana Sanz, Javier Garcia, Javier Saldana, and Antonio Amescua. 2009. A proposal of a process model to create a Test Factory. In Software Quality, 2009. WOSQ'09. ICSE Workshop on. IEEE, 65--70.
[15]
Praveen Ranjan Srivastava, Sirish Kumar, AP Singh, and G Raghurama. 2011. Software testing effort: an assessment through fuzzy criteria approach. Journal of Uncertain Systems 5, 3 (2011), 183--201.
[16]
Praveen Ranjan Srivastava, Abhishek Varshney, Priyanka Nama, and Xin-She Yang. 2012. Software test effort estimation: a model based on cuckoo search. International Journal of Bio-Inspired Computation 4, 5 (2012), 278--285.
[17]
Maneela Tuteja, Gaurav Dubey, et al. 2012. A research study on importance of testing and quality assurance in software development life cycle (SDLC) models. International Journal of Soft Computing and Engineering 2, 3 (2012), 251--257.
[18]
Lucas Vieira, Cayk Barreto, Erick Santos, Bruno S. Aragão, Ismayle De Sousa Santos, and Rossana Andrade. 2018. Automação de Testes em uma Fábrica de Testes: Um Relato de Experiência. (06 2018).
Index Terms
- Towards an automatic approach to estimating test effort: An Experience Report
Recommendations
An Experience-Based Approach for Test Execution Effort Estimation
ICYCS '08: Proceedings of the 2008 The 9th International Conference for Young Computer ScientistsSoftware testing is becoming more and more important as it is a widely used activity to ensure software quality. Testing is now an essential phase in software development life cycle. Test execution becomes an activity in the critical path of project ...
Investigation on test effort estimation of mobile applications: Systematic literature review and survey
Abstract ContextIn the last few years, the exigency of mobile devices has proliferated to prodigious heights. The process of developing the mobile software/application proceeds amidst testing phase to verify the correctness of the ...
qEstimation: a process for estimating size and effort of software testing
ICSSP '13: Proceedings of the 2013 International Conference on Software and System ProcessSoftware testing is an essential activity of the software development lifecycle. To ensure quality, applicability, and usefulness of a product, development teams must spend considerable time and resources testing, which makes the estimation of the ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2018
384 pages
Copyright © 2018 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
In-Cooperation
- SBC: Brazilian Computer Society
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 17 October 2018
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
SBQS
Acceptance Rates
Overall Acceptance Rate 35 of 99 submissions, 35%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 135Total Downloads
- Downloads (Last 12 months)3
- Downloads (Last 6 weeks)0
Reflects downloads up to 09 Nov 2024
Other Metrics
Citations
Cited By
View allView Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in