Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Automated web testing based on textual-visual UI patterns: the UTF approach

Published: 17 September 2014 Publication History

Abstract

Automated software testing is the only resort for delivering quality software, since there are usually large test suites to be executed, especially for regression testing. Though many automated testing tools and techniques have been developed, they still do not solve all problems like cost and maintenance, and they can even be brittle in some situations, thus confining their adoption. To address these issues, we develop a pattern-based automated testing framework, called UTF (User-oriented Testing Framework), for Web applications. UTF encodes textual-visual information about and relationships between widgets into a domain specific language for test scripts based on the underlying invariant structural patterns in the DOM, which allows test scripts to be easily created and maintained. In addition, UTF provides flexible extension and customization capabilities to make it adaptable for various Web-application scenarios. Our experiences show UTF can greatly reduce the cost of adopting automated testing and facilitate its institutionalization.

References

[1]
Thummalapenta, S., Devaki, P., Sinha, S., Chandra, S., Gnanasundaram, S., Nagaraj, D., et al, 2013. Efficient and change-resilient test automation: An industrial case study. In Proceedings of the 35th International Conference on Software Engineering, ICSE 2013, IEEE Press, 1002--1011.
[2]
Memon, A. 2002. GUI Testing: Pitfalls and Process. Computer, 35, 8, (Aug. 2002), 87--88.
[3]
Jubula, Automated functional testing. http://www.eclipse.org/jubula/.
[4]
Thummalapenta, S., Sinha, S., Singhania, N. and Chandra, S. 2012. Automating Test Automation. In Proceedings of the 34th International Conference on Software Engineering, ICSE 2012, IEEE Press, 881--891.
[5]
Chatley, R., Ayres, J. and White, T. 2010. LiFT: Driving Development using a Business-Readable DSL for Web Testing. In Proceedings of 3rd International Conference on Software Testing, Verification, and Validation Workshops. IEEE CS Press, 460--468.
[6]
Mittas, N. AND Angelis. L. 2008. Combining Regression and Estimation by Analogy in a Semi-parametric Model for Software Cost Estimation, ESEM'08, Kaiserslautern, Germany (Oct. 2008), 70--79.
[7]
Lin, J., Chang, C., AND Huang, S. 2011. Research on Software Effort Estimation Combined with Genetic Algorithm and Support Vector Regression, Proc. International Symposium on Computer Science and Security (July, 2011), 349--352.
[8]
Dave, V.S. AND Dutta, K., 2012. Neural Network based Models for Software Effort Estimation: A Review, Artificial Intelligence Review, Springer, online 06 May 2012.
[9]
Huang, G.-B., Zhu, Q.-Y., AND Siew, C.-K. 2006. Extreme learning machine: Theory and applications, Neurocomputing, 70, 489--501.
[10]
Foss, T., Stensrud, E. Kitchenham, B.A., AND Myrtveit, I. 2003. A Simulation Study of the Model Evaluation Criterion MMRE, IEEE Trans. on Software Eng., 29, 11, (Nov.2003), 985--994.
[11]
Shepperd, M. J. AND MacDonell, S. G. 2012. Evaluating Prediction Systems in Software Project Estimation, Information and Software Technology, 54, 8, 820--827.
[12]
Kitchenham, B. A., Pickard, L. M., MacDonell, S. G., AND Shepperd, M. J. 2001. What accuracy statistics really measure, IEE Proc. Software, 148, 3, 81--85.
[13]
Korte, M. AND Port, D. 2008. Confidence in Software Cost Estimation Results based on MMRE and PRED, PROMISE'08, ACM, Germany, 63--70.
[14]
Lopez Martin, C. 2011. A Fuzzy Logic Model for predicting the Development effort of Short Scale Programs Based upon Two Independent Variables, Applied Soft Computing, 11, 724--732.
[15]
Kitchenham, B. A., Pfleeger, S. L., Pickard, L. M., Jones, P. W., Hoaglin, D. C., Emam, K. E., AND Rosenberg, J. 2007. Preliminary Guidelines for Empirical Research in Software Engineering, IEEE Trans. Software Eng., 28, 8, (Aug. 2002), 721--733.
[16]
Arcuri, A. AND Briand, L. 2011. A Practical Guide for Using Statistical Tests to Assess Randomized Algorithms in Software Engineering, ICSE'11, May 21-28, 2011, Honolulu, USA, 1--10.
[17]
Dave, V. S., Dutta, K. 2011. Comparison of Regression model, Feed-forward Neural Network and Radial Basis Neural Network for Software Development Effort estimation, ACM SIGSOFT Software Engineering Notes, 36, 1--5.
[18]
Idri, A. AND Zakrani, A. 2010. Design of Radial Basis Function Neural Networks for Software Effort Estimation, International Journal of Computer Science 4, 11--17.
[19]
Miyoung Shin AND Amrit L. Goel. 2000. Empirical Data Modeling in Software Engineering Using Radial Basis Functions, IEEE Trans. on Software Eng., 26, (June, 2000), 567--57.
[20]
Zakrani, A AND Idri, A. 2010. Applying Radial Basis Function Neural Networks on Fuzzy Clustering to Estimate Web Applications Effort, International review on Computers and Software (I.RE.CO.S.), 5, 5, (Sep. 2010) 516--524.
[21]
Prasad Reddy, P.V.G.D., Sudha, K.R., Rama Sree, P., AND Ramesh, S.N.S.V.S.C. 2010. Software Effort Estimation using Radial Basis and Generalized Regression Neural Networks, Journal of Computing, 2, 5, ( May, 2010), 87--92.
[22]
Lopez Martin, C., Claudia Isaza, AND Arturo Chavoya. 2012. Software Development Effort Prediction of Industrial Projects applying a General Regression Neural Network, Empir. Software Eng., 17, 738--756.
[23]
Simon Haykin. 2010. Neural Networks and Learning Machines. PHI learning Private Limited, New Delhi, 3rd edition.
[24]
Specht, D. F. 1991. A General Regression Neural Network. IEEE Trans. on Neural Networks, 2, 6, (Nov.1991), 568--576.
[25]
Huang, G-B., Wang, D.H., AND Lan, Y. 2011. Extreme learning machines: a survey, International Journal of Machine Learning & Cybernetics 2, 107--122.
[26]
Olatunji, S.O., Rasheed, Z., Sattar, K.A., Al-Mana, A.M., Alshayeb, M., AND El-Sebakhy, E.A. 2010. Extreme Learning Machine as Maintainability Prediction model for Object-Oriented Software Systems, Journal of Computing, 2, 8, (Aug. 2010), 49--56.
[27]
http://www.ntu.edu.sg/home/egbhuang/elm_random_hidden_nodes.html, accessed on May 2012

Cited By

View all
  • (2023)A Systematic Review on Pattern-based GUI Testing of Android and Web Apps: State-of-the-Art, Taxonomy, Challenges and Future Directions2023 25th International Multitopic Conference (INMIC)10.1109/INMIC60434.2023.10465949(1-7)Online publication date: 17-Nov-2023
  • (2021)A survey on software test automation return on investment, in organizations predominantly from Bengaluru, IndiaInternational Journal of Engineering Business Management10.1177/1847979021106204413Online publication date: 17-Dec-2021

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM SIGSOFT Software Engineering Notes
ACM SIGSOFT Software Engineering Notes  Volume 39, Issue 5
September 2014
119 pages
ISSN:0163-5948
DOI:10.1145/2659118
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 September 2014
Published in SIGSOFT Volume 39, Issue 5

Check for updates

Author Tags

  1. automated testing
  2. domain-specific language
  3. user-interface pattern
  4. web application

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)16
  • Downloads (Last 6 weeks)0
Reflects downloads up to 21 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2023)A Systematic Review on Pattern-based GUI Testing of Android and Web Apps: State-of-the-Art, Taxonomy, Challenges and Future Directions2023 25th International Multitopic Conference (INMIC)10.1109/INMIC60434.2023.10465949(1-7)Online publication date: 17-Nov-2023
  • (2021)A survey on software test automation return on investment, in organizations predominantly from Bengaluru, IndiaInternational Journal of Engineering Business Management10.1177/1847979021106204413Online publication date: 17-Dec-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media