Workshop Summary: 2019 IEEE / ACM Fourth International Workshop on Metamorphic Testing (MET 2019)
Pages 56 - 59
Abstract
MET is a relatively new workshop on metamorphic testing for academic researchers and industry practitioners. The first international workshop on MET (MET 2016) was co-located with the 38th International Conference on Software Engineering (ICSE 2016) in Austin TX, USA on May 16, 2016. Since then the workshop has become an annual event. This paper reports on the fourth International Workshop on Metamorphic Testing (MET 2019) held in Montréal, Canada on May 26, 2019, as part of the 41st International Conference on Software Engineering (ICSE 2019). We first outline the aims of the workshop, followed by a discussion of its keynote speech and technical program.
References
[1]
Barr, E.T., Harman, M., McMinn, P., Shahbaz, M., and Yoo, S. 2015. The oracle problem in software testing: A survey. IEEE Transactions on Software Engineering, 41(5), 507--525.
[2]
Beydeda, S. 2006. Self-metamorphic-testing components. In Proceedings of the 30th Annual International Computer Software and Applications Conference (COMPSAC 2006), vol. 1, pp. 265--272.
[3]
Bhagyashree, R. 2018. Google buys GraphicsFuzz, bringing fuzzy logic and metamorphic testing to Android graphics drivers (August 8, 2018). https://hub.packtpub.com/google-buys-graphicsfuzzbringing- fuzzy-logic-and-metamorphic-testing-to-androidgraphics- drivers/
[4]
Chan, W.K., Chen, T.Y., Lu, H., Tse, T.H., and Yau, S.S. 2006. Integration testing of context-sensitive middleware-based applications: A metamorphic approach. International Journal of Software Engineering and Knowledge Engineering, 16(5), 677--703.
[5]
Chan, W.K., Cheung, S.C., and Leung, K.R.P.H. 2007. A metamorphic testing approach for online testing of service-oriented software applications. International Journal of Web Services Research, 4(2), 60--80.
[6]
Chen, T.Y., Cheung, S.C., and Yiu, S.M. 1998. Metamorphic testing: A new approach for generating next test cases. Technical Report HKUST-CS98-01, Department of Computer Science, Hong Kong University of Science and Technology, Hong Kong.
[7]
Chen, T.Y., Ho, J.W.K., Liu, H., and Xie, X. 2009. An innovative approach for testing bioinformatics programs using metamorphic testing. BMC Bioinformatics, 10, article no. 24.
[8]
Chen, T.Y., Kuo, F.-C., Liu, H., Poon, P.-L., Towey, D., Tse, T.H., and Zhou, Z.Q. 2018. Metamorphic testing: A review of challenges and opportunities. ACM Computing Surveys, 51(1), article no. 4.
[9]
Chen, T.Y., Kuo, F.-C., Ma, W., Susilo, W., Towey, D., Voas, J., and Zhou, Z.Q. 2016. Metamorphic testing for cybersecurity. Computer, 49(6), 48--55.
[10]
Chen, T.Y., Poon, P.-L., and Xie, X. 2016. METRIC: METamorphic Relation Identification based on the Category-choice framework. Journal of Systems and Software, 116, 177--190.
[11]
Dwarakanath, A., Ahuja, M., Sikand, S., Rao, R.M., Bose, R.P.J.C., Dubash, N., and Podderm S. 2018. Identifying implementation bugs in machine learning based image classifiers using metamorphic testing. In Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2018), pp. 118--128.
[12]
Lindvall, M., Ganesan, D., Árdal, R., and Wiegand, R.E. 2015. Metamorphic model-based testing applied on NASA DAT: An experience report. In Proceedings of the 37th International Conference on Software Engineering (ICSE 2015), vol. 2, pp. 129--138.
[13]
Oliveira, R.A.P., Kanewala, U., and Nardi, P.A. 2015. Automated test oracles: State of the art, taxonomies, and trends. In Advances in Computers, A. Memon (ed.), vol. 95, pp. 113--199. Elsevier, Amsterdam, The Netherlands.
[14]
Patel, K. and Hierons, R.M. 2018. A mapping study on testing non-testable systems. Software Quality Journal, 26(5), 1373--1413.
[15]
Pezzè, M. and Zhang, C. 2014. Automated test oracles: A survey. In Advances in Computers, A. Memon (ed.), vol. 95, pp. 1--48. Elsevier, Amsterdam, The Netherlands.
[16]
Segura, S., Hierons, R.M., Benavides, D., and Ruiz-Cortés, A. 2011. Automated metamorphic testing on the analyses of feature models. Information and Software Technology, 53(3), 45--258.
[17]
Xie, X., Ho, J.W.K., Murphy, C., Kaiser, G.E., Xu, B., and Chen, T.Y. 2011. Testing and validating machine learning classifiers by metamorphic testing. Journal of Systems and Software, 84(4), 544--558.
[18]
Zhou, Z.Q., Xiang, S., and Chen, T.Y. 2016. Metamorphic testing for software quality assessment: A study of search engines. IEEE Transactions on Software Engineering, 42(3), 264--284.
[19]
Zhou, Z.Q., Zhang, S., Hagenbuchner, M., Tse, T.H., Kuo, F.-C., and Chen, T.Y. 2012. Automated functional testing of online search services. Software Testing, Verification and Reliability, 22(4), 221--243.
- Workshop Summary: 2019 IEEE / ACM Fourth International Workshop on Metamorphic Testing (MET 2019)
Recommendations
Workshop Summary of AISec'14: 2014 Workshop on Artificial Intelligent and Security
CCS '14: Proceedings of the 2014 ACM SIGSAC Conference on Computer and Communications SecurityIt is our great pleasure to welcome you to the 2014 ACM Workshop Artificial Intelligence and Security (AISec 2014) -- the seventh annual workshop addressing technologies that fuse intelligent systems into computer security applications and the ...
Workshop Summary: 2019 IEEE / ACM Second International Workshop on Emerging Trends in Software Engineering for Blockchain (WETSEB 2019)
The second Workshop on Emerging Trends in Software Engineering for Blockchain (WETSEB 2019) intends to pursue the experience of WETSEB 2018 which inherited from the past eight editions of WETSoM (Workshop on Emerging Trends on Software Metrics) the ...
Summary of the second ICSE workshop on web engineering
The series of workshops on Web Engineering started in 1998 with the World Wide Web Conference WWW7 in Brisbane, Australia, and has continued with WWW8 (Toronto, 1999) and WWW9 (Amsterdam, 2000). The first such workshop with the International Conference ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
July 2019
100 pages
ISSN:0163-5948
DOI:10.1145/3356773
- Editors:
- John Georgas,
- Dietmar Pfahl,
- Will Tracz
Copyright © 2019 Copyright is held by the owner/author(s).
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 22 October 2020
Published in SIGSOFT Volume 44, Issue 3
Check for updates
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 64Total Downloads
- Downloads (Last 12 months)3
- Downloads (Last 6 weeks)2
Reflects downloads up to 18 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in