Export Citations
Save this search
Please login to be able to save your searches and receive alerts for new content matching your search criteria.
- research-articleJune 2024
An Empirical Study on Automated Test Generation Tools for Java: Effectiveness and Challenges
Journal of Computer Science and Technology (JCST), Volume 39, Issue 3Pages 715–736https://doi.org/10.1007/s11390-023-1935-5AbstractAutomated test generation tools enable test automation and further alleviate the low efficiency caused by writing hand-crafted test cases. However, existing automated tools are not mature enough to be widely used by software testing groups. This ...
- research-articleApril 2024
Identifying and Explaining Safety-critical Scenarios for Autonomous Vehicles via Key Features
ACM Transactions on Software Engineering and Methodology (TOSEM), Volume 33, Issue 4Article No.: 94, Pages 1–32https://doi.org/10.1145/3640335Ensuring the safety of autonomous vehicles (AVs) is of utmost importance, and testing them in simulated environments is a safer option than conducting in-field operational tests. However, generating an exhaustive test suite to identify critical test ...
- short-paperSeptember 2024
SBFT Tool Competition 2024 - Cyber-Physical Systems Track
SBFT '24: Proceedings of the 17th ACM/IEEE International Workshop on Search-Based and Fuzz TestingPages 33–36https://doi.org/10.1145/3643659.3643932This report summarizes the results of the fourth edition of the 2024 Cyber-Physical Systems tool competition, held as part of the SBFT'24 workshop. Three tools (AmbieGenVAE, CRAG, and OptAngle) competed with the aim of triggering out-of-bounds errors of ...
- short-paperSeptember 2024
Syntest-JavaScript: Automated Unit-Level Test Case Generation for JavaScript
SBFT '24: Proceedings of the 17th ACM/IEEE International Workshop on Search-Based and Fuzz TestingPages 21–24https://doi.org/10.1145/3643659.3643928Over the last decades, various tools (e.g., AUSTIN and EvoSuite) have been developed to automate the process of unit-level test case generation. Most of these tools are designed for statically-typed languages, such as C and Java. However, as is shown in ...
- research-articleMay 2024
OpenSBT: A Modular Framework for Search-based Testing of Automated Driving Systems
ICSE-Companion '24: Proceedings of the 2024 IEEE/ACM 46th International Conference on Software Engineering: Companion ProceedingsPages 94–98https://doi.org/10.1145/3639478.3640027Search-based software testing (SBST) is an effective and efficient approach for testing automated driving systems (ADS). However, testing pipelines for ADS testing are particularly challenging as they involve integrating complex driving simulation ...
-
- research-articleMarch 2024
Causality-driven Testing of Autonomous Driving Systems
ACM Transactions on Software Engineering and Methodology (TOSEM), Volume 33, Issue 3Article No.: 74, Pages 1–35https://doi.org/10.1145/3635709Testing Autonomous Driving Systems (ADS) is essential for safe development of self-driving cars. For thorough and realistic testing, ADS are usually embedded in a simulator and tested in interaction with the simulated environment. However, their high ...
Learning and Repair of Deep Reinforcement Learning Policies from Fuzz-Testing Data
ICSE '24: Proceedings of the IEEE/ACM 46th International Conference on Software EngineeringArticle No.: 6, Pages 1–13https://doi.org/10.1145/3597503.3623311Reinforcement learning from demonstrations (RLfD) is a promising approach to improve the exploration efficiency of reinforcement learning (RL) by learning from expert demonstrations in addition to interactions with the environment. In this paper, we ...
Doppelgänger Test Generation for Revealing Bugs in Autonomous Driving Software
ICSE '23: Proceedings of the 45th International Conference on Software EngineeringPages 2591–2603https://doi.org/10.1109/ICSE48619.2023.00216Vehicles controlled by autonomous driving software (ADS) are expected to bring many social and economic benefits, but at the current stage not being broadly used due to concerns with regard to their safety. Virtual tests, where autonomous vehicles are ...
- research-articleFebruary 2023
Some Seeds Are Strong: Seeding Strategies for Search-based Test Case Selection
ACM Transactions on Software Engineering and Methodology (TOSEM), Volume 32, Issue 1Article No.: 17, Pages 1–47https://doi.org/10.1145/3532182The time it takes software systems to be tested is usually long. Search-based test selection has been a widely investigated technique to optimize the testing process. In this article, we propose a set of seeding strategies for the test case selection ...
- posterJuly 2022
Evolutionary-based automated testing for GraphQL APIs
GECCO '22: Proceedings of the Genetic and Evolutionary Computation Conference CompanionPages 778–781https://doi.org/10.1145/3520304.3528952The Graph Query Language (GraphQL) is a powerful language for APIs manipulation in web services. It has been recently introduced as an alternative solution for addressing the limitations of RESTful APIs. This paper introduces an automated solution for ...
- research-articleOctober 2022
More effective test case generation with multiple tribes of AI
ICSE '22: Proceedings of the ACM/IEEE 44th International Conference on Software Engineering: Companion ProceedingsPages 286–290https://doi.org/10.1145/3510454.3517066Software testing is a critical activity in the software development life cycle for quality assurance. Automated Test Case Generation (TCG) can assist developers by speeding up this process. It accomplishes this by evolving an initial set of randomly ...
- research-articleOctober 2022
SynTest-solidity: automated test case generation and fuzzing for smart contracts
ICSE '22: Proceedings of the ACM/IEEE 44th International Conference on Software Engineering: Companion ProceedingsPages 202–206https://doi.org/10.1145/3510454.3516869Ethereum is the largest and most prominent smart contract platform. One key property of Ethereum is that once a contract is deployed, it can not be updated anymore. This increases the importance of thoroughly testing the behavior and constraints of the ...
- short-paperFebruary 2023
Towards run-time search for real-world multi-agent systems
SBST '22: Proceedings of the 15th Workshop on Search-Based Software TestingPages 14–15https://doi.org/10.1145/3526072.3527537Multi-agent systems (MAS) may encounter uncertainties in the form of unexpected environmental conditions, sub-optimal system configurations, and unplanned interactions between autonomous agents. The number of combinations of such uncertainties may be ...
- short-paperFebruary 2023
GenRL at the SBST 2022 tool competition
SBST '22: Proceedings of the 15th Workshop on Search-Based Software TestingPages 49–50https://doi.org/10.1145/3526072.3527533GenRL is a Deep Reinforcement Learning-based tool designed to generate test cases for Lane-Keeping Assist Systems. In this paper, we briefly presents GenRL, and summarize the results of its participation in the Cyber-Physical Systems (CPS) tool ...
- short-paperFebruary 2023
AdaFrenetic at the SBST 2022 tool competition
SBST '22: Proceedings of the 15th Workshop on Search-Based Software TestingPages 41–42https://doi.org/10.1145/3526072.3527530AdaFrenetic is a test generation tool for testing Autonomous Driving System (ADS). It extends the genetic algorithm-based testing tool Frenetic by adjusting the road points to reduce the number of invalid test cases. This paper provides a brief overview ...
- research-articleSeptember 2021
Adaptive Hypermutation for Search-Based System Test Generation: A Study on REST APIs with EvoMaster
ACM Transactions on Software Engineering and Methodology (TOSEM), Volume 31, Issue 1Article No.: 2, Pages 1–52https://doi.org/10.1145/3464940REST web services are widely popular in industry, and search techniques have been successfully used to automatically generate system-level test cases for those systems. In this article, we propose a novel mutation operator which is designed specifically ...
- research-articleNovember 2021
FastCA: an effective and efficient tool for combinatorial covering array generation
ICSE '21: Proceedings of the 43rd International Conference on Software Engineering: Companion ProceedingsPages 77–80https://doi.org/10.1109/ICSE-Companion52605.2021.00040Combinatorial interaction testing (CIT) is a popular approach to detecting faults in highly configurable software systems. The core task of CIT is to generate a small test suite called a t-way covering array (CA), where t is the covering strength. A ...
- research-articleJanuary 2021
Generating highly-structured input data by combining search-based testing and grammar-based fuzzing
ASE '20: Proceedings of the 35th IEEE/ACM International Conference on Automated Software EngineeringPages 1224–1228https://doi.org/10.1145/3324884.3418930Software testing is an important and time-consuming task that is often done manually. In the last decades, researchers have come up with techniques to generate input data (e.g., fuzzing) and automate the process of generating test cases (e.g., search-...
- research-articleJanuary 2021
Good things come in threes: improving search-based crash reproduction with helper objectives
ASE '20: Proceedings of the 35th IEEE/ACM International Conference on Automated Software EngineeringPages 211–223https://doi.org/10.1145/3324884.3416643Writing a test case reproducing a reported software crash is a common practice to identify the root cause of an anomaly in the software under test. However, this task is usually labor-intensive and time-taking. Hence, evolutionary intelligence ...
- research-articleJanuary 2021
Defect prediction guided search-based software testing
ASE '20: Proceedings of the 35th IEEE/ACM International Conference on Automated Software EngineeringPages 448–460https://doi.org/10.1145/3324884.3416612Today, most automated test generators, such as search-based software testing (SBST) techniques focus on achieving high code coverage. However, high code coverage is not sufficient to maximise the number of bugs found, especially when given a limited ...