Article

Supporting Continuous Integration by Code-Churn Based Test Selection

Authors:

Magnus CastellAuthors Info & Claims

RCOSE '15: Proceedings of the 2015 IEEE/ACM 2nd International Workshop on Rapid Continuous Software Engineering

Pages 19 - 25

https://doi.org/10.1109/RCoSE.2015.11

Published: 23 May 2015 Publication History

Abstract

Continuous integration promises advantages in large-scale software development by enabling software development organizations to deliver new functions faster. However, implementing continuous integration in large software development organizations is challenging because of organizational, social and technical reasons. One of the technical challenges is the ability to rapidly prioritize the test cases which can be executed quickly and trigger the most failures as early as possible. In our research we propose and evaluate a method for selecting a suitable set of functional regression tests on system level. The method is based on analysis of correlations between test-case failures and source code changes and is evaluated by combining semi-structured interviews and workshops with practitioners at Ericsson and Axis Communications in Sweden. The results show that using measures of precision and recall, the test cases can be prioritized. The prioritization leads to finding an optimal test suite to execute before the integration.

Cited By

View all

Zhang GLiu LChen ZWang JFilkov VRay BZhou M(2024)Hybrid Regression Test Selection by Integrating File and Method DependencesProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3695525(1557-1569)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691620.3695525
Arrieta AValle PAgirre JSagardui G(2023)Some Seeds Are Strong: Seeding Strategies for Search-based Test Case SelectionACM Transactions on Software Engineering and Methodology10.1145/353218232:1(1-47)Online publication date: 13-Feb-2023
https://dl.acm.org/doi/10.1145/3532182
Omri SSinz CGuizzo GPanichella S(2022)Learning to rank for test case prioritizationProceedings of the 15th Workshop on Search-Based Software Testing10.1145/3526072.3527525(16-24)Online publication date: 9-May-2022
https://dl.acm.org/doi/10.1145/3526072.3527525
Show More Cited By

Supporting Continuous Integration by Code-Churn Based Test Selection
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis

Recommendations

Supporting continuous integration by code-churn based test selection
RCoSE '15: Proceedings of the Second International Workshop on Rapid Continuous Software Engineering

Continuous integration promises advantages in large-scale software development by enabling software development organizations to deliver new functions faster. However, implementing continuous integration in large software development organizations is ...
Improving continuous integration with similarity-based test case selection
AST '18: Proceedings of the 13th International Workshop on Automation of Software Test

Automated testing is an essential component of Continuous Integration (CI) and Delivery (CD), such as scheduling automated test sessions on overnight builds. That allows stakeholders to execute entire test suites and achieve exhaustive test coverage, ...
Test Integration for SOC Supporting Very Low-Cost Testers
ATS '09: Proceedings of the 2009 Asian Test Symposium

To reduce test cost for SOC products, it is important to reduce the cost of testers. When using low-cost testers which have a limited test bandwidth to perform testing, Built-In- Self-Test (BIST) is necessary to reduce the data volume to be transmitted ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

RCOSE '15: Proceedings of the 2015 IEEE/ACM 2nd International Workshop on Rapid Continuous Software Engineering

May 2015

44 pages

ISBN:9781467370677

Publisher

IEEE Computer Society

United States

Publication History

Published: 23 May 2015

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zhang GLiu LChen ZWang JFilkov VRay BZhou M(2024)Hybrid Regression Test Selection by Integrating File and Method DependencesProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3695525(1557-1569)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691620.3695525
Arrieta AValle PAgirre JSagardui G(2023)Some Seeds Are Strong: Seeding Strategies for Search-based Test Case SelectionACM Transactions on Software Engineering and Methodology10.1145/353218232:1(1-47)Online publication date: 13-Feb-2023
https://dl.acm.org/doi/10.1145/3532182
Omri SSinz CGuizzo GPanichella S(2022)Learning to rank for test case prioritizationProceedings of the 15th Workshop on Search-Based Software Testing10.1145/3526072.3527525(16-24)Online publication date: 9-May-2022
https://dl.acm.org/doi/10.1145/3526072.3527525
Greca RMiranda BGligoric MBertolino AGarrido AWong WDe Angelis GDo HNguyen B(2022)Comparing and combining file-based selection and similarity-based prioritization towards regression test orchestrationProceedings of the 3rd ACM/IEEE International Conference on Automation of Software Test10.1145/3524481.3527223(115-125)Online publication date: 17-May-2022
https://dl.acm.org/doi/10.1145/3524481.3527223
Elsner DWuersching RSchnappinger MPretschner AGraber MDammer RReimer SHarman MMiller H(2022)Build system aware multi-language regression test selection in continuous integrationProceedings of the 44th International Conference on Software Engineering: Software Engineering in Practice10.1145/3510457.3513078(87-96)Online publication date: 21-May-2022
https://dl.acm.org/doi/10.1145/3510457.3513078
Al-Sabbagh KStaron MHebig RGomes FMcIntosh SXia XAmasaki S(2021)A classification of code changes and test types dependencies for improving machine learning based test selectionProceedings of the 17th International Conference on Predictive Models and Data Analytics in Software Engineering10.1145/3475960.3475987(40-49)Online publication date: 19-Aug-2021
https://dl.acm.org/doi/10.1145/3475960.3475987
Elsner DHauer FPretschner AReimer SCadar CZhang X(2021)Empirically evaluating readily available information for regression test optimization in continuous integrationProceedings of the 30th ACM SIGSOFT International Symposium on Software Testing and Analysis10.1145/3460319.3464834(491-504)Online publication date: 11-Jul-2021
https://dl.acm.org/doi/10.1145/3460319.3464834
Bertolino AGuerriero AMiranda BPietrantuono RRusso SRothermel GBae D(2020)Learning-to-rank vs ranking-to-learnProceedings of the ACM/IEEE 42nd International Conference on Software Engineering10.1145/3377811.3380369(1-12)Online publication date: 27-Jun-2020
https://dl.acm.org/doi/10.1145/3377811.3380369
Prado Lima JVergilio S(2020)Test Case Prioritization in Continuous Integration environmentsInformation and Software Technology10.1016/j.infsof.2020.106268121:COnline publication date: 1-May-2020
https://dl.acm.org/doi/10.1016/j.infsof.2020.106268
Widder DHilton MKästner CVasilescu BDumas MPfahl DApel SRusso A(2019)A conceptual replication of continuous integration pain points in the context of Travis CIProceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3338906.3338922(647-658)Online publication date: 12-Aug-2019
https://dl.acm.org/doi/10.1145/3338906.3338922
Show More Cited By

Abstract

Cited By

Recommendations