research-article

Identification of SLR tool needs - results of a community workshop

Authors:

Jeffrey C. Carver,

Ahmed Al-ZubidyAuthors Info & Claims

Information and Software Technology, Volume 70, Issue C

Pages 122 - 129

https://doi.org/10.1016/j.infsof.2015.10.011

Published: 01 February 2016 Publication History

Abstract

Context: With the increasing popularity of the Systematic Literature Review (SLR) process, there is also an increasing need for tool support. Objective:The goal of this work was to consult the software engineering researchers who conduct SLRs to identify and prioritize the necessary SLR tool features. Method: To gather information required to address this goal, we invited SLR authors to participate in an interactive 2 h workshop structured around the Nominal Group Technique. Results: The workshop outcomes indicated that Search & Selection and Collaboration are the two highest priority tool features. The results also showed that most of the high-priority features are not well-supported in current tools. Conclusion: These results support and extend the results of prior work. SLR tool authors can use these findings to guide future development efforts.

References

[1]

B. Kitchenham, S. Charters, Keele University and Durham University, 2007.

[2]

S. Imtiaz, M. Bano, N. Ikram, M. Niazi, A tertiary study: experiences of conducting systematic literature reviews in software engineering, ACM, New York, NY, USA, 2013.

[3]

E. Hassler, J.C. Carver, N.A. Kraft, D. Hale, Outcomes of a community workshop to identify and rank barriers to the systematic literature review process, 2014.

[4]

C. Marshall, P. Brereton, Tools to support systematic literature reviews in software engineering: a mapping study, 2013.

[5]

M. Ghafari, M. Saleh, T. Ebrahimi, A federated search approach to facilitate systematic literature review in software engineering, Int. J. Softw. Eng. Appl., 3 (2012) 13-24.

[6]

K.R. Felizardo, G.F. Andery, F.V. Paulovich, R. Minghim, J.C. Maldonado, A visual analysis approach to validate the selection review of primary studies in systematic reviews, Inf. Softw. Technol., 54 (2012) 1079-1091.

Digital Library

[7]

K. Felizardo, N. Salleh, R. Martins, E. Mendes, S. MacDonell, J. Maldonado, Using visual text mining to support the study selection activity in systematic literature reviews, 2011.

[8]

Y. Sun, Y. Yang, H. Zhang, W. Zhang, Q. Wang, Towards evidence-based ontology for supporting systematic literature review, 2012.

[9]

F. Tomassetti, G. Rizzo, A. Vetro, L. Ardito, M. Torchiano, M. Morisio, Linked data approach for selection process automation in systematic reviews, 2011.

[10]

K.R. Felizardo, E. Nakawaga, D. Feitosa, R. Minghim, J.C. Maldonado, An approach based on visual text mining to support categorization and classification in the systematic mapping, 2010.

[11]

J.A.S. Torres, D.S. Cruzes, L.d.N. Salvador, Automatic results identification in software engineering papers. is it possible?, 2012.

[12]

D. Cruzes, M. Mendonca, V. Basili, F. Shull, M. Jino, Automated information extraction from empirical software engineering literature: is that possible?, 2007.

[13]

D. Cruzes, M. Mendonca, V. Basili, F. Shull, M. Jino, Using context distance measurement to analyze results across studies, 2007.

[14]

K.R. Felizardo, M. Riaz, M. Sulayman, E. Mendes, S.G. MacDonell, J.C. Maldonado, Analysing the use of graphs to represent the results of systematic reviews in software engineering, 2011.

[15]

D. Bowes, T. Hall, S. Beecham, Slurp - a tool to help large complex systematic literature reviews deliver valid and rigorous results, 2012.

[16]

A.M. Fernandez-Saez, M.G. Bocco, F.P. Romero, Slr-tool: a tool for performing systematic literature reviews, INSTICC Press, 2010.

[17]

A. Delbecq, A.V. de Ven, D. Gustafson, Scott, Foresman, 1975.

[18]

T.C. Lethbridge, S.E. Sim, J. Singer, Studying software engineers: data collection techniques for software field studies, Empir. Softw. Eng., 10 (2005) 311-341.

Digital Library

[19]

J.C. Carver, E. Hassler, E. Hernandes, N.A. Kraft, Identifying barriers to the systematic literature review process, 2013.

[20]

B.S. Barn, F. Raimondi, L. Athappian, T. Clark, Slrtool: A tool to support collaborative systematic literature reviews, Lisbon, Portugal, 2014.

[21]

C. Marshall, P. Brereton, B. Kitchenham, Tools to support systematic reviews in software engineering: a feature analysis, 2014.

[22]

C. Marshall, P. Brereton, B. Kitchenham, Tools to support systematic reviews in software engineering: a cross-domain survey using semi-structured interviews, 2015.

Cited By

Felizardo KLima MDeizepe AConte TSteinmacher I(2024)ChatGPT application in Systematic Literature Reviews in Software Engineering: an evaluation of its accuracy to support the selection activityProceedings of the 18th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement10.1145/3674805.3686666(25-36)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3674805.3686666
Namoun ATufail ANawaz WBenRhouma OAlshanqiti A(2023)A Systematic Literature Review on Service Composition for People with DisabilitiesComputational Intelligence and Neuroscience10.1155/2023/59345482023Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1155/2023/5934548
Campos TDamasceno EValentim N(2022)Proposal and Evaluation of a Collaborative IS to Support Systematic Reviews and Mapping StudiesProceedings of the XVIII Brazilian Symposium on Information Systems10.1145/3535511.3535531(1-8)Online publication date: 16-May-2022
https://dl.acm.org/doi/10.1145/3535511.3535531
Show More Cited By

Recommendations

An SLR-tool: search process in practice: a tool to conduct and manage systematic literature review (SLR)
ICSE '20: Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering: Companion Proceedings

Systematic Literature Reviews (SLRs) have established themselves as a method in the field of software engineering. The aim of an SLR is to systematically analyze existing literature in order to answer a research question. In this paper, we present a ...
Vision for SLR tooling infrastructure

ContextEven with the increasing use of Systematic Literature Reviews (SLR) in software engineering (SE), there are still a number of barriers faced by SLR authors. These barriers increase the cost of conducting SLRs. ObjectiveFor many of these barriers, ...
Decision support tools for SLR search string construction
TEEM'18: Proceedings of the Sixth International Conference on Technological Ecosystems for Enhancing Multiculturality

Systematic literature reviews (SLRs) have gained popularity during the last years as a form of providing state of the art about previous research. As part of the SLR tasks, devising the search strategy and particularly finding the right keywords to be ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Information and Software Technology

Information and Software Technology Volume 70, Issue C

February 2016

251 pages

ISSN:0950-5849

Issue’s Table of Contents

Copyright © Elsevier B.V.

Publisher

Butterworth-Heinemann

United States

Publication History

Published: 01 February 2016

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 24 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Felizardo KLima MDeizepe AConte TSteinmacher I(2024)ChatGPT application in Systematic Literature Reviews in Software Engineering: an evaluation of its accuracy to support the selection activityProceedings of the 18th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement10.1145/3674805.3686666(25-36)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3674805.3686666
Namoun ATufail ANawaz WBenRhouma OAlshanqiti A(2023)A Systematic Literature Review on Service Composition for People with DisabilitiesComputational Intelligence and Neuroscience10.1155/2023/59345482023Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1155/2023/5934548
Campos TDamasceno EValentim N(2022)Proposal and Evaluation of a Collaborative IS to Support Systematic Reviews and Mapping StudiesProceedings of the XVIII Brazilian Symposium on Information Systems10.1145/3535511.3535531(1-8)Online publication date: 16-May-2022
https://dl.acm.org/doi/10.1145/3535511.3535531
Shakeel YAlchokr RKrüger JLeich TSaake G(2022)Incorporating Altmetrics to Support Selection and Assessment of Publications During Literature AnalysesProceedings of the 26th International Conference on Evaluation and Assessment in Software Engineering10.1145/3530019.3530038(180-189)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3530019.3530038
Alchokr RBorkar MThotadarya SSaake GLeich TSorbo APanichella S(2022)Supporting systematic literature reviews using deep-learning-based language modelsProceedings of the 1st International Workshop on Natural Language-based Software Engineering10.1145/3528588.3528658(67-74)Online publication date: 21-May-2022
https://dl.acm.org/doi/10.1145/3528588.3528658
Hinderks AMayo FThomaschewski JEscalona MRothermel GBae D(2020)An SLR-tool: search process in practiceProceedings of the ACM/IEEE 42nd International Conference on Software Engineering: Companion Proceedings10.1145/3377812.3382137(81-84)Online publication date: 27-Jun-2020
https://dl.acm.org/doi/10.1145/3377812.3382137
Krüger JLausberger Cvon Nostitz-Wallwitz ISaake GLeich T(2020)Search. Review. Repeat? An empirical study of threats to replicating SLR searchesEmpirical Software Engineering10.1007/s10664-019-09763-025:1(627-677)Online publication date: 1-Jan-2020
https://dl.acm.org/doi/10.1007/s10664-019-09763-0
Badami MBaez MZamanirad SKang W(2020)On How Cognitive Computing Will Plan Your Next Systematic ReviewService-Oriented Computing – ICSOC 2020 Workshops10.1007/978-3-030-76352-7_32(324-333)Online publication date: 14-Dec-2020
https://dl.acm.org/doi/10.1007/978-3-030-76352-7_32
Shakeel YKrüger JNostitz-Wallwitz ISaake GLeich T(2019)Automated Selection and Quality Assessment of Primary StudiesJournal of Data and Information Quality10.1145/335690112:1(1-26)Online publication date: 16-Nov-2019
https://dl.acm.org/doi/10.1145/3356901
Al-Zubidy ACarver J(2019)Identification and prioritization of SLR search tool requirementsEmpirical Software Engineering10.1007/s10664-018-9626-524:1(139-169)Online publication date: 1-Feb-2019
https://dl.acm.org/doi/10.1007/s10664-018-9626-5
Show More Cited By

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents