On How Cognitive Computing Will Plan Your Next Systematic Review
Pages 324 - 333
Abstract
Systematic literature reviews (SLRs) are at the heart of evidence-based research, setting the foundation for future research and practice. However, producing good quality timely contributions is a challenging and highly cognitive endeavor, which has lately motivated the exploration of automation and support in the SLR process. In this paper we address an often overlooked phase in this process, that of planning literature reviews, and explore under the lenses of cognitive process augmentation how to overcome its most salient challenges. In doing so, we report on the insights from 24 SLR authors on planning practices, its challenges as well as feedback on support strategies inspired by recent advances in cognitive computing. We frame our findings under the cognitive augmentation framework, and report on a prototype implementation and evaluation focusing on further informing the technical feasibility.
References
[1]
Báez M et al. Baresi L, Chi C-H, Suzuki J, et al. Gelee: cooperative lifecycle management for (composite) artifacts Service-Oriented Computing 2009 Heidelberg Springer 645-646
[2]
Barukh MC et al. Aiello M, Bouguettaya A, Tamburri DA, van den Heuvel W-J, et al. Cognitive augmentation in processes Next-Gen Digital Services. A Retrospective and Roadmap for Service Computing of the Future 2021 Cham Springer 123-137
[3]
Beheshti, A., Benatallah, B., Nouri, R., Chhieng, V.M., Xiong, H.T., Zhao, X.: Coredb: a data lake service. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, pp. 2451–2454 (2017)
[4]
Bojanowski P, Grave E, Joulin A, and Mikolov T Enriching word vectors with subword information Trans. Assoc. Comput. Linguist. 2017 5 135-146
[5]
Kenneth Ward Church Word2vec Nat. Lang. Eng. 2017 23 1 155-162
[6]
Créquit P, Trinquart L, Yavchitz A, and Ravaud P Wasted research when systematic reviews fail to provide a complete and up-to-date evidence synthesis: the example of lung cancer BMC Med. 2016 14 1 8
[7]
Garousi, V., Felderer, M.: Experience-based guidelines for effective and efficient data extraction in systematic reviews in software engineering. In: Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering, pp. 170–179 (2017)
[8]
Hassler E, Carver JC, Hale D, and Al-Zubidy A Identification of SLR tool needs-results of a community workshop Inf. Software Technol. 2016 70 122-129
[9]
Howard BE et al. Swift-review: a text-mining workbench for systematic review Syst. Rev. 2016 5 1 87
[10]
Huang, E.H., Socher, R., Manning, C.D., Ng, A.Y.: Improving word representations via global context and multiple word prototypes. In: Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 873–882 (2012)
[11]
Kitchenham B Procedures for performing systematic reviews Keele, UK, Keele University 2004 33 2004 1-26
[12]
Kontonatsios G et al. A semi-supervised approach using label propagation to support citation screening J. Biomed. Inform. 2017 72 67-76
[13]
Krivosheev E, Casati F, Baez M, and Benatallah B Combining crowd and machines for multi-predicate item screening Proc. ACM Hum.-Comput. Interact. 2018 2 CSCW 1-18
[14]
Lopes AA, Pinho R, Paulovich FV, and Minghim R Visual text mining using association rules Comput. Graph. 2007 31 3 316-326
[15]
Manning, C.D., Surdeanu, M., Bauer, J., Finkel, J.R., Bethard, S., McClosky, D.: The Stanford Corenlp natural language processing toolkit. In: Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pp. 55–60 (2014)
[16]
Marshall IJ, Kuiper J, and Wallace BC Robotreviewer: evaluation of a system for automatically assessing bias in clinical trials J. Am. Med. Inform. Assoc 2016 23 1 193-201
[17]
Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013)
[18]
Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems, pp. 3111–3119 (2013)
[19]
Ouzzani M, Hammady H, Fedorowicz Z, and Elmagarmid A Rayyan-a web and mobile app for systematic reviews Syst. Control Found. Appl. 2016 5 1 210
[20]
Palomino M, Dávila A, and Melendez K Mejia J, Muñoz M, Rocha Á, Peña A, and Pérez-Cisneros M Methodologies, methods, techniques and tools used on SLR elaboration: a mapping study Trends and Applications in Software Engineering 2019 Cham Springer 14-30
[21]
Pennington, J., Socher, R., Manning, C.D.: Glove: global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1532–1543 (2014)
[22]
Sampson M, Shojania KG, Garritty C, Horsley T, Ocampo M, and Moher D Systematic reviews can be produced and published faster J. Clin. Epidemiol. 2008 61 6 531-536
[23]
Shi, B., Lam, W., Jameel, S., Schockaert, S., Lai, K.P.: Jointly learning word embeddings and latent topics. In: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 375–384 (2017)
[24]
Speer, R., Chin, J., Havasi, C.: Conceptnet 5.5: an open multilingual graph of general knowledge. arXiv preprint arXiv:1612.03975 (2016)
[25]
Sun, Y., et al.: Crowdsourcing information extraction for biomedical systematic reviews. arXiv preprint arXiv:1609.01017 (2016)
[26]
Vaish, R., et al.: Crowd research: open and scalable university laboratories. In: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, pp. 829–843 (2017)
Index Terms
- On How Cognitive Computing Will Plan Your Next Systematic Review
Index terms have been assigned to the content through auto-classification.
Recommendations
The Systematic Review-lution: A Manifesto to Promote Rigour and Inclusivity in Research Synthesis
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing SystemsThe field of human-computer interaction (HCI) is maturing. Systematic reviews, a staple of many disciplines, play an important and often essential role in how each field contributes to human knowledge. On this prospect, we argue that our meta-level ...
NeXt generation/dynamic spectrum access/cognitive radio wireless networks: a survey
Today's wireless networks are characterized by a fixed spectrum assignment policy. However, a large portion of the assigned spectrum is used sporadically and geographical variations in the utilization of assigned spectrum ranges from 15% to 85% with a ...
Experiences using systematic review guidelines
EASE'06: Proceedings of the 10th international conference on Evaluation and Assessment in Software EngineeringA systematic review is a defined and methodical way to identify, assess and analyse published primary studies in order to investigate a specific research question. Kitchenham has recently published guidelines for software engineering researchers ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Dec 2020
659 pages
ISBN:978-3-030-76351-0
DOI:10.1007/978-3-030-76352-7
© Springer Nature Switzerland AG 2021.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 14 December 2020
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 24 Nov 2024
Other Metrics
Citations
View Options
View options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in