Abstract
Scientometrics has emerged as a research field for the evaluation and mapping of scientific fields, exploring research themes, collaboration clusters and identifying gaps and future trends. While early implementations have focused on quantitative metrics, recent directions emphasize a more nuanced approach that combines qualitative methods with quantitative analysis that triangulates several aspects, e.g., temporal trends, network, and semantic analysis. This chapter reviews scientometrics as a research methodology and discusses the strengths and weaknesses and how such weaknesses can be amended. The chapter also discusses the main methodological approach, and its theoretical underpinnings, used in some of the book chapters that make use of scientometrics as a means to map the field of CER.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Valtonen T, López-Pernas S, Saqr M, et al (2022) The nature and building blocks of educational technology research. Comput Human Behav 128:107123
Priem J, Hemminger BH (2010) Scientometrics 2.0: New metrics of scholarly impact on the social Web. FMRI Tech Rep. https://doi.org/10.5210/fm.v15i7.2874
Thijs B (2019) Science Mapping and the Identification of Topics: Theoretical and Methodological Considerations. In: Glänzel W, Moed HF, Schmoch U, Thelwall M (eds) Springer Handbook of Science and Technology Indicators. Springer International Publishing, Cham, pp 213–233
van Raan A (2019) Measuring Science: Basic Principles and Application of Advanced Bibliometrics. In: Glänzel W, Moed HF, Schmoch U, Thelwall M (eds) Springer Handbook of Science and Technology Indicators. Springer International Publishing, Cham, pp 237–280
Mingers J, Leydesdorff L (2015) A review of theory and practice in scientometrics. Eur J Oper Res 246:1–19
Ivancheva L (2008) Scientometrics today: A methodological overview. Collnet j scientometr inf manag 2:47–56
Alan P (1969) Statistical Bibliography or Bibliometrics. Journal of Documentation 25:348–349
Broadus RN (1987) Toward a definition of “bibliometrics”. Scientometrics 12:373–379
Hood WW, Wilson CS (2001). The literature of bibliometrics, scientometrics, and informetrics. Scientometrics 52:291–314
Abramo G, D’Angelo CA (2011) Evaluating research: from informed peer review to bibliometrics. Scientometrics 87:499–514
Diekmann A, Näf M, Schubiger M (2012) The impact of (Thyssen)-awarded articles in the scientific community. Kolner Z Soz Sozpsychol 64:563–581
Aksnes DW, Taxt RE (2004) Peer reviews and bibliometric indicators: a comparative study at a Norwegian university. Res Eval 13:33–41
Garfield E (1955) Citation Indexes for Science: A New Dimension in Documentation Through Association of Ideas. American Association for the Advancement of Science
Hirsch JE (2005) An index to quantify an individual’s scientific research output. Proceedings of the National Academy of Sciences of the United States of America, 102(46):16569–16572. https://doi.org/10.1073/pnas.0507655102
van Eck NJ, Waltman L (2014) Visualizing Bibliometric Networks. In: Ding Y, Rousseau R, Wolfram D (eds) Measuring Scholarly Impact: Methods and Practice. Springer International Publishing, Cham, pp 285–320
Saqr M, Poquet O, Lopez-Pernas S (2022) Networks in education: A travelogue through five decades. IEEE Access 10:32361–32380
Perianes-Rodriguez A, Waltman L, van Eck NJ (2016) Constructing bibliometric networks: A comparison between full and fractional counting. J Informetr 10:1178–1195
Apiola M, Tedre M, López-Pernas S, et al (2021) A Scientometric Journey Through the FIE Bookshelf: 1982-2020. In: Proceedings of the 2021 IEEE Frontiers in Education Conference (FIE). pp 1–9
Waltman L (2016) A review of the literature on citation impact indicators. J Informetr 10:365–391
Ismail II, Saqr M (2022) A Quantitative Synthesis of Eight Decades of Global Multiple Sclerosis Research Using Bibliometrics. Front Neurol 13:845539
Tyni J, Tarkiainen A, López-Pernas S, et al (2022) Games and Rewards: A Scientometric Study of Rewards in Educational and Serious Games. IEEE Access 10:31578–31585
Hicks D, Wouters P, Waltman L, et al (2015) Bibliometrics: The Leiden Manifesto for research metrics. Nature 520:429–431
Apiola M, Saqr M, López-Pernas S, Tedre M (2022) Computing Education Research Compiled: Keyword Trends, Building Blocks, Creators, and Dissemination. IEEE Access 10:27041–27068
Apiola M, López-Pernas S, Saqr M, et al (2022) From a National Meeting to an International Conference: A Scientometric Case Study of a Finnish Computing Education Conference. IEEE Access 10:66576–66588
Rethlefsen ML, Kirtley S, Waffenschmidt S, et al (2021) PRISMA-S: an extension to the PRISMA statement for reporting literature searches in systematic reviews. J Med Libr Assoc 109:174–200
Norris M, Oppenheim C (2007) Comparing alternatives to the Web of Science for coverage of the social sciences’ literature. J Informetr 1:161–169
Singh VK, Singh P, Karmakar M, et al (2021) The journal coverage of Web of Science, Scopus and Dimensions: A comparative analysis. Scientometrics 126:5113–5142
Baas J, Schotten M, Plume A, et al (2020) Scopus as a curated, high-quality bibliometric data source for academic research in quantitative science studies. Quantitative Science Studies 1:377–386
Aria M, Cuccurullo C (2017) bibliometrix: An R-tool for comprehensive science mapping analysis. J Informetr 11:959–975
OpenRefine. https://openrefine.org/. Accessed 2 May 2022
Clustering methods in-depth. https://docs.openrefine.org/next/technical-reference/clustering-in-depth. Accessed 2 May 2022
Patil I (2021) Visualizations with statistical details: The ‘ggstatsplot’ approach. Journal of Open Source Software 6(61):3167. https://doi.org/10.21105/joss.03167
Apiola M, López-Pernas S, Saqr M (2023) The Venues that Shaped Computing Education Research: The Gatekeepers Under the Lens. In: Apiola M, López-Pernas S, Saqr M (eds) Past, Present and Future of Computing Education Research. Springer
Apiola M, López-Pernas S, Saqr M (2023) The Evolving Themes of Computing Education Research: Trends, Topic Models, and Emerging Research. In: Apiola M, López-Pernas S, Saqr M (eds) Past, Present and Future of Computing Education Research. Springer
Wickham H, Wickham MH (2007) The ggplot package. URL: https://cran r-project org/web/packages/ggplot2/index html
Bastian M, Heymann S, Jacomy M (2009) Gephi: an open source software for exploring and manipulating networks. In: Proceedings of the third international AAAI conference on weblogs and social media. AAAI Press, Menlo Park, CA, pp 361–362
Fruchterman TMJ, Reingold EM (1991) Graph drawing by force-directed placement. Softw Pract Exp 21:1129–1164
De Meo P, Ferrara E, Fiumara G, Provetti A (2011) Generalized Louvain method for community detection in large networks. In: 2011 11th International Conference on Intelligent Systems Design and Applications. IEEE
Apiola M, López-Pernas S, Saqr M (2023) The Hands that Made Computing Education Research: Top Authors, Networks, Collaboration and Newcomers. In: Apiola M, López-Pernas S, Saqr M (eds) Past, Present and Future of Computing Education Research. Springer
Malmi L, Hellas A, Ihantola P, et al (2023) Computing Education Research in Finland. In: Apiola M, López-Pernas S, Saqr M (eds) Past, Present and Future of Computing Education Research. Springer
Becker B, Bradley S, Sentance S, et al (2023) CER in the UK and Ireland. In: Apiola M, López-Pernas S, Saqr M (eds) Past, Present and Future of Computing Education Research. Springer
Malmi L, Simon, Sheard J, et al (2023) The Evolution of CER: A Meta-Analytic Perspective. In: Apiola M, López-Pernas S, Saqr M (eds) Past, Present and Future of Computing Education Research. Springer
Daniels M, Berglund A, Pears A (2023) A Case Study: The Uppsala Computing Education Research Group (UpCERG). In: Apiola M, López-Pernas S, Saqr M (eds) Past, Present and Future of Computing Education Research. Springer
Saqr M, López-Pernas S, Apiola M (2023) The Impact and Chatter About Computing Education Research across the Social Media, News, Patents and Blogs: The Case of Altmetrics. In: Apiola M, López-Pernas S, Saqr M (eds) Past, Present and Future of Computing Education Research. Springer
Association for Computing Machinery ACM Curricula recommendations. https://www.acm.org/education/curricula-recommendations. Accessed 14 Aug 2022
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
López-Pernas, S., Saqr, M., Apiola, M. (2023). Scientometrics: A Concise Introduction and a Detailed Methodology for Mapping the Scientific Field of Computing Education Research. In: Apiola, M., López-Pernas, S., Saqr, M. (eds) Past, Present and Future of Computing Education Research . Springer, Cham. https://doi.org/10.1007/978-3-031-25336-2_5
Download citation
DOI: https://doi.org/10.1007/978-3-031-25336-2_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-25335-5
Online ISBN: 978-3-031-25336-2
eBook Packages: Computer ScienceComputer Science (R0)