research-article

Scoring concept maps: an overview

Authors:

Janis GrundspenkisAuthors Info & Claims

CompSysTech '09: Proceedings of the International Conference on Computer Systems and Technologies and Workshop for PhD Students in Computing

Article No.: 78, Pages 1 - 6

https://doi.org/10.1145/1731740.1731824

Published: 18 June 2009 Publication History

Abstract

The paper presents summarization of proposed scoring schemes of concept maps. The main attention is devoted not only to theoretical approaches considering assessment of students' concept maps, but also to scoring mechanisms implemented in the existent concept map based computerized assessment systems. Conclusions about application of examined scoring schemes are made and factors affecting students' score in computerized assessment systems are identified.

References

[1]

Cañas, A. J. A Summary of Literature Pertaining to the Use of Concept Mapping Techniques and Technologies for Education and Performance Support. Technical report: Pensacola, FL, 2003, 108 p.

[2]

Chang, K. E.,. Y. T. Sung, S. F. Chen. Learning Through Computer-Based Concept Mapping with Scaffolding Aid. Journal of Computer Assisted Learning, vol. 17, no. 1, 2001, pp. 21--33.

[3]

Chang, K. E., Y. T. Sung, R. B. Chang, S. C. Lin. A New Assessment for Computer-Based Concept Mapping. Educational Technology and Society, vol. 8, no. 3, 2005, pp. 138--148.

[4]

Cimolino, L., J. Kay, A. Miller. Incremental Student Modelling and Reflection by Verified Concept-Mapping. Proceedings of the 11^th International Conference on Artificial Intelligence in Education: Learner Modelling for Reflection Workshop, July 20--24, 2003, Sydney, Australia, pp. 219--227.

[5]

Conlon, T. Formative Assessment of Classroom Concept Maps: the Reasonable Fallible Analyser. Journal of Interactive Learning Research, vol. 17, no. 1, 2006, pp. 15--36.

[6]

Da Rocha, F. E. L., J. V. Da Costa Junior, E. L. Favero. An Approach to Computer-Aided Learning Assessment. Proceedings of the 3^rd International Conference on Concept Mapping, September 22--25, 2008, Tallinn, Estonia and Helsinki, Finland, pp. 170--177.

[7]

Goldsmith, T. E., P. J. Johnson, W. H. Acton. Assessing Structural Knowledge. Journal of Educational Psychology, vol. 83, no. 1, 1991, pp. 88--96.

[8]

Gouli, E., A. Gogoulou, K. Papanikolaou, M. Grigoriadou. Evaluating Learner's Knowledge Level on Concept Mapping Tasks. Proceedings of the 5^th IEEE International Conference on Advanced Learning Technologies, July 5--8, 2005, Kaohsiung, Taiwan, pp. 424--428.

Digital Library

[9]

Grundspenkis, J., A. Anohina. Evolution of the Concept Map Based Adaptive Knowledge Assessment System: Implementation and Evaluation Results. Scientific Proceedings of Riga Technical University, RTU Publishing, Riga, 2009 (in print).

[10]

Herl, H. E., H. F. O'Neil, G. K. W. K. Chung, R. A. Dennis, J. J. Lee. Feasibility of an On-line Concept Mapping Construction and Scoring System. Paper presented in the Annual Meeting of the American Educational Research Association, March, 1997, Chicago, Il.

[11]

Hoeft, R. M., F. G. Jentsch, M. E. Harper, A. W. Evans, C. A. Bowers, E. Salas. TPL-KATS-Concept Map: a Computerized Knowledge Assessment Tool. Computers in Human Behavior, no. 19, 2003, pp. 653--657.

[12]

Klein, D. C. D., G. K. W. K. Chung, E. Osmundson, H. E. Herl. Examining the Validity of Knowledge Mapping as a Measure of Elementary Students' Scientific Understanding. CSE Report 557, University of California, Los Angeles, 2002, 45p.

[13]

Liu, X. The Validity and Reliability of Concept Mapping as an Alternative Science Assessment when Item Response Theory Is Used for Scoring. Paper presented in Annual Meeting of the American Educational Research Association, New Orleans, LA, April 4--8, 1994, 32 p.

[14]

Liu, C. C., P. H. Don, C. M. Tsai. Assessment Based on Linkage Patterns in Concept Maps. Journal of Information Science and Engineering, no. 21, 2005, pp. 873--890.

[15]

Markham, K. M., J. J. Mintzes, M. G. Jones. The Concept Map as a Research and Evaluation Tool: Further Evidence of Validity. Journal of Research in Science Teaching, vol. 31, 1994, pp. 91--101.

[16]

McClure, J. R., B. Sonak, H. K. Suen. Concept Map Assessment of Classroom Learning: Reliability, Validity, and Logistical Practicality. Journal of Research in Science Teaching, vol. 36, no. 4, 1999, pp. 475--492.

[17]

Mls, K. Implicit Knowledge in Concept Maps and Their Revealing by Spatial Analysis of Hand-drawn Maps. Proceedings of the 2^nd International Conference on Concept Mapping, September 5--8, 2006, San José, Costa Rica, 2006, pp. 130--133.

[18]

Nicoll, G., J. Francisco, M. Nakhleh. A Three-Tier System for Assessing Concept Map Links: a Methodological Study. International Journal of Science Education, vol. 23, no. 8, 2001, pp. 863--875.

[19]

Novak, J. D., D. B. Gowin. Learning How to Learn. Cambrige: Cambridge University press, 1984.

[20]

Pearsall, N. R., J. Skipper, J. Mintzes. Knowledge Restructuring in the Life Sciences: a Longitudinal Study of Conceptual Change in Biology. Science Education, vol. 81, no. 2, 1997, pp. 193--215.

[21]

Pirnay-Dummer, P., D. Ifenthaler, J. M. Spector. Highly Integrated Model Assessment Technology and Tools. Proceedings of the IADIS International Conference on Cognition and Exploratory Learning in Digital Age, October 13--15, 2008, Freiburg, Germany, pp. 18--28.

[22]

Ruiz-Primo, M. A., S. E. Schultz, R. J. Shavelson. Concept Map-Based Assessment in Science: Two Exploratory Studies. CSE Report 436, University of California, Los Angeles, 1997, 54 p.

[23]

Rye, J. A., P. A. Rubba. Scoring Concept Maps: an Expert Map-Based Scheme Weighted for Relationships. School Science and Mathematics, vol. 102, no. 1, 2002, p. 33--44.

[24]

Taricani, E. M., R. B. Clariana. A Technique for Automatically Scoring Open-Ended Concept Maps. Educational Technology, Research and Development, vol. 54, no. 1, 2006, pp. 65--82.

[25]

Tsai, C. C., S. S. J. Lin, S. M Yuan. Students' Use of Web-based Concept Map Testing and Strategies for Learning. Journal of Computer Assisted Learning, vol. 17, no. 1, 2001, pp. 72--84.

[26]

Vilkelis, M., A. Anohina, R. Lukashenko. Architecture and Working Principles of the Concept Map Based Knowledge Assessment System. Proceedings of the 3^rd International Conference on Virtual Learning, October 31- November 2, 2008, Constanta, Romania, pp. 81--90.

[27]

Wallace, J. D., J. J. Mintzes. The Concept Map as a Research Tool: Exploring Conceptual Change in Biology. Journal of Research in Science Teaching, vol. 27, no. 10, 1990, pp. 1033--1052.

[28]

West, D. C., J. K. Park, J. R. Pomeroy, J. Sandoval. Concept Mapping Assessment in Medical Education: a Comparison of Two Scoring Systems. Medical Education, no. 36, 2002, pp. 820--826.

[29]

Yao, Q., K. Yang, G. Zhao, R Huang. A Scoring Algorithm Based on Proposition Chains for Concept Mapping. Proceedings of the 2^nd International Conference on Concept Mapping, September 5--8, 2006, San José, Costa Rica, 2006, pp. 8--15.

[30]

Yin, Y., J. Vanides, M. A. Ruiz-Primo, C. C. Ayala, R. Shavelson. A Comparison of Two Construct-a-Concept-Map Science Assessments: Created Linking Phrases and Selected Linking Phrases. CSE Report 624, University of California, Los Angeles, 2004.

Cited By

Wang BGiabbanelli P(2023)Identifying Informative Features to Evaluate Student Knowledge as Causal MapsInternational Journal of Artificial Intelligence in Education10.1007/s40593-023-00329-234:2(301-331)Online publication date: 17-Mar-2023
https://doi.org/10.1007/s40593-023-00329-2
de Ries KSchaap Hvan Loon AKral MMeijer P(2021)A literature review of open-ended concept maps as a research instrument to study knowledge and learningQuality & Quantity10.1007/s11135-021-01113-xOnline publication date: 24-Feb-2021
https://doi.org/10.1007/s11135-021-01113-x
Kapuza A(2020)How Concept Maps with and without a List of Concepts Differ: The Case of StatisticsEducation Sciences10.3390/educsci1004009110:4(91)Online publication date: 30-Mar-2020
https://doi.org/10.3390/educsci10040091
Show More Cited By

Index Terms

Scoring concept maps: an overview

Recommendations

Development of the scoring mechanism for the concept map based intelligent knowledge assessment system
CompSysTech '10: Proceedings of the 11th International Conference on Computer Systems and Technologies and Workshop for PhD Students in Computing on International Conference on Computer Systems and Technologies

Concept maps as a pedagogical tool have become rather popular for teaching, learning and knowledge assessment. However, known computer-based concept map assessment systems use rather primitive scoring models. The paper describes a novel scoring ...
A New Structural Knowledge Assessment Based on Weighted Concept Maps
ICCE '02: Proceedings of the International Conference on Computers in Education

Concept maps have been widely put to educational uses. But concept maps in the past were limited in their assessment standards. Some only take concept nodes into consideration; other evaluation criteria use concept nodes as the basis, with relation ...
Topological Scoring of Concept Maps for Cybersecurity Education
SIGCSE '19: Proceedings of the 50th ACM Technical Symposium on Computer Science Education

Concept maps are a well-known pedagogical tool for organizing and representing knowledge and developing a deep understanding of concepts. Unfortunately, the grading of concept maps tends to be manual and tedious thereby, posing serious limitation for an ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

CompSysTech '09: Proceedings of the International Conference on Computer Systems and Technologies and Workshop for PhD Students in Computing

June 2009

653 pages

ISBN:9781605589862

DOI:10.1145/1731740

Editors:
Boris Rachev
Technical University of Varna, Bulgaria
,
Angel Smrikarov
University of Ruse, Bulgaria

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 June 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CompSysTech '09

CompSysTech '09: Proceedings of the 10th International Conference on Computer Systems and Technologies and Workshop for PhD Students in Computing

June 18 - 19, 2009

Ruse, Bulgaria

Acceptance Rates

Overall Acceptance Rate 241 of 492 submissions, 49%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
437
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)2

Reflects downloads up to 24 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wang BGiabbanelli P(2023)Identifying Informative Features to Evaluate Student Knowledge as Causal MapsInternational Journal of Artificial Intelligence in Education10.1007/s40593-023-00329-234:2(301-331)Online publication date: 17-Mar-2023
https://doi.org/10.1007/s40593-023-00329-2
de Ries KSchaap Hvan Loon AKral MMeijer P(2021)A literature review of open-ended concept maps as a research instrument to study knowledge and learningQuality & Quantity10.1007/s11135-021-01113-xOnline publication date: 24-Feb-2021
https://doi.org/10.1007/s11135-021-01113-x
Kapuza A(2020)How Concept Maps with and without a List of Concepts Differ: The Case of StatisticsEducation Sciences10.3390/educsci1004009110:4(91)Online publication date: 30-Mar-2020
https://doi.org/10.3390/educsci10040091
Kostromina SGnedykh DMolodtsova G(2018)A Psycho-Pedagogical Model for Evaluating Effectiveness of Students' Learning on the Basis of Electronic Visual RowsOptimizing Human-Computer Interaction With Emerging Technologies10.4018/978-1-5225-2616-2.ch007(183-209)Online publication date: 2018
https://doi.org/10.4018/978-1-5225-2616-2.ch007
Petrovic JPale P(2017)Decision trees in formative procedural knowledge assessment2017 40th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO)10.23919/MIPRO.2017.7973383(17-20)Online publication date: May-2017
https://doi.org/10.23919/MIPRO.2017.7973383
Gurupur VPankaj Jain GRudraraju R(2015)Evaluating student learning using concept maps and Markov chainsExpert Systems with Applications: An International Journal10.1016/j.eswa.2014.12.01642:7(3306-3314)Online publication date: 1-May-2015
https://dl.acm.org/doi/10.1016/j.eswa.2014.12.016
Álvarez-Montero FSáenz-Pérez FVaquero-Sánchez A(2015)Using Datalog to provide just-in-time feedback during the construction of concept mapsExpert Systems with Applications: An International Journal10.1016/j.eswa.2014.08.05542:3(1362-1375)Online publication date: 15-Feb-2015
https://dl.acm.org/doi/10.1016/j.eswa.2014.08.055
Anohina-Naumeca AStrautmane MGrundspenkis J(2010)Development of the scoring mechanism for the concept map based intelligent knowledge assessment systemProceedings of the 11th International Conference on Computer Systems and Technologies and Workshop for PhD Students in Computing on International Conference on Computer Systems and Technologies10.1145/1839379.1839446(376-381)Online publication date: 17-Jun-2010
https://dl.acm.org/doi/10.1145/1839379.1839446
Anohina-Naumeca AGrundspenkis J(2009)Evaluating students' concept maps in the concept map based intelligent knowledge assessment systemProceedings of the 13th East European conference on Advances in Databases and Information Systems10.1007/978-3-642-12082-4_2(8-15)Online publication date: 7-Sep-2009
https://dl.acm.org/doi/10.1007/978-3-642-12082-4_2

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents