research-article

Public Access

Towards a Concept Inventory for Algorithm Analysis Topics

Authors:

Mohammed F. Farghally,

Jeremy V. Ernst,

Clifford A. ShafferAuthors Info & Claims

SIGCSE '17: Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education

Pages 207 - 212

https://doi.org/10.1145/3017680.3017756

Published: 08 March 2017 Publication History

Abstract

We present initial results from our work towards developing a concept inventory for algorithm analysis (AACI) at the post-CS2 level. We used a Delphi process to identify a list of algorithm analysis topics that were considered both important and hard by surveying a panel of experienced instructors. Through a similar survey process, we identified a list of student misconceptions related to the identified topics. Based on this, a set of pilot AACI items were developed. We validated the misconceptions list by analyzing student responses to four administrations of the pilot AACI in two different universities during Fall 2015 and Spring 2016. Results revealed that a sufficient number of students held most of the misconceptions identified in the list.

References

[1]

V. L. Almstrum, P. B. Henderson, V. Harvey, C. Heeren, W. Marion, C. Riedesel, L.-K. Soh, and A. E. Tew. Concept inventories in computer science for the topic discrete mathematics. In ACM SIGCSE Bulletin, volume 38, pages 132--145.

Digital Library

[2]

R. Caceffo, S. Wolfman, K. S. Booth, and R. Azevedo. Developing a computer science concept inventory for introductory programming. In Proceedings of the 47th ACM Technical Symposium on Computing Science Education, pages 364--369.

Digital Library

[3]

N. Dalkey and O. Helmer. An experimental application of the delphi method to the use of experts. Management science, 9(3):458--467, 1963.

Digital Library

[4]

H. Danielsiek, W. Paul, and J. Vahrenhold. Detecting and understanding students' misconceptions related to algorithms and data structures. In Proceedings of the 43rd ACM technical symposium on Computer Science Education, pages 21--26.

Digital Library

[5]

J. Gal-Ezer and E. Zur. The efficiency of algorithms misconceptions. Computers & Education, 42(3):215--226, 2004.

Digital Library

[6]

K. Goldman, P. Gross, C. Heeren, G. Herman, L. Kaczmarczyk, M. C. Loui, and C. Zilles. Identifying important and difficult concepts in introductory computing courses using a delphi process. ACM SIGCSE Bulletin, 40(1):256--260.

Digital Library

[7]

G. L. Herman, L. Kaczmarczyk, M. C. Loui, and C. Zilles. Proof by incomplete enumeration and other logical misconceptions. In Proceedings of the Fourth international Workshop on Computing Education Research, pages 59--70. ACM, 2008.

Digital Library

[8]

G. L. Herman, M. C. Loui, and C. Zilles. Creating the digital logic concept inventory. In Proceedings of the 41st ACM technical symposium on Computer science education, pages 102--106.

Digital Library

[9]

G. L. Herman, C. Zilles, and M. C. Loui. Work in progress-students' misconceptions about state in digital systems. In Frontiers in Education Conference, 2009. FIE'09. 39th IEEE, pages 1--2.

Digital Library

[10]

D. Hestenes, M. Wells, G. Swackhamer, et al. Force concept inventory. The physics teacher, 30(3):141--158, 1992.

[11]

S. Holland, R. Griffiths, and M. Woodman. Avoiding object misconceptions. In ACM SIGCSE Bulletin, volume 29, pages 131--134.

Digital Library

[12]

L. C. Kaczmarczyk, E. R. Petrick, J. P. East, and G. L. Herman. Identifying student misconceptions of programming. In Proceedings of the 41st ACM technical symposium on Computer science education, pages 107--111.

Digital Library

[13]

M. A. Nelson, M. R. Geist, R. L. Miller, R. A. Streveler, and B. M. Olds. How to create a concept inventory: The thermal and transport concept inventory. In Annual Conference of the American Educational Research Association, Chicago, IL, 2007.

[14]

J. Nunnally. Psychometric theory, 2nd. edition. McGraw-Hill, New York, 1978.

[15]

N. Özdener. A comparison of the misconceptions about the time-efficiency of algorithms by various profiles of computer-programming students. Computers & Education, 51(3):1094--1102, 2008.

Digital Library

[16]

L. Porter, S. Garcia, H.-W. Tseng, and D. Zingaro. Evaluating student understanding of core concepts in computer architecture. In Proceedings of the 18th ACM conference on Innovation and technology in computer science education, pages 279--284.

Digital Library

[17]

C. A. Shaffer. OpenDSA CS3114 eTextbook. http://algoviz.org/OpenDSA/Books/CS3114/html/AnalMisunderstanding.html, 2015.

[18]

C. Taylor, D. Zingaro, L. Porter, K. Webb, C. Lee, and M. Clancy. Computer science concept inventories: past and future. Computer Science Education, 24(4):253--276, 2014.

[19]

A. E. Tew and M. Guzdial. Developing a validated assessment of fundamental cs1 concepts. In Proceedings of the 41st ACM technical symposium on Computer science education, pages 97--101.

Digital Library

[20]

A. E. Tew and M. Guzdial. The fcs1: a language independent assessment of cs1 knowledge. In Proceedings of the 42nd ACM technical symposium on Computer science education, pages 111--116.

Digital Library

[21]

K. C. Webb and C. Taylor. Developing a pre-and post-course concept inventory to gauge operating systems learning. In Proceedings of the 45th ACM technical symposium on Computer science education, pages 103--108.

Digital Library

Cited By

van Renssen A(2024)Designing Problem Sessions for Algorithmic Subjects to Boost Student ConfidenceProceedings of the 26th Australasian Computing Education Conference10.1145/3636243.3636261(164-171)Online publication date: 29-Jan-2024
https://dl.acm.org/doi/10.1145/3636243.3636261
Tilanterä ASorva JSeppälä OKorhonen A(2024)Students Struggle with Concepts in Dijkstra's AlgorithmProceedings of the 2024 ACM Conference on International Computing Education Research - Volume 110.1145/3632620.3671096(154-165)Online publication date: 12-Aug-2024
https://dl.acm.org/doi/10.1145/3632620.3671096
Bellettini CLonati VMonga MMorpurgo AStephenson BStone JBattestilli LRebelsky SShoop L(2024)To Be Or Not To Be . . . An Algorithm: The Notion According to Students and TeachersProceedings of the 55th ACM Technical Symposium on Computer Science Education V. 110.1145/3626252.3630950(102-108)Online publication date: 7-Mar-2024
https://dl.acm.org/doi/10.1145/3626252.3630950
Show More Cited By

Index Terms

Towards a Concept Inventory for Algorithm Analysis Topics
1. Information systems
  1. Data management systems
    1. Data structures
2. Social and professional topics
  1. Professional topics
    1. Computing education
      1. Computing education programs
        Information science education

Recommendations

Developing a Computer Science Concept Inventory for Introductory Programming
SIGCSE '16: Proceedings of the 47th ACM Technical Symposium on Computing Science Education

A Concept Inventory (CI) is a set of multiple choice questions used to reveal student's misconceptions related to some topic. Each available choice (besides the correct choice) is a distractor that is carefully developed to address a specific ...
Identifying student misconceptions of programming
SIGCSE '10: Proceedings of the 41st ACM technical symposium on Computer science education

Computing educators are often baffled by the misconceptions that their CS1 students hold. We need to understand these misconceptions more clearly in order to help students form correct conceptions. This paper describes one stage in the development of a ...
Using Technology to Accelerate the Construction of Concept Inventories
CSEDU 2014: Proceedings of the 6th International Conference on Computer Supported Education - Volume 2

Concept Inventories are multiple choice instruments that map studentsâ conceptual understanding in a given subject area. They underpin some of the most effective teaching methods in science education, but they are labour intensive and expensive to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGCSE '17: Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education

March 2017

838 pages

ISBN:9781450346986

DOI:10.1145/3017680

General Chairs:
Michael E. Caspersen
Aarhus University
,
Stephen H. Edwards
Virginia Tech
,
Program Chairs:
Tiffany Barnes
North Carolina State University
,
Daniel D. Garcia
University of California, Berkeley

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCSE: ACM Special Interest Group on Computer Science Education

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 March 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

SIGCSE '17

Sponsor:

SIGCSE

SIGCSE '17: The 48th ACM Technical Symposium on Computer Science Education

March 8 - 11, 2017

Washington, Seattle, USA

Acceptance Rates

SIGCSE '17 Paper Acceptance Rate 105 of 348 submissions, 30%;

Overall Acceptance Rate 1,595 of 4,542 submissions, 35%

Upcoming Conference

SIGCSE Virtual 2024

Sponsor:
sigcse

1st ACM Virtual Global Computing Education Conference

December 5 - 8, 2024

Virtual Event , NC , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

27
Total Citations
View Citations
765
Total Downloads

Downloads (Last 12 months)106
Downloads (Last 6 weeks)21

Reflects downloads up to 04 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

van Renssen A(2024)Designing Problem Sessions for Algorithmic Subjects to Boost Student ConfidenceProceedings of the 26th Australasian Computing Education Conference10.1145/3636243.3636261(164-171)Online publication date: 29-Jan-2024
https://dl.acm.org/doi/10.1145/3636243.3636261
Tilanterä ASorva JSeppälä OKorhonen A(2024)Students Struggle with Concepts in Dijkstra's AlgorithmProceedings of the 2024 ACM Conference on International Computing Education Research - Volume 110.1145/3632620.3671096(154-165)Online publication date: 12-Aug-2024
https://dl.acm.org/doi/10.1145/3632620.3671096
Bellettini CLonati VMonga MMorpurgo AStephenson BStone JBattestilli LRebelsky SShoop L(2024)To Be Or Not To Be . . . An Algorithm: The Notion According to Students and TeachersProceedings of the 55th ACM Technical Symposium on Computer Science Education V. 110.1145/3626252.3630950(102-108)Online publication date: 7-Mar-2024
https://dl.acm.org/doi/10.1145/3626252.3630950
Velázquez-Iturbide J(2023)Approaches and Tools for Experiential Learning of Abstract ConceptsFostering Pedagogy Through Micro and Adaptive Learning in Higher Education10.4018/978-1-6684-8656-6.ch006(111-140)Online publication date: 30-Jun-2023
https://doi.org/10.4018/978-1-6684-8656-6.ch006
Crichton WGray GKrishnamurthi S(2023)A Grounded Conceptual Model for Ownership Types in RustProceedings of the ACM on Programming Languages10.1145/36228417:OOPSLA2(1224-1252)Online publication date: 16-Oct-2023
https://dl.acm.org/doi/10.1145/3622841
Ali MGhosh SRao PDhegaskar RJawort SMedler AShi MDasgupta S(2023)Taking Stock of Concept Inventories in Computing Education: A Systematic Literature ReviewProceedings of the 2023 ACM Conference on International Computing Education Research - Volume 110.1145/3568813.3600120(397-415)Online publication date: 7-Aug-2023
https://dl.acm.org/doi/10.1145/3568813.3600120
Luu MFerland MNagaraj Rao VArora AHuynh RReiber FWong-Ma JShindler MDoyle MStephenson BDorn BSoh LBattestilli L(2023)What is an Algorithms Course?Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 110.1145/3545945.3569820(284-290)Online publication date: 2-Mar-2023
https://dl.acm.org/doi/10.1145/3545945.3569820
Adamoli A(2023)An Agile Concept Inventory Methodology to Detect Large Sets of Student Misconceptions in Programming Language CoursesResponsive and Sustainable Educational Futures10.1007/978-3-031-42682-7_1(1-15)Online publication date: 28-Aug-2023
https://doi.org/10.1007/978-3-031-42682-7_1
Miedema DFletcher GAivaloglou E(2022)Expert Perspectives on Student Errors in SQLACM Transactions on Computing Education10.1145/355139223:1(1-28)Online publication date: 29-Dec-2022
https://dl.acm.org/doi/10.1145/3551392
Kao YWeintrop DMerkle LDoyle MSheard JSoh LDorn B(2022)Multilingual CS Education PathwaysProceedings of the 53rd ACM Technical Symposium on Computer Science Education - Volume 110.1145/3478431.3499315(64-70)Online publication date: 22-Feb-2022
https://dl.acm.org/doi/10.1145/3478431.3499315
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents