research-article

Analyzing Student Work Patterns Using Programming Exercise Data

Authors:

David Hovemeyer,

Robert DuvallAuthors Info & Claims

SIGCSE '15: Proceedings of the 46th ACM Technical Symposium on Computer Science Education

Pages 18 - 23

https://doi.org/10.1145/2676723.2677297

Published: 24 February 2015 Publication History

Abstract

Web-based programming exercises are a useful way for students to practice and master essential concepts and techniques presented in introductory programming courses. Although these systems are used fairly widely, we have a limited understanding of how students use these systems, and what can be learned from the data collected by these systems.

In this paper, we perform a preliminary exploratory analysis of data collected by the CloudCoder programming exercise system from five introductory courses taught in two programming languages across three colleges and universities. We explore a number of interesting correlations in the data that confirm existing hypotheses. Finally, and perhaps most importantly, we demonstrate the effectiveness and future potential of systems like CloudCoder to help us study novice programmers.

References

[1]

Cloudcoder - welcome to cloudcoder! http://cloudcoder.org, June 2014.

[2]

Cloudcoder exercise repository. https://cloudcoder.org/repo, June 2014.

[3]

M. Ahmadzadeh, D. Elliman, and C. Higgins. An Analysis of Patterns of Debugging Among Novice Computer Science Students. SIGCSE Bull., 37(3):84--88, June 2005.

Digital Library

[4]

J. Bennedsen and M. E. Caspersen. Failure rates in introductory programming. SIGCSE Bull., 39(2):32--36, June 2007.

Digital Library

[5]

N. C. C. Brown, M. Kölling, D. McCall, and I. Utting. Blackbox: A large scale repository of novice programmers' activity. In Proc. SIGCSE '14, SIGCSE '14, pages 223--228, New York, NY, USA, 2014. ACM.

Digital Library

[6]

P. Denny, A. Luxton-Reilly, and D. Carpenter. Enhancing syntax error messages appears ineffectual. In Proc. ITiCSE '14, ITiCSE '14, pages 273--278, New York, NY, USA, 2014. ACM.

Digital Library

[7]

P. Denny, A. Luxton-Reilly, and E. Tempero. All syntax errors are not equal. In Proc. ITiCSE '12, ITiCSE '12, pages 75--80, New York, NY, USA, 2012. ACM.

Digital Library

[8]

S. H. Edwards, J. Snyder, M. A. Pérez-Quiñones, A. Allevato, D. Kim, and B. Tretola. Comparing effective and ineffective behaviors of student programmers. In Proc. ICER '09, ICER '09, pages 3--14, New York, NY, USA, 2009. ACM.

Digital Library

[9]

S. Fitzgerald, G. Lewandowski, R. McCauley, L. Murphy, B. Simon, L. Thomas, and C. Zander. Debugging: Finding, Fixing and Flailing, a Multi-institutional Study of Novice Debuggers. Computer Science Education, 18(2):93--116, 2008.

[10]

D. Hovemeyer, M. Hertz, P. Denny, J. Spacco, A. Papancea, J. Stamper, and K. Rivers. Cloudcoder: building a community for creating, assigning, evaluating and sharing programming exercises (abstract only). In Proc. SIGCSE '13, SIGCSE '13, pages 742--742, New York, NY, USA, 2013. ACM.

Digital Library

[11]

M. C. Jadud. Methods and tools for exploring novice compilation behaviour. In Proc. ICER '06, ICER '06, pages 73--84, New York, NY, USA, 2006. ACM.

Digital Library

[12]

S. K. Kummerfeld and J. Kay. The Neglected Battle Fields of Syntax Errors. In Proc. ACE '03, ACE '03, pages 105--111, Darlinghurst, Australia, Australia, 2003. Australian Computer Society, Inc.

Digital Library

[13]

L. Murphy, G. Lewandowski, R. McCauley, B. Simon, L. Thomas, and C. Zander. Debugging: The Good, the Bad, and the Quirky - a Qualitative Analysis of Novices' Strategies. SIGCSE Bull., 40(1):163--167, Mar. 2008.

Digital Library

[14]

C. Norris, F. Barry, J. B. Fenwick Jr., K. Reid, and J. Rountree. Clockit: collecting quantitative data on how beginning software developers really work. In Proc. ITiCSE '08, ITiCSE '08, pages 37--41, New York, NY, USA, 2008. ACM.

Digital Library

[15]

A. Papancea, J. Spacco, and D. Hovemeyer. An open platform for managing short programming exercises. In Proc. ICER '13, ICER '13, pages 47--52. ACM.

Digital Library

[16]

N. Parlante. Nifty Reflections. SIGCSE Bull., 39(2):25--26, June 2007.

Digital Library

[17]

J. Spacco, D. Fossati, J. Stamper, and K. Rivers. Towards improving programming habits to create better computer science course outcomes. In Proc. ITiCSE '13, ITiCSE '13, pages 243--248, 2013. ACM.

Digital Library

Cited By

Chiu MMoss ERichards TStephenson BStone JBattestilli LRebelsky SShoop L(2024)Effect of Deadlines on Student Submission Timelines and Success in a Fully-Online Self-Paced CourseProceedings of the 55th ACM Technical Symposium on Computer Science Education V. 110.1145/3626252.3630837(207-213)Online publication date: 7-Mar-2024
https://dl.acm.org/doi/10.1145/3626252.3630837
Aerts K(2024)Improving Students’ Engagement and Learning Outcomes in a Primer Course on Object Oriented Programming in Java.2024 47th MIPRO ICT and Electronics Convention (MIPRO)10.1109/MIPRO60963.2024.10569397(642-647)Online publication date: 20-May-2024
https://doi.org/10.1109/MIPRO60963.2024.10569397
Gupta AJindal MGoyal A(2024)Identification of Student Programming Patterns through Clickstream Data2024 IEEE International Conference on Computing, Power and Communication Technologies (IC2PCT)10.1109/IC2PCT60090.2024.10486775(1153-1158)Online publication date: 9-Feb-2024
https://doi.org/10.1109/IC2PCT60090.2024.10486775
Show More Cited By

Index Terms

Analyzing Student Work Patterns Using Programming Exercise Data
1. Social and professional topics
  1. Professional topics
    1. Computing education
      1. Computing education programs
        Computer science education

Recommendations

Getting more oomph from programming exercises
SIGCSE '81: Proceedings of the twelfth SIGCSE technical symposium on Computer science education

Much attention has been given to the content of introductory computer science courses, but based upon a perusal of introductory textbooks, it appears that somewhat less attention has been given to the programming exercises to be used in these courses. ...
Evaluating Automatically Generated Contextualised Programming Exercises
SIGCSE 2024: Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1

Introductory programming courses often require students to solve many small programming exercises as part of their learning. Researchers have previously suggested that the context used in the problem description for these exercises is likely to impact ...
Getting more oomph from programming exercises
Proceedings of the 12th SIGCSE symposium on Computer science education

Much attention has been given to the content of introductory computer science courses, but based upon a perusal of introductory textbooks, it appears that somewhat less attention has been given to the programming exercises to be used in these courses. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGCSE '15: Proceedings of the 46th ACM Technical Symposium on Computer Science Education

February 2015

766 pages

ISBN:9781450329668

DOI:10.1145/2676723

General Chairs:
Adrienne Decker
Rochester Institute of Technology
,
Kurt Eiselt
University of British Columbia
,
Program Chairs:
Carl Alphonce
University at Buffalo
,
Jodi Tims
Baldwin Wallace College

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCSE: ACM Special Interest Group on Computer Science Education

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 February 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

SIGCSE
Amazon

Conference

SIGCSE '15

Sponsor:

SIGCSE

SIGCSE '15: The 46th ACM Technical Symposium on Computer Science Education

March 4 - 7, 2015

Missouri, Kansas City, USA

Acceptance Rates

SIGCSE '15 Paper Acceptance Rate 105 of 289 submissions, 36%;

Overall Acceptance Rate 1,595 of 4,542 submissions, 35%

Upcoming Conference

SIGCSE Virtual 2024

Sponsor:
sigcse

1st ACM Virtual Global Computing Education Conference

December 5 - 8, 2024

Virtual Event , NC , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

51
Total Citations
View Citations
912
Total Downloads

Downloads (Last 12 months)76
Downloads (Last 6 weeks)4

Reflects downloads up to 29 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chiu MMoss ERichards TStephenson BStone JBattestilli LRebelsky SShoop L(2024)Effect of Deadlines on Student Submission Timelines and Success in a Fully-Online Self-Paced CourseProceedings of the 55th ACM Technical Symposium on Computer Science Education V. 110.1145/3626252.3630837(207-213)Online publication date: 7-Mar-2024
https://dl.acm.org/doi/10.1145/3626252.3630837
Aerts K(2024)Improving Students’ Engagement and Learning Outcomes in a Primer Course on Object Oriented Programming in Java.2024 47th MIPRO ICT and Electronics Convention (MIPRO)10.1109/MIPRO60963.2024.10569397(642-647)Online publication date: 20-May-2024
https://doi.org/10.1109/MIPRO60963.2024.10569397
Gupta AJindal MGoyal A(2024)Identification of Student Programming Patterns through Clickstream Data2024 IEEE International Conference on Computing, Power and Communication Technologies (IC2PCT)10.1109/IC2PCT60090.2024.10486775(1153-1158)Online publication date: 9-Feb-2024
https://doi.org/10.1109/IC2PCT60090.2024.10486775
Chen JLi XHuang HYan L(2024)RETRACTED ARTICLE: Application of optical imaging detection based on IoT devices in sports dance data monitoring and simulationOptical and Quantum Electronics10.1007/s11082-024-06313-x56:4Online publication date: 5-Feb-2024
https://doi.org/10.1007/s11082-024-06313-x
Poitras EDempsey DCrane BSimpson SSiegel A(2023)The Applications of Learning Analytics to Enhance Learning and Engagement in Introductory Programming InstructionPerspectives on Learning Analytics for Maximizing Student Outcomes10.4018/978-1-6684-9527-8.ch005(89-108)Online publication date: 24-Oct-2023
https://doi.org/10.4018/978-1-6684-9527-8.ch005
de Freitas ACoffman Jde Freitas MWilson JWeingart TDoyle MStephenson BDorn BSoh LBattestilli L(2023)FalconCode: A Multiyear Dataset of Python Code Samples from an Introductory Computer Science CourseProceedings of the 54th ACM Technical Symposium on Computer Science Education V. 110.1145/3545945.3569822(938-944)Online publication date: 2-Mar-2023
https://dl.acm.org/doi/10.1145/3545945.3569822
Scott SHellas ALeinonen JEdwards JHaiduc SSchneider J(2023)Factors Affecting Compilable State at Each Keystroke in CS1Proceedings of the 45th International Conference on Software Engineering: Software Engineering Education and Training10.1109/ICSE-SEET58685.2023.00036(314-323)Online publication date: 17-May-2023
https://dl.acm.org/doi/10.1109/ICSE-SEET58685.2023.00036
Kaur AChahal K(2023)A learning analytics dashboard for data-driven recommendations on influences of non-cognitive factors in introductory programmingEducation and Information Technologies10.1007/s10639-023-12125-529:8(9221-9256)Online publication date: 7-Sep-2023
https://doi.org/10.1007/s10639-023-12125-5
Aggarwal AAshok A(2022)Exploring the Differences in Students’ Behavioral Engagement With Quizzes and Its Impact on their Performance in a Flipped CS1 CourseProceedings of the 22nd Koli Calling International Conference on Computing Education Research10.1145/3564721.3564740(1-11)Online publication date: 17-Nov-2022
https://dl.acm.org/doi/10.1145/3564721.3564740
Castro FLeinonen JHellas A(2022)Experiences With and Lessons Learned on Deadlines and Submission BehaviorProceedings of the 22nd Koli Calling International Conference on Computing Education Research10.1145/3564721.3564728(1-13)Online publication date: 17-Nov-2022
https://dl.acm.org/doi/10.1145/3564721.3564728
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents