Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3545945.3569752acmconferencesArticle/Chapter ViewAbstractPublication PagessigcseConference Proceedingsconference-collections
research-article

Prior Programming Experience: A Persistent Performance Gap in CS1 and CS2

Published: 03 March 2023 Publication History

Abstract

Previous work has reported on the advantageous effects of prior experience in CS1, but it remains unclear whether these effects fade over a sequence of introductory programming courses. Furthermore, while student perceptions suggest that prior experience remains important, studies have reported that a student's expectation of their performance is a more accurate predictor of outcome. We aim to confirm if prior experience (formal or informal) provides short-term and long-term advantages in computing courses or if the advantage fades. Furthermore, we explore whether the expectation of performance is a more accurate predictor of student success than informal and formal prior experience. To explore these questions, we deployed surveys in a CS1 course to gauge students' level of prior experience in programming, prediction of final exam grades, and self-efficacy to succeed in university. Grades from CS1 and CS2 were also collected. We observed a persistent (1-letter grade) gap between the performance of students with no prior experience and those with any experience, but we did not observe a noteworthy gap when comparing student performance based on formal or informal experience. We also observed differences in self-efficacy and retention rates between different levels of prior experience. Lastly, we confirm that success in CS1 can be better reflected and predicted by some controllable factors, such as students' perceptions of ability.

References

[1]
Alireza Ahadi and Raymond Lister. 2013. Geek genes, prior knowledge, stumbling points and learning edge momentum: parts of the one elephant?. In Proceedings of the ninth annual international ACM conference on International computing education research. 123--128.
[2]
Efthimia Aivaloglou and Anna van der Meulen. 2021. An empirical study of students' perceptions on the setup and grading of group programming assignments. ACM Transactions on Computing Education (TOCE), Vol. 21, 3 (2021), 1--22.
[3]
Christine Alvarado, Yingjun Cao, and Mia Minnes. 2017. Gender Differences in Students' Behaviors in CS Classes throughout the CS Major. In Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education (Seattle, Washington, USA) (SIGCSE '17). Association for Computing Machinery, New York, NY, USA, 27--32. https://doi.org/10.1145/3017680.3017771
[4]
Christine Alvarado, Cynthia Bailey Lee, and Gary Gillespie. 2014. New CS1 pedagogies and curriculum, the same success factors?. In Proceedings of the 45th ACM technical symposium on computer science education. 379--384.
[5]
Christine Alvarado, Gustavo Umbelino, and Mia Minnes. 2018. The persistent effect of pre-college computing experience on college CS course grades. In Proceedings of the 49th ACM Technical Symposium on Computer Science Education. 876--881.
[6]
Christina A Bauer, Raphael Boemelburg, and Gregory M Walton. 2021. Resourceful actors, not weak victims: Reframing refugees' stigmatized identity enhances long-term academic engagement. Psychological science, Vol. 32, 12 (2021), 1896--1906.
[7]
Jens Bennedsen and Michael E Caspersen. 2005. An investigation of potential success factors for an introductory model-driven programming course. In Proceedings of the first international workshop on Computing education research. 155--163.
[8]
Nicholas A Bowman, Lindsay Jarratt, KC Culver, and Alberto Maria Segre. 2019. How prior programming experience affects students' pair programming experiences and outcomes. In Proceedings of the 2019 ACM Conference on Innovation and Technology in Computer Science Education. 170--175.
[9]
Steven Bradley and Eleni Akrida. 2022. Narrowing and Stretching: Addressing the Challenge of Multi-track Programming. In Computing Education Practice 2022. 1--4.
[10]
Jennifer Campbell, Diane Horton, and Michelle Craig. 2016. Factors for success in online CS1. In Proceedings of the 2016 acm conference on innovation and technology in computer science education. 320--325.
[11]
Nasrin Dehbozorgi, Mary Lou Maher, and Mohsen Dorodchi. 2021. Does Self-Efficacy Correlate with Positive Emotion and Academic Performance in Collaborative Learning?. In 2021 IEEE Frontiers in Education Conference (FIE). IEEE, 1--8.
[12]
Jennifer Dempsey, Richard T Snodgrass, Isabel Kishi, and Allison Titcomb. 2015. The emerging role of self-perception in student intentions. In Proceedings of the 46th ACM technical symposium on computer science education. 108--113.
[13]
Sally Fincher, Anthony Robins, Bob Baker, Ilona Box, Quintin Cutts, Michael de Raadt, Patricia Haden, John Hamer, Margaret Hamilton, Raymond Lister, et al. 2006. Predictors of success in a first programming course. In Proceedings of the 8th Australasian Computing Education Conference (ACE 2006), Vol. 52. Australian Computer Society Inc., 189--196.
[14]
Allan Fisher, Jane Margolis, and Faye Miller. 1997. Undergraduate Women in Computer Science: Experience, Motivation and Culture. ACM SIGCSE Bulletin, Vol. 29, 1 (1997), 106--110.
[15]
Børge K Gjelsten, Gunnar R Bergersen, Dag IK Sjøberg, and Quintin Cutts. 2021. No Gender Difference in CS1 Grade for Students with Programming from High School: An Exploratory Study. In 21st Koli Calling International Conference on Computing Education Research. 1--5.
[16]
Dianne Hagan and Selby Markham. 2000. Does it help to have some programming experience before beginning a computing degree program?. In Proceedings of the 5th annual SIGCSE/SIGCUE ITiCSEconference on Innovation and technology in computer science education. 25--28.
[17]
Edward Holden and Elissa Weeden. 2003. The impact of prior experience in an information technology programming course sequence. In Proceedings of the 4th conference on Information technology curriculum. 41--46.
[18]
Edward Holden and Elissa Weeden. 2004. The Experience Factor in Early Programming Education. In Proceedings of the 5th Conference on Information Technology Education (Salt Lake City, UT, USA) (CITC5 '04). Association for Computing Machinery, New York, NY, USA, 211--218. https://doi.org/10.1145/1029533.1029585
[19]
Michael S Kirkpatrick and Chris Mayfield. 2017. Evaluating an alternative CS1 for students with prior programming experience. In Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education. 333--338.
[20]
Sophia Krause-Levy, William G Griswold, Leo Porter, and Christine Alvarado. 2021. The Relationship Between Sense of Belonging and Student Outcomes in CS1 and Beyond. In Proceedings of the 17th ACM Conference on International Computing Education Research. 29--41.
[21]
Soohyun Nam Liao, Kartik Shah, William G Griswold, and Leo Porter. 2021. A Quantitative Analysis of Study Habits Among Lower-and Higher-Performing Students in CS1. In Proceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education V. 1. 366--372.
[22]
David Liben-Nowell and Anna N Rafferty. 2022. Student Motivations and Goals for CS1: Themes and Variations. In Proceedings of the 53rd ACM Technical Symposium on Computer Science Education V. 1. 237--243.
[23]
Alex Lishinski, Sarah Narvaiz, and Joshua M Rosenberg. 2022. Self-efficacy, Interest, and Belongingness--URM Students' Momentary Experiences in CS1. In Proceedings of the 2022 ACM Conference on International Computing Education Research V. 1. 44--60.
[24]
Alex Lishinski, Aman Yadav, Jon Good, and Richard Enbody. 2016. Learning to program: Gender differences and interactive effects of students' motivation, goals, and self-efficacy on performance. In Proceedings of the 2016 ACM Conference on International Computing Education Research. 211--220.
[25]
Rodrigo Pessoa Medeiros, Geber Lisboa Ramalho, and Taciana Pontual Falcão. 2018. A systematic literature review on teaching and learning introductory programming in higher education. IEEE Transactions on Education, Vol. 62, 2 (2018), 77--90.
[26]
Carol Midgley, Martin L Maehr, Ludmila Z Hruda, Eric Anderman, Lynley Anderman, Kimberley E Freeman, T Urdan, et al. 2000. Manual for the patterns of adaptive learning scales. Ann Arbor: University of Michigan (2000).
[27]
Nea Pirttinen, Arto Hellas, Lassi Haaranen, and Rodrigo Duran. 2020. Study Major, Gender, and Confidence Gap: Effects on Experience, Performance, and Self-Efficacy in Introductory Programming. In 2020 IEEE Frontiers in Education Conference (FIE). IEEE, 1--7.
[28]
Yizhou Qian and James Lehman. 2017. Students' misconceptions and other difficulties in introductory programming: A literature review. Transactions on Computing Education (TOCE), Vol. 18, 1 (2017), 1--24.
[29]
Vennila Ramalingam, Deborah LaBelle, and Susan Wiedenbeck. 2004. Self-efficacy and mental models in learning to program. In Proceedings of the 9th annual SIGCSE conference on Innovation and technology in computer science education. 171--175.
[30]
Sarah Rauchas, Ian Sanders, and Benjamin Kumwenda. 2006. The effect of prior programming experience in a scheme-based breadth-first curriculum at wits. ACM SIGCSE Bulletin, Vol. 38, 3 (2006), 326--326.
[31]
Anthony Robins. 2010. Learning edge momentum: A new account of outcomes in CS1. Computer Science Education, Vol. 20, 1 (2010), 37--71.
[32]
Nathan Rountree, Janet Rountree, and Anthony Robins. 2002. Predictors of success and failure in a CS1 course. ACM SIGCSE Bulletin, Vol. 34, 4 (2002), 121--124.
[33]
Nicole M Stephens, MarYam G Hamedani, and Mesmin Destin. 2014. Closing the social-class achievement gap: A difference-education intervention improves first-generation students' academic performance and all students' college transition. Psychological science, Vol. 25, 4 (2014), 943--953.
[34]
Anya Tafliovich, Jennifer Campbell, and Andrew Petersen. 2013. A student perspective on prior experience in CS1. In Proceeding of the 44th ACM technical symposium on Computer science education. 239--244.
[35]
Anna van der Meulen and Efthimia Aivaloglou. 2021. Who does what? Work division and allocation strategies of computer science student teams. In 2021 IEEE/ACM 43rd International conference on software engineering: software engineering education and training (ICSE-SEET). IEEE, 273--282.
[36]
Phil Ventura and Bina Ramamurthy. 2004. Wanted: CS1 students. No experience required. ACM SIGCSE Bulletin, Vol. 36, 1 (2004), 240--244.
[37]
Jennifer Wang, Hai Hong, Jason Ravitz, and Marielena Ivory. 2015. Gender differences in factors influencing pursuit of computer science and related fields. In Proceedings of the 2015 ACM Conference on Innovation and Technology in Computer Science Education. 117--122.
[38]
Christopher Watson, Frederick WB Li, and Jamie L Godwin. 2014. No tests required: comparing traditional and dynamic predictors of programming success. In Proceedings of the 45th ACM technical symposium on Computer science education. 469--474.
[39]
Chris Wilcox and Albert Lionelle. 2018. Quantifying the Benefits of Prior Programming Experience in an Introductory Computer Science Course. In Proceedings of the 49th ACM Technical Symposium on Computer Science Education (Baltimore, Maryland, USA) (SIGCSE '18). Association for Computing Machinery, New York, NY, USA, 80--85. https://doi.org/10.1145/3159450.3159480
[40]
Brenda Cantwell Wilson and Sharon Shrock. 2001. Contributing to success in an introductory computer science course: a study of twelve factors. Acm sigcse bulletin, Vol. 33, 1 (2001), 184--188.

Cited By

View all
  • (2024)Designing for Interdisciplinary Transfer to Reduce Intrinsic Cognitive Load, Increase Self-Efficacy, and Promote Conceptual Understanding in Introductory ProgrammingProceedings of the 24th Koli Calling International Conference on Computing Education Research10.1145/3699538.3699553(1-13)Online publication date: 12-Nov-2024
  • (2024)Why Female Students Are Dropping out of CS ProgramsProceedings of the 2024 on Innovation and Technology in Computer Science Education V. 110.1145/3649217.3653635(304-310)Online publication date: 3-Jul-2024
  • (2024)Exploring the Effects of Grouping by Programming Experience in Q&A ForumsProceedings of the 2024 ACM Conference on International Computing Education Research - Volume 110.1145/3632620.3671107(206-221)Online publication date: 12-Aug-2024
  • Show More Cited By

Index Terms

  1. Prior Programming Experience: A Persistent Performance Gap in CS1 and CS2

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGCSE 2023: Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1
    March 2023
    1481 pages
    ISBN:9781450394314
    DOI:10.1145/3545945
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 03 March 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. confidence
    2. cs1
    3. cs2
    4. prediction
    5. prior experience
    6. self-efficacy

    Qualifiers

    • Research-article

    Conference

    SIGCSE 2023
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 1,595 of 4,542 submissions, 35%

    Upcoming Conference

    SIGCSE Virtual 2024
    1st ACM Virtual Global Computing Education Conference
    December 5 - 8, 2024
    Virtual Event , NC , USA

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)111
    • Downloads (Last 6 weeks)14
    Reflects downloads up to 12 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Designing for Interdisciplinary Transfer to Reduce Intrinsic Cognitive Load, Increase Self-Efficacy, and Promote Conceptual Understanding in Introductory ProgrammingProceedings of the 24th Koli Calling International Conference on Computing Education Research10.1145/3699538.3699553(1-13)Online publication date: 12-Nov-2024
    • (2024)Why Female Students Are Dropping out of CS ProgramsProceedings of the 2024 on Innovation and Technology in Computer Science Education V. 110.1145/3649217.3653635(304-310)Online publication date: 3-Jul-2024
    • (2024)Exploring the Effects of Grouping by Programming Experience in Q&A ForumsProceedings of the 2024 ACM Conference on International Computing Education Research - Volume 110.1145/3632620.3671107(206-221)Online publication date: 12-Aug-2024
    • (2024)Examining Intention to Major in Computer Science: Perceived Potential and ChallengesProceedings of the 55th ACM Technical Symposium on Computer Science Education V. 110.1145/3626252.3630843(1237-1243)Online publication date: 7-Mar-2024
    • (2024)Redefining computational thinking: Synergizing unplugged activities with block-based programmingEducation and Information Technologies10.1007/s10639-024-12869-8Online publication date: 19-Jul-2024

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media