Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3341525.3387419acmconferencesArticle/Chapter ViewAbstractPublication PagesiticseConference Proceedingsconference-collections
research-article

Towards a Competence Model for the Novice Programmer Using Bloom's Revised Taxonomy - An Empirical Approach

Published: 15 June 2020 Publication History

Abstract

This work addresses the demand of an empirically developed competence model for programming as challenging core tier of computer science curricula. The presented paper investigates the application of Bloom's revised taxonomy for learning, teaching and assessing by Anderson and Krathwohl for the specification of currently used learning objectives in programming education. Accordingly, 129 module descriptions of beginner level programming courses from 35 German universities constitute the sample. Learning goals are evaluated using Mayring's qualitative content analysis. In addition, seven guided interviews with computer science professors as experts are categorized according to Mayring's qualitative analysis method. As a result, a model comprised of deductively-inductively built cognitive categories is proposed, proving the adequacy of Bloom's revised taxonomy for computer science and programming in particular. The categories depict current operationalized learning objectives and cognitive competencies of novice programmers, as well as additional non-cognitive competencies. Thus, the results can help classify competency levels and support the didactic design of introductory programming classes and assessment. This research also constitutes a basis for the development of a measuring instrument of programming competence in the future.

References

[1]
Satu Alaoutinen and Kari Smolander. 2010. Student Self-Assessment in a Programming Course Using Bloom's Revised Taxonomy. In Proceedings of the Fifteenth Annual Conference on Innovation & Technology in Computer Science Education (ITiCSE '10). ACM, New York, 155--159.
[2]
Lorin W. Anderson and David R. Krathwohl. 2001. A Taxonomy for Learning, Teaching, and Assessing. A Revision of Bloom's Taxonomy of Educational Objectives. Addison Wesley Longman, New York.
[3]
Gillian Bain and Ian Barnes. 2014. Why is Programming so Hard to Learn. In Proceedings of the 2014 Conference on Innovation & Technology in Computer Science Education (ITiCSE '14). ACM, New York, 356.
[4]
Steffen-Peter Ballstaedt, Heinz Mandl, Wolfgang Schnotz, and Sigmar-Olaf Tergan. 1981. Texte verstehen, Texte gestalten .Urban & Schwarzenberg, München.
[5]
Jürgen Baumert, Petra Stanat, and Anke Demmrich. 2001. PISA 2000: Untersuchungsgegenstand, theoretische Grundlagen und Durchführung der Studie. In PISA 2000. Springer, 15--68.
[6]
Jens Bennedsen and Michael E. Caspersen. 2007. Failure Rates in Introductory Programming. SIGCSE Bull., Vol. 39, 2 (June 2007), 32--36.
[7]
Jens Bennedsen and Michael E. Caspersen. 2019. Failure Rates in Introductory Programming: 12 Years Later. ACM Inroads, Vol. 10, 2 (April 2019), 30--36.
[8]
Susan Bergin, Ronan Reilly, and Desmond Traynor. 2005. Examining the role of self-regulated learning on introductory programming performance. In Proceedings of the first international workshop on Computing education research. ACM, 81--86.
[9]
John B Biggs and Kevin F Collis. 1982. Evaluating the quality of learning: The SOLO taxonomy (Structure of the Observed Learning Outcome) .Academic Press, New York.
[10]
Arbeitskreis "Bildungsstandards". 2008. Grunds"atze und Standards für die Informatik in der Schule Bildungsstandards Informatik für die Sekundarstufe I. Beilage zu LOG IN, Vol. 28. Jahrgang, 150/151 (2008).
[11]
Benjamin S Bloom et al. 1956. Taxonomy of educational objectives. Vol. 1: Cognitive domain. New York: McKay (1956), 20--24.
[12]
Torsten Brinda, Hermann Puhlmann, and Carsten Schulte. 2009. Bridging ICT and CS: Educational Standards for Computer Science in Lower Secondary Education. SIGCSE Bull., Vol. 41, 3 (July 2009), 288--292.
[13]
Jesús Gabalán Coello and Kevin Huggins. 2019. The Students Outcomes ABET (1--7) and SOLO's Taxonomy: An Approach. In Proceedings of the 5th International Conference on Frontiers of Educational Technologies (ICFET 2019). ACM, New York, 110--117.
[14]
Michael W Connell, Kimberly Sheridan, and Howard Gardner. 2003. On abilities and domains. The Psychology of Abilities, Competencies, and Expertise (2003), 126--155.
[15]
BenHo Csapó. 2004. Knowledge and competencies. The integrated person (2004), 35--50.
[16]
Organisation for Economic Co-operation and Development (OECD). 2019. OECD skills outlook 2019: thriving in a digital world. (2019).
[17]
Barbara Friebertsh"auser. 1997. Interviewtechniken--ein Überblick. In Handbuch Qualitative Forschungsmethoden in der Erziehungswissenschaft, Barbara Friebertsh"auser & Annedore Prengel (Ed.). Juventa, Weinheim, 371--395.
[18]
GI Gesellschaft für Informatik e.V. 2016. Empfehlungen für Bachelor und Masterprogramme im Studienfach Informatik an Hochschulen.
[19]
Jochen Gl"aser and Grit Laudel. 2004. Experteninterviews und qualitative Inhaltsanalyse: als Instrumente rekonstruierender Untersuchungen .Springer-Verlag.
[20]
Richard Gluga, Judy Kay, Raymond Lister, Sabina Kleitman, and Tim Lever. 2012. Coming to Terms with Bloom: An Online Tutorial for Teachers of Programming Fundamentals. In Proceedings of the Fourteenth Australasian Computing Education Conference - Volume 123 (ACE '12). Australian Computer Society, Inc., AUS, 147--156.
[21]
Anabela Gomes and António José Mendes. 2007. Learning to program-difficulties and solutions. In International Conference on Engineering Education--ICEE, Vol. 2007.
[22]
Marcus Hasselhorn and Andreas Gold. 2009. P"adagogische Psychologie: Erfolgreiches Lernen und Lehren .W. Kohlhammer Verlag.
[23]
Marietjie Havenga, Elsa Mentz, and Ruth De Villiers. 2008. Knowledge, skills and strategies for successful object-oriented programming: a proposed learning repertoire. South African Computer Journal, Vol. 12, Dec 2008 (2008), 1--8.
[24]
Arbeitskreis "Bildungsstandards Informatik im Primarbereich". 2019. Kompetenzen für informatische Bildung im Primarbereich. Beilage zu LOG IN, Vol. 39. Jahrgang, 191/192 (2019).
[25]
Colin G. Johnson and Ursula Fuller. 2006. Is Bloom's Taxonomy Appropriate for Computer Science?. In Proceedings of the 6th Baltic Sea Conference on Computing Education Research: Koli Calling 2006 (Baltic Sea '06). ACM, New York, 120--123.
[26]
Association for Computing Machinery (ACM) Joint Task Force on Computing Curricula and IEEE Computer Society. 2013. Computer Science Curricula 2013: Curriculum Guidelines for Undergraduate Degree Programs in Computer Science .ACM, New York.
[27]
Eckhard Klieme. 2004. Was sind Kompetenzen und wie lassen sie sich messen? P"adagogik, Vol. 56, 6 (2004), 10--13.
[28]
Eckhard Klieme, Hermann Avenarius, Werner Blum, Peter Döbrich, Hans Gruber, Manfred Prenzel, Kristina Reiss, Kurt Riquarts, Jürgen Rost, Heinz-Elmar Tenorth, et al. 2003. The development of national educational standards. An Expertise. Bundesministerium für Bildung und Forschung (2003).
[29]
Eckhard Klieme and Johannes Hartig. 2007. Kompetenzkonzepte in den Sozialwissenschaften und im erziehungswissenschaftlichen Diskurs. Kompetenzdiagnostik, Zeitschrift für Erziehungswissenschaft, Vol. Sonderheft, 8 (2007), 11--29.
[30]
Eckhard Klieme, Johannes Hartig, and Dominique Rauch. 2008. The concept of competence in educational contexts. Assessment of competencies in educational contexts (2008), 3--22.
[31]
Eckhard Klieme, Detlev Leutner, Martina Kenk, et al. 2010. Kompetenzmodellierung: Zwischenbilanz des DFG-Schwerpunktprogramms und Perspektiven des Forschungsansatzes. Zeitschrift für Padagogik, Vol. 56. Beiheft (2010).
[32]
Karoline Koeppen, Johannes Hartig, Eckhard Klieme, and Detlev Leutner. 2008. Current issues in competence modeling and assessment. Zeitschrift für Psychologie/Journal of Psychology, Vol. 216, 2 (2008), 61--73.
[33]
Sabine Kowall and Daniel C O'Connell. 2009. Zur Transkription von Gespr"achen. In Qualitative Forschung. Ein Handbuch, Uwe Flick, Ernst Uwe von Kardoff, and Ines Steinke (Eds.). Vol. 7th ed. Rowohlt, Reinbek, 437--446.
[34]
Matthias Kramer, Peter Hubwieser, and Torsten Brinda. 2016a. A competency structure model of object-oriented programming. In 2016 International Conference on Learning and Teaching in Computing and Engineering (LaTICE). IEEE, 1--8.
[35]
Matthias Kramer, David A. Tobinski, and Torsten Brinda. 2016b. Modelling Competency in the Field of OOP: From Investigating Computer Science Curricula to Developing Test Items. In Stakeholders and Information Technology in Education (SaITE). IEEE, 1--8.
[36]
Essi Lahtinen. 2007. A Categorization of Novice Programmers: A Cluster Analysis Study. In PPIG, Vol. 16. 32--41.
[37]
Barbara Linck, Laura Ohrndorf, Sigrid Schubert, Peer Stechert, Johannes Magenheim, Wolfgang Nelles, Jonas Neugebauer, and Niclas Schaper. 2013. Competence model for informatics modelling and system comprehension. In 2013 IEEE Global Engineering Education Conference (EDUCON). 85--93.
[38]
Raymond Lister. 2000. On Blooming First Year Programming, and Its Blooming Assessment. In Proceedings of the Australasian Conference on Computing Education (ACSE '00). ACM, New York, 158--162.
[39]
Raymond Lister and John Leaney. 2003. First Year Programming: Let All the Flowers Bloom. In Proceedings of the Fifth Australasian Conference on Computing Education - Volume 20 (ACE '03). Australian Computer Society, Inc., AUS, 221--230.
[40]
Raymond Lister, Beth Simon, Errol Thompson, Jacqueline L. Whalley, and Christine Prasad. 2006. Not Seeing the Forest for the Trees: Novice Programmers and the SOLO Taxonomy. In Proceedings of the 11th Annual SIGCSE Conference on Innovation & Technology in Computer Science Education (ITICSE '06). ACM, New York, 118--122.
[41]
Andrew Luxton-Reilly. 2016. Learning to Program is Easy. In Proceedings of the 2016 ACM Conference on Innovation & Technology in Computer Science Education (ITiCSE '16). ACM, New York, 284--289.
[42]
Andrew Luxton-Reilly, Simon, Ibrahim Albluwi, Brett A. Becker, Michail Giannakos, Amruth N. Kumar, Linda Ott, James Paterson, Michael James Scott, Judy Sheard, and et al. 2018. Introductory Programming: A Systematic Literature Review. In Proceedings Companion of the 23rd Annual ACM Conference on Innovation & Technology in Computer Science Education (ITiCSE 2018 Companion). ACM, New York, 55--106.
[43]
Heinz Mandl. 1981. Zur Psychologie der Textverarbeitung: Ans"atze, Befunde, Probleme .Urban & Schwarzenberg, München.
[44]
Susana Masapanta-Carrión and J. Ángel Velázquez-Iturbide. 2018. A Systematic Review of the Use of Bloom's Taxonomy in Computer Science Education. In Proceedings of the 49th ACM Technical Symposium on Computer Science Education (SIGCSE '18). ACM, New York, 441--446.
[45]
Susana Masapanta-Carrión and J. Ángel Velázquez-Iturbide. 2019. Evaluating Instructors' Classification of Programming Exercises Using the Revised Bloom's Taxonomy. In Proceedings of the 2019 ACM Conference on Innovation & Technology in Computer Science Education (ITiCSE '19). ACM, New York, 541--547.
[46]
Philipp Mayring. 2015. Qualitative Inhaltsanalyse. 12th ed. Beltz, Weinheim.
[47]
Michael McCracken, Vicki Almstrum, Danny Diaz, Mark Guzdial, Dianne Hagan, Yifat Ben-David Kolikant, Cary Laxer, Lynda Thomas, Ian Utting, and Tadeusz Wilusz. 2001. A Multi-National, Multi-Institutional Study of Assessment of Programming Skills of First-Year CS Students. In Working Group Reports from ITiCSE on Innovation & Technology in Computer Science Education (ITiCSE-WGR '01). ACM, New York, 125--180.
[48]
Anthony Robins, Janet Rountree, and Nathan Rountree. 2003. Learning and teaching programming: A review and discussion. Computer science education, Vol. 13, 2 (2003), 137--172.
[49]
Dominique Simone Rychen and Laura Hersh Salganik. 2001. Defining and selecting key competencies. Hogrefe & Huber Publishers, Washington.
[50]
Andre Schafer, Rainer Brück, Steffen Büchner, Steffen Jaschke, Sigrid Schubert, Dietmar Fey, Bruno Kleinert, and Harald Schmidt. 2012. The Empirically Refined Competence Structure Model for Embedded Micro- and Nanosystems. In Proceedings of the 17th ACM Annual Conference on Innovation & Technology in Computer Science Education (ITiCSE '12). ACM, New York, 57--62.
[51]
Deborah Seehorn, Stephen Carey, Brian Fuschetto, Irene Lee, Daniel Moix, Dianne O'Grady-Cunniff, Barbara Boucher Owens, Chris Stephenson, and Anita Verno. 2011. CSTA K--12 Computer Science Standards: Revised 2011. Technical Report. New York.
[52]
Arbeitskreis "Bildungsstandards SII". 2016. Bildungsstandards Informatik für die Sekundarstufe II. Beilage zu LOG IN, Vol. 36. Jahrgang, 183/184 (2016).
[53]
Simon, Andrew Luxton-Reilly, Vangel V. Ajanovski, Eric Fouh, Christabel Gonsalvez, Juho Leinonen, Jack Parkinson, Matthew Poole, and Neena Thota. 2019. Pass Rates in Introductory Programming and in Other STEM Disciplines. In Proceedings of the Working Group Reports on Innovation & Technology in Computer Science Education (ITiCSE-WGR '19). ACM, New York, 53--71.
[54]
Elliot Soloway and James C Spohrer. 1988. Studying the novice programmer .Lawrence Erlbaum.
[55]
Errol Thompson. 2007. Holistic Assessment Criteria: Applying SOLO to Programming Projects. In Proceedings of the Ninth Australasian Conference on Computing Education - Volume 66 (ACE '07). Australian Computer Society, Inc., AUS, 155--162.
[56]
Errol Thompson, Andrew Luxton-Reilly, Jacqueline L. Whalley, Minjie Hu, and Phil Robbins. 2008. Bloom's Taxonomy for CS Assessment. In Proceedings of the Tenth Conference on Australasian Computing Education - Volume 78 (ACE '08). Australian Computer Society, Inc., AUS, 155--161.
[57]
Kuckartz Udo, Thorsten Dresing, Stefan Radiker, and Klaus Stefer. 2008. Qualitative Evaluation. Der Einstieg in die Praxis .VS Verlag, Wiesbaden.
[58]
Arto Vihavainen, Jonne Airaksinen, and Christopher Watson. 2014. A Systematic Review of Approaches for Teaching Introductory Programming and Their Influence on Success. In Proceedings of the Tenth Annual Conference on International Computing Education Research (ICER '14). ACM, New York, 19--26.
[59]
Florian Waldow. 2009. What PISA did and did not do: Germany after the 'PISA-shock'. European Educational Research Journal, Vol. 8, 3 (2009), 476--483.
[60]
Christopher Watson and Frederick W.B. Li. 2014. Failure Rates in Introductory Programming Revisited. In Proceedings of the 2014 Conference on Innovation & Technology in Computer Science Education (ITiCSE '14). ACM, New York, 39--44.
[61]
Gerald M Weinberg. 1971. The psychology of computer programming. Vol. 932633420. Van Nostrand Reinhold, New York.
[62]
Franz Emanuel Weinert. 2001. Concept of competence: A conceptual clarification. In Defining and selecting key competencies. Hogrefe & Huber, Seattle, 45--65.
[63]
Jacqueline L. Whalley, Raymond Lister, Errol Thompson, Tony Clear, Phil Robbins, P. K. Ajith Kumar, and Christine Prasad. 2006. An Australasian Study of Reading and Comprehension Skills in Novice Programmers .Australian Computer Society, Inc., AUS, 243--252.
[64]
Leon E Winslow. 1996. Programming pedagogy-a psychological overview. ACM Sigcse Bulletin, Vol. 28, 3 (1996), 17--22.
[65]
Stelios Xinogalos. 2016. Designing and deploying programming courses: Strategies, tools, difficulties and pedagogy. Education and Information Technologies, Vol. 21, 3 (2016), 559--588.

Cited By

View all
  • (2025)Towards a Quantitative Competency Model for CS1 via Five-Channel Learning SequencesProceedings of the 56th ACM Technical Symposium on Computer Science Education V. 110.1145/3641554.3701837(367-373)Online publication date: 12-Feb-2025
  • (2024)With Great Power Comes Great Responsibility - Integrating Data Ethics into Computing EducationProceedings of the 2024 on Innovation and Technology in Computer Science Education V. 110.1145/3649217.3653637(471-477)Online publication date: 3-Jul-2024
  • (2024)Feedback-Generation for Programming Exercises With GPT-4Proceedings of the 2024 on Innovation and Technology in Computer Science Education V. 110.1145/3649217.3653594(31-37)Online publication date: 3-Jul-2024
  • Show More Cited By

Index Terms

  1. Towards a Competence Model for the Novice Programmer Using Bloom's Revised Taxonomy - An Empirical Approach

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      ITiCSE '20: Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education
      June 2020
      615 pages
      ISBN:9781450368742
      DOI:10.1145/3341525
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 15 June 2020

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Bloom's revised taxonomy
      2. competence model
      3. programming competence
      4. qualitative content analysis

      Qualifiers

      • Research-article

      Conference

      ITiCSE '20
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 552 of 1,613 submissions, 34%

      Upcoming Conference

      ITiCSE '25
      Innovation and Technology in Computer Science Education
      June 27 - July 2, 2025
      Nijmegen , Netherlands

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)92
      • Downloads (Last 6 weeks)12
      Reflects downloads up to 09 Mar 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2025)Towards a Quantitative Competency Model for CS1 via Five-Channel Learning SequencesProceedings of the 56th ACM Technical Symposium on Computer Science Education V. 110.1145/3641554.3701837(367-373)Online publication date: 12-Feb-2025
      • (2024)With Great Power Comes Great Responsibility - Integrating Data Ethics into Computing EducationProceedings of the 2024 on Innovation and Technology in Computer Science Education V. 110.1145/3649217.3653637(471-477)Online publication date: 3-Jul-2024
      • (2024)Feedback-Generation for Programming Exercises With GPT-4Proceedings of the 2024 on Innovation and Technology in Computer Science Education V. 110.1145/3649217.3653594(31-37)Online publication date: 3-Jul-2024
      • (2024)"Let Them Try to Figure It Out First" - Reasons Why Experts (Do Not) Provide Feedback to Novice ProgrammersProceedings of the 2024 on Innovation and Technology in Computer Science Education V. 110.1145/3649217.3653530(38-44)Online publication date: 3-Jul-2024
      • (2024)Revolutionizing Engineering Education Through Future Skills for Workforce Development at INFOCOMM: A Proposal for Multisensory Decision Sessions Application2024 IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE)10.1109/TALE62452.2024.10834336(1-7)Online publication date: 9-Dec-2024
      • (2024)Unlocking the Future of INFOCOMM Workforce: A Visual KSA Matrix Taxonomy Approach to Education and Occupational Profiles2024 IEEE Global Engineering Education Conference (EDUCON)10.1109/EDUCON60312.2024.10578632(01-09)Online publication date: 8-May-2024
      • (2023)The Robots Are Here: Navigating the Generative AI Revolution in Computing EducationProceedings of the 2023 Working Group Reports on Innovation and Technology in Computer Science Education10.1145/3623762.3633499(108-159)Online publication date: 22-Dec-2023
      • (2023)Socially Responsible Programming in Computing Education and Expectations in the ProfessionProceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 110.1145/3587102.3588839(443-449)Online publication date: 29-Jun-2023
      • (2023)Computing Students' Understanding of Dispositions: A Qualitative StudyProceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 110.1145/3587102.3588797(103-109)Online publication date: 29-Jun-2023
      • (2023)Investigating the Use and Effects of Feedback in CodingBat Exercises: An Exploratory Thinking Aloud Study2023 Future of Educational Innovation-Workshop Series Data in Action10.1109/IEEECONF56852.2023.10104622(1-12)Online publication date: 16-Jan-2023
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media