research-article

Assessment of modeling and simulation in secondary computing science education

Authors:

Natasa Grgurina,

Erik Barendsen,

Bert Zwaneveld,

Klaas van VeenAuthors Info & Claims

WiPSCE '18: Proceedings of the 13th Workshop in Primary and Secondary Computing Education

Article No.: 7, Pages 1 - 10

https://doi.org/10.1145/3265757.3265764

Published: 04 October 2018 Publication History

Abstract

The introduction of the new computing science curriculum in the Netherlands in 2019 raises the need for new evidence-based teaching materials that include practical assignments and guidelines for their assessment. As a part of our research project on teaching Computational Science (modeling and simulation), we participate in these efforts and developed a curriculum intervention including a practical assignment and an accompanying assessment instrument consisting of grading rubrics based on the SOLO taxonomy. In this research paper we focus on the assessment instrument. We describe its development and report on a pilot study carried out in the secondary computing science course implementing the curriculum intervention. The instrument proved to be reliable and effective in tracing high and low levels of the students' achievements in modeling and simulation projects and exposed the expected differences in performance levels of various groups of students, which renders it useful for both formative and summative assessment. Furthermore, our application of the instrument has provided new insights into the needs of specific groups of students to receive instruction prior to and during the work on the assignments.

References

[1]

Edouard Amouroux, Benoit Gaudou, Stéphanie Desvaux, and Alexis Drogoul. 2010. Odd: A promising but incomplete formalism for individual-based model specification. In Computing and Communication Technologies, Research, Innovation, and Vision for the Future (RIVF), 2010 IEEE RIVF International Conference on. IEEE, 1--4.

[2]

E. Barendsen and J. Tolboom. 2016. Advisory report (intended) curriculum for informatics for upper secondary education. Technical Report. SLO. ID: 1204.

[3]

Bernhard Bauer, Jrg P. Mller, and James Odell. 2001. Agent UML: A formalism for specifying multiagent software systems. International journal of software engineering and knowledge engineering 11, 03 (2001), 207--230.

[4]

John Biggs and Catherine Tang. 2011. Teaching for quality learning at university. McGraw-Hill International. ID: 875.

[5]

P. Blikstein and U. Wilensky. 2009. An Atom is Known by the Company it Keeps: Content, Representation and Pedagogy within the Epistemic Revolution of the Complexity Sciences. (2009). ID: 784.

[6]

Karen Brennan and Mitchel Resnick. 2012. New Frameworks for Studying and Assessing the Development of Computational Thinking. In Proceedings of the 2012 annual meeting of the American Educational Research Association, Vancouver, Canada. ID: 763.

[7]

Michael E. Caspersen and Palle Nowack. {n. d.}. Model-Based Thinking & Practice. ({n. d.}). ID: 1014.

[8]

Francisco Enrique Vicente Castro and Kathi Fisler. 2017. Designing a Multifaceted SOLO Taxonomy to Track Program Design Skills Through an Entire Course. In Proceedings of the 17th Koli Calling Conference on Computing Education Research (Koli Calling '17). ACM, New York, NY, USA, 10--19.

Digital Library

[9]

CSTA Computational Thinking Task Force. 2011. Operational Definition of Computational Thinking for K-12 Education. http://csta.acm.org/Curriculum/sub/CurrFiles/CompThinkingFlyer.pdf ID: 744.

[10]

J. K. Gilbert. 2006. On the nature of "context" in chemical education. International Journal of Science Education 28, 9 (2006), 957--976. ID: 343.

[11]

N. Grgurina, E. Barendsen, C. Suhre, K. van Veen, and B. Zwaneveld. 2017. Investigating Informatics Teachers' Initial Pedagogical Content Knowledge on Modeling and Simulation. (2017).

[12]

N. Grgurina, E. Barendsen, C. Suhre, K. van Veen, and B. Zwaneveld. 2018. Assessment of Modeling Projects in Informatics Class. in press.

[13]

Nataša Grgurina, Erik Barendsen, Klaas van Veen, Cor Suhre, and Bert Zwaneveld. 2015. Exploring Students' Computational Thinking Skills in Modeling and Simulation Projects: a Pilot Study. In Proceedings of the Workshop in Primary and Secondary Computing Education. ACM, 65--68. ID: 1126.

Digital Library

[14]

Nataša Grgurina, Erik Barendsen, Bert Zwaneveld, Wim van de Grift, and Idzard Stoker. 2013. Computational Thinking Skills in Dutch Secondary Education. In Proceedings of the 8th Workshop in Primary and Secondary Computing Education. ACM, 31--32. ID: 1072.

Digital Library

[15]

Nataša Grgurina, Erik Barendsen, Bert Zwaneveld, Klaas van Veen, and Idzard Stoker. 2014. Computational Thinking Skills in Dutch Secondary Education: Exploring Pedagogical Content Knowledge. In Proceedings of the 14th Koli Calling International Conference on Computing Education Research. ACM, 173--174. ID: 1069.

Digital Library

[16]

Nataša Grgurina, Erik Barendsen, Bert Zwaneveld, Klaas van Veen, and Idzard Stoker. 2014. Computational Thinking Skills in Dutch Secondary Education: Exploring Teacher's Perspective. In Proceedings of the 9th Workshop in Primary and Secondary Computing Education. ACM, 124--125. ID: 1056.

Digital Library

[17]

Nataša Grgurina, Erik Barendsen, Bert Zwaneveld, Klaas van Veen, and Cor Suhre. 2016. Defining and Observing Modeling and Simulation in Informatics. In International Conference on Informatics in Schools: Situation, Evolution, and Perspectives. Springer, 130--141. ID: 1378.

[18]

Volker Grimm, Uta Berger, Finn Bastiansen, Sigrunn Eliassen, Vincent Ginot, Jarl Giske, John Goss-Custard, Tamara Grand, Simone K. Heinz, and Geir Huse. 2006. A standard protocol for describing individual-based and agent-based models. Ecological Modelling 198, 1--2 (2006), 115--126.

[19]

Volker Grimm, Uta Berger, Donald L. DeAngelis, J. Gary Polhill, Jarl Giske, and Steven F. Railsback. 2010. The ODD protocol: a review and first update. Ecological Modelling 221, 23 (2010), 2760--2768. ID: 1182.

[20]

Rosária S. Justi and John K. Gilbert. 2002. Science teachers' knowledge about and attitudes towards the use of models and modelling in learning science. International Journal of Science Education 24, 12 (2002), 1273--1292. ID: 936.

[21]

David R. Krathwohl. 2002. A revision of Bloom's taxonomy: An overview. Theory into practice 41, 4 (2002), 212--218. ID: 789.

[22]

Sze Yee Lye and Joyce Hwee Ling Koh. 2014. Review on teaching and learning of computational thinking through programming: What is next for K-12? Computers in Human Behavior 41 (2014), 51--61.

Digital Library

[23]

S. Magnusson, J. Krajcik, and H. Borko. 1999. Nature, sources, and development of pedagogical content knowledge for science teaching. Kluwer, 95--132. ID: 584.

[24]

Orni Meerbaum-Salant, Michal Armoni, and Mordechai Ben-Ari. 2013. Learning Computer Science Concepts with Scratch. Computer Science Education 23, 3 (2013), 239--264. ID: 1080.

[25]

Birgit Müller, Stefano Balbi, Carsten M Buchmann, Luís De Sousa, Gunnar Dressler, Jürgen Groeneveld, Christian J Klassert, Quang Bao Le, James DA Millington, Henning Nolzen, et al. 2014. Standardised and transparent model descriptions for agent-based models: Current status and prospects. Environmental Modelling & Software 55 (2014), 156--163.

Digital Library

[26]

James J. Odell, H. Van Dyke Parunak, and Bernhard Bauer. 2000. Representing agent interaction protocols in UML. In International Workshop on Agent-Oriented Software Engineering. Springer, 121--140.

Digital Library

[27]

K. Van Overveld, T. Borghuis, and E. van Berkum. 2015. From Problems to Numbers and Back. Eindhoven University of Technology, Eindhoven. ID: 1099.

[28]

James Rumbaugh, Ivar Jacobson, and Grady Booch. 2004. Unified modeling language reference manual, the. Pearson Higher Education.

Digital Library

[29]

Frits Vaandrager. 2011. A First Introduction to uppaal. Deliverable no.: D5.12 Title of Deliverable: Industrial Handbook 18 (2011).

[30]

Jacqueline Whalley, Tony Clear, Phil Robbins, and Errol Thompson. 2011. Salient elements in novice solutions to code writing problems. In Proceedings of the Thirteenth Australasian Computing Education Conference-Volume 114. Australian Computer Society, Inc., 37--46.

Digital Library

[31]

U. Wilensky. 1997. Net Logo Wolf Sheep Predation model. http://ccl.northwestern.edu/netlogo/models/WolfSheepPredation

[32]

U. Wilensky. 1999. NetLogo. http://ccl.northwestern.edu/netlogo/

[33]

Uri Wilensky. 2014. Computational thinking through modeling and simulation. Whitepaper presented at the summit on future directions in computer education.Orlando, FL.http://www.stanford.edu/coopers/2013Summit/WilenskyUriNorthwesternREV.pdf (2014). ID: 1120.

[34]

Uri Wilensky and William Rand. 2015. An introduction to agent-based modeling: modeling natural, social, and engineered complex systems with NetLogo. MIT Press. ID: 1184.

Digital Library

[35]

Kenneth Wolf and Ellen Stevens. 2007. The role of rubrics in advancing and assessing student learning. The Journal of Effective Teaching 7, 1 (2007), 3--14. ID: 975.

[36]

Baichang Zhong, Qiyun Wang, Jie Chen, and Yi Li. 2016. An exploration of three-dimensional integrated assessment for computational thinking. Journal of Educational Computing Research 53, 4 (2016), 562--590.

Cited By

Bijak JHilton JHinsch MLipscombe KNurse SPrike TSmith PReinhardt OUhrmacher AHigham PGrow A(2021)Teaching a modeling processProceedings of the Winter Simulation Conference10.5555/3522802.3523031(1-12)Online publication date: 13-Dec-2021
https://dl.acm.org/doi/10.5555/3522802.3523031
Bijak JHilton JHinsch MLipscombe KNurse SPrike TSmith PReinhardt OUhrmacher AHigham PGrow A(2021)Teaching a Modeling Process: Reflections From An Online Course2021 Winter Simulation Conference (WSC)10.1109/WSC52266.2021.9715415(1-12)Online publication date: 12-Dec-2021
https://doi.org/10.1109/WSC52266.2021.9715415
Al-Khazraji AIsmaeel S(2020)Efficient Practices on Teaching Modeling and Simulation for Engineers2020 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE)10.1109/CCECE47787.2020.9255788(1-4)Online publication date: 30-Aug-2020
https://doi.org/10.1109/CCECE47787.2020.9255788
Show More Cited By

Index Terms

Assessment of modeling and simulation in secondary computing science education
1. Social and professional topics
  1. Professional topics
    1. Computing education
      1. Computing education programs
        Computational science and engineering education
        Computer science education
      2. K-12 education

Recommendations

Computing education for secondary school teachers: A cooperative effort between computer scientist and educators
SIGCSE '81: Proceedings of the twelfth SIGCSE technical symposium on Computer science education

The proposed program will establish a Computer Education Institute for computing, mathematics, and science teachers and supervisors in grade 7 to 12. The goals of the program are to: (1) provide teachers with a knowledge of programming in BASIC, and ...
Computing education for secondary school teachers: A cooperative effort between computer scientist and educators
Proceedings of the 12th SIGCSE symposium on Computer science education

The proposed program will establish a Computer Education Institute for computing, mathematics, and science teachers and supervisors in grade 7 to 12. The goals of the program are to: (1) provide teachers with a knowledge of programming in BASIC, and ...
Assessment of computer science learning in a scratch-based outreach program
SIGCSE '13: Proceeding of the 44th ACM technical symposium on Computer science education

Many institutions have created and deployed outreach programs for middle school students with the goal of increasing the number and diversity of students who later pursue careers in computer science. While these programs have been shown to increase ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

WiPSCE '18: Proceedings of the 13th Workshop in Primary and Secondary Computing Education

October 2018

170 pages

ISBN:9781450365888

DOI:10.1145/3265757

Program Chairs:
Andreas Mühling
Kiel University
,
Quintin Cutts
University of Glasgow

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 October 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

WiPSCE '18

WiPSCE '18: Workshop in Primary and Secondary Computing Education

October 4 - 6, 2018

Potsdam, Germany

Acceptance Rates

WiPSCE '18 Paper Acceptance Rate 32 of 72 submissions, 44%;

Overall Acceptance Rate 104 of 279 submissions, 37%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
237
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)2

Reflects downloads up to 27 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bijak JHilton JHinsch MLipscombe KNurse SPrike TSmith PReinhardt OUhrmacher AHigham PGrow A(2021)Teaching a modeling processProceedings of the Winter Simulation Conference10.5555/3522802.3523031(1-12)Online publication date: 13-Dec-2021
https://dl.acm.org/doi/10.5555/3522802.3523031
Bijak JHilton JHinsch MLipscombe KNurse SPrike TSmith PReinhardt OUhrmacher AHigham PGrow A(2021)Teaching a Modeling Process: Reflections From An Online Course2021 Winter Simulation Conference (WSC)10.1109/WSC52266.2021.9715415(1-12)Online publication date: 12-Dec-2021
https://doi.org/10.1109/WSC52266.2021.9715415
Al-Khazraji AIsmaeel S(2020)Efficient Practices on Teaching Modeling and Simulation for Engineers2020 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE)10.1109/CCECE47787.2020.9255788(1-4)Online publication date: 30-Aug-2020
https://doi.org/10.1109/CCECE47787.2020.9255788
Lytle NCateté VDong YBoulden DAkram BHouchins JBarnes TWiebe EZhang MYang BCooper SLuxton-Reilly A(2019)CEOProceedings of the ACM Conference on Global Computing Education10.1145/3300115.3309527(58-64)Online publication date: 9-May-2019
https://dl.acm.org/doi/10.1145/3300115.3309527
Loper MBronston MBerenbach B(2019)Modeling &Amp; Simulation in Systems Engineering: A Survey Course2019 Winter Simulation Conference (WSC)10.1109/WSC40007.2019.9004797(3295-3306)Online publication date: Dec-2019
https://doi.org/10.1109/WSC40007.2019.9004797

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents