research-article

Review of recent systems for automatic assessment of programming assignments

Authors:

Petri Ihantola,

Tuukka Ahoniemi,

Ville Karavirta,

Otto SeppäläAuthors Info & Claims

Koli Calling '10: Proceedings of the 10th Koli Calling International Conference on Computing Education Research

Pages 86 - 93

https://doi.org/10.1145/1930464.1930480

Published: 28 October 2010 Publication History

Abstract

This paper presents a systematic literature review of the recent (2006--2010) development of automatic assessment tools for programming exercises. We discuss the major features that the tools support and the different approaches they are using both from the pedagogical and the technical point of view. Examples of these features are ways for the teacher to define tests, resubmission policies, security issues, and so forth. We have also identified a list of novel features, like assessing web software, that are likely to get more research attention in the future. As a conclusion, we state that too many new systems are developed, but also acknowledge the current reasons for the phenomenon. As one solution we encourage opening up the existing systems and joining efforts on developing those further. Selected systems from our survey are briefly described in Appendix A.

References

[1]

K. Ala-Mutka. A survey of automated assessment approaches for programming assignments. Computer Science Education, 15(2):83--102, 2005.

[2]

A. Alstes and J. Lindqvist. Verkkoke: learning routing and network programming online. In ITiCSE '07: Proceedings of the 12th annual SIGCSE Conf. on Innovation and technology in computer science education, pages 91--95, New York, NY, USA, 2007. ACM.

Digital Library

[3]

M. Amelung, P. Forbrig, and D. Rösner. Towards generic and flexible web services for e-assessment. In ITiCSE '08: Proceedings of the 13th annual Conf. on Innovation and technology in computer science education, pages 219--224, New York, NY, USA, 2008. ACM.

Digital Library

[4]

M. Amelung, M. Piotrowski, and D. Rösner. Educomponents: experiences in e-assessment in computer science education. In ITICSE '06: Proceedings of the 11th annual SIGCSE Conf. on Innovation and technology in computer science education, pages 88--92, New York, NY, USA, 2006. ACM.

Digital Library

[5]

D. J. Barnes and M. Kölling. Objects First with Java - A Practical Introduction using BlueJ, Thid edition. Prentice Hall / Pearson Education, 2006.

Digital Library

[6]

J. Biggs and C. Tang. Teaching for Quality Learning at University: What the Student Does (3rd Edition). Open University Press, 2007.

[7]

P. Brereton, B. A. Kitchenham, D. Budgen, M. Turner, and M. Khalil. Lessons from applying the systematic literature review process within the software engineering domain. J. Syst. Softw., 80(4):571--583, 2007.

Digital Library

[8]

P. Brusilovsky and S. Sosnovsky. Individualized exercises for self-assessment of programming knowledge: An evaluation of quizpack. J. Educ. Resour. Comput., 5(3):6, 2005.

Digital Library

[9]

J. Carter, J. English, K. Ala-Mutka, M. Dick, W. Fone, U. Fuller, and J. Sheard. ITICSE working group report: How shall we assess this? SIGCSE Bulletin, 35(4):107--123, 2003.

Digital Library

[10]

M.-Y. Chen, J.-D. Wei, J.-H. Huang, and D. T. Lee. Design and applications of an algorithm benchmark system in a computational problem solving environment. In ITICSE '06: Proceedings of the 11th annual SIGCSE Conf. on Innovation and technology in computer science education, pages 123--127, New York, NY, USA, 2006. ACM.

Digital Library

[11]

J. Coffman and A. C. Weaver. Electronic commerce virtual laboratory. In SIGCSE '10: Proceedings of the 41st ACM technical symposium on Computer science education, pages 92--96, New York, NY, USA, 2010. ACM.

Digital Library

[12]

S. Cooper, W. Dann, and R. Pausch. Alice: a 3-d tool for introductory programming concepts. In CCSC '00: Proceedings of the fifth annual CCSC northeastern Conf. on The journal of computing in small colleges, pages 107--116, USA, 2000. Consortium for Computing Sciences in Colleges.

Digital Library

[13]

M. de Raadt, S. Dekeyser, and T. Y. Lee. Do students sqlify? improving learning outcomes with peer review and enhanced computer assisted assessment of querying skills. In Proceedings of the 6th Baltic Sea Conf. on Computing education research, pages 101--108, New York, NY, USA, 2006. ACM.

Digital Library

[14]

C. Douce, D. Livingstone, and J. Orwell. Automatic test-based assessment of programming: A review. J. Educ. Resour. Comput., 5(3):4, 2005.

Digital Library

[15]

S. H. Edwards and M. A. Pérez-Quiñones. Experiences using test-driven development with an automated grader. J. Comput. Small Coll., 22(3):44--50, 2007.

Digital Library

[16]

S. H. Edwards and M. A. Pérez-Quiñones. Web-cat: automatically grading programming assignments. In ITiCSE '08: Proceedings of the 13th annual Conf. on Innovation and technology in computer science education, pages 328--328, New York, NY, USA, 2008. ACM.

Digital Library

[17]

M. Forišek. On the suitability of programming tasks for automated evaluation. Informatics in education, 5(1):63--76, 2006.

Digital Library

[18]

M. Forišek. Security of programming contest systems. In Informatics in Secondary Schools, Evolution and Perspectives, Vilnius, Lithuania, 2006.

[19]

X. Fu, B. Peltsverger, K. Qian, L. Tao, and J. Liu. Apogee: automated project grading and instant feedback system for web based computing. In SIGCSE '08: Proceedings of the 39th SIGCSE technical symposium on Computer science education, pages 77--81, New York, NY, USA, 2008. ACM.

Digital Library

[20]

G. Gárcia-Mateos and J. L. Fernández-Alemán. A course on algorithms and data structures using on-line judging. SIGCSE Bull., 41(3):45--49, 2009.

Digital Library

[21]

O. Gotel and C. Scharff. Adapting an open-source web-based assessment system for the automated assessment of programming problems. In WBED'07: Proceedings of the sixth Conf. on IASTED International Conf. Web-Based Education, pages 437--442, Anaheim, CA, USA, 2007. ACTA Press.

Digital Library

[22]

O. Gotel, C. Scharff, and A. Wildenberg. Extending and contributing to an open source web-based system for the assessment of programming problems. In PPPJ '07: Proceedings of the 5th international symposium on Principles and practice of programming in Java, pages 3--12, New York, NY, USA, 2007. ACM.

Digital Library

[23]

O. Gotel, C. Scharff, and A. Wildenberg. Teaching software quality assurance by encouraging student contributions to an open source web-based system for the assessment of programming assignments. SIGCSE Bull., 40(3):214--218, 2008.

Digital Library

[24]

G. R. Gray and C. A. Higgins. An introspective approach to marking graphical user interfaces. In ITICSE '06: Proceedings of the 11th annual SIGCSE Conf. on Innovation and technology in computer science education, pages 43--47, New York, NY, USA, 2006. ACM.

Digital Library

[25]

T. Greening. Computer Science Educational Futures: The Nature of 2020" Foresight. In Computer Science Education in the 21st Century, pages 1--6. Springer Verlag, 1999.

[26]

P. Guerreiro and K. Georgouli. Combating anonymousness in populous cs1 and cs2 courses. In ITICSE '06: Proceedings of the 11th annual SIGCSE Conf. on Innovation and technology in computer science education, pages 8--12, New York, NY, USA, 2006. ACM.

Digital Library

[27]

E. Gutiérrez, M. A. Trenas, J. Ramos, F. Corbera, and S. Romero. A new moodle module supporting automatic verification of vhdl-based assignments. Comput. Educ., 54(2):562--577, 2010.

Digital Library

[28]

F. Gutierrez. Stingray: a hands-on approach to learning information security. In SIGITE '06: Proceedings of the 7th Conf. on Information technology education, pages 53--58, New York, NY, USA, 2006. ACM.

Digital Library

[29]

M. T. Helmick. Interface-based programming assignments and automatic grading of java programs. In ITiCSE '07: Proceedings of the 12th annual SIGCSE Conf. on Innovation and technology in computer science education, pages 63--67, New York, NY, USA, 2007. ACM.

Digital Library

[30]

C. Higgins, T. Hegazy, P. Symeonidis, and A. Tsintsifas. The coursemarker cba system: Improvements over ceilidh. Education and Information Technologies, 8(3):287--304, 2003.

Digital Library

[31]

C. D. Hundhausen and J. L. Brown. An experimental study of the impact of visual semantic feedback on novice programming. J. Vis. Lang. Comput., 18(6):537--559, 2007.

Digital Library

[32]

W.-Y. Hwang, C.-Y. Wang, G.-J. Hwang, Y.-M. Huang, and S. Huang. A web-based programming learning environment to support cognitive development. Interacting with Computers, 20(6):524--534, 2008.

Digital Library

[33]

P. Ihantola. Creating and visualizing test data from programming exercises. Informatics in education, 6(1):81--102, 2007.

Digital Library

[34]

D. Jackson and M. Usher. Grading student programs using assyst. In SIGCSE '97: Proceedings of the twenty-eighth SIGCSE technical symposium on Computer science education, pages 335--339, New York, NY, USA, 1997. ACM.

Digital Library

[35]

T. Janhunen, T. Jussila, M. Järvisalo, and E. Oikarinen. Teaching Smullyan's analytic tableaux in a scalable learning environment. In Proceedings of the Fourth Finnish / Baltic Sea Conf. on Computer Science Education, volume TKO-42/04 of Research Report Series of Laboratory of Information Processing Science, Helsinki University of Technology, pages 85--94. Otamedia, December 2004.

[36]

D. Jimenez-Gonzalez, C. Alvarez, D. Lopez, J.-M. Parcerisa, J. Alonso, C. Perez, R. Tous, P. Barlet, M. Fernandez, and J. Tubella. Work in progress-improving feedback using an automatic assessment tool. In Proceedings of 38th annual Frontiers in Education Conf., pages S3B--9--T1A--10, oct. 2008.

[37]

M. Joy, N. Griffiths, and R. Boyatt. The BOSS online submission and assessment system. In ACM Journal on Educational Resources in Computing, volume 5, number 3, September 2005. Article 2. ACM, 2005.

Digital Library

[38]

H. Ke, G. Zhang, and H. Yan. Automatic grading system on sql programming. In Scalable Computing and Communications; Eighth International Conf. on Embedded Computing, 2009. SCALCOM-EMBEDDEDCOM'09. International Conf. on, pages 537--540, sept. 2009.

Digital Library

[39]

R. Kolstad. Infrastructure for contest task development. Olympiads in Informatics, 3:38--59, 2009.

[40]

A. Korhonen, L. Malmi, and P. Silvasti. TRAKLA2: a framework for automatically assessed visual algorithm simulation exercises. In Proceedings of the Third Annual Baltic Conf. on Computer Science Education, pages 48--56, Joensuu, Finland, 2003.

[41]

T. Lehtonen. Javala -- addictive e-learning of the java programming language. In Koli Calling 2005 -- Fifth Koli Calling Conf. on Computer Science Education, pages 41--48, 2005.

[42]

Y. Liang, Q. Liu, J. Xu, and D. Wang. The recent development of automated programming assessment. In Computational Intelligence and Software Engineering, 2009. CiSE 2009. International Conf. on, pages 1--5, dec. 2009.

[43]

M. Lingling, Q. Xiaojie, Z. Zhihong, Z. Gang, and X. Ying. An assessment tool for assembly language programming. In Computer Science and Software Engineering, 2008, volume 5, pages 882--884, dec. 2008.

Digital Library

[44]

L. Malmi, V. Karavirta, A. Korhonen, and J. Nikander. Experiences on automatically assessed algorithm simulation exercises with different resubmission policies. Journal of Educational Resources in Computing, 5(3), September 2005.

Digital Library

[45]

M. V. Mäntylä and C. Lassenius. Drivers for software refactoring decisions. In ISESE '06: Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering, pages 297--306, New York, NY, USA, 2006. ACM.

Digital Library

[46]

M. Mareš. Perspectives on grading systems. Olympiads in Informatics, 1:124--130, 2007.

[47]

M. Mareš. Moe -- design of a modular grading system. Olympiads in Informatics, 3:60--66, 2009.

[48]

B. Merry. Using a linux security module for contest security. Olympiads in Informatics, 3:67--73, 2009.

[49]

A. Moreno, N. Myller, E. Sutinen, and M. Ben-Ari. Visualizing programs with Jeliot 3. In Proceedings of the International Working Conf. on Advanced Visual Interfaces, pages 373--376, Gallipoli (Lecce), Italy, May 2004. ACM.

Digital Library

[50]

K. A. Naudé, J. H. Greyling, and D. Vogts. Marking student programs using graph similarity. Comput. Educ., 54(2):545--561, 2010.

Digital Library

[51]

P. Nordquist. Providing accurate and timely feedback by automatically grading student programming labs. J. Comput. Small Coll., 23(2):16--23, 2007.

Digital Library

[52]

R. Oechsle and K. Barzen. Checking automatically the output of concurrent threads. In ITiCSE '07: Proceedings of the 12th annual SIGCSE Conf. on Innovation and technology in computer science education, pages 43--47, New York, NY, USA, 2007. ACM.

Digital Library

[53]

J. O'Kelly and J. P. Gibson. Robocode & problem-based learning: a non-prescriptive approach to teaching programming. In ITICSE '06: Proceedings of the 11th annual SIGCSE Conf. on Innovation and technology in computer science education, pages 217--221, New York, NY, USA, 2006. ACM.

Digital Library

[54]

R. E. Pattis, J. Roberts, and M. Stehlik. Karel the robot (2nd ed.): a gentle introduction to the art of programming. John Wiley & Sons, Inc., New York, NY, USA, 1994.

Digital Library

[55]

A. Pears, S. Seidman, C. Eney, P. Kinnunen, and L. Malmi. Constructing a core literature for computing education research. SIGCSE Bulletin, 37(4):152--161, 2005.

Digital Library

[56]

A. Radenski. Digital cs1 study pack based on moodle and python. In ITiCSE '08: Proceedings of the 13th annual Conf. on Innovation and technology in computer science education, pages 325--325, New York, NY, USA, 2008. ACM.

Digital Library

[57]

M. A. Revilla, S. Manzoor, and R. Liu. Competitive learning in informatics: The uva online judge experience. Olympiads in Informatics, 2:131--148, 2008.

[58]

P. Ribeiro and P. Guerreiro. Increasing the appeal of programming contests with tasks involving graphical user interfaces and computer graphics. Olympiads in Informatics, 1:139--164, 2007.

[59]

M. M. T. Rodrigo, R. S. Baker, M. C. Jadud, A. C. M. Amarra, T. Dy, M. B. V. Espejo-Lahoz, S. A. L. Lim, S. A. Pascua, J. O. Sugay, and E. S. Tabanao. Affective and behavioral predictors of novice programmer achievement. In ITiCSE '09: Proceedings of the 14th annual ACM SIGCSE Conf. on Innovation and technology in computer science education, pages 156--160, New York, NY, USA, 2009. ACM.

Digital Library

[60]

G. Rößling and B. Freisleben. ANIMAL: A system for supporting multiple roles in algorithm animation. Journal of Visual Languages and Computing, 13(3):341--354, 2002.

[61]

G. Rößling and S. Hartte. Webtasks: online programming exercises made easy. SIGCSE Bull., 40(3):363--363, 2008.

Digital Library

[62]

G. Rößling, M. Joy, A. Moreno, A. Radenski, L. Malmi, A. Kerren, T. Naps, R. J. Ross, M. Clancy, A. Korhonen, R. Oechsle, and J. A. V. Iturbide. Enhancing learning management systems to better support computer science education. SIGCSE Bull., 40(4):142--166, 2008.

Digital Library

[63]

G. Rößling and T. Vellaramkalayil. A visualization-based computer science hypertextbook prototype. Trans. Comput. Educ., 9(2):1--13, 2009.

Digital Library

[64]

G. Rowe and G. Wright. The delphi technique as a forecasting tool: issues and analysis. International Journal of Forecasting, 15(4):353--375, October 1999.

[65]

J. A. Sant. "mailing it in": email-centric automated assessment. In ITiCSE '09: Proceedings of the 14th annual ACM SIGCSE Conf. on Innovation and technology in computer science education, pages 308--312, New York, NY, USA, 2009. ACM.

Digital Library

[66]

J. P. Sauvé and O. L. Abath Neto. Teaching software development with atdd and easyaccept. In SIGCSE '08: Proceedings of the 39th SIGCSE technical symposium on Computer science education, pages 542--546, New York, NY, USA, 2008. ACM.

Digital Library

[67]

J. P. Sauvé, O. L. Abath Neto, and W. Cirne. Easyaccept: a tool to easily create, run and drive development with automated acceptance tests. In AST '06: Proceedings of the 2006 international workshop on Automation of software test, pages 111--117, New York, NY, USA, 2006. ACM.

Digital Library

[68]

J. Sheard, S. Simon, M. Hamilton, and J. Lönnberg. Analysis of research into the teaching and learning of programming. In ICER '09: Proceedings of the fifth international workshop on Computing education research workshop, pages 93--104, New York, NY, USA, 2009. ACM.

Digital Library

[69]

M. Sitaraman, J. O. Hallstrom, J. White, S. Drachova-Strang, H. K. Harton, D. Leonard, J. Krone, and R. Pak. Engaging students in specification and reasoning: "hands-on" experimentation and evaluation. In ITiCSE '09: Proceedings of the 14th annual ACM SIGCSE Conf. on Innovation and technology in computer science education, pages 50--54, New York, NY, USA, 2009. ACM.

Digital Library

[70]

A. Solomon, D. Santamaria, and R. Lister. Automated testing of unix command-line and scripting skills. In Information Technology Based Higher Education and Training, 2006. ITHET '06. 7th International Conf. on, pages 120--125, july 2006.

[71]

H. Sondergaard. Learning from and with peers: the different roles of student peer reviewing. In ITiCSE '09: Proceedings of the 14th annual ACM SIGCSE Conf. on Innovation and technology in computer science education, pages 31--35, New York, NY, USA, 2009. ACM.

Digital Library

[72]

J. Spacco, D. Hovemeyer, W. Pugh, F. Emad, J. K. Hollingsworth, and N. Padua-Perez. Experiences with marmoset: designing and using an advanced submission and testing system for programming courses. In ITICSE '06: Proceedings of the 11th annual SIGCSE Conf. on Innovation and technology in computer science education, pages 13--17, New York, NY, USA, 2006. ACM.

Digital Library

[73]

J. T. Stasko. TANGO: A framework and system for algorithm animation. IEEE Computer, 23(9):27--39, 1990.

Digital Library

[74]

H. Suleman. Automatic marking with sakai. In SAICSIT '08: Proceedings of the 2008 annual research Conf. of the South African Institute of Computer Scientists and Information Technologists on IT research in developing countries, pages 229--236, New York, NY, USA, 2008. ACM.

Digital Library

[75]

M. Sztipanovits, K. Qian, and X. Fu. The automated web application testing (awat) system. In ACM-SE 46: Proceedings of the 46th Annual Southeast Regional Conf., pages 88--93, New York, NY, USA, 2008. ACM.

Digital Library

[76]

P. G. Thomas, N. Smith, and K. G. Waugh. Computer assisted assessment of diagrams. In ITiCSE '07: Proceedings of the 12th annual SIGCSE Conf. on Innovation and technology in computer science education, pages 68--72, New York, NY, USA, 2007. ACM.

Digital Library

[77]

M. Thornton, S. H. Edwards, R. P. Tan, and M. A. Pérez-Quiñones. Supporting student-written tests of gui programs. In SIGCSE '08: Proceedings of the 39th SIGCSE technical symposium on Computer science education, pages 537--541, New York, NY, USA, 2008. ACM.

Digital Library

[78]

D. W. Valentine. CS educational research: a meta-analysis of SIGCSE technical symposium proceedings. In SIGCSE '04: Proceedings of the 35th SIGCSE Technical Symposium on Computer Science Education, pages 255--259, New York, NY, USA, 2004. ACM Press.

Digital Library

[79]

T. Verhoeff. Programming task packages: Peach exchange format. Olympiads in Informatics, 2:192--207, 2008.

[80]

T. Wang, X. Su, Y. Wang, and P. Ma. Semantic similarity-based grading of student programs. Inf. Softw. Technol., 49(2):99--107, 2007.

Digital Library

Cited By

Novak MKermek D(2024)Assessment Automation of Complex Student Programming AssignmentsEducation Sciences10.3390/educsci1401005414:1(54)Online publication date: 1-Jan-2024
https://doi.org/10.3390/educsci14010054
Cipriano BBaltazar BFachada NVourvopoulos AAlves P(2024)Bridging the Gap between Project-Oriented and Exercise-Oriented Automatic Assessment ToolsComputers10.3390/computers1307016213:7(162)Online publication date: 30-Jun-2024
https://doi.org/10.3390/computers13070162
Htet EWai KAung SFunabiki NLu XKyaw HKao W(2024)Code Plagiarism Checking Function and Its Application for Code Writing Problem in Java Programming Learning Assistant SystemAnalytics10.3390/analytics30100043:1(46-62)Online publication date: 17-Jan-2024
https://doi.org/10.3390/analytics3010004
Show More Cited By

Index Terms

Review of recent systems for automatic assessment of programming assignments

Recommendations

Automated Assessment of Programming Assignments
CSERC '13: Proceedings of the 3rd Computer Science Education Research Conference on Computer Science Education Research

This is a position paper in which I argue that massive open online programming courses can benefit by the application of automated assessment of programming assignments.

I gathered success factors and identified concerns related to automatic assessment ...
Peer assessment methodology of open-ended assignments: Insights from a two-year case study within a university course using novel open source system
Abstract
Peer assessment is a process in which students rate their peers which has many benefits for both the assessor and the assessed. It actively engages students, increases motivation by giving a sense of ownership of the assessment process, ...
Validating the octave allegro information systems risk assessment methodology: a case study

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

Koli Calling '10: Proceedings of the 10th Koli Calling International Conference on Computing Education Research

October 2010

125 pages

ISBN:9781450305204

DOI:10.1145/1930464

Conference Chairs:
Carsten Schulte,
Jarkko Suhonen

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

FU-BERLIN: Free University Berlin

In-Cooperation

SIGCSE: ACM Special Interest Group on Computer Science Education

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 October 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

Koli Calling '10

Sponsor:

FU-BERLIN

Koli Calling '10: 10th Koli Calling International Conference on Computing Education Research

October 28 - 31, 2010

Koli, Finland

Acceptance Rates

Overall Acceptance Rate 80 of 182 submissions, 44%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

342
Total Citations
View Citations
3,620
Total Downloads

Downloads (Last 12 months)195
Downloads (Last 6 weeks)21

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Novak MKermek D(2024)Assessment Automation of Complex Student Programming AssignmentsEducation Sciences10.3390/educsci1401005414:1(54)Online publication date: 1-Jan-2024
https://doi.org/10.3390/educsci14010054
Cipriano BBaltazar BFachada NVourvopoulos AAlves P(2024)Bridging the Gap between Project-Oriented and Exercise-Oriented Automatic Assessment ToolsComputers10.3390/computers1307016213:7(162)Online publication date: 30-Jun-2024
https://doi.org/10.3390/computers13070162
Htet EWai KAung SFunabiki NLu XKyaw HKao W(2024)Code Plagiarism Checking Function and Its Application for Code Writing Problem in Java Programming Learning Assistant SystemAnalytics10.3390/analytics30100043:1(46-62)Online publication date: 17-Jan-2024
https://doi.org/10.3390/analytics3010004
Pesic DVujosevic-Janicic MMisic MProtic J(2024)A novel approach to source code assembling in the field of algorithmic complexityComputer Science and Information Systems10.2298/CSIS230730015P21:3(781-806)Online publication date: 2024
https://doi.org/10.2298/CSIS230730015P
Brusilovsky P(2024)Intelligent Technologies for Personalized Practice SystemsInformation and Technology in Education and Learning10.12937/itel.4.1.Inv.p0014:1(Inv-p001-Inv-p001)Online publication date: 2024
https://doi.org/10.12937/itel.4.1.Inv.p001
Lee UJeong YKoh JByun GLee YLee HEun SMoon JLim CKim H(2024)I see you: teacher analytics with GPT-4 vision-powered observational assessmentSmart Learning Environments10.1186/s40561-024-00335-411:1Online publication date: 16-Oct-2024
https://doi.org/10.1186/s40561-024-00335-4
Sölch MPaulsen MKrusche S(2024)Transforming Computer-Based Exams with BYOD: An Empirical StudyProceedings of the 24th Koli Calling International Conference on Computing Education Research10.1145/3699538.3699560(1-11)Online publication date: 12-Nov-2024
https://dl.acm.org/doi/10.1145/3699538.3699560
Anotaipaiboon W(2024)A Single-File Markup Format for Generation of Interactive Programming Exercises with Auto-GradingProceedings of the 2024 8th International Conference on Education and Multimedia Technology10.1145/3678726.3678741(65-69)Online publication date: 22-Jun-2024
https://dl.acm.org/doi/10.1145/3678726.3678741
Lu XWang XJoyner DKim MWang XXia M(2024)Generative Students: Using LLM-Simulated Student Profiles to Support Question Item EvaluationProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3662031(16-27)Online publication date: 9-Jul-2024
https://dl.acm.org/doi/10.1145/3657604.3662031
Zhong HNiu JLi J(2024)InsProg: Supporting Teaching Through Visual Analysis of Students’ Programming ProcessesProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656668(1-5)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3656650.3656668
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten