Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/1294325.1294327acmconferencesArticle/Chapter ViewAbstractPublication PagespppjConference Proceedingsconference-collections
Article

Extending and contributing to an open source web-based system for the assessment of programming problems

Published: 05 September 2007 Publication History

Abstract

This paper describes the development of a web-based programming and assessment environment for use in supporting programming fundamentals courses (CS1, CS2) taught in Java. This environment is currently linked with WeBWorK, an open source web-based system developed at the University of Rochester that is popular for administering and assessing mathematics and physics coursework, but is designed for the potential integration with other course management system (CMS) environments. In addition to the traditional multiple-choice and short answer questions that have been augmented with the extensive randomization and customization routines of WeBWorK, this new environment (called WeBWorK-JAG where JAG stands for Java Auto Grader) can automatically collect and grade free-form program fragments written in Java. Novel pedagogy has been developed based on the capabilities of this extension and preliminary classroom results are discussed in this paper. For example, when students contributed to WeBWorK by creating WeBWorK-JAG questions for their peers, they are exposed to the reality of creating comprehensive unit tests and to the wider quality assurance aspects of formulating questions and their solution sets. This work is described in the context of an emerging commercial market for web-based programming assistants and its unique contributions are summarized.

References

[1]
J. Baldwin, E. Crupi, and T. Estrellado. WeBWorK for programming fundamentals. In Proc. 11th Conference on Innovation and Technology in Computer Science Education, page 361, New York, NY, 2006. ACM Press. (poster).
[2]
J. Baldwin, E. Crupi, T. Estrellado, O. Gotel, R. Kline, C. Scharff, and A. Wildenberg. Examples of WeBWorK programming assignments. In Proc. 37th SIGCSE Technical Symposium on Computer Science Education, Houston, Texas, USA, 2006. (poster).
[3]
K. Beck. Extreme Programming Explained, Embrace Change. Addison-Wesley, 2001.
[4]
BOSS Home Page. http://www.dcs.warwick.ac.uk/boss.
[5]
M. Bower. The effect of receiving the preferred form of online assessment feedback upon middle school mathematics students. In Proc. Computers and Advanced Technology in Education, pages 462--467, Kauai, Hawaii, USA, 2004.
[6]
P. Brusilovsky and C. Higgins. Preface to the special issue on automated assessment of programming assignments. Journal of Educational Resources in Computing, 5(3), 2005.
[7]
J. Cassady, J. Budenz-Anders, G. Pavlechko, and W. Mock. The effects of internet-based formative and summative assessment on test anxiety, perceptions of threat, and achievement. In Annual Meeting of the American Educational Research Association, Seattle, USA, 2001.
[8]
D. J. Charman and A. Elmes. Computer Based Assessment 1: A Guide to Good Practice. SEED Publications, Faculty of Science, University of Plymouth, UK, 1998.
[9]
D. J. Charman and A. Elmes. Computer Based Assessment 2: Case Studies in Science and Computing. SEED Publications, Faculty of Science, University of Plymouth, UK, 1998.
[10]
CodeLab Home Page. http://www.turingscraft.com.
[11]
CourseMarker Home Page. http://www.cs.nott.ac.uk/coursemarker.
[12]
M. Covington and C. Omelich. Task-oriented versus competitive learning structures: Motivations and performance consequences. Journal of Educational Psychology, 76(6):1038--1050, 1984.
[13]
CruiseControl Home Page. http://www.cruisecontrol.sourceforge.net.
[14]
M. Fagan. Advances in software inspections. IEEE Transactions on Software Engineering, 12(7), 1987.
[15]
M. E. Gage and A. K. Pizer. WeBWorK -- math homework on the web. In Proceedings of the Annual International Conference on Technology in Collegiate Mathematics, 1999.
[16]
M. E. Gage, A. Pizer, and V. Roth. NSF 0088212 DUE CCLI proposal, 2000. (Obtained from Pizer, Gage and Roth).
[17]
M. Gage, A. Pizer, and V. Roth. WeBWorK: An internet-based system for generating and delivering homework problems. In Joint Meeting of the American Mathematical Society and the Mathematical Association of America, 2001.
[18]
D. Galin. Software Quality Assurance: From Theory to Implementation. Addison-Wesley, 2003.
[19]
O. Gotel and C. Scharff. Adapting an open-source web-based assessment system for the automated assessment of programming problems. In IASTED Web-based Education Conference, Chamonix, France, March 2007.
[20]
Gradiance Home Page. http://www.gradiance.com.
[21]
JavaBat Home Page. http://javabat.com.
[22]
Joint ACM/IEEE-CS Task Force on Computing Curricula 2001. Final report of the joint ACM/IEEE-CS task force on computing curricula 2001 for computer science, 2001. http://www.computer.org/education/cc2001/final/index.htm.
[23]
Joint ACM Task Force for Computing Curricula 2005. Computing Curricula: 2005 Overview Report. A cooperative project of the Association for Computing Machinery (ACM), The Association for Information Systems (AIS), The Computer Society (IEEE-CS), September 2005.
[24]
Maven Home Page. http://www.maven.apache.com.
[25]
MyCodeMate Home Page. http://www.mycodemate.com.
[26]
OWL Home Page. http://owl.course.com.
[27]
Praktomat Home Page. http://sourceforge.net/projects/praktomat.
[28]
QuizPACK Home Page. http://www2.sis.pitt.edu/taler/quizpack.html.
[29]
C. Scharff and A. Wildenberg. Teaching discrete structures with SML. In Proc. Functional and Declarative Programming in Education, Pittsburgh, USA, 2002.
[30]
Viope Home Page. http://www.viope.com.
[31]
C. Weibel and L. Hirsch. WeBWorK effectiveness in Rutgers calculus, July 2002. http://math.rutgers.edu/~ weibel/ww.html.

Cited By

View all
  • (2023)Experience Report on Using WeBWorK in Teaching Discrete MathematicsProceedings of the 54th ACM Technical Symposium on Computer Science Education V. 110.1145/3545945.3569857(861-867)Online publication date: 2-Mar-2023
  • (2020)Automated Assessment in Programming Courses: A Case Study during the COVID-19 EraSustainability10.3390/su1218745112:18(7451)Online publication date: 10-Sep-2020
  • (2019)Effect of an Instructor-Centered Tool for Automatic Assessment of Programming Assignments on Students’ Perceptions and PerformanceSustainability10.3390/su1120556811:20(5568)Online publication date: 10-Oct-2019
  • Show More Cited By

Index Terms

  1. Extending and contributing to an open source web-based system for the assessment of programming problems

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      PPPJ '07: Proceedings of the 5th international symposium on Principles and practice of programming in Java
      September 2007
      260 pages
      ISBN:9781595936721
      DOI:10.1145/1294325
      • General Chair:
      • Vasco Amaral
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 05 September 2007

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Eclipse
      2. JUnit
      3. Java
      4. WeBWorK
      5. automated grading
      6. open source
      7. peer-review
      8. testing

      Qualifiers

      • Article

      Conference

      PPPJ07
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 29 of 58 submissions, 50%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)2
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 06 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2023)Experience Report on Using WeBWorK in Teaching Discrete MathematicsProceedings of the 54th ACM Technical Symposium on Computer Science Education V. 110.1145/3545945.3569857(861-867)Online publication date: 2-Mar-2023
      • (2020)Automated Assessment in Programming Courses: A Case Study during the COVID-19 EraSustainability10.3390/su1218745112:18(7451)Online publication date: 10-Sep-2020
      • (2019)Effect of an Instructor-Centered Tool for Automatic Assessment of Programming Assignments on Students’ Perceptions and PerformanceSustainability10.3390/su1120556811:20(5568)Online publication date: 10-Oct-2019
      • (2017)CodeWorkoutProceedings of the 2017 ACM Conference on Innovation and Technology in Computer Science Education10.1145/3059009.3059055(188-193)Online publication date: 28-Jun-2017
      • (2017)Flipping introductory programming classes using spinoza and agile pedagogy2017 IEEE Frontiers in Education Conference (FIE)10.1109/FIE.2017.8190519(1-9)Online publication date: Oct-2017
      • (2016)Developing an exercise management system for e-learning2016 Sixth International Conference on Digital Information Processing and Communications (ICDIPC)10.1109/ICDIPC.2016.7470798(93-96)Online publication date: Apr-2016
      • (2015)Educational Data Mining and Learning Analytics in ProgrammingProceedings of the 2015 ITiCSE on Working Group Reports10.1145/2858796.2858798(41-63)Online publication date: 4-Jul-2015
      • (2015)Improving Automated Programming Assessments: User Experience Evaluation Using FaSt-generatorProcedia Computer Science10.1016/j.procs.2015.12.12072(186-193)Online publication date: 2015
      • (2014)Test data generation framework for Automatic Programming Assessment2014 8th. Malaysian Software Engineering Conference (MySEC)10.1109/MySec.2014.6985993(84-89)Online publication date: Sep-2014
      • (2010)Adapting moodle to better support CS educationProceedings of the 2010 ITiCSE working group reports10.1145/1971681.1971684(15-27)Online publication date: 28-Jun-2010
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media