Transitional feedback schedules during computer-based problem-solving practice
Pages 270 - 280
Abstract
Feedback has a strong influence on effective learning from computer-based instruction. Prior research on feedback in computer-based instruction has mainly focused on static feedback schedules that employ the same feedback schedule throughout an instructional session. This study examined transitional feedback schedules in computer-based multimedia instruction on procedural problem-solving in electrical circuit analysis. Specifically, we compared two transitional feedback schedules: the TFS-P schedule switched from initial feedback after each problem step to feedback after a complete problem at later learning states; the TFP-S schedule transitioned from feedback after a complete problem to feedback after each problem step. As control conditions, we also considered two static feedback schedules, namely providing feedback after each practice problem-solving step (SFS) or providing feedback after attempting a complete multi-step practice problem (SFP). Results indicate that the static stepwise (SFS) and transitional stepwise to problem (TFS-P) feedback produce higher problem solving near-transfer post-test performance than static problem (SFP) and transitional problem to step (TFP-S) feedback. Also, TFS-P resulted in higher ratings of program liking and feedback helpfulness than TFP-S. Overall, the study results indicate benefits of maintaining high feedback frequency (SFS) and reducing feedback frequency (TFS-P) compared to low feedback frequency (SFP) or increasing feedback frequency (TFP-S) as novice learners acquire engineering problem solving skills. An experiment investigated feedback schedules in problem solving instruction.Static stepwise feedback outperformed problem (summative) feedback on posttest.Stepwise-problem feedback schedule outperformed problem-stepwise feedback.Initial stepwise feedback is critical for problem-solving learning by novices.
References
[1]
J.R. Anderson, Rules of the mind, Lawrence Erlbaum, Hillsdale, NJ, 1993.
[2]
J.R. Anderson, J.M. Fincham, S. Douglass, The role of examples and rules in the acquisition of a cognitive skill, Journal of Experimental Psychology: Learning, Memory, and Cognition, 23 (1997) 932-945.
[3]
R.K. Atkinson, S.J. Derry, A. Renkl, D. Wortham, Learning from examples: instructional principles from the worked examples research, Review of Educational Research, 70 (2000) 181-214.
[4]
R.K. Atkinson, A. Renkl, M.M. Merrill, Transitioning from studying examples to solving problems: effects of self-explanation prompts and fading worked-out steps, Journal of Educational Psychology, 95 (2003) 774-783.
[5]
R. Azevedo, R.M. Bernard, A meta-analysis of the effects of feedback in computer-based instruction, Journal of Educational Computing Research, 13 (1995) 111-127.
[6]
A. Baddeley, Working memory, Science, 255 (1992) 556-559.
[7]
R.L. Bangert-Drowns, C.C. Kulik, J.A. Kulik, M.T. Morgan, The instructional effect of feedback in test-like events, Review of Educational Research, 61 (1991) 213-238.
[8]
K. Biesinger, K. Crippen, The effects of feedback protocol on self-regulated learning in a web-based worked example learning environment, Computers & Education, 55 (2010) 1470-1482.
[9]
D.R. Billings, Efficacy of adaptive feedback strategies in simulation-based training, Military Psychology, 24 (2012) 114-133.
[10]
B.D. Butki, S.J. Hoffman, Effects of reducing frequency of intrinsic knowledge of results on the learning of a motor skill, Perceptual & Motor Skills, 97 (2003) 569-580.
[11]
R. Butler, Task-involving and ego-involving properties of evaluation: effects of different feedback conditions on motivational perceptions, interest, and performance, Journal of Educational Psychology, 79 (1987) 474-482.
[12]
A.C. Butler, H.L. Roediger, Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing, Memory & Cognition, 36 (2008) 604-616.
[13]
G. Cierniak, K. Scheiter, P. Gerjets, Explaining the split-attention effect: is the reduction of extraneous cognitive load accompanied by an increase in germane cognitive load?, Computers in Human Behavior, 25 (2009) 315-324.
[14]
K. Clark, F. Dwyer, Effect of different types of computer-assisted feedback strategies on achievement and response confidence, International Journal of Instructional Media, 25 (1998) 55-63.
[15]
G. Corbalan, F. Paas, H. Cuypers, Computer-based feedback in linear algebra: effects on transfer performance and motivation, Computers & Education, 55 (2010) 692-703.
[16]
T. De Jong, Cognitive load theory, educational research, and instructional design: some food for thought, Instructional Science, 38 (2010) 105-134.
[17]
R.E. Dihoff, G.M. Brosvic, M.L. Epstein, M.J. Cook, Provision of feedback during preparation for academic testing: learning is enhanced by immediate but not delayed feedback, Psychological Record, 54 (2004) 207-232.
[18]
P.C. Earley, G.B. Northcraft, C. Le, T.R. Lituchy, Impact of process and outcome feedback on the relation of goal setting to task performance, Academy of Management Journal, 33 (1990) 87-105.
[19]
E.R. Fyfe, B. Rittle-Johnson, M.S. DeCaro, The effects of feedback during exploratory mathematics problem solving: prior knowledge matters, Journal of Educational Psychology, 104 (2012) 1094.
[20]
P. Ginns, Integrating information: a meta-analysis of the spatial contiguity and temporal contiguity effects, Learning and Instruction, 16 (2006) 511-525.
[21]
J.S. Goodman, R.E. Wood, Faded versus increasing feedback, task variability trajectories, and transfer of training, Human Performance, 22 (2009) 64-85.
[22]
J.S. Goodman, R.E. Wood, Z. Chen, Feedback specificity, information processing, and transfer of training, Organizational Behavior and Human Decision Processes, 115 (2011) 253-267.
[23]
J.A. Hattie, Influences on student learning, University of Auckland, New Zealand, 1999. http://www-rp0a.teacherstoolbox.co.uk/downloads/managers/Influencesonstudent.pdf
[24]
J. Hattie, H. Timperley, The power of feedback, Review of Educational Research, 77 (2007) 81-112.
[25]
L. Ho, J.B. Shea, Effects of relative frequency of knowledge of results on retention of a motor skill, Perceptual and Motor Skills, 46 (1978) 859-866.
[26]
I.G. Hsieh, H.F. O'Neil, Types of feedback in a computer-based collaborative problem-solving group task, Computers in Human Behavior, 18 (2002) 699-715.
[27]
D. Irwin, M.R. Nelms, Basic engineering circuit analysis, John Wiley & Sons Inc, Hoboken, NJ, 2008.
[28]
D.S. Johnson, R. Perlow, K.F. Pieper, Differences in task performance as a function of type of feedback: learning-oriented versus performance oriented feedback, Journal of Applied Social Psychology, 23 (1993) 303-320.
[29]
A.M. Johnson, J. Reisslein, M. Reisslein, Representation sequencing in computer-based engineering education, Computers & Education, 72 (2014) 249-261.
[30]
S. Kalyuga, Expertise reversal effect and its implications for learner-tailored instruction, Educational Psychology Review, 19 (2007) 509-539.
[31]
C.M. Kelley, A.C. McLaughlin, Individual differences in the benefits of feedback for learning, Human Factors, 54 (2012) 26-35.
[32]
L. Kester, P.A. Kirschner, Effects of fading support on hypertext navigation and performance in student-centered e-learning environments, Interactive Learning Environments, 17 (2009) 165-179.
[33]
L. Kester, P.A. Kirschner, J.J. van Merriënboer, Just-in-time information presentation: improving learning a troubleshooting skill, Contemporary Educational Psychology, 31 (2006) 167-185.
[34]
A.N. Kluger, A. DeNisi, The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory, Psychological Bulletin, 119 (1996) 254-284.
[35]
R.W. Kulhavy, W.A. Stock, Feedback in written instruction: the place of response certitude, Educational Psychology Review, 1 (1989) 279-308.
[36]
J.A. Kulik, C.L.C. Kulik, Timing of feedback and verbal learning, Review of Educational Research, 58 (1988) 79-97.
[37]
J.E. Laird, P.S. Rosenbloom, A. Newell, Chunking in soar: the anatomy of a general learning mechanism, Machine Learning, 1 (1986) 11-46.
[38]
C.F. Lam, D.S. DeRue, E.P. Karam, J.R. Hollenbeck, The impact of feedback frequency on learning and task performance: challenging the "more is better" assumption, Organizational Behavior and Human Decision Processes, 116 (2011) 217-228.
[39]
C.R. Landsberg, R.S. Astwood, W.L. Van Buskirk, L.N. Townsend, N.B. Steinhauser, A.D. Mercado, Review of adaptive training system techniques, Military Psychology, 24 (2012) 96-113.
[40]
J. Leppink, F. Paas, T. van Gog, C.P. van der Vleuten, J.J. van Merriënboer, Effects of pairs of problems and examples on task performance and different types of cognitive load, Learning and Instruction, 30 (2014) 32-42.
[41]
M.W. Lewis, J.R. Anderson, Discrimination of operator schemata in problem solving: learning from examples, Cognitive Psychology, 17 (1985) 26-65.
[42]
L. Lin, R.K. Atkinson, R.M. Christopherson, S.S. Joseph, C.J. Harrison, Animated agents and learning: does the type of verbal feedback they provide matter?, Computers & Education, 67 (2013) 239-249.
[43]
J.-W. Lin, Y.-C. Lai, Y.-S. Chuang, Timely diagnostic feedback for database concept learning, Educational Technology & Society, 16 (2013) 228-242.
[44]
N.H. Lurie, J.M. Swaminathan, Is timely information always better? The effect of feedback frequency on decision making, Organizational Behavior and Human Decision Processes, 108 (2009) 315-329.
[45]
W.T. Maddox, F.G. Ashby, C.J. Bohil, Delayed feedback effects on rule-based and information-integration category learning, Journal of Experimental Psychology: Learning, Memory, and Cognition, 29 (2003) 650.
[46]
W.T. Maddox, A.D. Ing, Delayed feedback disrupts the procedural-learning system but not the hypothesis-testing system in perceptual category learning, Journal of Experimental Psychology: Learning, Memory, and Cognition, 31 (2005) 100-107.
[47]
J.B. Mason, R. Bruning, Providing feedback in computer-based instruction: What the research tells us, 2001. http://dwb.unl.edu/Edit/MB/MasonBruning.html
[48]
L. Mason, P. Pluchino, M.C. Tornatora, N. Ariasi, An eye-tracking study of learning from science text with concrete and abstract illustrations, The Journal of Experimental Education, 81 (2013) 356-384.
[49]
S. Mathan, K.R. Koedinger, Recasting the feedback debate: benefits of tutoring error detection and correction skills, in: Artificial intelligence in education, IOS Press, Amsterdam, The Netherlands, 2003.
[50]
R.E. Mayer, R. Moreno, Nine ways to reduce cognitive load in multimedia learning, Educational Psychologist, 38 (2003) 43-52.
[51]
L.C. McDermott, P.S. Shaffer, Research as a guide for curriculum development: an example from introductory electricity. Part I: investigation of student understanding, American Journal of Physics, 60 (1992) 994-1003.
[52]
R. Moreno, Decreasing cognitive load for novice students: effects of explanatory versus corrective feedback in discovery-based multimedia, Instructional Science, 32 (2004) 99-113.
[53]
R. Moreno, R. Mayer, Interactive multimodal learning environments, Educational Psychology Review, 19 (2007) 309-326.
[54]
R. Moreno, M. Reisslein, G. Ozogul, Optimizing worked-example instruction in electrical engineering: the role of fading and feedback during problem-solving practice, Journal of Engineering Education, 98 (2009) 83-92.
[55]
E.H. Mory, Feedback research revisited, 2004.
[56]
A. Munro, M.R. Fehling, D.M. Towne, Instruction intrusiveness in dynamic simulation training, Journal of Computer-Based Instruction, 12 (1985) 50-53.
[57]
S. Narciss, S. Sosnovsky, L. Schnaubert, E. Andrès, A. Eichelmann, G. Goguadze, Exploring feedback and student characteristics relevant for personalizing feedback strategies, Computers & Education, 71 (2013) 56-76.
[58]
G. Ozogul, A.M. Johnson, R. Moreno, M. Reisslein, Technological literacy learning with cumulative and stepwise integration of equations into electrical circuit diagrams, IEEE Transactions on Education, 55 (2012) 480-487.
[59]
F.G.W.C. Paas, J.J.G. van Merrienboer, Variability of worked examples and transfer of geometrical problem-solving skills: a cognitive load approach, Journal of Educational Psychology, 86 (1994) 122-133.
[60]
J. Reisslein, A.M. Johnson, M. Reisslein, Color coding of circuit quantities in introductory circuit analysis instruction, IEEE Transactions on Education (2014).
[61]
M. Reisslein, R. Moreno, G. Ozogul, Pre-college electrical engineering instruction: the impact of abstract vs. contextualized representation and practice on learning, Journal of Engineering Education, 99 (2010) 225-235.
[62]
J. Reisslein, P. Seeling, M. Reisslein, Comparing static fading with adaptive fading to independent problem solving: the impact on the achievement and attitudes of high school students learning electrical circuit analysis, Journal of Engineering Education, 95 (2006) 217-226.
[63]
A. Renkl, R.K. Atkinson, Structuring the transition from example study to problem solving in cognitive skill acquisition: a cognitive load perspective, Educational Psychologist, 38 (2003) 15-22.
[64]
A. Renkl, R.K. Atkinson, U.H. Maier, R. Staley, From example study to problem solving: smooth transitions help learning, Journal of Experimental Education, 70 (2002) 293-315.
[65]
W. Schnotz, C. Kürschner, A reconsideration of cognitive load theory, Educational Psychology Review, 19 (2007) 469-508.
[66]
L.J. Schooler, J.R. Anderson, The disruptive potential of immediate feedback, 2008. http://repository.cmu.edu/psychology/27
[67]
W. Schoppek, M. Tulis, Enhancing arithmetic and word-problem solving skills efficiently by individualized computer-assisted practice, Journal of Educational Research, 103 (2010) 239-252.
[68]
V.J. Shute, Focus on formative feedback, Review of Educational Research, 78 (2008) 153-189.
[69]
B.J. Skromme, Q. Wang, P. Reyes, J.M. Quick, R.K. Atkinson, T. Frank, Teaching linear circuit analysis techniques with computers, in: Proc. ASEE, 2013.
[70]
T.A. Smith, D.R. Kimball, Learning from feedback: spacing and the delay-retention effect, Journal of Experimental Psychology: Learning, Memory, and Cognition, 36 (2010) 80-95.
[71]
J. Sweller, Instructional design in technical areas, ACER Press, Melbourne, Austr., 1999.
[72]
J. Sweller, J. van Merriënboer, F. Paas, Cognitive architecture and instructional design, Educational Psychology Review, 10 (1998) 251-296.
[73]
S.P. Swinnen, R.A. Schmidt, D.E. Nicholson, D.C. Shapiro, Information feedback for skill acquisition: instantaneous knowledge of results degrades learning, Journal of Experimental Psychology: Learning, Memory, and Cognition, 16 (1990) 706-716.
[74]
L.R. Van Duyne, K. Jentsch, C. Bowers, W. Burroughs, J. Cannon-Bowers, E. Salas, Comparing the utility and sequencing of different types of feedback, in: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 45, No. 26, SAGE Publications, 2001, October, pp. 1843-1847.
[75]
T. Van Gog, L. Kester, F. Paas, Effects of worked examples, example-problem, and problem-example pairs on novices' learning, Contemporary Educational Psychology, 36 (2011) 212-218.
[76]
T. Van Gog, F. Paas, Instructional efficiency: revisiting the original construct in educational research, Educational Psychologist, 43 (2008) 16-26.
[77]
F.M. Van der Kleij, T.J. Eggen, C.F. Timmers, B.P. Veldkamp, Effects of feedback in a computer-based assessment for learning, Computers & Education, 58 (2012) 263-272.
[78]
C.J. Winstein, R.A. Schmidt, Reduced frequency of knowledge of results enhances motor skill learning, Journal of Experimental Psychology: Learning, Memory, and Cognition, 16 (1990) 677-691.
[79]
G. Wulf, R.A. Schmidt, The learning of generalized motor programs: reducing the relative frequency of knowledge of results enhances memory, Journal of Experimental Psychology: Learning, Memory, and Cognition, 15 (1989) 748-757.
[80]
G. Wulf, C.H. Shea, Principles derived from the study of simple skills do not generalize to complex skill learning, Psychonomic Bulletin & Review, 9 (2002) 185-211.
[81]
D. Yang, R.A. Streveler, R.L. Miller, J.D. Slotta, H.M. Matusovich, A.J. Magana, Using computer-based online learning modules to promote conceptual change: helping students understand difficult concepts in thermal and transport science, International Journal of Engineering Education, 28 (2012) 686-700.
Index Terms
- Transitional feedback schedules during computer-based problem-solving practice
Index terms have been assigned to the content through auto-classification.
Recommendations
Providing feedback on computer-based algebra homework in middle-school classrooms
Homework is transforming at a rapid rate with continuous advances in educational technology. Computer-based homework, in particular, is gaining popularity across a range of schools, with little empirical evidence on how to optimize student learning. The ...
Effects of feedback elaboration and feedback timing during computer-based practice in mathematics problem solving
This study investigated the effects of feedback on performance with pairs of isomorphic items that were embedded within consecutive mathematics web-based practice tests. Participants were randomly assigned to different experimental testing conditions: (...
Automatic assessment and immediate feedback in first grade mathematics
Koli Calling '14: Proceedings of the 14th Koli Calling International Conference on Computing Education ResearchIn this paper we present a study where automatic assessment and immediate feedback was utilized to support the learning of mathematical concepts and automatization of basic arithmetic calculations. Two first grade classes from a Finnish elementary ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Copyright © Elsevier Ltd.
Publisher
Elsevier Science Ltd.
United Kingdom
Publication History
Published: 01 February 2015
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 01 Oct 2024
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in