Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Effects of digital video-based feedback environments on pre-service teachers’ feedback competence

Published: 01 January 2020 Publication History

Abstract

The present study investigates the added value of blended digital video-based feedback environments in fostering pre-service teachers' feedback competence on teaching during a practicum. Pre-service teachers practised providing their peers with feedback on their classroom management in traditional face-to-face feedback sessions (control group, n = 65) or blended digital video-based environments with an expert present (V-Feedback+, n = 22) or without (V-Feedback, n = 16). Before and after the practicum, a video-based tool was applied that required pre-service teachers to provide written feedback to a teacher concerning fictitious classroom events. Written feedbacks were analysed by applying quantitative content analysis. Feedback competence was assessed with six categories: assessment criteria; specificity; suggestions; questions; first person; and positive/negative emphasis. This study demonstrated that digital video-based environments can elicit stronger effects than traditional face-to-face settings, especially when combined with expert feedback. Results from the pre- and post-tests revealed that V-Feedback and V-Feedback + participants provided more specific feedback than the control group. V-Feedback + participants provided feedback containing more high quality suggestions than the V-Feedback group. This study illustrates how pre-service teachers’ feedback competence can be fostered in teaching practicums using digital video-based feedback environments.

Highlights

Effects of face-to-face and digital video-based feedback environments were compared.
Pre-service teachers' feedback specificity increased in the video-based environments.
Expert feedback enhanced effects of digital video-based feedback environments.
Video-based environments with expert feedback led to more high quality suggestions.
Teaching practicums can be enhanced by digital video-based feedback environments.

References

[1]
J.P. Allen, C.A. Hafen, A.C. Gregory, A.Y. Mikami, R. Pianta, Enhancing secondary school instruction and student achievement: Replication and extension of the My Teaching Partner-Secondary intervention, Journal of Research on Educational Effectiveness 8 (4) (2015) 475–489.
[2]
M. Alqassab, J.-W. Strijbos, S. Ufer, Training peer-feedback skills on geometric construction tasks: Role of domain knowledge and peer-feedback levels, European Journal of Psychology of Education 33 (1) (2018) 11–30.
[3]
A. Bandura, D. Cervone, Differential engagement of self-reactive influences in cognitive motivation, Organizational Behavior and Human Decision Processes 38 (1) (1986) 92–113.
[4]
V.L. Barth, F. Thiel, D. Ophardt, Professionelle Wahrnehmung von Unterrichtsstörungen: Konzeption einer videobasierten Fallanalyse mit offenem Antwortformat [Professional vision of classroom disruptions: Development of a video-based case analysis with open questions], in: A. Krüger, F. Radisch, T. Häcker, M. Walm (Eds.), Empirische Bildungsforschung im Kontext von Schule und Lehrerinnenbildung [Empirical education research in the context of school and teacher education], Julius Klinkhardt, Bad Heilbrunn, 2018, pp. 141–153.
[5]
G. Blomberg, A. Renkl, M. Sherin, H. Borko, T. Seidel, Five research-based heuristics for using video in pre-service teacher education, Journal of Educational Research Online 5 (1) (2013) 90–114.
[6]
S. Blömeke, J.-E. Gustafsson, R.J. Shavelson, Beyond dichotomies: Ompetence viewed as a continuum, Zeitschrift für Psychologie 223 (1) (2015) 3–13.
[7]
H. Borko, J. Whitcomb, D. Liston, Wicked problems and other thoughts on issues of technology and teacher learning, Journal of Teacher Education 60 (1) (2009) 3–7.
[8]
D. Carless, K.K.H. Chan, J. To, M. Lo, E. Barrett, Developing students' capacities for evaluative judgement through analysing exemplars, in: D. Boud, R. Ajjawi, P. Dawson, J. Tai (Eds.), Developing evaluative judgement in higher education: Assessment for knowing and producing quality work, Routledge, London, UK, 2018.
[9]
M.T.H. Chi, Quantifying qualitative analyses of verbal data: A practical guide, The Journal of the Learning Sciences 6 (3) (1997) 271–315.
[10]
A. Clarke, V. Triggs, W. Nielsen, Cooperating teacher participation in teacher education: A review of the literature, Review of Educational Research 84 (2) (2014) 163–202.
[11]
S. Derry, M. Sherin, B. Sherin, Multimedia learning with video, in: R. Mayer (Ed.), The Cambridge handbook of multimedia learning, Cambridge University Press, Cambridge, UK, 2014.
[12]
T.E. Dobie, E.R. Anderson, Interaction in teacher communities: Three forms teachers use to express contrasting ideas in video clubs, Teaching and Teacher Education 47 (2015) 230–240.
[13]
K.A. Ericsson, Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains, Academic Medicine 79 (10) (2004) 70–81.
[14]
K.A. Ericsson, R.T. Krampe, C. Tesch-Römer, The role of deliberate practice in the acquisition of expert performance, Psychological Review 100 (3) (1993) 363–406.
[15]
F. Faul, E. Erdfelder, A. Buchner, A.-G. Lang, Statistical power analyses using GPower 3.1: Tests for correlation and regression analyses, Behavior Research Methods 41 (2009) 1149–1160.
[16]
D. Fisher, N. Frey, D. Lapp, Coaching middle-level teachers to think aloud improves comprehension instruction and student reading achievement, The Teacher Educator 46 (3) (2011) 231–243.
[17]
J.L. Fleiss, J. Cohen, The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability, Educational and Psychological Measurement 33 (3) (1973) 613–619.
[18]
R.G. Fukkink, L.W.C. Tavecchio, Effects of video interaction guidance on early childhood teachers, Teaching and Teacher Education 26 (8) (2010) 1652–1659.
[19]
M. Gan, The effects of prompts and explicit coaching on peer feedback quality (Unpublished doctoral dissertation), University of Auckland, New Zealand, 2011.
[20]
M.J.S. Gan, J. Hattie, Prompting secondary students‘ use of criteria, feedback specificity and feedback levels during an investigative task, Instructional Science 42 (6) (2014) 861–878.
[21]
C. Gaudin, S. Chaliès, Video viewing in teacher education and professional development: A literature review, Educational Research Review 16 (2015) 41–67.
[22]
M. Gielen, B. De Wever, Structuring peer assessment: Comparing the impact of the degree of structure on peer feedback content, Computers in Human Behavior 52 (2015) 315–325.
[23]
S. Gielen, E. Peeters, F. Dochy, P. Onghena, K. Struyven, Improving the effectiveness of peer feedback for learning, Learning and Instruction 20 (4) (2010) 304–315.
[24]
B. Gold, M. Holodynski, Using digital video to measure the professional vision of elementary classroom management: Test validation and methodological challenges, Computers & Education 107 (2017) 13–30.
[25]
A. Gregory, E. Ruzek, C.A. Hafen, A.Y. Mikami, J.P. Allen, R.C. Pianta, My teaching partner-secondary: A video-based coaching model, Theory Into Practice 56 (1) (2017) 38–45.
[26]
A. Gröschner, A.-K. Schindler, D. Holzberger, M. Alles, T. Seidel, How systematic video reflection in teacher professional development regarding classroom discourse contributes to teacher and student self-efficacy, International Journal of Educational Research 90 (2018) 223–233.
[27]
P. Grossman, K. Hammerness, M. McDonald, Redefining teaching, re‐imagining teacher education, Teachers and Teaching: Theory and Practice 15 (2) (2009) 273–289.
[28]
P. Grossman, M. McDonald, Back to the future: Directions for research in teaching and teacher education, American Educational Research Journal 45 (1) (2008) 184–205.
[29]
J. Hafner, P. Hafner, Quantitative analysis of the rubric as an assessment tool: An empirical study of student peer‐group rating, International Journal of Science Education 25 (12) (2003) 1509–1528.
[30]
K.M. Hammerness, L. Darling-Hammond, J. Bransford, D.C. Berliner, M. Cochran-Smith, M. McDonald, et al., How teachers learn and develop, in: L. Darling-Hammond, J. Bransford, P. LePage, K. Hammerness, H. Duffy (Eds.), Preparing teachers for a changing world: What teachers should learn and be able to do, Jossey-Bass, San Francisco, CA, 2005, pp. 358–389.
[31]
J. Hattie, H. Timperley, The power of feedback, Review of Educational Research 77 (1) (2007) 81–112.
[32]
T. Heemsoth, T. Kleickmann, Learning to plan self-controlled physical education : Good vs. problematic teaching examples, Teaching and Teacher Education 71 (2018) 168–178.
[33]
C. Hellermann, B. Gold, M. Holodynski, Förderung von Klassenführungsfähigkeiten im Lehramtsstudium. Die Wirkung der Analyse eigener und fremder Unterrichtsvideos auf das strategische Wissen und die professionelle Wahrnehmung [Fostering classroom management skills in teacher education: Effects of analysis of one's own or other teachers‘ classroom videos on strategic knowledge and professional vision], Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie 47 (2) (2015) 97–109.
[34]
E. Hixon, H.-J. So, Technology's role in field experiences for preservice teacher training, Educational Technology & Society 12 (4) (2009) 294–304.
[35]
H. Hollingsworth, D. Clarke, Video as a tool for focusing teacher self-reflection: Supporting and provoking teacher learning, Journal of Mathematics Teacher Education 70 (5) (2017) 457–475.
[36]
S.W. Huck, R.A. McLean, Using a repeated measures ANOVA to analyze the data from a pretest-posttest design: A potentially confusing task, Psychological Bulletin 82 (4) (1975) 511–518.
[37]
P. Huppertz, U. Massler, R. Plötzner, V-share: Video-based analysis and reflection of teaching experiences in virtual groups, in: Proceedings of the international conference on computer support for collaborative learning, Lawrence Erlbaum Associates, Mahwah, NJ, 2005, pp. 245–253.
[38]
B. Joyce, B. Showers, Staff development as a comprehensive service organisation, Journal of Staff Development 17 (1) (1996) 2–6.
[39]
B.R. Joyce, B. Showers, Student achievement through staff development, (3rd ed.), VA: ASCD, Alexandria, 2002.
[40]
H. Kang, E.A. Van Es, Articulating design principles for productive use of video in preservice education, Journal of Teacher Education (2018) 1–14.
[41]
N. Kersting, Using video clips of mathematics classroom instruction as item prompts to measure teachers’ knowledge of teaching mathematics, Educational and Psychological Measurement 68 (5) (2008) 845–861.
[42]
M. Kleinknecht, A. Gröschner, Fostering preservice teachers’ noticing with structured video feedback: Results of an online- and video-based intervention study, Teaching and Teacher Education 59 (2016) 45–56.
[43]
M. Kleinknecht, J. Schneider, What do teachers think and feel when analyzing videos of themselves and other teachers teaching?, Teaching and Teacher Education 33 (2013) 13–23.
[44]
A.N. Kluger, A. DeNisi, The effects of feedback interventions on performance: A historical review, a meta-analysis and a preliminary feedback intervention theory, Psychological Bulletin 119 (2) (1996) 254–284.
[45]
M. Körkkö, S. Morales Rios, O. Kyrö-Ämmäla, Using a video app as a tool for reflective practice, Educational Research 61 (1) (2019) 22–37.
[46]
J.S. Kounin, Discipline and group management in classrooms, Holt, Rinchart & Winston, New York, NY, 1970.
[47]
M.A. Kraft, D. Blazar, D. Hogan, The effect of teacher coaching on instruction and achievement: A meta-analysis of the causal evidence, Review of Educational Research 88 (4) (2018) 547–588.
[48]
K. Krammer, I. Hugener, S. Biaggi, M. Frommelt, A.der M. Fürrer, K. G., & Stürmer, Videos in der Ausbildung von Lehrkräften: Förderung der professionellen Unterrichtswahrnehmung durch die Analyse von eigenen und fremden Videos [Classroom videos in initial teacher education: Fostering professional vision by analysing one's own and other teachers‘ videos], Unterrichtswissenschaft 44 (4) (2016) 357–372.
[49]
G.C. Lee, C.-C. Wu, Enhancing the teaching experience of pre-service teachers through the use of videos in web-based computer-mediated communication (CMC), Innovations in Education & Teaching International 43 (4) (2006) 369–380.
[50]
H.-L. Lu, Research on peer-coaching in preservice teacher education – a review of literature, Teaching and Teacher Education 26 (4) (2010) 748–753.
[51]
L. Major, S. Watson, Using video to support in-service teacher professional development: The state of the field, limitations and possibilities, Technology, Pedagogy and Education 27 (1) (2018) 49–68.
[52]
E. Malewski, J. Phillion, J.D. Lehman, A Freirian framework for technology- based virtual field experiences, Contemporary Issues in Technology and Teacher Education 4 (4) (2005) 410–428.
[53]
L.C. Matsumura, H.E. Garnier, J. Spybrook, Literacy coaching to improve student reading achievement: A multi-level mediation model, Learning and Instruction 25 (2013) 35–48.
[54]
S.E. Maxwell, G.S. Howard, Change scores—necessarily, Anathema? Educational and Psychological Measurement Vol. 41 (1981) 3.
[55]
R. Moreno, A. Valdez, Immediate and delayed effects of using a classroom case exemplar in teacher education: The role of presentation format, Journal of Educational Psychology 99 (1) (2007) 194–206.
[56]
S. Narciss, Designing and evaluating tutoring feedback strategies for digital learning environments on the basis of the interactive feedback model, Digital Education Review 23 (1) (2013) 7–26.
[57]
D.J. Nicol, D. Macfarlane-Dick, Formative assessment and self-regulated learning: A model and seven principles of good feedback practice, Studies in Higher Education 31 (2) (2006) 199–218.
[58]
R.G. O'Brien, M.K. Kaiser, MANOVA method for analyzing repeated measures designs: An extensive primer, Psychological Bulletin 97 (2) (1985) 316–333.
[59]
O. Peters, H. Körndle, S. Narciss, Effects of a formative assessment script on how vocational students generate formative assessment feedback to a peer's or their own performance, European Journal of Psychology of Education 33 (1) (2018) 117–143.
[60]
F. Prins, D. Sluijsmans, P.A. Kirschner, Feedback for general practitioners in training: Quality, styles and preferences, Advances in Health Sciences Education 11 (2006) 289–303.
[61]
Questback, Unipark - EFS survey, version summer 2017, Questback GmbH, Köln, 2017.
[62]
P. Rich, M.J. Hannafin, Capturing and assessing evidence of student teacher inquiry: A case study, Teaching and Teacher Education 24 (6) (2008) 1426–1440.
[63]
T. Rotsaert, E. Panadero, T. Schellens, A. Raes, Now you know what you’re doing right or wrong!’ Peer feedback quality in synchronous peer assessment in secondary education, European Journal of Psychology of Education 33 (2) (2018) 255–275.
[64]
M. Sailors, L. Price, Support for the improvement of practices through intensive coaching (SIPIC): A model of coaching for improving reading instruction and reading achievement, Teaching and Teacher Education 45 (2015) 115–127.
[65]
R. Santagata, G. Angelici, Studying the impact of the lesson analysis framework on preservice teachers' abilities to reflect on videos of classroom teaching, Journal of Teacher Education 61 (4) (2010) 339–349.
[66]
R. Santagata, J. Guarino, Using video to teach future teachers to learn from teaching, ZDM 43 (1) (2011) 133–145.
[67]
E. Schmider, M. Ziegler, E. Danay, L. Beyer, M. Bühner, Is it really robust? Reinvestigating the robustness of ANOVA against violations of the normal distribution assumption, Methodology: European Journal of Research Methods for the Behavioural and Social Sciences 6 (4) (2010) 147–151.
[68]
T. Seidel, K. Stürmer, Modelling and measuring the structure of professional vision in pre-service teachers, American Educational Research Journal 51 (4) (2014) 739–771.
[69]
T. Seidel, K. Stürmer, G. Blomberg, M. Kobarg, K. Schwindt, Teacher learning from analysis of videotaped classroom situations: Does it make a difference whether teachers observe their own teaching or that of others?, Teaching and Teacher Education 27 (2) (2011) 259–267.
[70]
L. Sharpe, C. Hu, L. Crawford, S. Gopinathan, M.S. Khine, S.N. Moo, et al., Enhancing multipoint desktop video conferencing (MDVC) with lesson video clips: Recent developments in pre-service teaching practice in Singapore, Teaching and Teacher Education 19 (5) (2003) 529–541.
[71]
M. Sherin, New perspectives on the role of video in teacher education, in: J. Brophy (Ed.), Advances in research on teaching, Emerald, Bingley, UK, 2007, pp. 1–27.
[72]
D.M.A. Sluijsmans, S. Brand-Gruwel, J.J.G. Van Merriënboer, Peer assessment training in teacher education: Effects on performance and perceptions, Assessment & Evaluation in Higher Education 27 (5) (2002) 443–454.
[73]
D.M.A. Sluijsmans, S. Brand-Gruwel, J.J.G. Van Merriënboer, T.J. Bastiaens, The training of peer assessment skills to promote the development of reflection skills in teacher education, Studies In Educational Evaluation 29 (1) (2003) 23–42.
[74]
D.M.A. Sluijsmans, S. Brand-Gruwel, J.J.G. Van Merriënboer, R.L. Martens, Training teachers in peer-assessment skills: Effects on performance and perceptions, Innovations in Education & Teaching International 41 (1) (2004) 59–78.
[75]
W.W. So, J.W. Pow, V.H. Hung, The interactive use of a video database in teacher education: Creating a knowledge base for teaching through a learning community, Computers & Education 53 (3) (2009) 775–786.
[76]
K.J. Topping, Peer assessment: Learning by judging and discussing the work of other learners, Interdisciplinary Education and Psychology 1 (1) (2017) 1–17.
[77]
T.R. Tripp, P.J. Rich, The influence of video analysis on the process of teacher change, Teaching and Teacher Education 28 (5) (2012) 728–739.
[78]
T.R. Tripp, P.J. Rich, Using video to analyse one’s own teaching, British Journal of Educational Technology 43 (4) (2012) 678–704.
[79]
M. Tschannen-Moran, P. McMaster, Sources of self-efficacy: Four professional development formats and their relationship to self-efficacy and implementation of a new teaching strategy, The Elementary School Journal 110 (2) (2009) 228–245.
[80]
M. Tschannen-Moran, A. Woolfolk Hoy, W.K. Hoy, Teacher efficacy: Its meaning and measure, Review of Educational Research 68 (2) (1998) 202–248.
[81]
S.W. Valencia, S.D. Martin, N.A. Place, P. Grossman, Complex interactions in student teaching: Lost opportunities for learning, Journal of Teacher Education 60 (3) (2009) 304–322.
[82]
E. Van Steendam, G. Rijlaarsdam, L. Sercu, H. Van den Bergh, the effect of instruction type and dyadic or individual emulation on the quality of higher-order peer feedback in EFL, Learning and Instruction 20 (4) (2010) 316–327.
[83]
N. Van den Bogert, J. Van Bruggen, D. Kostons, W. Jochems, First steps into understanding teachers‘ visual perception of classroom events, Teaching and Teacher Education 37 (2014) 208–216.
[84]
F. Vogt, M. Rogalla, Developing adaptive teaching competency through coaching. Teaching, Teacher Education 25 (8) (2009) 1051–1060.
[85]
K.E. Weber, B. Gold, C.N. Prilop, M. Kleinknecht, Promoting pre-service teachers’ professional vision of classroom management during practical school training: Effects of a structured online- and video-based self-reflection and feedback intervention, Teaching and Teacher Education 76 (2018) 39–49.
[86]
C.E. Wolff, Revisiting ‘withitness’: Differences in teachers' representations, perceptions and interpretations of classroom management, Open University of the Netherlands, Heerlen, Netherlands, 2015.
[87]
C.E. Wolff, H. Jarodzka, H. Boshuizen, See and tell: Differences between expert and novice teachers’ interpretations of problematic classroom management events, Teaching and Teacher Education 66 (1) (2017) 295–308.
[88]
C.E. Wolff, N. Van den Bogert, H. Jarodzka, H. Boshuizen, Keeping an eye on learning: Differences between expert and novice teachers' representations of classroom management events, Journal of Teacher Education 66 (1) (2015) 68–85.
[89]
C.-C. Wu, H.-C. Kao, Streaming videos in peer assessment to support training pre- service teachers, Educational Technology & Society 11 (1) (2008) 45–55.
[90]
J.M. Zottmann, K. Stegmann, J.-W. Strijbos, F. Vogel, C. Wecker, F. Fischer, Computer-supported collaborative learning with digital video cases in teacher education: The impact of teaching experience on knowledge convergence, Computers in Human Behavior 29 (5) (2013) 2100–2108.

Cited By

View all

Index Terms

  1. Effects of digital video-based feedback environments on pre-service teachers’ feedback competence
    Index terms have been assigned to the content through auto-classification.

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image Computers in Human Behavior
    Computers in Human Behavior  Volume 102, Issue C
    Jan 2020
    312 pages

    Publisher

    Elsevier Science Publishers B. V.

    Netherlands

    Publication History

    Published: 01 January 2020

    Author Tags

    1. Pre-service teacher education
    2. Digital learning environments
    3. Video
    4. Intervention
    5. Feedback
    6. Practicum

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 01 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    View options

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media