Nothing Special   »   [go: up one dir, main page]

Skip to main content
Log in

Uncovering student learning profiles with a video annotation tool: reflective learning with and without instructional norms

  • Research Article
  • Published:
Educational Technology Research and Development Aims and scope Submit manuscript

Abstract

This study explores the types of learning profiles that evolve from student use of video annotation software for reflective learning. The data traces from student use of the software were analysed across four undergraduate courses with differing instructional conditions. That is, the use of graded or non-graded self-reflective annotations. Using hierarchical cluster analysis, four profiles of students emerged: minimalists, task-oriented, disenchanted, and intensive users. Students enrolled in one of the courses where grading of the video annotation software was present, were exposed to either another graded course (annotations graded) or non-graded course (annotations not graded) in their following semester of study. Further analysis revealed that in the presence of external factors (i.e., grading), more students fell within the task-oriented and intensive clusters. However, when the external factor is removed, most students exhibited the disenchanted and minimalist learning behaviors. The findings provide insight into how students engage with the different features of a video annotation tool when there are graded or non-graded annotations and, most importantly, that having experience with one course where there are external factors influencing students’ use of the tool is not sufficient to sustain their learning behaviour in subsequent courses where the external factor is removed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Notes

  1. For the purpose of the study presented in this paper, we have adopted Garrison and Vaughan's (2008) definition of blended learning as the “integration of thoughtfully selected and complementary face-to-face and online approaches and technologies” (p. 148).

References

  • Alexander, P. A., Jetton, T. L., & Kulikowich, J. M. (1995). Interrelationship of knowledge, interest, and recall: Assessing a model of domain learning. Journal of Educational Psychology, 87(4), 559.

    Article  Google Scholar 

  • Al-Qahtani, A. A. Y., & Higgins, S. E. (2013). Effects of traditional, blended and e-learning on students’ achievement in higher education: E-Learning, blended and traditional learning. Journal of Computer Assisted Learning, 29(3), 220–234. doi:10.1111/j.1365-2729.2012.00490.x.

    Article  Google Scholar 

  • Aubert, O., Prié, Y., & Canellas, C. (2014). Leveraging video annotations in video-based e-learning. In 7th International Conference on Computer Supported Education, Barcelona, Spain. Retrieved from http://arxiv.org/abs/1404.4607.

  • Azevedo, R., Moos, D. C., Greene, J. A., Winters, F. I., & Cromley, J. G. (2008). Why is externally-facilitated regulated learning more effective than self-regulated learning with hypermedia? Educational Technology Research and Development, 56(1), 45–72. doi:10.1007/s11423-007-9067-0.

    Article  Google Scholar 

  • Barab, S. A., Bowdish, B. E., & Lawless, K. A. (1997). Hypermedia navigation: Profiles of hypermedia users. Educational Technology Research and Development, 45(3), 23–41.

    Article  Google Scholar 

  • Bargeron, D., Gupta, A., Grudin, J., & Sanocki, E. (1999). Annotations for streaming video on the Web: System design and usage studies. Computer Networks, 31(11), 1139–1153.

    Article  Google Scholar 

  • Beretvas, S. N., Meyers, J. L., & Leite, W. L. (2002). A reliability generalization study of the Marlowe-Crowne social desirability scale. Educational and Psychological Measurement, 62(4), 570–589. doi:10.1177/0013164402062004003.

    Article  Google Scholar 

  • Brooks, C., Epp, C., Logan, G., & Greer, J. (2011). The who, what, when, and why of lecture capture. In Proceedings of the First International Conference on Learning Analytics and Knowledge (pp. 86–92). Banff, Alberta, Canada: ACM. doi:10.1145/2090116.2090128.

  • Cerasoli, C. P., Nicklin, J. M., & Ford, M. T. (2014). Intrinsic motivation and extrinsic incentives jointly predict performance: A 40-year meta-analysis. Psychological Bulletin, 140(4), 980.

    Article  Google Scholar 

  • Chen, P.-S. D., Lambert, A. D., & Guidry, K. R. (2010). Engaging online learners: The impact of Web-based learning technology on college student engagement. Computers & Education, 54(4), 1222–1232. doi:10.1016/j.compedu.2009.11.008.

    Article  Google Scholar 

  • Cleave, J. B., Edelson, D., & Beckwith, R. (1993). A matter of style: An analysis of student interaction with a computer-based learning environment. In American Educational Research Association (AERA) Annual Meeting, Atlanta, GA.

  • Colasante, M. (2011). Using video annotation to reflect on and evaluate physical education pre-service teaching practice. Australasian Journal of Educational Technology, 27(1), 66–88.

    Article  Google Scholar 

  • Colasante, M., & Fenn, J. (2009). “mat”: A new media annotation tool with an interactive learning cycle for application in tertiary education. In World Conference on Educational Multimedia, Hypermedia and Telecommunications (Vol. 2009, pp. 3546–3551). Retrieved from http://www.editlib.org/pv/31992.

  • Cross, A., Bayyapunedi, M., Ravindran, D., Cutrell, E., & Thies, W. (2014). VidWiki: Enabling the crowd to improve the legibility of online educational videos (pp. 1167–1175). New York: ACM Press. doi:10.1145/2531602.2531670.

    Google Scholar 

  • Dawson, S., Macfadyen, L., Evan, F. R., Foulsham, T., & Kingstone, A. (2012). Using technology to encourage self-directed learning: The Collaborative Lecture Annotation System (CLAS). In Ascilite conference (Vol. 2012). http://www.ascilite2012.org/images/custom/dawson,_shane_-_using_technology_to_encourage.pdf.

  • del Valle, R., & Duffy, T. M. (2009). Online learning: Learner characteristics and their approaches to managing learning. Instructional Science, 37(2), 129–149. doi:10.1007/s11251-007-9039-0.

    Article  Google Scholar 

  • Dunning, T. (2012). Natural experiments in the social sciences: A design-based approach. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Eisenhardt, K. M. (1989). Building theories from case study research. Academy of Management Review, 14(4), 532–550.

    Google Scholar 

  • Garrison, D. R., & Kanuka, H. (2004). Blended learning: Uncovering its transformative potential in higher education. The Internet and Higher Education, 7(2), 95–105. doi:10.1016/j.iheduc.2004.02.001.

    Article  Google Scholar 

  • Garrison, D. R., & Vaughan, N. (2008). Blended learning in higher education. San Francisco: Jossey-Bass Inc., Publishers.

    Google Scholar 

  • Gašević, D., Mirriahi, N., & Dawson, S. (2014). Analytics of the effects of video use and instruction to support reflective learning. In Proceedings of the fourth international conference on learning analytics and Knowledge (pp 123–132). ACM Press. doi:10.1145/2567574.2567590.

  • Giannakos, M. N., Chorianopoulos, K., & Chrisochoides, N. (2014). Collecting and making sense of video learning analytics. In Frontiers in Education Conference (FIE), 2014 IEEE (pp. 1–7). IEEE. Retrieved from http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=7044485.

  • Giannakos, M. N., Chorianopoulos, K., & Chrisochoides, N. (2015). Making sense of video analytics: Lessons learned from clickstream interactions, attitudes, and learning outcome in a video-assisted course. The International Review of Research in Open and Distributed Learning, 16(1). Retrieved from http://www.irrodl.org/index.php/irrodl/article/view/1976.

  • Gibbs, G., & Simpson, C. (2004). Conditions under which assessment supports students’ learning. Learning and Teaching in Higher Education, 1(1), 3–31.

    Google Scholar 

  • Gonyea, R. M. (2005). Self-reported data in institutional research: Review and recommendations. New Directions for Institutional Research, 2005(127), 73–89.

    Article  Google Scholar 

  • Gosper, M., Malfroy, J., & McKenzie, J. (2013). Students’ experiences and expectations of technologies: An Australian study designed to inform planning and development decisions. Australasian Journal of Educational Technology, 29(2). Retrieved from http://ascilite.org.au/ajet/submission/index.php/AJET/article/view/127.

  • Graham, C. R., Woodfield, W., & Harrison, J. B. (2013). A framework for institutional adoption and implementation of blended learning in higher education. The Internet and Higher Education, 18, 4–14. doi:10.1016/j.iheduc.2012.09.003.

    Article  Google Scholar 

  • Greller, W., & Drachsler, H. (2012). Translating learning into numbers: A generic framework for learning analytics. Educational Technology & Society, 15(3), 42–57.

    Google Scholar 

  • Hadwin, A. F., Nesbit, J. C., Jamieson-Noel, D., Code, J., & Winne, P. H. (2007). Examining trace data to explore self-regulated learning. Metacognition and Learning, 2(2–3), 107–124. doi:10.1007/s11409-007-9016-7.

    Article  Google Scholar 

  • Hattie, J., & Timperley, H. (2007). The Power of Feedback. Review of Educational Research, 77(1), 81–112. doi:10.3102/003465430298487.

    Article  Google Scholar 

  • Hulsman, R. L., Harmsen, A. B., & Fabriek, M. (2009). Reflective teaching of medical communication skills with DiViDU: Assessing the level of student reflection on recorded consultations with simulated patients. Patient Education and Counseling, 74(2), 142–149. doi:10.1016/j.pec.2008.10.009.

    Article  Google Scholar 

  • Koestner, R., Ryan, R. M., Bernieri, F., & Holt, K. (1984). Setting limits on children’s behavior: The differential effects of controlling vs. informational styles on intrinsic motivation and creativity. Journal of Personality, 52(3), 233–248. doi:10.1111/j.1467-6494.1984.tb00879.x.

    Article  Google Scholar 

  • Lust, G., Elen, J., & Clarebout, G. (2013). Regulation of tool-use within a blended course: Student differences and performance effects. Computers & Education, 60(1), 385–395. doi:10.1016/j.compedu.2012.09.001.

    Article  Google Scholar 

  • Lust, G., Vandewaetere, M., Ceulemans, E., Elen, J., & Clarebout, G. (2011). Tool-use in a blended undergraduate course. In search of user profiles. Computers & Education, 57(3), 2135–2144. doi:10.1016/j.compedu.2011.05.010.

    Article  Google Scholar 

  • Magenheim, J., Reinhardt, W., Roth, A., Moi, M., & Engbring, D. (2010). Integration of a video annotation tool into a coactive learning and working environment. In Key Competencies in the Knowledge Society (pp. 257–268). Springer. Retrieved from http://link.springer.com/chapter/10.1007/978-3-642-15378-5_25.

  • McGill, T. J., & Klobas, J. E. (2009). A task–technology fit view of learning management system impact. Computers & Education, 52(2), 496–508. doi:10.1016/j.compedu.2008.10.002.

    Article  Google Scholar 

  • Mu, X. (2010). Towards effective video annotation: An approach to automatically link notes with video content. Computers & Education, 55(4), 1752–1763. doi:10.1016/j.compedu.2010.07.021.

    Article  Google Scholar 

  • Perkins, D. N. (1985). The fingertip effect: How information-processing technology shapes thinking. Educational Researcher, 14(7), 11–17. doi:10.3102/0013189X014007011.

    Article  Google Scholar 

  • Phillips, R., Maor, D., Preston, G., & Cumming-Potvin, W. (2012). Exploring learning analytics as indicators of study behaviour. In Proceedings of EdMedia: World Conference on Educational Media and Technology (pp. 2861–2867). Denver, Colorado, USA: Association for the Advancement of Computing in Education. Retrieved from http://researchrepository.murdoch.edu.au/10460/.

  • Pintrich, P. R., & de Groot, E. V. (1990). Motivational and self-regulated learning components of classroom academic performance. Journal of Educational Psychology, 82(1), 33–40. doi:10.1037/0022-0663.82.1.33.

    Article  Google Scholar 

  • Rich, P. J., & Hannafin, M. (2008). Video annotation tools: Technologies to scaffold, structure, and transform teacher reflection. Journal of Teacher Education, 60(1), 52–67. doi:10.1177/0022487108328486.

    Article  Google Scholar 

  • Risko, E. F., Foulsham, T., Dawson, S., & Kingstone, A. (2013). The Collaborative Lecture Annotation System (CLAS): A new tool for distributed learning. IEEE Transactions on Learning Technologies, 6(1), 4–13. doi:10.1109/TLT.2012.15.

    Article  Google Scholar 

  • Ryan, R. M., Mims, V., & Koestner, R. (1983). Relation of reward contingency and interpersonal context to intrinsic motivation: A review and test using cognitive evaluation theory. Journal of Personality and Social Psychology, 45(4), 736–750. doi:10.1037/0022-3514.45.4.736.

    Article  Google Scholar 

  • Torrisi-Steele, G., & Drew, S. (2013). The literature landscape of blended learning in higher education: the need for better understanding of academic blended practice. International Journal for Academic Development,. doi:10.1080/1360144X.2013.786720.

    Google Scholar 

  • Ward, J. H. (1963). Hierarchical grouping to optimize an objective function. Journal of the American Statistical Association, 58(301), 236–244. doi:10.1080/01621459.1963.10500845.

    Article  Google Scholar 

  • Winne, P. H. (2006). How software technologies can improve research on learning and bolster school reform. Educational Psychologist, 41(1), 5–17. doi:10.1207/s15326985ep4101_3.

    Article  Google Scholar 

  • Winne, P. H. (2013). Learning strategies, study skills, and self-regulated learning in postsecondary education. In M. B. Paulsen (Ed.) Higher education: Handbook of theory and research (Vol. 28, pp. 377–403). Dordrecht: Springer. Retrieved from http://link.springer.com/chapter/10.1007%2F978-94-007-5836-0_8#.

  • Winne, P. H., & Jamieson-Noel, D. (2002). Exploring students’ calibration of self reports about study tactics and achievement. Contemporary Educational Psychology, 27(4), 551–572.

    Article  Google Scholar 

  • Yen, J.-C., & Lee, C.-Y. (2011). Exploring problem solving patterns and their impact on learning achievement in a blended learning environment. Computers & Education, 56(1), 138–145. doi:10.1016/j.compedu.2010.08.012.

    Article  Google Scholar 

  • Yin, R. K. (2009). Case study research: Design and methods (4th ed.). Thousand Oaks, CA: Sage Publications Inc.

    Google Scholar 

  • Yousef, A. M. F., Chatti, M. A., & Schroeder, U. (2014). Video-based learning: A critical analysis of the research published in 2003–2013 and future visions. In eLmL 2014, The Sixth International Conference on Mobile, Hybrid, and On-line Learning (pp. 112–119). Retrieved from http://www.thinkmind.org/index.php?view=article&articleid=elml_2014_5_30_50050.

Download references

Acknowledgments

This research is in part supported by Australian Office of Learning and Teaching (Innovation and Development Grant), Canada Research Chair Program of the Government of Canada, Social Sciences and Humanities Research Council of Canada (Insight Grant), and Natural Sciences and Engineering Research Council of Canada (Discovery Grant). We also thank Thomas Dang for data extraction.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Negin Mirriahi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mirriahi, N., Liaqat, D., Dawson, S. et al. Uncovering student learning profiles with a video annotation tool: reflective learning with and without instructional norms. Education Tech Research Dev 64, 1083–1106 (2016). https://doi.org/10.1007/s11423-016-9449-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11423-016-9449-2

Keywords

Navigation