research-article

Investigating the effectiveness of speech-to-text recognition applications on learning performance and cognitive load

Authors:

Yueh-Min Huang,

Rustam Shadiev,

Wu-Yuin HwangAuthors Info & Claims

Computers & Education, Volume 101, Issue C

Pages 15 - 28

https://doi.org/10.1016/j.compedu.2016.05.011

Published: 01 October 2016 Publication History

Abstract

This study explores the effectiveness of applying speech-to-text recognition (STR) technology during lectures in English on learning performance and the cognitive load of non-native English speaking students. Furthermore, the study also explores the usefulness of texts generated using STR for students with different levels of English as foreign language (EFL) ability during lectures of varying difficulty levels. Two lectures, one with intermediate difficulty level content and the other advanced, were administered, and STR was adopted to aid student learning. The results of this study show that the students who used STR-generated texts outperformed the students who did not. Furthermore, lectures in English caused less cognitive load for low ability EFL students when they used STR-texts. According to the students, the STR-texts were useful for following the instructor, confirming content, clarifying vocabulary, and making up missed information. It was found that STR-texts were used by low EFL ability students during both lectures whereas high EFL ability students used STR-texts during the lecture at the advanced level and only some of high EFL ability students used them during the intermediate lecture. Based on these results, several suggestions and implications for teaching and research community are proposed. Students who use STR-texts outperform those who do not.Lectures in English cause lower cognitive load for students when they use STR-texts.STR-texts are useful for students learning.STR-texts are beneficial for low EFL ability students learning.

References

[1]

K. Bain, S. Basson, A. Faisman, D. Kanevsky, Accessibility, transcription, and access everywhere, IBM Systems Journal, 44 (2005) 589-603.

Digital Library

[2]

B.D. Barnes, G. Lock, The attributes of effective lecturers of English as a foreign language as perceived by students in a Korean university, Australian Journal of Teacher Education, 35 (2010) 139-152.

[3]

R. Brunken, J.L. Plass, D. Leutner, Direct measurement of cognitive load in multimedia learning, Educational Psychologist, 38 (2003) 53-61.

[4]

B.C. Camiciottoli, Adjusting a business lecture for an international audience: a case study, English for Specific Purposes, 24 (2005) 183-199.

[5]

I.J. Chen, C.C. Chang, Cognitive load theory: an Empirical study of anxiety and task performance in language learning, Electronic Journal of Research in Educational Psychology, 7 (2009) 729-746.

[6]

R.C. Clark, R.E. Mayer, E-Learning and the science of instruction: Proven guidelines for consumers and designers of multimedia learning, John Wiley & Sons, San Francisco, CA, 2011.

Digital Library

[7]

J.W. Creswell, Educational research: Planning, conducting, and evaluating quantitative, Pearson Education, Boston, MA, 2014.

[8]

J.R. Fraenkel, N.E. Wallen, H.H. Hyun, How to design and evaluate research in education, McGraw-Hill, New York, 2014.

[9]

Y.M. Huang, Y.M. Huang, C.H. Liu, C.C. Tsai, Applying social tagging to manage cognitive load in a Web 2.0 self-learning environment, Interactive Learning Environments, 21 (2013) 273-289.

[10]

Y.M. Huang, C.L. Liu, R. Shadiev, M.H. Shen, W.Y. Hwang, Investigating an application of speech-to-text recognition: a study on visual attention and learning behavior, Journal of Computer Assisted Learning, 31 (2015) 529-545.

[11]

W.Y. Hwang, R. Shadiev, T.C.T. Kuo, N.S. Chen, Effects of Speech-to-Text Recognition application on learning performance in synchronous cyber classrooms, Journal of Educational Technology & Society, 15 (2012) 367-380.

[12]

S. Kalyuga, The expertise reversal principle in multimedia learning, in: The Cambridge handbook of multimedia learning, Cambridge University Press, New York, 2014, pp. 576-597.

[13]

B. Keysar, S.L. Hayakawa, S.G. An, The Foreign-language effect thinking in a foreign tongue reduces decision biases, Psychological Science, 23 (2012) 661-668.

[14]

B.S. Kramer, A.E. Walker, J.M. Brill, The underutilization of information and communication technology-assisted collaborative project-based learning among international educators: a Delphi study, Educational Technology Research and Development, 55 (2007) 527-543.

[15]

T.C.T. Kuo, R. Shadiev, W.Y. Hwang, N.S. Chen, Effects of applying STR for group learning activities on learning performance in a synchronous cyber classroom, Computers & Education, 58 (2012) 600-608.

[16]

D. Leitch, Gift atlantic liberated learning high school pilot project: A study of the transfer of speech recognition technology from university classrooms to high school classrooms, Saint Marys University Press, Nova Scotia, Canada, 2008.

[17]

R.E. Mayer, Multimedia learning, Cambridge University Press, New York, 2009.

[18]

R.E. Mayer, R. Moreno, Nine ways to reduce cognitive load in multimedia learning, Educational Psychologist, 38 (2003) 43-52.

[19]

L. Miller, Issues in lecturing in a second language: lecturers behaviour and students perceptions, Studies in Higher Education, 32 (2007) 747-760.

[20]

F. Paas, A. Renkl, J. Sweller, Cognitive load theory and instructional design: recent developments, Educational Psychologist, 38 (2003) 1-4.

[21]

J.L. Plass, D.M. Chun, R.E. Mayer, D. Leutner, Cognitive load in reading a foreign language text with multimedia aids and the influence of verbal and spatial abilities, Computers in Human Behavior, 19 (2003) 221-243.

[22]

R. Poulsen, P. Hastings, D. Allbritton, Tutoring bilingual students with an automated Reading Tutor that listens, Journal of Educational Computing Research, 36 (2007) 191-221.

[23]

R. Ranchal, T. Taber-Doughty, Y. Guo, K. Bain, H. Martin, J. Robinson, Using speech recognition for real-time captioning and lecture transcription in the classroom, IEEE Transactions on Learning Technologies, 6 (2013) 299-311.

Digital Library

[24]

K. Ryba, T. McIvor, M. Shakir, D. Paez, Liberated learning: analysis of university students perceptions and experiences with continuous automated speech recognition, Journal of Instructional Science and Technology, 9 (2006) 1-19.

[25]

R. Shadiev, W.Y. Hwang, N.S. Chen, Y.M. Huang, Review of speech-to-text recognition technology for enhancing learning, Journal of Educational Technology and Society, 17 (2014) 65-84.

[26]

R. Shadiev, W.Y. Hwang, Y.M. Huang, Investigating learning strategies of using texts generated by Speech to Text Recognition technology in traditional classroom, in: Proceedings of the AECT International Conference on the Frontier in e-Learning Research, National Central University & AECT, Taiwan, 2013, pp. 279-286.

[27]

R. Shadiev, W.Y. Hwang, Y.M. Huang, C.J. Liu, Investigating applications of speech to text recognition for face to face seminar to assist learning of non-native English participants, Technology, Pedagogy and Education, 25 (2016) 119-134.

[28]

J. Sweller, J.J. Van Merrienboer, F.G. Paas, Cognitive architecture and instructional design, Educational Psychology Review, 10 (1998) 251-296.

[29]

M. Wald, K. Bain, Universal access to communication and learning: the role of automatic speech recognition, International Journal Universal Access in the Information Society, 6 (2008) 435-447.

Digital Library

Cited By

Haavisto MJaakkola TLepola J(2023)Video outperforms illustrated textComputers & Education10.1016/j.compedu.2023.104775199:COnline publication date: 1-Jul-2023
https://dl.acm.org/doi/10.1016/j.compedu.2023.104775
Chen K(2022)Speech-to-text recognition in University English as a Foreign Language LearningEducation and Information Technologies10.1007/s10639-022-11016-527:7(9857-9875)Online publication date: 1-Aug-2022
https://dl.acm.org/doi/10.1007/s10639-022-11016-5
Hwang WNguyen VChin CPurba SGhinea G(2022)Investigation of Multiple Recognitions Used for EFL Writing in Authentic ContextsInnovative Technologies and Learning10.1007/978-3-031-15273-3_48(433-443)Online publication date: 29-Aug-2022
https://dl.acm.org/doi/10.1007/978-3-031-15273-3_48
Show More Cited By

Recommendations

Understanding the effects of professors' pedagogical development with Clicker Assessment and Feedback technologies and the impact on students' engagement and learning in higher education

Clicker Assessment and Feedback (CAF) is an instructional assessment and feedback strategy that is incorporated with interactive technologies, often referred to as clickers. Several thousand colleges and universities across Europe and North America have ...
Technology tools to support learning design

The need to improve the quality of higher education has fostered an interest in technology tools to support effective design for teaching and learning. Over the past decade this interest has led to the development of tools to support the creation of ...
Exploring problem solving patterns and their impact on learning achievement in a blended learning environment

Blended learning, thoughtfully combining the best elements of online and face-to-face education, is likely to emerge as the predominant teaching model of the future. In this paper, we present a blended learning environment combining mobile learning, web-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Computers & Education

Computers & Education Volume 101, Issue C

October 2016

26 pages

ISSN:0360-1315

Issue’s Table of Contents

Copyright © Elsevier Ltd.

Publisher

Elsevier Science Ltd.

United Kingdom

Publication History

Published: 01 October 2016

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Haavisto MJaakkola TLepola J(2023)Video outperforms illustrated textComputers & Education10.1016/j.compedu.2023.104775199:COnline publication date: 1-Jul-2023
https://dl.acm.org/doi/10.1016/j.compedu.2023.104775
Chen K(2022)Speech-to-text recognition in University English as a Foreign Language LearningEducation and Information Technologies10.1007/s10639-022-11016-527:7(9857-9875)Online publication date: 1-Aug-2022
https://dl.acm.org/doi/10.1007/s10639-022-11016-5
Hwang WNguyen VChin CPurba SGhinea G(2022)Investigation of Multiple Recognitions Used for EFL Writing in Authentic ContextsInnovative Technologies and Learning10.1007/978-3-031-15273-3_48(433-443)Online publication date: 29-Aug-2022
https://dl.acm.org/doi/10.1007/978-3-031-15273-3_48
Heo MToomey N(2020)Learning with multimediaComputers & Education10.1016/j.compedu.2019.103747146:COnline publication date: 1-Mar-2020
https://dl.acm.org/doi/10.1016/j.compedu.2019.103747
Hwang WLi YShadiev R(2018)Exploring effects of discussion on visual attention, learning performance, and perceptions of students learning with STR-supportComputers & Education10.1016/j.compedu.2017.09.015116:C(225-236)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1016/j.compedu.2017.09.015

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents