Abstract
In the evaluation of human-computer interfaces, numerous active measures, such as EEGs and eye tracking analysis, have been frequently deployed to help determine the cognitive loads of system operators. However, less is known about the less-intrusive passive impact of, or interference by, speaker variations and speech characteristics in situations of diminishing mental resource availability within the context of interface evaluation. In this paper, we discuss the results of a Sudoku game experiment and the impact of interface variants on the vocal intensity and pitch frequency of players from diverse linguistic backgrounds. We demonstrate a strong relationship between brain activities, speech features and the user interface.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Kahneman, D.: Attention and effort. Prentice-Hall, Englewood Cliffs (1973)
Wickens, C.D.: Multiple Resource Time Sharing Model. In: Stanton, N.A., Salas, E., Hendrick, H.W., Hedge, A., Brookhuis, K. (eds.) Handbook of Human Factors and Ergonomics, pp. 40-1– 40-7. Taylor and Francis, London (2005)
Trimmel, M., Poelzl, G.: Impact of background noise on reaction time and brain DC potential changes of VDT-based spatial attention. Ergonomics 49(2) (2006)
Helton, W., Russell, P.: Working memory load and the vigilance decrement. Experimental Brain Research 212(3), 429–437 (2011)
Abutalebi, J., Green, D.: Bilingual language production: The neurocognition of language representation and control. Journal of Neurolinguistics 20(3), 242–275 (2007)
Abutalebi, J., Green, D.: Control mechanisms in bilingual language production: Neural evidence from language switching studies. Language and Cognitive Processes. 23(4) (2008)
Hernandez, A.E.: Language switching in the bilingual brain: What’s next? Brain and Language 109(2-3), 133–140 (2009)
Blank, S.C., Scott, S.K., Murphy, K., Warburton, E., Wise, R.J.S.: Speech production: Wernicke, Broca and beyond. Brain 125(8), 1829–1838 (2002)
Levelt, W.J.M.: Speaking: From Intention to Articulation. MIT Press (1989)
Costa, A., Hernández, M., Costa-Faidella, J., Sebastián-Gallés, N.: On the bilingual advantage in conflict processing: Now you see it, now you don’t. Cognition 113(2), 135–149 (2009)
Kerns, J.G., Cohen, J.D., Stenger, V.A., Carter, C.S.: Prefrontal Cortex Guides Context-Appropriate Responding during Language Production. Neuron. 43(2), 283–291 (2004)
Khawaja, A., Chen, F., Owen, C., Hickey, G.: Cognitive Load Measurement from User’s Linguistic Speech Features for Adaptive Interaction Design. In: Gross, T., Gulliksen, J., Kotzé, P., Oestreicher, L., Palanque, P., Prates, R.O., Winckler, M. (eds.) INTERACT 2009. LNCS, vol. 5726, pp. 485–489. Springer, Heidelberg (2009)
Power, M.J.: A technique for measuring processing load during speech production. Journal of Psycholinguistic Research 15(5), 371–382 (1986)
Oviatt, S.: Predicting spoken disfluencies during human–computer interaction. Computer Speech and Language 9(1), 19–35 (1995)
Le, P.N., Ambikairajah, E., Epps, J., Sethu, V., Choi, E.C.H.: Investigation of spectral centroid features for cognitive load classification. Speech Communication 53(4), 540–551 (2011)
Müller, C., Großmann-Hutter, B., Jameson, A., Rummer, R., Wittig, F.: Recognizing Time Pressure and Cognitive Load on the Basis of Speech: An Experimental Study. In: Bauer, M., Gmytrasiewicz, P.J., Vassileva, J. (eds.) UM 2001. LNCS (LNAI), vol. 2109, pp. 24–33. Springer, Heidelberg (2001)
Baddeley, A.: The concept of working memory: A view of its current state and probable future development. Cognition 10, 17–23 (1981)
Daneman, M., Green, I.: Individual differences in comprehending and producing words in context. Journal of Memory and Language 25, 1 (1986)
Miller, G.A.: The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review 63(2), 81–97 (1956)
Daneman, M., Green, I.: Individual differences in comprehending and producing words in context. Journal of Memory and Language 25, 1 (1986)
Lorist, M.M., Klein, M., Nieuwenhuis, S., de Jong, R., Mulder, G., Meijman, T.F.: Mental fatigue and task control: Planning and preparation. Psychophysiology 37, 614–625 (2000)
Krajewski, J., Trutschel, U., Golz, M., Sommer, D., Edawrds, D.: Estimating Fatigue from Predetermined Speech Samples Transmitted by Operator Communication Systems. In: Driving Assessment Conference, Montana (2009)
Charlton, S.G.: Driving while conversing: Cell phones that distract and passengers who react. Accident Analysis & Prevention 41(1), 160–173 (2009)
Huttunen, K., Keränen, H., Väyrynen, E., Pääkkönen, R., Leino, T.: Effect of cognitive load on speech prosody in aviation: Evidence from military simulator flights. Applied Ergonomics 42(2), 348–357 (2011)
Luig, J., Sontacchi, A.: Workload monitoring through speech analysis: towards a system for air traffic control. In: ICAS 2010 – 27th International Congress of the Aeronautical Sciences, http://www.icas.org/icas_archive_cd1998-2010/icas2010/papers/669.pdf
Stroop, J.R.: Studies of interference in serial verbal reactions. Journal of Experimental Psychology 12, 242–248 (1935)
Dyer, F.: The Stroop phenomenon and its use in the study of perceptual, cognitive, and response processes. Memory & Cognition 1(2), 106–120 (1973)
Daneman, M.: Working Memory as a Predictor of Verbal Fluency. Journal of Psycholinguistic Research 20(6), 445–463 (1991)
Wickens, C.D.: Multiple Resources and Mental Workload. Human Factors 50(3), 449–455 (2008)
Boersma, P., Weenink, D.: Praat: doing phonetics by computer [Computer program]. Version 5.3.16, http://www.praat.org/ (retrieved May 23, 2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tuček, D.C., Mount, W.M., Abbass, H.A. (2012). Neural and Speech Indicators of Cognitive Load for Sudoku Game Interfaces. In: Huang, T., Zeng, Z., Li, C., Leung, C.S. (eds) Neural Information Processing. ICONIP 2012. Lecture Notes in Computer Science, vol 7663. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34475-6_26
Download citation
DOI: https://doi.org/10.1007/978-3-642-34475-6_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34474-9
Online ISBN: 978-3-642-34475-6
eBook Packages: Computer ScienceComputer Science (R0)