research-article

Think before you talk: an empirical study of relationship between speech pauses and cognitive load

Authors:

M. Asif Khawaja,

Fang ChenAuthors Info & Claims

OZCHI '08: Proceedings of the 20th Australasian Conference on Computer-Human Interaction: Designing for Habitus and Habitat

Pages 335 - 338

https://doi.org/10.1145/1517744.1517814

Published: 08 December 2008 Publication History

Abstract

Measuring a user's level of cognitive load while they are interacting with the system could offer another dimension to the development of adaptable user interfaces. High levels of cognitive load affect performance and efficiency. However, current methods of measuring cognitive load are physically intrusive and interrupt the task flow. Certain speech features have been shown to change under high levels of load and are good candidates for cognitive load indices for usability evaluation and automatic adaptation of an interface or work environment. A speech-based dual-task user study is presented in which we explore the behaviour of speech pause features in natural speech. The experiment yielded new results confirming that speech pauses are useful indicators of high load versus low load speech. We report an increase in the percentage of time spent pausing from low load to high load tasks. We interpret these results within the framework of Baddeley's modal model of working memory and detail how such a measure could be utilized in the cognitive load measurement.

References

[1]

Khawaja, M. A., Ruiz, N., Chen, F., "Potential Speech Features for Cognitive Load Measurement." In Proc. OzCHI 2007, ACM Press, 2007.

Digital Library

[2]

Chandler, P. and Sweller, J. "Cognitive load theory and the format of instruction." Cognition and Instruction, Vol 8, pp. 293--332.

[3]

Paas, F., Tuovinen, J. E., Tabbers, H., and Gerven, P. W. M. V. "Cognitive Load Measurement as a Means to Advance Cognitive Load Theory." Educational Psychologist, 38, 1 (2003), 63--71.

[4]

Mayer, R. E., "Multimedia learning." Cambridge, UK: Cambridge University Press, 2001.

Digital Library

[5]

Berthold, A. and Jameson, A. "Interpreting Symptoms of Cognitive Load in Speech Input." In User Modelling 99, Springer Wien New York, 1999.

Digital Library

[6]

Schilperoord J.; "On the Cognitive Status of Pauses in Discourse Production" In T. Olive & C. M. Levy (Eds.), Contemporary tools and techniques for studying writing, Vol. 10, pp. 61--88. London: Kluwer Academic Publishers, 2001.

[7]

Muller, C., et al., "Recognizing time pressure and cognitive load on the basis of speech: An experimental study", Proc. 8^th International Conf. User Modeling, pp. 24--33, 2001.

Digital Library

[8]

Kramer, A. F., "Physiological metrics of mental workload: a review of recent progress," in Multiple-task performance, Damos, D. L., Ed. London: Taylor and Francis, 1991, pp. 279--328.

[9]

Oviatt S., "Ten myths of multimodal interaction", In Communications of the ACM, Vol. 42, Issue 11, pp. 74--81, 1999.

Digital Library

[10]

Oviatt, S. L., DeAngeli, A., and Kuhn, K. "Integration and synchronization of input modes during multimodal human-computer interaction." In Human Factors in Computing Systems: CHI '97, ACM Press, 1997.

Digital Library

[11]

Yin B., et al., "Automatic Cognitive Load Detection from Speech Features", In Proc. OzCHI 2007, ACM Press, 2007.

Digital Library

[12]

Kahneman, D., "Attention and effort", U.S.A: Prentice Hall, 1973.

[13]

Lennon C. and Burdick H.; "The Lexile Framework as an Approach for Reading Measurement and Success"; A white paper from The Lexile Framework for Reading, April 2004; http://www.Lexile.com; Last accessed: July 2008.

[14]

Dechert, Hans W. & Raupach, M.; "Towards a Cross-Linguistic Assessment of Speech Production." Frankfurt: Lang. 1980.

[15]

Schilperoord, J.; "It's about time: Temporal aspects of cognitive processes in text production."; Amsterdam/Atlanta: Rodopi, 1996.

[16]

Baddeley A., "Working Memory", Science, Vol. 255, pp. 556--559, 1992.

Cited By

Schneegass CWilson MShaban JNiess JChiossi FMitrevska TWoźniak P(2024)Broadening the mind: how emerging neurotechnology is reshaping HCI and interactive system designi-com10.1515/icom-2024-000723:2(165-177)Online publication date: 23-May-2024
https://doi.org/10.1515/icom-2024-0007
Dragicevic DDahl KPerkins ZAbur DStepp C(2024)Effects of a Concurrent Working Memory Task on Speech Acoustics in Parkinson's DiseaseAmerican Journal of Speech-Language Pathology10.1044/2023_AJSLP-23-0021433:1(418-434)Online publication date: 3-Jan-2024
https://doi.org/10.1044/2023_AJSLP-23-00214
Kosch TKarolus JZagermann JReiterer HSchmidt AWoźniak P(2023)A Survey on Measuring Cognitive Workload in Human-Computer InteractionACM Computing Surveys10.1145/358227255:13s(1-39)Online publication date: 13-Jul-2023
https://dl.acm.org/doi/10.1145/3582272
Show More Cited By

Index Terms

Think before you talk: an empirical study of relationship between speech pauses and cognitive load
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Software and its engineering
  1. Software creation and management
    1. Designing software
      1. Software implementation planning
        Software design techniques
    2. Software development process management

Recommendations

Potential speech features for cognitive load measurement
OZCHI '07: Proceedings of the 19th Australasian conference on Computer-Human Interaction: Entertaining User Interfaces

Intelligent user interfaces with an awareness of a user's experienced level of cognitive load have the potential to change the way output strategies are implemented and executed. However, current methods of measuring cognitive load are intrusive and ...
Adjustable deterministic pseudonymization of speech
Abstract
While public speech resources become increasingly available, there is a growing interest to preserve the privacy of the speakers, through methods that anonymize the speaker information from speech while preserving the spoken linguistic ...
Highlights
- Speech production knowledge-driven deterministic speech pseudonymization approach.
The effect of pauses in dysarthric speech recognition study on Thai cerebral palsy children
i-CREATe '07: Proceedings of the 1st international convention on Rehabilitation engineering & assistive technology: in conjunction with 1st Tan Tock Seng Hospital Neurorehabilitation Meeting

Dysarthric speech recognition (DSR) is continuously developed to improve the quality of life of people with speech impairment. This study aimed to investigate the effect of pauses in DSR. Speech corpus consists of 40 words including two subsets, (i) 20 ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

OZCHI '08: Proceedings of the 20th Australasian Conference on Computer-Human Interaction: Designing for Habitus and Habitat

December 2008

366 pages

ISBN:0980306345

DOI:10.1145/1517744

Conference Chair:
Nic Bidwell
James Cook University
,
Program Chairs:
Frank Vetere
University of Melbourne
,
Connor Graham
Lancaster University and University of Melbourne
,
Christine Satchell
Queensland University of Technology

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 December 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

OZCHI '08

OZCHI '08: Proceedings of the 20th conference of the computer-human interaction special interest group of Australia on Computer-human interaction: design

December 8 - 12, 2008

Cairns, Australia

Acceptance Rates

OZCHI '08 Paper Acceptance Rate 28 of 57 submissions, 49%;

Overall Acceptance Rate 362 of 729 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
448
Total Downloads

Downloads (Last 12 months)57
Downloads (Last 6 weeks)6

Reflects downloads up to 26 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Schneegass CWilson MShaban JNiess JChiossi FMitrevska TWoźniak P(2024)Broadening the mind: how emerging neurotechnology is reshaping HCI and interactive system designi-com10.1515/icom-2024-000723:2(165-177)Online publication date: 23-May-2024
https://doi.org/10.1515/icom-2024-0007
Dragicevic DDahl KPerkins ZAbur DStepp C(2024)Effects of a Concurrent Working Memory Task on Speech Acoustics in Parkinson's DiseaseAmerican Journal of Speech-Language Pathology10.1044/2023_AJSLP-23-0021433:1(418-434)Online publication date: 3-Jan-2024
https://doi.org/10.1044/2023_AJSLP-23-00214
Kosch TKarolus JZagermann JReiterer HSchmidt AWoźniak P(2023)A Survey on Measuring Cognitive Workload in Human-Computer InteractionACM Computing Surveys10.1145/358227255:13s(1-39)Online publication date: 13-Jul-2023
https://dl.acm.org/doi/10.1145/3582272
Qi DLiu H(2022)Towards Measuring the Cognitive Loads of Different Dialog Acts through Dependency DistanceProceedings of the 2022 6th International Conference on Natural Language Processing and Information Retrieval10.1145/3582768.3582775(169-175)Online publication date: 16-Dec-2022
https://dl.acm.org/doi/10.1145/3582768.3582775
Ahmad MKeller IRobb DLohan K(2020)A framework to estimate cognitive load using physiological dataPersonal and Ubiquitous Computing10.1007/s00779-020-01455-727:6(2027-2041)Online publication date: 27-Sep-2020
https://doi.org/10.1007/s00779-020-01455-7
Ahmad MRobb DKeller ILohan K(2020)Towards a Multimodal Measure for Physiological Behaviours to Estimate Cognitive LoadEngineering Psychology and Cognitive Ergonomics. Mental Workload, Human Physiology, and Human Energy10.1007/978-3-030-49044-7_1(3-13)Online publication date: 10-Jul-2020
https://doi.org/10.1007/978-3-030-49044-7_1
Sato EOsawa H(2019)Reducing Partner’s Cognitive Load by Estimating the Level of Understanding in the Cooperative Game HanabiAdvances in Computer Games10.1007/978-3-030-65883-0_2(11-23)Online publication date: 11-Aug-2019
https://dl.acm.org/doi/10.1007/978-3-030-65883-0_2
Sipilä JSundqvist STarkiainen A(2017)Winding paths: Ambivalence in consumers' buying processesJournal of Consumer Behaviour10.1002/cb.166216:6Online publication date: 31-May-2017
https://doi.org/10.1002/cb.1662
Chen FZhou JWang YYu KArshad SKhawaji AConway DChen FZhou JWang YYu KArshad SKhawaji AConway D(2016)Trust and Cognitive LoadRobust Multimodal Cognitive Load Measurement10.1007/978-3-319-31700-7_13(195-214)Online publication date: 15-Jun-2016
https://doi.org/10.1007/978-3-319-31700-7_13
Khawaji AChen FZhou JMarcus NLeong T(2014)Trust and cognitive load in the text-chat environmentProceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: the Future of Design10.1145/2686612.2686661(324-327)Online publication date: 2-Dec-2014
https://dl.acm.org/doi/10.1145/2686612.2686661
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents