Article

Free access

Why conversational agents should catch the eye

Authors:

Roel Vertegaal,

Robert Slagter,

Gerrit van der Veer,

Anton NijholtAuthors Info & Claims

CHI EA '00: CHI '00 Extended Abstracts on Human Factors in Computing Systems

Pages 257 - 258

https://doi.org/10.1145/633292.633442

Published: 01 April 2000 Publication History

PDF eReader

Abstract

We studied whether the gaze direction of users indicates whom they are speaking or listening to in multiparty conversations. Results show when someone is listening or speaking to individuals, there is indeed a high probability that the person looked at is the person listened (p=88%) or spoken to (p=77%). We implemented these findings in a multi-agent conversational system that uses eye input to gauge which agent the user is listening or speaking to.

References

[1]

Argyle, M. and Cook, M. Gaze and Mutual Gaze. London: Cambridge University Press, 1976.

Google Scholar

[2]

Cassell, J., Bickmore, T., et al. Embodiment in Conversational Interfaces: Rea. In Proceedings of CHI'99. Pittsburgh: ACM, 1999.

Digital Library

Google Scholar

[3]

Kendon, A. Some Function of Gaze Direction in Social Interaction. Acta Psychologica 32, 1967, pp. 1-25.

Google Scholar

[4]

LC Technologies. http://www.eyegaze.com, 1997.

Google Scholar

[5]

Nijholt, A., v.d. Hoeven, G., et al. SCHISMA: A Natural Language Accessible Theatre Information and Booking System. In Proceedings of First Workshop on Applications of Natural Language to Databases. Versailles, France, 1995, pp. 271-285.

Google Scholar

[6]

Vertegaal, R. The GAZE Groupware System: Mediating Joint Attention in Multiparty Communication and Collaboration. In Proceedings of CHI'99. Pittsburgh: ACM, 1999.

Digital Library

Google Scholar

[7]

Vertegaal, R. Look Who's Talking to Whom. PhD Thesis. Enschede, Netherlands: Cognitive Ergonomics Dept., Twente University, 1998.

Google Scholar

[8]

Waters, K. and Frisbee, J. A coordinated muscle model for speech animation. In Proceedings of Graphics Interface'95. Canada, 1995.

Google Scholar

[9]

Weisbrod, R. M. Looking behavior in a discussion group. Unpublished paper, Dept. of Psychology, Cornell University, 1965.

Google Scholar

Cited By

View all

Veivo OMutta M(2022)Dialogue breakdowns in robot-assisted L2 learningComputer Assisted Language Learning10.1080/09588221.2022.2158203(1-22)Online publication date: 19-Dec-2022
https://doi.org/10.1080/09588221.2022.2158203
Ham JBokhorst RCuijpers Rvan der Pol DCabibihan J(2011)Making robots persuasiveProceedings of the Third international conference on Social Robotics10.1007/978-3-642-25504-5_8(71-83)Online publication date: 24-Nov-2011
https://dl.acm.org/doi/10.1007/978-3-642-25504-5_8
Rienks RPoppe RHeylen D(2010)Differences in head orientation behavior for speakers and listenersACM Transactions on Applied Perception10.1145/1658349.16583517:1(1-13)Online publication date: 18-Jan-2010
https://dl.acm.org/doi/10.1145/1658349.1658351
Show More Cited By

Recommendations

Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes
CHI '01: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

In multi-agent, multi-user environments, users as well as agents should have a means of establishing who is talking to whom. In this paper, we present an experiment aimed at evaluating whether gaze directional cues of users could be used for this ...
Explaining effects of eye gaze on mediated group conversations:: amount or synchronization?
CSCW '02: Proceedings of the 2002 ACM conference on Computer supported cooperative work

We present an experiment examining effects of gaze on speech during three-person conversations. Understanding such effects is crucial for the design of teleconferencing systems and Collaborative Virtual Environments (CVEs). Previous findings suggest ...
Gaze, conversational agents and face-to-face communication

In this paper, we describe two series of experiments that examine audiovisual face-to-face interaction between naive human viewers and either a human interlocutor or a virtual conversational agent. The main objective is to analyze the interplay between ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CHI EA '00: CHI '00 Extended Abstracts on Human Factors in Computing Systems

April 2000

406 pages

ISBN:1581132484

DOI:10.1145/633292

Conference Chair:
Marilyn Tremaine
Drexel University

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 April 2000

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CHI00

Sponsor:

SIGCHI

CHI00: Human Factors in Computing Systems

April 1 - 6, 2000

The Hague, The Netherlands

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
492
Total Downloads

Downloads (Last 12 months)36
Downloads (Last 6 weeks)8

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Veivo OMutta M(2022)Dialogue breakdowns in robot-assisted L2 learningComputer Assisted Language Learning10.1080/09588221.2022.2158203(1-22)Online publication date: 19-Dec-2022
https://doi.org/10.1080/09588221.2022.2158203
Ham JBokhorst RCuijpers Rvan der Pol DCabibihan J(2011)Making robots persuasiveProceedings of the Third international conference on Social Robotics10.1007/978-3-642-25504-5_8(71-83)Online publication date: 24-Nov-2011
https://dl.acm.org/doi/10.1007/978-3-642-25504-5_8
Rienks RPoppe RHeylen D(2010)Differences in head orientation behavior for speakers and listenersACM Transactions on Applied Perception10.1145/1658349.16583517:1(1-13)Online publication date: 18-Jan-2010
https://dl.acm.org/doi/10.1145/1658349.1658351
Gu ELee SBadler JBadler N(2007)Eye Movements, Saccades, and Multiparty ConversationsData-Driven 3D Facial Animation10.1007/978-1-84628-907-1_4(79-97)Online publication date: 2007
https://doi.org/10.1007/978-1-84628-907-1_4
Masuko SHoshino J(2005)Attentional behavior model for a virtual characterProceedings of the 2005 International Conference on Active Media Technology, 2005. (AMT 2005).10.1109/AMT.2005.1505412(511-516)Online publication date: 2005
https://doi.org/10.1109/AMT.2005.1505412
Skaburskis AVertegaal RShell JDuchowski AVertegaal R(2004)AuramirrorProceedings of the 2004 symposium on Eye tracking research & applications10.1145/968363.968385(101-108)Online publication date: 22-Mar-2004
https://dl.acm.org/doi/10.1145/968363.968385
Vertegaal RDing YChurchill EMcCarthy JNeuwirth CRodden T(2002)Explaining effects of eye gaze on mediated group conversations:Proceedings of the 2002 ACM conference on Computer supported cooperative work10.1145/587078.587085(41-48)Online publication date: 16-Nov-2002
https://dl.acm.org/doi/10.1145/587078.587085
Lee SBadler JBadler NAppolloni T(2002)Eyes aliveProceedings of the 29th annual conference on Computer graphics and interactive techniques10.1145/566570.566629(637-644)Online publication date: 23-Jul-2002
https://dl.acm.org/doi/10.1145/566570.566629
Vertegaal RDuchowski AVertegaal RSenders J(2002)Designing attentive interfacesProceedings of the 2002 symposium on Eye tracking research & applications10.1145/507072.507077(23-30)Online publication date: 25-Mar-2002
https://dl.acm.org/doi/10.1145/507072.507077
Yang GDempere-Marco LHu XRowe A(2002)Visual search: psychophysical models and practical applicationsImage and Vision Computing10.1016/S0262-8856(02)00022-720:4(291-305)Online publication date: Apr-2002
https://doi.org/10.1016/S0262-8856(02)00022-7
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes

Explaining effects of eye gaze on mediated group conversations:: amount or synchronization?

Gaze, conversational agents and face-to-face communication