Article

Empathic tutoring software agents using real-time eye tracking

Authors:

Mitsuru IshizukaAuthors Info & Claims

ETRA '06: Proceedings of the 2006 symposium on Eye tracking research & applications

Pages 73 - 78

https://doi.org/10.1145/1117309.1117346

Published: 27 March 2006 Publication History

Abstract

This paper describes an empathic software agent (ESA) interface using eye movement information to facilitate empathy-relevant reasoning and behavior. Eye movement tracking is used to monitor user's attention and interests, and to personalize the agent behaviors. The system reacts to user eye information in real-time, recording eye gaze and pupil dilation data during the learning process. Based on these measures, the ESA infers the focus of attention and motivational status of the learner and responds accordingly with affective (display of emotion) and instructional behaviors. In addition to describing the design and implementation of empathic software agents, this paper will report on some preliminary usability test results concerning how users respond to the empathic functions that are provided.

References

[1]

Palloff, R. M. and Pratt, K. Lessons from the cyberspace classroom: The realities of online teaching. San Francisco: Jossey-Bass, 2001.

Digital Library

[2]

Cooper B, Brna P, Martins A. Effective Affective in Intelligent Systems -- Building on Evidence of Empathy in Teaching and Learning. In: Affective Interactions: Towards a New Generation of Computer Interfaces. Paiva A ed. London: Springer Verlag. 2000

Digital Library

[3]

Otteson, J. P., and Otteson, C. R. Effect of teacher's gaze on children's story recall. Perceptual and Motor Skills, 50, 35--42, 1979

[4]

Sherwood, J. V. Facilitative effects of gaze upon learning. Perceptual and Motor Skills, 64, 1275--1278, 1987.

[5]

Graham, S. Communicating sympathy and anger to black and white children: The cognitive (attributional) consequences of affective cues. Journal of Personality and Social Psychology. 47(1), 40--54, 1984.

[6]

Klein, J., Moon, Y., and Picard, R. This computer responds to learner frustration: Theory, design, and results. Interacting with Computers, pp 119--140, 2002.

[7]

Ahn, H. and Picard, R. Affective-Cognitive Learning and Decision Making: A Motivational Reward Framework For Affective Agent, The 1st International Conference on Affective Computing and Intelligent Interaction. October 22--24, 2005, Beijing, China.

Digital Library

[8]

Qu, L., Wang, N., John, W. L., "Choosing when to interact with learners", Proceedings of the 9th international conference on Intelligent user interface table of contents, Funchal, Madeira, Portugal, Short Papers table of contents, pp 307--309, 2004.

Digital Library

[9]

Fabri, M., D. Moore, and D. Hobbs, "Mediating the Expression of Emotion in Educational Collaborative Virtual Environments: An Experimental Study". Virtual Reality Journal, 2004

Digital Library

[10]

Stone, B., and Lester, J., Dynamically Sequencing an Animated Pedagogical Agent, Proceedings of the 13th National Conference on Artificial Intelligence, pp. 424--431, Portland, OR, August, 1996.

Digital Library

[11]

Duchowski, T., Eye Tracking Methodology: Theory and Practice. Springer, London, UK, 2003.

Digital Library

[12]

Johnson, W. L., Marsella, S., Mote, H., Vilhjalmsson, S., Narayanan, S. and Choi, S., Language Training System: Supporting the Rapid Acquisition of Foreign Language and Cultural Skills.

[13]

Faraday, P., and Sutclie, A., An empirical study of attending and comprehending multimedia presentations. In Proceedings of ACM Multimedia, pp. 265--275, Boston MA, 1996.

Digital Library

[14]

Prendinger, H., Descamps. S., and Ishizuka, M., MPML: A markup language for controlling the behavior of life-like characters. Journal of Visual Languages.

[15]

Huang, Z., Elis, A., and Visser, C., Facial Expressions for Embodied Agents in STEP, Proceedings of AAMAS 2004 Workshop on Embodied Conversational Agents: Balanced Perception and Action, 2004.

Cited By

Potts DBroad ZSehgal THartley JO'Neill EJicol CClarke CLutteroth C(2024)Sweating the Details: Emotion Recognition and the Influence of Physical Exertion in Virtual Reality ExergamingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642611(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642611
Broussard DBorst C(2023)Heat Metaphor for Attention Estimation for Educational VR2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW58643.2023.00184(683-684)Online publication date: Mar-2023
https://doi.org/10.1109/VRW58643.2023.00184
Borst CKulshreshth A(2023)Networked Virtual Reality and Enhanced Sensing for Remote Classes and PresentationsEveryday Virtual and Augmented Reality10.1007/978-3-031-05804-2_6(147-179)Online publication date: 19-Feb-2023
https://doi.org/10.1007/978-3-031-05804-2_6
Show More Cited By

Index Terms

Empathic tutoring software agents using real-time eye tracking
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
      2. Computer vision tasks
        Scene understanding
    2. Distributed artificial intelligence
      1. Intelligent agents
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Empathic Multiple Tutoring Agents for Multiple Learner Interface
WI-IATW '06: Proceedings of the 2006 IEEE/WIC/ACM international conference on Web Intelligence and Intelligent Agent Technology

This paper describes a multiple user e-learning interface with multiple tutoring character agents. The character agents use eye movement information to facilitate empathy-relevant reasoning and behavior. Eye Information is used to monitor user's ...
Character agents in E-learning interface using multimodal real-time interaction
HCI'07: Proceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments

This paper describes an e-learning interface with multiple tutoring character agents. The character agents use eye movement information to facilitate empathy-relevant reasoning and behavior. Eye Information is used to monitor user's attention and ...
User Eye Fatigue Detection via Eye Movement Behavior
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems

In this study we propose and evaluate a novel approach that allows detection of physical eye fatigue. The proposed approach is based on the analysis of the recorded eye movements via what is called behavioral scores. These easy-to-compute scores can be ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '06: Proceedings of the 2006 symposium on Eye tracking research & applications

March 2006

175 pages

ISBN:1595933050

DOI:10.1145/1117309

Conference Chairs:
Kari-Jouko Räihä
University of Tampere
,
Andrew T. Duchowski
Clemson University

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 March 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ETRA06

Sponsor:

ETRA06: Eye Tracking Research and Applications

March 27 - 29, 2006

California, San Diego

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

61
Total Citations
View Citations
1,531
Total Downloads

Downloads (Last 12 months)31
Downloads (Last 6 weeks)4

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Potts DBroad ZSehgal THartley JO'Neill EJicol CClarke CLutteroth C(2024)Sweating the Details: Emotion Recognition and the Influence of Physical Exertion in Virtual Reality ExergamingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642611(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642611
Broussard DBorst C(2023)Heat Metaphor for Attention Estimation for Educational VR2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW58643.2023.00184(683-684)Online publication date: Mar-2023
https://doi.org/10.1109/VRW58643.2023.00184
Borst CKulshreshth A(2023)Networked Virtual Reality and Enhanced Sensing for Remote Classes and PresentationsEveryday Virtual and Augmented Reality10.1007/978-3-031-05804-2_6(147-179)Online publication date: 19-Feb-2023
https://doi.org/10.1007/978-3-031-05804-2_6
Zhang JPark SCho AWhang M(2022)Significant Measures of Gaze and Pupil Movement for Evaluating Empathy between Viewers and Digital ContentSensors10.3390/s2205170022:5(1700)Online publication date: 22-Feb-2022
https://doi.org/10.3390/s22051700
Zhang JWen XWhang M(2022)Empathy evaluation by the physical elements of the advertisingMultimedia Tools and Applications10.1007/s11042-021-11637-x81:2(2241-2257)Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1007/s11042-021-11637-x
Durant SWilkins BWoods CUliana EStathis K(2021)Attention Guidance Agents with Eye-TrackingEngineering Multi-Agent Systems10.1007/978-3-030-97457-2_6(92-113)Online publication date: 3-May-2021
https://dl.acm.org/doi/10.1007/978-3-030-97457-2_6
Purnama FUsagawa T(2020)Using real-time online preprocessed mouse tracking for lower storage and transmission costsJournal of Big Data10.1186/s40537-020-00304-x7:1Online publication date: 10-Apr-2020
https://doi.org/10.1186/s40537-020-00304-x
Khokhar AYoshimura ABorst C(2020)Modified Playback of Avatar Clip Sequences Based on Student Attention in Educational VR2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW50115.2020.00276(850-851)Online publication date: Mar-2020
https://doi.org/10.1109/VRW50115.2020.00276
Dutta AMondal ADey NSen SMoraru LHassanien A(2020)Vision Tracking: A Survey of the State-of-the-ArtSN Computer Science10.1007/s42979-019-0059-z1:1Online publication date: 11-Jan-2020
https://doi.org/10.1007/s42979-019-0059-z
Schneider BDich YRadu I(2020)Unpacking the relationship between existing and new measures of physiological synchrony and collaborative learning: a mixed methods studyInternational Journal of Computer-Supported Collaborative Learning10.1007/s11412-020-09318-215:1(89-113)Online publication date: 24-Apr-2020
https://doi.org/10.1007/s11412-020-09318-2
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents