short-paper

Eye-tracking for avatar eye-gaze and interactional analysis in immersive collaborative virtual environments

Authors:

William Steptoe,

Alessio Murgia,

Estefania Guimaraes,

Anthony SteedAuthors Info & Claims

CSCW '08: Proceedings of the 2008 ACM conference on Computer supported cooperative work

Pages 197 - 200

https://doi.org/10.1145/1460563.1460593

Published: 08 November 2008 Publication History

Abstract

Participants' eye-gaze is generally not captured or represented in immersive collaborative virtual environment (ICVE) systems. We present EyeCVE, which uses mobile eye-trackers to drive the gaze of each participant's virtual avatar, thus supporting remote mutual eye-contact and awareness of others' gaze in a perceptually unfragmented shared virtual workspace. We detail trials in which participants took part in three-way conferences between remote CAVE™ systems linked via EyeCVE. Eye-tracking data was recorded and used to evaluate interaction, confirming the system's support for the use of gaze as a communicational and management resource in multiparty conversational scenarios. We point toward subsequent investigation of eye-tracking in ICVEs for enhanced remote social-interaction and analysis.

References

[1]

S. Acker and S. Levitt. Designing Videoconference Facilities for Improved Eye Contact. J. Broad. & Elec. Media, 31: 181, 1987.

[2]

M. Argyle and M. Cook. Gaze and Mutual Gaze. Cambridge University Press Cambridge, 1976.

[3]

J. Bailenson, A. Beall, J. Loomis, J. Blascovich, and M. Turk. Transformed Social Interaction: Decoupling Representation from Behavior and Form in Collaborative Virtual Environments. Presence: Teleoperators & Virtual Environments, 13(4): 428--441, 2004.

Digital Library

[4]

J. Bailenson, J. Blascovich, A. Beall, and J. Loomis. Equilibrium Theory Revisited: Mutual Gaze and Personal Space in Virtual Environments. Presence: Teleoperators & Virtual Environments, 10(6): 583--598, 2001.

Digital Library

[5]

S. Benford, J. Bowers, L. Fahlén, C. Greenhalgh, and D. Snowdon. User embodiment in collaborative virtual environments. Proceedings of the SIGCHI conference on Human factors in computing systems, pages 242--249, 1995.

Digital Library

[6]

M. Chen. Leveraging the asymmetric sensitivity of eye contact for videoconference. Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, pages 49--56, 2002.

Digital Library

[7]

S. Duncan. Some signals and rules for taking speaking turns in conversations. Nonverbal Communication: Readings with Commentary, 1974.

[8]

M. Garau, M. Slater, V. Vinayagamoorthy, A. Brogni, A. Steed, and M. Sasse. The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment. Proceedings of the conference on Human factors in computing systems, pages 529--536, 2003.

Digital Library

[9]

E. Gu and N. Badler. Visual Attention and Eye Gaze During Multiparty Conversations with Distractions. Intelligent Virtual Agents, 2006.

Digital Library

[10]

J. Hauber, H. Regenbrecht, M. Billinghurst, and A. Cockburn. Spatiality in videoconferencing: trade-offs between efficiency and social presence. Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work, pages 413--422, 2006.

Digital Library

[11]

I. Heldal, A. Steed, M. Spante, et al. Successes and Failures in Co-Present Situations. Presence: Teleoperators & Virtual Environments, 14(5): 563--579, 2005.

Digital Library

[12]

J. Hindmarsh, M. Fraser, C. Heath, S. Benford, and C. Greenhalgh. Object-focused interaction in collaborative virtual environments. ACM Transactions on Computer-Human Interaction (TOCHI), 7(4): 477--509, 2000.

Digital Library

[13]

E. Isaacs and J. Tang. What video can and cannot do for collaboration: A case study. Multimedia Systems, 2(2): 63--73, 1994.

Digital Library

[14]

S. Langton, R. Watt, and V. Bruce. Do the eyes have it? Cues to the direction of social attention. Trends in Cognitive Sciences, 4(2): 50--59, 2000.

[15]

S. Lee, J. Badler, and N. Badler. Eyes alive. ACM Transactions on Graphics (TOG), 21(3): 637--644, 2002.

Digital Library

[16]

A. Murgia, R. Wolff, W. Steptoe, et al. A Tool For Replay And Analysis of Gaze-Enhanced Multiparty Sessions Captured in Immersive Collaborative Environments. ACM DS-RT '08, 2008.

Digital Library

[17]

N. Murray and D. Roberts. Comparison of head gaze and head and eye gaze within an immersive environment. the 10th IEEE International Symposium on Distributed Simulation and Real Time Applications. IEEE Computer Society, Los Alamitos, CA, 2006.

Digital Library

[18]

K. Okada, F. Maeda, Y. Ichikawaa, and Y. Matsushita. Multiparty videoconferencing at virtual social distance: MAJIC design. Proceedings of the 1994 ACM conference on Computer supported cooperative work, pages 385--393, 1994.

Digital Library

[19]

D. Roberts, R. Wolff, O. Otto, and A. Steed. Constructing a Gazebo: Supporting Teamwork in a Tightly Coupled, Distributed Task in Virtual Reality. Presence: Teleoperators & Virtual Environments, 12(6): 644--657, 2003.

Digital Library

[20]

H. Sacks. Lectures on Conversation. Blackwell, 1995.

[21]

A. Steed, D. Roberts, R. Schroeder, and I. Heldal. Interaction between Users of Immersion Projection Technology Systems. HCI International 2005, the 11th International Conference on Human Computer Interaction, pages 22--27, 2005.

[22]

W. Steptoe and A. Steed. High-Fidelity Avatar Eye-Representation. Virtual Reality Conference, 2008. VR '08. IEEE, pages 111--114, 2008.

[23]

R. Vertegaal. The GAZE groupware system: mediating joint attention in multiparty communication and collaboration. Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, pages 294--301, 1999.

Digital Library

[24]

R. Vertegaal, I. Weevers, C. Sohn, and C. Cheung. GAZE-2: conveying eye contact in group video conferencing using eye-controlled camera direction. Proceedings of the conference on Human factors in computing systems, pages 521--528, 2003.

Digital Library

[25]

V. Vinayagamoorthy, M. Garau, A. Steed, and M. Slater. An Eye Gaze Model for Dyadic Interaction in an Immersive Virtual Environment: Practice and Experience. Computer Graphics Forum, 23(1): 1--11, 2004.

[26]

R. Wolff, D. Roberts, A. Murgia, et al. Communicating Eye Gaze across a Distance without Rooting Participants to the Spot. ACM DS-RT '08, 2008.

Digital Library

Cited By

Schuessler MHormann LDachselt RBlake ARother C(2024)Gazing Heads: Investigating Gaze Perception in Video-Mediated CommunicationACM Transactions on Computer-Human Interaction10.1145/366034331:3(1-31)Online publication date: 11-Jun-2024
https://dl.acm.org/doi/10.1145/3660343
Aziz SLohr DFriedman LKomogortsev O(2024)Evaluation of Eye Tracking Signal Quality for Virtual Reality Applications: A Case Study in the Meta Quest ProProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3653347(1-8)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3649902.3653347
Lee GLee DSu GManocha D(2024)“May I Speak?”: Multi-Modal Attention Guidance in Social VR Group ConversationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337211930:5(2287-2297)Online publication date: 7-Mar-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372119
Show More Cited By

Index Terms

Eye-tracking for avatar eye-gaze and interactional analysis in immersive collaborative virtual environments
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Information systems
  1. World Wide Web
    1. Web applications
      1. Internet communications tools
        Web conferencing

Recommendations

The effect of avatar realism in immersive social virtual realities
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology

This paper investigates the effect of avatar realism on embodiment and social interactions in Virtual Reality (VR). We compared abstract avatar representations based on a wooden mannequin with high fidelity avatars generated from photogrammetry 3D scan ...
The impact of eye gaze on communication using humanoid avatars
CHI '01: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

In this paper we describe an experiment designed to investigate the importance of eye gaze in humanoid avatar's representing people engaged in conversation. We compare responses to dyadic conversations in four mediated conditions: video, audio-only, and ...
The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment
CHI '03: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

This paper presents an experiment designed to investigate the impact of scommunication in an immersive virtual environment.Participants were paired by gender and were randomly assigned to a CAVE-like system or a head-mounted display. Both were ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CSCW '08: Proceedings of the 2008 ACM conference on Computer supported cooperative work

November 2008

752 pages

ISBN:9781605580074

DOI:10.1145/1460563

General Chairs:
Bo Begole
PARC, USA
,
David W. McDonald
University of Washington, USA

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 November 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

CSCW08

Sponsor:

CSCW08: Computer Supported Cooperative Work

November 8 - 12, 2008

CA, San Diego, USA

Acceptance Rates

Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

Upcoming Conference

CSCW '25

Sponsor:
sigchi

Computer-Supported Cooperative Work and Social Computing

October 18 - 22, 2025

Bergen , Norway

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

58
Total Citations
View Citations
1,446
Total Downloads

Downloads (Last 12 months)76
Downloads (Last 6 weeks)10

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Schuessler MHormann LDachselt RBlake ARother C(2024)Gazing Heads: Investigating Gaze Perception in Video-Mediated CommunicationACM Transactions on Computer-Human Interaction10.1145/366034331:3(1-31)Online publication date: 11-Jun-2024
https://dl.acm.org/doi/10.1145/3660343
Aziz SLohr DFriedman LKomogortsev O(2024)Evaluation of Eye Tracking Signal Quality for Virtual Reality Applications: A Case Study in the Meta Quest ProProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3653347(1-8)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3649902.3653347
Lee GLee DSu GManocha D(2024)“May I Speak?”: Multi-Modal Attention Guidance in Social VR Group ConversationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337211930:5(2287-2297)Online publication date: 7-Mar-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372119
Dembinsky DWatanabe KDengel AIshimaru S(2024)Gaze Generation for Avatars Using GANsIEEE Access10.1109/ACCESS.2024.343083512(101536-101548)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3430835
Liu YZhao SCheng S(2024)Augmenting collaborative interaction with shared visualization of eye movement and gesture in VRComputer Animation and Virtual Worlds10.1002/cav.226435:3Online publication date: 4-Jun-2024
https://doi.org/10.1002/cav.2264
Huang WBillinghurst MAlem LXiao CRasmussen T(2024)Communicating Eye Gaze Cues in Remote Collaboration on Physical TasksComputer‐Supported Collaboration10.1002/9781119719830.ch5(115-142)Online publication date: 24-May-2024
https://doi.org/10.1002/9781119719830.ch5
Albiz JViberg OMatviienko A(2023)Guiding Visual Attention on 2D Screens: Effects of Gaze Cues from Avatars and HumansProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614529(1-9)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614529
Dasari MLu EFarb MPereira NLiang IRowe A(2023)Scaling VR Video Conferencing2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00080(648-657)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00080
Kim HPark J(2023)Providing Dual Awareness using Multimodal Cues for Collaborative Manipulation in Virtual EnvironmentsInternational Journal of Human–Computer Interaction10.1080/10447318.2023.218853340:12(3298-3312)Online publication date: 3-Apr-2023
https://doi.org/10.1080/10447318.2023.2188533
Misersky JPeeters DFlecken M(2022)The Potential of Immersive Virtual Reality for the Study of Event PerceptionFrontiers in Virtual Reality10.3389/frvir.2022.6979343Online publication date: 1-Jul-2022
https://doi.org/10.3389/frvir.2022.697934
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents