research-article

Attention from Afar: Simulating the Gazes of Remote Participants in Hybrid Meetings

Authors:

Thomas EricksonAuthors Info & Claims

DIS '17: Proceedings of the 2017 Conference on Designing Interactive Systems

Pages 101 - 113

https://doi.org/10.1145/3064663.3064720

Published: 10 June 2017 Publication History

Abstract

Gaze is a powerful form of social feedback, providing cues about attention and interest, and boredom and distraction. We designed a working prototype that enabled remote participants in a collocated meeting to look around the local meeting space, and that showed local participants where the remote participants' "simulated gazes" (that is, their virtual cameras) were directed. Of course, pointing a camera is not the same as gazing, and so we conducted a study to understand how simulated gazes might be used, and to what extent they would be experienced as social cues. Findings range from the use of simulated gaze to signal attention, to ways in which local and remote participants experienced these simulated gazes. These findings illustrate the value of indirection and abstraction in presenting social cues; raise issues of privacy, visibility, and participation asymmetry; and suggest implications for design and further research.

References

[1]

Geoffrey W. Beattie. 1981. A further investigation of the cognitive interference hypothesis of gaze patterns Figure 6. An enhanced gaze visualization. Rays show the direction of gazes, and their lengths reflect how recently each was changed (initially they reach the periphery, and then shrink). An image of the person who has most recently shifted their gaze is briefly shown. during conversation. British Journal of Social Psychology 20.4: 243--248.

[2]

Michael S. Bernstein, Eytan Bakshy, Moira Burke, and Brian Karrer. 2013. Quantifying the invisible audience in social networks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 21--30.

Digital Library

[3]

Jeremy P. Birnholtz, Carl Gutwin, and Kirstie Hawkey. 2007. Privacy in the open: how attention mediates awareness and privacy in open-plan offices. In Proceedings of the 2007 international ACM conference on Supporting group work (GROUP '07). ACM, New York, NY, USA, 51--60.

Digital Library

[4]

Mark S. Cary. 1978. The role of gaze in the initiation of conversation. Social Psychology: 269--271.

[5]

Alex Colburn, Michael F. Cohen, and Steven Drucker. 2000. The role of eye gaze in avatar mediated conversational interfaces. Sketches and Applications, Siggraph'00.

[6]

Mark Cook. 1977. Gaze and Mutual Gaze in Social Encounters: How long -- and when -- we look others "in the eye" is one of the main signals in nonverbal communication. American Scientist 65.3: 328--333.

[7]

Laura Dabbish and Robert E. Kraut. 2004. Controlling interruptions: awareness displays and social motivation for coordination. In Proceedings of the 2004 ACM conference on Computer supported cooperative work (CSCW '04). ACM, New York, NY, USA, 182--191.

Digital Library

[8]

Daniela Damian, Luis Izquierdo, Janice Singer, and Irwin Kwan. 2007. Awareness in the wild: Why communication breakdowns occur. In Proceedings of the International Conference on Global Software Engineering (ICGSE'07), 81--90.

Digital Library

[9]

Deepak Akkil and Poika Isokoski. 2016. Gaze Augmentation in Egocentric Video Improves Awareness of Intention. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 15731584.

Digital Library

[10]

Paul Dourish. 1997. Extending awareness beyond synchronous collaboration. Position Paper for CHI 97: 249--256.

[11]

Paul Dourish and Sara Bly. 1992. Portholes: supporting awareness in a distributed work group. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '92), Penny Bauersfeld, John Bennett, and Gene Lynch (Eds.). ACM, New York, NY, USA, 541--547.

Digital Library

[12]

Thomas Erickson and Wendy A. Kellogg. 2000. Social translucence: an approach to designing systems that support social processes. ACM Trans. Comput.-Hum. Interact. 7, 1 (March 2000), 59--83.

Digital Library

[13]

Thomas Erickson, David N. Smith, Wendy A. Kellogg, Mark Laff, John T. Richards, and Erin Bradner. 1999. Socially translucent systems: social proxies, persistent conversation, and the design of "babble". In Proceedings of the SIGCHI conference on Human Factors in Computing Systems (CHI '99). ACM, New York, NY, USA, 72--79.

Digital Library

[14]

Motahhare Eslami, Aimee Rickman, Kristen Vaccaro, Amirhossein Aleyasen, Andy Vuong, Karrie Karahalios, Kevin Hamilton, and Christian Sandvig. 2015. "I always assumed that I wasn't really that close to {her}": Reasoning about Invisible Algorithms in News Feeds. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 153--162.

Digital Library

[15]

Danyel Fisher and Paul Dourish. 2004. Social and temporal structures in everyday collaboration. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). ACM, New York, NY, USA, 551--558.

Digital Library

[16]

George. W. Furnas. 1986. Generalized fisheye views. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '86), Marilyn Mantei and Peter Orbeton (Eds.). ACM, New York, NY, USA, 16--23.

Digital Library

[17]

Susan R. Fussell, Leslie D. Setlock, and Elizabeth M. Parker. 2003. Where do helpers look?: gaze targets during collaborative physical tasks. In CHI '03 Extended Abstracts on Human Factors in Computing Systems (CHI EA '03). ACM, New York, NY, USA, 768--769.

Digital Library

[18]

Susan R. Fussell, Leslie D. Setlock, Jie Yang, Jiazhi Ou, Elizabeth Mauer, and Adam D. I. Kramer. 2004. Gestures over video streams to support remote collaboration on physical tasks. ACM Trans. HumComput. Interact. 19, 3 (September 2004), 273--309.

Digital Library

[19]

Maia Garau, Mel Slater, Vinoba Vinayagamoorthy, Andrea Brogni, Anthony Steed, and M. Angela Sasse. 2003. The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, 529--536.

Digital Library

[20]

Ge Gao, Bin Xu, Dan Cosley, and Susan R. Fussell. 2014. How beliefs about the presence of machine translation impact multilingual collaborations. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing (CSCW '14). ACM, New York, NY, USA, 1549--1560.

Digital Library

[21]

Eric Gilbert. 2012. Designing social translucence over social networks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2731--2740.

Digital Library

[22]

Erving Goffman. 1963. Behavior in Public Places. New York: Free Press.

[23]

Erving Goffman. 1984 {originally 1959}. The Presentation of Self in Everyday Life. Harmondsworth: Penguin.

[24]

Charles Goodwin, and John Heritage. 1990. Conversation analysis. Annual review of anthropology 19: 283--307.

[25]

Joy E.Hanna, and Susan E. Brennan. 2007. Speakers' eye gaze disambiguates referring expressions early during face-to-face conversation. Journal of Memory and Language 57.4: 596--615.

[26]

Keita Higuch, Ryo Yonetani, and Yoichi Sato. 2016. Can Eye Help You?: Effects of Visualizing Eye Fixations on Remote Collaboration Scenarios for Physical Tasks. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 51805190.

Digital Library

[27]

Gordon Hull, Heather Richter Lipford, and Celine Latulipe. 2011. Contextual gaps: Privacy issues on Facebook. Ethics and Information Technology 13, 4: 289--302.

Digital Library

[28]

Hiroshi Ishii, and Minoru Kobayashi. 1992. ClearBoard: a seamless medium for shared drawing and conversation with eye contact. In Proceedings of the SIGCHI conference on Human factors in computing systems (CHI'92), Penny Bauersfeld, John Bennett, and Gene Lynch (Eds.). ACM, New York, NY, USA, 525--532.

Digital Library

[29]

Jeroen Janssen, Gijsbert Erkens, and Paul A. Kirschner. 2011. Group awareness tools: It's what you do with it that matters. Computers in Human Behavior27.3: 1046--1058.

Digital Library

[30]

Adam Kendon. 1967. Some functions of gaze direction in social interaction. Acta psychologica 26: 22--63.

[31]

Kana Misawa, Yoshio Ishiguro, and Jun Rekimoto. 2012. LiveMask: a telepresence surrogate system with a face-shaped screen for supporting nonverbal communication. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI '12), Genny Tortora, Stefano Levialdi, and Maurizio Tucci (Eds.). ACM, New York, NY, USA, 394--397.

Digital Library

[32]

Kana Misawa, Yoshio Ishiguro, and Jun Rekimoto. 2012. Ma petite chérie: what are you looking at?: a small telepresence system to support remote collaborative work for intimate communication. In Proceedings of the 3rd Augmented Human International Conference (AH '12). ACM, New York, NY, USA, Article 17, 5 pages.

Digital Library

[33]

Andrew F. Monk, and Caroline Gale. 2002. A look is worth a thousand words: Full gaze awareness in videomediated conversation. Discourse Processes 33.3: 257--278.

[34]

Jens Edlund, Samer Al Moubayed, and Jonas Beskow. 2011. The Mona Lisa gaze effect as an objective metric for perceived cospatiality. In Proceeding of International Conference on Intelligent Virtual Agents (IVA'11). Springer Berlin Heidelberg, 439--440.

Digital Library

[35]

Helen Nissenbaum. 2009. Privacy in context: Technology, policy, and the integrity of social life. Stanford University Press.

Digital Library

[36]

Helen Nissenbaum. 2011. A contextual approach to privacy online. Daedalus 140, 4: 32--48.

[37]

David G. Novick, Brian Hansen, and Karen Ward. 1996. Coordinating turn-taking with gaze. In Proceedings of Fourth International Conference on Spoken Language (ICSLP'96). IEEE. 1888--1891.

[38]

Hiroaki Ogata, Kenji Matsuura, and Yoneo Yano. 1996. Knowledge awareness: Bridging between shared knowledge and collaboration in sharlok. In Proceedings of Educational Telecommunications: 232--237.

[39]

Omnidirectional camera. 2016. Retrieved January 12, 2017 from https://en.wikipedia.org/wiki/Omnidirectional_camera

[40]

Antti Oulasvirta, Mika Raento, and Sauli Tiitta. 2005. ContextContacts: re-designing SmartPhone's contact book to support mobile awareness and collaboration. In Proceedings of the 7th international conference on Human computer interaction with mobile devices & services (MobileHCI '05). ACM, New York, NY, USA, 167--174.

Digital Library

[41]

Pan--tilt--zoom camera. 2016. Retrieved January 12, 2017 from https://en.wikipedia.org/wiki/Pan%E2%80%93tilt%E2 %80%93zoom_camera

[42]

Elin Rønby Pedersen and Tomas Sokoler. 1997. AROMA: abstract representation of presence supporting mutual awareness. In Proceedings of the ACM SIGCHI Conference on Human factors in computing systems (CHI '97). ACM, New York, NY, USA, 51--58.

Digital Library

[43]

Christopher Peters, Catherine Pelachaud, Elisabetta Bevacqua, Maurizio Mancini, and Isabella Poggi. 2005. A model of attention and interest using gaze behavior. In Proceeding of International Workshop on Intelligent Virtual Agents. Springer Berlin Heidelberg, 229--240.

Digital Library

[44]

Alex Poole, and Linden J. Ball. 2006. Eye tracking in HCI and usability research. Encyclopedia of human computer interaction 1: 211--219.

[45]

Ramana Rao and Stuart K. Card. 1994. The table lens: merging graphical and symbolic representations in an interactive focus + context visualization for tabular information. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '94), Beth Adelson, Susan Dumais, and Judith Olson (Eds.). ACM, New York, NY, USA, 318--322

Digital Library

[46]

Ricoh Theta S camera. 2016. Retrieved January 12, 2017 from https://theta360.com/en/about/theta/s.html

[47]

Markus Rittenbruch, and Gregor McEwan. 2009. An historical reflection of awareness in collaboration. Awareness Systems: 3--48.

[48]

Randy Stein and Susan E. Brennan. 2004. Another person's eye gaze as a cue in solving programming problems. In Proceedings of the 6th international conference on Multimodal interfaces (ICMI '04). ACM, New York, NY, USA, 9--15.

Digital Library

[49]

John C. Tang, and Ellen Isaacs. 1992. Why do users like video?. Computer Supported Cooperative Work 1.3: 163--196.

[50]

Joseph B. Walther, Brandon Van Der Heide, Artemio Ramirez, Judee K. Burgoon, and Jorge Peña. 2015. Interpersonal and hyperpersonal dimensions of computer-mediated communication. Wiley.

[51]

Bernard Weiner. 2001. Intrapersonal and interpersonal theories of motivation from an attribution perspective. Student motivation: 17--30.

[52]

Suzanne Weisband. 2002. Maintaining awareness in distributed team collaboration: Implications for leadership and performance. Distributed work: 311--333.

[53]

Timo Wolf, Adrian Schröter, Daniela Damian, Lucas D. Panjer, and Thanh HD Nguyen. 2009. Mining taskbased social networks to explore collaboration in software teams. IEEE Software 26.1: 58--66.

Digital Library

[54]

Bin Xu, Pamara Chang, Christopher L. Welker, Natalya N. Bazarova, and Dan Cosley. 2016. Automatic Archiving versus Default Deletion: What Snapchat Tells Us About Ephemerality in Design. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, New York, NY, USA, 1662--1675.

Digital Library

Cited By

Lee GLee DSu GManocha D(2024)“May I Speak?”: Multi-Modal Attention Guidance in Social VR Group ConversationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337211930:5(2287-2297)Online publication date: May-2024
https://doi.org/10.1109/TVCG.2024.3372119
Hu EGrønbæk JHouck AHeo S(2023)OpenMic: Utilizing Proxemic Metaphors for Conversational Floor Transitions in Multiparty Video MeetingsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581013(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581013
Rogers BApperley MReyes EMasoodian M(2023)Wedge Video: Supporting Remote Participants in a Mixed-Mode Videoconference MeetingInteracting with Computers10.1093/iwc/iwad03235:5(666-680)Online publication date: 10-May-2023
https://doi.org/10.1093/iwc/iwad032
Show More Cited By

Index Terms

Attention from Afar: Simulating the Gazes of Remote Participants in Hybrid Meetings
1. Human-centered computing
  1. Collaborative and social computing

Recommendations

Social Distancing and Social Biosensing: Intersubjectivity from Afar
Abstract
The shelter-in-place orders across the U.S. in response to the COVID-19 pandemic forced many relationships once sustained by in-person interaction into remote states through computer-mediated communication (CMC). Work, school, holidays, social ...
A Method to Recognize Eyeball Movement Gesture using Infrared Distance Sensor Array on Eyewear
iiWAS2021: The 23rd International Conference on Information Integration and Web Intelligence

Sensing technology for eyeball movement (i.e., gaze movement) has enabled various applications, e.g., hands-free input interfaces and provided information that helps us understand human beings in various fields. However, the existing method, which ...
GlassBoARd: A Gaze-Enabled AR Interface for Collaborative Work
CHI EA '24: Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems
Recent research on remote collaboration focuses on improving the sense of co-presence and mutual understanding among the collaborators, whereas there is limited research on using non-verbal cues such as gaze or head direction alongside their main ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '17: Proceedings of the 2017 Conference on Designing Interactive Systems

June 2017

1444 pages

ISBN:9781450349222

DOI:10.1145/3064663

General Chair:
Oli Mival
Edinburgh Napier University, UK
,
Program Chairs:
Michael Smyth
Edinburgh Napier University, UK
,
Peter Dalsgaard
Aarhus University, Denmark

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 June 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

DIS '17

Sponsor:

SIGCHI

DIS '17: Designing Interactive Systems Conference 2017

June 10 - 14, 2017

Edinburgh, United Kingdom

Acceptance Rates

DIS '17 Paper Acceptance Rate 107 of 487 submissions, 22%;

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
550
Total Downloads

Downloads (Last 12 months)63
Downloads (Last 6 weeks)2

Reflects downloads up to 24 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lee GLee DSu GManocha D(2024)“May I Speak?”: Multi-Modal Attention Guidance in Social VR Group ConversationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337211930:5(2287-2297)Online publication date: May-2024
https://doi.org/10.1109/TVCG.2024.3372119
Hu EGrønbæk JHouck AHeo S(2023)OpenMic: Utilizing Proxemic Metaphors for Conversational Floor Transitions in Multiparty Video MeetingsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581013(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581013
Rogers BApperley MReyes EMasoodian M(2023)Wedge Video: Supporting Remote Participants in a Mixed-Mode Videoconference MeetingInteracting with Computers10.1093/iwc/iwad03235:5(666-680)Online publication date: 10-May-2023
https://doi.org/10.1093/iwc/iwad032
Buyukguzel SMitchell R(2023)Progressivity in Hybrid Meetings: Daily Scrum as an Enabling Constraint for a Multi-Locational Software Development TeamComputer Supported Cooperative Work (CSCW)10.1007/s10606-022-09454-332:3(573-606)Online publication date: 23-Jan-2023
https://doi.org/10.1007/s10606-022-09454-3
Avdullahu AHerrmann TRummel N(2023)Requirements Analysis to Support Equal Participation in Hybrid Collaboration Settings in Higher EducationLearning and Collaboration Technologies10.1007/978-3-031-34550-0_30(411-430)Online publication date: 9-Jun-2023
https://doi.org/10.1007/978-3-031-34550-0_30
Neumayr TAugstein MSchönböck JRintel SLeeb HTeichmeister T(2022)Semi-automated Analysis of Collaborative Interaction: Are We There Yet?Proceedings of the ACM on Human-Computer Interaction10.1145/35677246:ISS(354-380)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567724
Neumayr TAugstein MKubicek B(2022)Territoriality in Hybrid CollaborationProceedings of the ACM on Human-Computer Interaction10.1145/35552246:CSCW2(1-37)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555224
Zhong SRosset LPapinutto MLalanne DAlavi H(2022)Binaural Audio in Hybrid Meetings: Effects on Speaker Identification, Comprehension, and User ExperienceProceedings of the ACM on Human-Computer Interaction10.1145/35551706:CSCW2(1-24)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555170
Yang CYamashita NKuzuoka HWang HFoong E(2022)Distance Matters to Weak TiesProceedings of the ACM on Human-Computer Interaction10.1145/34928636:GROUP(1-26)Online publication date: 14-Jan-2022
https://dl.acm.org/doi/10.1145/3492863
Poretski LLanir JMargalit RArazy O(2021)Physicality As an Anchor for Coordination: Examining Collocated Collaboration in Physical and Mobile Augmented Reality SettingsProceedings of the ACM on Human-Computer Interaction10.1145/34798575:CSCW2(1-29)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3479857
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents