research-article

Elevating Communication, Collaboration, and Shared Experiences in Mobile Video through Drones

Authors:

Carman Neustaedter,

Scott BatemanAuthors Info & Claims

DIS '16: Proceedings of the 2016 ACM Conference on Designing Interactive Systems

Pages 1123 - 1135

https://doi.org/10.1145/2901790.2901847

Published: 04 June 2016 Publication History

Abstract

People are increasingly using mobile video to communicate, collaborate, and share experiences while on the go. Yet this presents challenges in adequately sharing camera views with remote users. In this paper, we study the use of semi-autonomous drones for video conferencing, where an outdoor user (using a smartphone) is connected to a desktop user who can explore the environment from the drone's perspective. We describe findings from a study where pairs collaborated to complete shared navigation and search tasks. We illustrate the benefits of providing the desktop user with a view that is elevated, manipulable, and decoupled from the outdoor user. In addition, we articulate how participants overcame challenges in communicating environmental information and navigational cues, negotiated control of the view, and used the drone as a tool for sharing experiences. This provides a new way of thinking about mobile video conferencing where cameras that are decoupled from both users play an integral role in communication, collaboration, and sharing experiences.

Supplementary Material

suppl.mov (pn0412-file3.mp4)

Supplemental video

Download
78.61 MB

References

[1]

Jenay M. Beer and Leila Takayama. 2011. Mobile Remote Presence Systems for Older Adults: Acceptance, Benefits, and Concerns. Proceedings of the 6th International Conference on Human-robot Interaction, ACM, 19--26. http://doi.org/10.1145/1957656.1957665

Digital Library

[2]

Jed R. Brubaker, Gina Venolia, and John C. Tang. 2012. Focusing on shared experiences: moving beyond the camera in video communication. Proceedings of the Designing Interactive Systems Conference, ACM, 96--105.

Digital Library

[3]

Jessica R. Cauchard, L. E. Jane, Kevin Y. Zhai, and James A. Landay. 2015. Drone & Me: An Exploration into Natural Human-drone Interaction. Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, ACM, 361--365. http://doi.org/10.1145/2750858.2805823

Digital Library

[4]

Lars M. Ellison, Peter A. Pinto, Fernando Kim, et al. 2004. Telerounding and patient satisfaction after surgery. Journal of the American College of Surgeons 199, 4: 523--530. http://doi.org/10.1016/j.jamcollsurg.2004.06.022

[5]

Mica R. Endsley. 1995. Toward a Theory of Situation Awareness in Dynamic Systems. Human Factors: The Journal of the Human Factors and Ergonomics Society 37, 1: 32--64. http://doi.org/10.1518/001872095779049543

[6]

Omid Fakourfar, Kevin Ta, Richard Tang, Scott Bateman, and Anthony Tang. 2016. Stabilized Annotations for Mobile Remote Assistance. Proceedings of the 34th Annual ACM Conference on Human Factors in Computing Systems, ACM. http://doi.org/10.1145/2858036.2858171

Digital Library

[7]

Susan R. Fussell, Leslie D. Setlock, Jie Yang, Jiazhi Ou, Elizabeth Mauer, and Adam D. I. Kramer. 2004. Gestures over Video Streams to Support Remote Collaboration on Physical Tasks. Hum.-Comput. Interact. 19, 3: 273--309. http://doi.org/10.1207/s15327051hci1903_3

Digital Library

[8]

Steffen Gauglitz, Cha Lee, Matthew Turk, and Tobias Höllerer. 2012. Integrating the Physical Environment into Mobile Remote Collaboration. Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services, ACM, 241--250. http://doi.org/10.1145/2371574.2371610

Digital Library

[9]

Steffen Gauglitz, Benjamin Nuernberger, Matthew Turk, and Tobias Höllerer. 2014. World-stabilized Annotations and Virtual Scene Navigation for Remote Collaboration. Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, ACM, 449--459. http://doi.org/10.1145/2642918.2647372

Digital Library

[10]

Carl Gutwin and Reagan Penner. 2002. Improving Interpretation of Remote Gestures with Telepointer Traces. Proceedings of the 2002 ACM Conference on Computer Supported Cooperative Work, ACM, 49--57. http://doi.org/10.1145/587078.587086

Digital Library

[11]

Jim Hollan and Scott Stornetta. 1992. Beyond Being There. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 119--125. http://doi.org/10.1145/142750.142769

Digital Library

[12]

Kori Inkpen, Brett Taylor, Sasa Junuzovic, John Tang, and Gina Venolia. 2013. Experiences2Go: sharing kids' activities outside the home with remote family members. Proceedings of the 2013 conference on Computer supported cooperative work, ACM, 1329--1340.

Digital Library

[13]

C. A. Johnson, J. A. Adams, and K. Kawamura. 2003. Evaluation of an enhanced human-robot interface. IEEE International Conference on Systems, Man and Cybernetics, 2003, 900--905 vol.1. http://doi.org/10.1109/ICSMC.2003.1243929

[14]

Brennan Jones, Anna Witcraft, Scott Bateman, Carman Neustaedter, and Anthony Tang. 2015. Mechanics of Camera Work in Mobile Video Collaboration. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, 957--966. http://doi.org/10.1145/2702123.2702345

Digital Library

[15]

Tejinder K. Judge and Carman Neustaedter. 2010. Sharing Conversation and Sharing Life: Video Conferencing in the Home. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 655--658. http://doi.org/10.1145/1753326.1753422

Digital Library

[16]

Shunichi Kasahara and Jun Rekimoto. 2014. JackIn: integrating first-person view with out-of-body vision generation for human-human augmentation. Proceedings of the 5th Augmented Human International Conference, ACM, 46.

Digital Library

[17]

Shunichi Kasahara and Jun Rekimoto. 2015. JackIn Head: An Immersive Human-human Telepresence System. SIGGRAPH Asia 2015 Emerging Technologies, ACM, 14:1--14:3. http://doi.org/10.1145/2818466.2818486

Digital Library

[18]

Shunichi Kasahara and Jun Rekimoto. 2015. JackIn Head: Immersive Visual Telepresence System with Omnidirectional Wearable Camera for Remote Collaboration. Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology, ACM, 217--225. http://doi.org/10.1145/2821592.2821608

Digital Library

[19]

Tadakazu Kashiwabara, Hirotaka Osawa, Kazuhiko Shinozawa, and Michita Imai. 2012. TEROOS: A Wearable Avatar to Enhance Joint Activities. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 2001--2004. http://doi.org/10.1145/2207676.2208345

Digital Library

[20]

Seungwon Kim, Sasa Junuzovic, and Kori Inkpen. 2014. The Nomad and the Couch Potato: Enriching Mobile Shared Experiences with Contextual Information. Proceedings of the 18th International Conference on Supporting Group Work, ACM, 167--177.

Digital Library

[21]

David Kirk and Danae Stanton Fraser. 2006. Comparing Remote Gesture Technologies for Supporting Collaborative Physical Tasks. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 1191--1200. http://doi.org/10.1145/1124772.1124951

Digital Library

[22]

Sven Kratz, Daniel Avrahami, Don Kimber, Jim Vaughan, Patrick Proppe, and Don Severns. 2015. Polly Wanna Show You: Examining ViewpointConveyance Techniques for a Shoulder-Worn Telepresence System. Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2014), Industrial Case Studies, ACM.

Digital Library

[23]

Sven Kratz, Don Kimber, Weiqing Su, Gwen Gordon, and Don Severns. 2014. Polly: Being there through the parrot and a guide. Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services, ACM, 625--630.

Digital Library

[24]

Min Kyung Lee and Leila Takayama. 2011. Now, I have a body: Uses and social norms for mobile remote presence in the workplace. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 33--42.

Digital Library

[25]

Paul Luff, Christian Heath, Hideaki Kuzuoka, Jon Hindmarsh, Keiichi Yamazaki, and Shinya Oyama. 2003. Fractured ecologies: creating environments for collaboration. Human-Computer Interaction 18, 1: 51--84.

Digital Library

[26]

Michael Massimi and Carman Neustaedter. 2014. Moving from talking heads to newlyweds: exploring video chat use during major life events. Proceedings of the 2014 conference on Designing interactive systems, ACM, 43--52.

Digital Library

[27]

Florian 'Floyd' Mueller and Matthew Muirhead. 2015. Jogging with a Quadcopter. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, 2023--2032. http://doi.org/10.1145/2702123.2702472

Digital Library

[28]

Carman Neustaedter and Tejinder K. Judge. 2010. Peek-A-Boo: The Design of a Mobile Family Media Space. Proceedings of the 12th ACM International Conference Adjunct Papers on Ubiquitous Computing - Adjunct, ACM, 449--450. http://doi.org/10.1145/1864431.1864482

Digital Library

[29]

Carman Neustaedter, Gina Venolia, Jason Procyk, and Daniel Hawkins. 2016. To Beam or Not to Beam: A Study of Remote Telepresence Attendance at an Academic Conference. Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, ACM, 418--431. http://doi.org/10.1145/2818048.2819922

Digital Library

[30]

Kenton O'Hara, Alison Black, and Matthew Lipson. 2006. Everyday Practices with Mobile Video Telephony. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 871--880. http://doi.org/10.1145/1124772.1124900

Digital Library

[31]

Oscar Olmos, Christopher D. Wickens, and Andrew Chudy. 2000. Tactical Displays for Combat Awareness: An Examination of Dimensionality and Frame of Reference Concepts and the Application of Cognitive Engineering. The International Journal of Aviation Psychology 10, 3: 247--271. http://doi.org/10.1207/S15327108IJAP1003_03

[32]

Eric Paulos and John Canny. 1998. PRoP: Personal Roving Presence. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM Press/Addison-Wesley Publishing Co., 296--303. http://doi.org/10.1145/274644.274686

Digital Library

[33]

Eric Paulos and John Canny. 2001. Social TeleEmbodiment: Understanding Presence. Autonomous Robots 11, 1: 87--95. http://doi.org/10.1023/A:1011264330469

Digital Library

[34]

Jason Procyk, Carman Neustaedter, Carolyn Pang, Anthony Tang, and Tejinder K. Judge. 2014. Exploring Video Streaming in Public Settings: Shared Geocaching over Distance Using Mobile Video Chat. Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems, ACM, 2163--2172. http://doi.org/10.1145/2556288.2557198

Digital Library

[35]

Irene Rae, Bilge Mutlu, and Leila Takayama. 2014. Bodies in Motion: Mobility, Presence, and Task Awareness in Telepresence. Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems, ACM, 2153--2162. http://doi.org/10.1145/2556288.2557047

Digital Library

[36]

M. Sharma, D. Hildebrandt, G. Newman, J.E. Young, and R. Eskicioglu. 2013. Communicating affect via flight path Exploring use of the Laban Effort System for designing affective locomotion paths. 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 293--300. http://doi.org/10.1109/HRI.2013.6483602

Digital Library

[37]

Daniel Szafir, Bilge Mutlu, and Terrence Fong. 2014. Communication of Intent in Assistive Free Flyers. Proceedings of the 2014 ACM/IEEE International Conference on Human-robot Interaction, ACM, 358--365. http://doi.org/10.1145/2559636.2559672

Digital Library

[38]

Daniel Szafir, Bilge Mutlu, and Terry Fong. 2015. Communicating Directionality in Flying Robots. Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction, ACM, 19--26. http://doi.org/10.1145/2696454.2696475

Digital Library

[39]

Lisa C. Thomas and Christopher D. Wickens. 2000. Effects of Display Frames of Reference on Spatial Judgments and Change Detection.

[40]

Lisa C. Thomas and Christopher D. Wickens. 2001. Visual Displays and Cognitive Tunneling: Frames of Reference Effects on Spatial Judgments and Change Detection. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 45, 4: 336--340. http://doi.org/10.1177/154193120104500415

[41]

Tzung-Cheng Tsai, Yeh-Liang Hsu, An-I. Ma, Trevor King, and Chang-Huei Wu. 2007. Developing a Telepresence Robot for Interpersonal Communication with the Elderly in a Home Environment. Telemedicine and e-Health 13, 4: 407--424. http://doi.org/10.1089/tmj.2006.0068

[42]

Gina Venolia, John Tang, Ruy Cervantes, et al. 2010. Embodied Social Proxy: Mediating Interpersonal Connection in Hub-and-satellite Teams. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 1049--1058. http://doi.org/10.1145/1753326.1753482

Digital Library

[43]

Lily - The Camera That Follows You. Retrieved September 23, 2015 from https://www.lily.camera/

[44]

Virtual Photo Walks, using Video conferencing tools to help people be interactive citizens again. - Home. Retrieved September 23, 2015 from http://www.virtualphotowalks.org/

[45]

Periscope. Periscope. Retrieved January 11, 2016 from https://www.periscope.tv

Cited By

Samaddar SPetrie H(2024)GUFO: Three studies in the initial development of an assistive drone for older people living independentlyProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685409(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685409
Hu YStegner LKotturi YZhang CPeng YHuq FZhao YBigham JMutlu B(2024)"This really lets us see the entire world:" Designing a conversational telepresence robot for homebound older adultsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660710(2450-2467)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660710
Dash PAxtell BGeiskkovitch DNeustaedter CStuerzlinger W(2024)Multimedia-Enabled 911: Exploring 911 Callers’ Experience of Call Taker Controlled Video Calling in Simulated EmergenciesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3643055(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3643055
Show More Cited By

Index Terms

Elevating Communication, Collaboration, and Shared Experiences in Mobile Video through Drones
1. Human-centered computing

Recommendations

Designing Telepresence Drones to Support Synchronous, Mid-air Remote Collaboration: An Exploratory Study
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Drones are increasingly used to support humanitarian crises and events that involve dangerous or costly tasks. While drones have great potential for remote collaborative work and aerial telepresence, existing drone technology is limited in its support ...
Mechanics of Camera Work in Mobile Video Collaboration
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Mobile video conferencing, where one or more participants are moving about in the real world, enables entirely new interaction scenarios (e.g., asking for help to construct or repair an object, or showing a physical location). While we have a good ...
Collaboard: a remote collaboration groupware device featuring an embodiment-enriched shared workspace
GROUP '10: Proceedings of the 2010 ACM International Conference on Supporting Group Work

In this paper we present a mixed presence groupware device called "CollaBoard". The device improves collaboration between co-located and remote partners by providing a high level of workspace awareness. This is achieved by superimposing a life-size ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '16: Proceedings of the 2016 ACM Conference on Designing Interactive Systems

June 2016

1374 pages

ISBN:9781450340311

DOI:10.1145/2901790

General Chair:
Marcus Foth
Queensland University of Technology
,
Program Chairs:
Wendy Ju
Stanford University
,
Ronald Schroeter
Queensland University of Technology
,
Stephen Viller
University of Queensland

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 June 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

DIS '16

Sponsor:

SIGCHI

DIS '16: Designing Interactive Systems Conference 2016

June 4 - 8, 2016

QLD, Brisbane, Australia

Acceptance Rates

DIS '16 Paper Acceptance Rate 107 of 418 submissions, 26%;

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

39
Total Citations
View Citations
667
Total Downloads

Downloads (Last 12 months)39
Downloads (Last 6 weeks)6

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Samaddar SPetrie H(2024)GUFO: Three studies in the initial development of an assistive drone for older people living independentlyProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685409(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685409
Hu YStegner LKotturi YZhang CPeng YHuq FZhao YBigham JMutlu B(2024)"This really lets us see the entire world:" Designing a conversational telepresence robot for homebound older adultsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660710(2450-2467)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660710
Dash PAxtell BGeiskkovitch DNeustaedter CStuerzlinger W(2024)Multimedia-Enabled 911: Exploring 911 Callers’ Experience of Call Taker Controlled Video Calling in Simulated EmergenciesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3643055(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3643055
Held THeld T(2024)State of the ArtEinblick: Videotelefonie und Design10.1007/978-3-658-44585-0_2(31-253)Online publication date: 29-May-2024
https://doi.org/10.1007/978-3-658-44585-0_2
Xu SWu LLiao WFujimura S(2024)Enhancing Remote Collaboration Through Drone-Driven Agent and Mixed RealityVirtual, Augmented and Mixed Reality10.1007/978-3-031-61044-8_9(116-127)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-61044-8_9
Helmert RHardes TYigitbas E(2023)Design and Evaluation of an AR Voice-based Indoor UAV Assistant for Smart Home ScenariosProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614522(1-11)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614522
Inoue MTakashima KFujita KKitamura Y(2023)BirdViewAR: Surroundings-aware Remote Drone Piloting Using an Augmented Third-person PerspectiveProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580681(1-19)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580681
Yan YLiu HShi YWang JGuo RLi ZXu XYu CWang YShi Y(2023)ConeSpeech: Exploring Directional Speech Interaction for Multi-Person Remote Communication in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324708529:5(2647-2657)Online publication date: 1-May-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3247085
Dash PNeustaedter CJones BYip C(2022)The Design and Evaluation of Emergency Call Taking User Interfaces for Next Generation 9-1-1Frontiers in Human Dynamics10.3389/fhumd.2022.6706474Online publication date: 16-Feb-2022
https://doi.org/10.3389/fhumd.2022.670647
Jones BTang ANeustaedter C(2022)RescueCASTR: Exploring Photos and Live Streaming to Support Contextual Awareness in the Wilderness Search and Rescue Command PostProceedings of the ACM on Human-Computer Interaction10.1145/35129606:CSCW1(1-32)Online publication date: 7-Apr-2022
https://dl.acm.org/doi/10.1145/3512960
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents