Exploring Augmented Reality Interface Designs for Virtual Meetings in Real-world Walking Contexts
Authors: 
Chiao-Ju Chang, Yu Lun Hsu, Wei Tian Mireille Tan, Yu-Cheng Chang, Pin Chun Lu, Yu Chen, Yi-Han Wang, 
Mike Y. ChenAuthors Info & Claims
Pages 391 - 408
Abstract
Research has shown that walking during meetings improves creativity, memory, attention, health, and happiness. While mobile technologies have freed users from having to be stationary during virtual meetings, mobile phones pose several usability challenges, such as reduced productivity due to small screens and safety concerns. In this paper, we present the first exploration of augmented reality (AR) interface design for virtual meetings in real-world walking conditions. We conducted design sessions in-situ with 16 user interface and AR designers using a 2x2 experimental design: meeting while walking in two levels of traffic conditions and with two types of meeting formats. Results show that the designed AR windows averaged 14.5 times in viewing size compared to the most popular smartphone screens. Also, Traffic Level significantly affected the size, opacity, and placement of windows, as well as the preference of anchoring modes, while Meeting Format significantly affected size and opacity. Furthermore, clustering analysis identified two groups of designs that can serve as initial reference designs for further customization and research.
References
[1]
Aino Ahtinen, Eeva Andrejeff, and Kaisa Väänänen. 2016. Brainwolk: A Mobile Technology Mediated Walking Meeting Concept for Wellbeing and Creativity at Work. In Proceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia (Rovaniemi, Finland) (MUM ’16). Association for Computing Machinery, New York, NY, USA, 307–309. https://doi.org/10.1145/3012709.3016062
[2]
Aino Ahtinen, Eeva Andrejeff, Maiju Vuolle, and Kaisa Väänänen. 2016. Walk as You Work: User Study and Design Implications for Mobile Walking Meetings. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (Gothenburg, Sweden) (NordiCHI ’16). Association for Computing Machinery, New York, NY, USA, Article 72, 10 pages. https://doi.org/10.1145/2971485.2971510
[3]
apple. 2023. Principles of spatial design. apple. https://developer.apple.com/videos/play/wwdc2023/10072/?time=449Accessed: 2023-09-07.
[4]
Andrew A. Bennett, Emily D. Campion, Kathleen R. Keeler, and Sheila K. Keener. 2021. Videoconference fatigue? Exploring changes in fatigue after videoconference meetings during COVID-19.Journal of Applied Psychology 106, 3 (March 2021), 330–344. https://doi.org/10.1037/apl0000906
[5]
Jens Bergqvist, Per Dahlberg, Fredrik Ljungberg, and Steinar Kristoffersen. 2002. Moving Out of the Meeting Room. Springer Netherlands, Dordrecht, 81–98. https://doi.org/10.1007/0-306-47316-X_5
[6]
Olivier Borg, Remy Casanova, and Reinoud J. Bootsma. 2015. Reading from a Head-Fixed Display during Walking: Adverse Effects of Gaze Stabilization Mechanisms. PLOS ONE 10, 6 (June 2015), e0129902. https://doi.org/10.1371/journal.pone.0129902
[7]
Anna Bornioli. 2022. The walking meeting: opportunities for better health and sustainability in post-COVID-19 cities. Cities & Health 7, 4 (March 2022), 556–562. https://doi.org/10.1080/23748834.2022.2050103
[8]
Rory Brown. 2023. Meta Quest 3: Full Specification - VRcompare. https://vr-compare.com/headset/metaquest3. (Accessed on 02/06/2024).
[9]
John P Buckley, Alan Hedge, Thomas Yates, Robert J Copeland, Michael Loosemore, Mark Hamer, Gavin Bradley, and David W Dunstan. 2015. The sedentary office: an expert statement on the growing case for change towards better health and productivity. British Journal of Sports Medicine 49, 21 (June 2015), 1357–1362. https://doi.org/10.1136/bjsports-2015-094618
[10]
Canoopsy. 2024. (i wore Apple Vision Pro for 24 hours - YouTube. https://www.youtube.com/watch?v=JJ4R0yJ9-vg. (Accessed on 02/06/2024).
[11]
Cindy L. Carmack, Carl de Moor, Edwin Boudreaux, Marta Amaral-Melendez, and Phillip J. Brantley. 1999. Aerobic fitness and leisure physical activity as moderators of the stress-illness relation. Annals of Behavioral Medicine 21, 3 (Sept. 1999), 251–257. https://doi.org/10.1007/bf02884842
[12]
Josephine Y. Chau, Hidde P. van der Ploeg, Jannique G.Z. van Uffelen, Jason Wong, Ingrid Riphagen, Genevieve N. Healy, Nicholas D. Gilson, David W. Dunstan, Adrian E. Bauman, Neville Owen, and Wendy J. Brown. 2010. Are workplace interventions to reduce sitting effective? A systematic review. Preventive Medicine 51, 5 (Nov. 2010), 352–356. https://doi.org/10.1016/j.ypmed.2010.08.012
[13]
Lung-Pan Cheng, Eyal Ofek, Christian Holz, and Andrew D. Wilson. 2019. VRoamer: Generating On-The-Fly VR Experiences While Walking inside Large, Unknown Real-World Building Environments. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, New York, USA, 359–366. https://doi.org/10.1109/VR.2019.8798074
[14]
Stacy A. Clemes, Sophie E. O'Connell, and Charlotte L. Edwardson. 2014. Office Workers' Objectively Measured Sedentary Behavior and Physical Activity During and Outside Working Hours. Journal of Occupational and Environmental Medicine 56, 3 (March 2014), 298–303. https://doi.org/10.1097/jom.0000000000000101
[15]
Ida Damen, Anika Kok, Bas Vink, Hans Brombacher, Steven Vos, and Carine Lallemand. 2020. The Hub. In Companion Publication of the 2020 ACM Designing Interactive Systems Conference. ACM, New York, NY, USA, 19–24. https://doi.org/10.1145/3393914.3395876
[16]
Ida Damen, Carine Lallemand, Rens Brankaert, Aarnout Brombacher, Pieter van Wesemael, and Steven Vos. 2020. Understanding Walking Meetings: Drivers and Barriers. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376141
[17]
Brian Dean. 2023. Zoom User Stats: How Many People Use Zoom in 2023?https://backlinko.com/zoom-users [Accessed 12-09-2023].
[18]
Paddy C. Dempsey, Neville Owen, Stuart J. H. Biddle, and David W. Dunstan. 2014. Managing Sedentary Behavior to Reduce the Risk of Diabetes and Cardiovascular Disease. Current Diabetes Reports 14, 9 (July 2014), 522–533. https://doi.org/10.1007/s11892-014-0522-0
[19]
Brian Lystgaard Due. 2014. The future of smart glasses:: An essay about challenges and possibilities with smart glasses. Working papers on interaction and communication 1, 2 (Nov. 2014), 1–21.
[20]
Microsoft Teams for Education. 2023. View and organize class teams in Microsoft Teams for Education. Microsoft. https://support.microsoft.com/en-us/topic/view-and-organize-class-teams-in-microsoft-teams-for-education-b9dd0d8c-243a-43a4-9501-ec8017fec32e
[21]
Shogo Fukushima, Takeo Hamada, and Ari Hautasaari. 2020. Comparing World and Screen Coordinate Systems in Optical See-Through Head-Mounted Displays for Text Readability while Walking. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, New York, USA, 649–658. https://doi.org/10.1109/ISMAR50242.2020.00093
[22]
Shogo Fukushima, Takeo Hamada, and Ari Hautasaari. 2020. Comparing World and Screen Coordinate Systems in Optical See-Through Head-Mounted Displays for Text Readability while Walking. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, New York, USA, 649–658. https://doi.org/10.1109/ISMAR50242.2020.00093
[23]
Google. 2023. Google Meet training and help. Google. https://support.google.com/a/users/answer/9282720?hl=en&ref_topic=7306097&sjid=3088227985042756589-AP&visit_id=638303749495047666-3810269039&rd=1Accessed: 2023-09-15.
[24]
Google. 2023. Learn about the Meet layout for your computer. Google. https://support.google.com/meet/answer/10550593?hl=en
[25]
Chiara Gruden, Irena Ištoka Otković, and Matjaž Šraml. 2021. Safety Analysis of Young Pedestrian Behavior at Signalized Intersections: An Eye-Tracking Study. Sustainability 13, 8 (2021), 16 pages. https://doi.org/10.3390/su13084419
[26]
Luke Haliburton, Natalia Bartłomiejczyk, Albrecht Schmidt, Paweł W. Woźniak, and Jasmin Niess. 2023. The Walking Talking Stick: Understanding Automated Note-Taking in Walking Meetings. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 431, 16 pages. https://doi.org/10.1145/3544548.3580986
[27]
Luke Haliburton, Pawel W. Wozniak, Albrecht Schmidt, and Jasmin Niess. 2021. Charting the Path: Requirements and Constraints for Technology-Supported Walking Meetings. Proc. ACM Hum.-Comput. Interact. 5, CSCW2, Article 347 (oct 2021), 31 pages. https://doi.org/10.1145/3476088
[28]
Luke Haliburton, Pawel W. Wozniak, Albrecht Schmidt, and Jasmin Niess. 2021. Charting the Path: Requirements and Constraints for Technology-Supported Walking Meetings. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (Oct. 2021), 1–31. https://doi.org/10.1145/3476088
[29]
Rhonda Hughes. 2022. Here’s how you zoomed over the past year. https://blog.zoom.us/how-you-zoomed-over-the-past-year-2021/
[30]
Apple Inc.2023. Introducing Apple Vision Pro: Apple’s first spatial computer - Apple. https://www.apple.com/newsroom/2023/06/introducing-apple-vision-pro/. (Accessed on 02/06/2024).
[31]
Apple Inc.2024. iPhone 15 Pro and 15 Pro Max - Technical Specifications - Apple. https://www.apple.com/iphone-15-pro/specs/. (Accessed on 02/05/2024).
[32]
Apple Inc.2024. What is Screen Distance? - Apple Support. https://support.apple.com/en-us/105007. (Accessed on 02/06/2024).
[33]
Emil Ivov. 2023. Jitsi Meet. https://meet.jit.si/
[34]
The Wall Street Journal. 2024. I Spent 24 Hours Wearing Apple’s Vision Pro Headset | WSJ - YouTube. https://www.youtube.com/watch?v=8xI10SFgzQ8. (Accessed on 02/06/2024).
[35]
Maulik P. K.2017. Workplace stress: A neglected aspect of mental health wellbeing.The Indian journal of medical research 146 (2017), 441––444.
[36]
Ki Joon Kim and S. Shyam Sundar. 2014. Does Screen Size Matter for Smartphones? Utilitarian and Hedonic Effects of Screen Size on Smartphone Adoption. Cyberpsychology, Behavior, and Social Networking 17, 7 (July 2014), 466–473. https://doi.org/10.1089/cyber.2013.0492
[37]
Elisa Maria Klose, Nils Adrian Mack, Jens Hegenberg, and Ludger Schmidt. 2019. Text Presentation for Augmented Reality Applications in Dual-Task Situations. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, New York, USA, 636–644. https://doi.org/10.1109/VR.2019.8797992
[38]
Pin-Sung Ku, Yu-Chih Lin, Yi-Hao Peng, and Mike Y. Chen. 2019. PeriText: Utilizing Peripheral Vision for Reading Text on Augmented Reality Smart Glasses. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, New York, USA, 630–635. https://doi.org/10.1109/vr.2019.8798065
[39]
Stringer L.2017. Ten Bad Habits that Should Be Banned from the Workplace Forever.The Journal of medical practice management 32 (2017), 288––291.
[40]
Élise Labonté-LeMoyne, Radhika Santhanam, Pierre-Majorique Léger, François Courtemanche, Marc Fredette, and Sylvain Sénécal. 2015. The delayed effect of treadmill desk usage on recall and attention. Computers in Human Behavior 46 (May 2015), 1–5. https://doi.org/10.1016/j.chb.2014.12.054
[41]
Wallace S. Lages and Doug A. Bowman. 2019. Walking with Adaptive Augmented Reality Workspaces: Design and Usage Patterns. In Proceedings of the 24th International Conference on Intelligent User Interfaces (Marina del Ray, California) (IUI ’19). Association for Computing Machinery, New York, NY, USA, 356–366. https://doi.org/10.1145/3301275.3302278
[42]
Hyunjin Lee, Sunyoung Bang, and Woontack Woo. 2022. Effects of coordinate system and position of AR notification while walking. Virtual Reality 27, 2 (Sept. 2022), 829–848. https://doi.org/10.1007/s10055-022-00693-9
[43]
Andrés Lucero and Akos Vetek. 2014. NotifEye: Using Interactive Glasses to Deal with Notifications While Walking in Public. In Proceedings of the 11th Conference on Advances in Computer Entertainment Technology (Funchal, Portugal) (ACE ’14). Association for Computing Machinery, New York, NY, USA, Article 17, 10 pages. https://doi.org/10.1145/2663806.2663824
[44]
Microsoft. 2021. Comfort - Mixed Reality | Microsoft Learn. https://learn.microsoft.com/en-us/windows/mixed-reality/design/comfort. (Accessed on 02/04/2024).
[45]
Microsoft. 2023. Microsoft Mesh overview. Microsoft. https://learn.microsoft.com/en-us/mesh/overviewAccessed: 2023-09-13.
[46]
Florian Müller, Martin Schmitz, Daniel Schmitt, Sebastian Günther, Markus Funk, and Max Mühlhäuser. 2020. Walk The Line: Leveraging Lateral Shifts of the Walking Path as an Input Modality for Head-Mounted Displays. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3313831.3376852
[47]
Marily Oppezzo and Daniel L. Schwartz. 2014. Give your ideas some legs: The positive effect of walking on creative thinking.Journal of Experimental Psychology: Learning, Memory, and Cognition 40, 4 (2014), 1142–1152. https://doi.org/10.1037/a0036577
[48]
Marily Oppezzo and Daniel L. Schwartz. 2014. Give your ideas some legs: The positive effect of walking on creative thinking.Journal of Experimental Psychology: Learning, Memory, and Cognition 40, 4 (2014), 1142–1152. https://doi.org/10.1037/a0036577
[49]
Neville Owen, Jo Salmon, Mohammad Javad Koohsari, Gavin Turrell, and Billie Giles-Corti. 2014. Sedentary behaviour and health: mapping environmental and social contexts to underpin chronic disease prevention. British Journal of Sports Medicine 48, 3 (Jan. 2014), 174–177. https://doi.org/10.1136/bjsports-2013-093107
[50]
Eunil Park, Jinyoung Han, Ki Joon Kim, Yongwoo Cho, and Angel P. del Pobil. 2018. Effects of Screen Size in Mobile Learning Over Time. In Proceedings of the 12th International Conference on Ubiquitous Information Management and Communication (Langkawi, Malaysia) (IMCOM ’18). Association for Computing Machinery, New York, NY, USA, Article 16, 5 pages. https://doi.org/10.1145/3164541.3164625
[51]
F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12 (2011), 2825–2830.
[52]
Ashwin Ram and Shengdong Zhao. 2021. LSVP: Towards Effective On-the-go Video Learning Using Optical Head-Mounted Displays. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 1, Article 30 (mar 2021), 27 pages. https://doi.org/10.1145/3448118
[53]
Ashwin Ram and Shengdong Zhao. 2022. Does Dynamically Drawn Text Improve Learning? Investigating the Effect of Text Presentation Styles in Video Learning. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (, New Orleans, LA, USA,) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 89, 12 pages. https://doi.org/10.1145/3491102.3517499
[54]
Remio. 2023. Remiovr. Remio. https://www.remiovr.com/Accessed: 2023-09-13.
[55]
Rufat Rzayev, Paweł W. Woźniak, Tilman Dingler, and Niels Henze. 2018. Reading on Smart Glasses: The Effect of Text Position, Presentation Type and Walking. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (, Montreal QC, Canada, ) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3173574.3173619
[56]
Marc Satkowski, Rufat Rzayev, Eva Goebel, and Raimund Dachselt. 2022. ABOVE & BELOW: Investigating Ceiling and Floor for Augmented Reality Content Placement. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, USA, 518–527. https://doi.org/10.1109/ISMAR55827.2022.00068
[57]
Siobhan M. Schabrun, Wolbert van den Hoorn, Alison Moorcroft, Cameron Greenland, and Paul W. Hodges. 2014. Texting and Walking: Strategies for Postural Control and Implications for Safety. PLoS ONE 9, 1 (Jan. 2014), e84312. https://doi.org/10.1371/journal.pone.0084312
[58]
UFD Tech. 2024. Can You Use the Apple Vision Pro While Walking? - YouTube. https://www.youtube.com/shorts/sbA1Z83dXb4 (Accessed on 02/06/2024).
[59]
Nicholas Thomas, James Gardiner, Robin Crompton, and Rebecca Lawson. 2020. Look out: an exploratory study assessing how gaze (eye angle and head angle) and gait speed are influenced by surface complexity. PeerJ 8 (04 2020), 8838. https://doi.org/10.7717/peerj.8838
[60]
Leah L Thompson, Frederick P Rivara, Rajiv C Ayyagari, and Beth E Ebel. 2012. Impact of social and technological distraction on pedestrian crossing behaviour: an observational study. Injury Prevention 19, 4 (Dec. 2012), 232–237. https://doi.org/10.1136/injuryprev-2012-040601
[61]
Vuplex. 2023. 3D WebView for Android (Web Browser). https://assetstore.unity.com/packages/tools/gui/3d-webview-for-android-web-browser-137030
[62]
Vuplex. 2023. 3D WebView for Windows and macOS (Web Browser). https://assetstore.unity.com/packages/tools/gui/3d-webview-for-windows-and-macos-web-browser-154144
[63]
F. Wang, H. M. Orpana, H. Morrison, M. de Groh, S. Dai, and W. Luo. 2012. Long-term Association Between Leisure-time Physical Activity and Changes in Happiness: Analysis of the Prospective National Population Health Survey. American Journal of Epidemiology 176, 12 (Nov. 2012), 1095–1100. https://doi.org/10.1093/aje/kws199
[64]
Horizon Workrooms. 2023. Meta Horizon Workrooms. Horizon Workrooms. https://forwork.meta.com/tw/en/horizon-workrooms/Accessed: 2023-09-13.
[65]
Jackie (Junrui) Yang, Christian Holz, Eyal Ofek, and Andrew D. Wilson. 2019. DreamWalker: Substituting Real-World Walking Experiences with a Virtual Reality. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 1093–1107. https://doi.org/10.1145/3332165.3347875
[66]
Chen Zhou, Katherine Fennedy, Felicia Fang-Yi Tan, Shengdong Zhao, and Yurui Shao. 2023. Not All Spacings are Created Equal: The Effect of Text Spacings in On-the-go Reading Using Optical See-Through Head-Mounted Displays. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (, Hamburg, Germany,) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 720, 19 pages. https://doi.org/10.1145/3544548.3581430
[67]
Zoom. 2023. Adjusting your video layout during a virtual meeting. Zoom. https://support.zoom.us/hc/en-us/articles/201362323-Adjusting-your-video-layout-during-a-virtual-meetingAccessed: 2023-09-13.
Index Terms
- Exploring Augmented Reality Interface Designs for Virtual Meetings in Real-world Walking Contexts
Recommendations
Mixed reality in virtual world teleconferencing
VR '10: Proceedings of the 2010 IEEE Virtual Reality ConferenceIn this paper we present a Mixed Reality (MR) teleconferencing application based on Second Life (SL) and the OpenSim virtual world. Augmented Reality (AR) techniques are used for displaying virtual avatars of remote meeting participants in real physical ...
Extending Virtual Reality Display Wall Environments Using Augmented Reality
SUI '19: Symposium on Spatial User InteractionTwo major form factors for virtual reality are head-mounted displays and large display environments such as CAVE®and the LCD-based successor CAVE2®. Each of these has distinct advantages and limitations based on how they’re used. This work explores ...
Collaborative Augmented Reality: Multi-user Interaction in Urban Simulation
IVIC '09: Proceedings of the 1st International Visual Informatics Conference on Visual Informatics: Bridging Research and PracticeAugmented reality (AR) environment allows user or multi-user to interact with 2D and 3D data. AR simply can provide a collaborative interactive AR environment for urban simulation, where users can interact naturally and intuitively. AR collaboration ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
July 2024
3616 pages
ISBN:9798400705830
DOI:10.1145/3643834
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 01 July 2024
Check for updates
Badges
Honorable Mention
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
DIS '24
Sponsor:
Acceptance Rates
Overall Acceptance Rate 1,158 of 4,684 submissions, 25%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 289Total Downloads
- Downloads (Last 12 months)289
- Downloads (Last 6 weeks)51
Reflects downloads up to 16 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format