research-article

SelectVisAR: Selective Visualisation of Virtual Environments in Augmented Reality

Authors:

Adalberto L. SimeoneAuthors Info & Claims

DIS '21: Proceedings of the 2021 ACM Designing Interactive Systems Conference

Pages 275 - 282

https://doi.org/10.1145/3461778.3462096

Published: 28 June 2021 Publication History

Abstract

When establishing a visual connection between a virtual reality user and an augmented reality user, it is important to consider whether the augmented reality user faces a surplus of information. Augmented reality, compared to virtual reality, involves two – not one – planes of information: the physical and the virtual. We propose SelectVisAR, a selective visualisation system of virtual environments in augmented reality. Our system enables an augmented reality spectator to perceive a co-located virtual reality user in the context of four distinct visualisation conditions: Interactive, Proximity, Everything, and Dollhouse. We explore an additional two conditions, Context and Spotlight, in a follow-up study. Our design uses a human-centric approach to information filtering, selectively visualising only parts of the virtual environment related to the interactive possibilities of a virtual reality user. The research investigates how selective visualisations can be helpful or trivial for the augmented reality user when observing a virtual reality user.

References

[1]

Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (1 2006), 77–101. https://doi.org/10.1191/1478088706qp063oa

[2]

Jeronimo Gustavo Grandi, Henrique Galvan Debarba, and Anderson Maciel. 2019. Characterizing asymmetric collaborative interactions in virtual and augmented realities. In 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 127–135. https://doi.org/10.1109/VR.2019.8798080

[3]

Jens Grubert, Tobias Langlotz, Stefanie Zollmann, and Holger Regenbrecht. 2017. Towards Pervasive Augmented Reality: Context-Awareness in Augmented Reality. IEEE Transactions on Visualization and Computer Graphics 23, 6 (6 2017). https://doi.org/10.1109/TVCG.2016.2543720

Digital Library

[4]

Jan Gugenheimer, Evgeny Stemasov, Julian Frommel, and Enrico Rukzio. 2017. ShareVR: Enabling co-located experiences for virtual reality between HMD and Non-HMD users. In Conference on Human Factors in Computing Systems - Proceedings, Vol. 2017-May. Association for Computing Machinery, 4021–4033. https://doi.org/10.1145/3025453.3025683

Digital Library

[5]

Jan Gugenheimer, Evgeny Stemasov, Harpreet Sareen, and Enrico Rukzio. 2018. FaceDisplay: Towards asymmetric multi-user interaction for nomadic virtual reality. In Conference on Human Factors in Computing Systems - Proceedings, Vol. 2018-April. Association for Computing Machinery, New York, New York, USA, 1–13. https://doi.org/10.1145/3173574.3173628

Digital Library

[6]

Jihae Han, Robbe Cools, and Adalberto L Simeone. 2020. The Body in Cross-Reality: A Framework for Selective Augmented Reality Visualisation of Virtual Objects. Proceedings of the International Workshop on Cross-Reality (XR) Interaction (2020).

[7]

Hikaru Ibayashi, Yuta Sugiura, Daisuke Sakamoto, Natsuki Miyata, Mitsunori Tada, Takashi Okuma, Takeshi Kurata, Masaaki Mochimaru, and Takeo Igarashi. 2015. Dollhouse VR: A multi-view, multi-user collaborative design workspace with VR technology. In SIGGRAPH Asia 2015 Emerging Technologies, SA 2015. Association for Computing Machinery, Inc, New York, New York, USA, 1–2. https://doi.org/10.1145/2818466.2818480

Digital Library

[8]

Akira Ishii, Masaya Tsuruta, Ippei Suzuki, Shuta Nakamae, Junichi Suzuki, and Yoichi Ochiai. 2019. Let Your World Open: CAVE-based Visualization Methods of Public Virtual Reality towards a Shareable VR Experience. In Proceedings of the 10th Augmented Human International Conference 2019 on - AH2019. ACM Press, New York, New York, USA. https://doi.org/10.1145/3311823.3311860

Digital Library

[9]

S. Julier, Y. Baillot, D. Brown, and M. Lanzagorta. 2002. Information filtering for mobile augmented reality. IEEE Computer Graphics and Applications 22, 5 (9 2002). https://doi.org/10.1109/MCG.2002.1028721

Digital Library

[10]

Robert S. Kennedy, Norman E. Lane, Kevin S. Berbaum, and Michael G. Lilienthal. 1993. Simulator Sickness Questionnaire: An Enhanced Method for Quantifying Simulator Sickness. The International Journal of Aviation Psychology 3, 3 (7 1993), 203–220. https://doi.org/10.1207/s15327108ijap0303_3

[11]

Andrey Krekhov, Daniel Preuß, Sebastian Cmentowski, and Jens Krüger. 2020. Silhouette Games: An Interactive One-Way Mirror Approach to Watching Players in VR. Proceedings of the Annual Symposium on Computer-Human Interaction in Play (8 2020), 561–571. https://doi.org/10.1145/3410404.3414247

Digital Library

[12]

Balasaravanan Thoravi Kumaravel, Cuong Nguyen, Stephen Diverdi, and Björn Hartmann. 2020. TransceiVR: Bridging Asymmetrical Communication Between VR Users and External Collaborators. (2020). https://doi.org/10.1145/3379337.3415827

Digital Library

[13]

Paul Milgram, Haruo Takemura, Akira Utsumi, and Fumio Kishino. 1995. Augmented reality: a class of displays on the reality-virtuality continuum. In Telemanipulator and Telepresence Technologies, Vol. 2351. 282–292. https://doi.org/10.1117/12.197321

[14]

Randy Pausch, Tommy Burnette, Dan Brockway, and Michael E. Weiblen. 1995. Navigation and locomotion in virtual worlds via flight into hand-held miniatures. In Proceedings of the ACM SIGGRAPH Conference on Computer Graphics. ACM, New York, New York, USA, 399–400. https://doi.org/10.1145/218380.218495

Digital Library

[15]

Tran Pham, Jo Vermeulen, Anthony Tang, and Lindsay Mac Donald Vermeulen. 2018. Scale impacts elicited gestures for manipulating holograms: Implications for AR gesture design. In DIS 2018 - Proceedings of the 2018 Designing Interactive Systems Conference. Association for Computing Machinery, Inc, New York, NY, USA, 227–240. https://doi.org/10.1145/3196709.3196719

Digital Library

[16]

Richard Skarbez, Missie Smith, and Mary C. Whitton. 2021. Revisiting Milgram and Kishino’s Reality-Virtuality Continuum. Frontiers in Virtual Reality 2 (3 2021), 647997. https://doi.org/10.3389/frvir.2021.647997

[17]

Yuta Sugiura, Hikaru Ibayashi, Toby Chong, Daisuke Sakamoto, Natsuki Miyata, Mitsunori Tada, Takashi Okuma, Takeshi Kurata, Takashi Shinmura, Masaaki Mochimaru, and Takeo Igarashi. 2018. An asymmetric collaborative system for architectural-scale space design. In Proceedings of the 16th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry. ACM, New York, NY, USA. https://doi.org/10.1145/3284398.3284416

Digital Library

[18]

Santawat Thanyadit, Parinya Punpongsanon, and Ting Chuen Pong. 2019. ObserVAR: Visualization system for observing virtual reality users using augmented reality. In Proceedings - 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2019. Institute of Electrical and Electronics Engineers Inc., 258–268. https://doi.org/10.1109/ISMAR.2019.00023

[19]

Martin Usoh, Ernest Catena, Sima Arman, and Mel Slater. 2000. Using presence questionnaires in reality. Presence: Teleoperators and Virtual Environments 9, 5(2000), 497–503. https://doi.org/10.1162/105474600566989

Digital Library

[20]

Chiu Hsuan Wang, Chia En Tsai, Seraphina Yong, and Liwei Chan. 2020. Slice of light: Transparent and integrative transition among realities in a multi-HMD-user environment. In UIST 2020 - Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, Inc, New York, NY, USA, 805–817. https://doi.org/10.1145/3379337.3415868

Digital Library

[21]

Chiu-Hsuan Wang, Seraphina Yong, Hsin-Yu Chen, Yuan-Syun Ye, and Liwei Chan. 2020. HMD Light: Sharing In-VR Experience via Head-Mounted Projector for Asymmetric Interaction. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 472–486. https://doi.org/10.1145/3379337.3415847

Digital Library

[22]

Susan C. Weller. 2005. Cultural Consensus Model. In Encyclopedia of Social Measurement. Elsevier. https://doi.org/10.1016/B0-12-369398-5/00410-2

[23]

Haijun Xia, Sebastian Herscher, Ken Perlin, and Daniel Wigdor. 2018. SpaceTime: Enabling fluid individual and collaborative editing in virtual reality. In UIST 2018. Association for Computing Machinery, Inc, New York, New York, USA, 853–866. https://doi.org/10.1145/3242587.3242597

Digital Library

Cited By

Cools RVenema REsteves ASimeone A(2024)The Impact of Near-Future Mixed Reality Contact Lenses on Users' Lives via an Immersive Speculative Enactment and Focus GroupsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682099(1-13)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682099
Wang QXie Z(2023)ARIAS: An AR-based interactive advertising systemPLOS ONE10.1371/journal.pone.028583818:9(e0285838)Online publication date: 29-Sep-2023
https://doi.org/10.1371/journal.pone.0285838
Van Delm NCools RSimeone A(2023)Investigating the Effect of Material and Shape Abstraction on Object Recognition for Private Objects in Augmented Reality EnvironmentsProceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia10.1145/3626705.3631784(486-488)Online publication date: 3-Dec-2023
https://dl.acm.org/doi/10.1145/3626705.3631784
Show More Cited By

Recommendations

Extending Virtual Reality Display Wall Environments Using Augmented Reality
SUI '19: Symposium on Spatial User Interaction

Two major form factors for virtual reality are head-mounted displays and large display environments such as CAVE®and the LCD-based successor CAVE2®. Each of these has distinct advantages and limitations based on how they’re used. This work explores ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2

An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Speed reading on virtual reality and augmented reality
Abstract
Many virtual reality (VR) and augmented reality (AR) applications in education require speed reading. The current study aimed to explore whether the reading performance on VR and AR is different from that on traditional desktop display,...
Highlights
- We explored performance of speed reading on virtual and augmented reality.
- ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '21: Proceedings of the 2021 ACM Designing Interactive Systems Conference

June 2021

2082 pages

ISBN:9781450384766

DOI:10.1145/3461778

Editors:
Wendy Ju
Jacobs Technion-Cornell Institute at Cornell Tech
,
Lora Oehlberg
University of Calgary
,
Sean Follmer
Stanford University
,
Sarah Fox
Carnegie Mellon University
,
Stacey Kuznetsov
Arizona State University

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 June 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Interne Fondsen KU Leuven / Internal Funds KU Leuven

Conference

DIS '21

Sponsor:

SIGCHI

DIS '21: Designing Interactive Systems Conference 2021

June 28 - July 2, 2021

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
591
Total Downloads

Downloads (Last 12 months)121
Downloads (Last 6 weeks)12

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Cools RVenema REsteves ASimeone A(2024)The Impact of Near-Future Mixed Reality Contact Lenses on Users' Lives via an Immersive Speculative Enactment and Focus GroupsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682099(1-13)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682099
Wang QXie Z(2023)ARIAS: An AR-based interactive advertising systemPLOS ONE10.1371/journal.pone.028583818:9(e0285838)Online publication date: 29-Sep-2023
https://doi.org/10.1371/journal.pone.0285838
Van Delm NCools RSimeone A(2023)Investigating the Effect of Material and Shape Abstraction on Object Recognition for Private Objects in Augmented Reality EnvironmentsProceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia10.1145/3626705.3631784(486-488)Online publication date: 3-Dec-2023
https://dl.acm.org/doi/10.1145/3626705.3631784
Cools RZhang XSimeone A(2023)CReST: Design and Evaluation of the Cross-Reality Study ToolProceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia10.1145/3626705.3627803(409-419)Online publication date: 3-Dec-2023
https://dl.acm.org/doi/10.1145/3626705.3627803
Auda JGruenefeld UFaltaous SMayer SSchneegass S(2023)A Scoping Survey on Cross-reality SystemsACM Computing Surveys10.1145/361653656:4(1-38)Online publication date: 21-Oct-2023
https://dl.acm.org/doi/10.1145/3616536
Chauvergne EHachet MProuzeau A(2023)User Onboarding in Virtual Reality: An Investigation of Current PracticesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581211(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581211
Castillo JAssadian SBatmaz A(2023)Where We Stand and Where to Go: Building Bridges Between Real and Virtual Worlds for Collaboration2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00053(228-233)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR-Adjunct60411.2023.00053
Zhang XSimeone A(2023)Using Think-Aloud Protocol in Immersive VR EvaluationsEveryday Virtual and Augmented Reality10.1007/978-3-031-05804-2_8(197-226)Online publication date: 19-Feb-2023
https://doi.org/10.1007/978-3-031-05804-2_8
Osama MAteya AAhmed Elsaid SMuthanna A(2022)Ultra-Reliable Low-Latency Communications: Unmanned Aerial Vehicles Assisted SystemsInformation10.3390/info1309043013:9(430)Online publication date: 12-Sep-2022
https://doi.org/10.3390/info13090430
Zhang XSimeone A(2022)Using the Think Aloud Protocol in an Immersive Virtual Reality Evaluation of a Virtual TwinProceedings of the 2022 ACM Symposium on Spatial User Interaction10.1145/3565970.3567706(1-8)Online publication date: 1-Dec-2022
https://dl.acm.org/doi/10.1145/3565970.3567706
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents