research-article

Public Access

Depth Conflict Reduction for Stereo VR Video Interfaces

Authors:

Stephen DiVerdi,

Aaron Hertzmann,

Feng LiuAuthors Info & Claims

CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Paper No.: 64, Pages 1 - 9

https://doi.org/10.1145/3173574.3173638

Published: 19 April 2018 Publication History

Abstract

Applications for viewing and editing 360° video often render user interface (UI) elements on top of the video. For stereoscopic video, in which the perceived depth varies over the image, the perceived depth of the video can conflict with that of the UI elements, creating discomfort and making it hard to shift focus. To address this problem, we explore two new techniques that adjust the UI rendering based on the video content. The first technique dynamically adjusts the perceived depth of the UI to avoid depth conflict, and the second blurs the video in a halo around the UI. We conduct a user study to assess the effectiveness of these techniques in two stereoscopic VR video tasks: video watching with subtitles, and video search.

Supplementary Material

suppl.mov (pn1443-file3.mp4)

Supplemental video

Download
54.00 MB

suppl.mov (pn1443-file5.mp4)

Supplemental video

Download
5.40 MB

MP4 File (pn1443.mp4)

Download
235.08 MB

References

[1]

2017. Binocular Vision, Stereoscopic Imaging and Depth Cues. (2017). https://developer.oculus.com/design/ latest/concepts/bp_app_imaging/

[2]

Robert Anderson, David Gallup, Jonathan T. Barron, Janne Kontkanen, Noah Snavely, Carlos Hernández, Sameer Agarwal, and Steven M. Seitz. 2016. Jump: virtual reality video. ACM Transactions on Graphics 35, 6 (nov 2016), 1--13.

Digital Library

[3]

Stephen R Arnott and Judith M Shedden. 2000. Attention switching in depth using random-dot autostereograms: Attention gradient asymmetries. Attention, Perception, & Psychophysics 62, 7 (2000), 1459--1473.

[4]

Blaine Bell, Steven Feiner, and Tobias Höllerer. 2001. View management for virtual and augmented reality. In Proceedings of the 14th annual ACM symposium on User interface software and technology. ACM, 101--110.

Digital Library

[5]

Anastasia Bezerianos, Pierre Dragicevic, and Ravin Balakrishnan. 2006. Mnemonic Rendering: An Image-Based Approach for Exposing Hidden Changes in Dynamic Displays. In Proceedings of the 19th annual ACM symposium on User interface software and technology - UIST '06. ACM Press, New York, New York, USA, 159.

Digital Library

[6]

Tobias Blum, Matthias Wieczorek, Andre Aichert, Radhika Tibrewal, and Nassir Navab. 2010. The effect of out-of-focus blur on visual discomfort when using stereo displays. In 2010 IEEE International Symposium on Mixed and Augmented Reality. IEEE, 13--17.

[7]

David K. Broberg. 2011. Infrastructures for Home Delivery, Interfacing, Captioning, and Viewing of 3-D Content. Proc. IEEE 99, 4 (apr 2011), 684--693.

[8]

Jacqueline Chu, Chris Bryan, Min Shih, Leonardo Ferrer, and Kwan-Liu Ma. 2017. Navigable Videos for Presenting Scientific Data on Affordable Head-Mounted Displays. In Proceedings of the 8th ACM on Multimedia Systems Conference - MMSys'17. ACM Press, New York, New York, USA, 250--260.

Digital Library

[9]

Bleeding Disorders Community. 2017. Factor Treatment in Hemophilia A and B. Video. (9 June 2017). Retrieved August 22, 2017 from https://www.youtube.com/watch?v=tHbFY5G3GVs.

[10]

Joao L C Dasilva. 2017. period film scene full VR 360 3D on film set. Video. (2 September 2017). Retrieved August 22, 2017 from https://www.youtube.com/watch?v=nH1xJox61z4.

[11]

IRALTA VR Productora de video. 2016. 360 3D The Circus School CARAMPA. Video. (19 February 2016). Retrieved August 22, 2017 from https://www.youtube.com/watch?v=tABJlVww-2M.

[12]

devinsupertramp. 2017. Terrifying Masquerade Party in 3D 360!! Video. (8 February 2017). Retrieved August 22, 2017 from https://www.youtube.com/watch?v=mb_J_bMor1g.

[13]

Piotr Didyk, Tobias Ritschel, Elmar Eisemann, Karol Myszkowski, Hans-Peter Seidel, and Wojciech Matusik. 2012. A luminance-contrast-aware disparity model and applications. ACM Transactions on Graphics 31, 6 (nov 2012), 1.

Digital Library

[14]

Adeola Fabola, Alan Miller, and Richard Fawcett. 2015. Exploring the past with Google Cardboard. In Digital Heritage, 2015, Vol. 1. IEEE, 277--284.

[15]

Steven Feiner, Blair MacIntyre, Marcus Haupt, and Eliot Solomon. 1993. Windows on the world: 2D windows for 3D augmented reality. In Proceedings of the 6th annual ACM symposium on User interface software and technology. ACM, 145--155.

Digital Library

[16]

Davide Gadia, Marco Granato, Dario Maggiorini, Laura Anna Ripamonti, and Cinzia Vismara. 2017. Consumer-oriented Head Mounted Displays: Analysis and Evaluation of Stereoscopic Characteristics and User Preferences. Mobile Networks and Applications February (feb 2017), 1--11.

Digital Library

[17]

ZDF Enterprises GmbH. 2017. Gladiators In The Roman Colosseum VR 3D 360°. Video. (28 February 2017). Retrieved August 22, 2017 from https://www.youtube.com/watch?v=XBuijx_iZtQ.

[18]

David M Hoffman and Martin S Banks. 2010. Focus information is used to interpret binocular images. Journal of vision 10, 5 (2010), 13.

[19]

Hong Hua. 2017. Enabling Focus Cues in Head-Mounted Displays. Proc. IEEE 105, 5 (may 2017), 805--824.

[20]

Jingwei Huang, Zhili Chen, Duygu Ceylan, and Hailin Jin. 2017. 6-DOF VR videos with a single 360-camera. In 2017 IEEE Virtual Reality (VR). IEEE, 37--44.

[21]

Robert Kennedy, Norman Lane, Kevin Berbaum, and Michael Lilienthal. 1993. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. (1993).

[22]

Johannes Kopf. 2016. 360 video stabilization. ACM Transactions on Graphics (TOG) 35, 6 (2016), 195.

Digital Library

[23]

Gregory Kramida and Amitabh Varshney. 2015. Resolving the Vergence-Accommodation Conflict in Head Mounted Displays. IEEE Transactions on Visualization and Computer Graphics 22, 7 (2015), 1--16.

[24]

Arun Kulshreshth and Joseph J. LaViola. 2016. Dynamic Stereoscopic 3D Parameter Adjustment for Enhanced Depth Discrimination. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems CHI '16. ACM Press, New York, New York, USA, 177--187.

Digital Library

[25]

Jeremy Lacoche, Morgan Le Chenechal, Sebastien Chalme, Jerome Royan, Thierry Duval, Valerie Gouranton, Eric Maisel, and Bruno Arnaldi. 2015. Dealing with frame cancellation for stereoscopic displays in 3D user interfaces. In 2015 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 73--80.

[26]

M. Lambooij, M.J. Murdoch, W.A. IJsselsteijn, and I. Heynderickx. 2013. The impact of video characteristics and subtitles on visual comfort of 3D TV. Displays 34, 1 (jan 2013), 8--16.

[27]

Marc T. M. Lambooij, Wijnand A. IJsselsteijn, and Ingrid Heynderickx. 2007. Visual discomfort in stereoscopic displays: a review. 6490, May 2010 (2007), 64900I.

[28]

Robert S. Laramee and Colin Ware. 2002. Rivalry and interference with a head-mounted display. ACM Transactions on Computer-Human Interaction 9, 3 (sep 2002), 238--251.

Digital Library

[29]

Andrew MacQuarrie and Anthony Steed. 2017. Cinematic virtual reality: Evaluating the effect of display type on the viewing experience for panoramic video. In Virtual Reality (VR), 2017 IEEE. IEEE, 45--54.

[30]

Kevin Matzen, Michael F. Cohen, Bryce Evans, Johannes Kopf, and Richard Szeliski. 2017. Low-cost 360 stereo photography and video capture. ACM Trans. Graphics (2017).

Digital Library

[31]

Ming Hou. 2003. A model of real-virtual object interactions in stereoscopic augmented reality environments. In Proceedings on Seventh International Conference on Information Visualization, 2003. IV 2003., Vol. 2003-Janua. IEEE Comput. Soc, 512--517.

Digital Library

[32]

Cuong Nguyen, Stephen DiVerdi, Aaron Hertzmann, and Feng Liu. 2017a. CollaVR: Collaborative In-Headset Review for VR Video. In ACM symposium on User interface software and technology - UIST '17. ACM.

Digital Library

[33]

Cuong Nguyen, Stephen DiVerdi, Aaron Hertzmann, and Feng Liu. 2017b. Vremiere: In-Headset Virtual Reality Video Editing. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems CHI '17. ACM Press, New York, New York, USA, 5428--5438.

Digital Library

[34]

Thomas Oskam, Alexander Hornung, Huw Bowles, Kenny Mitchell, and Markus Gross. 2011. OSCAM optimized stereoscopic camera control for interactive 3D. In Proceedings of the 2011 SIGGRAPH Asia Conference on - SA '11. ACM Press, New York, New York, USA, 1.

Digital Library

[35]

Javier Sánchez Pérez, Enric Meinhardt-Llopis, and Gabriele Facciolo. 2013. TV-L1 optical flow estimation. Image Processing On Line 2013 (2013), 137--150.

[36]

Stephan Reichelt, Ralf Häussler, Gerald Fütterer, and Norbert Leister. 2010. Depth cues in human visual perception and their realization in 3D displays. In Proc. SPIE, Vol. 7690. 76900B.

[37]

Leila Schemali and Elmar Eisemann. 2014. Design and evaluation of mouse cursors in a stereoscopic desktop environment. In 2014 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 67--70.

[38]

Jonas Schild, Liane Bölicke, Joseph J. LaViola Jr., and Maic Masuch. 2013. Creating and analyzing stereoscopic 3D graphical user interfaces in digital games. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '13. ACM Press, New York, New York, USA, 169.

Digital Library

[39]

Jonas Schild, Joseph J. LaViola, and Maic Masuch. 2014. Altering gameplay behavior using stereoscopic 3D vision-based video game design. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI '14. ACM Press, New York, New York, USA, 207--216.

Digital Library

[40]

Aljoscha Smolic, Peter Kauff, Sebastian Knorr, Alexander Hornung, Matthias Kunter, M MuÌ´ Lller, and Manuel Lang. 2011. Three-Dimensional Video Postproduction and Processing. Proc. IEEE 99, 4 (apr 2011), 607--625.

[41]

Filippo Speranza, Wa J Tam, Ron Renaud, and Namho Hur. 2006. Effect of disparity and motion on visual comfort of stereoscopic images. In Proceedings of SPIE: Stereoscopic Displays and Virtual Reality Systems XIII, Andrew J. Woods, Neil A. Dodgson, John O. Merritt, Mark T. Bolas, and Ian E. McDowall (Eds.), Vol. 6055. 60550B.

[42]

Wa James Tam, Filippo Speranza, Carlos Vázquez, Ron Renaud, and Namho Hur. 2012. Visual comfort: stereoscopic objects moving in the horizontal and mid-sagittal planes. In Proc. SPIE, Andrew J. Woods, Nicolas S. Holliman, and Gregg E. Favalora (Eds.), Vol. 8288. 828813.

[43]

Junle Wang, Patrick Le Callet, Sylvain Tourancheau, Vincent Ricordel, and Matthieu Perreira Da Silva. 2012. Study of depth bias of observers in free viewing of still stereoscopic synthetic stimuli. Journal of Eye Movement Research 5, 5 (2012).

[44]

Colin Ware. 1995. Dynamic stereo displays. Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '95 (1995), 310--316.

Digital Library

[45]

Yong Jung, Hosik Sohn, Seong-il Lee, and Yong Ro. 2014. Visual comfort improvement in stereoscopic 3D displays using perceptually plausible assessment metric of visual comfort. IEEE Transactions on Consumer Electronics 60, 1 (feb 2014), 1--9.

Cited By

Emsenhuber GLanglotz TKalkofen DSutton JTatzgern M(2023)Eye-Perspective View Management for Optical See-Through Head-Mounted DisplaysProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581059(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581059
Li ZCui YZhou TJiang YWang YYan YNebeling MShi Y(2022)Color-to-Depth Mappings as Depth Cues in Virtual RealityProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545646(1-14)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545646
Duan ZJung C(2022)Joint Disparity Estimation and Pseudo NIR Generation From Cross Spectral Image PairsIEEE Access10.1109/ACCESS.2022.314043510(7153-7163)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3140435
Show More Cited By

Index Terms

Depth Conflict Reduction for Stereo VR Video Interfaces
1. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

3D User Interfaces: New Directions and Perspectives

Three-dimensional user interfaces (3D UIs) let users interact with virtual objects, environments, or information using direct 3D input in the physical and/or virtual space. In this article, the founders and organizers of the IEEE Symposium on 3D User ...
Towards usable VR: an empirical study of user interfaces for immersive virtual environments
CHI '99: Proceedings of the SIGCHI conference on Human Factors in Computing Systems

This paper reports empirical results from a study into the use of 2D widgets in 3D immersive virtual environments. Several researchers have proposed the use of 2D interaction techniques in 3D environments, however little empirical work has been done to test ...
Multimedia Interfaces: Don't Move My Cheese!

The author notes ways to be more consistent and practical when designing an interface.He also provides a concrete example of a less-than-perfect user interface on a phone/fax/answering machine.

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

April 2018

8489 pages

ISBN:9781450356206

DOI:10.1145/3173574

General Chairs:
Regan Mandryk
University of Saskatchewan, Canada
,
Mark Hancock
University of Waterloo, Canada
,
Program Chairs:
Mark Perry
Brunel University London, UK
,
Anna Cox
University College London, UK

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 April 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

CHI '18

Sponsor:

SIGCHI

CHI '18: CHI Conference on Human Factors in Computing Systems

April 21 - 26, 2018

Montreal QC, Canada

Acceptance Rates

CHI '18 Paper Acceptance Rate 666 of 2,590 submissions, 26%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
1,215
Total Downloads

Downloads (Last 12 months)161
Downloads (Last 6 weeks)18

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Emsenhuber GLanglotz TKalkofen DSutton JTatzgern M(2023)Eye-Perspective View Management for Optical See-Through Head-Mounted DisplaysProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581059(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581059
Li ZCui YZhou TJiang YWang YYan YNebeling MShi Y(2022)Color-to-Depth Mappings as Depth Cues in Virtual RealityProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545646(1-14)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545646
Duan ZJung C(2022)Joint Disparity Estimation and Pseudo NIR Generation From Cross Spectral Image PairsIEEE Access10.1109/ACCESS.2022.314043510(7153-7163)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3140435
Chen SErgu DMa BCai YLiu F(2022)Improvement of AnyNet-based end-to-end phased binocular stereo matching networkProcedia Computer Science10.1016/j.procs.2022.01.184199(1450-1457)Online publication date: 2022
https://doi.org/10.1016/j.procs.2022.01.184
Shimizu YOhnishi ATerada TTsukamoto M(2021)Gaze-Adaptive Subtitles Considering the Balance among Vertical/Horizontal and Depth of Eye Movement2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct54149.2021.00035(127-132)Online publication date: Oct-2021
https://doi.org/10.1109/ISMAR-Adjunct54149.2021.00035
Alexandrovsky DPutze SBonfert MHöffner SMichelmann PWenig DMalaka RSmeddinck JBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Examining Design Choices of Questionnaires in VR User StudiesProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376260(1-21)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376260
Thoravi Kumaravel BNguyen CDiVerdi SHartmann BBrewster SFitzpatrick GCox AKostakos V(2019)TutoriVRProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300514(1-12)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300514
Wang YLai ZHuang GWang Bvan der Maaten LCampbell MWeinberger K(2019)Anytime Stereo Image Depth Estimation on Mobile Devices2019 International Conference on Robotics and Automation (ICRA)10.1109/ICRA.2019.8794003(5893-5900)Online publication date: May-2019
https://doi.org/10.1109/ICRA.2019.8794003

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents