research-article

Creating the Perfect Illusion: What will it take to Create Life-Like Virtual Reality Headsets?

Authors:

Eduardo Cuervo,

Krishna Chintalapudi,

Manikanta KotaruAuthors Info & Claims

HotMobile '18: Proceedings of the 19th International Workshop on Mobile Computing Systems & Applications

Pages 7 - 12

https://doi.org/10.1145/3177102.3177115

Published: 12 February 2018 Publication History

Abstract

As Virtual Reality (VR) Head Mounted Displays (HMD) push the boundaries of technology, in this paper, we try and answer the question, "What would it take to make the visual experience of a VR-HMD Life-Like, i.e., indistinguishable from physical reality?" Based on the limits of human perception, we first try and establish the specifications for a Life-Like HMD. We then examine crucial technological trends and speculate on the feasibility of Life-Like VR headsets in the near future. Our study indicates that while display technology will be capable of Life-Like VR, rendering computation is likely to be the key bottleneck. Life-Like VR solutions will likely involve frames rendered on a separate machine and then transmitted to the HMD. Can we transmit Life-Like VR frames wirelessly to the HMD and make the HMD cable-free? We find that current wireless and compression technology may not be sufficient to accommodate the bandwidth and latency requirements. We outline research directions towards achieving Life-Like VR.

References

[1]

Ranovus announces availability of world's first 200g cfp2 direct detect optical transceiver to enable 38.4 terabits per data center interconnect rack. http://ranovus.com/.

[2]

Visual acuity. https://en.wikipedia.org/wiki/Visual_acuity.

[3]

Abari, O., Bharadia, D., Duffield, A., and Katabi, D. Enabling high-quality untethered virtual reality.

[4]

Abrash, M. Latency, the sine qua non of ar and vr. http://blogs.valvesoftware.com/abrash/latency-the-sine-qua-non-of-ar-and-vr/.

[5]

Abrash, M. Down the vr rabbit hole: Fixing judder. http://blogs.valvesoftware.com/abrash/down-the-vr-rabbit-hole-fixing-judder/, July 2013.

[6]

Andersen, S. R. The history of the ophthalmological society of copenhagen 1900--50. Acta Ophthalmologica 80, s234 (2002), 6--17.

[7]

Beeler, D., Hutchins, E., and Pedriana, P. Asynchronous spacewarp. https://developer.oculus.com/blog/asynchronous-spacewarp/.

[8]

Boitard, R., Mantiuk, R. K., and Pouli, T. Evaluation of color encodings for high dynamic range pixels. In Proceedings Volume 9394, Human Vision and Electronic Imaging (2015).

[9]

Bomb, G. How long is your average gaming session? https://www.giantbomb.com/forums/general-discussion-30/how-long-is-your-average-gaming-session-1438129/.

[10]

Boos, K., Chu, D., and Cuervo, E. Flashback: Immersive virtual reality on mobile devices via rendering memoization. In Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services (2016), ACM, pp. 291--304.

Digital Library

[11]

Britannica. Sensory reception: Human vision: Structure and function of the human eye, 1987.

[12]

Carney, T., and Klien, S. Resolution acuity is better than vernier acuity. Vision Research 37, 5 (1997), 525--539.

[13]

Committee, V. F. Visual acuity measurement standard. May 2015.

[14]

Cuervo, E., Balasubramanian, A., Cho, D.-k., Wolman, A., Saroiu, S., Chandra, R., and Bahl, P. Maui: Making smartphones last longer with code offload. In MobiSys 2010 (2010).

Digital Library

[15]

Cuervo, E., and Chu, D. Poster: Mobile virtual reality for head-mounted displays with interactive streaming video and likelihood-based foveation. In Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services Companion (2016), ACM, pp. 130--130.

Digital Library

[16]

Cuervo, E., et al. Kahawai: High-quality mobile gaming using gpu offload. In MobiSys (May 2015).

Digital Library

[17]

Cui, Y., Xiao, S., Wang, X., Yang, Z., Yan, S., Zhu, C., Li, X.-Y., and Ge, N. Diamond: Nesting the data center network with wireless rings in 3-d space. IEEE/ACM Transactions on Networking (2017).

[18]

Curran, M., Rahman, M. S., Gupta, H., Zheng, K., Longtin, J., Das, S. R., and Mohamed, T. Fsonet: A wireless backhaul for multi-gigabit picocells using steerable free space optics. In Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking (New York, NY, USA, 2017), MobiCom '17, ACM, pp. 154--166.

Digital Library

[19]

EIZO. Focus on the foris fg2421. http://gaming.eizo.com/news/the-gaming-monitor-weve-all-been-waiting-for/, June 2014.

[20]

Guenter, B., Finch, M., Drucker, S., Tan, D., and Snyder, J. Foveated 3d graphics. ACM Trans. Graph. 31, 6 (Nov. 2012), 164:1--164:10.

Digital Library

[21]

Hamedazimi, N., Qazi, Z., Gupta, H., Sekar, V., Das, S. R., Longtin, J. P., Shah, H., and Tanwer, A. Firefly: A reconfigurable wireless data center fabric using free-space optics. In ACM SIGCOMM Computer Communication Review (2014), vol. 44, ACM, pp. 319--330.

Digital Library

[22]

Hansen, C. J. Wigig: Multi-gigabit wireless communications in the 60 ghz band. IEEE Wireless Communications 18, 6 (2011).

[23]

Hruska, J. Lg new 440 ppi display is way too much of a good thing. https://www.extremetech.com/computing/130051-lgs-new-440-ppi-display-is-way-too-much-of-a-good-thing, May 2012.

[24]

HTC. Htc vive. https://www.htcvive.com/us/, Apr. 2016.

[25]

IEEE. International roadmap for devices and systems 2016, more moore white paper. https://irds.ieee.org/images/files/pdf/2016_MM.pdf.

[26]

Lang, B. Nvidia demonstrates experimental zero latency display running at 1,700hz. https://www.roadtovr.com/nvidia-demonstrates-experimental-zero-latency-display-running-at-17000hz/.

[27]

Larsen, R. Review: Samsung 2233rz: First 120hz and 3d-monitor. http://www.flatpanelshd.com/review.php'subaction=showfull&id=1239184512, May 2009.

[28]

LaValle, S. M., Yershova, A., Katsev, M., and Antonov, M. Head tracking for the oculus rift. In Robotics and Automation (ICRA), 2014 IEEE International Conference on (2014), IEEE, pp. 187--194.

[29]

Mark, W. R., McMillan, L., and Bishop, G. Post-rendering 3d warping. In Proceedings of the 1997 Symposium on Interactive 3D Graphics (New York, NY, USA, 1997), I3D '97, ACM, pp. 7--ff.

Digital Library

[30]

Moore, S. T., Hirasaki, E., Raphan, T., and Cohen, B. The human vestibulo-ocular reflex during linear locomotion. Annals of the New York Academy of Sciences 942, 1 (2001), 139--147.

[31]

Patney, A., Salvi, M., Kim, J., Kaplanyan, A., Wyman, C., Benty, N., Luebke, D., and Lefohn, A. Towards foveated rendering for gaze-tracked virtual reality. ACM Transactions on Graphics (TOG) 35, 6 (2016), 179.

Digital Library

[32]

Purves, D., Augustine, G., Fitzpatrick, D., et al. Neuroscience. 2nd edition. https://www.ncbi.nlm.nih.gov/books/NBK10991/, 2001. Types of Eye Movements and Their Functions.

[33]

Reed, B. Lg new 440 ppi display is way too much of a good thing. http://bgr.com/2013/08/21/lg-display-538-ppi/, May 2012.

[34]

Reinert, B., Kopf, J., Ritschel, T., Cuervo, E., Chu, D., and Seidel, H.-P. Proxy-guided image-based rendering for mobile devices. Computer Graphics Forum 35, 7 (2016), 353--362.

Digital Library

[35]

Sony. Xperia z5 premium. https://www.sonymobile.com/global-en/products/phones/xperia-z5-premium/.

[36]

StarVR. Starvr. https://www.starvr.com/, July 2013.

[37]

Sullivan, G., and Ohm, J.-R. Meeting report of the 13th meeting of the joint collaborative team on video coding (jct-vc). http://phenix.it-sudparis.eu/jct/doc_end_user/current_document.php?id=7746.

[38]

Technology, P. Pimax 8k. https://www.pimaxvr.com/en/8k/.

[39]

TPCast. Tpcast vive. https://www.tpcastvr.com/.

[40]

https://www.oculus.com/en-us/rift/. Oculus rift, Mar. 2016.

[41]

Valve, H. Vive pro. https://www.vive.com/us/product/vive-pro/.

[42]

VR, F. Fove 0 eye tracking vr devkit. https://www.getfove.com/.

[43]

Walls, F., and MacInnis, S. Vesa display stream compression. http://www.vesa.org/wp-content/uploads/2014/04/VESA_DSC-ETP200.pdf.

[44]

WirelessHD. Wirelesshd. https://www.wirelesshd.org/.

[45]

Yokoyama, K., Hirasa, S., Miyairi, N., Dozen, Y., Sasaki, T., Jimbo, Y., Toyotaka, K., Kaneyasu, M., Miyake, H., Seo, S., et al. Ultra-high-resolution 1058-ppi oled displays with 2.78-in size using caac-igzo fets with tandem oled device and single oled device. Journal of the Society for Information Display 24, 3 (2016), 159--167.

[46]

Zisworks. Zisworks zws 480hz: Engineering sample purchase. http://www.zisworks.com/shop.html, 2017 Aug.

Cited By

Li XElnagar DSong GGhannam R(2024)Advancing Medical Education Using Virtual and Augmented Reality in Low- and Middle-Income Countries: A Systematic and Critical ReviewVirtual Worlds10.3390/virtualworlds30300213:3(384-403)Online publication date: 18-Sep-2024
https://doi.org/10.3390/virtualworlds3030021
McGowin GSonnenfeld NFiore S(2024)Navigating Cognitive Demand in Virtual Reality: Implications for Education and TrainingProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/10711813241278286Online publication date: 30-Aug-2024
https://doi.org/10.1177/10711813241278286
Lee JKim HKim MChun BLee YOkoshi TKo JLiKamWa R(2024)Maestro: The Analysis-Simulation Integrated Framework for Mixed RealityProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661891(99-112)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3643832.3661891
Show More Cited By

Index Terms

Creating the Perfect Illusion: What will it take to Create Life-Like Virtual Reality Headsets?

Recommendations

Merging environments for shared spaces in mixed reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

In virtual reality a real walking interface limits the extent of a virtual environment to our local walkable space. As local spaces are specific to each user, sharing a virtual environment with others for collaborative work or games becomes complicated. ...
Using Perceptual Illusions for Redirected Walking

Redirected walking (RDW) gives users the ability to explore a virtual world by walking in a confined physical space. It inconspicuously guides them on a physical path that might differ from the path they perceive in the virtual world. Exploiting three ...
Beaming: An Asymmetric Telepresence System

The Beaming project recreates, virtually, a real environment; using immersive VR, remote participants can visit the virtual model and interact with the people in the real environment. The real environment doesn't need extensive equipment and can be a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HotMobile '18: Proceedings of the 19th International Workshop on Mobile Computing Systems & Applications

February 2018

130 pages

ISBN:9781450356305

DOI:10.1145/3177102

General Chair:
Minkyong Kim
Samsung Electronics, USA
,
Program Chair:
Aruna Balasubramanian
Stony Brook, NY, USA

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 February 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HotMobile '18

Sponsor:

SIGMOBILE

HotMobile '18: The 19th International Workshop on Mobile Computing Systems and Applications

February 12 - 13, 2018

Arizona, Tempe, USA

Acceptance Rates

HotMobile '18 Paper Acceptance Rate 19 of 65 submissions, 29%;

Overall Acceptance Rate 96 of 345 submissions, 28%

Upcoming Conference

HOTMOBILE '25

Sponsor:
sigmobile

The 26th International Workshop on Mobile Computing Systems and Applications

February 26 - 27, 2025

La Quinta , CA , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

53
Total Citations
View Citations
907
Total Downloads

Downloads (Last 12 months)125
Downloads (Last 6 weeks)14

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Li XElnagar DSong GGhannam R(2024)Advancing Medical Education Using Virtual and Augmented Reality in Low- and Middle-Income Countries: A Systematic and Critical ReviewVirtual Worlds10.3390/virtualworlds30300213:3(384-403)Online publication date: 18-Sep-2024
https://doi.org/10.3390/virtualworlds3030021
McGowin GSonnenfeld NFiore S(2024)Navigating Cognitive Demand in Virtual Reality: Implications for Education and TrainingProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/10711813241278286Online publication date: 30-Aug-2024
https://doi.org/10.1177/10711813241278286
Lee JKim HKim MChun BLee YOkoshi TKo JLiKamWa R(2024)Maestro: The Analysis-Simulation Integrated Framework for Mixed RealityProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661891(99-112)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3643832.3661891
Chen CDas SVidev SSparks ABabadi SKrishnamoorthy ALee CGrieder DHartnett KRudy PRaring JNajafi MPapanikolaou VSchober RHaas H(2024)100 Gbps Indoor Access and 4.8 Gbps Outdoor Point-to-Point LiFi Transmission Systems Using Laser-Based Light SourcesJournal of Lightwave Technology10.1109/JLT.2024.340019242:12(4146-4157)Online publication date: 15-Jun-2024
https://doi.org/10.1109/JLT.2024.3400192
Gruber LEgger JBönsch AKraeima JUlbrich Mvan den Bosch VMotmaen IWilpert COoms MIsfort PHölzle FPuladi B(2024)Accuracy and Precision of Mandible Segmentation and Its Clinical Implications: Virtual Reality, Desktop Screen and Artificial IntelligenceExpert Systems with Applications10.1016/j.eswa.2023.122275239(122275)Online publication date: Apr-2024
https://doi.org/10.1016/j.eswa.2023.122275
Tzung-Yuan LYu-Hsing CYao-Ming LKun-Yueh LChun-Ta WYu-Hsun P(2024) 51‐2: Invited Paper: Foveated Image Transmission with Anti‐Aliasing Image Reconstruction SID Symposium Digest of Technical Papers10.1002/sdtp.1762055:1(697-700)Online publication date: 30-Jul-2024
https://doi.org/10.1002/sdtp.17620
Tzung-Yuan LYu-Hsing CYao-Ming LKun-Yueh LChun-Ta WYu-Hsun P(2024) 71‐1: Invited Paper: High‐Quality Image Transmission with Reduced Bandwidth: A Strategy for Selective Downsampling and Precise Reconstruction SID Symposium Digest of Technical Papers10.1002/sdtp.1715355:S1(611-614)Online publication date: 27-Jun-2024
https://doi.org/10.1002/sdtp.17153
Kuo GSchiffers FLanman DCossairt OMatsuda N(2023)Multisource HolographyACM Transactions on Graphics10.1145/361838042:6(1-14)Online publication date: 5-Dec-2023
https://dl.acm.org/doi/10.1145/3618380
Liu KWu NHan BMontpetit MLeivadeas AUhlig SJaved M(2023)Demystifying Web-based Mobile Extended Reality Accelerated by WebAssemblyProceedings of the 2023 ACM on Internet Measurement Conference10.1145/3618257.3624833(145-153)Online publication date: 24-Oct-2023
https://dl.acm.org/doi/10.1145/3618257.3624833
Illahi GVaishnav AKämäräinen TSiekkinen MDi Francesco MZimmermann RShirmohammadi SGriwodz CHefeeda MWang M(2023)Learning to Predict Head Pose in Remotely-Rendered Virtual RealityProceedings of the 14th Conference on ACM Multimedia Systems10.1145/3587819.3590972(27-38)Online publication date: 7-Jun-2023
https://dl.acm.org/doi/10.1145/3587819.3590972
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

ePub

View this article in ePub.

Media

Figures

Other

Tables

View Table of Contents