Article

Free access

Gaze-directed volume rendering

Authors:

Ross WhitakerAuthors Info & Claims

I3D '90: Proceedings of the 1990 symposium on Interactive 3D graphics

Pages 217 - 223

https://doi.org/10.1145/91385.91449

Published: 01 February 1990 Publication History

Abstract

We direct our gaze at an object by rotating our eyes or head until the object's projection falls on the fovea, a small region of enhanced spatial acuity near the center of the retina. In this paper, we explore methods for encorporating gaze direction into rendering algorithms. This approach permits generation of images exhibiting continuously varying resolution, and allows these images to be displayed on conventional television monitors. Specifically, we describe a ray tracer for volume data in which the number of rays cast per unit area on the image plane and the number of samples drawn per unit length along each ray are functions of local retinal acuity. We also describe an implementation using 2D and 3D mip maps, an eye tracker, and the Pixel-Planes 5 massively parallel raster display system. Pending completion of Pixel-Planes 5 in the spring of 1990, we have written a simulator on a Stellar graphics supercomputer. Preliminary results indicate that while users are aware of the variable-resolution structure of the image, the high-resolution sweet spot follows their gaze well and promises to be useful in practice.

References

[1]

[1] Blinn, J.F., "Light Reflection Functions for Simulation of Clouds and Dusty Surfaces," Computer Graphics, Vol. 16, No. 3, July, 1982, pp. 21-29.

Digital Library

[2]

[2] Cook, R.L., "Stochastic Sampling in Computer Graphics," ACM Transactions on Graphics, Vol. 5, No. 1, January, 1986, pp. 51-72.

[3]

[3] Crow, F.C., "Summed-Area Tables for Texture Mapping," Computer Graphics, Vol. 18, No. 3, July, 1984, pp. 207-212.

[4]

[4] Dippé, M.A.Z. and Wold, E.H., "Antialiasing Through Stochastic Sampling," Computer Graphics, Vol. 19, No. 3, July, 1985, pp. 69-78.

[5]

[5] Drebin, R.A., Carpenter, L., and Hanrahan, P., "Volume Rendering," Computer Graphics, Vol. 22, No. 4, August, 1988, pp. 65-74.

Digital Library

[6]

[6] Feibush, E., Levoy, M., and Cook, R., "Synthetic Texturing using Digital Filters," Computer Graphics, Vol. 14, No. 3, July, 1980, pp. 294-301.

[7]

[7] Fisher, R.A. and Tong, H.M., "A Full-Field-of-View Dome Visual Display for Tactical Combat Training," Proc. Image Conference IV, Phoenix, Arizona, June, 1987.

[8]

[8] Fuchs, H., Poulton, J., Eyles, J., Greer, T., Goldfeather, J., Ellsworth, D., Molnar, S., Turk, G., Tebbs, B., and Israel, L., "A Heterogeneous Multiprocessor Graphics System Using Processor-Enhanced Memories," Computer Graphics, Vol. 23, No. 3, July, 1989, pp. 79-88.

Digital Library

[9]

[9] Kajiya, J.T., "The Rendering Equation," Computer Graphics, Vol. 20, No. 4, August, 1986, pp. 143-150.

Digital Library

[10]

[10] Kajiya, J.T., Kay, T.L., "Rendering Fur with Three Dimensional Textures," Computer Graphics, Vol. 23, No. 3, July, 1989, pp. 271-280.

[11]

[11] Lee, M.E., Redner, R.A., and Uselton, S.P., "Statistically Optimized Sampling for Distributed Ray Tracing," Computer Graphics, Vol. 19, No. 3, July, 1985, pp. 61-67.

[12]

[12] Levoy, M., "Display of Surfaces from Volume Data," IEEE Computer Graphics and Applications, Vol. 8, No. 3, May, 1988, pp. 29-37.

[13]

[13] Levoy, M., "Design for a Real-Time High-Quality Volume Rendering Workstation," Proc. Chapel Hill Workshop on Volume Visualization, ed, C. Upson, University of North Carolina, 1989, pp. 85-92.

[14]

[14] Levoy, M., "Volume Rendering by Adaptive Refinement," The Visual Computer, Vol. 6, No. 1, January, 1990. In Press.

[15]

[15] Levoy, M., "Efficient Ray Tracing of Volume Data," ACM Transactions on Graphics, 1990. In press.

[16]

[16] Mitchell, D.P., "Generating Anti-Aliased Images at Low Sampling Densities," Computer Graphics, Vol. 21, No. 4, July, 1987, pp. 65-72.

Digital Library

[17]

[17] Painter, J. and Sloan, K., "Antialiased Ray Tracing by Adaptive Progressive Refinement," Computer Graphics, Vol. 23, No. 3, July, 1989, pp. 281-288.

[18]

[18] Sabella, P., "A Rendering Algorithm for Visualizing 3D Scalar Fields," Computer Graphics, Vol. 22, No. 4, August 1988, pp. 51-58.

[19]

[19] Peters, D., CAE-Link Corp., Personal communication, September, 1989.

[20]

[20] Tong, H.M. and Fisher, R.A., "Progress Report on an Eye-Slaved Area-of-Interest Visual Display," Proc. Image Conference III, Phoenix, Arizona, May, 1984.

[21]

[21] Upson, C. and Keeler, M., "VBUFFER: Visible Volume Rendering," Computer Graphics, Vol. 22, No. 4, August 1988, pp. 59-64.

[22]

[22] Uttal, W.R., The Psychobiology of Sensory Coding, Harper & Row, 1973.

[23]

[23] Westover, L., "Interactive Volume Rendering," Chapel Hill Workshop on Volume Visualization, Chapel Hill, North Carolina, May, 1989, pp. 9-16.

[24]

[24] Whitted, T., "An Improved Illumination Model for Shaded Display," Communications of the ACM, Vol. 23., No. 6, June, 1980, pp. 343-349.

[25]

[25] Williams, L., "Pyramidal Parametrics," Computer Graphics, Vol. 17, No. 3, July, 1983, pp. 1-11.

Digital Library

Cited By

Henriques HOliveira AOliveira ETrevisan DClua E(2024)Foveated Path Culling: A mixed path tracing and radiance field approach for optimizing rendering in XR DisplaysJournal on Interactive Systems10.5753/jis.2024.435215:1(576-590)Online publication date: 18-Jun-2024
https://doi.org/10.5753/jis.2024.4352
Henriques HOliveira EClua ETrevisan D(2024)Analysing Hybrid Neural and Ray Tracing Perception for Foveated RenderingProceedings of the 26th Symposium on Virtual and Augmented Reality10.1145/3691573.3691580(21-30)Online publication date: 30-Sep-2024
https://dl.acm.org/doi/10.1145/3691573.3691580
Wu NLiu KCheng RHan BZhou POkoshi TKo JLiKamWa R(2024)Theia: Gaze-driven and Perception-aware Volumetric Content Delivery for Mixed Reality HeadsetsProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661858(70-84)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3643832.3661858
Show More Cited By

Index Terms

Gaze-directed volume rendering
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        3D imaging
  2. Computer graphics
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Graphics input devices

Recommendations

Gaze-directed volume rendering

We direct our gaze at an object by rotating our eyes or head until the object's projection falls on the fovea, a small region of enhanced spatial acuity near the center of the retina. In this paper, we explore methods for encorporating gaze direction ...
Global illumination models for volume rendering
Hardware-accelerated parallel non-photorealistic volume rendering
NPAR '02: Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering

Non-photorealistic rendering can be used to illustrate subtle spatial relationships that might not be visible with more realistic rendering techniques. We present a parallel hardware-accelerated rendering technique, making extensive use of multi-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

I3D '90: Proceedings of the 1990 symposium on Interactive 3D graphics

February 1990

271 pages

ISBN:0897913515

DOI:10.1145/91385

Chairman:
Michael J. Zyda
Naval Postgraduate School, Monterey, CA

ACM SIGGRAPH Computer Graphics Volume 24, Issue 2
Mar. 1990
241 pages
ISSN:0097-8930
DOI:10.1145/91394
Editor:
Richard J. Beach
Xerox PARC, Palo Alto, CA
Issue’s Table of Contents

Copyright © 1990 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 February 1990

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 148 of 485 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

156
Total Citations
View Citations
1,038
Total Downloads

Downloads (Last 12 months)194
Downloads (Last 6 weeks)19

Reflects downloads up to 20 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Henriques HOliveira AOliveira ETrevisan DClua E(2024)Foveated Path Culling: A mixed path tracing and radiance field approach for optimizing rendering in XR DisplaysJournal on Interactive Systems10.5753/jis.2024.435215:1(576-590)Online publication date: 18-Jun-2024
https://doi.org/10.5753/jis.2024.4352
Henriques HOliveira EClua ETrevisan D(2024)Analysing Hybrid Neural and Ray Tracing Perception for Foveated RenderingProceedings of the 26th Symposium on Virtual and Augmented Reality10.1145/3691573.3691580(21-30)Online publication date: 30-Sep-2024
https://dl.acm.org/doi/10.1145/3691573.3691580
Wu NLiu KCheng RHan BZhou POkoshi TKo JLiKamWa R(2024)Theia: Gaze-driven and Perception-aware Volumetric Content Delivery for Mixed Reality HeadsetsProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661858(70-84)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3643832.3661858
Harasawa MMiyashita YKomine K(2024)Optimizing spatial resolution in head-mounted displays: evaluating characteristics of peripheral visual fieldProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687740(1-7)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3687740
Kim JKim JJung MKwon TKim K(2024)Individualized foveated rendering with eye-tracking head-mounted displayVirtual Reality10.1007/s10055-023-00931-828:1Online publication date: 19-Jan-2024
https://dl.acm.org/doi/10.1007/s10055-023-00931-8
Henriques HOliveira EClua ETrevisan D(2023)A mixed path tracing and NeRF approach for optimizing rendering in XR DisplaysProceedings of the 25th Symposium on Virtual and Augmented Reality10.1145/3625008.3625027(123-130)Online publication date: 6-Nov-2023
https://dl.acm.org/doi/10.1145/3625008.3625027
Lisboa TMacêdo HPorcino TOliveira ETrevisan DClua E(2023)Is Foveated Rendering Perception Affected by Users’ Motion?2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00127(1104-1112)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00127
Clua ETrevisan DPorcino TMarques BOliveira EBarbosa LLisboa TFerrari VPeres V(2023)Challenges for XR in GamesGrand Research Challenges in Games and Entertainment Computing in Brazil - GranDGamesBR 2020–203010.1007/978-3-031-27639-2_8(159-186)Online publication date: 10-Mar-2023
https://doi.org/10.1007/978-3-031-27639-2_8
Kim YIhm I(2022)Adaptive Foveated Ray Tracing Based on Time-Constrained Rendering for Head-Mounted DisplayJournal of the Korea Computer Graphics Society10.15701/kcgs.2022.28.3.11328:3(113-123)Online publication date: 25-Jul-2022
https://doi.org/10.15701/kcgs.2022.28.3.113
Plopski AHirzle TNorouzi NQian LBruder GLanglotz T(2022)The Eye in Extended Reality: A Survey on Gaze Interaction and Eye Tracking in Head-worn Extended RealityACM Computing Surveys10.1145/349120755:3(1-39)Online publication date: 25-Mar-2022
https://dl.acm.org/doi/10.1145/3491207
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents