From Reconstruction to Generation: State-of-Art Approaches for 3D Visualization
Authors: 
Pallavi Mohan, June KimAuthors Info & Claims
Article No.: 8, Pages 1 - 75
Abstract
Our course provides an essential overview of 3D reconstruction and generative AI-based 3D generation approaches that have transformed the field. The course provides an understanding of the fundamentals of photogrammetry, neural radiance fields-based techniques such as Instant NeRF, and generative AI-based 3D generation such as text-to-3D, with a focus on reflecting on these approaches, their applications in 3D world building, and how participants can integrate them into their research.
The course firstly introduces the core concepts of photogrammetry, through which participants can understand its importance in reconstructing accurate 3D models. Through case studies, participants will reflect on the applications of photogrammetry in various domains, such as cultural heritage preservation and VR experiences, and can view some examples themselves.
We then delve into a gentle introduction to neural rendering with a broad overview of NVIDIA Instant NeRF, a state-of-the-art technique for real-time 3D reconstruction from multiple images. Participants will have the opportunity to watch several demonstrations of InstantNGP and discover its applications in interactive 3D world building.
Furthermore, participants will be introduced to emerging generative AI approaches that simplify 3D content generation. In particular, we explore the use of text-to-3D techniques, which leverage natural language descriptions to automatically generate 3D models. We will also examine the impact of generative AI techniques on the creation of realistic and immersive 3D environments.
By the end of the course, participants will have a solid understanding of the basics of two salient 3D reconstruction methods, as well as other generative AI techniques for 3D content. We also hope to enable participants to critically evaluate and harness the potential of these approaches in 3D world building.
Index Terms
- From Reconstruction to Generation: State-of-Art Approaches for 3D Visualization
Index terms have been assigned to the content through auto-classification.
Recommendations
3D Archaeological Reconstruction and Visualisation: An Artificial Life Model for Determining Vegetation Dispersal Patterns in Ancient Landscapes
CGIV '06: Proceedings of the International Conference on Computer Graphics, Imaging and VisualisationThis paper describes a methodology and software engine for generating dynamic vegetation models for archaeological reconstruction and interactive visualisation, integrating the disciplines of Artificial Life (Alife) and Virtual Reality. The engine, ...
3D Shape Reconstruction from Free-Hand Sketches
Computer Vision – ECCV 2022 WorkshopsAbstractSketches are arguably the most abstract 2D representations of real-world objects. Although a sketch usually has geometrical distortion and lacks visual cues, humans can effortlessly envision a 3D object from it. This suggests that sketches encode ...
3D Reconstruction of Paper Based Assembly Drawings: State of the Art and Approach
GREC '01: Selected Papers from the Fourth International Workshop on Graphics Recognition Algorithms and ApplicationsEngineering solutions are generally documented in assembly and part drawings and bill of materials. A great benefit, qualitatively and commercially, can be achieved if these paper based storages can be transformed into digital information archives. The ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
December 2023
1359 pages
Copyright © 2023 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 06 December 2023
Check for updates
Qualifiers
- Course
Conference
SA '23
Sponsor:
Acceptance Rates
Overall Acceptance Rate 178 of 869 submissions, 20%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 226Total Downloads
- Downloads (Last 12 months)226
- Downloads (Last 6 weeks)11
Reflects downloads up to 17 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in