Export Citations
Save this search
Please login to be able to save your searches and receive alerts for new content matching your search criteria.
- ArticleNovember 2024
AG-NeRF: Attention-Guided Neural Radiance Fields for Multi-height Large-Scale Outdoor Scene Rendering
AbstractExisting neural radiance fields (NeRF)-based novel view synthesis methods for large-scale outdoor scenes are mainly built on a single altitude. Moreover, they often require a priori camera shooting height and scene scope, leading to inefficient ...
- ArticleNovember 2024
3D Data Augmentation for Driving Scenes on Camera
- Wenwen Tong,
- Jiangwei Xie,
- Tianyu Li,
- Yang Li,
- Hanming Deng,
- Bo Dai,
- Lewei Lu,
- Hao Zhao,
- Junchi Yan,
- Hongyang Li
AbstractDriving scenes are extremely diverse and complicated that it is impossible to collect all cases with human effort alone. While data augmentation is an effective technique to enrich the training data, existing methods for camera data in autonomous ...
- ArticleNovember 2024
Multi-3D Occlusion Mask Learning for Flexible Occlusion Removal in Neural Radiance Fields
AbstractAs NeRFs modeling becomes more widely available, there is an increasing demand for the ability to flexibly and conveniently exclude unnecessary obstructions during the modeling process. Existing methods generally adopt a “ignore” strategy for ...
- ArticleNovember 2024
SFDNeRF: A Semantic Feature-Driven Few-Shot Neural Radiance Field Framework with Hybrid Regularization
AbstractFew-shot 3D scene reconstruction remains a challenge due to the limited number of viewpoints available for rendering high-quality images. The proposed framework, SFDNeRF, addresses this by integrating semantic feature-driven constraints and hybrid ...
- ArticleNovember 2024
Animatable Human Rendering from Monocular Video via Pose-Independent Deformation
AbstractRendering animatable avatars from monocular videos has significant applications in the broader field of interactive entertainment. Previous methods based on Neural Radiance Field (NeRF) struggle with long training time and tend to overfit on seen ...
-
- ArticleNovember 2024
Multi-view 3D Reconstruction by Fusing Polarization Information
AbstractFor the shortcomings of current 3D reconstruction models such as poor reconstruction effect and blurred edges when dealing with weakly textured and textureless objects, this paper fuses the rich polarization spectral information with multi-view 3D ...
- ArticleNovember 2024
Disentangled Generation and Aggregation for Robust Radiance Fields
AbstractThe utilization of the triplane-based radiance fields has gained attention in recent years due to its ability to effectively disentangle 3D scenes with a high-quality representation and low computation cost. A key requirement of this method is the ...
- ArticleNovember 2024
Protecting NeRFs’ Copyright via Plug-And-Play Watermarking Base Model
AbstractNeural Radiance Fields (NeRFs) have become a key method for 3D scene representation. With the rising prominence and influence of NeRF, safeguarding its intellectual property has become increasingly important. In this paper, we propose ...
- ArticleOctober 2024
Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-observations for High-Quality Sparse-View Reconstruction
AbstractNovel view synthesis via Neural Radiance Fields (NeRFs) or 3D Gaussian Splatting (3DGS) typically necessitates dense observations with hundreds of input images to circumvent artifacts. We introduce Deceptive-NeRF/3DGS (In harmonic progression, a ...
- ArticleOctober 2024
WaSt-3D: Wasserstein-2 Distance for Scene-to-Scene Stylization on 3D Gaussians
- Dmytro Kotovenko,
- Olga Grebenkova,
- Nikolaos Sarafianos,
- Avinash Paliwal,
- Pingchuan Ma,
- Omid Poursaeed,
- Sreyas Mohan,
- Yuchen Fan,
- Yilei Li,
- Rakesh Ranjan,
- Björn Ommer
AbstractWhile style transfer techniques have been well-developed for 2D image stylization, the extension of these methods to 3D scenes remains relatively unexplored. Existing approaches demonstrate proficiency in transferring colors and textures but often ...
- ArticleSeptember 2024
SAM-NeRF: NeRF-Based 3D Instance Segmentation with Segment Anything Model
Artificial Neural Networks and Machine Learning – ICANN 2024Pages 434–448https://doi.org/10.1007/978-3-031-72335-3_30AbstractExisting NeRF-based instance segmentation methods lift 2D annotated or predicted semantic and instance masks into 3D through radiance field, but still insufficient in segmenting on the unlabeled semantic classes. The Segment Anything Model (SAM) ...
- research-articleOctober 2024
Neural Radiance Selector: Find the best 2D representations of 3D data for CLIP based 3D tasks
AbstractRepresenting the world in 3D space provides vivid texture and depth information. However, 3D datasets currently do not match the scale of 2D datasets. There is a growing trend in representing 3D data as multi-view 2D images and using large-scale ...
- ArticleAugust 2024
SDF-Net: Enhanced Novel View Synthesis from Ultra-sparse Viewpoints via Multi-level Feature Fusion
Advanced Intelligent Computing Technology and ApplicationsPages 405–418https://doi.org/10.1007/978-981-97-5588-2_34AbstractThe primary aim of this study is to enhance the quality of synthetic novel views under conditions characterized by data sparsity. Our investigations demonstrate that the utilization of multi-scale, multi-level stereoscopic depth feature extraction ...
- research-articleAugust 2024
Towards Real-Time Neural Volumetric Rendering on Mobile Devices: A Measurement Study
EMS '24: Proceedings of the 2024 SIGCOMM Workshop on Emerging Multimedia SystemsPages 8–13https://doi.org/10.1145/3672196.3673399Neural Radiance Fields (NeRF) is an emerging technique to synthesize 3D objects from 2D images with a wide range of potential applications. However, rendering existing NeRF models is extremely computation intensive, making it challenging to support real-...
- research-articleNovember 2024
DyNeRFactor: Temporally consistent intrinsic scene decomposition for dynamic NeRFs
- Mario Alfonso-Arsuaga,
- Jorge García-González,
- Andrea Castiella-Aguirrezabala,
- Miguel Andrés Alonso,
- Elena Garcés
AbstractWe present a method for estimating the intrinsic components of a dynamic scene captured with multi-view video sequences. Unlike previous work focused either on static scenes or single view videos, our method simultaneously addresses the ...
Graphical abstractDisplay Omitted
Highlights- Novel view synthesis and inverse rendering of dynamic (moving) is an open problem.
- We leverage a temporal embedding to represent the dynamism in the scene.
- We produce albedo, specular, visibility, and normals for a novel view of a ...
- research-articleJuly 2024
Physics-Informed Learning of Characteristic Trajectories for Smoke Reconstruction
SIGGRAPH '24: ACM SIGGRAPH 2024 Conference PapersArticle No.: 53, Pages 1–11https://doi.org/10.1145/3641519.3657483We delve into the physics-informed neural reconstruction of smoke and obstacles through sparse-view RGB videos, tackling challenges arising from limited observation of complex dynamics. Existing physics-informed neural networks often emphasize short-...
- ArticleJuly 2024
NeRFlame: Flame-Based Conditioning of NeRF for 3D Face Rendering
AbstractTraditional 3D face models are based on mesh representations with texture. One of the most important models is Flame (Faces Learned with an Articulated Model and Expressions), which produces meshes of human faces that are fully controllable. ...
- research-articleMay 2024Honorable Mention
SharedNeRF: Leveraging Photorealistic and View-dependent Rendering for Real-time and Remote Collaboration
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing SystemsArticle No.: 675, Pages 1–14https://doi.org/10.1145/3613904.3642945Collaborating around physical objects necessitates examining different aspects of design or hardware in detail when reviewing or inspecting physical artifacts or prototypes. When collaborators are remote, coordinating the sharing of views of their ...
- research-articleJuly 2024
High-fidelity 3D reconstruction of plants using Neural Radiance Fields
Computers and Electronics in Agriculture (COEA), Volume 220, Issue Chttps://doi.org/10.1016/j.compag.2024.108848AbstractAccurate reconstruction of plant phenotypes plays a key role in optimizing sustainable farming practices in the field of Precision Agriculture (PA). Currently, optical sensor-based approaches dominate the field, but the need for high-fidelity 3D ...
Highlights- Explore NeRF in high-fidelity plant phenotyping.
- Introduction of a first-of-its-kind initiative dataset for plant phenotyping.
- Comprehensive study of several SOTA NeRF models.
- research-articleJune 2024
RPE-BARF: Relative Pose Estimation for Robust Bundle-Adjusting Neural Radiance Fields
CVIPPR '24: Proceedings of the 2024 2nd Asia Conference on Computer Vision, Image Processing and Pattern RecognitionArticle No.: 33, Pages 1–6https://doi.org/10.1145/3663976.3664017Neural Radiance Fields (NeRF) has recently shown impressive results in synthesizing novel views of complex scenes from images. However, its performance is highly dependent on the quality of the estimated pose. Although existing methods have achieved ...