3D Reconstruction from Sketch with Hidden Lines by Two-Branch Diffusion Model
No Thumbnail Available
Date
2024
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
We present a method for sketch-based modelling of 3D man-made shapes that exploits not only the commonly considered visible surface lines but also the hidden lines typical for technical drawings. Hidden lines are used by artists and designers to communicate holistic shape structure. Given a single viewpoint sketch, leveraging such lines allows us to resolve the ambiguity of the shape's surfaces hidden from the observer. We assume that the separation into visible and hidden lines is given, and focus solely on how to leverage this information. Our strategy is to mingle two distinct diffusion networks: one generates denoized occupancy grid estimates from a visible line image, whilst the other generates occupancy grid estimates based on contextualized hidden lines unveiling the occluded shape structure. We iteratively merge noisy estimates from both models in a reverse diffusion process. Importantly, we demonstrate the importance of what we call a contextualized hidden lines image over just a hidden lines image. Our contextualized hidden lines image contains hidden lines and silhouette lines. Such contextualization allows us to achieve superior performance to a range of alternative configurations and reconstruct hidden holes and hidden surfaces.
Description
CCS Concepts: Computing methodologies → Artificial intelligence; Computer graphics → Shape modeling
@inproceedings{10.2312:egs.20241032,
booktitle = {Eurographics 2024 - Short Papers},
editor = {Hu, Ruizhen and Charalambous, Panayiotis},
title = {{3D Reconstruction from Sketch with Hidden Lines by Two-Branch Diffusion Model}},
author = {Fukushima, Yuta and Qi, Anran and Shen, I-Chao and Gryaditskaya, Yulia and Igarashi, Takeo},
year = {2024},
publisher = {The Eurographics Association},
ISSN = {1017-4656},
ISBN = {978-3-03868-237-0},
DOI = {10.2312/egs.20241032}
}