Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3145749.3149432acmconferencesArticle/Chapter ViewAbstractPublication Pagessiggraph-asiaConference Proceedingsconference-collections
research-article

Auto-colorization of 3D models from images

Published: 27 November 2017 Publication History

Abstract

Color is crucial to achieve more realism and better visual perception. However, majority of existing 3D model repositories are colorless. In this paper, we propose an automatic scheme for 3D model colorization taking advantage of large availability of realistic 2D images with similar appearance. Specifically, we establish a region-based correspondence between a given 3D model and its 2D image counterpart. Then we employ a PatchMatch based approach to synthesize the texture images. Subsequently, we quilt the texture seams via multi-view coverage. Finally, the texture coordinates are obtained by projecting back to the 3D model. Our method yields satisfactory results in most situations even when there exists an inconsistency between the 3D model and the corresponding image. Results obtained through a cross-over experiment validate the effectiveness and generality of our method.

Supplementary Material

ZIP File (a15-liu.zip)
Supplemental material.

References

[1]
Connelly Barnes, Eli Shechtman, Adam Finkelstein, and Dan B Goldman. 2009. Patch-Match: A Randomized Correspondence Algorithm for Structural Image Editing. ACM Transactions on Graphics (Proc. SIGGRAPH) 28, 3 (Aug. 2009).
[2]
Gilbert Louis Bernstein and Chris Wojtan. 2013. Putting holes in holey geometry: topology change for arbitrary surfaces. Acm Transactions on Graphics 32, 4 (2013), 1--12.
[3]
Sai Bi, Xiaoguang Han, and Yizhou Yu. 2015. An L 1 image transform for edge-preserving smoothing and scene-level intrinsic decomposition. Acm Transactions on Graphics 34, 4 (2015), 78.
[4]
Sai Bi, Nima Khademi Kalantari, and Ravi Ramamoorthi. 2017. Patch-based optimization for image-based texture mapping. 36 (07 2017), 1--11.
[5]
Angel X. Chang, Thomas Funkhouser, Leonidas Guibas, Pat Hanrahan, Qixing Huang, Zimo Li, Silvio Savarese, Manolis Savva, Shuran Song, Hao Su, Jianxiong Xiao, Li Yi, and Fisher Yu. 2015. ShapeNet: An Information-Rich 3D Model Repository. Technical Report arXiv:1512.03012 {cs.GR}. Stanford University --- Princeton University --- Toyota Technological Institute at Chicago.
[6]
Navneet Dalal and Bill Triggs. 2005. Histograms of Oriented Gradients for Human Detection. In Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on. 886--893.
[7]
Leo Grady and Eric L. Schwartz. 2006. Isoperimetric Graph Partitioning for Image Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 3 (2006), 469.
[8]
Andriy Myronenko and Xubo Song. 2010. Point Set Registration: Coherent Point Drift. IEEE Transactions on Pattern Analysis and Machine Intelligence 32, 12 (2010), 2262--2275.
[9]
Lior Shapira, Ariel Shamir, and Daniel Cohen-Or. 2008. Consistent mesh partitioning and skeletonisation using the shape diameter function. Visual Computer 24, 4 (2008), 249.
[10]
Joshua B. Tenenbaum, Vin De Silva, and John C. Langford. 2000. A Global Geometric Framework for Nonlinear Dimensionality Reduction. Science 290, 5500 (2000), 2319.
[11]
Tuanfeng Y. Wang, Hao Su, Qixing Huang, Jingwei Huang, Leonidas Guibas, and Niloy J. Mitra. 2016. Unsupervised Texture Transfer from Images to Model Collections. ACM Trans. Graph. 35, 6, Article 177 (2016), 13 pages.
[12]
Kun Zhou, Xi Wang, Yiying Tong, Mathieu Desbrun, Baining Guo, and Heung-Yeung Shum. 2005. Texturemontage: Seamless Texturing of Arbitrary Surfaces From Multiple Images. ACM Transactions on Graphics 24, 3 (2005), 1148--1155.
[13]
Yang Zhou, Huajie Shi, Dani Lischinski, Minglun Gong, Johannes Kopf, and Hui Huang. 2017. Analysis and Controlled Synthesis of Inhomogeneous Textures. Computer Graphics Forum (Proc. of Eurographics 2017) 36, 2 (2017).

Cited By

View all
  • (2022)Photo-to-shape material transfer for diverse structuresACM Transactions on Graphics10.1145/3528223.353008841:4(1-14)Online publication date: Jul-2022
  • (2022)Deep Exemplar-Based Color Transfer for 3D ModelIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.304148728:8(2926-2937)Online publication date: 1-Aug-2022

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
SA '17: SIGGRAPH Asia 2017 Technical Briefs
November 2017
108 pages
ISBN:9781450354066
DOI:10.1145/3145749
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 November 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 3D model
  2. colorization
  3. texture synthesis

Qualifiers

  • Research-article

Funding Sources

Conference

SA '17
Sponsor:
SA '17: SIGGRAPH Asia 2017
November 27 - 30, 2017
Bangkok, Thailand

Acceptance Rates

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)16
  • Downloads (Last 6 weeks)0
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Photo-to-shape material transfer for diverse structuresACM Transactions on Graphics10.1145/3528223.353008841:4(1-14)Online publication date: Jul-2022
  • (2022)Deep Exemplar-Based Color Transfer for 3D ModelIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.304148728:8(2926-2937)Online publication date: 1-Aug-2022

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media