research-article

Visual Hull-Based Geometric Data Compression of a 3-D Object

Authors:

Sung Soo Hwang,

Wook-Joong Kim,

Seong Dae KimAuthors Info & Claims

IEEE Transactions on Circuits and Systems for Video Technology, Volume 25, Issue 7

Pages 1151 - 1160

https://doi.org/10.1109/TCSVT.2014.2361420

Published: 01 July 2015 Publication History

Abstract

As image-based 3-D modeling is used in a variety of applications, accordingly, the compression of 3-D object geometry represented by multiple images becomes an important task. This paper presents a model-based approach to predict the geometric structure of an object using its visual hull. A visual hull is a geometric entity generated by shape-from-silhouette (SFS), and consequently it largely follows the overall shape of the object. The construction of a visual hull is computationally inexpensive and a visual hull can be encoded with relatively small amount of bits because it can be represented with 2-D silhouette images. Therefore, when it comes to the predictive compression of object's geometric data, the visual hull should be an effective predictor. In the proposed method, the geometric structure of an object is represented by a layered depth image (LDI), and a visual hull from the LDI data is computed via silhouette generation and SFS. The geometry of an object is predicted with the computed visual hull, and the visual hull data with its prediction errors are encoded. Simulation results show that the proposed predictive coding based on visual hull outperforms the previous image-based methods and the partial surface-based method.

References

[1]

L. Levkovich-Maslyuk et al., “Depth image-based representation and compression for static and animated 3D objects,” IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 7, pp. 1032–1045, Jul. 2004.

Digital Library

[2]

H.-Y. Shum, S. B. Kang, and S.-C. Chan, “Survey of image-based representations and compression techniques,” IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 11, pp. 1020–1037, Nov. 2003.

Digital Library

[3]

C.-M. Tsai, W.-Y. Chang, C.-S. Chen, and G. Y. Tang, “Compression of 3D objects with multistage color-depth panoramic maps,” in Proc. Data Compress. Conf., 2004, p. 475.

[4]

A. Laurentini, “The visual hull concept for silhouette-based image understanding,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 16, no. 2, pp. 150–162, Feb. 1994.

Digital Library

[5]

S. M. Seitz and C. R. Dyer, “Photorealistic scene reconstruction by voxel coloring,” Int. J. Comput. Vis., vol. 35, no. 2, pp. 151–173, 1999.

Digital Library

[6]

K. N. Kutulakos and S. M. Seitz, “A theory of shape by space carving,” Int. J. Comput. Vis., vol. 35, no. 3, pp. 199–218, 2000.

[7]

J. Shade, S. Gotler, L.-W. He, and R. Szeliski, “Layered depth image,” in Proc. SIGGRAPH, 1998, pp. 231–242.

[8]

S.-U. Yoon and Y.-S. Ho, “Multiple color and depth video coding using a hierarchical representation,” IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, pp. 1450–1460, Nov. 2007.

Digital Library

[9]

X. Cheng, L. Sun, and S. Yang, “A multi-view video coding approach using layered depth image,” in Proc. IEEE 9th Workshop Multimedia Signal Process., Oct. 2007, pp. 143–146.

[10]

U. Takyar, T. Maugey, and P. Frossard, “Extended layered depth image representation in multiview navigation,” IEEE Signal Process. Lett., vol. 21, no. 1, pp. 22–25, Jan. 2014.

[11]

M. Trapp and J. Dollner, “Efficient representation of layered depth images for real-time volumetric tests,” in Proc. EG UK Theory Pract. Comput. Graph., Jun. 2008, pp. 9–16.

[12]

J.-S. Lee, K.-Y. Rhee, S.-Y. Park, and S.-D. Kim, “Efficient three-dimensional object representation and reconstruction using depth and texture maps,” Opt. Eng., vol. 47, no. 1, p. 017204, Jan. 2008.

[13]

W. Matusik, C. Buehler, R. Raskar, S. J. Gortler, and L. McMillan, “Image-based Visual Hulls,” in Proc. ACM 27th SIGGRAPH, 2000, pp. 369–374.

[14]

L. McMillan, “A list-priority rendering algorithm for redisplaying projected surfaces,” Univ. North Carolina at Chapel Hill, Chapel Hill, NC, USA, UNC Tech. Rep. TR95-005, 1995.

Digital Library

[15]

J. Duan and J. Li, “Compression of the layered depth image,” IEEE Trans. Image Process., vol. 12, no. 3, pp. 365–372, Mar. 2003.

Digital Library

[16]

S.-Y. Park and S.-D. Kim, “Efficient depth compression based on partial surface for 3-D object represented by layered depth image,” IEEE Signal Process. Lett., vol. 17, no. 10, pp. 839–842, Oct. 2010.

[17]

S. S. Hwang, S.-Y. Park, S. Kim, and S.-D. Kim, “Visual hull-based prediction framework for 3D object coding,” in Proc. Picture Coding Symp., Krakow, Poland, 2012, pp. 225–228.

[18]

E. Boyer and J.-S. Franco, “A hybrid approach for computing visual hulls of complex objects,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., vol. 1. Jun. 2003, pp. 695–701.

[19]

E. Boyer and J. Franco, “Efficient polyhedral modeling from silhouettes,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 3, pp. 414–427, Mar. 2009.

[20]

G. K. M. Gheung, T. Kanade, J.-Y. Bouguet, and M. Holler, “A real time system for robust 3D voxel reconstruction of human motions,” in Proc. IEEE Conf. Comput. Vis. Pattern Reconit., vol. 2. Jun. 2000, pp. 714–720.

[21]

K. Tomiyama, Y. Orihara, M. Katayama, and Y. Iwadate, “Algorithm for dynamic 3D object generation from multi-viewpoint images,” Proc. SPIE, vol. 5599, pp. 153–161, Oct. 25, 2004.

[22]

S. Kim, H.-D. Kim, W.-J. Kim, and S.-D. Kim, “Fast computation of a visual hull,” in Proc. Asian Conf. Comput. Vis., 2010, pp. 2075–2084.

[23]

N. Brady, “MPEG-4 standardized methods for the compression of arbitrarily shaped video objects,” IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 8, pp. 1170–1189, Dec. 1999.

Digital Library

[24]

S.-D. Kim, J.-H. Lee, and J.-K. Kim, “A new chain-coding algorithm for binary images using run-length codes,” Comput. Vis., Graph., Image Process., vol. 41, no. 1, pp. 114–128, 1988.

Digital Library

[25]

Y. Furukawa and J. Ponce, “Carved visual hulls for image-based modeling,” in Proc. Eur. Conf. Comput. Vis., 2006, pp. 564–577.

[26]

Bones. Michael Garland’s QSLIM Program. [Online]. Available: http://people.sc.fsu.edu/~jburkardt/data/smf/smf.html, accessed Oct. 2011.

[27]

Happy Buddha. The Stanford 3D Scanning Repository. [Online]. Available: http://graphics.stanford.edu/data/3Dscanrep/, accessed Oct. 2011.

Cited By

Li PNiggemann O(2022)Non-convex hull based anomaly detection in CPPSEngineering Applications of Artificial Intelligence10.1016/j.engappai.2019.10330187:COnline publication date: 21-Apr-2022
https://dl.acm.org/doi/10.1016/j.engappai.2019.103301
Yan WHou CLei JFang YGu ZLing N(2017)Stereoscopic Image Stitching Based on a Hybrid Warping ModelIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2016.256483827:9(1934-1946)Online publication date: 1-Sep-2017
https://dl.acm.org/doi/10.1109/TCSVT.2016.2564838

Index Terms

Visual Hull-Based Geometric Data Compression of a 3-D Object
1. Information systems
  1. Data management systems
    1. Data structures
      1. Data layout

Index terms have been assigned to the content through auto-classification.

Recommendations

The Visual Hull of Smooth Curved Objects

The visual hull is a geometric entity that relates the shape of an object to its silhouettes or shadows. This paper develops the theory of the visual hull of generic smooth objects. We show that the visual hull can be constructed using surfaces which ...
The visual hull of piecewise smooth objects

The visual hull summarizes the relations between an object and its silhouettes and shadows. This paper develops the theory of the visual hull of general piecewise smooth objects, as those used in CAD applications. A complete catalogue of the nine types ...
Visual Hull from Imprecise Polyhedral Scene
3DIMPVT '11: Proceedings of the 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission

We present a framework to compute the visual hull of a polyhedral scene, in which the vertices of the polyhedra are given with some imprecision. Two kinds of visual event surfaces, namely VE and EEE surfaces are modelled under the geometric framework to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE Transactions on Circuits and Systems for Video Technology

IEEE Transactions on Circuits and Systems for Video Technology Volume 25, Issue 7

July 2015

177 pages

ISSN:1051-8215

Issue’s Table of Contents

Copyright © 2014.

Publisher

IEEE Press

Publication History

Published: 01 July 2015

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Li PNiggemann O(2022)Non-convex hull based anomaly detection in CPPSEngineering Applications of Artificial Intelligence10.1016/j.engappai.2019.10330187:COnline publication date: 21-Apr-2022
https://dl.acm.org/doi/10.1016/j.engappai.2019.103301
Yan WHou CLei JFang YGu ZLing N(2017)Stereoscopic Image Stitching Based on a Hybrid Warping ModelIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2016.256483827:9(1934-1946)Online publication date: 1-Sep-2017
https://dl.acm.org/doi/10.1109/TCSVT.2016.2564838

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents