research-article

Space-time surface reconstruction using incompressible flow

Authors:

Dan A. Alcantara,

Thomas Lewiner,

Daniel Cohen-OrAuthors Info & Claims

SIGGRAPH Asia '08: ACM SIGGRAPH Asia 2008 papers

Article No.: 110, Pages 1 - 10

https://doi.org/10.1145/1457515.1409063

Published: 01 December 2008 Publication History

Abstract

We introduce a volumetric space-time technique for the reconstruction of moving and deforming objects from point data. The output of our method is a four-dimensional space-time solid, made up of spatial slices, each of which is a three-dimensional solid bounded by a watertight manifold. The motion of the object is described as an incompressible flow of material through time. We optimize the flow so that the distance material moves from one time frame to the next is bounded, the density of material remains constant, and the object remains compact. This formulation overcomes deficiencies in the acquired data, such as persistent occlusions, errors, and missing frames. We demonstrate the performance of our flow-based technique by reconstructing coherent sequences of watertight models from incomplete scanner data.

Supplementary Material

MOV File (a110-sharf-mp4_hi.mov)

Download
437.77 MB

References

[1]

de Aguiar, E., Zayer, R., Theobalt, C., Magnor, M., and Seidel, H.-P. 2007. Video-driven animation of human body scans. In 3DTV, IEEE, 1--4.

[2]

Allen, B., Curless, B., and Popovic, Z. 2002. Articulated body deformation from range scan data. In Siggraph, ACM, 612--619.

Digital Library

[3]

Anguelov, D., Koller, D., Pang, H.-C., Srinivasan, P., and Thrun, S. 2004. Recovering Articulated Object Models from 3D Range Data. In Uncertainty in Artificial Intelligence, Morgan Kaufmann, 18--26.

Digital Library

[4]

Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., and Davis, J. 2005. SCAPE: shape completion and animation of people. Transactions on Graphics 24, 3, 408--416.

Digital Library

[5]

Anuar, N., and Guskov, I. 2004. Extracting Animated Meshes with Adaptive Motion Estimation. In Vision, Modeling, and Visualization, IOS, 63--71.

[6]

Barron, J. L., and Thacker, N. A. 2004. Tutorial: Computing 2D and 3D Optical Flow. Tech. Rep. 012, Tina Memo.

[7]

Bradley, D., Popa, T., Sheffer, A., Heidrich, W., and Boubekeur, T. 2008. Markerless Garment Capture. In Siggraph, ACM.

Digital Library

[8]

Carranza, J., Theobalt, C., Magnor, M., and Seidel, H.-P. 2003. Free-viewpoint video of human actors. In Siggraph, ACM, 569--577.

Digital Library

[9]

Fong, P., and Buron, F. 2005. Sensing Deforming and Moving Objects with Commercial Off the Shelf Hardware. In Computer Vision and Pattern Recognition, IEEE, 101.

Digital Library

[10]

Goldlücke, B., and Magnor, M. 2005. Spacetime-continuous geometry meshes from multi-view video sequences. In International Conference on Image Processing, IEEE, 625--628.

[11]

Goldlücke, B., Ihrke, I., Linz, C., and Magnor, M. 2007. Weighted Minimal Hypersurface Reconstruction. Transactions on Pattern Analysis and Machine Intelligence 29, 7, 1194--1208.

Digital Library

[12]

Golub, G. H., and Greif, C. 2003. On solving block structured indefinite linear systems. Journal on Scientific Computing 24, 6, 2076--2092. SIAM.

Digital Library

[13]

Greif, C., and Schötzau, D. 2006. Preconditioners for Saddle Point Linear Systems with Highly Singular (1,1) Blocks. Electronic Transactions on Numerical Analysis 22, 114--121.

[14]

Grosso, E., Sandini, G., and Tistarelli, M. 1989. 3D object reconstruction using stereo and motion. Systems, Man and Cybernetics 19, 6, 1465--1476.

[15]

Gupta, N. C., and Kanal, L. N. 1995. 3D Motion Estimation from Motion Field. Artificial Intelligence 78, 1--2, 45--86.

Digital Library

[16]

Guskov, I., Klibanov, S., and Bryant, B. 2003. Trackable surfaces. In Symposium on Computer Animation, ACM/Eurographics, 251--257.

Digital Library

[17]

Hansen, P. C. 1998. Rank-Deficient and Discrete Ill-Posed Problems. SIAM.

Digital Library

[18]

Holland, P., and Welsch, R. 1977. Robust regression using iteratively reweighted least-squares. Communications in Statistics - Theory and Methods 6, 9, 813 -- 827.

[19]

Koninckx, T. P., and van Gool, L. J. 2006. Real-Time Range Acquisition by Adaptive Structured Light. Transactions on Pattern Analysis and Machine Intelligence 28, 3, 432--445.

Digital Library

[20]

Levin, A., Fergus, R., Durand, F., and Freeman, W. 2007. Image and depth from a conventional camera with a coded aperture. In Siggraph, ACM, 70.

Digital Library

[21]

Magnor, M., and Goldlücke, B. 2004. Spacetime-Coherent Geometry Reconstruction from Multiple Video Streams. In 3D Data Processing, Visualization and Transmission, IEEE, 365--372.

Digital Library

[22]

Marschner, S. R., Guenter, B. K., and Raghupathy, S. 2000. Modeling and Rendering for Realistic Facial Animation. In Rendering Techniques, Eurographics, 231--242.

Digital Library

[23]

Mitra, N. J., Flüry, S., Ovsjanikov, M., Gelfand, N., Guibas, L. J., and Pottmann, H. 2007. Dynamic geometry registration. In Symposium on Geometry Processing, ACM/Eurographics, 173--182.

Digital Library

[24]

Ohtake, Y., Belyaev, A., Alexa, M., Turk, G., and Seidel, H.-P. 2003. Multi-level partition of unity implicits. In Siggraph, ACM, 463--470.

Digital Library

[25]

Pekelny, Y., and Gotsman, C. 2008. Articulated object reconstruction and motion capture from depth video. In Eurographics, Eurographics, to appear.

[26]

Rusinkiewicz, S., Hall-Holt, O. A., and Levoy, M. 2002. Real-time 3D model acquisition. In Siggraph, ACM, 438--446.

Digital Library

[27]

Sharf, A., Lewiner, T., Shklarski, G., Toledo, S., and Cohen-Or, D. 2007. Interactive topology-aware surface reconstruction. In Siggraph, ACM, 43.

Digital Library

[28]

Shinya, M. 2004. Unifying Measured Point Sequences of Deforming Objects. In 3D Data Processing, Visualization and Transmission, IEEE, 904--911.

Digital Library

[29]

Toledo, S., 2003. TAUCS: A library of sparse linear solvers. version 2.2.

[30]

Ullman, S. 1979. The interpretation of structure from motion. Biological Sciences B 203, 1153, 405--426.

[31]

Vedula, S., Baker, S., Rander, P., Collins, R. T., and Kanade, T. 1999. Three-Dimensional Scene Flow. In International Conference on Computer Vision, IEEE, 722--729.

Digital Library

[32]

Wand, M., Jenke, P., Huang, Q., Bokeloh, M., Guibas, L. J., and Schilling, A. 2007. Reconstruction of deforming geometry from time-varying point clouds. In Symposium on Geometry Processing, ACM/Eurographics, 49--58.

Digital Library

[33]

Wang, Y., Gupta, M., 0002, S. Z., Wang, S., Gu, X., Samaras, D., and Huang, P. 2005. High Resolution Tracking of Non-Rigid 3D Motion of Densely Sampled Data Using Harmonic Maps. In International Conference on Computer Vision, IEEE, 388--395.

Digital Library

[34]

White, R., Crane, K., and Forsyth, D. A. 2007. Capturing and animating occluded cloth. In Siggraph, ACM, 34.

Digital Library

[35]

Zhang, L., Brian Curless, B., and Seitz, S. M. 2003. Spacetime faces: high resolution capture for modeling and animation. In Computer Vision and Pattern Recognition, IEEE, 367--374.

[36]

Zhang, L., Snavely, N., Curless, B., and Seitz, S. M. 2004. Spacetime faces: high resolution capture for modeling and animation. Transactions on Graphics 23, 3, 548--558.

Digital Library

Cited By

Yu TGuo KXu FDong YSu ZZhao JLi JDai QLiu Y(2017)BodyFusion: Real-Time Capture of Human Motion and Surface Geometry Using a Single Depth Camera2017 IEEE International Conference on Computer Vision (ICCV)10.1109/ICCV.2017.104(910-919)Online publication date: Oct-2017
https://doi.org/10.1109/ICCV.2017.104
Li HWan GLi HSharf AXu KChen BKobbelt LOvsjanikov MPanozzo D(2016)Mobility fitting using 4D RANSACProceedings of the Symposium on Geometry Processing10.5555/3061451.3061462(79-88)Online publication date: 20-Jun-2016
https://dl.acm.org/doi/10.5555/3061451.3061462
Li HWan GLi HSharf AXu KChen B(2016)Mobility Fitting using 4D RANSACComputer Graphics Forum10.1111/cgf.1296535:5(79-88)Online publication date: 15-Aug-2016
https://doi.org/10.1111/cgf.12965
Show More Cited By

Index Terms

Space-time surface reconstruction using incompressible flow
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        3D imaging
  2. Computer graphics
    1. Animation

Recommendations

Space-time surface reconstruction using incompressible flow

We introduce a volumetric space-time technique for the reconstruction of moving and deforming objects from point data. The output of our method is a four-dimensional space-time solid, made up of spatial slices, each of which is a three-dimensional solid ...
Surface Reconstruction from 3D Point Clouds
LV surface reconstruction from sparse TMRI using Laplacian surface deformation and optimization
ISBI'09: Proceedings of the Sixth IEEE international conference on Symposium on Biomedical Imaging: From Nano to Macro

We propose a novel framework to reconstruct the left ventricle (LV)'s 3D surface from sparse tagged-MRI (tMRI). First we acquire an initial surface mesh from a dense tMRI. Then landmarks are calculated both on contours of a specific new tMRI data and on ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH Asia '08: ACM SIGGRAPH Asia 2008 papers

December 2008

581 pages

ISBN:9781450318310

DOI:10.1145/1457515

Editor:
John C. Hart
University of Illinois at Urbana-Champaign, Urbana, IL

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SIGGRAPH '08

Sponsor:

SIGGRAPH

SIGGRAPH '08: Special Interest Group on Computer Graphics and Interactive Techniques Conference

December 10 - 13, 2008

Singapore

Acceptance Rates

SIGGRAPH Asia '08 Paper Acceptance Rate 59 of 320 submissions, 18%;

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
1,144
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yu TGuo KXu FDong YSu ZZhao JLi JDai QLiu Y(2017)BodyFusion: Real-Time Capture of Human Motion and Surface Geometry Using a Single Depth Camera2017 IEEE International Conference on Computer Vision (ICCV)10.1109/ICCV.2017.104(910-919)Online publication date: Oct-2017
https://doi.org/10.1109/ICCV.2017.104
Li HWan GLi HSharf AXu KChen BKobbelt LOvsjanikov MPanozzo D(2016)Mobility fitting using 4D RANSACProceedings of the Symposium on Geometry Processing10.5555/3061451.3061462(79-88)Online publication date: 20-Jun-2016
https://dl.acm.org/doi/10.5555/3061451.3061462
Li HWan GLi HSharf AXu KChen B(2016)Mobility Fitting using 4D RANSACComputer Graphics Forum10.1111/cgf.1296535:5(79-88)Online publication date: 15-Aug-2016
https://doi.org/10.1111/cgf.12965
Turner ECheng PZakhor A(2015)Fast, Automated, Scalable Generation of Textured 3D Models of Indoor EnvironmentsIEEE Journal of Selected Topics in Signal Processing10.1109/JSTSP.2014.23811539:3(409-421)Online publication date: Apr-2015
https://doi.org/10.1109/JSTSP.2014.2381153
Yan FSharf ALin WHuang HChen B(2014)Proactive 3D scanning of inaccessible partsACM Transactions on Graphics10.1145/2601097.260119133:4(1-8)Online publication date: 27-Jul-2014
https://dl.acm.org/doi/10.1145/2601097.2601191
Gafni NSharf ALai YMartin R(2014)3D motion completion in crowded scenesProceedings of the Symposium on Geometry Processing10.1111/cgf.12432(65-74)Online publication date: 9-Jul-2014
https://dl.acm.org/doi/10.1111/cgf.12432
Kuster CBazin JÖztireli CDeng TMartin TPopa TGross M(2014)Spatio-temporal geometry fusion for multiple hybrid cameras using moving least squares surfacesComputer Graphics Forum10.1111/cgf.1228533:2(1-10)Online publication date: 1-May-2014
https://dl.acm.org/doi/10.1111/cgf.12285
Li HVouga EGudym ALuo LBarron JGusev G(2013)3D self-portraitsACM Transactions on Graphics10.1145/2508363.250840732:6(1-9)Online publication date: 1-Nov-2013
https://dl.acm.org/doi/10.1145/2508363.2508407
Oswald MCremers D(2013)A Convex Relaxation Approach to Space Time Multi-view 3D ReconstructionProceedings of the 2013 IEEE International Conference on Computer Vision Workshops10.1109/ICCVW.2013.46(291-298)Online publication date: 2-Dec-2013
https://dl.acm.org/doi/10.1109/ICCVW.2013.46
Turner EZakhor A(2013)Watertight Planar Surface Meshing of Indoor Point-Clouds with Voxel CarvingProceedings of the 2013 International Conference on 3D Vision10.1109/3DV.2013.14(41-48)Online publication date: 29-Jun-2013
https://dl.acm.org/doi/10.1109/3DV.2013.14
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents