research-article

Markerless garment capture

Authors:

Wolfgang Heidrich,

Tamy BoubekeurAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 27, Issue 3

Pages 1 - 9

https://doi.org/10.1145/1360612.1360698

Published: 01 August 2008 Publication History

Abstract

A lot of research has recently focused on the problem of capturing the geometry and motion of garments. Such work usually relies on special markers printed on the fabric to establish temporally coherent correspondences between points on the garment's surface at different times. Unfortunately, this approach is tedious and prevents the capture of off-the-shelf clothing made from interesting fabrics.

In this paper, we describe a marker-free approach to capturing garment motion that avoids these downsides. We establish temporally coherent parameterizations between incomplete geometries that we extract at each timestep with a multiview stereo algorithm. We then fill holes in the geometry using a template. This approach, for the first time, allows us to capture the geometry and motion of unpatterned, off-the-shelf garments made from a range of different fabrics.

Supplementary Material

MOV File (a99-bradley.mov)

Download
24.89 MB

References

[1]

Allen, B., Curless, B., and Popović, Z. 2003. The space of human body shapes: reconstruction and parameterization from range scans. ACM Trans. Graphics (Proc. SIGGRAPH), 587--594.

Digital Library

[2]

Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., and Davis, J. 2005. SCAPE: shape completion and animation of people. ACM Trans. Graphics (Proc. SIGGRAPH), 408--416.

Digital Library

[3]

Bhat, K., Twigg, C., Hodgins, J., Khosla, P., Popovic, Z., and Seitz., S. 2003. Estimating cloth simulation parameters from video. In Proc. SCA, 37--51.

Digital Library

[4]

Bickel, B., Botsch, M., Angst, R., Matusik, W., Otaduy, M., Pfister, H., and Gross, M. 2007. Multi-scale capture of facial geometry and motion. ACM Trans. Graphics (Proc. SIGGRAPH), 33.

Digital Library

[5]

Boubekeur, T., Reuter, P., and Schlick, C. 2005. Visualization of point-based surfaces with locally reconstructed subdivision surfaces. In Proc. Shape Modeling International.

Digital Library

[6]

Bradley, D., Boubekeur, T., and Heidrich, W. 2008. Accurate multi-view reconstruction using robust binocular stereo and surface meshing. In Proc. CVPR.

[7]

Cheung, K., Baker, S., and Kanade, T. 2005. Shape-from-silhouette across time part ii: Applications to human modeling and markerless motion tracking. IJCV 63, 3, 225--245.

Digital Library

[8]

de Aguiar, E., Theobalt, C., Stoll, C., and Seidel, H.-P. 2007. Marker-less deformable mesh tracking for human shape and motion capture. In Proc. CVPR, 1--8.

[9]

Fiala, M., and Shu, C. 2005. Fully automatic camera calibration using self-identifying calibration targets. Tech. Rep. NRC-48306 ERB-1130, National Research Council of Canada.

[10]

Fischler, M., and Bolles, R. 1981. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 6, 381--395.

Digital Library

[11]

Floater, M. 2003. Mean value coordinates. Comput. Aided Geom. Des. 20, 1, 19--27.

Digital Library

[12]

Goldenthal, R., Harmon, D., Fattal, R., Bercovier, M., and Grinspun, E. 2007. Efficient simulation of inextensible cloth. ACM Trans. Graphics (Proc. SIGGRAPH), 49.

Digital Library

[13]

Guskov, I., Klibanov, S., and Bryant, B. 2003. Trackable surfaces. In Proc. SCA, 251--257.

Digital Library

[14]

Hasler, N., Asbach, M., Rosenhahn, B., Ohm, J.-R., and Seidel, H.-P. 2006. Physically based tracking of cloth. In Proc. Workshop on Vision, Modeling, and Visualization, 49--56.

[15]

Hernandez, C., Vogiatzis, G., Brostow, G. J., Stenger, B., and Cipolla, R. 2007. Non-rigid photometric stereo with colored lights. In Proc. ICCV.

[16]

Kraevoy, V., and Sheffer, A. 2004. Cross-parameterization and compatible remeshing of 3d models. ACM Trans. Graphics (Proc. SIGGRAPH), 861--869.

Digital Library

[17]

Kraevoy, V., and Sheffer, A. 2005. Template-based mesh completion. In Proc. SGP, 13.

Digital Library

[18]

Mitra, N., Flöry, S., Ovsjanikov, M., Gelfand, N., Guibas, L., and Pottmann, H. 2007. Dynamic geometry registration. In Proc. SGP, 173--182.

Digital Library

[19]

Mori, Y., and Igarashi, T. 2007. Plushie: an interactive design system for plush toys. ACM Trans. Graphics (Proc. SIGGRAPH), 45.

Digital Library

[20]

MVIEW. http://vision.middlebury.edu/mview/.

[21]

Praun, E., Sweldens, W., and Schröder, P. 2001. Consistent mesh parameterizations. In ACM Trans. Graphics (Proc. SIGGRAPH), 179--184.

Digital Library

[22]

Pritchard, D., and Heidrich, W. 2003. Cloth motion capture. In Proc. Eurographics, 263--271.

Digital Library

[23]

Rosenhahn, B., Kersting, U., Powell, K., Klette, R., Klette, G., and Seidel, H.-P. 2007. A system for articulated tracking incorporating a clothing model. Machine Vision and Applications 18, 1, 25--40.

Digital Library

[24]

Scholz, V., and Magnor, M. A. 2004. Cloth motion from optical flow. In Proc. Vision, Modeling and Visualization 2004, 117--124.

[25]

Scholz, V., Stich, T., Keckeisen, M., Wacker, M., and Magnor, M. 2005. Garment motion capture using color-coded patterns. In Proc. Eurographics, 439--448.

Digital Library

[26]

Schreiner, J., Asirvatham, A., Praun, E., and Hoppe, H. 2004. Inter-surface mapping. ACM Trans. Graphics (Proc. SIGGRAPH), 870--877.

Digital Library

[27]

Seitz, S., Curless, B., Diebel, J., Scharstein, D., and Szeliski, R. 2006. A comparison and evaluation of multi-view stereo reconstruction algorithms. In Proc. CVPR, 519--528.

Digital Library

[28]

Sheffer, A., and Kraevoy, V. 2004. Pyramid Coordinates for morphing and deformation. In Proc. 3DPVT, 68--75.

[29]

Shewchuk, J. 1996. Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator. In Applied Computational Geometry: Towards Geometric Engineering, M. C. Lin and D. Manocha, Eds., vol. 1148 of Lecture Notes in Computer Science. Springer-Verlag, 203--222.

Digital Library

[30]

Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. In Proc. ICCV, 839.

Digital Library

[31]

Wand, M., Jenke, P., Huang, Q., Bokeloh, M., Guibas, L., and Schilling, A. 2007. Reconstruction of deforming geometry from time-varying point clouds. In Proc. SGP, 49--58.

Digital Library

[32]

White, R., Crane, K., and Forsyth, D. 2007. Capturing and animating occluded cloth. ACM Trans. Graphics (Proc. SIGGRAPH), 34.

Digital Library

[33]

Zhang, L., Snavely, N., Curless, B., and Seitz, S. M. 2004. Spacetime faces: high resolution capture for modeling and animation. ACM Trans. Graphics (Proc. SIGGRAPH), 548--558.

Digital Library

Cited By

Gao QTaketomi T(2023)Garment Model Extraction from Clothed Mannequin ScanComputer Graphics Forum10.1111/cgf.1480442:6Online publication date: 14-May-2023
https://doi.org/10.1111/cgf.14804
Casado‐Elvira ATrinidad MCasas D(2023)PERGAMO: Personalized 3D Garments from Monocular VideoComputer Graphics Forum10.1111/cgf.1464441:8(293-304)Online publication date: 20-Mar-2023
https://doi.org/10.1111/cgf.14644
Su ZYu TWang YLiu Y(2023)DeepCloth: Neural Garment Representation for Shape and Style EditingIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2022.316856945:2(1581-1593)Online publication date: 1-Feb-2023
https://doi.org/10.1109/TPAMI.2022.3168569
Show More Cited By

Index Terms

Markerless garment capture

Recommendations

Markerless Shape and Motion Capture From Multiview Video Sequences

We propose a new markerless shape and motion capture approach from multiview video sequences. The shape recovery method consists of two steps: separating and merging. In the separating step, the depth map represented with a point cloud for each view is ...
Garment-based motion capture (GaMoCap): high-density capture of human shape in motion

This paper presents a new motion capture (MoCap) system, the garment-based motion capture system--GaMoCap. The key feature is the use of an easily wearable garment printed with colour-coded pattern and a generic multicamera setup with standard video ...
Using motion capture for interactive motion editing
VRCAI '14: Proceedings of the 13th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

Motion capture technology has been widely used for creating character motions. Motion editing is usually also required to adjust captured motions. Because character poses which include joint rotations, body positions, and orientations are high-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 27, Issue 3

August 2008

844 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1360612

Issue’s Table of Contents

Copyright © 2008 ACM.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2008

Published in TOG Volume 27, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

127
Total Citations
View Citations
1,933
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)1

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gao QTaketomi T(2023)Garment Model Extraction from Clothed Mannequin ScanComputer Graphics Forum10.1111/cgf.1480442:6Online publication date: 14-May-2023
https://doi.org/10.1111/cgf.14804
Casado‐Elvira ATrinidad MCasas D(2023)PERGAMO: Personalized 3D Garments from Monocular VideoComputer Graphics Forum10.1111/cgf.1464441:8(293-304)Online publication date: 20-Mar-2023
https://doi.org/10.1111/cgf.14644
Su ZYu TWang YLiu Y(2023)DeepCloth: Neural Garment Representation for Shape and Style EditingIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2022.316856945:2(1581-1593)Online publication date: 1-Feb-2023
https://doi.org/10.1109/TPAMI.2022.3168569
Yoon JYu ZPark JPark H(2023)HUMBI: A Large Multiview Dataset of Human Body Expressions and Benchmark ChallengeIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2021.313876245:1(623-640)Online publication date: 1-Jan-2023
https://doi.org/10.1109/TPAMI.2021.3138762
Xie XBhatnagar BPons-Moll G(2023)Visibility Aware Human-Object Interaction Tracking from Single RGB Camera2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.00461(4757-4768)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.00461
Su WChen SChin CHsiao H(2023)Virtual Garment Fitting Through Parsing and Context-Aware Generative Adversarial Networks with Discriminator Group2023 Asia Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC)10.1109/APSIPAASC58517.2023.10317305(1732-1738)Online publication date: 31-Oct-2023
https://doi.org/10.1109/APSIPAASC58517.2023.10317305
Liu XLi JLu G(2023)Wrinkles Realistic Clothing Reconstruction by Combining Implicit and Explicit MethodComputer-Aided Design10.1016/j.cad.2023.103514160(103514)Online publication date: Jul-2023
https://doi.org/10.1016/j.cad.2023.103514
Xiang DBagautdinov TStuyck TPrada FRomero JXu WSaito SGuo JSmith BShiratori TSheikh YHodgins JWu C(2022)Dressing AvatarsACM Transactions on Graphics10.1145/3550454.355545641:6(1-15)Online publication date: 30-Nov-2022
https://dl.acm.org/doi/10.1145/3550454.3555456
Halimi OStuyck TXiang DBagautdinov TWen HKimmel RShiratori TWu CSheikh YPrada F(2022)Pattern-Based Cloth Registration and Sparse-View AnimationACM Transactions on Graphics10.1145/3550454.355544841:6(1-17)Online publication date: 30-Nov-2022
https://dl.acm.org/doi/10.1145/3550454.3555448
Su ZWan WYu TLiu LFang LWang WLiu Y(2022)MulayCap: Multi-Layer Human Performance Capture Using a Monocular Video CameraIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.302776328:4(1862-1879)Online publication date: 1-Apr-2022
https://doi.org/10.1109/TVCG.2020.3027763
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents