research-article

Learning skeletons for shape and pose

Authors:

Thorsten Thormählen,

Bodo Rosenhahn,

Hans-Peter SeidelAuthors Info & Claims

I3D '10: Proceedings of the 2010 ACM SIGGRAPH symposium on Interactive 3D Graphics and Games

Pages 23 - 30

https://doi.org/10.1145/1730804.1730809

Published: 19 February 2010 Publication History

Abstract

In this paper a method for estimating a rigid skeleton, including skinning weights, skeleton connectivity, and joint positions, given a sparse set of example poses is presented. In contrast to other methods, we are able to simultaneously take examples of different subjects into account, which improves the robustness of the estimation. It is additionally possible to generate a skeleton that primarily describes variations in body shape instead of pose. The shape skeleton can then be combined with a regular pose varying skeleton. That way pose and body shape can be controlled simultaneously but separately. As this skeleton is technically still just a skinned rigid skeleton, compatibility with major modelling packages and game engines is retained. We further present an approach for synthesizing a suitable bind shape that additionally improves the accuracy of the generated model.

References

[1]

Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., and Davis, J. 2005. Scape: shape completion and animation of people. ACM ToG 24, 3, 408--416.

Digital Library

[2]

Au, O. K.-C., Tai, C.-L., Chu, H.-K., Cohen-Or, D., and Lee, T.-Y. 2008. Skeleton extraction by mesh contraction. In ACM SIGGRAPH Papers, ACM Press, New York, NY, USA, 1--10.

Digital Library

[3]

Bai, X., and Liu, W.-Y. 2007. Skeleton pruning by contour partitioning with discrete curve evolution. IEEE Trans. Pattern Anal. Mach. Intell. 29, 3, 449--462. Member-Latecki, Longin Jan.

Digital Library

[4]

Baran, I., and Popović, J. 2007. Automatic rigging and animation of 3d characters. ACM ToG 26, 3, 72.

Digital Library

[5]

de Aguiar, E., Theobalt, C., Thrun, S., and Seidel, H.-P. 2008. Automatic Conversion of Mesh Animations into Skeleton-based Animations. vol. 27, 389--397.

[6]

Harary, F. 1994. Graph Theory. Addison-Wesley.

[7]

Hasler, N., Stoll, C., Sunkel, M., Rosenhahn, B., and Seidel, H.-P. 2009. A statistical model of human pose and body shape. In Eurographics, no. 28.

[8]

He, Y., Xiao, X., and Seah, H.-S. 2009. Harmonic 1-form based skeleton extraction from examples. Graphical Models 71, 49--62.

Digital Library

[9]

Higham, N. J. 1986. Computing the polar decomposition---with applications. SIAM Journal of Scientific and Statistical Computing 7, 4, 1160--1174.

Digital Library

[10]

James, D. L., and Twigg, C. D. 2005. Skinning mesh animations. ACM SIGGRAPH Papers 24, 3 (Aug.).

Digital Library

[11]

Katz, S., and Tal, A. 2003. Hierarchical mesh decomposition using fuzzy clustering and cuts. ACM Trans. Graph. 22, 3, 954--961.

Digital Library

[12]

Kruskal, J. B. 1956. On the shortest spanning subtree of a graph and the traveling salesman problem. In Proceedings of the American Mathematical Society, American Mathematical Society, vol. 7, 48--50.

[13]

Magnenat-Thalmann, N., Seo, H., and Cordier, F. 2003. Automatic modeling of animatable virtual humans -- a survey. In 4th International Conference on 3D Digital Imaging and Modeling (3DIM 2003), 2--11.

[14]

Marquardt, D. W. 1963. An algorithm for least-squares estimation of nonlinear parameters. SIAM Journal on Applied Mathematics 11, 2, 431--441.

[15]

Mohr, A., and Gleicher, M. 2003. Building efficient, accurate character skins from examples. ACM Trans. Graph. 22, 3, 562--568.

Digital Library

[16]

Schaefer, S., and Yuksel, C. 2007. Example-based skeleton extraction. In SGP '07: Proc. Eurographics Symposium on Geometry Processing, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 153--162.

Digital Library

[17]

Seo, H., and Magnenat-Thalmann, N. 2003. An automatic modeling of human bodies from sizing parameters. In SI3D '03: Proceedings of the 2003 symposium on Interactive 3D graphics, ACM Press, New York, NY, USA, 19--26.

Digital Library

[18]

Sundar, H., Silver, D., Gagvani, N., and Dickinson, S. 2003. Skeleton based shape matching and retrieval. In SMI '03: Proceedings of the Shape Modeling International 2003, IEEE Computer Society, Washington, DC, USA, 130.

Digital Library

[19]

Tschirren, J., Palágyi, K., Reinhardt, J. M., Hoffman, E. A., and Sonka, M. 2002. Segmentation, skeletonization, and branchpoint matching -- a fully automated quantitative evaluation of human intrathoracic airway trees. In Medical Image Computing and Computer-Assisted Intervention (MICCAI 2002), Springer-Verlag, vol. 2489 of Lecture Notes in Computer Science, 12--19.

Digital Library

[20]

Weber, J. 2000. Run-time skin deformation. In Proceedings of Game Developers Conference.

[21]

Xian, X., Soon, S. H., Feng, T., Lewis, J. P., and Fong, N. 2006. A powell optimization approach for example-based skinning in a production animation environment. In Computer Animation and Social Agents, 141--150.

[22]

Xu, W., Wang, J., Yin, K., Zhou, K., van de Panne, M., Chen, F., and Guo, B. 2009. Joint-aware manipulation of deformable models. In SIGGRAPH '09: ACM SIGGRAPH 2009 papers, ACM, New York, NY, USA, 1--9.

Digital Library

[23]

Zelnik-Manor, L., and Perona, P. 2005. Self-tuning spectral clustering. In Advances in Neural Information Processing Systems 17, L. K. Saul, Y. Weiss, and L. Bottou, Eds. MIT Press, Cambridge, MA, 1601--1608.

[24]

Zhang, Y. 2009. User's guide for yall1: Your algorithms for 11 optimization. Tech. Rep. TR09-17, Rice University, May.

Cited By

Kavan LDoublestein JPrazak MCioffi MRoble D(2024)Compressed Skinning for Facial BlendshapesACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657477(1-9)Online publication date: 13-Jul-2024
https://dl.acm.org/doi/10.1145/3641519.3657477
Zhao ZXie WZuo BWang Y(2024)Skeleton Extraction for Articulated Objects With the Spherical Unwrapping ProfilesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.323937030:7(3731-3748)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2023.3239370
Moutafidou AToulatzis VFudos I(2024)Deep fusible skinning of animation sequencesThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-023-03130-340:8(5695-5715)Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1007/s00371-023-03130-3
Show More Cited By

Index Terms

Learning skeletons for shape and pose
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision representations
        Hierarchical representations
  2. Computer graphics
    1. Shape modeling

Recommendations

Computing a family of skeletons of volumetric models for shape description

Skeletons are important shape descriptors in object representation and recognition. Typically, skeletons of volumetric models are computed using iterative thinning. However, traditional thinning methods often generate skeletons with complex structures ...
From 3D Discrete Surface Skeletons to Curve Skeletons
ICIAR '08: Proceedings of the 5th international conference on Image Analysis and Recognition

An algorithm to compute the curve skeleton of a 3D object starting from its surface skeleton is presented. The voxels of the surface skeleton are suitably classified to compute the geodesic distance transform of the surface skeleton and to identify ...
Pose-Oblivious Shape Signature

A 3D shape signature is a compact representation for some essence of a shape. Shape signatures are commonly utilized as a fast indexing mechanism for shape retrieval. Effective shape signatures capture some global geometric properties which are scale, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

I3D '10: Proceedings of the 2010 ACM SIGGRAPH symposium on Interactive 3D Graphics and Games

February 2010

201 pages

ISBN:9781605589398

DOI:10.1145/1730804

Conference Chairs:
Daniel Aliaga
Purdue University
,
Manuel M. Oliveira
Universidade Federal do Rio Grande do Sul - UFRGS
,
General Chairs:
Amitabh Varshney
University of Maryland
,
Chris Wyman
University of Iowa

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 February 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Max-Planck-Center for Visual Computing and Communication

Conference

I3D '10

Sponsor:

SIGGRAPH

I3D '10: Symposium on Interactive 3D Graphics and Games

February 19 - 21, 2010

D.C., Washington

Acceptance Rates

Overall Acceptance Rate 148 of 485 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

54
Total Citations
View Citations
882
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)3

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kavan LDoublestein JPrazak MCioffi MRoble D(2024)Compressed Skinning for Facial BlendshapesACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657477(1-9)Online publication date: 13-Jul-2024
https://dl.acm.org/doi/10.1145/3641519.3657477
Zhao ZXie WZuo BWang Y(2024)Skeleton Extraction for Articulated Objects With the Spherical Unwrapping ProfilesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.323937030:7(3731-3748)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2023.3239370
Moutafidou AToulatzis VFudos I(2024)Deep fusible skinning of animation sequencesThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-023-03130-340:8(5695-5715)Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1007/s00371-023-03130-3
YAN YCHENG YCHEN ZPENG YWU SZHANG WLI JLI YGAO JZHANG WZHAI GYANG X(2023)A survey on generative 3D digital humans based on neural networks: representation, rendering, and learningSCIENTIA SINICA Informationis10.1360/SSI-2022-031953:10(1858)Online publication date: 13-Oct-2023
https://doi.org/10.1360/SSI-2022-0319
Tian YZhang HLiu YWang L(2023)Recovering 3D Human Mesh From Monocular Images: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.329885045:12(15406-15425)Online publication date: Dec-2023
https://doi.org/10.1109/TPAMI.2023.3298850
Li YZhang LQiu ZJiang YLi NMa YZhang YXu LYu J(2022)NIMBLEACM Transactions on Graphics10.1145/3528223.353007941:4(1-16)Online publication date: 22-Jul-2022
https://dl.acm.org/doi/10.1145/3528223.3530079
Li JLi PHu XYu K(2022)Learning common and label-specific features for multi-Label classification with correlation informationPattern Recognition10.1016/j.patcog.2021.108259121:COnline publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1016/j.patcog.2021.108259
Akcay SBreckon T(2022)Towards automatic threat detectionPattern Recognition10.1016/j.patcog.2021.108245122:COnline publication date: 1-Feb-2022
https://dl.acm.org/doi/10.1016/j.patcog.2021.108245
Li RTanke JVo MZollhöfer MGall JKanazawa ALassner C(2022)TAVA: Template-free Animatable Volumetric ActorsComputer Vision – ECCV 202210.1007/978-3-031-19824-3_25(419-436)Online publication date: 11-Nov-2022
https://doi.org/10.1007/978-3-031-19824-3_25
Huang ZHan RHuang JYin HQin ZWang Z(2021)Automatically Generate Rigged Character from Single ImageProceedings of the 3rd ACM International Conference on Multimedia in Asia10.1145/3469877.3490565(1-5)Online publication date: 1-Dec-2021
https://dl.acm.org/doi/10.1145/3469877.3490565
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents