article

Constraint-based motion optimization using a statistical dynamic model

Authors:

Jessica K. HodginsAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 26, Issue 3

Pages 8 - es

https://doi.org/10.1145/1276377.1276387

Published: 29 July 2007 Publication History

Abstract

In this paper, we present a technique for generating animation from a variety of user-defined constraints. We pose constraint-based motion synthesis as a maximum a posterior (MAP) problem and develop an optimization framework that generates natural motion satisfying user constraints. The system automatically learns a statistical dynamic model from motion capture data and then enforces it as a motion prior. This motion prior, together with user-defined constraints, comprises a trajectory optimization problem. Solving this problem in the low-dimensional space yields optimal natural motion that achieves the goals specified by the user. We demonstrate the effectiveness of this approach by generating whole-body and facial motion from a variety of spatial-temporal constraints.

Supplementary Material

JPG File (pps008.jpg)

Download
9.90 KB

MP4 File (pps008.mp4)

Download
34.10 MB

References

[1]

Abe, Y., Liu, C. K., and Popović, Z. 2004. Momentum-based parameterization of dynamic character motion. In Proceedings of the 2004 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 173--182.

Digital Library

[2]

Arikan, O., and Forsyth, D. A. 2002. Interactive motion generation from examples. In ACM Transactions on Graphics. 21(3):483--490.

Digital Library

[3]

Bazaraa, M. S., Sherali, H. D., and Shetty, C. 1993. Nonl-inear Programming: Theory and Algorithms. John Wiley and Sons Ltd. 2nd Edition.

[4]

Bishop, C. 1996. Neural Network for Pattern Recognition. Cambridge University Press.

Digital Library

[5]

Brand, M., and Hertzmann, A. 2000. Style machines. In Proceedings of ACM ACM SIGGRAPH 2000. 183--192.

Digital Library

[6]

Brand, M. E. 1999. Voice puppetry. In Proceedings of ACM SIGGRAPH 1999. 21--28.

Digital Library

[7]

Bregler, C., Covell, M., and Slaney, M. 1997. Video rewrite: Driving visual speech with audio. In Proceedings of ACM SIGGRAPH 1997. 353--360.

Digital Library

[8]

Chai, J., and Hodgins, J. 2005. Performance animation from low-dimensional control signals. In ACM Transactions on Graphics. 24(3):686--696.

Digital Library

[9]

Chai, J., Xiao, J., and Hodgins, J. 2003. Vision-based control of 3d facial animation. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 193--206.

Digital Library

[10]

Fang, A., and Pollard, N. S. 2003. Efficient synthesis of physically valid human motion. In ACM Transactions on Graphics. 22(3):417--426.

Digital Library

[11]

Galata, A., Johnson, N., and Hogg, D. 2001. Learning variable length markov models of behavior. In Computer Vision and Image Understanding (CVIU) Journal. 81(3):398--413.

Digital Library

[12]

Gleicher, M. 1998. Retargeting motion to new characters. In Proceedings of ACM SIGGRAPH 1998. 33--42.

Digital Library

[13]

Grochow, K., Martin, S. L., Hertzmann, A., and Popović, Z. 2004. Style-based inverse kinematics. In ACM Transactions on Graphics. 23(3):522--531.

Digital Library

[14]

Grzeszczuk, R., Terzopoulos, D., and Hinton, G. 1998. Neuroanimator: Fast neural network emulation and control of physics-based models. In Proceedings of ACM SIGGRAPH 1998. 9--20.

Digital Library

[15]

Kovar, L., and Gleicher, M. 2004. Automated extraction and parameterization of motions in large data sets. In ACM Transactions on Graphics. 23(3):559--568.

Digital Library

[16]

Kovar, L., Gleicher, M., and Pighin, F. 2002. Motion graphs. In ACM Transactions on Graphics. 21(3):473--482.

Digital Library

[17]

Lee, J., Chai, J., Reitsma, P., Hodgins, J., and Pollard, N. 2002. Interactive control of avatars animated with human motion data. In ACM Transactions on Graphics. 21(3):491--500.

Digital Library

[18]

Li, Y., Wang, T., and Shum, H.-Y. 2002. Motion texture: A two-level statistical model for character synthesis. In ACM Transactions on Graphics. 21(3):465--472.

Digital Library

[19]

Liu, C. K., and Popović, Z. 2002. Synthesis of complex dynamic character motion from simple animations. In ACM Transactions on Graphics. 21(3):408--416.

Digital Library

[20]

Liu, K., Hertzmann, A., and Popović, Z. 2005. Learning physics-based motion style with nonlinear inverse optimization. In ACM Transactions on Graphics. 23(3):1071--1081.

Digital Library

[21]

Ljung, L. 1999. System identification: Theory for the user. Prentice Hall PTR. 2nd Edition.

Digital Library

[22]

Molina Tanco, L., and Hilton, A. 2000. Realistic synthesis of novel human movements from a database of motion capture examples. In Proceedings of the Workshop on Human Motion. 137--142.

Digital Library

[23]

Mukai, T., and Kuriyama, S. 2005. Geostatistical motion interpolation. In ACM Transactions on Graphics. 24(3):1062--1070.

Digital Library

[24]

Palm, W. J. 1999. Modeling, analysis, and control of dynamic systems. Wiley Publishers. 2nd Edition.

[25]

Pavlović, V., Rehg, J. M., and MacCormick, J. 2000. Learning switching linear models of human motion. In Advances in Neural Information Processing Systems 13, 981--987.

[26]

Popović, Z., and Witkin, A. P. 1999. Physically based motion transformation. In Proceedings of ACM SIGGRAPH 1999. 11--20.

Digital Library

[27]

Rose, C., Cohen, M. F., and Bodenheimer, B. 1998. Verbs and adverbs: Multidimensional motion interpolation. In IEEE Computer Graphics and Applications. 18(5):32--40.

Digital Library

[28]

Rose, C. F., Sloan, P.-P. J., and Cohen, M. F. 2001. Artist-directed inverse-kinematics using radial basis function interpolation. In Computer Graphics Forum. 20(3):239--250.

[29]

Safonova, A., and Hodgins, J. K. 2007. Construction and optimal search of interpolated motion graphs. In ACM Transactions on Graphics. 26(3).

Digital Library

[30]

Safonova, A., Hodgins, J., and Pollard, N. 2004. Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces. In ACM Transactions on Graphics. 23(3):514--521.

Digital Library

[31]

Soatto, S., Doretto, G., and Wu, Y. N. 2001. Dynamic textures. In Proceedings of International Conference on Computer Vision (ICCV'01). 2:439--446.

[32]

Urtasun, R., Fleet, D. J., and Fua, P. 2006. Temporal motion models for monocular and multiview 3d human body tracking. In Computer Vision and Image Understanding (CVIU). 104(2):157--177.

Digital Library

[33]

Vicon Systems, 2004. http://www.vicon.com.

[34]

Witkin, A., and Kass, M. 1988. Spacetime constraints. In Proceedings of ACM SIGGRAPH 1998. 159--168.

Digital Library

[35]

Zhang, L., Snavely, N., Curless, B., and Seitz, S. M. 2004. Spacetime faces: high resolution capture for modeling and animation. In ACM Transactions on Graphics. 23(3):548--558.

Digital Library

Cited By

Chai ZQin H(2025)Dynamic Motion Transition: A Hybrid Data-Driven and Model-Driven Method for Human Pose TransitionsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337242131:3(1848-1861)Online publication date: 1-Mar-2025
https://dl.acm.org/doi/10.1109/TVCG.2024.3372421
Xu RTran VNayar SKrishnan G(2024)DanceCraft: A Music-Reactive Real-time Dance Improv SystemProceedings of the 9th International Conference on Movement and Computing10.1145/3658852.3659078(1-10)Online publication date: 30-May-2024
https://dl.acm.org/doi/10.1145/3658852.3659078
Qin JYan PAn B(2024)Robust Diffusion‐based Motion In‐betweeningComputer Graphics Forum10.1111/cgf.1526043:7Online publication date: 7-Nov-2024
https://doi.org/10.1111/cgf.15260
Show More Cited By

Index Terms

Constraint-based motion optimization using a statistical dynamic model
1. Computing methodologies
  1. Computer graphics
    1. Animation
    2. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Graphics input devices

Recommendations

Constraint-based motion optimization using a statistical dynamic model
SIGGRAPH '07: ACM SIGGRAPH 2007 papers

In this paper, we present a technique for generating animation from a variety of user-defined constraints. We pose constraint-based motion synthesis as a maximum a posterior (MAP) problem and develop an optimization framework that generates natural ...
Animating blendshape faces by cross-mapping motion capture data
I3D '06: Proceedings of the 2006 symposium on Interactive 3D graphics and games

Animating 3D faces to achieve compelling realism is a challenging task in the entertainment industry. Previously proposed face transfer approaches generally require a high-quality animated source face in order to transfer its motion to new 3D faces. In ...
A novel automatic motion capture data recognition method based on statistics learning and subspace

In this paper, we propose a motion recognition method based on motion capture data. To recognise motion type, a generalised Isomap non-linear dimension reduction based on Radius Basis Function (RBF) networks and feature extraction is used to project ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 26, Issue 3

July 2007

976 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1276377

Issue’s Table of Contents

Copyright © 2007 ACM.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 July 2007

Published in TOG Volume 26, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

76
Total Citations
View Citations
2,080
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)2

Reflects downloads up to 23 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Chai ZQin H(2025)Dynamic Motion Transition: A Hybrid Data-Driven and Model-Driven Method for Human Pose TransitionsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337242131:3(1848-1861)Online publication date: 1-Mar-2025
https://dl.acm.org/doi/10.1109/TVCG.2024.3372421
Xu RTran VNayar SKrishnan G(2024)DanceCraft: A Music-Reactive Real-time Dance Improv SystemProceedings of the 9th International Conference on Movement and Computing10.1145/3658852.3659078(1-10)Online publication date: 30-May-2024
https://dl.acm.org/doi/10.1145/3658852.3659078
Qin JYan PAn B(2024)Robust Diffusion‐based Motion In‐betweeningComputer Graphics Forum10.1111/cgf.1526043:7Online publication date: 7-Nov-2024
https://doi.org/10.1111/cgf.15260
Oreshkin BValkanas AHarvey FMénard LBocquelet FCoates M(2024)Motion In-Betweening via Deep $\Delta$Δ-InterpolatorIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.330910730:8(5693-5704)Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1109/TVCG.2023.3309107
Hu MFan DWan LXu WWang S(2024)Keyframe control for customizable choreography with style maintenanceComputers and Electrical Engineering10.1016/j.compeleceng.2024.109267117:COnline publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1016/j.compeleceng.2024.109267
Yang HZhang ZWang YGuan DGuo KChang YZhang Y(2024)A U-Shaped Spatio-Temporal Transformer as Solver for Motion CaptureComputational Visual Media10.1007/978-981-97-2095-8_15(274-294)Online publication date: 30-Mar-2024
https://doi.org/10.1007/978-981-97-2095-8_15
Tao HHou SZou CBao HXu W(2023)Neural Motion GraphSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618181(1-11)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.1145/3610548.3618181
Tang XWu LWang HHu BGong XLiao YLi SKou QJin X(2023)RSMT: Real-time Stylized Motion Transition for CharactersACM SIGGRAPH 2023 Conference Proceedings10.1145/3588432.3591514(1-10)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1145/3588432.3591514
Qin JZheng YZhou K(2022)Motion In-Betweening via Two-Stage TransformersACM Transactions on Graphics10.1145/3550454.355545441:6(1-16)Online publication date: 30-Nov-2022
https://dl.acm.org/doi/10.1145/3550454.3555454
Tang XWang HHu BGong XYi RKou QJin X(2022)Real-time controllable motion transition for charactersACM Transactions on Graphics10.1145/3528223.353009041:4(1-10)Online publication date: 22-Jul-2022
https://dl.acm.org/doi/10.1145/3528223.3530090
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents