Article

Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces

Authors:

Jessica K. Hodgins,

Nancy S. PollardAuthors Info & Claims

SIGGRAPH '04: ACM SIGGRAPH 2004 Papers

Pages 514 - 521

https://doi.org/10.1145/1186562.1015754

Published: 01 August 2004 Publication History

Abstract

Optimization is an appealing way to compute the motion of an animated character because it allows the user to specify the desired motion in a sparse, intuitive way. The difficulty of solving this problem for complex characters such as humans is due in part to the high dimensionality of the search space. The dimensionality is an artifact of the problem representation because most dynamic human behaviors are intrinsically low dimensional with, for example, legs and arms operating in a coordinated way. We describe a method that exploits this observation to create an optimization problem that is easier to solve. Our method utilizes an existing motion capture database to find a low-dimensional space that captures the properties of the desired behavior. We show that when the optimization problem is solved within this low-dimensional subspace, a sparse sketch can be used as an initial guess and full physics constraints can be enabled. We demonstrate the power of our approach with examples of forward, vertical, and turning jumps; with running and walking; and with several acrobatic flips.

Supplementary Material

MOV File (pps038.mov)

Download
11.81 KB

References

[1]

ALBRO, J. V., SOHL, G. A., AND BOBROW, J. E. 2000. On the computation of optimal high-dives. In Proc. IEEE Intl. Conference on Robotics and Automation, 3958--3963.

[2]

ANDERSON, F. C., AND PANDY, M. G. 1999. A dynamic optimization solution for vertical jumping in three dimensions. Computer Methods in Biomechanics and Biomedical Engineering, 2, 201--231.

[3]

BRAND, M., AND HERTZMANN, A. 2000. Style machines. In Proc. of SIGGRAPH 2000, 183--192.

Digital Library

[4]

CRAWFORD, L. S., AND SASTRY, S. S. 1995. Biological motor control approaches for a planar diver. In Proc. IEEE Conference on Decision and Control, 3881--3886.

[5]

DASGUPTA, A., AND NAKAMURA, Y. 1999. Making feasible walking motion of humanoid robots from human motion capture data. In Proc. IEEE Intl. Conference on Robotics and Automation, 1044--1049.

[6]

DE LA TORRE, F., AND BLACK, M. J. 2003. A framework for robust subspace learning. In Intl. Journal of Computer Vision, vol. 54, 117--142.

Digital Library

[7]

FANG, A. C., AND POLLARD, N. S. 2003. Efficient synthesis of physically valid human motion. ACM Trans. on Graphics 22, 3, 417--426.

Digital Library

[8]

FOURER, R., GAY, D., AND KERNIGHAN, B., 1989. AMPL: A mathematical programming language.

[9]

FUKUNAGA, K. 1989. Statistical pattern recognition - 2nd edition. John Hopkins University Press, Baltimore.

Digital Library

[10]

GILL, P. E., MURRAY, W., AND SAUNDERS, M. A. 1997. SNOPT: An SQP algorithm for large-scale constrained optimization. Tech. Rep. NA--97--2, San Diego, CA.

[11]

GLEICHER, M. 1997. Motion editing with spacetime constraints. In Proc. of the 1997 Symposium on Interactive 3D Graphics, 139--148.

Digital Library

[12]

GRZESZCZUK, R., TERZOPOULOS, D., AND HINTON, G. 1998. Neuroanimator: Fast neural network emulation and control of physics-based models. In Proc. of SIGGRAPH 98, 9--20.

Digital Library

[13]

HARDT, M. 1999. Multibody Dynamical Algorithms, Numerical Optimal Control, with Detailed Studies in the Control of Jet Engine Compressors and Biped Walking. PhD thesis, University of California San Diego.

Digital Library

[14]

HUANG, G., LO, J., AND METAXAS, D. 2000. Human motion planning based on recurive dynamics and optimal control techniques. In Proc. of Computer Graphics International 2000, 19--28.

Digital Library

[15]

JAMES, D. L., AND FATAHALIAN, K. 2003. Precomputing interactive dynamic deformable scenes. ACM Trans. on Graphics, 879--887.

Digital Library

[16]

JENKINS, O. C., AND MATARIC, M. J. 2002. Deriving action and behavior primitives from human motion data. In IEEE/RSJ Intl. Conference on Intelligent Robots and Systems (IROS), 2551--2556.

[17]

JOLLIFFE, I. 1986. Principal component analysis. Springer Verlag.

[18]

KO, H., AND BADLER, N. I. 1996. Animating human locomotion with inverse dynamics. In IEEE Computer Graphics and Applications, 50--59.

Digital Library

[19]

KOREIN, J., AND BADLER, N. 1982. Techniques for generating the goal-directed motion of articulated structures. 71--81.

[20]

LALL, S. P., KRYSL, P., AND MARSDEN, J. E. 2003. Structure-preserving model reduction for mechanical systems. In Physica D 184, 304--318.

[21]

LEE, J., AND SHIN, S. Y. 1999. A hierarchical approach to interactive motion editing for human-like figures. In Proc. of SIGGRAPH 99, 39--48.

Digital Library

[22]

LI, Y., WANG, T., AND SHUM, H.-Y. 2002. Motion texture: a two-level statistical model for character motion synthesis. ACM Trans. on Graphics, 465--472.

Digital Library

[23]

LIU, Z., AND COHEN, M. 1994. Decomposition of linked figure motion: Diving. In 5th Eurographics Workshop on Animation and Simulation.

[24]

LIU, Z., AND COHEN, M. F. 1995. Keyframe motion optimization by relaxing speed and timing. In 6th Eurographics Workshop on Animation and Simulation, 144--153.

[25]

LIU, C. K., AND POPOVIĆ, Z. 2002. Synthesis of complex dynamic character motion from simple animations. ACM Trans. on Graphics 21, 3, 408--416.

Digital Library

[26]

PANDY, M. G., AND ANDERSON, F. C. 2000. Dynamic simulation of human movement using large-scale models of the body. In Proc. IEEE Intl. Conference on Robotics and Automation, 676--681.

[27]

PENTLAND, A., AND WILLIAMS, J. 1989. Good vibrations: Modal dynamics for graphics and animation. In Computer Graphics (Proc. of SIGGRAPH 89), vol. 23, 215--222.

Digital Library

[28]

POLLARD, N. S., AND REITSMA, P. S. A. 2001. Animation of humanlike characters: Dynamic motion filtering with a physically plausible contact model. In Yale Workshop on Adaptive and Learning Systems.

[29]

POPOVIĆ, Z., AND WITKIN, A. P. 1999. Physically based motion transformation. In Proc. of SIGGRAPH 99, 11--20.

Digital Library

[30]

POPOVIĆ, J., SEITZ, S. M., ERDMANN, M., POPOVIĆ, Z., AND WITKIN, A. P. 2000. Interactive manipulation of rigid body simulations. In Proc. of SIGGRAPH 00, 209--218.

Digital Library

[31]

RAVINDRAN, S. 2000. Reduced-order adaptive controllers for fluid flows using POD. In Journal of Scientific Computing, vol. 15, 457--478.

Digital Library

[32]

ROSE, C. F., GUENTER, B., BODENHEIMER, B., AND COHEN, M. F. 1996. Efficient generation of motion transitions using spacetime constraints. In Proc. of SIGGRAPH 96, 147--154.

Digital Library

[33]

SANTELLO, M., FLANDERS, M., AND SOECHTING, J. F. 2002. Patterns of hand motion during grasping and the influence of sensory guidance. In Journal of Neuroscience, vol. 22, 1426--1435.

[34]

SULEJMANPAŠIĆ, A. 2004. Adaptation of Performed Ballistic Motion. Master's thesis, MIT Dept of EECS.

[35]

TOLANI, D., GOSWAMI, A., AND BADLER, N. 2000. Real-time inverse kinematics techniques for anthropomorphic limbs. In Graphical Models 62 (5), 353--388.

Digital Library

[36]

WITKIN, A., AND KASS, M. 1988. Spacetime constraints. In Computer Graphics (Proc. of SIGGRAPH 88), vol. 22, 159--168.

Digital Library

[37]

YAMANE, K., AND NAKAMURA, Y. 2000. Dynamics filter -- concept and implementation of on-line motion generator for human figures. In Proc. IEEE Intl. Conference on Robotics and Automation, 688--695.

Cited By

Zeng QZheng GLiu Q(2024)DTP: learning to estimate full-body pose in real-time from sparse VR sensor measurementsVirtual Reality10.1007/s10055-024-01011-128:2Online publication date: 23-May-2024
https://dl.acm.org/doi/10.1007/s10055-024-01011-1
Xie KXu PAndrews SZordan VKry P(2023)Too Stiff, Too Strong, Too SmartProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/36069356:3(1-17)Online publication date: 24-Aug-2023
https://dl.acm.org/doi/10.1145/3606935
Iizuka RNenchev DSato D(2021)Motion Generation and Control of Acrobatic Motion Synergies Emerging From the Momentum Equilibrium Principle2020 IEEE-RAS 20th International Conference on Humanoid Robots (Humanoids)10.1109/HUMANOIDS47582.2021.9555678(362-369)Online publication date: 19-Jul-2021
https://doi.org/10.1109/HUMANOIDS47582.2021.9555678
Show More Cited By

Index Terms

Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces

Recommendations

Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces

Optimization is an appealing way to compute the motion of an animated character because it allows the user to specify the desired motion in a sparse, intuitive way. The difficulty of solving this problem for complex characters such as humans is due in ...
A physically-based motion retargeting filter

This article presents a novel constraint-based motion editing technique. On the basis of animator-specified kinematic and dynamic constraints, the method converts a given captured or animated motion to a physically plausible motion. In contrast to ...
Motion Data Correction and Extrapolation Using Physical Constraints
IV '05: Proceedings of the Ninth International Conference on Information Visualisation

Optimization techniques have proven to be a powerful approach for generating new motions. In this paper, we present a physically based optimization method to synthesize motions by using motion capture data as input. We assume that the captured motion ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '04: ACM SIGGRAPH 2004 Papers

August 2004

684 pages

ISBN:9781450378239

DOI:10.1145/1186562

Editor:
Joe Marks
Mitsubishi Electric Research Laboratories (MERL)

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGGRAPH04

Sponsor:

SIGGRAPH

SIGGRAPH04: Special Interest Group on Computer Graphics and Interactive Techniques

August 8 - 12, 2004

California, Los Angeles

Acceptance Rates

SIGGRAPH '04 Paper Acceptance Rate 83 of 478 submissions, 17%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

63
Total Citations
View Citations
3,153
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zeng QZheng GLiu Q(2024)DTP: learning to estimate full-body pose in real-time from sparse VR sensor measurementsVirtual Reality10.1007/s10055-024-01011-128:2Online publication date: 23-May-2024
https://dl.acm.org/doi/10.1007/s10055-024-01011-1
Xie KXu PAndrews SZordan VKry P(2023)Too Stiff, Too Strong, Too SmartProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/36069356:3(1-17)Online publication date: 24-Aug-2023
https://dl.acm.org/doi/10.1145/3606935
Iizuka RNenchev DSato D(2021)Motion Generation and Control of Acrobatic Motion Synergies Emerging From the Momentum Equilibrium Principle2020 IEEE-RAS 20th International Conference on Humanoid Robots (Humanoids)10.1109/HUMANOIDS47582.2021.9555678(362-369)Online publication date: 19-Jul-2021
https://doi.org/10.1109/HUMANOIDS47582.2021.9555678
Ling HZinno FCheng GVan De Panne M(2020)Character controllers using motion VAEsACM Transactions on Graphics10.1145/3386569.339242239:4(40:1-40:12)Online publication date: 12-Aug-2020
https://dl.acm.org/doi/10.1145/3386569.3392422
Xie ZLing HKim Nvan de Panne MLevin DKry P(2020)ALLSTEPSProceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation10.1111/cgf.14115(1-12)Online publication date: 6-Oct-2020
https://dl.acm.org/doi/10.1111/cgf.14115
Rempe DGuibas LHertzmann ARussell BVillegas RYang J(2020)Contact and Human Dynamics from Monocular VideoComputer Vision – ECCV 202010.1007/978-3-030-58558-7_5(71-87)Online publication date: 29-Oct-2020
https://doi.org/10.1007/978-3-030-58558-7_5
Hornung RChen Nvan der Smagt P(2019)Early integration for movement modeling in latent spacesThe Handbook of Multimodal-Multisensor Interfaces10.1145/3233795.3233805(305-345)Online publication date: 1-Jul-2019
https://dl.acm.org/doi/10.1145/3233795.3233805
Holden DKomura TSaito J(2017)Phase-functioned neural networks for character controlACM Transactions on Graphics10.1145/3072959.307366336:4(1-13)Online publication date: 20-Jul-2017
https://dl.acm.org/doi/10.1145/3072959.3073663
Park CPark JTonneau SMansard NMulton FPettré JManocha DWyman CYuksel C(2016)Dynamically balanced and plausible trajectory planning for human-like charactersProceedings of the 20th ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games10.1145/2856400.2856405(39-48)Online publication date: 27-Feb-2016
https://dl.acm.org/doi/10.1145/2856400.2856405
Rabbani Avan de Panne MKry P(2016)Anticipatory balance control and dimension reductionComputer Animation and Virtual Worlds10.1002/cav.172629:6Online publication date: 13-Jul-2016
https://doi.org/10.1002/cav.1726
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents