Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Generalizing locomotion style to new animals with inverse optimal regression

Published: 27 July 2014 Publication History

Abstract

We present a technique for analyzing a set of animal gaits to predict the gait of a new animal from its shape alone. This method works on a wide range of bipeds and quadrupeds, and adapts the motion style to the size and shape of the animal. We achieve this by combining inverse optimization with sparse data interpolation. Starting with a set of reference walking gaits extracted from sagittal plane video footage, we first use inverse optimization to learn physically motivated parameters describing the style of each of these gaits. Given a new animal, we estimate the parameters describing its gait with sparse data interpolation, then solve a forward optimization problem to synthesize the final gait. To improve the realism of the results, we introduce a novel algorithm called joint inverse optimization which learns coherent patterns in motion style from a database of example animal-gait pairs. We quantify the predictive performance of our model by comparing its synthesized gaits to ground truth walking motions for a range of different animals. We also apply our method to the prediction of gaits for dinosaurs and other extinct creatures.

Supplementary Material

ZIP File (a49-wampler.zip)
Supplemental material.
MP4 File (a49-sidebyside.mp4)

References

[1]
Alexander, R. 1996. Optima for Animals. Princeton paper-backs. Princeton University Press.
[2]
Arikan, O., and Forsyth, D. A. 2002. Interactive motion generation from examples. ACM Transactions on Graphics (ACM SIGGRAPH 2002) 21, 3, 483--490.
[3]
Bay, H., Ess, A., Tuytelaars, T., and Van Gool, L. 2008. Speeded-up robust features (surf). Comput. Vis. Image Underst. 110, 3 (June), 346--359.
[4]
Boyd, S., and Vandenberghe, L. 2004. Convex Optimization. Cambridge University Press, New York, NY, USA.
[5]
Bruderlin, A., and Williams, L. 1995. Motion signal processing. In Proceedings of SIGGRAPH 95, Computer Graphics Proceedings, Annual Conference Series, 97--104.
[6]
Coros, S., Beaudoin, P., and van de Panne, M. 2010. Generalized biped walking control. ACM Transctions on Graphics 29, 4, Article 130.
[7]
Coros, S., Karpathy, A., Jones, B., Reveret, L., and van de Panne, M. 2011. Locomotion skills for simulated quadrupeds. ACM Transactions on Graphics 30, 4, Article TBD.
[8]
de Lasa, M., Mordatch, I., and Hertzmann, A. 2010. Feature-Based Locomotion Controllers. ACM Transactions on Graphics 29, 3.
[9]
Fang, A. C., and Pollard, N. S. 2003. Efficient synthesis of physically valid human motion. ACM Trans. Graph. 22, 3, 417--426.
[10]
Geijtenbeek, T., van de Panne, M., and van der Stappen, A. F. 2013. Flexible muscle-based locomotion for bipedal creatures. ACM Transactions on Graphics 32, 6.
[11]
Gill, P. E., Murray, W., and Saunders, M. A. 2005. Snopt: An sqp algorithm for large-scale constrained optimization. SIAM Review 47, 1, 99--131.
[12]
Hansen, N., Hansen, N., Ostermeier, A., and Ostermeier, A. 1996. Adapting arbitrary normal mutation distributions in evolution strategies: the covariance matrix adaptation. Morgan Kaufmann, 312--317.
[13]
Hecker, C., Raabe, B., Enslow, R. W., DeWeese, J., Maynard, J., and van Prooijen, K. 2008. Real-time motion retargeting to highly varied user-created morphologies. ACM Trans. Graph. 27, 3, 1--11.
[14]
Hodgins, J. K., and Pollard, N. S. 1997. Adapting simulated behaviors for new characters. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, SIGGRAPH '97, 153--162.
[15]
Jain, S., and Liu, C. K. 2011. Controlling physics-based characters using soft contacts. ACM Trans. Graph. (SIGGRAPH Asia) 30 (Dec.), 163:1--163:10.
[16]
Kovar, L., Gleicher, M., and Pighin, F. 2002. Motion graphs. ACM Transactions on Graphics 21, 3 (July), 473--482.
[17]
Kry, P. G., Reveret, L., Faure, F., and Cani, M.-P. 2009. Modal locomotion: Animating virtual characters with natural vibrations. Computer Graphics Forum.
[18]
Lee, S. J., and Popović, Z. 2010. Learning behavior styles with inverse reinforcement learning. ACM Trans. Graph. 29, 4, 1--7.
[19]
Lee, J., Chai, J., Reitsma, P. S. A., Hodgins, J. K., and Pollard, N. S. 2002. Interactive control of avatars animated with human motion data. ACM Transactions on Graphics 21, 3 (July), 491--500.
[20]
Liu, C. K., Hertzmann, A., and Popović, Z. 2005. Learning physics-based motion style with nonlinear inverse optimization. ACM Trans. Graph. 24, 3, 1071--1081.
[21]
MacIver, M. A., Patankar, N. A., and Shirgaonkar, A. A. 2010. Energy-information trade-offs between movement and sensing. PLoS computational biology 6, 5, e1000769.
[22]
Mordatch, I., Todorov, E., and Popović, Z. 2012. Discovery of complex behaviors through contact-invariant optimization. ACM Trans. Graph. 31, 4 (July), 43:1--43:8.
[23]
Mordatch, I., Wang, J. M., Todorov, E., and Koltun, V. 2013. Animating human lower limbs using contact-invariant optimization. ACM Trans. Graph. 32, 6 (Nov.), 203:1--203:8.
[24]
Nunes, R. F., Cavalcante-Neto, J. B., Vidal, C. A., Kry, P. G., and Zordan, V. B. 2012. Using natural vibrations to guide control for locomotion. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, ACM, New York, NY, USA, I3D '12, 87--94.
[25]
Raibert, M. H., and Hodgins, J. K. 1991. Animation of dynamic legged locomotion. SIGGRAPH Comput. Graph. 25 (July), 349--358.
[26]
Safonova, A., Hodgins, J. K., and Pollard, N. S. 2004. Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces. ACM Trans. Graph. 23, 3, 514--521.
[27]
Sims, K. 1994. Evolving virtual creatures. In Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH '94, 15--22.
[28]
Tan, J., Gu, Y., Turk, G., and Liu, C. K. 2011. Articulated swimming creatures. ACM Trans. Graph. 30, 4 (July), 58:1--58:12.
[29]
Wampler, K., and Popović, Z. 2009. Optimal gait and form for animal locomotion. ACM Trans. Graph. 28, 3, 1--8.
[30]
Wampler, K. 2012. Computational Generation of Terrestrial Animal Locomotion. PhD thesis, Seattle, WA, USA. AAI3552870.
[31]
Wang, J. M., Hamner, S. R., Delp, S. L., and Koltun, V. 2012. Optimizing locomotion controllers using biologically-based actuators and objectives. ACM Trans. Graph. 31, 4, 25.
[32]
Wei, X., Min, J., and Chai, J. 2011. Physically valid statistical models for human motion generation. ACM Trans. Graph. 30 (May), 19:1--19:10.
[33]
Witkin, A. P., and Popović, Z. 1995. Motion warping. In Proceedings of SIGGRAPH 95, Computer Graphics Proceedings, Annual Conference Series, 105--108.
[34]
Wu, J.-c., and Popović, Z. 2003. Realistic modeling of bird flight animations. ACM Trans. Graph. 22, 3 (July), 888--895.
[35]
Yin, K., Loken, K., and van de Panne, M. 2007. Simbicon: Simple biped locomotion control. ACM Trans. Graph. 26, 3, Article 105.
[36]
Zhang, L., Snavely, N., Curless, B., and Seitz, S. M. 2004. Spacetime faces: High-resolution capture for modeling and animation. In ACM Annual Conference on Computer Graphics, 548--558.

Cited By

View all
  • (2024)VMP: Versatile Motion Priors for Robustly Tracking Motion on Physical CharactersComputer Graphics Forum10.1111/cgf.15175Online publication date: 9-Oct-2024
  • (2024)Pose‐to‐Motion: Cross‐Domain Motion Retargeting with Pose PriorComputer Graphics Forum10.1111/cgf.15170Online publication date: 9-Oct-2024
  • (2024)Learning to Play Guitar with Robotic HandsComputer Graphics Forum10.1111/cgf.15166Online publication date: 9-Oct-2024
  • Show More Cited By

Index Terms

  1. Generalizing locomotion style to new animals with inverse optimal regression

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Graphics
    ACM Transactions on Graphics  Volume 33, Issue 4
    July 2014
    1366 pages
    ISSN:0730-0301
    EISSN:1557-7368
    DOI:10.1145/2601097
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 July 2014
    Published in TOG Volume 33, Issue 4

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. character animation
    2. locomotion
    3. optimization

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)31
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 29 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)VMP: Versatile Motion Priors for Robustly Tracking Motion on Physical CharactersComputer Graphics Forum10.1111/cgf.15175Online publication date: 9-Oct-2024
    • (2024)Pose‐to‐Motion: Cross‐Domain Motion Retargeting with Pose PriorComputer Graphics Forum10.1111/cgf.15170Online publication date: 9-Oct-2024
    • (2024)Learning to Play Guitar with Robotic HandsComputer Graphics Forum10.1111/cgf.15166Online publication date: 9-Oct-2024
    • (2024)Evolution-Based Shape and Behavior Co-Design of Virtual AgentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.335574530:12(7579-7591)Online publication date: Dec-2024
    • (2024)OmniMotionGPT: Animal Motion Generation with Limited Data2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00125(1249-1259)Online publication date: 16-Jun-2024
    • (2023)Adaptive Tracking of a Single-Rigid-Body Character in Various EnvironmentsSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618187(1-11)Online publication date: 10-Dec-2023
    • (2023)Discovering Fatigued Movements for Virtual Character AnimationSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618176(1-12)Online publication date: 10-Dec-2023
    • (2023)Physics-based Motion Retargeting from Sparse InputsProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/36069286:3(1-19)Online publication date: 24-Aug-2023
    • (2023)Composite Motion Learning with Task ControlACM Transactions on Graphics10.1145/359244742:4(1-16)Online publication date: 26-Jul-2023
    • (2022)Learning Virtual Chimeras by Dynamic Motion ReassemblyACM Transactions on Graphics10.1145/3550454.355548941:6(1-13)Online publication date: 30-Nov-2022
    • Show More Cited By

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media