tutorial

Automatic Hand-Over Animation using Principle Component Analysis

Authors:

Nkenge Wheatland,

Victor ZordanAuthors Info & Claims

MIG '13: Proceedings of Motion on Games

Pages 197 - 202

https://doi.org/10.1145/2522628.2522656

Published: 11 November 2013 Publication History

Abstract

This paper introduces a method for producing high quality hand motion using a small number of markers. The proposed "handover" animation technique constructs joint angle trajectories with the help of a reference database. Utilizing principle component analysis (PCA) applied to the database, the system automatically determines the sparse marker set to record. Further, to produce hand animation, PCA is used along with a locally weighted regression (LWR) model to reconstruct joint angles. The resulting animation is a full-resolution hand which reflects the original motion without the need for capturing a full marker set. Comparing the technique to other methods reveals improvement over the state of the art in terms of the marker set selection. In addition, the results highlight the ability to generalize the motion synthesized, both by extending the use of a single reference database to new motions, and from distinct reference datasets, over a variety of freehand motions.

References

[1]

Atkeson, C., Moore, A., and Schaal, S. 1997. Locally weighted learning. Artificial Intelligence Review 11, 1--5, 11--73.

Digital Library

[2]

Bishop, C. M. 1995. Neural Networks for Pattern Recognition. Oxford University Press, Inc.

Digital Library

[3]

Braido, P., and Zhang, X. 2004. Quantitative analysis of finger motion coordination in hand manipulative and gestic acts. Human Movement Science 22, 6, 661--678.

[4]

Chai, J., and Hodgins, J. K. 2005. Performance animation from low-dimensional control signals. ACM Transactions on Graphics (SIGGRAPH) 24, 686--696.

Digital Library

[5]

Chang, L. Y., Pollard, N., Mitchell, T., and Xing, E. P. 2007. Feature selection for grasp recognition from optical markers. In IEEE/RSJ International Conference on Intelligent Robots and Systems, 2944--2950.

[6]

Courty, N., and Gibet, S. 2010. Why is the creation of a virtual signer challenging computer animation? In Motion in Games, Springer-Verlag, MIG'10, 290--300.

Digital Library

[7]

CyberGlove, 2013. http://www.cyberglovesystems.com.

[8]

Hoyet, L., Ryall, K., McDonnell, R., and O'Sullivan, C. 2012. Sleight of hand: perception of finger motion from reduced marker sets. In ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, I3D '12, 79--86.

Digital Library

[9]

Jörg, S., and O'Sullivan, C. 2009. Exploring the dimensionality of finger motion. In Proceedings of the 9th Eurographics Ireland Workshop (EGIE 2009), 1--11.

[10]

Jörg, S., Hodgins, J. K., and Safonova, A. 2012. Data-driven finger motion synthesis for gesturing characters. ACM Transactions on Graphics (SIGGRAPH Asia) 31, 6, 189:1--189:7.

Digital Library

[11]

Kahlesz, F., Zachmann, G., and Klein, R. 2004. 'Visual-fidelity' dataglove calibration. In Computer Graphics International, IEEE, CGI '04, 403--410.

Digital Library

[12]

Kang, C., Wheatland, N., Neff, M., and Zordan, V. 2012. Automatic hand-over animation for free-hand motions from low resolution input. In Motion in Games, MIG '12. Springer Berlin Heidelberg, 244--253.

[13]

Majkowska, A., Zordan, V. B., and Faloutsos, P. 2006. Automatic splicing for hand and body animations. In ACM SIGGRAPH / Eurographics Symposium on Computer Animation, SCA '06, 309--316.

Digital Library

[14]

Rijpkema, H., and Girard, M. 1991. Computer animation of knowledge-based human grasping. In SIGGRAPH '91, ACM, 339--348.

Digital Library

[15]

Safonova, A., Hodgins, J. K., and Pollard, N. S. 2004. Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces. In ACM Transactions on Graphics (SIGGRAPH), 514--521.

Digital Library

[16]

Santello, M., Flanders, M., and Soechting, J. F. 1998. Postural hand synergies for tool use. The Journal of Neuroscience 18, 23, 10105--10115.

[17]

Wang, Y., and Neff, M. 2013. Data-driven glove calibration for hand motion capture. In ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA '13, 15--24.

Digital Library

[18]

Wang, R. Y., and Popović, J. 2009. Real-time hand-tracking with a color glove. ACM Transactions on Graphics (SIGGRAPH) 28, 3, 1--8.

Digital Library

[19]

Wang, Y., Min, J., Zhang, J., Liu, Y., Xu, F., Dai, Q., and Chai, J. 2013. Video-based hand manipulation capture through composite motion control. ACM Transactions on Graphics (SIGGRAPH) 32, 4, 43:1--43:14.

Digital Library

[20]

Ye, Y., and Liu, C. K. 2012. Synthesis of detailed hand manipulations using contact sampling. ACM Transactions on Graphics (SIGGRAPH) 31, 4, 41:1--41:10.

Digital Library

[21]

Zhao, W., Chai, J., and Xu, Y.-Q. 2012. Combining marker-based mocap and RGB-D camera for acquiring high-fidelity hand motion data. In ACM SIGGRAPH / Eurographics Symposium on Computer Animation, SCA '12, 33--42.

Digital Library

Cited By

Rekik RWuhrer SHoyet LZibrek KOlivier A(2024)A Survey on Realistic Virtual Human Animations: Definitions, Features and EvaluationsComputer Graphics Forum10.1111/cgf.1506443:2Online publication date: 30-Apr-2024
https://doi.org/10.1111/cgf.15064
Moon SSung EPark J(2024)Kernel PCA-Based Hand Synergy for Efficient Robot Hand Teleoperation Using Glove Interface2024 IEEE-RAS 23rd International Conference on Humanoid Robots (Humanoids)10.1109/Humanoids58906.2024.10769864(17-23)Online publication date: 22-Nov-2024
https://doi.org/10.1109/Humanoids58906.2024.10769864
Waldow KFuhrmann ARoth D(2024)Deep Neural Labeling: Hybrid Hand Pose Estimation Using Unlabeled Motion Capture Data With Color Gloves in Context of German Sign Language2024 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR)10.1109/AIxVR59861.2024.00009(1-10)Online publication date: 17-Jan-2024
https://doi.org/10.1109/AIxVR59861.2024.00009
Show More Cited By

Index Terms

Automatic Hand-Over Animation using Principle Component Analysis
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        3D imaging
  2. Computer graphics
    1. Animation

Recommendations

Building Hand Motion-Based Character Animation: The Case of Puppetry
CW '10: Proceedings of the 2010 International Conference on Cyberworlds

Automatic motion generation for digital character under the real-time user control is a challenging problem for computer graphic research and virtual environment applications such as on-line games. The present study introduces a methodology to generate ...
Real time automatic skeleton and motion estimation for character animation
International Workshop Motion in Games (MIG08)

Motion capture is prevalent in the pipeline of realistic articulated character animation. To define accurate joint positions and joint orientations for the movement of a hierarchical human-like character without using a pre-defined skeleton remains a ...
Synchronized multi-character motion editing

The ability to interactively edit human motion data is essential for character animation. We present a novel motion editing technique that allows the user to manipulate synchronized multiple character motions interactively. Our Laplacian motion editing ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MIG '13: Proceedings of Motion on Games

November 2013

30 pages

ISBN:9781450325462

DOI:10.1145/2522628

Conference Chair:
Rachel McDonnell
Trinity College Dublin, Ireland
,
Program Chairs:
Nathan Sturtevant
University of Denver
,
Victor Zordan
University of California Riverside

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 November 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Tutorial
Research
Refereed limited

Conference

MIG '13

Sponsor:

SIGGRAPH

MIG '13: Motion in Games

November 6 - 8, 2013

Dublin 2, Ireland

Acceptance Rates

MIG '13 Paper Acceptance Rate -9 of -9 submissions, 100%;

Overall Acceptance Rate -9 of -9 submissions, 100%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
203
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)2

Reflects downloads up to 30 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Rekik RWuhrer SHoyet LZibrek KOlivier A(2024)A Survey on Realistic Virtual Human Animations: Definitions, Features and EvaluationsComputer Graphics Forum10.1111/cgf.1506443:2Online publication date: 30-Apr-2024
https://doi.org/10.1111/cgf.15064
Moon SSung EPark J(2024)Kernel PCA-Based Hand Synergy for Efficient Robot Hand Teleoperation Using Glove Interface2024 IEEE-RAS 23rd International Conference on Humanoid Robots (Humanoids)10.1109/Humanoids58906.2024.10769864(17-23)Online publication date: 22-Nov-2024
https://doi.org/10.1109/Humanoids58906.2024.10769864
Waldow KFuhrmann ARoth D(2024)Deep Neural Labeling: Hybrid Hand Pose Estimation Using Unlabeled Motion Capture Data With Color Gloves in Context of German Sign Language2024 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR)10.1109/AIxVR59861.2024.00009(1-10)Online publication date: 17-Jan-2024
https://doi.org/10.1109/AIxVR59861.2024.00009
Adkins ANormoyle ALin LSun YYe YDi Luca MJörg S(2023)How Important are Detailed Hand Motions for Communication for a Virtual Character Through the Lens of Charades?ACM Transactions on Graphics10.1145/357857542:3(1-16)Online publication date: 31-May-2023
https://dl.acm.org/doi/10.1145/3578575
Zell EMcDonnell R(2022)Compact Facial Landmark Layouts for Performance CaptureComputer Graphics Forum10.1111/cgf.1446341:2(121-133)Online publication date: 24-May-2022
https://doi.org/10.1111/cgf.14463
Shenoy PSompur VSkm V(2022)Methods for Measurement and Analysis of Full Hand Angular Kinematics Using Electromagnetic Tracking SensorsIEEE Access10.1109/ACCESS.2022.316867410(42673-42689)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3168674
Chan JHo E(2021)Emotion Transfer for 3D Hand and Full Body Motion Using StarGANComputers10.3390/computers1003003810:3(38)Online publication date: 22-Mar-2021
https://doi.org/10.3390/computers10030038
Li GWu ZLiu YZhang HNie YMao A(2021)3D hand reconstruction from a single image based on biomechanical constraintsThe Visual Computer10.1007/s00371-021-02250-yOnline publication date: 27-Jul-2021
https://doi.org/10.1007/s00371-021-02250-y
Jörg SYe YMueller FNeff MZordan V(2020)Virtual hands in VRSIGGRAPH Asia 2020 Courses10.1145/3415263.3419155(1-32)Online publication date: 17-Nov-2020
https://dl.acm.org/doi/10.1145/3415263.3419155
Jörg SYe YNeff MMueller FZordan V(2020)Virtual hands in VRACM SIGGRAPH 2020 Courses10.1145/3388769.3407494(1-145)Online publication date: 17-Aug-2020
https://dl.acm.org/doi/10.1145/3388769.3407494
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents