research-article

Real-Time Fingertip Tracking and Gesture Recognition

Authors:

Hideki KoikeAuthors Info & Claims

IEEE Computer Graphics and Applications, Volume 22, Issue 6

Pages 64 - 71

https://doi.org/10.1109/MCG.2002.1046630

Published: 01 November 2002 Publication History

Abstract

The authors introduce a fast and robust method for tracking a user's hands and multiple fingertips. They then demonstrate gesture recognition based on measured fingertip trajectories for augmented desk interface systems. This tracking method is capable of tracking multiple fingertips in a reliable manner even in a complex background under a dynamically changing lighting condition without any markers. The authors' gesture recognition system is particularly advantageous for human-computer interaction (HCI) in that users can achieve interactions based on symbolic gestures at the same time that they perform direct manipulation with their own hands and fingers.

References

[1]

L. Rabiner and B. Juang, "An Introduction to Hidden Markov Models," IEEE Acoustic Signal and Speech Processing (ASSP), vol. 3, no. 1, Jan. 1986, pp. 4-16.

[2]

T. Starner and A. Pentland, "Visual Recognition of American Sign Language Using Hidden Markov Models," Proc. IEEE Int'l Workshop Automatic Face and Gesture Recognition (FG 95), IEEE Press, Piscataway, N.J., 1995, pp. 189-194.

[3]

J. Martin and J. Durand, "Automatic Handwriting Gestures Recognition Using Hidden Markov Models," Proc. 4th IEEE Int'l Conf. Automatic Face and Gesture Recognition (FG 2000), IEEE Press, Piscataway, N.J., 2000, pp. 403-409.

Digital Library

[4]

J. Underkoffler and H. Ishii, "Illuminating Light: An Optical Design Tool with a Luminous-Tangible Interface," Proc. ACM Conf. Human Factors and Computing Systems (CHI 98), ACM Press, New York, 1998, pp. 542-549.

Digital Library

[5]

J. Rekimoto and M. Saito, "Augmented Surfaces: A Spatially Continuous Work Space for Hybrid Computing Environments," Proc. ACM Conf. Human Factors and Computing Systems (CHI 99), ACM Press, New York, 1999, pp. 378-385.

Digital Library

[6]

P. Wellner, "Interacting with Paper on the DigitalDesk," Comm. ACM, vol. 36, no. 7, July 1993, pp. 87-96.

Digital Library

[7]

H. Koike, et al., "Interactive Textbook and Interactive Venn Diagram: Natural and Intuitive Interface on Augmented Desk System," Proc. ACM Conf. Human Factors and Computing Systems (CHI 2000), ACM Press, New York, 2000, pp. 121-128.

Digital Library

[8]

X. Chen, et al., "Two-Handed Drawing on Augmented Desk System," Proc. Int'l Working Conf. Advanced Visual Interfaces (AVI 2002), ACM Press, New York, 2002, pp. 219-222.

Digital Library

[9]

Y. Sato Y. Kobayashi and H. Koike, "Fast Tracking of Hands and Fingertips in Infrared Images for Augmented Desk Interface," Proc. 4th IEEE Int'l Conf. Automatic Face and Gesture Recognition (FG 2000), IEEE Press, Piscataway, N.J., 2000, pp. 462-467.

Digital Library

[10]

M. Fukumoto Y. Suenaga and K. Mase, "Finger-pointer: Pointing Interface by Image Processing," Computer and Graphics, vol. 18, no. 5, 1994, pp. 633-642.

[11]

J. Segan and S. Kumar, "Shadow Gestures: 3D Hand Pose Estimation Using a Single Camera," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR 99), IEEE Press, Piscataway, N.J., 1999, pp. 479-485.

Digital Library

[12]

A. Utsumi and J. Ohya, "Multiple-Hand-Gesture Tracking Using Multiple Cameras," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR 99), IEEE Press, Piscataway, N.J., 1999, pp. 473-478.

Digital Library

[13]

J. Crowley F. Berard and J. Coutaz, "Finger Tracking as an Input Device for Augmented Reality," Proc. IEEE Int'l Workshop Automatic Face and Gesture Recognition (FG 95), IEEE Press, Piscataway, N.J., 1995, pp. 195-200.

[14]

J. Rehg and T. Kanade, "Model-Based Tracking of Self-Occluding Articulated Objects," Proc. IEEE Int'l Conf. Computer Vision (ICCV 95), IEEE Press, Piscataway, N.J., 1995, pp. 612-617.

Digital Library

[15]

N. Shimada, et al., "Hand Gesture Estimation and Model Refinement Using Monocular Camera-Ambiguity Limitation by Inequality Constraints," Proc. 3rd IEEE Int'l Conf. Automatic Face and Gesture Recognition (FG 98), IEEE Press, Piscataway, N.J., 1998, pp. 268-273.

Digital Library

[16]

Y. Wu J. Lin and T. Huang, "Capturing Natural Hand Articulation," Proc. IEEE Int'l Conf. Computer Vision (ICCV 01), vol. 2, IEEE Press, Piscataway, N.J., 2001, pp. 426-432.

[17]

V. Pavlovic R. Sharma and T. Huang, "Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, July 1997, pp. 677-695.

Digital Library

Cited By

Cao SWang X(2022)Real-time dynamic gesture recognition and hand servo tracking using PTZ cameraMultimedia Tools and Applications10.1007/s11042-019-07869-778:19(27403-27424)Online publication date: 10-Mar-2022
https://dl.acm.org/doi/10.1007/s11042-019-07869-7
Masuda JHayashida KYokoyama SChbeir RManolopoulos YBellatreche LBenslimane DIvanovic MMaamar Z(2021)Position Estimation for Objects in the High Latitude Region of 360° Panoramic ImagesProceedings of the 13th International Conference on Management of Digital EcoSystems10.1145/3444757.3485170(146-152)Online publication date: 1-Nov-2021
https://dl.acm.org/doi/10.1145/3444757.3485170
Choi OSon YLim HAhn S(2019)Co-Recognition of Multiple Fingertips for Tabletop Human–Projector InteractionIEEE Transactions on Multimedia10.1109/TMM.2018.288060821:6(1487-1498)Online publication date: 22-May-2019
https://dl.acm.org/doi/10.1109/TMM.2018.2880608
Show More Cited By

Index Terms

Real-Time Fingertip Tracking and Gesture Recognition
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
    1. Animation
      1. Motion capture
      2. Motion processing

Recommendations

Gliding and saccadic gaze gesture recognition in real time

Eye movements can be consciously controlled by humans to the extent of performing sequences of predefined movement patterns, or 'gaze gestures'. Gaze gestures can be tracked noninvasively employing a video-based eye tracking system. Gaze gestures hold ...
Real-time vision-based hand tracking and gesture recognition
Real-time fingertip localization conditioned on hand gesture classification

A method to obtain accurate hand gesture classification and fingertip localization from depth images is proposed. The Oriented Radial Distribution feature is utilized, exploiting its ability to globally describe hand poses, but also to locally detect ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE Computer Graphics and Applications

IEEE Computer Graphics and Applications Volume 22, Issue 6

November 2002

139 pages

ISSN:0272-1716

Issue’s Table of Contents

Copyright © Copyright © 2002 IEEE. All Rights Reserved.

Publisher

IEEE Computer Society Press

Washington, DC, United States

Publication History

Published: 01 November 2002

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

43
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Cao SWang X(2022)Real-time dynamic gesture recognition and hand servo tracking using PTZ cameraMultimedia Tools and Applications10.1007/s11042-019-07869-778:19(27403-27424)Online publication date: 10-Mar-2022
https://dl.acm.org/doi/10.1007/s11042-019-07869-7
Masuda JHayashida KYokoyama SChbeir RManolopoulos YBellatreche LBenslimane DIvanovic MMaamar Z(2021)Position Estimation for Objects in the High Latitude Region of 360° Panoramic ImagesProceedings of the 13th International Conference on Management of Digital EcoSystems10.1145/3444757.3485170(146-152)Online publication date: 1-Nov-2021
https://dl.acm.org/doi/10.1145/3444757.3485170
Choi OSon YLim HAhn S(2019)Co-Recognition of Multiple Fingertips for Tabletop Human–Projector InteractionIEEE Transactions on Multimedia10.1109/TMM.2018.288060821:6(1487-1498)Online publication date: 22-May-2019
https://dl.acm.org/doi/10.1109/TMM.2018.2880608
Tanwar VBuckchash HRaman BBhargava R(2019)Dense motion analysis of German finger spellingsMultimedia Tools and Applications10.1007/s11042-018-6533-078:8(9511-9536)Online publication date: 1-Apr-2019
https://dl.acm.org/doi/10.1007/s11042-018-6533-0
Bhalerao RKshirsagar VRaval M(2019)Finger Tracking Based Tabla Syllable TranscriptionPattern Recognition10.1007/978-3-030-41404-7_40(569-579)Online publication date: 26-Nov-2019
https://dl.acm.org/doi/10.1007/978-3-030-41404-7_40
Al-Shamayleh AAhmad RAbushariah MAlam KJomhari N(2018)A systematic literature review on vision based gesture recognition techniquesMultimedia Tools and Applications10.5555/3287850.328787377:21(28121-28184)Online publication date: 1-Nov-2018
https://dl.acm.org/doi/10.5555/3287850.3287873
Gong DLiu K(2018)A multi-objective optimization model and its evolution-based solutions for the fingertip localization problemPattern Recognition10.1016/j.patcog.2017.09.00174:C(385-405)Online publication date: 1-Feb-2018
https://dl.acm.org/doi/10.1016/j.patcog.2017.09.001
Collins JRegenbrecht HLanglotz T(2017)Visual coherence in mixed realityPresence: Teleoperators and Virtual Environments10.5555/3211567.321157026:1(16-41)Online publication date: 1-Feb-2017
https://dl.acm.org/doi/10.5555/3211567.3211570
Togootogtokh EShih T(2017)Multimedia content analysis on gesture event detection for a SMART TV Keyboard applicationMultimedia Tools and Applications10.1007/s11042-016-3385-376:5(7341-7363)Online publication date: 1-Mar-2017
https://dl.acm.org/doi/10.1007/s11042-016-3385-3
Yu JKim GCruz-Neira CKiyokawa KReiners DIwai DSteinicke F(2016)Blurry (sticky) fingerProceedings of the 26th International Conference on Artificial Reality and Telexistence and the 21st Eurographics Symposium on Virtual Environments10.5555/3061323.3061335(49-56)Online publication date: 7-Oct-2016
https://dl.acm.org/doi/10.5555/3061323.3061335
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents