short-paper

Hand gesture recognition and virtual game control based on 3D accelerometer and EMG sensors

Authors:

Kong-qiao WangAuthors Info & Claims

IUI '09: Proceedings of the 14th international conference on Intelligent user interfaces

Pages 401 - 406

https://doi.org/10.1145/1502650.1502708

Published: 08 February 2009 Publication History

Get Access

Abstract

This paper describes a novel hand gesture recognition system that utilizes both multi-channel surface electromyogram (EMG) sensors and 3D accelerometer (ACC) to realize user-friendly interaction between human and computers. Signal segments of meaningful gestures are determined from the continuous EMG signal inputs. Multi-stream Hidden Markov Models consisting of EMG and ACC streams are utilized as decision fusion method to recognize hand gestures. This paper also presents a virtual Rubik's Cube game that is controlled by the hand gestures and is used for evaluating the performance of our hand gesture recognition system. For a set of 18 kinds of gestures, each trained with 10 repetitions, the average recognition accuracy was about 91.7% in real application. The proposed method facilitates intelligent and natural control based on gesture interaction.

References

[1]

Asghari Oskoei M. and Hu H. Myoelectric control systems--A survey. Biomedical Signal Processing and Control, Vol. 2(4), 2007, pp. 275--294.

Crossref

Google Scholar

[2]

Brashear H., Starner T., Lukowicz P. and Junker H. Using Multiple Sensors for Mobile Sign Language Recognition. In Proc. 7th IEEE Int. Sympos. Wearable Computers, 2003, pp. 45--52.

Digital Library

Google Scholar

[3]

Costanza E., Inverso S.A., and Allen R. Toward subtle intimate interfaces for mobile devices using an EMG controller. In Proceedings of the SIGCHI conference on Human factors in computing systems, Portland, Oregon, USA, April 02-07, 2005, pp. 481--489.

Digital Library

Google Scholar

[4]

Kim, J., Mastnik, S., and André, E. EMG-based hand gesture recognition for realtime biosignal interfacing. In Proceedings of the 13th international Conference on intelligent User interfaces (IUI '08), New York, NY, pp. 30--39.

Digital Library

Google Scholar

[5]

Mitra S. and Acharya T. Gesture Recognition: A Survey. IEEE Transactions on Systems, Man, and Cybernetics, Vol. 37(3), 2007, pp. 311--324.

Digital Library

Google Scholar

[6]

Mäntyjärvi J., Kela J., Korpipää P., and Kallio S. Enabling fast and effortless customisation in accelerometer based gesture interaction. In: Proc. 3rd Int. Conf. Mobile and ubiquitous multimedia, New York, NY, USA, 2004, pp. 25--31.

Digital Library

Google Scholar

[7]

Rubik's Cube http://en.wikipedia.org/wiki/Rubik's_cube

Google Scholar

[8]

Sherrill D.M., Bonato P., De Luca C.J. A neural network approach to monitor motor activities. In Proceedings of the Second Joint EMBS/BMES Conference, vol.1, Houston, USA, 2002, pp. 52--53.

Crossref

Google Scholar

[9]

Tamura S., Iwano K., and Furui S. A stream-weight optimization method for audio-visual speech recognition using multi-stream HMMs. In Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP '04), vol. 1, 2004, pp. I-857--60.

Crossref

Google Scholar

Cited By

View all

Hazar YFaruk Ertuğrul Ö(2025)Developing a real-time hand exoskeleton system that controlled by a hand gesture recognition system via wireless sensorsBiomedical Signal Processing and Control10.1016/j.bspc.2024.10688699(106886)Online publication date: Jan-2025
https://doi.org/10.1016/j.bspc.2024.106886
Pan JChen JWei SPan JWang Z(2024)MSMFNet: Multi-Modal Fusion Gesture Recognition Network with Multi-Scale Integration of AUS and sEMG2024 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN60899.2024.10650249(1-9)Online publication date: 30-Jun-2024
https://doi.org/10.1109/IJCNN60899.2024.10650249
Bhavesh Kumar Jaisawal Dr. Yusuf Perwej Sanjay Kumar Singh Susheel Kumar Jai Pratap Dixit Niraj Kumar Singh (2023)An Empirical Investigation of Human Identity Verification MethodsInternational Journal of Scientific Research in Science, Engineering and Technology10.32628/IJSRSET2310012(16-38)Online publication date: 2-Jan-2023
https://doi.org/10.32628/IJSRSET2310012
Show More Cited By

Index Terms

Hand gesture recognition and virtual game control based on 3D accelerometer and EMG sensors
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

Evaluating the placement of arm-worn devices for recognizing variations of dynamic hand gestures

Dynamic hand gestures have become increasingly popular as touch-free input modality for interactive systems. There exists a variety of arm-worn devices for the recognition of hand gestures, which differ not only in their capabilities, but also in their ...
Comparing the Placement of Two Arm-Worn Devices for Recognizing Dynamic Hand Gestures
MoMM '16: Proceedings of the 14th International Conference on Advances in Mobile Computing and Multi Media

Dynamic hand gestures have become increasingly popular as an input modality for interactive systems. There exists a variety of arm-worn devices for the recognition of hand gestures, which differ not only in their capabilities, but also in the arm ...
Finger Gesture Recognition Based on 3D-Accelerometer and 3D-Gyroscope
Knowledge Science, Engineering and Management
Abstract
Gesture-based interaction, as a natural way for human-computer interaction, has a wide range of applications in the ubiquitous computing environment. The latest research findings reveal that user’s arm and hand gestures are likely to be identified ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

IUI '09: Proceedings of the 14th international conference on Intelligent user interfaces

February 2009

522 pages

ISBN:9781605581682

DOI:10.1145/1502650

General Chairs:
Cristina Conati
University of British Columbia, Canada
,
Mathias Bauer
mineway GmbH, Germany
,
Program Chairs:
Nuria Oliver
Telefonica Research, Spain
,
Dan Weld
University of Washington, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 February 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

IUI09

Sponsor:

IUI09: 14th International Conference on Intelligent User Interfaces

February 8 - 11, 2009

Florida, Sanibel Island, USA

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

110
Total Citations
View Citations
3,655
Total Downloads

Downloads (Last 12 months)113
Downloads (Last 6 weeks)11

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Hazar YFaruk Ertuğrul Ö(2025)Developing a real-time hand exoskeleton system that controlled by a hand gesture recognition system via wireless sensorsBiomedical Signal Processing and Control10.1016/j.bspc.2024.10688699(106886)Online publication date: Jan-2025
https://doi.org/10.1016/j.bspc.2024.106886
Pan JChen JWei SPan JWang Z(2024)MSMFNet: Multi-Modal Fusion Gesture Recognition Network with Multi-Scale Integration of AUS and sEMG2024 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN60899.2024.10650249(1-9)Online publication date: 30-Jun-2024
https://doi.org/10.1109/IJCNN60899.2024.10650249
Bhavesh Kumar Jaisawal Dr. Yusuf Perwej Sanjay Kumar Singh Susheel Kumar Jai Pratap Dixit Niraj Kumar Singh (2023)An Empirical Investigation of Human Identity Verification MethodsInternational Journal of Scientific Research in Science, Engineering and Technology10.32628/IJSRSET2310012(16-38)Online publication date: 2-Jan-2023
https://doi.org/10.32628/IJSRSET2310012
Eddy EScheme EBateman S(2023)A Framework and Call to Action for the Future Development of EMG-Based Input in HCIProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580962(1-23)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580962
Wang XZhang XChen XChen XLv ZLiang Z(2023)Similarity Function for One-Shot Learning to Enhance the Flexibility of Myoelectric InterfacesIEEE Transactions on Neural Systems and Rehabilitation Engineering10.1109/TNSRE.2023.325368331(1697-1706)Online publication date: 2023
https://doi.org/10.1109/TNSRE.2023.3253683
Althekair AOdeh MAlBayaa MSharawi MDoush I(2023)Mobile Gaming EMG-Based Brain Computer InterfaceComputer-Human Interaction Research and Applications10.1007/978-3-031-49425-3_3(40-52)Online publication date: 23-Dec-2023
https://doi.org/10.1007/978-3-031-49425-3_3
Costagliola GDe Rosa MFuccella V(2023)Gesture‐Based ComputingHandbook of Human‐Machine Systems10.1002/9781119863663.ch32(397-408)Online publication date: 7-Jul-2023
https://doi.org/10.1002/9781119863663.ch32
Yu ZLu YAn QChen CLi YWang Y(2022)Real-Time Multiple Gesture Recognition: Application of a Lightweight Individualized 1D CNN Model to an Edge Computing SystemIEEE Transactions on Neural Systems and Rehabilitation Engineering10.1109/TNSRE.2022.316585830(990-998)Online publication date: 2022
https://doi.org/10.1109/TNSRE.2022.3165858
Fan BSu XNiu JHui P(2022)EmgAuth: Unlocking Smartphones with EMG SignalsIEEE Transactions on Mobile Computing10.1109/TMC.2022.3176651(1-1)Online publication date: 2022
https://doi.org/10.1109/TMC.2022.3176651
Lai ZKang XWang HZhang XZhang WWang F(2022)Contrastive Domain Adaptation: A Self-Supervised Learning Framework for sEMG-Based Gesture Recognition2022 IEEE International Joint Conference on Biometrics (IJCB)10.1109/IJCB54206.2022.10008005(1-7)Online publication date: 10-Oct-2022
https://doi.org/10.1109/IJCB54206.2022.10008005
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Evaluating the placement of arm-worn devices for recognizing variations of dynamic hand gestures

Comparing the Placement of Two Arm-Worn Devices for Recognizing Dynamic Hand Gestures

Finger Gesture Recognition Based on 3D-Accelerometer and 3D-Gyroscope