research-article

Hand Gesture Recognition with Convolution Neural Networks

Author:

Felix ZhanAuthors Info & Claims

2019 IEEE 20th International Conference on Information Reuse and Integration for Data Science (IRI)

Pages 295 - 298

https://doi.org/10.1109/IRI.2019.00054

Published: 30 July 2019 Publication History

Abstract

Hand gestures are the most common forms of communication and have great importance in our world. They can help in building safe and comfortable user interfaces for a multitude of applications. Various computer vision algorithms have employed color and depth camera for hand gesture recognition, but robust classification of gestures from different subjects is still challenging. I propose an algorithm for real-time hand gesture recognition using convolutional neural networks (CNNs). The proposed CNN achieves an average accuracy of 98.76% on the dataset comprising of 9 hand gestures and 500 images for each gesture.

References

[1]

S. Mitra and T. Acharya. Gesture recognition: A survey. IEEE Systems, Man, and Cybernetics, 37: 311–324, 2007.

Digital Library

[2]

V. I. Pavlovic, R. Sharma, and T. S. Huang. Visual interpretation of hand gestures for human-computer interaction: A review. PAMI, 19: 677–695, 1997.

[3]

P. Trindade, J. Lobo, and J. Barreto. Hand gesture recognition using color and depth images enhanced with hand angular pose data. In IEEE Conf. on Multisensor Fusion and Integration for Intelligent Systems, pages 71–76, 2012.

[4]

J. J. LaViola Jr. An introduction to 3D gestural interfaces. In SIGGRAPH Course, 2014.

[5]

T. Starner, A. Pentland, and J. Weaver. Real-time American sign language recognition using desk and wearable computer based video. PAMI, 20(12):1371–1375, 1998.

Digital Library

[6]

S. B. Wang, A. Quattoni, L. Morency, D. Demirdjian, and T. Darrell. Hidden conditional random fields for gesture recognition. In CVPR, pages 1521–1527, 2006.

[7]

N. Dardas and N. D. Georganas. Real-time hand gesture detection and recognition using bag-of-features and support vector machine techniques. IEEE Transactions on Instrumentation and Measurement, 60(11):3592–3607, 2011.

[8]

M. Zobl, R. Nieschulz, M. Geiger, M. Lang, and G. Rigoll. Gesture components for natural interaction with in-car devices. In Gesture-Based Communication in Human Computer Interaction, pages 448–459. Springer, 2004.

[9]

F. Althoff, R. Lindl, and L. Walchshausl. Robust multimodal hand-and head gesture recognition for controlling automotive infotainment systems. In VDI-Tagung: Der Fahrer im 21. Jahrhundert, 2005.

[10]

F. Parada-Loira, E. Gonzalez-Agulla, and J. Alba-Castro. Hand gestures to control infotainment equipment in cars. In IEEE Intelligent Vehicles Symposium, pages 1–6, 2014.

[11]

D. C. Cires¸an, U. Meier, J. Masci, L. M. Gambardella, and J. Schmidhuber. Flexible, high performance convolutional neural networks for image classification. In International Joint Conference on Artificial Intelligence, pages 1237–1242, 2011.

[12]

A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, pages 1097–1105. 2012.

Digital Library

[13]

Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner. Gradientbased learning applied to document recognition. In Proceedings of the IEEE, pages 2278–2324, 1998.

[14]

P. Y. Simard, D. Steinkraus, and J. C. Platt. J.c.: Best practices for convolutional neural networks applied to visual document analysis. In Int. Conference on Document Analysis and Recognition, pages 958–963, 2003.

[15]

D. Ciresan, U. Meier, and J. Schmidhuber. Multi-column deep neural networks for image classification. In CVPR, pages 3642–3649, 2012.

Digital Library

[16]

A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei. Large-scale video classification with convolutional neural networks. In CVPR, pages 1725–1732, 2014.

[17]

L. Pigou, S. Dieleman, P.-J. Kindermans, and B. Schrauwen. Sign language recognition using convolutional neural networks. In ECCVW, 2014.

[18]

K. Simonyan and A. Zisserman. Two-stream convolutional networks for action recognition in videos. In NIPS, pages 568–576, 2014.

Digital Library

[19]

P. Molchanov, S. Gupta, K. Kim, and K. Pulli. Multi-sensor System for Driver’s Hand-gesture Recognition. In AFGR, 2015.

[20]

S. Ioffe and C. Szegedy, “Batch normalization: Accelerating deep network training by reducing internal covariate shift,” in International Conference on Machine Learning, 2015, pp. 448–456.

[21]

Raymond Ahn, Justin Zhan, Using proxies for node immunization identification on large graphs, IEEE Access, Vol. 5, pp. 13046–13053, 2017.

[22]

Gary Blosser, Justin Zhan, Privacy preserving collaborative social network, International Conference on Information Security and Assurance, pp. 543–548, 2008.

[23]

C Chiu, J Zhan, F Zhan, Uncovering suspicious activity from partially paired and incomplete multimodal data, Vol. 5, pp. 13689–13698, IEEE Access, 2017.

[24]

Brittany Cozzens, Richard Huang, Maxwell Jay, Kyle Khembunjong, Sahan Paliskara, Felix Zhan, Mark Zhang, Shahab Tayeb, Signature Verification Using a Convolutional Neural Network, University of Nevada Las Vegas AEOP/STEM/REAP/RET Programs Technical Report, 2018.

[25]

Pravin Chopade, Justin Zhan, Marwan Bikdash, Node attributes and edge structure for large-scale big data network analytics and community detection, 2015 IEEE International Symposium on Technologies for Homeland Security, pp. 1–8, 2015.

[26]

Pravin Chopade, Justin Zhan, A framework for community detection in large networks using game-theoretic modeling, IEEE Transactions on Big Data, Vol. 3, Issue 3, pp. 276–288, 2017.

[27]

Pravin Chopade, Justin Zhan, Structural and functional analytics for community detection in large-scale complex networks, Journal of Big Data, Vol. 2, Issue 1, 2015.

[28]

Matin Pirouz, Justin Zhan, Shahab Tayeb, An optimized approach for community detection and ranking, Journal of Big Data, Vol. 3, Issue 1, pp. 22, 2016.

[29]

Matin Pirouz, Justin Zhan, Optimized relativity search: node reduction in personalized page rank estimation for large graphs, Journal of Big Data, Vol. 3, Issue 1, 2016.

[30]

Shahab Tayeb, Matin Pirouz, Brittany Cozzens, Richard Huang, Maxwell Jay, Kyle Khembunjong, Sahan Paliskara, Felix Zhan, Mark Zhang, Justin Zhan, Shahram Latifi, Toward data quality analytics in signature verification using a convolutional neural network, 2017 IEEE International Conference on Big Data, pp. 2644–2651, 2017.

[31]

Haysam Selim, Justin Zhan, Towards shortest path identification on large networks, Journal of Big Data, Vol. 3, Issue 1, pp. 10, 2016.

[32]

Xian-Ming Xu, Justin Zhan, Hai-tao Zhu, Using social networks to organize researcher community, International Conference on Intelligence and Security Informatics, pp. 421–427, 2008.

[33]

Felix Zhan, Gabriella Laines, Sarah Deniz, Sahan Paliskara, Irvin Ochoa, Idania Guerra, Shahab Tayeb, Carter Chiu, Matin Pirouz, Elliott Ploutz, Justin Zhan, Laxmi Gewali, Paul Oh, Prediction of online social networks users’ behaviors with a game theoretic approach, pp. 1–2, 2018 15th IEEE Annual Consumer Communications & Networking Conference.

[34]

Felix Zhan, Brandon Waters, Maria Mijangos, LeAnn Chung, Raghav Bhagat, Tanvi Bhagat, Matin Pirouz, Carter Chiu, Shahab Tayeb, Elliott Ploutz, Justin Zhan, Laxmi Gewali, An efficient alternative to personalized page rank for friend recommendations, pp. 1–2, 2018 15th IEEE Annual Consumer Communications & Networking Conference.

[35]

Justin Zhan, Xing Fang, A novel trust computing system for social networks, IEEE Third International Conference on Social Computing, pp. 1284–1289, 2011.

[36]

Justin Zhan, Secure collaborative social networks, IEEE Transactions on Systems, Man, and Cybernetics, Part C, Vol. 40, Issue 6, pp. 682–689, 2010.

Digital Library

[37]

Justin Zhan, Xing Fang, Social computing: the state of the art, International Journal of Social Computing and Cyber-Physical Systems, Vol. 1, Issue 1, pp. 1–12, 2011.

[38]

Justin Zhan, Xing Fang, A computational trust framework for social computing (a position paper for panel discussion on social computing foundations), IEEE Second International Conference on Social Computing, pp. 264–269, 2010.

[39]

Felix Zhan, Gabriella Laines, Sarah Deniz, Sahan Paliskara, Irvin Ochoa, Idania Guerra, Shahab Tayeb, University of Nevada Las Vegas AEOP/STEM/REAP/RET Programs Technical Report, Vol. 2, pp. 26–30, 2017.

[40]

Felix Zhan, Brandon Waters, Maria Mijangos, Raghav Bhagat, Tanvi Bhagat, A Low Cost, High Speed Alternative to Personalized Page Rank for Friend Recommendations, http://aeop.asecamps.com/wpcontent/uploads/2017/07/TeamC.pdf

[41]

Felix Zhan, How to Optimize Social Network Influence, 2019 IEEE International Conference on Artificial Intelligence and Knowledge Engineering, Cagliari, Italy, June 3-5, 2019.

[42]

Justin Zhan, Gary Blosser, Chris Yang, Lisa Singh, Privacy-preserving collaborative social networks, International Conference on Intelligence and Security Informatics, pp. 114–125, 2008.

[43]

Justin Zhan, Xing Fang, Trust maximization in social networks, International Conference on Social Computing, Behavioral-Cultural Modeling, and Prediction, pp. 205–211, 2011.

[44]

Justin Zhan, Vivek Guidibande, Sai Phani Krishna Parsa, Identification of top-K influential communities in big networks, Journal of Big Data, Vol. 3, Issue 1, pp. 16, 2016.

[45]

Justin Zhan, Sweta Gurung, Sai Phani Krishna Parsa, Identification of top-K nodes in large networks using Katz centrality, Journal of Big Data, Vol. 4, Issue 1, pp. 16, 2017.

[46]

Justin Zhan, Xing Fang, Peter Killion, Trust optimization in task-oriented social networks, 2011 IEEE Symposium on Computational Intelligence in Cyber Security, pp. 137–143, 2011.

[47]

Carter Chiu and Justin Zhan, Deep Learning for Link Prediction in Dynamic Networks Using Weak Estimators, IEEE Access, Volume 6, Issue 1, pp., 2018.

[48]

Moinak Bhaduri and Justin Zhan, Using Empirical Recurrences Rates Ratio for Time Series Data Similarity, IEEE Access, Volume 6, Issue 1., pp.30855–30864, 2018.

[49]

Jimmy Ming-Tai Wu, Justin, Zhan, and Sanket Chobe, Mining Association Rules for Low Frequency Itemsets, PLoS ONE 13(7): e0198066., 2018.

[50]

Payam Ezatpoor, Justin Zhan, Jimmy Ming-Tai Wu, and Carter Chiu, Finding Top-k Dominance on Incomplete Big Data Using MapReduce Framework, IEEE Access, Volume 6, Issue 1, pp. 7872–7887, 2018.

[51]

Pravin Chopade and Justin Zhan, Towards A Framework for Community Detection in Large Networks using Game-Theoretic Modeling, IEEE Transactions on Big Data, Volume: 3, Issue: 3, pp.276–288, 2017. Moinak Bhaduri, Justin Zhan, and Carter Chiu, A Weak Estimator For Dynamic Systems, IEEE Access, Volume 5, Issue 1, pp. 27354–27365, 2017.

[52]

Matin Pirouz and Justin Zhan, Toward Efficient Hub-Less Real Time Personalized PageRank, IEEE Access, Volume 5, Issue 1, pp. 26364–26375, 2017.

[53]

Moinak Bhaduri, Justin Zhan, Carter Chiu, and Felix Zhan, A Novel Online and Non-Parametric Approach for Drift Detection in Big Data, IEEE Access, Volume 5, Issue 1, pp. 15883–15892, 2017.

[54]

Carter Chiu, Justin Zhan, and Felix Zhan, Uncovering Suspicious Activity from Partially Paired and Incomplete Multimodal Data, IEEE Access, Volume 5, Issue 1, pp. 13689 – 13698, 2017.

[55]

Jimmy Ming-Tai Wu, Justin Zhan, Jerry Lin, Ant Colony System Sanitization Approach to Hiding Sensitive Itemsets, IEEE Access, Vol. 5, No. 1, pp. 10024–10039, 2017.

[56]

Justin Zhan and Binay Dahal, Using Deep Learning for Short Text Understanding, Journal of Big Data, 4: 34, pp. 1–15, 2017.

[57]

Justin Zhan, Timothy Rafalski, Gennady Stashkevich, Edward Verenich, Vaccination Allocation in Large Dynamic Networks, Journal of Big Data, 4: 2, 2017.

[58]

Zhan, J., Oommen, J., and Crisostomo, J., Anomaly Detection in Dynamic Systems Using Weak Estimator, ACM Transaction on Internet Technology, Vol. 11, No. 1, pp. 53–69, 2011.

[59]

Zhan, J., Hsieh C., Wang, I., Hsu, T., Liau, C., and Wang D., Privacy-Preserving Collaborative Recommender Systems, IEEE Transaction on Systems, Man, and Cybernetics, Part C, Volume 40, Issue 4, pp. 472–476, 2010.

Digital Library

[60]

Wang, I., Shen, C., Zhan, J., Hsu, T., Liau, C. and Wang, D., Empirical Evaluations of Secure Scalar Product, IEEE Transactions on Systems, Man, and Cybernetics, Part C, Vol. 39, Issue 4, pp. 440–447, 2009.

Digital Library

[61]

Andrea Hart, Brianna Smith, Sean Smith, Elijah Sales, Jacqueline Hernandez-Camargo, Yarlin Mayor Garcia, Felix Zhan, Lori Griswold, Brian Dunkelberger, Michael R. Schwob, Sharang Chaudhry, Justin Zhan, Laxmi Gewali, Paul Oh, Resolving Intravoxel White Matter Structures in the Human Brain Using Regularized Regression and Clustering, Journal of Big Data, 2019.

[62]

Jimmy Ming-Thai Wu, Justin Zhan, and Jerry Chun-Wei Lin, An ACO-based Approach to Mine High-Utility Itemsets, Knowledge-Based Systems, Vol. 116, pp. 102–113, 2017.

[63]

Justin Zhan, Vivek Gudibande, and Sai Phani Krishna Parsa, Idenfication of Top-K Influential Communities in Large Networks, Journal of Big Data, 3: 16, 2016.

[64]

Matin Pirouz, Justin Zhan, Node Reduction in Personalized Page Rank Estimation for Large Graphs, Journal of Big Data, 3–12, 2016.

[65]

Haysam Selim, Justin Zhan, Towards Shortest Path Identification on Large Networks, Journal of Big Data, 3–10, 2016.

Cited By

Mondal JDey SMukherjee A(2023)Binary Convolutional Neural Network for Efficient Gesture Recognition at EdgeProceedings of the Third International Conference on AI-ML Systems10.1145/3639856.3639874(1-10)Online publication date: 25-Oct-2023
https://dl.acm.org/doi/10.1145/3639856.3639874
Chandra MLall B(2021)A Novel Method for CNN Training Using Existing Color Datasets for Classifying Hand Postures in Bayer ImagesSN Computer Science10.1007/s42979-021-00450-w2:2Online publication date: 1-Apr-2021
https://dl.acm.org/doi/10.1007/s42979-021-00450-w

Index Terms

Hand Gesture Recognition with Convolution Neural Networks
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Object recognition
  2. Machine learning
    1. Machine learning approaches
      1. Neural networks
2. Human-centered computing
  1. Human computer interaction (HCI)

Index terms have been assigned to the content through auto-classification.

Recommendations

Depth-based hand gesture recognition

In this article, a dynamic gesture recognition system with the depth information is proposed. The proposed system consists of three main components: preprocessing, static posture recognition and dynamic gesture recognition. In the first component, the ...
Real-Time Dynamic Hand Gesture Recognition
IS3C '14: Proceedings of the 2014 International Symposium on Computer, Consumer and Control

A real time dynamic hand gesture recognition system is performed in this paper. The eleven kinds of hand gestures have been dynamic recognized, which represent the number from one to nine. The dynamic images are caught by a dynamic video. We use the ...
Robust Hand Gesture Recognition for Robotic Hand Control

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

2019 IEEE 20th International Conference on Information Reuse and Integration for Data Science (IRI)

Jul 2019

423 pages

Copyright © 2019.

Publisher

IEEE Press

Publication History

Published: 30 July 2019

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Mondal JDey SMukherjee A(2023)Binary Convolutional Neural Network for Efficient Gesture Recognition at EdgeProceedings of the Third International Conference on AI-ML Systems10.1145/3639856.3639874(1-10)Online publication date: 25-Oct-2023
https://dl.acm.org/doi/10.1145/3639856.3639874
Chandra MLall B(2021)A Novel Method for CNN Training Using Existing Color Datasets for Classifying Hand Postures in Bayer ImagesSN Computer Science10.1007/s42979-021-00450-w2:2Online publication date: 1-Apr-2021
https://dl.acm.org/doi/10.1007/s42979-021-00450-w

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents