Abstract
Ambient Intelligence and Ubiquitous Computing are carrying the world to a reality where almost every object interacts with the environment, either via sensors or actuators, and users must learn how to interact with such systems. This paper presents a gesture-based interaction approach to manipulate such objects. We developed a prototype using a leap motion controller as a hand-tracking device, and a Support Vector Machine as a classifier to distinguish between gestures. Our system was evaluated by 12 users with over 10 commands. We also show a review on gesture-based interaction and compare other proposals with ours.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
López, G., López, M., Guerrero, L.A., Bravo, J.: Human-objects interaction: a framework for designing, developing and evaluating augmented objects. Int. J. Hum.-Comput. Inter. 30(10), 787–801 (2014)
Yuksel, K.A., Adali, S.H.: Prototyping input controller for touch-less interaction with ubiquitous environments. In: International Conference on Human Computer Interaction with Mobile Devices and Services (2011)
Leap Motion, Inc. www.leapmotion.com
Pavlovic, V., Sharma, R., Huang, T.: Visual interpretation of hand gestures for human-computer interaction: a review. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 677–695 (1997)
Elepfandt, M., Sünderhauf, M.: Multimodal, touchless interaction in spatial augmented reality environments. In: Duffy, V.G. (ed.) ICDHM 2011. LNCS, vol. 6777, pp. 263–271. Springer, Heidelberg (2011)
Saidinejad, H., Veronese, F., Comai, S., Salice, F.: Towards a hand-based gestural language for smart-home control using hand shapes and dynamic hand movements. In: Hervás, R., Lee, S., Nugent, C., Bravo, J. (eds.) UCAmI 2014. LNCS, vol. 8867, pp. 268–271. Springer, Heidelberg (2014)
Ng, W.L., Ng, C.K., Noordin, N.K., Ali, B.M.: Gesture based automating household appliances. In: Jacko, J.A. (ed.) Human-Computer Interaction, Part II, HCII 2011. LNCS, vol. 6762, pp. 285–293. Springer, Heidelberg (2011)
Pan, G., Wu, J., Zhang, D., Wu, Z., Yang, Y., Li, S.: GeeAir: a universal multimodal remote control device for home appliances. Pers. Ubiquit. Comput. 14(8), 723–735 (2010)
Suau, X., Alcoverro, M., Lopez-Mendez, A., Ruiz-Hidalgo, J., Casas, J.: INTAIRACT: joint hand gesture and fingertip classification for touchless interaction. In: Fusiello, A., Murino, V., Cucchiara, R. (eds.) ECCV 2012 Ws/Demos, Part III. LNCS, vol. 7585, pp. 602–606. Springer, Heidelberg (2012)
Jaimes, A., Sebe, N.: Multimodal human computer interaction: a survey. In: Sebe, N., Lew, M., Huang, T.S. (eds.) HCI/ICCV 2005. LNCS, vol. 3766, pp. 1–15. Springer, Heidelberg (2005)
Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)
Scikit-Learn, Machine Learning in Python. http://scikit-learn.org/
Ben-Hur, A., Weston, J.: Data Mining Techniques for the Life Sciences. Humana Press, Totowa (2010)
Ishii, H., Ullmer, B.: Tangible bits: towards seamless interfaces between people, bits and atoms. In: ACM SIGCHI Conference on Human Factors in Computing Systems (1997)
Kawsar, F., Fujinami, K., Nakajima, T.: Augmenting everyday life with sentient artefacts. In: Joint Conference on Smart Objects and Ambient Intelligence: Innovative Context-Aware Services: Usages and Technologies (2005)
Chung, K., Shilman, M., Merrill, C., Ishii, H.: OnObject: gestural play with tagged everyday objects. In: ACM Symposium on User Interface Software and Technology (2010)
Sra, M., Lee, A., Pao, S., Jiang, G., Ishii, H.: Point and share: from paper to whiteboard. In: ACM Symposium on User Interface Software and Technology (2012)
Navarro, G.: A guided tour to approximate string matching. ACM Comput. Surv. 33(1), 31–88 (2001)
Rempel, D., Camilleri, M., Lee, D.: The design of hand gestures for human–computer interaction: lessons from sign language interpreters. Int. J. Hum Comput Stud. 72(10–11), 728–735 (2014)
Hein, A., Hoffmeyer, A., Kirste, T.: Utilizing an accelerometric bracelet for ubiquitous gesture-based interaction. In: Stephanidis, C. (ed.) UAHCI 2009, Part II. LNCS, vol. 5615, pp. 519–527. Springer, Heidelberg (2009)
Moya, J.M., de Espinosa, A.M., Araujo, Á., de Goyeneche, J.-M., Vallejo, J.C.: Low-cost gesture-based interaction for intelligent environments. In: Omatu, S., Rocha, M.P., Bravo, J., Fernández, F., Corchado, E., Bustillo, A., Corchado, J.M. (eds.) IWANN 2009, Part II. LNCS, vol. 5518, pp. 752–755. Springer, Heidelberg (2009)
Wu, J., Pan, G., Li, S., Wu, Z., Zhang, D.: GeeAir: waving in the air to control home appliances. In: Ubiquitous Intelligence Computing and 7th International Conference on Autonomic Trusted Computing (2010)
Fernández, M.Á., Peláez, V., López, G., Carus, J.L., Lobato, V.: Multimodal interfaces for the smart home: findings in the process from architectural design to user evaluation. In: Bravo, J., López-de-Ipiña, D., Moya, F. (eds.) UCAmI 2012. LNCS, vol. 7656, pp. 173–180. Springer, Heidelberg (2012)
Acknowledgments
This work was partially supported by Centro de Investigaciones en Tecnologías de la Información y Comunicación at Universidad de Costa Rica (CITIC-UCR) grand No. 834-B4-159, by Escuela de Ciencias de la Computación e Informática at Universidad de Costa Rica (ECCI-UCR), by Ministerio de Ciencia, Tecnología y Telecomunicaciones (MICITT), and by Consejo Nacional para Investigaciones Científicas y Tecnológicas (CONICIT) of the Government of Costa Rica.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Appendix
Appendix
The Table shown in this Appendix shows the results of 12 users that tested our system. Results are grouped by sex and leading hand.
User Group | Sign | Attempts | Recognized signs |
|---|---|---|---|
Female (right handed) N = 3 | Movement | 12 | 9 |
Turn on/off | 6 | 5 | |
In | 6 | 5 | |
Out | 6 | 6 | |
Male (right handed) N = 8 | Movement | 32 | 26 |
Turn on/off | 16 | 14 | |
In | 16 | 15 | |
Out | 16 | 12 | |
Male (left handed) N = 1 | Movement | 4 | 3 |
Turn on/off | 2 | 1 | |
In | 2 | 1 | |
Out | 2 | 1 |
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
López, G., Quesada, L., Guerrero, L.A. (2015). A Gesture-Based Interaction Approach for Manipulating Augmented Objects Using Leap Motion. In: Cleland, I., Guerrero, L., Bravo, J. (eds) Ambient Assisted Living. ICT-based Solutions in Real Life Situations. IWAAL 2015. Lecture Notes in Computer Science(), vol 9455. Springer, Cham. https://doi.org/10.1007/978-3-319-26410-3_22
Download citation
DOI: https://doi.org/10.1007/978-3-319-26410-3_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-26409-7
Online ISBN: 978-3-319-26410-3
eBook Packages: Computer ScienceComputer Science (R0)