poster

Geremin": 2D microgestures for drivers based on electric field sensing

Authors:

Christoph Endres,

Tim Schwartz,

Christian A. MüllerAuthors Info & Claims

IUI '11: Proceedings of the 16th international conference on Intelligent user interfaces

Pages 327 - 330

https://doi.org/10.1145/1943403.1943457

Published: 13 February 2011 Publication History

Get Access

Abstract

We introduce the "Geremin" approach on in-car 2D microgesture recognition, which belongs to the category of electric field sensing techniques detecting the presence of a human hand near a conductive object (not affected by light and dynamic backgrounds, fast response times). The core component is essentially a modified "Theremin", an early electronic musical instrument named after the Russian inventor Professor Leon Theremin. Gesture recognition is done using a Dynamic Time Warp DTW algorithm. With respect to the application domain, we follow the direction of "selective mapping to theme or function" suggested in the literature. For gesture location, we propose the immediate proximity of the steering wheel, which has the advantage of providing gesture-based interaction without requiring the driver to take off hand(s). The major motivating factor for the proposed approach is reducing installation costs. Although, we use a single-antenna setup for this study, our results indicate that the gain in recognition accuracy justifies the use of two or more.

References

[1]

F. Althoff, R. Lindl, and L. Walchshaeusl. Robust Multimodal Hand- and Head Gesture Recognition for controlling Automotive Infotainment Systems. In VDI-Tagung: Der Fahrer im 21. Jahrhundert, Braunschweig, Germany, November 22--23 2005.

Google Scholar

[2]

M. Billinghurst. Gesture Based Interaction. In B. Buxton, editor, Haptic Input. Cambridge University Press, 2009.

Google Scholar

[3]

P. Boersma. PRAAT, a system for doing phonetics by computer. Glot International, 9(5):341--345, 2001.

Google Scholar

[4]

M. J. R. Carl A. Pickering, Keith J. Burnham. A Research Study of Hand Gesture Recognition Technologies and Applications for Human Vehicle Interaction. In 3rd Conf. on Automotive Electronics, June 2007.

Google Scholar

[5]

R. Nesselrath and J. Alexandersson. A 3D Gesture Recognition System for Multimodal Dialog Systems. In 6th IJCAI Worksh. on Knowledge and Reasoning in Practical Dialogue Systems, pages 46--51, Passadena, CA, July 12 2009.

Google Scholar

[6]

K. Oka, Y. Sato, and H. Koike. Real-Time Fingertip Tracking and Gesture Recognition. IEEE Computer Graphics and Applications, 22:64--71, 2002.

Digital Library

Google Scholar

[7]

C. Pickering. Gesture Recognition Could Improve Automotive Safety. Asian Engineer - Automotive-Design, December 2006.

Google Scholar

[8]

U. Reissner. Gestures and Speech in Cars. In Electronic proceedings of Joint Advanced Student School (JASS), March 2007.

Google Scholar

[9]

T. Schlömer, B. Poppinga, N. Henze, and S. Boll. Gesture recognition with a Wii controller. In TEI '08: Proc. of the 2nd International Conference on Tangible and Embedded Interaction, pages 11--14, New York, NY, USA, 2008. ACM.

Digital Library

Google Scholar

[10]

G. ten Holt, M. Reinders, and E. Hendriks. Multi-Dimensional DTW for Gesture Recognition. In 13th Conference Advanced School for Computing and Imaging, 2007.

Google Scholar

[11]

K. Whitfield. Gesture Interface for Automotive CONTROL: Beyond Digital Expletives. Automotive Design and Production Magazine, July 2003.

Google Scholar

[12]

T. Zimmerman, J. R. Smith, J. A. Paradiso, D. Allport, and N. Gershenfeld. Applying Electric Field Sensing to Human-Computer Interfaces. In Proceedings of CHI 1995, pages 280--287. Press, 1995.

Digital Library

Google Scholar

Cited By

View all

Lambert VChaffangeon Caillet AGoguey AMalacria SNigay L(2023)Studying the Visual Representation of MicrogesturesProceedings of the ACM on Human-Computer Interaction10.1145/36042727:MHCI(1-36)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604272
Chen TLi TYang XZhu K(2023)EFRingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694786:4(1-31)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3569478
Chaffangeon Caillet AGoguey ANigay L(2023)µGlyph: a Microgesture NotationProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580693(1-28)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580693
Show More Cited By

Index Terms

Geremin": 2D microgestures for drivers based on electric field sensing
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

Kinect-based Taiwanese sign-language recognition system

Gesture-recognition is an important component for many intelligent human---computer interaction applications. For example, a realtime sign-language recognition system would detect and interpret hand gestures. Many vision-based sign-language recognition ...
Multi-scenario gesture recognition using Kinect
CGAMES '12: Proceedings of the 2012 17th International Conference on Computer Games: AI, Animation, Mobile, Interactive Multimedia, Educational & Serious Games (CGAMES)

Hand gesture recognition (HGR) is an important research topic because some situations require silent communication with sign languages. Computational HGR systems assist silent communication, and help people learn a sign language. In this article, a ...
Evaluating the placement of arm-worn devices for recognizing variations of dynamic hand gestures

Dynamic hand gestures have become increasingly popular as touch-free input modality for interactive systems. There exists a variety of arm-worn devices for the recognition of hand gestures, which differ not only in their capabilities, but also in their ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

IUI '11: Proceedings of the 16th international conference on Intelligent user interfaces

February 2011

504 pages

ISBN:9781450304191

DOI:10.1145/1943403

General Chairs:
Pearl Pu
EPFL, Switzerland
,
Michael Pazzani
Rutgers University, USA
,
Program Chairs:
Elisabeth André
Augsburg University, Germany
,
Doug Riecken
CCLS Columbia University, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 February 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

IUI '11

Sponsor:

IUI '11: 16th International Conference on Intelligent User Interfaces

February 13 - 16, 2011

CA, Palo Alto, USA

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

28
Total Citations
View Citations
453
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)1

Reflects downloads up to 13 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Lambert VChaffangeon Caillet AGoguey AMalacria SNigay L(2023)Studying the Visual Representation of MicrogesturesProceedings of the ACM on Human-Computer Interaction10.1145/36042727:MHCI(1-36)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604272
Chen TLi TYang XZhu K(2023)EFRingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694786:4(1-31)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3569478
Chaffangeon Caillet AGoguey ANigay L(2023)µGlyph: a Microgesture NotationProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580693(1-28)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580693
Chaffangeon Caillet AGoguey ANigay L(2023)3D Selection in Mixed Reality: Designing a Two-Phase Technique To Reduce Fatigue2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00095(800-809)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00095
Spakov OVenesvirta HLylykangas JFarooq ARaisamo RSurakka V(2023)Multimodal Gaze-Based Interaction in Cars: Are Mid-Air Gestures with Haptic Feedback Safer Than Buttons?Design, User Experience, and Usability10.1007/978-3-031-35702-2_24(333-352)Online publication date: 9-Jul-2023
https://doi.org/10.1007/978-3-031-35702-2_24
Chaffangeon AGoguey ANigay L(2022)μGlyphe: une Notation Graphique pour Décrire les MicrogestesProceedings of the 33rd Conference on l'Interaction Humain-Machine10.1145/3500866.3516371(1-13)Online publication date: 5-Apr-2022
https://dl.acm.org/doi/10.1145/3500866.3516371
Wilhelm MKrakowczyk DAlbayrak S(2020)PeriSense: Ring-Based Multi-Finger Gesture Interaction Utilizing Capacitive Proximity SensingSensors10.3390/s2014399020:14(3990)Online publication date: 17-Jul-2020
https://doi.org/10.3390/s20143990
Ye YZhang CHe CWang XHuang JDeng J(2020)A Review on Applications of Capacitive Displacement Sensing for Capacitive Proximity SensorIEEE Access10.1109/ACCESS.2020.29777168(45325-45342)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.2977716
Lee SYoon S(2020)User interface for in-vehicle systems with on-wheel finger spreading gestures and head-up displaysJournal of Computational Design and Engineering10.1093/jcde/qwaa052Online publication date: 19-Jun-2020
https://doi.org/10.1093/jcde/qwaa052
Nanjappan VShi RLiang HLau KYue YAtkinson K(2019)Towards a Taxonomy for In-Vehicle Interactions Using Wearable Smart Textiles: Insights from a User-Elicitation StudyMultimodal Technologies and Interaction10.3390/mti30200333:2(33)Online publication date: 9-May-2019
https://doi.org/10.3390/mti3020033
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Kinect-based Taiwanese sign-language recognition system

Multi-scenario gesture recognition using Kinect

Evaluating the placement of arm-worn devices for recognizing variations of dynamic hand gestures