demonstration

Automated Data Gathering and Training Tool for Personalized "Itchy Nose"

Authors:

Woontack WooAuthors Info & Claims

AH '18: Proceedings of the 9th Augmented Human International Conference

Article No.: 43, Pages 1 - 3

https://doi.org/10.1145/3174910.3174953

Published: 06 February 2018 Publication History

Get Access

Abstract

In "Itchy Nose" we proposed a sensing technique for detecting finger movements on the nose for supporting subtle and discreet interaction. It uses the electrooculography sensors embedded in the frame of a pair of eyeglasses for data gathering and uses machine-learning technique to classify different gestures. Here we further propose an automated training and visualization tool for its classifier. This tool guides the user to make the gesture in proper timing and records the sensor data. It automatically picks the ground truth and trains a machine-learning classifier with it. With this tool, we can quickly create trained classifier that is personalized for the user and test various gestures.

References

[1]

Ashbrook, D. et al. 2016. Bitey. Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services - MobileHCI '16 (New York, New York, USA, 2016), 158--169.

Digital Library

Google Scholar

[2]

Bragi Dash: https://www.bragi.com/thedash/.

Google Scholar

[3]

Harrison, C. et al. 2010. Skinput. Proceedings of the 28th international conference on Human factors in computing systems - CHI '10 (New York, New York, USA, 2010), 453.

Google Scholar

[4]

Jota, R. and Wigdor, D. 2015. Palpebrae superioris: exploring the design space of eyelid gestures. Proceedings of Graphics Interface 2015 (Toronto, Ontario, Canada, 2015), 273--280.

Digital Library

Google Scholar

[5]

Kikuchi, T. et al. 2017. EarTouch. Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services - MobileHCI '17 (New York, New York, USA, 2017), 1--6.

Digital Library

Google Scholar

[6]

Lee, J. et al. 2017. Itchy nose. Proceedings of the 2017 ACM International Symposium on Wearable Computers - ISWC '17 (New York, New York, USA, 2017), 94--97.

Digital Library

Google Scholar

[7]

Lissermann, R. et al. 2014. EarPut. Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures the Future of Design - OzCHI '14 (New York, New York, USA, 2014), 300--307.

Digital Library

Google Scholar

[8]

Yamashita, K. et al. 2017. CheekInput. Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology - VRST '17 (New York, New York, USA, 2017), 1--8.

Digital Library

Google Scholar

[9]

Zhang, C. et al. 2016. TapSkin. Proceedings of the 2016 ACM on Interactive Surfaces and Spaces - ISS '16 (New York, New York, USA, 2016), 13--22.

Digital Library

Google Scholar

Cited By

View all

Pérez-Medina JVillarreal SVanderdonckt J(2020)A Gesture Elicitation Study of Nose-Based GesturesSensors10.3390/s2024711820:24(7118)Online publication date: 11-Dec-2020
https://doi.org/10.3390/s20247118
Vanderdonckt JMagrofuoco NKieffer SPérez JRase YRoselli PVillarreal S(2019)Head and Shoulders Gestures: Exploring User-Defined Gestures with Upper BodyDesign, User Experience, and Usability. User Experience in Advanced Technological Environments10.1007/978-3-030-23541-3_15(192-213)Online publication date: 3-Jul-2019
https://doi.org/10.1007/978-3-030-23541-3_15

Index Terms

Automated Data Gathering and Training Tool for Personalized "Itchy Nose"
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques
      1. Gestural input

Recommendations

JINSense: Repurposing Electrooculography Sensors on Smart Glass for Midair Gesture and Context Sensing
CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

In this work, we explore a new sensing technique for smart eyewear equipped with Electrooculography (EOG) sensors. We repurpose the EOG sensors embedded in a JINS MEME smart eyewear, originally designed to detect eye movement, to detect midair hand ...
Itchy nose: discreet gesture interaction using EOG sensors in smart eyewear
ISWC '17: Proceedings of the 2017 ACM International Symposium on Wearable Computers

We propose a sensing technique for detecting finger movements on the nose, using EOG sensors embedded in the frame of a pair of eyeglasses. Eyeglasses wearers can use their fingers to exert different types of movement on the nose, such as flicking, ...
Haptic feedback of gaze gestures with glasses: localization accuracy and effectiveness
UbiComp/ISWC'15 Adjunct: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers

Wearable devices including smart eyewear require new interaction methods between the device and the user. In this paper, we describe our work on the combined use of eye tracking for input and haptic (touch) stimulation for output with eyewear. Input ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

AH '18: Proceedings of the 9th Augmented Human International Conference

February 2018

229 pages

ISBN:9781450354158

DOI:10.1145/3174910

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 February 2018

Check for updates

Author Tags

Qualifiers

Demonstration
Research
Refereed limited

Conference

AH2018

AH2018: The 9th Augmented Human International Conference

February 7 - 9, 2018

Seoul, Republic of Korea

Acceptance Rates

Overall Acceptance Rate 121 of 306 submissions, 40%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
147
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Pérez-Medina JVillarreal SVanderdonckt J(2020)A Gesture Elicitation Study of Nose-Based GesturesSensors10.3390/s2024711820:24(7118)Online publication date: 11-Dec-2020
https://doi.org/10.3390/s20247118
Vanderdonckt JMagrofuoco NKieffer SPérez JRase YRoselli PVillarreal S(2019)Head and Shoulders Gestures: Exploring User-Defined Gestures with Upper BodyDesign, User Experience, and Usability. User Experience in Advanced Technological Environments10.1007/978-3-030-23541-3_15(192-213)Online publication date: 3-Jul-2019
https://doi.org/10.1007/978-3-030-23541-3_15

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

JINSense: Repurposing Electrooculography Sensors on Smart Glass for Midair Gesture and Context Sensing

Itchy nose: discreet gesture interaction using EOG sensors in smart eyewear

Haptic feedback of gaze gestures with glasses: localization accuracy and effectiveness