research-article

EyeGuardian: a framework of eye tracking and blink detection for mobile device users

Authors:

Mario GerlaAuthors Info & Claims

HotMobile '12: Proceedings of the Twelfth Workshop on Mobile Computing Systems & Applications

Article No.: 6, Pages 1 - 6

https://doi.org/10.1145/2162081.2162090

Published: 28 February 2012 Publication History

Abstract

Computer Vision Syndrome (CVS) is a common problem in the "Information Age", and it is becoming more serious as mobile devices (e.g. smartphones and tablet PCs) with small, low-resolution screens are outnumbering the home computers. The simplest way to avoid CVS is to blink frequently. However, most people do not realize that they blink less and some do not blink at all in front of the screen. In this paper, we present a mobile application that keeps track of the reader's blink rate and prods the user to blink if an exceptionally low blink rate is detected. The proposed eye detection and tracking algorithm is designed for mobile devices and can keep track of the eyes in spite of camera motion. The main idea is to predict the eye position in the camera frame using the feedback from the built-in accelerometer. The eye tracking system was built on a commercial Tablet PC. The experimental results consistently show that the scheme can withstand very aggressive mobility scenarios.

References

[1]

http://online.wsj.com/article/SB10001424052748704868604575433361436276340.html?mod=WSJ_hpp_MIDDLENexttoWhatsNewsThird.

[2]

http://opencv.willowgarage.com/wiki/Android.

[3]

www.osteopathic.org.

[4]

Batista, J. A drowsiness and point of attention monitoring system for driver vigilance. In Intelligent Transportation Systems Conference, 2007. ITSC 2007. IEEE (30 2007-oct. 3 2007), pp. 702--708.

[5]

Bradski, G., and Kaehler, A. Learning OpenCV. O'Reilly Media, Inc., 2008.

[6]

Chau, M., and Betke, M. Real time eye tracking and blink detection with usb cameras. Tech. rep., 2005.

[7]

Freund, Y., and Schapire, R. E. A decision-theoretic generalization of on-line learning and an application to boosting. In Proceedings of the Second European Conference on Computational Learning Theory (London, UK, 1995), Springer-Verlag, pp. 23--37.

Digital Library

[8]

Grauman, K., Betke, M., Gips, J., and Bradski, G. Communication via eye blinks - detection and duration analysis in real time. In Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on (2001), vol. 1, pp. I--1010 -- I--1017 vol.1.

[9]

Grauman, K., Betke, M., Lombardi, J., Gips, J., and Bradski, G. R. Communication via eye blinks and eyebrow raises: Video-based human-computer interfaces. In UNIVERSAL ACCESS IN THE INFORMATION SOCIETY (2003), pp. 2--4.

Digital Library

[10]

Lienhart, R., and Maydt, J. An extended set of haar-like features for rapid object detection. In Image Processing. 2002. Proceedings. 2002 International Conference on (2002), vol. 1, pp. I--900 -- I--903 vol.1.

[11]

Magee, J. J., Scott, M. R., Waber, B. N., and Betke, M. Eyekeys: A real-time vision interface based on gaze detection from a low-grade video camera. In In Proceedings of the IEEE Workshop on Real-Time Vision for Human-Computer Interaction (RTV4HCI (2004), pp. 159--166.

Digital Library

[12]

Miluzzo, E., Wang, T., and Campbell, A. T. Eyephone: activating mobile phones with your eyes. In Proceedings of the second ACM SIGCOMM workshop on Networking, systems, and applications on mobile handhelds (New York, NY, USA, 2010), MobiHeld '10, ACM, pp. 15--20.

Digital Library

[13]

Picot, A., Caplier, A., and Charbonnier, S. Comparison between eog and high frame rate camera for drowsiness detection. In Applications of Computer Vision (WACV), 2009 Workshop on (dec. 2009), pp. 1--6.

[14]

Tsubota, K. Tear dynamics and dry eye. Progress in Retinal and Eye Research 17, 4 (1998), 565--596.

[15]

Viola, P., and Jones, M. Rapid object detection using a boosted cascade of simple features. In Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on (2001), vol. 1, pp. I--511 -- I--518 vol.1.

[16]

Yan, Z., Hu, L., Chen, H., and Lu, F. Computer vision syndrome: A widely spreading but largely unknown epidemic among computer users. Comput. Hum. Behav. 24 (September 2008), 2026--2042.

Digital Library

Cited By

Silva-Sánchez DJiménez-Barbosa WValero-Pacheco IGómez-Rúa N(2024)Aportes de las intervenciones educativas en el manejo del Síndrome Visual Informático: una revisión de literaturaRevista Ciencia y Cuidado10.22463/17949831.401521:1Online publication date: 1-Jan-2024
https://doi.org/10.22463/17949831.4015
Cheng HLou WYang YChen YZhang X(2023)TwinkleTwinkleProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35962387:2(1-30)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3596238
Wolffsohn JLingham GDownie LHuntjens BInomata TJivraj SKobia-Acquah EMuntz AMohamed-Noriega KPlainis SRead MSayegh RSingh SUtheim TCraig J(2023)TFOS Lifestyle: Impact of the digital environment on the ocular surfaceThe Ocular Surface10.1016/j.jtos.2023.04.00428(213-252)Online publication date: Apr-2023
https://doi.org/10.1016/j.jtos.2023.04.004
Show More Cited By

Recommendations

MAGIC pointing for eyewear computers
ISWC '15: Proceedings of the 2015 ACM International Symposium on Wearable Computers

In this paper, we propose a combination of head and eye movements for touchlessly controlling the "mouse pointer" on eyewear devices, exploiting the speed of eye pointing and accuracy of head pointing. The method is a wearable computer-targeted ...
Analysing EOG signal features for the discrimination of eye movements with wearable devices
PETMEI '11: Proceedings of the 1st international workshop on pervasive eye tracking & mobile eye-based interaction

Eye tracking research in human-computer interaction and experimental psychology traditionally focuses on stationary devices and a small number of common eye movements. The advent of pervasive eye tracking promises new applications, such as eye-based ...
Eye-based head gestures
ETRA '12: Proceedings of the Symposium on Eye Tracking Research and Applications

A novel method for video-based head gesture recognition using eye information by an eye tracker has been proposed. The method uses a combination of gaze and eye movement to infer head gestures. Compared to other gesture-based methods a major advantage ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HotMobile '12: Proceedings of the Twelfth Workshop on Mobile Computing Systems & Applications

February 2012

92 pages

ISBN:9781450312073

DOI:10.1145/2162081

General Chair:
Gaetano Borriello
University of Washington
,
Program Chair:
Rajesh Krishna Balan
Singapore Management University, SG

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 February 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

HotMobile '12

Sponsor:

SIGMOBILE

HotMobile '12: 13th Workshop on Mobile Computing Systems and Applications

February 28 - 29, 2012

California, San Diego

Acceptance Rates

HotMobile '12 Paper Acceptance Rate 14 of 68 submissions, 21%;

Overall Acceptance Rate 96 of 345 submissions, 28%

Upcoming Conference

HOTMOBILE '25

Sponsor:
sigmobile

The 26th International Workshop on Mobile Computing Systems and Applications

February 26 - 27, 2025

La Quinta , CA , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

29
Total Citations
View Citations
813
Total Downloads

Downloads (Last 12 months)33
Downloads (Last 6 weeks)5

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Silva-Sánchez DJiménez-Barbosa WValero-Pacheco IGómez-Rúa N(2024)Aportes de las intervenciones educativas en el manejo del Síndrome Visual Informático: una revisión de literaturaRevista Ciencia y Cuidado10.22463/17949831.401521:1Online publication date: 1-Jan-2024
https://doi.org/10.22463/17949831.4015
Cheng HLou WYang YChen YZhang X(2023)TwinkleTwinkleProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35962387:2(1-30)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3596238
Wolffsohn JLingham GDownie LHuntjens BInomata TJivraj SKobia-Acquah EMuntz AMohamed-Noriega KPlainis SRead MSayegh RSingh SUtheim TCraig J(2023)TFOS Lifestyle: Impact of the digital environment on the ocular surfaceThe Ocular Surface10.1016/j.jtos.2023.04.00428(213-252)Online publication date: Apr-2023
https://doi.org/10.1016/j.jtos.2023.04.004
Apicharttrisorn KChen JSekar VRowe AKrishnamurthy SGummeson JLee SGao JXing G(2022)Breaking Edge ShacklesProceedings of the 20th ACM Conference on Embedded Networked Sensor Systems10.1145/3560905.3568546(1-15)Online publication date: 6-Nov-2022
https://dl.acm.org/doi/10.1145/3560905.3568546
Izhar FAli SPonum MMahmood MIlyas HIqbal A(2022)Detection & recognition of veiled and unveiled human face on the basis of eyes using transfer learningMultimedia Tools and Applications10.1007/s11042-022-13402-082:3(4257-4287)Online publication date: 25-Jul-2022
https://doi.org/10.1007/s11042-022-13402-0
Pandey NMuppalaneni N(2022)A survey on visual and non-visual features in Driver’s drowsiness detectionMultimedia Tools and Applications10.1007/s11042-022-13150-181:26(38175-38215)Online publication date: 23-Apr-2022
https://doi.org/10.1007/s11042-022-13150-1
Hwang YShin DEun JSuh BLee J(2021)Design Guidelines of a Computer-Based Intervention for Computer Vision Syndrome: Focus Group Study and Real-World DeploymentJournal of Medical Internet Research10.2196/2209923:3(e22099)Online publication date: 29-Mar-2021
https://doi.org/10.2196/22099
Liu JLi DWang LXiong J(2021)BlinkListenerProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34635215:2(1-27)Online publication date: 24-Jun-2021
https://dl.acm.org/doi/10.1145/3463521
Singh NMishra SBhardwaj A(2021)Eye Blinking Detection Test2021 3rd International Conference on Advances in Computing, Communication Control and Networking (ICAC3N)10.1109/ICAC3N53548.2021.9725633(1734-1736)Online publication date: 17-Dec-2021
https://doi.org/10.1109/ICAC3N53548.2021.9725633
Keerthana MVishnu Prasath MYaswanthkumar S(2021)A Computer Vision Approach for Automated Driver Assistance System2021 International Conference on Intelligent Technologies (CONIT)10.1109/CONIT51480.2021.9498356(1-5)Online publication date: 25-Jun-2021
https://doi.org/10.1109/CONIT51480.2021.9498356
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents