Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3241539.3241578acmconferencesArticle/Chapter ViewAbstractPublication PagesmobicomConference Proceedingsconference-collections
research-article

Battery-Free Eye Tracker on Glasses

Published: 15 October 2018 Publication History

Abstract

This paper presents a battery-free wearable eye tracker that tracks both the 2D position and diameter of a pupil based on its light absorption property. With a few near-infrared (NIR) lights and photodiodes around the eye, NIR lights sequentially illuminate the eye from various directions while photodiodes sense spatial patterns of reflected light, which are used to infer pupil's position and diameter on the fly via a lightweight inference algorithm. The system also exploits characteristics of different eye movement stages and adjusts its sensing and computation accordingly for further energy savings. A prototype is built with off-the-shelf hardware components and integrated into a regular pair of glasses. Experiments with 22 participants show that the system achieves 0.8-mm mean error in tracking pupil position (2.3 mm at the 95th percentile) and 0.3-mm mean error in tracking pupil diameter (0.9 mm at the 95th percentile) at 120-Hz output frame rate, consuming 395 µW mean power supplied by two small, thin solar cells on glasses side arms.

References

[1]
2018. Gaze tracking on Microsoft HoloLens. https://docs.microsoft. com/en-us/windows/mixed-reality/gaze. (2018).
[2]
2018. Harvard Database of Useful Biological Numbers. http: //bionumbers.hms.harvard.edu/bionumber.aspx?&id=100706&ver=4. (2018).
[3]
2018. IES Lighting Library. https://www.ies.org/standards/ ies-lighting-library/. (2018).
[4]
2018. PI NOIR CAMERA V2. https://www.raspberrypi.org/products/ pi-noir-camera-v2/. (2018).
[5]
2018. Pupil Labs. https://docs.pupil-labs.com/. (2018).
[6]
2018. Recommended Light Levels. https://www.noao.edu/education/ QLTkit/ACTIVITY_Documents/Safety/LightLevels_outdoor+indoor. pdf. (2018).
[7]
2018. Tobii Pro Glasses. https://www.tobiipro.com/product-listing/ tobii-pro-glasses-2/. (2018).
[8]
2018. Tobii Pro X2--60 eye tracker. https://www.tobiipro.com/ product-listing/tobii-pro-x2--60/. (2018).
[9]
2018. Vishay surface emitting technology. http://www.vishay.com/ docs/49623/_pt0282.pdf. (2018).
[10]
Robert W Baloh, Andrew W Sills, Warren E Kumley, and Vicente Honrubia. 1975. Quantitative measurement of saccade amplitude, duration, and velocity. Neurology 25, 11 (1975), 1065--1065.
[11]
F Behrens, M MacKeben, and W Schröder-Preikschat. 2010. An improved algorithm for automatic detection of saccades in eye movement data and for calculating saccade parameters. Behavior research methods 42, 3 (2010), 701--708.
[12]
Inessa Bekerman, Paul Gottlieb, and Michael Vaiman. 2014. Variations in eyeball diameters of the healthy adults. Journal of ophthalmology 2014 (2014).
[13]
Anna Rita Bentivoglio, Susan B Bressman, Emanuele Cassetta, Donatella Carretta, Pietro Tonali, and Alberto Albanese. 1997. Analysis of blink rate patterns in normal subjects. Movement Disorders 12, 6 (1997), 1028--1034.
[14]
PR Bittencourt, P Wade, AT Smith, and A Richens. 1981. The relationship between peak velocity of saccadic eye movements and serum benzodiazepine concentration. British journal of clinical pharmacology 12, 4 (1981), 523--533.
[15]
James Brandt. 1991. Dictionary of Eye Terminology. (1991).
[16]
Katherine Breeden and Pat Hanrahan. 2017. Gaze Data for the Analysis of Attention in Feature Films. ACM Transactions on Applied Perception (TAP) 14, 4 (2017), 23.
[17]
ABuizza and R Schmid. 1986. Velocity characteristics of smooth pursuit eye movements to different patterns of target motion. Experimental brain research 63, 2 (1986), 395--401.
[18]
Andreas Bulling, Daniel Roggen, and Gerhard Tröster. 2009. Wearable EOG goggles: eye-based interaction in everyday environments. ACM.
[19]
A. Bulling, J. A. Ward, H. Gellersen, and G. Troster. 2011. Eye Movement Analysis for Activity Recognition Using Electrooculography. IEEE Transactions on Pattern Analysis and Machine Intelligence 33, 4 (April 2011), 741--753.
[20]
Rich Caruana, Nikos Karampatziakis, and Ainur Yessenalina. 2008. An empirical evaluation of supervised learning in high dimensions. In Proceedings of the 25th international conference on Machine learning. ACM, 96--103.
[21]
Rich Caruana and Alexandru Niculescu-Mizil. 2006. An empirical comparison of supervised learning algorithms. In Proceedings of the 23rd international conference on Machine learning. ACM, 161--168.
[22]
Tianqi Chen and Carlos Guestrin. 2016. Xgboost: A scalable tree boosting system. In Proc. of SIGKDD.
[23]
Trevor J Crawford, Steve Higham, Ted Renvoize, Julie Patel, Mark Dale, Anur Suriya, and Sue Tetley. 2005. Inhibitory control of saccadic eye movements and cognitive impairment in Alzheimer's disease. Biological psychiatry 57, 9 (2005), 1052--1060.
[24]
Edward Cutrell and Zhiwei Guan. 2007. What are you looking for?: an eye-tracking study of information usage in web search. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 407--416.
[25]
Andrew T Duchowski. 2007. Eye tracking methodology. Theory and practice 328 (2007).
[26]
Y. Ebisawa and S. i. Satoh. 1993. Effectiveness of pupil area detection technique using two light sources and image difference method. In Proc. of the 15th Annual International Conference of the IEEE Engineering in Medicine and Biology Societ. 1268--1269.
[27]
Burkhart Fischer and E Ramsperger. 1984. Human express saccades: extremely short reaction times of goal directed eye movements. Experimental Brain Research 57, 1 (1984), 191--195.
[28]
RC Frecker,MEizenman, and WJ MacLean. 1989. An evaluation of optical radiation hazards associated with infrared corneal. CMBEC15CCGB, Toronto, Ontario, Canada (1989).
[29]
Jerome H Friedman. 2001. Greedy function approximation: a gradient boosting machine. Annals of statistics (2001), 1189--1232.
[30]
Jukka Häkkinen, Takashi Kawai, Jari Takatalo, Reiko Mitsuya, and Göte Nyman. 2010. What do people look at when they watch stereoscopic movies?. In Stereoscopic Displays and Applications XXI, Vol. 7524. International Society for Optics and Photonics, 75240E.
[31]
Kenneth Holmqvist, Marcus Nyström, and Fiona Mulvey. 2012. Eye Tracker Data Quality: What It is and How to Measure It. In Proc. of the Symposium on Eye Tracking Research and Applications.
[32]
Michael Xuelin Huang, Tiffany CK Kwok, Grace Ngai, Stephen CF Chan, and Hong Va Leong. 2016. Building a personalized, autocalibrating eye tracker from user interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 5169--5179.
[33]
Edmund Burke Huey. 1908. The psychology and pedagogy of reading. The Macmillan Company.
[34]
Jukka Hyönä, Robert F Lorch Jr, and Johanna K Kaakinen. 2002. Individual differences in reading to summarize expository text: Evidence from eye fixation patterns. Journal of Educational Psychology 94, 1 (2002), 44.
[35]
William G Iacono, Margaret Moreau, Morton Beiser, Jonathan AE Fleming, and Tsung-Yi Lin. 1992. Smooth-pursuit eye tracking in firstepisode psychotic patients and their relatives. Journal of Abnormal Psychology 101, 1 (1992), 104.
[36]
Kenji Irie, Bruce A Wilson, Richard D Jones, Philip J Bones, and Tim J Anderson. 2002. A laser-based eye-tracking system. Behavior Research Methods, Instruments, & Computers 34, 4 (2002), 561--572.
[37]
Olivia E. Kang, Katherine E. Huffer, and Thalia P. Wheatley. 2014. Pupil Dilation Dynamics Track Attention to High-Level Information. PLOS ONE 9, 8 (08 2014), 1--6.
[38]
Oleg V Komogortsev and Javed I Khan. 2007. Kalman filtering in the design of eye-gaze-guided computer interfaces. In International Conference on Human-Computer Interaction. Springer, 679--689.
[39]
Ravi Kothari and Jason L Mitchell. 1996. Detection of eye locations in unconstrained visual images. In Image Processing, 1996. Proceedings., International Conference on, Vol. 3. IEEE, 519--522.
[40]
Bartosz Kunka and Bozena Kostek. 2009. Non-intrusive infrared-free eye tracking method. In Signal Processing Algorithms, Architectures, Arrangements, and Applications Conference Proceedings (SPA), 2009. IEEE, 105--109.
[41]
Tianxing Li, Qiang Liu, and Xia Zhou. 2017. Ultra-Low Power Gaze Tracking for Virtual Reality. In Proc. of SenSys.
[42]
Tianxing Li and Xia Zhou. 2018. Battery-Free Eye Tracker on Glasses. Technical Report TR2018--861. Department of Computer Science, Dartmouth College.
[43]
Simon P. Liversedge and John M. Findlay. 2000. Saccadic eye movements and cognition. Trends in Cognitive Sciences 4, 1 (2000), 6 -- 14.
[44]
Addison Mayberry, Pan Hu, Benjamin Marlin, Christopher Salthouse, and Deepak Ganesan. 2014. iShadow: design of a wearable, real-time mobile gaze tracker. In Proc. of MobiCom.
[45]
Addison Mayberry, Yamin Tun, Pan Hu, Duncan Smith-Freedman, Deepak Ganesan, Benjamin M Marlin, and Christopher Salthouse. 2015. CIDER: Enabling robustness-power tradeoffs on a computational eyeglass. In Proc. of MobiCom.
[46]
Yair Morad, Hadas Lemberg, Nehemiah Yofe, and Yaron Dagan. 2000. Pupillography as an objective indicator of fatigue. Current Eye Research 21, 1 (2000), 535--542.
[47]
C.H Morimoto, D Koons, A Amir, andMFlickner. 2000. Pupil detection and tracking using multiple light sources. Image and Vision Computing 18, 4 (2000), 331 -- 335.
[48]
Carlos Hitoshi Morimoto, Dave Koons, Arnon Amir, and Myron Flickner. 2000. Pupil detection and tracking using multiple light sources. Image and vision computing 18, 4 (2000), 331--335.
[49]
Tamami Nakano, Makoto Kato, Yusuke Morito, Seishi Itoi, and Shigeru Kitazawa. 2013. Blink-related momentary activation of the default mode network while viewing videos. Proceedings of the National Academy of Sciences 110, 2 (2013), 702--706.
[50]
Harald Niederreiter. 1988. Low-discrepancy and low-dispersion sequences. Journal of number theory 30, 1 (1988), 51--70.
[51]
P-H Niemenlehto. 2009. Constant false alarm rate detection of saccadic eye movements in electro-oculography. Computer methods and programs in biomedicine 96, 2 (2009), 158--171.
[52]
Marcus Nyström and Kenneth Holmqvist. 2010. An adaptive algorithm for fixation, saccade, and glissade detection in eyetracking data. Behavior research methods 42, 1 (2010), 188--204.
[53]
Gillian A O'driscoll, Mark F Lenzenweger, and Philip S Holzman. 1998. Antisaccades and smooth pursuit eye tracking and schizotypy. Archives of general psychiatry 55, 9 (1998), 837--843.
[54]
Takehiko Ohno, Naoki Mukawa, and Atsushi Yoshikawa. 2002. FreeGaze: a gaze tracking system for everyday gaze interaction. In Proceedings of the 2002 symposium on Eye tracking research & applications. ACM, 125--132.
[55]
Sandra Oliveira, Friderike Oehler, Jesús San-Miguel-Ayanz, Andrea Camia, and José MC Pereira. 2012. Modeling spatial patterns of fire occurrence in Mediterranean Europe using Multiple Regression and Random Forest. Forest Ecology and Management 275 (2012), 117--129.
[56]
Naoyuki Osaka. 1992. Size of saccade and fixation duration of eye movements during reading: Psychophysics of Japanese text processing. JOSA A 9, 1 (1992), 5--13.
[57]
Alexandra Papoutsaki, James Laskey, and Jeff Huang. 2017. SearchGazer:Webcam Eye Tracking for Remote Studies ofWeb Search. In Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval. ACM, 17--26.
[58]
James L. Reilly, Rebekka Lencer, Jeffrey R. Bishop, Sarah Keedy, and John A. Sweeney. 2008. Pharmacological treatment effects on eye movement control. Brain and Cognition 68, 3 (2008), 415 -- 435.
[59]
JPH Reulen, JT Marcus, D Koops, FR De Vries, G Tiesinga, K Boshuizen, and JE Bos. 1988. Precise recording of eye movement: the IRIS technique Part 1. Medical and Biological Engineering and Computing 26, 1 (1988), 20--26.
[60]
D. A. Robinson. 1963. A Method of Measuring Eye Movement Using a Scleral Search Coil in a Magnetic Field. IEEE Transactions on Biomedical Electronics 10, 4 (Oct 1963), 137--145.
[61]
Timothy A Salthouse and Cecil L Ellis. 1980. Determinants of eyefixation duration. The American journal of psychology (1980), 207--234.
[62]
Dario D. Salvucci. 1999. Inferring Intent in Eye-based Interfaces: Tracing Eye Movements with Process Models. In Proc. of CHI.
[63]
Dario D. Salvucci. 1999. Mapping Eye Movements to Cognitive Processes. Ph.D. Dissertation. Carnegie Mellon University.
[64]
Dario D Salvucci and Joseph H Goldberg. 2000. Identifying fixations and saccades in eye-tracking protocols. In Proceedings of the 2000 symposium on Eye tracking research & applications. ACM, 71--78.
[65]
N Sarkar, B O'Hanlon, A Rohani, D Strathearn, G Lee, M Olfat, and RR Mansour. 2017. A resonant eye-tracking microsystem for velocity estimation of saccades and foveated rendering. In Micro Electro Mechanical Systems (MEMS), 2017 IEEE 30th International Conference on. IEEE, 304--307.
[66]
Louis L Scharf and Cédric Demeure. 1991. Statistical signal processing: detection, estimation, and time series analysis. Vol. 63. Addison-Wesley Reading, MA.
[67]
Jeroen BJ Smeets and Ignace TC Hooge. 2003. Nature of variability in saccades. Journal of neurophysiology 90, 1 (2003), 12--20.
[68]
Mark B Spitzer and Jeffrey Jacobsen. 1994. Eye tracking system having an array of photodetectors aligned respectively with an array of pixels. (July 19 1994). US Patent 5,331,149.
[69]
SR Research Ltd. 2005. EyeLink 1000 User Manual. (2005).
[70]
Patrick Suppes. 1990. Eye-movement models for arithmetic and reading performance. Eye movements and their role in visual and cognitive processes 4 (1990), 455--477.
[71]
Ambuj Varshney, Andreas Soleiman, Luca Mottola, and Thiemo Voigt. 2017. Battery-free Visible Light Sensing. In Proceedings of the 4th ACM Workshop on Visible Light Communication Systems. ACM, 3--8.
[72]
MéLodie Vidal, Jayson Turner, Andreas Bulling, and Hans Gellersen. 2012. Wearable eye tracking for mental health monitoring. Computer Communications 35, 11 (2012), 1306--1311.
[73]
RJM Vullers, Rob van Schaijk, Inge Doms, Chris Van Hoof, and R Mertens. 2009. Micropower energy harvesting. Solid-State Electronics 53, 7 (2009), 684--693.
[74]
G. Waldman. 2002. Introduction to Light: The Physics of Light, Vision, and Color. Dover Publications.
[75]
Bruce A Wilson, Richard D Jones, Philip J Bones, and Tim J Anderson. 1996. A flying-spot laser scanner for tracking eye movements. In Engineering in Medicine and Biology Society, 1996. Bridging Disciplines for Biomedicine. Proceedings of the 18th Annual International Conference of the IEEE, Vol. 1. IEEE, 146--147.
[76]
Alfred L Yarbus. 1967. Eye movements during perception of complex objects. In Eye movements and vision. Springer, 171--211.
[77]
Lan Zhang, Xiang-Yang Li, Wenchao Huang, Kebin Liu, Shuwei Zong, Xuesi Jian, Puchun Feng, Taeho Jung, and Yunhao Liu. 2014. It Starts with iGaze: Visual Attention Driven Networking with Smart Glasses. In Proc. of MobiCom.
[78]
Yongtuo Zhang, Wen Hu, Weitao Xu, Chun Tung Chou, and Jiankun Hu. 2018. Continuous Authentication Using Eye Movement Response of Implicit Visual Stimuli. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 4 (2018), 177.
[79]
Jie Zhu and Jie Yang. 2002. Subpixel eye gaze tracking. In Automatic face and gesture recognition, 2002. proceedings. fifth ieee international conference on. IEEE, 131--136.

Cited By

View all
  • (2024)EyeGesener: Eye Gesture Listener for Smart Glasses Interaction Using Acoustic SensingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785418:3(1-28)Online publication date: 9-Sep-2024
  • (2024)UrineSpec: A Lightweight Near-Infrared Spectroscopy System for Metabolite Detection in UrineProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699375(799-810)Online publication date: 4-Nov-2024
  • (2024)Towards Invisible Eye Tracking with Lens-Coupled Lateral PhotodetectorsProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3656354(1-7)Online publication date: 4-Jun-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
MobiCom '18: Proceedings of the 24th Annual International Conference on Mobile Computing and Networking
October 2018
884 pages
ISBN:9781450359030
DOI:10.1145/3241539
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 October 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. energy harvesting
  2. eye tracking
  3. light sensing

Qualifiers

  • Research-article

Funding Sources

  • CNS-1552924

Conference

MobiCom '18
Sponsor:

Acceptance Rates

MobiCom '18 Paper Acceptance Rate 42 of 187 submissions, 22%;
Overall Acceptance Rate 440 of 2,972 submissions, 15%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)135
  • Downloads (Last 6 weeks)17
Reflects downloads up to 14 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)EyeGesener: Eye Gesture Listener for Smart Glasses Interaction Using Acoustic SensingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785418:3(1-28)Online publication date: 9-Sep-2024
  • (2024)UrineSpec: A Lightweight Near-Infrared Spectroscopy System for Metabolite Detection in UrineProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699375(799-810)Online publication date: 4-Nov-2024
  • (2024)Towards Invisible Eye Tracking with Lens-Coupled Lateral PhotodetectorsProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3656354(1-7)Online publication date: 4-Jun-2024
  • (2024)Practical Optical Camera Communication Behind Unseen and Complex BackgroundsProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661866(113-126)Online publication date: 3-Jun-2024
  • (2024)Theia: Gaze-driven and Perception-aware Volumetric Content Delivery for Mixed Reality HeadsetsProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661858(70-84)Online publication date: 3-Jun-2024
  • (2024)GazeTrak: Exploring Acoustic-based Eye Tracking on a Glass FrameProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3649376(497-512)Online publication date: 29-May-2024
  • (2024)Laser-Powered Vibrotactile RenderingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314497:4(1-25)Online publication date: 12-Jan-2024
  • (2024)Practical Gaze Tracking on Any Surface With Your PhoneIEEE Transactions on Mobile Computing10.1109/TMC.2024.344537323:12(14689-14707)Online publication date: Dec-2024
  • (2024)A wearable non-contact optical system based on muscle tracking for ultra-long-term and indirect eye-tracking2024 International Conference on Electrical, Computer and Energy Technologies (ICECET10.1109/ICECET61485.2024.10698669(1-10)Online publication date: 25-Jul-2024
  • (2024)Fingertip Air-Writing with Ambient LightMobile and Ubiquitous Systems: Computing, Networking and Services10.1007/978-3-031-63992-0_11(179-191)Online publication date: 19-Jul-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

EPUB

View this article in ePub.

ePub

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media