article

Pupil localization in image data acquired with near-infrared or visible wavelength illumination

Author:

Farmanullah JanAuthors Info & Claims

Multimedia Tools and Applications, Volume 77, Issue 1

Pages 1041 - 1067

https://doi.org/10.1007/s11042-016-4334-x

Published: 01 January 2018 Publication History

Abstract

Pupil localization in human face/eye images has numerous applications, e.g., eye tracking, iris recognition, cataract assessment and surgery, diabetic retinopathy screening, neuropsychiatric disorders diagnosing, and aliveness detection. In real scenario, the pupil localization task suffers from many complications such as pupil's constriction and dilation moments, light reflections, eyelids and eyelashes, and cataract disease. To resolve this issue, this study proposes an accurate and fast pupil localization scheme. It performs relatively well for eyeimages acquired either with the near infrared (NIR) or visible wavelength (VW) illumination. First, it effectively preprocesses the input eyeimage. Next, it coarsely marks pupil location using a scheme comprising an adaptive threshold and two-dimensional (2D) object properties. Then, it validates pupil location via an effective test involving global gray-level statistics. If it finds pupil location invalid, then it localizes pupil through a hybrid of the Hough transform and image global gray-level statistics. Finally, it localizes the fine pupillary boundary through a hybrid of the Fourier series and image's gradients. Its experimental results obtained on numerous publically available iris datasets demonstrate its superiority over most of the contemporary schemes.

References

[1]

Abdullah MAM, Dlay SS, Woo WL (2014) Fast and accurate pupil isolation based on morphology and active contour. Int J Inf Electron Eng 4(6):418---422

[2]

Aydi W, Masmoudi N, Kamoun L (2012) Active contour without edges vs GVF active contour for accurate pupil segmentation. Int J Comput Appl 54(4):25---36

[3]

Azeem A, Sharif M, Raza M, Murtaza M (2014) A survey: face recognition techniques under partial occlusion. Int Arab J Inf Technol 11(1):1---10

[4]

Basit A, Javed MY, Masood S. Non-circular pupil localization in iris images. In: Proc 4th Int Conf Emerging Technol (ICET 2008); Rawalpindi, Pakistan; 18---19 Oct. 2008: p. 228---231;

[5]

Bowyer KW, Hollingsworth K, Flynn PJ (2008) Image understanding for iris biometrics: A survey. Comp Vision Image Underst (CVIU) 110(2):281---307

Digital Library

[6]

CASIA iris databases; http://biometrics.idealtest.org/dbDetailForUser.do?id=4. Accessed 24 Dec 2016

[7]

Daugman J (2007) New methods in iris recognition. IEEE Trans Syst Man Cybern Part-B 37(5):1167---1175

Digital Library

[8]

GokayA EP, Orhan MK (2013) A video-based eye pupil detection system for diagnosing bipolar disorder. Turkish J Electr Eng Comput Sci 21:2367---2377

[9]

Gonzalez RC, Woods RE (2001) Digital Image Processing, 2nd edn. Upper Saddle River, Prentice Hall

Digital Library

[10]

Google webiste; https://www.google.com.pk/. Accessed 24 Dec 2016

[11]

IITD iris databases; http://www.iitd.ac.in/. Accessed 24 Dec 2016

[12]

Jan F (2017) Segmentation and localization schemes for non-ideal iris biometric systems. Signal Process 133:192---212

Digital Library

[13]

Jan F, Imran U, Khan SA, Malik SA (2014) A dynamic non-circular iris localization technique for non-ideal data. Comput Electr Eng 40(8):215---226

Digital Library

[14]

Jan F, Usman I, Agha S (2012) Iris localization in frontal eye images for less constrained iris recognition systems. Digital Signal Process 22(6):971---986

Digital Library

[15]

Jarjes AA, Kuanquan W, Mohammed GJ. Iris localization: Detecting accurate pupil contour and localizing limbus boundary. In: Proc 2nd Int Asia Conf Informatics Control, Automation and Robotics (CAR); Wuhan; 6---7 March 2010: p. 349---352.

Digital Library

[16]

Javadi AH, Hakimi Z, Barati M, Walsh V, Tcheang L (2015) SET: a pupil detection method using sinusoidal approximation. Front Neuroeng 8(4):1---15

[17]

Krishnamoorthy R, Indradevi D (2013) A new snake model for pupil localization using orthogonal polynomials transform. Int J Comput Theory Eng 5(1):36---40

[18]

Laddi A, Prakash NR (2016) An augmented image gradients based supervised regression technique for iris center localization. Mult Tools Applic 1---11.

Digital Library

[19]

Lee GJ, Jang SW, Kim GY (2014) Pupil center detection using edge and circle characteristics. Adv Sci Technol Lett 49:53---58

[20]

Leo M, Cazzato D, Marco TD, Distante C (2013) Unsupervised approach for the accurate localization of the pupils in near-frontal facial images. J Electron Imaging 22(3):033033-1---033033-10

[21]

Li P, Liu X (2008)An incremental method for accurate iris segmentation. in: Proc 19th Int Conf Pattern Recogn (ICPR 2008); Tampa, FL; 8---11 Dec. 2008; pp.1:4.

[22]

Lin TC, Huang HC, Liao BY, Pan JS (2007) An optimized approach on applying genetic algorithm to adaptive cluster validity index. Int J Comput Sci Eng Syst 1(4):253---257

[23]

Lin YT, Lin RY, Lin YC, Lee GC (2012) Real-time eye-gaze estimation using a low-resolution webcam. Multimed Tools Appl 65(3):543---568

Digital Library

[24]

Lin Z, Yu H (2011) The pupil location based on the OTSU method and hough transform. Procedia Environ Sci 8:352---356

[25]

Marciniak T, Dąbrowski A, Chmielewska A, Krzykowska AA (2014) Selection of parameters in iris recognition system. Multimed Tools Appl 68(1):193---208

Digital Library

[26]

Markus N, Miroslav F, Pandzic IS, Ahlberg J, Forchheimer R (2014) Eye pupil localization with an ensemble of randomized trees. Pattern Recogn 47(2):578---587

Digital Library

[27]

Masek L (2003) Recognition of human iris patterns for biometric identification. BSc-Thesis: School of Computer Science and Software Engineering; The University of Western Australia

[28]

MMU iris databases; http://pesona.mmu.edu.my/~ccteo/. Accessed 24 Dec 2016

[29]

Mohammed GJ, Hong BR, Jarjes AA (2010) Accurate pupil features extraction based on new projection functions. Comput Inform 29(4):663---680

[30]

Morimoto CH, Koons D, Amir A, Flickner M (2000) Pupil detection and tracking using multiple light sources. Image Vis Comput 18(4):331---335

[31]

Morimoto CH, Santos TT, Muniz AS (2005) Automatic Iris Segmentation Using Active Near Infra Red Lighting. In: Computer Graphics Image Processing SIBGRAPI 2005. 18th Brazilian Symposium on. 2005

Digital Library

[32]

Perumal RS, Mouli PVSSRC (2011) Pupil segmentation from IRIS images using modified peak detection algorithm. Int J Comput Appl 31(7):51---56

[33]

Puhan NB, Sudha N, Anirudh SK (2011) Efficient segmentation technique for noisy frontal view iris images using Fourier spectral density. Signal Image Video Process 5(1):105---119

[34]

Radman A, Jumari K, Zainal N (2013) Fast and reliable iris segmentation algorithm. IET Image Process 7(1):42---49

[35]

Roig AB, Marta M, Julian E, Jorge P, David M, Carlos I (2012) Pupil detection and tracking for analysis of fixational eye micromovements. Optik --- Int J Light Electron Opt 123(1):11---15

[36]

Saad IA, George LE, Tayyar AA (2014) Accurate and fast pupil localization using contrast stretching, seed filling and circular geometrical constraints. J Comput Sci 10(2):305---315

[37]

Skodras E, Kanas VG, Fakotakis N (2015) On visual gaze tracking based on a single low cost camera. Signal Process Image Commun 36:29---42

Digital Library

[38]

Talmi K, Liu J (1999) Eye and gaze tracking for visually controlled interactive stereoscopic displays. Signal Process Image Commun 14(10):799---810

[39]

Teo C, Neo H, Michael G, Tee C, Sim K (2010) A robust iris segmentation with fuzzy supports. In: Neural Information Processing. Theory and Algorithms, K. Wong, B. Mendis, and A. Bouzerdoum, Editors. Springer Berlin / Heidelberg, p. 532---539

Digital Library

[40]

UBIRIS iris databases; http://iris.di.ubi.pt/. Accessed 24 Dec 2016

[41]

UPOL iris database; http://www.cbsr.ia.ac.cn:8080/iapr_database.jsp. Accessed 24 Dec 2016

[42]

Wang QZ, Kang WJ, Wang YJ (2016) Support tensor machine image classification algorithm based on tensor principal component analysis. J Inf Hiding Multimed Signal Process 7(6):1265---1273

[43]

Wang J, Zhang G, Shi J (2015) Pupil and glint detection using wearable camera sensor and near-infrared LED array. Sensors 15(12):30126---30141

[44]

Wikipediacwebsite; http://en.wikipedia.org/wiki/Main_Page. Accessed 24 Dec 2016

[45]

Wildes RP (1997) Iris recognition: an emerging biometric technology. Proc IEEE 85(9):1348---1363

[46]

Yadav MR, Shivdas SS (2014) Novel method to localize the pupil in eye gaze tracking systems. Int J Emerging Technol Computational Applied Sci 14:52---57

[47]

Yuasa M, Yamaguchi O, Fukui K (2004) Precise pupil contour detection based on minimizing the energy of pattern and edge. IEICE Trans Inf Syst 87(1):105---112

[48]

Zhu D, Moore ST, Raphan T (1999) Robust pupil center detection using a curvature algorithm. Comput Methods Prog Biomed 59(3):145---157

Cited By

Chen JYu PYao CZhao LQiao Y(2024)Eye detection and coarse localization of pupil for video-based eye tracking systemsExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.121316236:COnline publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1016/j.eswa.2023.121316
Li MZhang WHu BKang JWang YLu S(2023)Automatic Assessment of Depression and Anxiety through Encoding Pupil-wave from HCI in VR ScenesACM Transactions on Multimedia Computing, Communications, and Applications10.1145/351326320:2(1-22)Online publication date: 25-Sep-2023
https://dl.acm.org/doi/10.1145/3513263
Min-Allah NJan FAlrashed S(2021)Pupil detection schemes in human eye: a reviewMultimedia Systems10.1007/s00530-021-00806-527:4(753-777)Online publication date: 1-Aug-2021
https://dl.acm.org/doi/10.1007/s00530-021-00806-5
Show More Cited By

Index Terms

Pupil localization in image data acquired with near-infrared or visible wavelength illumination
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
        Scene understanding
  2. Machine learning

Index terms have been assigned to the content through auto-classification.

Recommendations

Eye detection and coarse localization of pupil for video-based eye tracking systems
Abstract
A video-based eye tracking system generally captures NIR images, each of which contains one or two eyes of a subject. The subject’s point of gaze is then determined using 3D eye model and pupil centre corneal reflection technique. Eye detection ...
Pupil vs. Eyelid: Evaluating the Accuracy of Blink Detection in Pupil-based Eye Tracking Devices
Abstract
Spontaneous eye blinks as a means to tap into human cognitive and affective processes have been demonstrated to offer valuable insight in various fields of application, such as human-computer-interaction and driver drowsiness detection. ...
Non-circular iris contours localization in the visible wavelength eye images

Effective non-circular iris contours localization algorithm.Validated on the visible wavelength iris databases.Validated on the near infra-red iris databases.It is real-time applicable. Contemporary iris localization schemes perform well for ideal eye ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Multimedia Tools and Applications

Multimedia Tools and Applications Volume 77, Issue 1

January 2018

1467 pages

ISSN:1380-7501

Issue’s Table of Contents

Copyright © Copyright © 2018 Springer Science+Business Media, LLC, part of Springer Nature.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 January 2018

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chen JYu PYao CZhao LQiao Y(2024)Eye detection and coarse localization of pupil for video-based eye tracking systemsExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.121316236:COnline publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1016/j.eswa.2023.121316
Li MZhang WHu BKang JWang YLu S(2023)Automatic Assessment of Depression and Anxiety through Encoding Pupil-wave from HCI in VR ScenesACM Transactions on Multimedia Computing, Communications, and Applications10.1145/351326320:2(1-22)Online publication date: 25-Sep-2023
https://dl.acm.org/doi/10.1145/3513263
Min-Allah NJan FAlrashed S(2021)Pupil detection schemes in human eye: a reviewMultimedia Systems10.1007/s00530-021-00806-527:4(753-777)Online publication date: 1-Aug-2021
https://dl.acm.org/doi/10.1007/s00530-021-00806-5
Jan FMin-Allah NAgha SUsman IKhan I(2020)A robust iris localization scheme for the iris recognitionMultimedia Tools and Applications10.1007/s11042-020-09814-580:3(4579-4605)Online publication date: 30-Sep-2020
https://dl.acm.org/doi/10.1007/s11042-020-09814-5
Vyas RKanumuri TSheoran GDubey P(2019)Recent trends of ROI segmentation in iris biometricsInternational Journal of Biometrics10.1504/ijbm.2019.10084211:3(274-307)Online publication date: 23-May-2019
https://dl.acm.org/doi/10.1504/ijbm.2019.100842
Kapoor RGupta RSon LKumar R(2019)Iris localization for direction and deformation independence based on polynomial curve fitting and singleton expansionMultimedia Tools and Applications10.1007/s11042-019-7314-078:14(19279-19303)Online publication date: 1-Jul-2019
https://dl.acm.org/doi/10.1007/s11042-019-7314-0

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents