Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Towards Automating Retinoscopy for Refractive Error Diagnosis

Published: 07 September 2022 Publication History

Abstract

Refractive error is the most common eye disorder and is the key cause behind correctable visual impairment, responsible for nearly 80% of the visual impairment in the US. Refractive error can be diagnosed using multiple methods, including subjective refraction, retinoscopy, and autorefractors. Although subjective refraction is the gold standard, it requires cooperation from the patient and hence is not suitable for infants, young children, and developmentally delayed adults. Retinoscopy is an objective refraction method that does not require any input from the patient. However, retinoscopy requires a lens kit and a trained examiner, which limits its use for mass screening. In this work, we automate retinoscopy by attaching a smartphone to a retinoscope and recording retinoscopic videos with the patient wearing a custom pair of paper frames. We develop a video processing pipeline that takes retinoscopic videos as input and estimates the net refractive error based on our proposed extension of the retinoscopy mathematical model. Our system alleviates the need for a lens kit and can be performed by an untrained examiner. In a clinical trial with 185 eyes, we achieved a sensitivity of 91.0% and specificity of 74.0% on refractive error diagnosis. Moreover, the mean absolute error of our approach was 0.75±0.67D on net refractive error estimation compared to subjective refraction measurements. Our results indicate that our approach has the potential to be used as a retinoscopy-based refractive error screening tool in real-world medical settings.

References

[1]
Arunika Agarwal, David E Bloom, Vincent P deLuise, Alyssa Lubet, Kaushik Murali, and Srinivas M Sastry. 2019. Comparing low-cost handheld autorefractors: A practical approach to measuring refraction in low-resource settings. PLoS One 14, 10 (Oct 2019).
[2]
Haitham Al-Mahrouqi, Saif Oraba, Shihab Al-Habsi, Noufal Mundemkattil, Jithin Babu, Sathiya Panchatcharam, Rashid Al-Saidi, and Abdulatif Al-Raisi. 2019. Retinoscopy as a Screening Tool for Keratoconus. Cornea 38 (04 2019), 1. https://doi.org/10.1097/ICO.0000000000001843
[3]
American Optometric Association. 2020. Evidence-based clinical practice guideline: Comprehensive pediatric eye and vision examination. Optometric Clinical Practice (2020), 2--67.
[4]
Anvesh Annadanam, Varshini Varadaraj, Lucy Mudie, Alice Liu, William Plum, J. White, Megan Collins, and David Friedman. 2018. Comparison of self-refraction using a simple device, USee, with manifest refraction in adults. PLOS ONE 13 (02 2018). https://doi.org/10.1371/journal.pone.0192055
[5]
Shrikant R Bharadwaj, Menaka Malavita, and Jennifer Jayaraj. 2014. A psychophysical technique for estimating the accuracy and precision of retinoscopy. Clinical and Experimental Optometry 97, 2 (2014), 164--170. https://doi.org/10.1111/cxo.12112
[6]
Karthik S Bhat, Mohit Jain, and Neha Kumar. 2021. Infrastructuring Telehealth in (In)Formal Patient-Doctor Contexts. Proc. ACM Hum.-Comput. Interact. 5, CSCW2, Article 323 (oct 2021), 28 pages. https://doi.org/10.1145/3476064
[7]
Paul Boeder and H. E. Kolder. 1984. Neutralization at Infinity in Streak Retinoscopy. Archives of Ophthalmology 102, 9 (09 1984), 1396--1399. https://doi.org/10.1001/archopht.1984.01040031138042 arXiv:https://jamanetwork.com/journals/jamaophthalmology/articlepdf/635237/archopht_102_9_042.pdf
[8]
Rupert Bourne, Jaimie Adelson, Seth Flaxman, Paul Briant, Hugh Taylor, Robert Casson, Mukharram Bikbov, Michele Bottone, Tasanee Braithwaite, Alain Bron, Ching-yu Cheng, Maria Vittoria Cicinelli, Nathan Congdon, Arthur Fernandes, David Friedman, Joao Furtado, Ronnie George, Rim Kahloun, John Kempen, and Theo Vos. 2020. Trends in Prevalence of Blindness and Distance and Near Vision Impairment Over 30 Years and Contribution to the Global Burden of Disease in 2020. SSRN Electronic Journal (01 2020). https://doi.org/10.2139/ssrn.3582742
[9]
Richard F. Brubaker, Robert D. Reinecke, and Jack C. Copeland. 1969. Meridional Refractometry: I. Derivation of Equations. Archives of Ophthalmology 81, 6 (06 1969), 849--852. https://doi.org/10.1001/archopht.1969.00990010851018
[10]
Antoni Buades, Bartomeu Coll, and Jean-Michel Morel. 2011. Non-Local Means Denoising. Image Processing On Line 1 (2011), 208--212. https://doi.org/10.5201/ipol.2011.bcm_nlm.
[11]
John Canny. 1986. A Computational Approach to Edge Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-8, 6 (1986), 679--698. https://doi.org/10.1109/TPAMI.1986.4767851
[12]
Weng Onn Chan, Matthew Crabb, David Sia, and Deepa Ajay Taranath. 2014. Creating a digital retinoscope by combining a mobile smartphone camera and a retinoscope. Journal of AAPOS: the official publication of the American Association for Pediatric Ophthalmology and Strabismus 18 4 (2014), 387--8.
[13]
Ying-Ling Chen, bo Tan, and Jwl Lewis. 2003. Simulation of eccentric photorefraction images. Optics express 11 (08 2003), 1628--42. https://doi.org/10.1364/OE.11.001628
[14]
Yee-Fong Choong, Ai-Hong Chen, and Pik-Pin Goh. 2006. A comparison of autorefraction and subjective refraction with and without cycloplegia in primary school children. Am J Ophthalmol 142, 1 (July 2006), 68--74.
[15]
Kenneth Ciuffreda and Mark Rosenfield. 2015. Evaluation of the SVOne: A Handheld, Smartphone-Based Autorefractor. Optometry and vision science: official publication of the American Academy of Optometry 92 (11 2015). https://doi.org/10.1097/OPX.0000000000000726
[16]
J.M. Corboy. 2003. The Retinoscopy Book: An Introductory Manual for Eye Care Professionals. Slack. https://books.google.co.in/books?id=6I6JeDWonhQC
[17]
I. Cosme-Cisneros, G. Escamilla-Ruiz, D. Flores-Montoya, G. Hernández-Gómez, and A. Gómez-Vieyra. 2017. Instrument for Recording Purkinje Images. 101--109. https://doi.org/10.1007/978-3-319-28513-9_14
[18]
L Dandona, R Dandona, M Srinivas, P Giridhar, K Vilas, M N Prasad, R K John, C A McCarty, and G N Rao. 2001. Blindness in the Indian state of Andhra Pradesh. Invest Ophthalmol Vis Sci 42, 5 (April 2001), 908--916.
[19]
Sean P. Donahue, Brian Arthur, Daniel E. Neely, Robert W. Arnold, David Silbert, and James B. Ruben. 2013. Guidelines for automated preschool vision screening: A 10-year, evidence-based update. Journal of American Association for Pediatric Ophthalmology and Strabismus 17, 1 (2013), 4--8. https://doi.org/10.1016/j.jaapos.2012.09.012
[20]
Chao Dong, Chen Change Loy, and Xiaoou Tang. 2016. Accelerating the Super-Resolution Convolutional Neural Network. In Computer Vision - ECCV 2016, Bastian Leibe, Jiri Matas, Nicu Sebe, and Max Welling (Eds.). Springer International Publishing, Cham, 391--407.
[21]
Nicholas J Durr, Shivang R Dave, Fuensanta A Vera-Diaz, Daryl Lim, Carlos Dorronsoro, Susana Marcos, Frank Thorn, and Eduardo Lage. 2015. Design and Clinical Evaluation of a Handheld Wavefront Autorefractor. Optometry and vision science: official publication of the American Academy of Optometry 92, 12 (December 2015), 1140--1147. https://doi.org/10.1097/opx.0000000000000732
[22]
David B. Elliott. 2016. The good (logMAR), the bad (Snellen) and the ugly (BCVA, number of letters read) of visual acuity measurement. Ophthalmic and Physiological Optics 36, 4 (2016), 355--358. https://doi.org/10.1111/opo.12310 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/opo.12310
[23]
Daniel Ian Flitcroft, Mingguang He, Jost B. Jonas, Monica Jong, Kovin Naidoo, Kyoko Ohno-Matsui, Jugnoo Rahi, Serge Resnikoff, Susan Vitale, and Lawrence Yannuzzi. 2019. IMI - Defining and Classifying Myopia: A Proposed Set of Standards for Clinical and Epidemiologic Studies. Investigative Ophthalmology & Visual Science 60, 3 (02 2019), M20-M30. https://doi.org/10.1167/iovs.18-25957 arXiv:https://arvojournals.org/arvo/content_public/journal/iovs/937872/i1552-5783-60-3-m20.pdf
[24]
LVPEI Center for Innovation. 2018. FoFo (Folding Foropter) project. Retrieved January 1,2022 from https://www.fofo-project.com/
[25]
Eugene Fu, Zhongqi Yang, Hong Leong, Grace Ngai, Chi Wai Do, and Lily Chan. 2020. Exploiting Active Learning in Novel Refractive Error Detection with Smartphones. 2775--2783. https://doi.org/10.1145/3394171.3413748
[26]
Siddhartha Gairola, Murtuza Bohra, Nadeem Shaheer, Navya Jayaprakash, Pallavi Joshi, Anand Balasubramaniam, Kaushik Murali, Nipun Kwatra, and Mohit Jain. 2022. SmartKC: Smartphone-Based Corneal Topographer for Keratoconus Detection. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 4, Article 155 (dec 2022), 27 pages. https://doi.org/10.1145/3494982
[27]
Siddhartha Gairola, Pallavi Joshi, Anand Balasubramaniam, Kaushik Murali, Nipun Kwatra, and Mohit Jain. 2022. Keratoconus Classifier for Smartphone-based Corneal Topographer. In 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). IEEE.
[28]
Baran Gencer, Engin Ozgurhan, Tuğba Kurt, Ismail Ersan, Sedat Arıkan, Selçuk Kara, Mediha Coşar, and Ercüment Bozkurt. 2015. Comparision of pupil size in myopic and hyperopic patients. Pamukkale Medical Journal 8 (01 2015), 88--91. https://doi.org/10.5505/ptd.2015.59455
[29]
R. I. Hartley and A. Zisserman. 2004. Multiple View Geometry in Computer Vision (second ed.). Cambridge University Press, ISBN: 0521540518.
[30]
Xilang Huang, Sang Joon Lee, Chang Kim, and Seon Han Choi. 2021. An automatic screening method for strabismus detection based on image processing. PLOS ONE 16 (08 2021), e0255643. https://doi.org/10.1371/journal.pone.0255643
[31]
J. Illingworth and J. Kittler. 1987. The Adaptive Hough Transform. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-9, 5 (1987), 690--698. https://doi.org/10.1109/TPAMI.1987.4767964
[32]
V Swetha E Jeganathan, Nita Valikodath, Leslie M Niziol, Sean Hansen, Hannah Apostolou, and Maria A Woodward. 2018. Accuracy of a Smartphone-based Autorefractor Compared with Criterion-standard Refraction. Optometry and vision science: official publication of the American Academy of Optometry 95, 12 (December 2018), 1135--1141. https://doi.org/10.1097/opx.0000000000001308
[33]
Daniela Jesus, Flávio Villela, Luis Orlandin, Fernando Eiji, Daniel Dantas, and Milton Alves. 2016. Comparison between refraction measured by Spot Vision ScreeningTM and subjective clinical refractometry. Clinics 70 (02 2016), 69--72. https://doi.org/10.6061/clinics/2016(02)03
[34]
Jorge Jorge, António Queirós, José B Almeida, and Manuel A Parafita. 2005. Retinoscopy/autorefraction: which is the best starting point for a noncycloplegic refraction? Optometry and vision science: official publication of the American Academy of Optometry 82, 1 (January 2005), 64--68. http://europepmc.org/abstract/MED/15630406
[35]
S. Kullback and R. A. Leibler. 1951. On Information and Sufficiency. The Annals of Mathematical Statistics 22, 1 (1951), 79--86.
[36]
Michael Lawless, FRACS FRACO, Anthony DCLP, and Mark FRACS. 2007. Keratoconus: Diagnosis and management. Australian and New Zealand Journal of Ophthalmology 17 (11 2007), 33 - 60. https://doi.org/10.1111/j.1442-9071.1989.tb00487.x
[37]
Olivia L Lee. 2015. Retinoscopy 101. Retrieved February 1,2022 from https://www.aao.org/young-ophthalmologists/yo-info/article/retinoscopy-101
[38]
Jody Leone (nee Major), Paul Mitchell, Ian Morgan, Annette Kifley, and Kathryn Rose. 2010. Use of Visual Acuity to Screen for Significant Refractive Errors in Adolescents Is It Reliable? Archives of ophthalmology 128 (07 2010), 894--9. https://doi.org/10.1001/archophthalmol.2010.134
[39]
Alan Lukežic, Tomáš Vojír, Luka Cehovin Zajc, Jirí Matas, and Matej Kristan. 2017. Discriminative Correlation Filter with Channel and Spatial Reliability. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 4847--4856. https://doi.org/10.1109/CVPR.2017.515
[40]
Alex Mariakakis, Megan A. Banks, Lauren Phillipi, Lei Yu, James Taylor, and Shwetak N. Patel. 2017. BiliScreen: Smartphone-Based Scleral Jaundice Monitoring for Liver and Pancreatic Disorders. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 2, Article 20 (jun 2017), 26 pages. https://doi.org/10.1145/3090085
[41]
Sara J McCullough, Lesley Doyle, and Kathryn J Saunders. 2017. Intra- and inter- examiner repeatability of cycloplegic retinoscopy among young children. Ophthalmic & physiological optics: the journal of the British College of Ophthalmic Opticians (Optometrists) 37, 1 (January 2017), 16--23. https://doi.org/10.1111/opo.12341
[42]
Kaushik Murali, Viswesh Krishna, Vrishab Krishna, B. Kumari, Sowmya Raveendra Murthy, Vidhya C, and Payal Shah. 2021. Effectiveness of Kanna photoscreener in detecting amblyopia risk factors. Indian Journal of Ophthalmology 69, 8 (2021). https://journals.lww.com/ijo/Fulltext/2021/08000/Effectiveness_of_Kanna_photoscreener_in_detecting.19.aspx
[43]
Kovin S Naidoo, Janet Leasher, Rupert R Bourne, Seth R Flaxman, Jost B Jonas, Jill Keeffe, Hans Limburg, Konrad Pesudovs, Holly Price, Richard A White, Tien Y Wong, Hugh R Taylor, Serge Resnikoff, and Vision Loss Expert Group of the Global Burden of Disease Study. 2016. Global Vision Impairment and Blindness Due to Uncorrected Refractive Error, 1990--2010. Optom Vis Sci 93, 3 (March 2016), 227--234.
[44]
World Health Organization. 2019. World report on vision. World Health Organization. 160 p. pages.
[45]
Nobuyuki Otsu. 1979. A threshold selection method from gray level histograms. IEEE Transactions on Systems, Man, and Cybernetics 9 (1979), 62--66.
[46]
Art Owen. 2007. A robust hybrid of lasso and ridge regression. Contemp. Math. 443 (01 2007). https://doi.org/10.1090/conm/443/08555
[47]
Vitor F. Pamplona, Ankit Mohan, Manuel M. Oliveira, and Ramesh Raskar. 2010. NETRA: Interactive Display for Estimating Refractive Errors and Focal Range. ACM Trans. Graph. 29, 4, Article 77 (jul 2010), 8 pages. https://doi.org/10.1145/1778765.1778814
[48]
Chunjong Park, Hung Ngo, Libby Rose Lavitt, Vincent Karuri, Shiven Bhatt, Peter Lubell-Doughtie, Anuraj H. Shankar, Leonard Ndwiga, Victor Osoti, Juliana K. Wambua, Philip Bejon, Lynette Isabella Ochola-Oyier, Monique Chilver, Nigel Stocks, Victoria Lyon, Barry R. Lutz, Matthew Thompson, Alex Mariakakis, and Shwetak Patel. 2021. The Design and Evaluation of a Mobile System for Rapid Diagnostic Test Interpretation. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 1, Article 29 (mar 2021), 26 pages. https://doi.org/10.1145/3448106
[49]
Donatella Pascolini and Silvio Paolo Mariotti. 2012. Global estimates of visual impairment: 2010. British Journal of Ophthalmology 96, 5 (2012), 614--618. https://doi.org/10.1136/bjophthalmol-2011-300539
[50]
Arnaud Payerols, Claudie Eliaou, Véronique Trezeguet, Max Villain, and Vincent Daien. 2016. Accuracy of PlusOptix A09 distance refraction in pediatric myopia and hyperopia. BMC ophthalmology 16 (June 2016), 72. https://doi.org/10.1186/s12886-016-0247-8
[51]
J S Rahi, C S Peckham, and P M Cumberland. 2008. Visual impairment due to undiagnosed refractive error in working age adults in Britain. Br J Ophthalmol 92, 9 (Sept. 2008), 1190--1194.
[52]
Austin Roorda, Melanie Campbell, and William Bobier. 1997. Slope-based eccentric photorefraction: Theoretical analysis of different light source configurations and effects of ocular aberrations. Journal of the Optical Society of America. A, Optics, image science, and vision 14 (11 1997), 2547--56. https://doi.org/10.1364/JOSAA.14.002547
[53]
Aran Safir, Lyon Hyams, John Philpot, and Louis S. Jagerman. 1970. Studies in Refraction: I. The Precision of Retinoscopy. Archives of Ophthalmology 84, 1 (07 1970), 49--61. https://doi.org/10.1001/archopht.1970.00990040051013
[54]
Ashwin Sainani. 2013. Special considerations for prescription of glasses in children. Journal of Clinical Ophthalmology and Research 1 (01 2013), 169. https://doi.org/10.4103/2320-3897.116861
[55]
Geetha Sravani, Vinay Nilagiri, and Shrikant Bharadwaj. 2015. Photorefraction estimates of refractive power varies with the ethnic origin of human eyes. Scientific reports 5 (01 2015), 7976. https://doi.org/10.1038/srep07976
[56]
J M Tielsch, A Sommer, K Witt, J Katz, and R M Royall. 1990. Blindness and visual impairment in an American urban population. The Baltimore Eye Survey. Arch Ophthalmol 108, 2 (Feb. 1990), 286--290.
[57]
Silay Ugurbas, Numan Küçük, Irem Isik, Atilla Alpay, Cagatay Buyukuysal, and Suat Uğurbaş. 2019. Objective vision screening using PlusoptiX for children aged 3-11 years in rural Turkey. BMC Ophthalmology 19 (03 2019). https://doi.org/10.1186/s12886-019-1080-7
[58]
Edward Jay Wang, Junyi Zhu, Mohit Jain, Tien-Jui Lee, Elliot Saba, Lama Nachman, and Shwetak N. Patel. 2018. Seismo: Blood Pressure Monitoring Using Built-in Smartphone Accelerometer and Camera. Association for Computing Machinery, New York, NY, USA, 1--9. https://doi.org/10.1145/3173574.3173999
[59]
Wolfgang Wesemann, Anthony Norcia, and Dale Allen. 1992. Theory of eccentric photorefraction (photoretinoscopy): astigmatic eyes. Journal of the Optical Society of America. A, Optics and image science 8 (01 1992), 2038--47. https://doi.org/10.1364/JOSAA.8.002038
[60]
Stephanie West and Cathy Williams. 2016. Amblyopia in children (aged 7 years or less). BMJ clinical evidence 2016 (01 2016).
[61]
Zhongqi Yang, Eugene Fu, Grace Ngai, Hong Leong, Chi Wai Do, and Lily Chan. 2020. Screening for refractive error with low-quality smartphone images. 119--128. https://doi.org/10.1145/3428690.3429175
[62]
Yaopeng Zhou. 2015. Portable wavefront aberrometer. 9066683 (06 2015). https://www.freepatentsonline.com/9066683.html
[63]
Basil J. Zitelli, Sara C. McIntire, and Andrew J. Nowalk. 2012. Zitelli and Davis' atlas of pediatric physical diagnosis. Saunders/Elsevier.
[64]
Karel J. Zuiderveld. 1994. Contrast Limited Adaptive Histogram Equalization. In Graphics Gems.

Cited By

View all
  • (2024)Examining the challenges of blood pressure estimation via photoplethysmogramScientific Reports10.1038/s41598-024-68862-114:1Online publication date: 7-Aug-2024
  • (2024)BCLA CLEAR Presbyopia: Evaluation and diagnosisContact Lens and Anterior Eye10.1016/j.clae.2024.10215647:4(102156)Online publication date: Aug-2024
  • (2023)Towards Intermediated Workflows for Hybrid TelemedicineProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580653(1-17)Online publication date: 19-Apr-2023

Index Terms

  1. Towards Automating Retinoscopy for Refractive Error Diagnosis

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
      Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 6, Issue 3
      September 2022
      1612 pages
      EISSN:2474-9567
      DOI:10.1145/3563014
      Issue’s Table of Contents
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 07 September 2022
      Published in IMWUT Volume 6, Issue 3

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Retinoscopy
      2. diagnosis
      3. health sensing
      4. hyperopia
      5. image processing
      6. low cost system
      7. mobile health
      8. myopia
      9. optics
      10. refractive error
      11. retinoscope
      12. screening
      13. smartphone

      Qualifiers

      • Research-article
      • Research
      • Refereed

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)91
      • Downloads (Last 6 weeks)3
      Reflects downloads up to 26 Nov 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Examining the challenges of blood pressure estimation via photoplethysmogramScientific Reports10.1038/s41598-024-68862-114:1Online publication date: 7-Aug-2024
      • (2024)BCLA CLEAR Presbyopia: Evaluation and diagnosisContact Lens and Anterior Eye10.1016/j.clae.2024.10215647:4(102156)Online publication date: Aug-2024
      • (2023)Towards Intermediated Workflows for Hybrid TelemedicineProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580653(1-17)Online publication date: 19-Apr-2023

      View Options

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media