poster

Human faces detection and localization with simulated prosthetic vision

Authors:

Grégoire Denis,

Christophe Jouffrais,

Victor Vergnieux,

Marc MacéAuthors Info & Claims

CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

Pages 61 - 66

https://doi.org/10.1145/2468356.2468368

Published: 27 April 2013 Publication History

Get Access

Abstract

Clinical trials reveal that current visual neuroprosthesis are not yet usable. The main reason is the small number of implanted electrodes, leading to a very poor visual resolution. The resolution is especially not sufficient to detect specific objects (faces, signs, etc.) in the surroundings. We used simulated prosthetic vision (SPV) to show that pre-processing of the camera image could restore these functions, even with low-resolution implants. Specifically, we showed that it is possible to quickly detect and localize human faces located nearby. We suggest that high-level processing of the video stream may be included in current visual neuroprosthesis. This would restore many visuomotor behaviors such as grasping, heading, steering, etc.

References

[1]

Bigham, J.P., Jayant, C., Miller, A., White, B., and Yeh, T. VizWiz::LocateIt - enabling blind people to locate objects in their environment. 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, (2010), 65--72.

Google Scholar

[2]

Campbell, P.K., Jones, K.E., Huber, R.J., Horch, K.W., and Normann, R.A. A silicon-based, threedimensional neural interface: manufacturing processes for an intracortical electrode array. IEEE transactions on bio-medical engineering 38, 8 (1991), 758--68.

Google Scholar

[3]

Chen, S.C., Suaning, G.J., Morley, J.W., and Lovell, N.H. Simulating prosthetic vision: I. Visual models of phosphenes. Vision Research 49, 12 (2009), 1493--1506.

Crossref

Google Scholar

[4]

Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-fei, L. ImageNet: A large-scale hierarchical image database. 2009 IEEE Conference on Computer Vision and Pattern Recognition, IEEE (2009), 248-- 255.

Crossref

Google Scholar

[5]

Dorn, J.D., Ahuja, A.K., Caspi, A., et al. The Detection of Motion by Blind Subjects With the Epiretinal 60-Electrode (Argus II) Retinal Prosthesis. Archives of ophthalmology, (2012), 1-- 7.

Google Scholar

[6]

Dramas, F., Thorpe, S.J., and Jouffrais, C. Artificial vision for the Blind: a bio-inspired algorithm for objects and obstacles detection. International Journal of Image and Graphics 10, 04 (2010), 531.

Crossref

Google Scholar

[7]

Humayun, M.S., Dorn, J.D., Da Cruz, L., et al. Interim results from the international trial of Second Sight's visual prosthesis. Ophthalmology 119, 4 (2012), 779--88.

Crossref

Google Scholar

[8]

Pérez Fornos, A., Sommerhalder, J., Da Cruz, L., et al. Temporal properties of visual perception on electrical stimulation of the retina. Investigative ophthalmology & visual science 53, 6 (2012), 2720--31.

Google Scholar

[9]

Zrenner, E., Bartz-Schmidt, K.U., Benav, H., et al. Subretinal electronic chips allow blind patients to read letters and combine them to words. Proceedings. Biological sciences / The Royal Society 278, 1711 (2011), 1489--97.

Crossref

Google Scholar

[10]

Zrenner, E., Wilke, R., Sachs, H., et al. Patients allow recognition of letters and direction of thin stripes. World Congress on Medical Physics and Biomedical Engineering - IFMBE Proceedings 25, 9 (2009), 444--447.

Google Scholar

Cited By

View all

Wang CFang CZou YYang JSawan M(2023)Artificial intelligence techniques for retinal prostheses: a comprehensive review and future directionJournal of Neural Engineering10.1088/1741-2552/acb29520:1(011003)Online publication date: 15-Feb-2023
https://doi.org/10.1088/1741-2552/acb295
Kasowski JBeyeler M(2022)Immersive Virtual Reality Simulations of Bionic VisionProceedings of the Augmented Humans International Conference 202210.1145/3519391.3522752(82-93)Online publication date: 13-Mar-2022
https://dl.acm.org/doi/10.1145/3519391.3522752
Prabhu DWise LMacMahon CDe Man MPetoe MMcCarthy C(2021)Effect of camera position on egocentric localisation with Simulated Prosthetic VisionEngineering Research Express10.1088/2631-8695/abcd513:1(015016)Online publication date: 4-Feb-2021
https://doi.org/10.1088/2631-8695/abcd51
Show More Cited By

Index Terms

Human faces detection and localization with simulated prosthetic vision

Recommendations

The Relative Importance of Depth Cues and Semantic Edges for Indoor Mobility Using Simulated Prosthetic Vision in Immersive Virtual Reality
VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology

Visual neuroprostheses (bionic eyes) have the potential to treat degenerative eye diseases that often result in low vision or complete blindness. These devices rely on an external camera to capture the visual scene, which is then translated frame-by-...
Immersive Virtual Reality Simulations of Bionic Vision
AHs '22: Proceedings of the Augmented Humans International Conference 2022

Bionic vision uses neuroprostheses to restore useful vision to people living with incurable blindness. However, a major outstanding challenge is predicting what people “see” when they use their devices. The limited field of view of current devices ...
Deep Learning–Based Scene Simplification for Bionic Vision
AHs '21: Proceedings of the Augmented Humans International Conference 2021

Retinal degenerative diseases cause profound visual impairment in more than 10 million people worldwide, and retinal prostheses are being developed to restore vision to these individuals. Analogous to cochlear implants, these devices electrically ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

April 2013

3360 pages

ISBN:9781450319522

DOI:10.1145/2468356

General Chair:
Wendy E. Mackay
INRIA
,
Program Chairs:
Stephen Brewster
Glasgow University
,
Susanne Bødker
University of Aarhus

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 April 2013

Check for updates

Author Tags

Qualifiers

Poster

Conference

CHI '13

Sponsor:

SIGCHI

CHI '13: CHI Conference on Human Factors in Computing Systems

April 27 - May 2, 2013

Paris, France

Acceptance Rates

CHI EA '13 Paper Acceptance Rate 630 of 1,963 submissions, 32%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
227
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Wang CFang CZou YYang JSawan M(2023)Artificial intelligence techniques for retinal prostheses: a comprehensive review and future directionJournal of Neural Engineering10.1088/1741-2552/acb29520:1(011003)Online publication date: 15-Feb-2023
https://doi.org/10.1088/1741-2552/acb295
Kasowski JBeyeler M(2022)Immersive Virtual Reality Simulations of Bionic VisionProceedings of the Augmented Humans International Conference 202210.1145/3519391.3522752(82-93)Online publication date: 13-Mar-2022
https://dl.acm.org/doi/10.1145/3519391.3522752
Prabhu DWise LMacMahon CDe Man MPetoe MMcCarthy C(2021)Effect of camera position on egocentric localisation with Simulated Prosthetic VisionEngineering Research Express10.1088/2631-8695/abcd513:1(015016)Online publication date: 4-Feb-2021
https://doi.org/10.1088/2631-8695/abcd51
Kono MTakahashi TNakamura HMiyaki TRekimoto J(2018)Design Guideline for Developing Safe Systems that Apply Electricity to the Human BodyACM Transactions on Computer-Human Interaction10.1145/318474325:3(1-36)Online publication date: 8-Jun-2018
https://dl.acm.org/doi/10.1145/3184743
Vergnieux VMace MJouffrais C(2014)Wayfinding with simulated prosthetic vision: Performance comparison with regular and structure-enhanced renderings2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society10.1109/EMBC.2014.6944151(2585-2588)Online publication date: Aug-2014
https://doi.org/10.1109/EMBC.2014.6944151

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

The Relative Importance of Depth Cues and Semantic Edges for Indoor Mobility Using Simulated Prosthetic Vision in Immersive Virtual Reality

Immersive Virtual Reality Simulations of Bionic Vision

Deep Learning–Based Scene Simplification for Bionic Vision