research-article

ChromaGlasses: Computational Glasses for Compensating Colour Blindness

Authors:

Tobias Langlotz,

Jonathan Sutton,

Stefanie Zollmann,

Holger RegenbrechtAuthors Info & Claims

CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Paper No.: 390, Pages 1 - 12

https://doi.org/10.1145/3173574.3173964

Published: 21 April 2018 Publication History

Abstract

Prescription glasses are used by many people as a simple, and even fashionable way, to correct refractive problems of the eye. However, there are other visual impairments that cannot be treated with an optical lens in conventional glasses. In this work we present ChromaGlasses, Computational Glasses using optical head-mounted displays for compensating colour vision deficiency. Unlike prior work that required users to look at a screen in their visual periphery rather than at the environment directly, ChromaGlasses allow users to directly see the environment using a novel head-mounted displays design that analyzes the environment in real-time and changes the appearance of the environment with pixel precision to compensate the impairment of the user. In this work, we present first prototypes for ChromaGlasses and report on the results from several studies showing that ChromaGlasses are an effective method for managing colour blindness.

Supplementary Material

ZIP File (pn3346-file4.zip)

Download
2.05 MB

suppl.mov (pn3346-file3.mp4)

Supplemental video

Download
69.92 MB

suppl.mov (pn3346-file5.mp4)

Supplemental video

Download
10.96 MB

References

[1]

Cagri Ates, Alexander Fiannaca, and Eelke Folmer. 2015. Immersive simulation of visual impairments using a wearable see-through display. TEI 2015 - Proceedings of the 9th International Conference on Tangible, Embedded, and Embodied Interaction (2015), 225--228.

Digital Library

[2]

Michael Bajura, Henry Fuchs, and Ryutarou Ohbuchi. 1992. Merging Virtual Objects with the Real World: Seeing Ultrasound Imagery Within the Patient. In Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '92). ACM, New York, NY, USA, 203--210.

Digital Library

[3]

Jennifer Birch. 1973. Dichromatic convergence points obtained by subtractive colour matching. Vision Research 13, 9 (1973), 1755 -- 1765.

[4]

Hans Brettel, Françoise Viénot, and John D. Mollon. 1997. Computerized simulation of color appearance for dichromats. J. Opt. Soc. Am. A 14, 10 (Oct 1997), 2647--2655.

[5]

Andreas Bulling and Kai Kunze. 2016. Eyewear Computers for Human-computer Interaction. interactions 23, 3 (April 2016), 70--73.

Digital Library

[6]

Marta G. Carcedo, Soon Hau Chua, Simon Perrault, Paweł Wozniak, Raj Joshi, Mohammad Obaid, Morten Fjeld, and Shengdong Zhao. 2016. HaptiColor: Interpolating Color Information as Haptic Feedback to Assist the Colorblind. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems CHI '16 (2016), 3572--3583.

Digital Library

[7]

S Hau Chua, Haimo Zhang, and Muhammad Hammad. 2015. ColorBless: Augmenting Visual Information for Colorblind People with Binocular Luster Effect. ACM Transactions on ... 21, 6 (2015), 1--20.

Digital Library

[8]

Steven Feiner, Blair MacIntyre, Tobias Höllerer, and Anthony Webster. 1997. A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment. Personal Technologies 1, 4 (dec 1997), 208--217.

[9]

D. R. Pilbeam G. A. Harrison, J. M. Tanner and P. T. Baker. 1988. Human Biology An Introduction to Human Evolution, Variation, Growth and Adaptability. OUP Higher Education Division.

[10]

Yakup Genc, Mihran Tuceryan, and Nassir Navab. 2002. Practical Solutions for Calibration of Optical See-Through Devices. In Proceedings of the 1st International Symposium on Mixed and Augmented Reality (ISMAR '02). IEEE Computer Society, Washington, DC, USA, 169--. http://dl.acm.org/citation.cfm?id=850976.854985

Digital Library

[11]

J. Grubert, T. Langlotz, S. Zollmann, and H. Regenbrecht. 2017. Towards Pervasive Augmented Reality: Context-Awareness in Augmented Reality. IEEE Transactions on Visualization and Computer Graphics 23, 6 (June 2017), 1706--1724.

Digital Library

[12]

Chun-Rong Huang, Kuo-Chuan Chiu, and Chu-Song Chen. 2010. Key Color Priority Based Image Recoloring for Dichromats. In Proceedings of the Advances in Multimedia Information Processing, and 11th Pacific Rim Conference on Multimedia: Part II (PCM'10). Springer-Verlag, Berlin, Heidelberg, 637--647. http://dl.acm.org/citation.cfm?id=1894049.1894111

Digital Library

[13]

S. Ishihara. 1917. Tests for color-blindness. Handaya, Tokyo, Hongo Harukicho, Japan.

[14]

Yuta Itoh and Gudrun Klinker. 2014. Interaction-free calibration for optical see-through head-mounted displays based on 3D Eye localization. In 3D User Interfaces (3DUI), 2014 IEEE Symposium on. 75--82.

[15]

Yuta Itoh and Gudrun Klinker. 2015. Vision enhancement: defocus correction via optical see-through head-mounted displays. In Proceedings of the 6th Augmented Human International Conference. ACM, 1--8.

Digital Library

[16]

Luke Jefferson and Richard Harvey. 2006. Accommodating color blind computer users. Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility Assets 06 (2006), 40--47.

Digital Library

[17]

Luke Jefferson and Richard Harvey. 2007. An interface to support color blind computer users. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '07. ACM Press, New York, New York, USA, 1535.

Digital Library

[18]

G. Kramida. 2016. Resolving the Vergence-Accommodation Conflict in Head-Mounted Displays. IEEE Transactions on Visualization and Computer Graphics 22, 7 (July 2016), 1912--1931.

Digital Library

[19]

Giovane R. Kuhn, Manuel M. Oliveira, and L. A F Fernandes. 2008. An efficient naturalness-preserving image-recoloring method for dichromats. IEEE Transactions on Visualization and Computer Graphics 14, 6 (2008), 1747--1754.

Digital Library

[20]

Tobias Langlotz, Matthew Cook, and Holger Regenbrecht. 2016. Real-Time Radiometric Compensation for Optical See-Through Head-Mounted Displays. IEEE Transactions on Visualization and Computer Graphics 22, 11 (nov 2016), 2385--2394.

Digital Library

[21]

Tobias Langlotz, Thanh Nguyen, Dieter Schmalstieg, and Raphael Grasset. 2014. Next-Generation Augmented Reality Browsers: Rich, Seamless, and Adaptive. Proc. IEEE 102, 2 (feb 2014), 155--169.

[22]

Gustavo M. Machado and Manuel M. Oliveira. 2010. Real-Time Temporal-Coherent Color Contrast Enhancement for Dichromats. Computer Graphics Forum 29, 3 (aug 2010), 933--942.

Digital Library

[23]

G M Machado, M M Oliveira, and L A F Fernandes. 2010. A Physiologically-Based Model for Simulation of Color Vision Deficiency (vol 15, pg 1291, 2009). Ieee Transactions on Visualization and Computer Graphics 16, 2 (2010), 352.

Digital Library

[24]

Andrew Maimone and Henry Fuchs. 2013. Computational augmented reality eyeglasses. In 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 29--38.

[25]

G.W. Meyer and D.P. Greenberg. 1988. Color-defective vision and computer graphics displays. IEEE Computer Graphics and Applications 8, 5 (sep 1988), 28--40.

Digital Library

[26]

W. E. K. Middleton. 1957. Vision through the Atmosphere. Springer Berlin Heidelberg, Berlin, Heidelberg, 254--287.

[27]

E Peli. 2001. Vision multiplexing: an engineering approach to vision rehabilitation device development. Optometry and vision science : official publication of the American Academy of Optometry 78, 5 (may 2001), 304--15. http://www.ncbi.nlm.nih.gov/ /11384008

[28]

Eli Peli, Gang Luo, Alex Bowers, and Noa Rensing. 2007. Applications of Augmented Vision Head-Mounted Systems in Vision Rehabilitation. Journal of the Society for Information Display 15, 12 (2007), 1037--1045.

[29]

Alexander Plopski, Yuta Itoh, Christian Nitschke, Kiyoshi Kiyokawa, Gudrun Klinker, and Haruo Takemura. 2015. Corneal-Imaging Calibration for Optical See-Through Head-Mounted Displays. IEEE Transactions on Visualization and Computer Graphics (Proceedings Virtual Reality 2015) 21, 4 (April 2015), 481--490.

Digital Library

[30]

B. Sajadi, A. Majumder, M. M. Oliveira, R. G. Schneider, and R. Raskar. 2013. Using Patterns to Encode Color Information for Dichromats. IEEE Transactions on Visualization and Computer Graphics 19, 1 (jan 2013), 118--129.

Digital Library

[31]

Simon Schmitt, Stefan Stein, Felix Hampe, and Dietrich Paulus. 2012. Mobile services supporting color vision deficiency. Proceedings of the International Conference on Optimisation of Electrical and Electronic Equipment, OPTIM (2012), 1413--1420.

[32]

Wuyao Shen, Xiangyu Mao, Xinghong Hu, and Tien-Tsin Wong. 2016. Seamless visual sharing with color vision deficiencies. ACM Transactions on Graphics 35, 4 (jul 2016), 1--12.

Digital Library

[33]

Ivan E. Sutherland. 1968. A head-mounted three dimensional display. In Proceedings of the December 9--11, 1968, fall joint computer conference, part I on AFIPS '68 (Fall, part I). ACM Press, New York, New York, USA, 757. http://dl.acm.org/citation.cfm?id=1476589.1476686

Digital Library

[34]

Enrico Tanuwidjaja, Derek Huynh, Kirsten Koa, Calvin Nguyen, Churen Shao, Patrick Torbett, Colleen Emmenegger, and Nadir Weibel. 2014. Chroma: AWearable Augmented-Reality Solution for Color Blindness. Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing - UbiComp '14 Adjunct (2014), 799--810.

Digital Library

[35]

Françoise Viénot, Hans Brettel, and John D. Mollon. 1999. Digital video colourmaps for checking the legibility of displays by dichromats. Color Research & Application 24, 4 (1999), 243--252.

[36]

Yuhang Zhao, Michele Hu, Shafeka Hashash, and Shiri Azenkot. 2017. Understanding Low Vision People's Visual Perception on Commercial Augmented Reality Glasses. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 4170--4181.

Digital Library

[37]

Yuhang Zhao, Sarit Szpiro, Jonathan Knighten, and Shiri Azenkot. 2016. CueSee. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing - UbiComp '16. ACM Press, New York, New York, USA, 73--84.

[38]

Yuhang Zhao, Cornell Tech, Cornell Tech, Sarit Szpiro, Shiri Azenkot, Cornell Tech, Cornell Tech, Sarit Szpiro, and Shiri Azenkot. 2015. ForeSee : A Customizable Head-Mounted Vision Enhancement System for People with Low Vision. ASSETS '15 The 17th International ACM SIGACCESS Conference on Computers and Accessibility (2015), 239--249.

Digital Library

[39]

Stefanie Zollmann, Raphael Grasset, Gerhard Reitmayr, and Tobias Langlotz. 2014. Image-based X-ray Visualization Techniques for Spatial Understanding in Outdoor Augmented Reality. In Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: The Future of Design (OzCHI '14). ACM, New York, NY, USA, 194--203.

Digital Library

Cited By

Gamage BHolloway LMcDowell NDo TPrice NLowery AMarriott K(2024)Vision-Based Assistive Technologies for People with Cerebral Visual Impairment: A Review and Focus StudyProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675637(1-20)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675637
Zhu YChen EHascup CYan YSharma G(2024)Computational Trichromacy Reconstruction: Empowering the Color-Vision Deficient to Recognize Colors Using Augmented RealityProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676415(1-17)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676415
Hong JLanglotz TSutton JRegenbrecht H(2024)Visual Noise Cancellation: Exploring Visual Discomfort and Opportunities for Vision AugmentationsACM Transactions on Computer-Human Interaction10.1145/363469931:2(1-26)Online publication date: 29-Jan-2024
https://dl.acm.org/doi/10.1145/3634699
Show More Cited By

Index Terms

ChromaGlasses: Computational Glasses for Compensating Colour Blindness
1. Information systems
  1. Information systems applications
    1. Multimedia information systems
2. Social and professional topics

Recommendations

Seeing Colours: Addressing Colour Vision Deficiency with Vision Augmentations using Computational Glasses
Colour vision deficiency is a common visual impairment that cannot be compensated for using optical lenses in traditional glasses, and currently remains untreatable. In our work, we report on research on Computational Glasses for compensating colour ...
AdaptiVisor: assisting eye adaptation via occlusive optical see-through head-mounted displays
AH '17: Proceedings of the 8th Augmented Human International Conference

Brightness adaptation is a fundamental ability in human visual system, and adjusts various levels of darkness and light. While this ability is continuously used, and it can mostly handle sudden lighting changes in the environment, the adaptation could ...
Exploring Visual Discomfort and Opportunities for Vision Augmentations: Visual Noise Cancellation and Head-worn LCD Light Actuators for Perception Modulation
MobileHCI '24 Adjunct: Adjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction

Recently, Head-Mounted Displays have shown great potential for augmenting vision beyond traditional visual aids, such as compensating for complex visual impairments or providing superhuman vision to the unimpaired eye. Example applications addressed ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

April 2018

8489 pages

ISBN:9781450356206

DOI:10.1145/3173574

General Chairs:
Regan Mandryk
University of Saskatchewan, Canada
,
Mark Hancock
University of Waterloo, Canada
,
Program Chairs:
Mark Perry
Brunel University London, UK
,
Anna Cox
University College London, UK

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 April 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Honorable Mention

Author Tags

Qualifiers

Research-article

Funding Sources

JST, PRESTO Grant
Callaghan Innovation
JSPS KAKENHI Grant

Conference

CHI '18

Sponsor:

SIGCHI

CHI '18: CHI Conference on Human Factors in Computing Systems

April 21 - 26, 2018

Montreal QC, Canada

Acceptance Rates

CHI '18 Paper Acceptance Rate 666 of 2,590 submissions, 26%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

53
Total Citations
View Citations
1,254
Total Downloads

Downloads (Last 12 months)100
Downloads (Last 6 weeks)10

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gamage BHolloway LMcDowell NDo TPrice NLowery AMarriott K(2024)Vision-Based Assistive Technologies for People with Cerebral Visual Impairment: A Review and Focus StudyProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675637(1-20)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675637
Zhu YChen EHascup CYan YSharma G(2024)Computational Trichromacy Reconstruction: Empowering the Color-Vision Deficient to Recognize Colors Using Augmented RealityProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676415(1-17)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676415
Hong JLanglotz TSutton JRegenbrecht H(2024)Visual Noise Cancellation: Exploring Visual Discomfort and Opportunities for Vision AugmentationsACM Transactions on Computer-Human Interaction10.1145/363469931:2(1-26)Online publication date: 29-Jan-2024
https://dl.acm.org/doi/10.1145/3634699
Gamage BHolloway LMcDowell NDo TPrice NLowery AMarriott K(2024)Broadening Our View: Assistive Technology for Cerebral Visual ImpairmentExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650740(1-9)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650740
Lipkowitz GDesimone J(2024)Palette-PrintAR: augmented reality design and simulation for multicolor resin 3D printingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642909(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642909
Wang RPotter ZHo YKillough DZeng LMondal SZhao Y(2024)GazePrompt: Enhancing Low Vision People's Reading Experience with Gaze-Aware AugmentationsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642878(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642878
Langlotz TSutton JRegenbrecht H(2024)A Design Space for Vision Augmentations and Augmented Human Perception using Digital EyewearProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642380(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642380
Tang YZhu ZMao X(2024)A Study on Impact of Displaying Depth on User Recognition to Virtual Information2024 Nicograph International (NicoInt)10.1109/NICOInt62634.2024.00011(9-13)Online publication date: 14-Jun-2024
https://doi.org/10.1109/NICOInt62634.2024.00011
Geddes CFlatla DConnelly C(2023)30 Years of Solving the Wrong Problem: How Recolouring Tool Design Fails those with Colour Vision DeficiencyProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3608407(1-13)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3608407
Zhu ZLi JTang YGo KToyoura MKashiwagi KFujishiro IMao XWard JMcGill MMarky K(2023)CC-Glasses: Color Communication Support for People with Color Vision Deficiency Using Augmented Reality and Deep LearningProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582707(190-199)Online publication date: 12-Mar-2023
https://dl.acm.org/doi/10.1145/3582700.3582707
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents