research-article

Imagining Artificial Intelligence Applications with People with Visual Disabilities using Tactile Ideation

Authors:

Cecily Morrison,

Edward Cutrell,

Anupama Dhareshwar,

Alex TaylorAuthors Info & Claims

ASSETS '17: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility

Pages 81 - 90

https://doi.org/10.1145/3132525.3132530

Published: 19 October 2017 Publication History

Abstract

There has been a surge in artificial intelligence (AI) technologies co-opted by or designed for people with visual disabilities. Researchers and engineers have pushed technical boundaries in areas such as computer vision, natural language processing, location inference, and wearable computing. But what do people with visual disabilities imagine as their own technological future? To explore this question, we developed and carried out tactile ideation workshops with participants in the UK and India. Our participants generated a large and diverse set of ideas, most focusing on ways to meet needs related to social interaction. In some cases, this was a matter of recognizing people. In other cases, they wanted to be able to participate in social situations without foregrounding their disability. It was striking that this finding was consistent across UK and India despite substantial cultural and infrastructural differences. In this paper, we describe a new technique for working with people with visual disabilities to imagine new technologies that are tuned to their needs and aspirations. Based on our experience with these workshops, we provide a set of social dimensions to consider in the design of new AI technologies: social participation, social navigation, social maintenance, and social independence. We offer these social dimensions as a starting point to forefront users' social needs and desires as a more deliberate consideration for assistive technology design.

References

[1]

D Adams, S Kurniawan, C Herrera, V Kang, and N Friedman. 2016. Blind Photographers and VizSnap: A Long-Term Study. In Proc ASSETS '16.

Digital Library

[2]

D Ahmetovic, C Gleason, C Ruan, K Kitani, H Takagi, and C Asakawa. 2016. NavCog: a navigational cognitive assistant for the blind. In Proc MobileHCI '16.

Digital Library

[3]

D Ahmetovic, R Manduchi, J M Coughlan, and S Mascetti. 2015. Zebra Crossing Spotter: Automatic Population of Spatial Databases for Increased Safety of Blind Travelers. In Proc ASSETS '15.

Digital Library

[4]

American Printing House for the Blind. Nearby Explorer. http://louis.aph.org/product/Nearby-Explorer,142793.aspx?FormatFilter=8

[5]

C Andrews. 2014. Accessible Participatory Design: Engaging and Including Visually Impaired Participants. In Inclusive Designing. Springer.

[6]

M Avila, M Funk, and N Henze. 2015. DroneNavigator: Using Drones for Navigating Visually Impaired Persons. In Proc ASSETS '15.

Digital Library

[7]

S Azenkot, C Feng, and M Cakmak. 2016. Enabling building service robots to guide blind people: A participatory design approach. In Proc Human Robot Interaction HRI '16.

Digital Library

[8]

C M Baker, L R Milne, and R E Ladner. 2015. StructJumper. In Proc CHI '15.

[9]

J P Bigham, C Jayant, H Ji, G Little, A Miller, R C Miller, R Miller, A Tatarowicz, B White, S White, and T Yeh. 2010. VizWiz: nearly real-time answers to visual questions. In Proc UIST '10.

Digital Library

[10]

S Blessenohl, C Morrison, A Criminisi, and J Shotton. 2015. Improving Indoor Mobility of the Visually Impaired with Depth-Based Spatial Sound. In ICCVW '15 IEEE Int Conf on Computer Vision Workshops.

Digital Library

[11]

J Bornschein, D Prescher, and G Weber. 2015. Collaborative Creation of Digital Tactile Graphics. 117-126. In Proc ASSETS '15.

Digital Library

[12]

S M Branham and S K Kane. 2015. The Invisible Work of Accessibility: How Blind Employees Manage Accessibility in Mixed-Ability Workplaces. In Proc ASSETS '15.

Digital Library

[13]

S M Branham and S K Kane. 2015. Collaborative Accessibility: How Blind and Sighted Companions Co-Create Accessible Home Spaces. In Proc CHI '15.

Digital Library

[14]

P Briggs, M Blythe, J Vines, S Lindsay, P Dunphy, J Nicholson, D Green, J Kitson, A Monk and P Olivier. 2012. Invisible design: exploring insights and ideas through ambiguous film scenarios. In DIS '12.

Digital Library

[15]

A M Brock. 2013. Touch the map!: designing interactive maps for visually impaired people. SIGACCESS Access. Comput. 105: 9-14.

Digital Library

[16]

J S Brown and P Duguid. 1994. Borderline issues: Social and material aspects of design. Human-Computer Interaction 9, 1: 3-36.

Digital Library

[17]

M Campbell, C Bennett, C Bonnar, and A Borning. 2014. Where's my bus stop?: supporting independence of blind transit riders with StopInfo. In Proc ASSETS '14.

Digital Library

[18]

A Fiannaca, I Apostolopoulous, and E Folmer. 2014. Headlock: a wearable navigation aid that helps blind cane users traverse large open spaces. In Proc ASSETS '14.

Digital Library

[19]

B Friedman and D Hendry. 2012. The envisioning cards: a toolkit for catalyzing humanistic and technical imaginations. In Proc CHI '12.

Digital Library

[20]

G Fusco and V S Morash. 2015. The Tactile Graphics Helper: Providing Audio Clarification for Tactile Graphics Using Machine Vision. In Proc ASSETS '15.

Digital Library

[21]

M Golembewski and M Selby. 2010. Ideation decks: a card-based design ideation tool. In DIS '10.

Digital Library

[22]

D Graham and T Bachmann. 2004. Ideation: The Birth and Death of Ideas. Wiley.

[23]

D Gray. 2010. Gamestorming: A Playbook for Innovators, Rulebreakers, and Changemakers.

Digital Library

[24]

J Guerreiro and D Gonçalves. 2015. Faster Text-to-Speeches: Enhancing Blind People's Information Scanning with Faster Concurrent Speech. In Proc ASSETS '15.

Digital Library

[25]

Horus. https://horus.tech/horus/?l=en_us

[26]

D Jain. 2014. Path-guided indoor navigation for the visually impaired using minimal building retrofitting. In Proc ASSETS '14.

Digital Library

[27]

H Kacorri, K M Kitani, J P Bigham and C Asakawa. 2017. People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges. In Proc CHI'17.

Digital Library

[28]

N J Kemp. 1981. Social psychological aspects of blindness: A review. Current Psyc Rev 1, 1: 69.

[29]

S Krishna, D Colbry, J Black, V Balasubramanian and S Panchanathan. 2008. A systematic requirements analysis and development of an assistive device to enhance the social interaction of people who are blind or visually impaired. In Wkshp on Comp Vis Apps for the Vis Impaired.

[30]

E Luger and A Sellen. 2016. Like Having a Really Bad PA: The Gulf between User Expectation and Experience of Conversational Agents. In Proc CHI '14.

Digital Library

[31]

E Luger, L Urquhart, T Rodden, and M Golembewski. 2015. Playing the Legal Card: Using Ideation Cards to Raise Data Protection Issues within the Design Process. In Proc CHI '15.

Digital Library

[32]

R Manduchi and J M Coughlan. 2014. The last meter: blind visual guidance to a target. In Proc CHI '14.

Digital Library

[33]

D Massey. 2013. Space, place and gender. John Wiley.

[34]

O Metatla, N Bryan-Kinns, T Stockman, and F Martin. 2015. Designing with and for people living with visual impairments: Audio-tactile mock-ups, audio diaries and participatory prototyping. In CoDesign 11(1), 35-48.

[35]

Microsoft. 2016. https://blogs.msdn.microsoft.com/accessibility/2016/04/07/seeing-ai/

[36]

Microsoft. 2014. https://blogs.windows.com/devices/2014/ 11/14/microsoft-research-3d-soundscape-technology-helpsvisually-impaired/#ODbbB3H3y22YqHsD.97

[37]

M R Morris, A Perkins, C Yao, S Bahram, J P Bigham, and S K Kane. 2016. "With most of it being pictures now, I rarely use it": Understanding Twitter's Evolving Accessibility to Blind Users. In Proc CHI '16.

Digital Library

[38]

L Murray, P Hands, R Goucher, and J Ye. 2016. Capturing social cues with imaging glasses. In Proc Ubicomp '16.

Digital Library

[39]

Orcam. http://www.orcam.com/

[40]

S Panchanathan, S Chakraborty and T McDaniel. 2016. Social Interaction Assistant: A Person-Centered Approach to Enrich Social Interactions for Individuals With Visual Impairments. IEEE J Sel Top in Signal Processing, 10, 5.

[41]

S Qiu, M Rauterberg, and J Hu. 2016. Tactile Band: Accessing Gaze Signals from the Sighted in Face-to-Face Communication. In Proc TEI '16.

Digital Library

[42]

Rasmussen Consulting. 2012. The Science Behind the LEGO SERIOUS PLAY method. Retrieved from http://seriousplayground.squarespace.com/storage/The Science Behind the LEGO SERIOUS PLAY Method.pdf

[43]

M Ratto, I Record, G Coons, and M Julien. 2014. Blind tennis: extreme users and participatory design. In Proc PDC '14, 2, 41-44

Digital Library

[44]

K Shinohara and J O Wobbrock. 2016. Self-Conscious or Self-Confident? A Diary Study Conceptualizing the Social Accessibility of Assistive Technology. ACM Transactions on Accessible Computing (TACCESS) 8, 2: 5.

Digital Library

[45]

N G Sahib, T Stockman, A Tombros, and O Metatla. 2013. Participatory design with blind users: a scenario-based approach. In Proc INTERACT '13.

[46]

K Shinohara and J O Wobbrock. 2011. In the shadow of misperception. In Proc CHI '11.

Digital Library

[47]

L Stearns, R Du, U Oh, Y Wang, L Findlater, R Chellappa, and J E Froehlich. 2014. The design and preliminary evaluation of a finger-mounted camera and feedback system to enable reading of printed text for the blind. In Euro Conf on Computer Vision.

[48]

D Swann. 2011. NHS at Home: Using Lego Serious Play to Capture Service Narratives andEnvision Future Healthcare Products. INCLUDE 2011 Proceedings. http://eprints.hud.ac.uk/13355/1/SwannpdfF358_1689.pdf

[49]

R Talhouk, S Mesmar, A Thieme, M Balaam, P Olivier, C Akik, H Ghattas. 2016. Syrian refugees and digital health in Lebanon: Opportunities for improving antenatal health. In Proc ASSETS '16.

Digital Library

[50]

B Taylor, A Dey, D Siewiorek and A Smailagic. 2016. Customizable 3D Printed Tactile Maps as Interactive Overlays. In Proc ASSETS '16.

Digital Library

[51]

A Taylor. 2017. Becoming more capable. In Platypus, the CASTAC Blog. Ret April 27, 2017 from http://blog.castac.org/2017/04/becoming-more-capable

[52]

J Vines, M Blythe, S Lindsay, P Dunphy, A Monk, and P Olivier. 2012. Questionable concepts: critique as resource for designing with eighty somethings. In Proc ASSETS '12.

Digital Library

[53]

J Wallace, PC Wright, J McCarthy, DP Green, J Thomas, and P Olivier. 2013. A design-led inquiry into personhood in dementia. In Proc CHI '13.

Digital Library

[54]

M A Williams, E Buehler, A Hurst, and S K Kane. 2015. What not to wearable: using participatory workshops to explore wearable device form factors for blind users. In W4A '15, Web for All Conference.

Digital Library

[55]

M A Williams, C Galbraith, S K Kane, and A Hurst. 2014. "just let the cane hit it." In Proc ASSETS '16.

[56]

C Wölfel and T Merritt. 2013. Method card design dimensions: a survey of card-based design tools. In Proc INTERACT '13.

[57]

World Health Organization. 2013. Factsheet on Visual impairment and blindness. Retrieved from http://www.who.int/mediacentre/factsheets/fs282/en/

[58]

S Wu, J Wieland, O Farivar, and J Schiller. 2017. Automatic Alt-text: Computer-generated Image Descriptions for Blind Users on a Social Networking Service. In Proc CSCW '17.

Digital Library

[59]

H Ye, M Malu, U Oh, and L Findlater. 2014. Current and future mobile and wearable device use by people with visual impairments. In Proc CHI '14.

Digital Library

[60]

Y Zhao, S Szpiro, J Knighten, and S Azenkot. 2016. Cue-See: exploring visual cues for people with low vision to facilitate a visual search task. In Proc Ubicomp '16.

Digital Library

[61]

A Zolyomi, A Shukla, and J Snyder. 2016. Social Dimensions of Technology-Mediated Sight. In Proc ASSETS '16.

Digital Library

[62]

H Zou and J Treviranus. 2015. ChartMaster: A Tool for Interacting with Stock Market Charts using a Screen Reader. In Proc ASSETS '15.

Digital Library

Cited By

Sharma S(2024)The Potential of Artificial Intelligence to Enhance Special EducationTransforming Special Education Through Artificial Intelligence10.4018/979-8-3693-5538-1.ch004(113-138)Online publication date: 20-Sep-2024
https://doi.org/10.4018/979-8-3693-5538-1.ch004
Singh SJain P(2024)AI in Special EducationAdvanced Intelligence Systems and Innovation in Entrepreneurship10.4018/979-8-3693-0790-8.ch005(56-75)Online publication date: 16-May-2024
https://doi.org/10.4018/979-8-3693-0790-8.ch005
Palmer ZOswal S(2024)Constructing Websites with Generative AI Tools: The Accessibility of Their Workflows and Products for Users With DisabilitiesJournal of Business and Technical Communication10.1177/10506519241280644Online publication date: 28-Sep-2024
https://doi.org/10.1177/10506519241280644
Show More Cited By

Index Terms

Imagining Artificial Intelligence Applications with People with Visual Disabilities using Tactile Ideation
1. Human-centered computing
  1. Accessibility
    1. Accessibility design and evaluation methods

Recommendations

Exploring the Community of Blind or Visually Impaired People on YouTube
ASSETS '17: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility

We explore a community of blind or visually impaired (BVI) people through video blogs (vlogs) on YouTube. Many researchers have used vlogs as a means of identifying communities of video bloggers (vloggers). Nevertheless, little is still known about how ...
Groupware Accessibility for Persons with Disabilities
UAHCI '09: Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and Services

The accessibility issues of Groupware applications prevent visually impaired and other persons with disabilities access to these highly graphical interfaces. To address the accessibility issues persons with disabilities have with Groupware, a recent ...
Comparative analysis of tactile sensitivity between blind, deaf and unimpaired people

This paper presents the methodological procedures and the results of a tactile sensitivity analysis to vibrotactile stimuli. The results were obtained through the analyses between the rightness mean while identifying the target frequency, among the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ASSETS '17: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility

October 2017

450 pages

ISBN:9781450349260

DOI:10.1145/3132525

General Chair:
Amy Hurst
University of Maryland, Baltimore County, USA
,
Program Chairs:
Leah Findlater
University of Washington, USA
,
Meredith Ringel Morris
Microsoft Research, USA

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGACCESS: ACM Special Interest Group on Accessible Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ASSETS '17

Sponsor:

SIGACCESS

ASSETS '17: The 19th International ACM SIGACCESS Conference on Computers and Accessibility

October 20 - November 1, 2017

Maryland, Baltimore, USA

Acceptance Rates

ASSETS '17 Paper Acceptance Rate 28 of 126 submissions, 22%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

54
Total Citations
View Citations
1,210
Total Downloads

Downloads (Last 12 months)176
Downloads (Last 6 weeks)31

Reflects downloads up to 24 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sharma S(2024)The Potential of Artificial Intelligence to Enhance Special EducationTransforming Special Education Through Artificial Intelligence10.4018/979-8-3693-5538-1.ch004(113-138)Online publication date: 20-Sep-2024
https://doi.org/10.4018/979-8-3693-5538-1.ch004
Singh SJain P(2024)AI in Special EducationAdvanced Intelligence Systems and Innovation in Entrepreneurship10.4018/979-8-3693-0790-8.ch005(56-75)Online publication date: 16-May-2024
https://doi.org/10.4018/979-8-3693-0790-8.ch005
Palmer ZOswal S(2024)Constructing Websites with Generative AI Tools: The Accessibility of Their Workflows and Products for Users With DisabilitiesJournal of Business and Technical Communication10.1177/10506519241280644Online publication date: 28-Sep-2024
https://doi.org/10.1177/10506519241280644
Datey IZytko D(2024)"Just Like, Risking Your Life Here": Participatory Design of User Interactions with Risk Detection AI to Prevent Online-to-Offline Harm Through Dating AppsProceedings of the ACM on Human-Computer Interaction10.1145/36869068:CSCW2(1-41)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686906
Yildirim NZlotnikov SSayar DKahn JBukowski LAmin SRiman KDavis BMinturn JKing ARicketts DTang LSivaraman VPerer APreum SMcCann JZimmerman J(2024)Sketching AI Concepts with Capabilities and Examples: AI Innovation in the Intensive Care UnitProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641896(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641896
Kumar SMishra DGanie SBharathikannan RVijayakanthan K(2023)Artificial Intelligence Solutions for the Visually ImpairedHandbook of Research on AI and Knowledge Engineering for Real-Time Business Intelligence10.4018/978-1-6684-6519-6.ch013(198-207)Online publication date: 7-Apr-2023
https://doi.org/10.4018/978-1-6684-6519-6.ch013
Almurayziq TAlotibi NAlshammari GAlshammari AAlsaffar M(2023)Smart and Guide Hat for Blind Persons in Smart Cities Using Deep LearningJournal of Advances in Information Technology10.12720/jait.14.6.1214-122014:6(1214-1220)Online publication date: 2023
https://doi.org/10.12720/jait.14.6.1214-1220
Glazko KYamagami MDesai AMack KPotluri VXu XMankoff J(2023)An Autoethnographic Case Study of Generative Artificial Intelligence's Utility for AccessibilityProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3614548(1-8)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3614548
Jiang LPhutane MAzenkot S(2023)Beyond Audio Description: Exploring 360° Video Accessibility with Blind and Low Vision Users Through Collaborative CreationProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3608381(1-17)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3608381
Kameswaran VY VMarathe M(2023)Advocacy as Access Work: How People with Visual Impairments Gain Access to Digital Banking in IndiaProceedings of the ACM on Human-Computer Interaction10.1145/35795967:CSCW1(1-23)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579596
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents