research-article

Public Access

Editing Spatial Layouts through Tactile Templates for People with Visual Impairments

Authors:

Joshua A. Miele,

Maneesh Agrawala,

Sean FollmerAuthors Info & Claims

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Paper No.: 206, Pages 1 - 11

https://doi.org/10.1145/3290605.3300436

Published: 02 May 2019 Publication History

All formats PDF

Abstract

Spatial layout is a key component in graphic design. While people who are blind or visually impaired (BVI) can use screen readers or magnifiers to access digital content, these tools fail to fully communicate the content's graphic design information. Through semi-structured interviews and contextual inquiries, we identify the lack of this information and feedback as major challenges in understanding and editing layouts. Guided by these insights and a co-design process with a blind hobbyist web developer, we developed an interactive, multimodal authoring tool that lets blind people understand spatial relationships between elements and modify layout templates. Our tool automatically generates tactile print-outs of a web page's layout, which users overlay on top of a tablet that runs our self-voicing digital design tool. We conclude with design considerations grounded in user feedback for improving the accessibility of spatially encoded information and developing tools for BVI authors.

Supplementary Material

ZIP File (paper206pvc.zip)

Preview video captions

Download
1.04 KB

MP4 File (paper206p.mp4)

Preview video

Download
3.05 MB

References

[1]

Nacny Amick and Jane Corcoran. 1997. Guidelines for Design of Tactile Graphics. http://www.aph.org/research/guides/. Accessed: 2018-09-06.

[2]

Sona K Andrews. 1985. The use of capsule paper in producing tactual maps. Journal of Visual Impairment & Blindness (1985).

[3]

Mauro Avila, Francisco Kiss, Ismael Rodriguez, Albrecht Schmidt, and Tonja Machulla. 2018. Tactile Sheets: Using Engraved Paper Overlays to Facilitate Access to a Digital Document's Layout and Logical Structure. In Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference (PETRA '18). ACM, New York, NY, USA, 165--169.

Digital Library

[4]

Mark S. Baldwin, Gillian R. Hayes, Oliver L. Haimson, Jennifer Mankof, and Scott E. Hudson. 2017. The Tangible Desktop: A Multimodal Approach to Nonvisual Computing. ACM Trans. Access. Comput. 10, 3, Article 9 (Aug. 2017), 28 pages.

Digital Library

[5]

Edward C. Bell and Natalia M. Mino. 2015. Employment outcomes for blind and visually impaired adults. (2015).

[6]

Edward C. Bell and Natalia M. Mino. 2016. Blogging when you're blind or visually impaired. https://yourdolphin.com/news?id=223. Accessed: 2018-08--30.

[7]

Jens Bornschein, Denise Bornschein, and Gerhard Weber. 2018. Comparing Computer-Based Drawing Methods for Blind People with RealTime Tactile Feedback. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 115, 13 pages.

Digital Library

[8]

Erin Brady, Meredith Ringel Morris, Yu Zhong, Samuel White, and Jefrey P. Bigham. 2013. Visual Challenges in the Everyday Lives of Blind People. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2117--2126.

Digital Library

[9]

Anke M Brock, Philippe Truillet, Bernard Oriola, Delphine Picard, and Christophe Joufrais. 2015. Interactivity improves usability of geographic maps for visually impaired people. Human--Computer Interaction 30, 2 (2015), 156--194.

[10]

Craig Brown and Amy Hurst. 2012. VizTouch: Automatically Generated Tactile Visualizations of Coordinate Spaces. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction (TEI '12). ACM, New York, NY, USA, 131--138.

Digital Library

[11]

Erin Buehler, Shaun K. Kane, and Amy Hurst. 2014. ABC and 3D: Opportunities and Obstacles to 3D Printing in Special Education Environments. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS '14). ACM, New York, NY, USA, 107--114.

Digital Library

[12]

Kathy Charmaz and Linda Liska Belgrave. 2007. Grounded theory. The Blackwell encyclopedia of sociology (2007).

[13]

American Printing House for the Blind. 2016. American Printing House for the Blind and Orbit Research Announce the World's First Afordable Refreshable Tactile Graphics Display. https://www.aph.org/pr/aph-and-orbit-research-announcethe-worlds-frst-afordable-refreshable-tactile-graphics-display/

[14]

John A Gardner, Vladimir Bulatov, and Holly Stowell. 2005. The ViewPlus IVEO technology for universally usable graphical information. In Proceedings of the 2005 CSUN International Conference on Technology and People with Disabilities.

[15]

Anhong Guo, Jeeeun Kim, Xiang 'Anthony' Chen, Tom Yeh, Scott E. Hudson, Jennifer Mankof, and Jefrey P. Bigham. 2017. Facade: Auto-generating Tactile Interfaces to Appliances. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 5826--5838.

Digital Library

[16]

Lucia Hasty. 2018. Guidelines for Design of Tactile Graphics. http: //www.tactilegraphics.org/index.html. Accessed: 2018-09-06.

[17]

Liang He, Zijian Wan, Leah Findlater, and Jon E. Froehlich. 2017. TacTILE: A Preliminary Toolchain for Creating Accessible Graphics with 3D-Printed Overlays and Auditory Annotations. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17). ACM, New York, NY, USA, 397--398.

Digital Library

[18]

Charles Jacobs, Wilmot Li, Evan Schrier, David Bargeron, and David Salesin. 2003. Adaptive Grid-based Document Layout. ACM Trans. Graph. 22, 3 (July 2003), 838--847.

Digital Library

[19]

Ali Jahanian, Jerry Liu, Qian Lin, Daniel Tretter, Eamonn O'BrienStrain, Seungyon Claire Lee, Nic Lyons, and Jan Allebach. 2013. Recommendation System for Automatic Design of Magazine Covers. In Proceedings of the 2013 International Conference on Intelligent User Interfaces (IUI '13). ACM, New York, NY, USA, 95--106.

Digital Library

[20]

Shaun K. Kane and Jefrey P. Bigham. 2014. Tracking @Stemxcomet: Teaching Programming to Blind Students via 3D Printing, Crisis Management, and Twitter. In Proceedings of the 45th ACM Technical Symposium on Computer Science Education (SIGCSE '14). ACM, New York, NY, USA, 247--252.

Digital Library

[21]

Shaun K. Kane, Meredith Ringel Morris, and Jacob O. Wobbrock. 2013. Touchplates: Low-cost Tactile Overlays for Visually Impaired Touch Screen Users. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '13). ACM, New York, NY, USA, Article 22, 8 pages.

Digital Library

[22]

Jeeeun Kim and Tom Yeh. 2015. Toward 3D-Printed Movable Tactile Pictures for Children with Visual Impairments. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2815--2824.

Digital Library

[23]

Mikko Kuhna, Ida-Maria Kivelä, and Pirkko Oittinen. 2012. Semiautomated Magazine Layout Using Content-based Image Features. In Proceedings of the 20th ACM International Conference on Multimedia (MM '12). ACM, New York, NY, USA, 379--388.

Digital Library

[24]

Ranjitha Kumar, Arvind Satyanarayan, Cesar Torres, Maxine Lim, Salman Ahmad, Scott R. Klemmer, and Jerry O. Talton. 2013. Webzeitgeist: Design Mining the Web. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 3083--3092.

Digital Library

[25]

Steven Landau and Lesley Wells. 2003. Merging tactile sensory input and audio data by means of the Talking Tactile Tablet. In Proceedings of EuroHaptics, Vol. 3. 414--418.

[26]

Veronica Lewis. 2018. Veronica With Four Eyes. https:// veroniiiica.com/. Accessed: 2018-08--30.

[27]

Jason Linder, Gierad Laput, Mira Dontcheva, Gregg Wilensky, Walter Chang, Aseem Agarwala, and Eytan Adar. 2013. PixelTone: A Multimodal Interface for Image Editing. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13). ACM, New York, NY, USA, 2829--2830.

Digital Library

[28]

Ellen Lupton. 2004. Thinking with type. Critical Guide for Designers, Writers, Editors & Students (2004).

[29]

Nolwenn Maudet, Ghita Jalal, Philip Tchernavskij, Michel BeaudouinLafon, and Wendy E. Mackay. 2017. Beyond Grids: Interactive Graphical Substrates to Structure Digital Layout. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 5053--5064.

Digital Library

[30]

David McCandless. 2012. Information is beautiful. Collins London.

[31]

Samantha McDonald, Joshua Dutterer, Ali Abdolrahmani, Shaun K. Kane, and Amy Hurst. 2014. Tactile Aids for Visually Impaired Graphical Design Education. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS '14). ACM, New York, NY, USA, 275--276.

Digital Library

[32]

Valerie S Morash, Allison E Connell Pensky, Steven TW Tseng, and Joshua A Miele. 2014. Efects of using multiple hands and fngers on haptic performance in individuals who are blind. Perception 43, 6 (2014), 569--588.

[33]

Valerie S Morash, Alexander Russomanno, R Brent Gillespie, and Sile O'Modhrain. 2017. Evaluating Approaches to Rendering Braille Text on a High-Density Pin Display. IEEE transactions on haptics (2017).

Digital Library

[34]

Josef Müller-Brockmann. 1996. Grid systems. Alemanha, Editora Braun (1996).

[35]

Peter O'Donovan, Aseem Agarwala, and Aaron Hertzmann. 2015. DesignScape: Design with Interactive Layout Suggestions. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1221--1224.

Digital Library

[36]

Braille Authority of North America. 2010. Guidelines and Standards for Tactile Graphics. http://www.brailleauthority.org/tg/. Accessed: 2018-09-06.

[37]

M Sile O'Modhrain and Brent Gillespie. 1997. The moose: A haptic user interface for blind persons. In Proc. Third WWW6 Conference.

[38]

Denise Prescher, Jens Bornschein, Wiebke Köhlmann, and Gerhard Weber. 2018. Touching graphical applications: bimanual tactile interaction on the HyperBraille pin-matrix display. Universal Access in the Information Society 17, 2 (2018), 391--409.

Digital Library

[39]

Andreas Reichinger, Helena Garcia Carrizosa, Joanna Wood, Svenja Schröder, Christian Löw, Laura Rosalia Luidolt, Maria Schimkowitsch, Anton Fuhrmann, Stefan Maierhofer, and Werner Purgathofer. 2018. Pictures in Your Mind: Using Interactive Gesture-Controlled Reliefs to Explore Art. ACM Trans. Access. Comput. 11, 1, Article 2 (March 2018), 39 pages.

Digital Library

[40]

Daniel Ritchie, Ankita Arvind Kejriwal, and Scott R. Klemmer. 2011. D.Tour: Style-based Exploration of Design Example Galleries. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 165--174.

Digital Library

[41]

Jana Sedivy and Hilary Johnson. 1999. Supporting Creative Work Tasks: The Potential of Multimodal Tools to Support Sketching. In Proceedings of the 3rd Conference on Creativity & Cognition (C&C '99). ACM, New York, NY, USA, 42--49.

Digital Library

[42]

Lei Shi, Yuhang Zhao, and Shiri Azenkot. 2017. Markit and Talkit: A Low-Barrier Toolkit to Augment 3D Printed Models with Audio Annotations. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 493--506.

Digital Library

[43]

Anoop K. Sinha and James A. Landay. 2003. Capturing User Tests in a Multimodal, Multidevice Informal Prototyping Tool. In Proceedings of the 5th International Conference on Multimodal Interfaces (ICMI '03). ACM, New York, NY, USA, 117--124.

Digital Library

[44]

Atau Tanaka and Adam Parkinson. 2016. Haptic Wave: A Cross-Modal Interface for Visually Impaired Audio Producers. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2150--2161.

Digital Library

[45]

Brandon Taylor, Anind Dey, Dan Siewiorek, and Asim Smailagic. 2016. Customizable 3D Printed Tactile Maps As Interactive Overlays. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '16). ACM, New York, NY, USA, 71--79.

Digital Library

[46]

Kashyap Todi, Daryl Weir, and Antti Oulasvirta. 2016. Sketchplore: Sketch and Explore with a Layout Optimiser. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16). ACM, New York, NY, USA, 543--555.

Digital Library

[47]

Jan Tschichold. 1998. The new typography: A handbook for modern designers. Vol. 8. Univ of California Press.

[48]

Jacob O. Wobbrock, Shaun K. Kane, Krzysztof Z. Gajos, Susumu Harada, and Jon Froehlich. 2011. Ability-Based Design: Concept, Principles and Examples. ACM Trans. Access. Comput. 3, 3, Article 9 (April 2011), 27 pages.

Digital Library

Cited By

Alzalabny SMoured OMüller KSchwarz TRapp BStiefelhagen R(2024)Designing a Tactile Document UI for 2D Refreshable Tactile Displays: Towards Accessible Document Layouts for Blind PeopleMultimodal Technologies and Interaction10.3390/mti81101028:11(102)Online publication date: 8-Nov-2024
https://doi.org/10.3390/mti8110102
Benhamida LLarabi SMetatla O(2024)Hapstick-Figure: Investigating the Design of a Haptic Representation of Human Gestures from Theater Performances for Blind and Visually-Impaired PeopleProceedings of the ACM on Human-Computer Interaction10.1145/36981528:ISS(649-673)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698152
Chang RLiu YZhang LGuo A(2024)EditScribe: Non-Visual Image Editing with Natural Language Verification LoopsProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675599(1-19)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675599
Show More Cited By

Index Terms

Editing Spatial Layouts through Tactile Templates for People with Visual Impairments
1. Human-centered computing
  1. Accessibility
    1. Accessibility systems and tools
    2. Accessibility technologies

Recommendations

What Makes Videos Accessible to Blind and Visually Impaired People?
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

User-generated videos are an increasingly important source of information online, yet most online videos are inaccessible to blind and visually impaired (BVI) people. To find videos that are accessible, or understandable without additional description ...
Drawing and Understanding Diagrams: An Accessible Approach Dedicated to Blind People
Universal Access in Human-Computer Interaction. User and Context Diversity
Abstract
Our research activity focuses on accessibility for document design and consultation, especially in the field of computer science. In this article, we focus on the design and reading of class diagrams according to the UML standard. Our goal is to ...
Addressing Accessibility Barriers in Programming for People with Visual Impairments: A Literature Review
Accessibility issues with programming languages and programming environments pose a major barrier for students with visual impairments to participate in computing related courses as well as threatens the productivity of professional programmers with ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

May 2019

9077 pages

ISBN:9781450359702

DOI:10.1145/3290605

General Chairs:
Stephen Brewster
University of Glasgow, Scotland, UK
,
Geraldine Fitzpatrick
TU Wien, Austria
,
Program Chairs:
Anna Cox
University College London, UK
,
Vassilis Kostakos
University of Melbourne, Australia

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

CHI '19

Sponsor:

SIGCHI

CHI '19: CHI Conference on Human Factors in Computing Systems

May 4 - 9, 2019

Glasgow, Scotland Uk

Acceptance Rates

CHI '19 Paper Acceptance Rate 703 of 2,958 submissions, 24%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

45
Total Citations
View Citations
1,492
Total Downloads

Downloads (Last 12 months)420
Downloads (Last 6 weeks)43

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Alzalabny SMoured OMüller KSchwarz TRapp BStiefelhagen R(2024)Designing a Tactile Document UI for 2D Refreshable Tactile Displays: Towards Accessible Document Layouts for Blind PeopleMultimodal Technologies and Interaction10.3390/mti81101028:11(102)Online publication date: 8-Nov-2024
https://doi.org/10.3390/mti8110102
Benhamida LLarabi SMetatla O(2024)Hapstick-Figure: Investigating the Design of a Haptic Representation of Human Gestures from Theater Performances for Blind and Visually-Impaired PeopleProceedings of the ACM on Human-Computer Interaction10.1145/36981528:ISS(649-673)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698152
Chang RLiu YZhang LGuo A(2024)EditScribe: Non-Visual Image Editing with Natural Language Verification LoopsProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675599(1-19)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675599
Gupta CSridhar SMatthies DJouffrais CNanayakkara S(2024)SonicVista: Towards Creating Awareness of Distant Scenes through SonificationProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596098:2(1-32)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659609
Huh MPavel A(2024)DesignChecker: Visual Design Support for Blind and Low Vision Web DevelopersProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676369(1-19)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676369
Moured OBaumgarten-Egemole MMüller KRoitberg ASchwarz TStiefelhagen R(2024)Chart4Blind: An Intelligent Interface for Chart Accessibility ConversionProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645175(504-514)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3640543.3645175
Zhang LStangl ASharma TTseng YXu IGurari DWang YFindlater L(2024)Designing Accessible Obfuscation Support for Blind Individuals’ Visual Privacy ManagementProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642713(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642713
Kulkarni TKim GMouallem A(2023)A Case for Improving the Accessibility of Electrical and Computer Engineering Education – Starting with a Blind Student's AutoethnographyProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3614551(1-8)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3614551
Chheda-Kothary ARios DSmith KReyna AZhang CSmith B(2023)Understanding Blind and Low Vision Users' Attitudes Towards Spatial Interactions in Desktop Screen ReadersProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3614490(1-5)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3614490
Potluri VSinganamalla STieanklin NMankoff J(2023)Notably Inaccessible — Data Driven Understanding of Data Science Notebook (In)AccessibilityProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3608417(1-19)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3608417
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents