research-article

Deformation Gesture-based Input Method for Non-visual Primitive Geometric Shape Drawing

Author:

Pranjal Protim BorahAuthors Info & Claims

TEI '20: Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction

Pages 911 - 915

https://doi.org/10.1145/3374920.3374960

Published: 09 February 2020 Publication History

Abstract

Reading and creating graphical information is a difficult task for users with visual impairment and blindness. It becomes even more challenging on touchscreen devices due to the lack of tactile buttons. However, advancement in flexible displays and electronics offers the potential use of physical deformation as an additional input modality. These deformation-based gestures provide innate tactile and kinesthetic feedback, which are essential for non-visual interaction. In this paper, I describe my Ph.D. research on non-visual drawing using the deformation gesture-based input method. This work is currently in the initial phase. This research aims to understand the preference and performance of deformation-based gestures on a smartphone-sized flexible handheld device and evaluate the effect of deformation and touch input modalities in the non-visual primitive geometric shape drawing. The expected outcome of this research can be useful for user interface designers and developers and researchers in developing accessible applications for future flexible devices.

References

[1]

Patricia Arroba, Juan Carlos Vallejo, Álvaro Araujo, David Fraga, and José M Moya. 2011. A methodology for developing accessible mobile platforms over leading devices for visually impaired people. In International Workshop on Ambient Assisted Living. Springer, 209--215.

[2]

Suzanne P Balik, Sean P Mealin, Matthias F Stallmann, and Robert D Rodman. 2013. GSK: universally accessible graph sketching. In Proceeding of the 44th ACM technical symposium on Computer science education. ACM, 221--226.

[3]

Michael T Battista. 2002. Learning geometry in a dynamic computer environment. Teaching children mathematics 8, 6 (2002), 333--340.

[4]

Paul Blenkhorn and David Gareth Evans. 1998. Using speech and touch to enable blind people to access schematic diagrams. Journal of Network and Computer Applications 21, 1 (1998), 17--29.

Digital Library

[5]

Pranjal Protim Borah and Keyur Sorathia. 2019. Direct Observation of Tactile Geometric Drawing by Visually Impaired and Blind Students. In Proceedings of the 10th Indian Conference on Human Computer Interaction. ACM, Accepted.

Digital Library

[6]

Jens Bornschein, Denise Bornschein, and Gerhard Weber. 2018. Comparing computer-based drawing methods for blind people with real-time tactile feedback. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 115.

Digital Library

[7]

Andy Brown, Steve Pettifer, and Robert Stevens. 2004. Evaluation of a non-visual molecule browser. In ACM SIGACCESS Accessibility and Computing. ACM, 40--47.

[8]

Victor Cheung, Alexander Keith Eady, and Audrey Girouard. 2017. Exploring eyes-free interaction with wrist-worn deformable materials. (2017).

[9]

Matthew Ernst, Travis Swan, Victor Cheung, and Audrey Girouard. 2017. Typhlex: Exploring Deformable Input for Blind Users Controlling a Mobile Screen Reader. IEEE Pervasive Computing 16, 4 (2017), 28--35.

[10]

William Grussenmeyer and Eelke Folmer. 2016. AudioDraw: user preferences in non-visual diagram drawing for touchscreens. In Proceedings of the 13th Web for All Conference. ACM, 22.

Digital Library

[11]

Beverly Harrison, Kenneth P Fishkin, Anuj Gujar, and Carlos Mochon.1998. Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces. In Proceedings of CHI'98. Citeseer.

[12]

Hesham M Kamel and James A Landay. 1999. The integrated communication 2 draw (IC2D): a drawing program for the visually impaired. In Conference on Human Factors in Computing Systems: CHI'99 extended abstracts on Human factors in computing systems, Vol. 15. 222--223.

Digital Library

[13]

Hesham M Kamel and James A Landay. 2000. A study of blind drawing practice: creating graphical information without the visual channel. In Proceedings of the fourth international ACM conference on Assistive technologies. ACM, 34--41.

Digital Library

[14]

Shaun K Kane, Chandrika Jayant, Jacob O Wobbrock, and Richard E Ladner. 2009. Freedom to roam: a study of mobile device adoption and accessibility for people with visual and motor disabilities. In Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility. ACM, 115--122.

Digital Library

[15]

Andrea R Kennel. 1996. Audiograf: A diagram-reader for the blind. In Proceedings of the second annual ACM conference on Assistive technologies. ACM, 51--56.

Digital Library

[16]

Martin Kurze. 1996. TDraw: a computer-based tactile drawing tool for blind people. In International ACM Conference on Assistive Technologies. 131--138.

Digital Library

[17]

Sang-su Lee, Youn-kyung Lim, and Kun-Pyo Lee. 2012. Exploring the effects of size on deformable user interfaces. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services companion. ACM, 89--94.

Digital Library

[18]

Lora T Likova and Laura Cacciamani. 2018. Transfer of Learning in People who Are Blind: Enhancement of Spatial-Cognitive Abilities through Drawing. Journal of Visual Impairment & Blindness 112, 4 (2018), 385--397.

[19]

David McGookin, Euan Robertson, and Stephen Brewster. 2010. Clutching at straws: using tangible interaction to provide non-visual access to graphs. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 1715--1724.

Digital Library

[20]

David K McGookin and Stephen A Brewster. 2006. MultiVis: improving access to visualisations for visually impaired people. (2006).

[21]

Uran Oh, Shaun K Kane, and Leah Findlater. 2013. Follow that sound: using sonification and corrective verbal feedback to teach touchscreen gestures. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 13.

Digital Library

[22]

Ivan Poupyrev, Shigeaki Maruyama, and Jun Rekimoto. 2002. Ambient touch: designing tactile interfaces for handheld devices. In Proceedings of the 15th annual ACM symposium on User interface software and technology ACM, 51--60.

Digital Library

[23]

Kirsten Rassmus-Gröhn, Charlotte Magnusson, and HäWIP Ekan Eftring. 2007. Iterative design of an audio-haptic drawing application. In CHI'07 Extended Abstracts on Human Factors in Computing Systems. ACM, 2627--2632.

Digital Library

[24]

André Rodrigues, Kyle Montague, Hugo Nicolau, and Tiago Guerreiro. 2015. Getting smartphones to TalkBack: understanding the smartphone adoption process of blind users. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility. ACM, 23--32.

Digital Library

[25]

Julia Schmidt. 2017. GEOVIB: An Application to Support Visually Impaired and Blind Children in Following Geometry Lectures.

[26]

Carsten Schwesig, Ivan Poupyrev, and Eijiro Mori. 2003. Gummi: user interface for deformable computers. In CHI'03 Extended Abstracts on Human Factors in Computing Systems. ACM, 954--955.

Digital Library

[27]

Carsten Schwesig, Ivan Poupyrev, and Eijiro Mori. 2004. Gummi: a bendable computer. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 263--270.

Digital Library

[28]

Kristen Warren, Jessica Lo, Vaibhav Vadgama, and Audrey Girouard. 2013. Bending the rules: bend gesture classification for flexible displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 607--610.

Digital Library

[29]

Tetsuya Watanabe and Makoto Kobayashi. 2002. A prototype of the freely rewritable tactile drawing system for persons who are blind. Journal of Visual Impairment & Blindness 96, 6 (2002), 460--464.

[30]

Doug Wightman, Tim Ginn, and Roel Vertegaal. 2011. Bendflip: examining input techniques for electronic book readers with flexible form factors. In IFIP Conference on Human-Computer Interaction. Springer, 117--133.

[31]

Wai Yu, Katri Kangas, and Stephen Brewster. 2003. Web-based haptic applications for blind people to create virtual graphs. In 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings. IEEE, 318--325.

Cited By

Bolesnikov AKang JGirouard A(2022)Understanding Tabletop Games Accessibility: Exploring Board and Card Gaming Experiences of People who are Blind and Low VisionProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501327(1-17)Online publication date: 13-Feb-2022
https://dl.acm.org/doi/10.1145/3490149.3501327
Yin JBai SHan YZhang XDeng SWang S(2021)The Study of Bending and Twisting Input Modalities in Deformable InterfacesElectronics10.3390/electronics1023299110:23(2991)Online publication date: 1-Dec-2021
https://doi.org/10.3390/electronics10232991

Index Terms

Deformation Gesture-based Input Method for Non-visual Primitive Geometric Shape Drawing
1. Human-centered computing

Recommendations

Direct observation of tactile geometric drawing by visually impaired and blind students
IndiaHCI '19: Proceedings of the 10th Indian Conference on Human-Computer Interaction

Reading and drawing geometric shapes are challenging tasks for visually impaired and blind users. The development of a human-centered design solution to address these issues and simulate the techniques of tactile drawing requires a detailed ...
Drawing and Understanding Diagrams: An Accessible Approach Dedicated to Blind People
Universal Access in Human-Computer Interaction. User and Context Diversity
Abstract
Our research activity focuses on accessibility for document design and consultation, especially in the field of computer science. In this article, we focus on the design and reading of class diagrams according to the UML standard. Our goal is to ...
Accessible Touch Input for People with Motor Impairments
CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Touch input has emerged as a dominant form of interaction for billions of interactive computing devices like smartphones, tablets, and interactive surfaces. Although touch input is widely used, it remains largely inaccessible for many people with motor ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

TEI '20: Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction

February 2020

978 pages

ISBN:9781450361071

DOI:10.1145/3374920

General Chairs:
Elise van den Hoven
University of Technology Sydney (Australia) & Eindhoven University of Technology (the Netherlands)
,
Lian Loke
University of Sydney (Australia)
,
Program Chairs:
Orit Shaer
Wellesley College (USA)
,
Jelle van Dijk
University of Twente (Netherlands)
,
Andrew Kun
University of New Hampshire (USA)

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 February 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

TEI '20

Sponsor:

SIGCHI

TEI '20: Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction

February 9 - 12, 2020

Sydney NSW, Australia

Acceptance Rates

TEI '20 Paper Acceptance Rate 37 of 132 submissions, 28%;

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Upcoming Conference

TEI '25

Sponsor:
sigchi

Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction

March 4 - 7, 2025

Bordeaux / Talence , France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
187
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)1

Reflects downloads up to 29 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bolesnikov AKang JGirouard A(2022)Understanding Tabletop Games Accessibility: Exploring Board and Card Gaming Experiences of People who are Blind and Low VisionProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501327(1-17)Online publication date: 13-Feb-2022
https://dl.acm.org/doi/10.1145/3490149.3501327
Yin JBai SHan YZhang XDeng SWang S(2021)The Study of Bending and Twisting Input Modalities in Deformable InterfacesElectronics10.3390/electronics1023299110:23(2991)Online publication date: 1-Dec-2021
https://doi.org/10.3390/electronics10232991

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents