Article

No-look notes: accessible eyes-free multi-touch text entry

Authors:

Matthew N. Bonner,

Jeremy T. Brudvik,

Gregory D. Abowd,

W. Keith EdwardsAuthors Info & Claims

Pervasive'10: Proceedings of the 8th international conference on Pervasive Computing

Pages 409 - 426

https://doi.org/10.1007/978-3-642-12654-3_24

Published: 17 May 2010 Publication History

Abstract

Mobile devices with multi-touch capabilities are becoming increasingly common, largely due to the success of the Apple iPhone and iPod Touch. While there have been some advances in touchscreen accessibility for blind people, touchscreens remain inaccessible in many ways. Recent research has demonstrated that there is great potential in leveraging multi-touch capabilities to increase the accessibility of touchscreen applications for blind people. We have created No-Look Notes, an eyes-free text entry system that uses multi-touch input and audio output. No-Look Notes was implemented on Apple's iPhone platform. We have performed a within-subjects (n=10) user study of both No-Look Notes and the text entry component of Apple's VoiceOver, the recently released official accessibility component on the iPhone. No-Look Notes significantly outperformed VoiceOver in terms of speed, accuracy and user preference.

References

[1]

McGookin, D., Brewster, S., Jiang, W.: Investigating touchscreen accessibility for people with visual impairments. In: Proceedings of the 5th Nordic conference on Human-Computer Interaction: Building Bridges, pp. 298-307 (2008).

Digital Library

[2]

MacKenzie, I.S., Soukoreff, R.W.: Text Entry for Mobile Computing: Models and Methods, Theory and Practice. Human-Computer Interaction 17(2), 147 (2002).

[3]

Sánchez, J., Aguayo, F.: Mobile Messenger for the Blind. In: Universal Access in Ambient Intelligence Environments, pp. 369-385 (2007).

Digital Library

[4]

Tinwala, H., MacKenzie, I.S.: Eyes-Free Text Entry on a Touchscreen Phone. In: Proceedings of the IEEE Toronto International Conference Science and Technology for Humanity TIC-STH 2009, pp. 83-89 (2009).

[5]

Perlin, K.: Quikwriting: continuous stylus-based text entry. In: Proceedings of the 11th annual ACM symposium on User interface software and technology, pp. 215-216 (1998).

Digital Library

[6]

Plimmer, B., Crossan, A., Brewster, S.A., Blagojevic, R.: Multimodal Collaborative Handwriting Training for Visually-Impaired People. In: Proceeding of the twentysixth annual SIGCHI conference on Human factors in computing systems, pp. 393-402 (2008).

Digital Library

[7]

Yfantidis, G., Evreinov, G.: Adaptive Blind Interaction Technique for Touchscreens. Universal Access in the Information Society 4(4), 328-337 (2006).

Digital Library

[8]

Speech Enabled Eyes Free Android Applications, http://code.google.com/p/eyes-free/

[9]

VoiceOver, http://www.apple.com/accessibility/iphone/vision.html

[10]

Mynatt, E.D., Edwards, W.K.: Mapping GUIs to Auditory Interfaces. In: Proceedings of the 5th annual ACM symposium on User Interface Software and Technology, pp. 61-70 (1992).

Digital Library

[11]

Kane, S.K., Bigham, J.P., Wobbrock, J.O.: Slide Rule: Making Mobile Touch Screens Accessible to Blind people using Multi-Touch Interaction Techniques. In: Proceedings of the 10th international ACM SIGACCESS Conference on Computers and Accessibility, pp. 73-80 (2008).

Digital Library

[12]

Brewster, S., Chohan, F., Brown, L.: Tactile Feedback for Mobile Interactions. In: Proceedings of the SIGCHI Conference on Human Factors in Computing System, pp. 159-162 (2007).

Digital Library

[13]

Leung, R., MacLean, K., Bertelsen, M.B., Saubhasik, M.: Evaluation of Haptically Augmented Touchscreen GUI Elements under Cognitive Load. In: Proceedings of the 9th International Conference on Multimodal Interfaces, pp. 374-381 (2007).

Digital Library

[14]

Kaaresoja, T.: Snap-Crackle-Pop: Tactile Feedback for Mobile Touch Screens. In: Proceedings of Eurohaptics, pp. 565-566 (2006).

[15]

Yatani, K., Truong, K.N.: SemFeel: A User Interface with Semantic Tactile Feedback for Mobile Touch-screen Devices. In: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 111-120 (2009).

Digital Library

[16]

E.161: Arrangement of Digits, Letters and Symbols on Telephones and Other Devices that can be Used for Gaining Access to a Telephone Network, http://www.itu.int/rec/T-REC-E.161-200102-I/en

[17]

Wobbrock, J.O., Myers, B.A., Kembel, J.A.: EdgeWrite: A Stylus-Based Text Entry Method Designed for High Accuracy and Stability of Motion. In: Proceedings of the 16th annual ACM Symposium on User Interface Software and Technology, pp. 61-70 (2003).

Digital Library

[18]

Black, A., Lenzo, K.: Flite: A Small Fast Runtime Synthesis Engine. In: 4th ISCA Speech Synthesis Workshop, pp. 157-162 (2007).

[19]

MacKenzie, I.S., Soukoreff, R.W.: Phrase Sets for Evaluating Text Entry Techniques. In: CHI 2003 Extended Abstracts on Human Factors in Computing Systems, pp. 754-755 (2003).

Digital Library

[20]

Wigdor, D., Balakrishnan, R.: TiltText: Using Tilt for Text Input toMobile Phones. In: Proceedings of the 16th annual ACM symposium on User interface software and technology, pp. 81-90 (2003).

Digital Library

Cited By

Zhang DLi ZAshok VSeiple WRamakrishnan IBi X(2024)Accessible Gesture Typing on Smartphones for People with Low VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676447(1-11)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676447
Liu ZChen CWang JChen MWu BHuang YHu JWang Q(2024)Unblind Text Inputs: Predicting Hint-text of Text Input in Mobile Apps via LLMProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642939(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642939
Karimi PBrady EMartin-Hammond ABolchini D(2023)“I stepped into a puddle”: Non-Visual Texting in Nomadic ContextsProceedings of the 20th International Web for All Conference10.1145/3587281.3587285(32-43)Online publication date: 30-Apr-2023
https://dl.acm.org/doi/10.1145/3587281.3587285
Show More Cited By

No-look notes: accessible eyes-free multi-touch text entry
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices

Recommendations

An evaluation of BrailleTouch: mobile touchscreen text entry for the visually impaired
MobileHCI '12: Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services

We present the evaluation of BrailleTouch, an accessible keyboard for blind users on touchscreen smartphones. Based on the standard Perkins Brailler, BrailleTouch implements a six-key chorded braille soft keyboard. Eleven blind participants typed for ...
Brailletouch: mobile texting for the visually impaired
UAHCI'11: Proceedings of the 6th international conference on Universal access in human-computer interaction: context diversity - Volume Part III

BrailleTouch is an eyes-free text entry application for mobile devices. Currently, there exist a number of hardware and software solutions for eyes-free text entry. Unfortunately, the hardware solutions are expensive and the software solutions do not ...
BrailleTouch: designing a mobile eyes-free soft keyboard
MobileHCI '11: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services

Texting is the essence of mobile communication and connectivity, as evidenced by today's teenagers, tomorrow's workforce. Fifty-four percent of American teens contact each other daily by texting, as compared to face-to-face (33%) and talking on the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

Pervasive'10: Proceedings of the 8th international conference on Pervasive Computing

May 2010

446 pages

ISBN:3642126537

Editors:
Patrik Floréen
Helsinki Institute for Information Technology – HIIT, Department of Computer Science,, University of Helsinki, Finland
,
Antonio Krüger
Helsinki Institute for Information Technology – HIIT, Department of Computer Science,, German Research Center for Artificial Intelligence (DFKI), Stuhlsatzenhausweg 3, Saarbrücken, Germany
,
Mirjana Spasojevic
Helsinki Institute for Information Technology – HIIT, Department of Computer Science,, Nokia Research Center, Stuhlsatzenhausweg 3, Palo Alto, CA, Germany

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 17 May 2010

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

68
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhang DLi ZAshok VSeiple WRamakrishnan IBi X(2024)Accessible Gesture Typing on Smartphones for People with Low VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676447(1-11)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676447
Liu ZChen CWang JChen MWu BHuang YHu JWang Q(2024)Unblind Text Inputs: Predicting Hint-text of Text Input in Mobile Apps via LLMProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642939(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642939
Karimi PBrady EMartin-Hammond ABolchini D(2023)“I stepped into a puddle”: Non-Visual Texting in Nomadic ContextsProceedings of the 20th International Web for All Conference10.1145/3587281.3587285(32-43)Online publication date: 30-Apr-2023
https://dl.acm.org/doi/10.1145/3587281.3587285
Gaines DBaker MVertanen K(2023)FlexType: Flexible Text Input with a Small Set of Input GesturesProceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581641.3584077(584-594)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581641.3584077
Lottridge DYoon CBurton DWang CKaye J(2022)Ally: Understanding Text Messaging to Build a Better Onscreen Keyboard for Blind PeopleACM Transactions on Accessible Computing10.1145/353370715:4(1-22)Online publication date: 22-Oct-2022
https://dl.acm.org/doi/10.1145/3533707
Karimi PPlebani EMartin-Hammond ABolchini D(2022)Textflow: Toward Supporting Screen-free Manipulation of Situation-Relevant Smart MessagesACM Transactions on Interactive Intelligent Systems10.1145/351926312:4(1-29)Online publication date: 5-Nov-2022
https://dl.acm.org/doi/10.1145/3519263
Abbott JKaye JClawson J(2022)Identifying an Aurally Distinct Phrase Set for Text Entry TechniquesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501897(1-13)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501897
Ho YLau SAzman A(2022)Comparison of BlindLoginV2 and AudioBlindLogin with the common textual password authentication for the blind and visually impaired using smartphonesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2021.102718156:COnline publication date: 22-Apr-2022
https://dl.acm.org/doi/10.1016/j.ijhcs.2021.102718
Gu YYu CChen XLI ZShi Y(2021)TypeBoard: Identifying Unintentional Touch on Pressure-Sensitive Touchscreen KeyboardsThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474770(568-581)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474770
Lee HAshok VConlan OHerder E(2021)Towards Enhancing Blind Users' Interaction Experience with Online Videos via Motion GesturesProceedings of the 32nd ACM Conference on Hypertext and Social Media10.1145/3465336.3475116(231-236)Online publication date: 30-Aug-2021
https://dl.acm.org/doi/10.1145/3465336.3475116
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Table of Contents