Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Touchtalk: Enhancing Messaging in Smartphones for Visually Impaired

  • Conference paper
  • First Online:
Proceedings of the 14th Indian Conference on Human-Computer Interaction (IndiaHCI 2023)

Part of the book series: Studies in Computational Intelligence ((SCI,volume 1162))

Included in the following conference series:

  • 101 Accesses

Abstract

Messaging applications have become integral to modern communication, enabling people to connect and share information. Despite efforts to design gadgets for visually impaired (VI) individuals, existing interfaces remain inaccessible. This research paper is focused on the hurdles that VI users experience while transitioning to devices with smooth screens for basic messaging tasks. An extensive review was conducted by authors for 17 papers covering various keyboard layouts and usability features in smartphones for messaging applications. The authors also conducted a preliminary study with 18 participants aged 12–48 to understand their pain points and needs. The paper reports implementing a 9-key-based keyboard layout in a messaging application. The layout is similar to the multi-tap system used on numeric keypads of feature phones, which had several letters associated with each number key. Additionally, the proposal includes a phonic instruction to make it easier for visually impaired individuals to learn and use this keyboard layout. The authors have created the application and are currently in the initial stage of conducting user testing. They aim to assess the accuracy of the layout in the near future. Thus, the authors aim to reduce cognitive effort, simplify the learning process, and improve the overall texting experience for users with visual impairment via their application - Touchtalk.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from permissions@acm.org.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. 2014. What is Google TalkBack?—androidcentral.com. https://www.androidcentral.com/what-google-talk-back. Last Accessed on 8 Oct 2023

  2. 2018. Design of Smartphone 9-Key Keyboard Based on Spelling Rule of Pinyin—link.springer.com. https://link.springer.com/chapter/10.1007/978-3-319-91803-7_42. Last Accessed on 8 Oct 2023

  3. 2019. 62 million in India visually impaired—thehindu.com. https://www.thehindu.com/news/cities/chennai/62-million-in-india-visually-impaired/article27699902.ece. Last Accessed on 8 Oct 2023

  4. 2020. A new keyboard for typing braille on Android—blog.google. https://blog.google/products/android/braille-keyboard/. Last Accessed on 8 Oct 2023

  5. 2022. Thinkerbell Labs and braille literacy in India—medicircle.in. https://medicircle.in/thinkerbell-labs-and-braille-literacy-in-india. Last Accessed on 8 Oct 2023

  6. 2023. Vision impairment and blindness—who.int. https://www.who.int/news-room/fact-sheets/detail/blindness-and-visual-impairment. Last Accessed on 8 Oct 2023

  7. Aksentseva A (2023) Mobile accessibility testing guide for product owners—mobidev.biz. https://mobidev.biz/blog/mobile-accessibility-testing-explained. Last Accessed on 8 Oct 2023

  8. Alnfiai M, Sampalli S (2018) Improved singeltapbraille: developing a single tap text entry method based on grade 1 and 2 Braille encoding. J Ubiquitous Syst Pervasive Networks 9(1):23–31

    Google Scholar 

  9. Bonner MN, Brudvik JT, Abowd GD, Keith Edwards W (2010) No-look notes: accessible eyes-free multi-touch text entry. In: Pervasive computing: 8th international conference, Pervasive 2010, Helsinki, Finland, 17–20 May 2010. Proceedings 8. Springer, Berlin, pp 409–426

    Google Scholar 

  10. Burton D (2007) Talk me through it: a review of two cell phone-based screen readers—afb.org. https://www.afb.org/aw/8/1/14407. Last Accessed on 8 Oct 2023

  11. Brian F, Southern C, Romero M (2011) Brailletouch: mobile texting for the visually impaired. In: Universal access in human-computer interaction. Context diversity: 6th international conference (UAHCI 2011), Held as Part of HCI International 2011, Orlando, FL, USA, 9-14 July 2011, Proceedings, Part III 6. Springer, Berlin, pp 19–25

    Google Scholar 

  12. Green N, Kruger J, Faldu C, St. Amant R (2004) A reduced QWERTY keyboard for mobile text entry. In: CHI’04 extended abstracts on human factors in computing systems, pp 1429–1432

    Google Scholar 

  13. Guerreiro T, Nicolau H, Jorge J, Gonçalves D (2009) NavTap: a long term study with excluded blind users. In: Proceedings of the 11th international ACM SIGACCESS conference on computers and accessibility, pp 99–106

    Google Scholar 

  14. Hamzah R, Mohamad Fadzil MI (2016) Voice4Blind: the talking braille keyboard to assist the visual impaired users in text messaging. In: 2016 4th International conference on user science and engineering (i-USEr). IEEE, pp 265–270

    Google Scholar 

  15. Jadhav A, Patil A (2012) Android speech to text converter for SMS application. IOSR J Eng 2(3):420–423

    Google Scholar 

  16. Jadhav D, Bhutkar G, Mehta V (2013) Usability evaluation of messenger applications for android phones using cognitive walkthrough. In: Proceedings of the 11th Asia Pacific conference on computer human interaction, pp 9–18

    Google Scholar 

  17. Naveen Kumar M, Linga Chandar PC, Venkatesh Prasad A, Sumangali K (2016) Android based educational Chatbot for visually impaired people. In: 2016 IEEE International conference on computational intelligence and computing research (ICCIC). IEEE, pp 1–4

    Google Scholar 

  18. Landicho JA (2016) VOISEE COMMUNICATOR: an android mobile application for hearing-impaired and blind communications. Int J Interact Mob Technol 10(4):26–31

    Google Scholar 

  19. Misra S, Banubakode SM, Dhawale CA (2014) Novel user interface for text entry on touch screen mobile device for visually impaired users. In: 2014 Global summit on computer & information technology (GSCIT)

    Google Scholar 

  20. United Nations (2023) Population|United Nations—un.org. https://www.un.org/en/global-issues/population. Last Accessed on 8 Oct 2023

  21. Nayak S, Chandrakala CB (2020) Assistive mobile application for visually impaired people

    Google Scholar 

  22. Nour Azimah Z, Abdullah JM (2020) The Malaysian Journal of Medical Sciences’ performance report for 2019. Malays J Med Sci 27(5)

    Google Scholar 

  23. Rodrigues A, Nicolau H, Montague K, Guerreiro J, Guerreiro T (2020) Open challenges of blind people using smartphones. Int J Hum Comput Interact 36(17):1605–1622

    Google Scholar 

  24. Romero M, Frey B, Southern C, Abowd GD (2011) BrailleTouch: designing a mobile eyes-free soft keyboard. In: Proceedings of the 13th International conference on human computer interaction with mobile devices and services, pp 707–709

    Google Scholar 

  25. Sagale U, Bhutkar G, Karad M, Jathar N (2018) An eye-free android application for visually impaired users. In: Ergonomics in caring for people: proceedings of the international conference on humanizing work and work environment 2015. Springer, Berlin, pp 291–297

    Google Scholar 

  26. Sánchez J, Aguayo F (2007) Mobile messenger for the blind. In: Universal access in ambient intelligence environments: 9th ERCIM workshop on user interfaces for all, Königswinter, Germany, 27–28 Sept 2006. Revised Papers. Springer, Berlin, pp 369–385

    Google Scholar 

  27. Senjam SS, Manna S, Bascaran C (2021) Smartphones-based assistive technology: accessibility features and apps for people with visual impairment, and its usage, challenges, and usability testing. Clin Optom 2021:311–322

    Article  Google Scholar 

  28. Wang J, Zhai S, Canny J (2010) SHRIMP: solving collision and out of vocabulary problems in mobile predictive input with motion gesture. In: Proceedings of the SIGCHI Conference on human factors in computing systems, pp 15–24

    Google Scholar 

  29. Zhang MR, Wang R, Xu X, Li Q, Sharif A, Wobbrock JO (2021) Voicemoji: emoji entry using voice for visually impaired people. In: Proceedings of the 2021 CHI conference on human factors in computing systems, pp 1–18

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Texas at Austin, Austin, TX, USA

    Bindi Shah & Mrunmai Abhyankar

Authors
  1. Bindi Shah
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mrunmai Abhyankar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mrunmai Abhyankar .

Editor information

Editors and Affiliations

  1. IDC School of Design, Indian Institute of Technology Bombay, Mumbai, Maharashtra, India

    Anirudha Joshi

  2. School of Engineering and Computing, University of Central Lancashire, Preston, Lancashire, UK

    Gavin R. Sim

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Shah, B., Abhyankar, M. (2024). Touchtalk: Enhancing Messaging in Smartphones for Visually Impaired. In: Joshi, A., Sim, G.R. (eds) Proceedings of the 14th Indian Conference on Human-Computer Interaction. IndiaHCI 2023. Studies in Computational Intelligence, vol 1162. Springer, Singapore. https://doi.org/10.1007/978-981-97-4335-3_7

Download citation

  • DOI: https://doi.org/10.1007/978-981-97-4335-3_7

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-97-4334-6

  • Online ISBN: 978-981-97-4335-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation