research-article

Comparing semiliterate and illiterate users' ability to transition from audio+text to text-only interaction

Authors:

Leah Findlater,

Ravin Balakrishnan,

Kentaro ToyamaAuthors Info & Claims

CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1751 - 1760

https://doi.org/10.1145/1518701.1518971

Published: 04 April 2009 Publication History

Abstract

Multimodal interfaces with little or no text have been shown to be useful for users with low literacy. However, this research has not differentiated between the needs of the fully illiterate and semiliterate - those who have basic literacy but cannot read and write fluently. Text offers a fast and unambiguous mode of interaction for literate users and the exposure to text may allow for incidental improvement of reading skills. We conducted two studies that explore how semiliterate users with very little education might benefit from a combination of text and audio as compared to illiterate and literate users. Results show that semiliterate users reduced their use of audio support even during the first hour of use and over several hours this reduction was accompanied by a gain in visual word recognition; illiterate users showed no similar improvement. Semiliterate users should thus be treated differently from illiterate users in interface design.

References

[1]

Alvarez, J.M.M. Trust building user generated interfaces for illiterate people. In Proc. IUI4DR 2008, (2008), 38--42.

[2]

Barr, R., Pearson, P.D., Kamil, M.L., Mosenthal, P.B. (Eds.). Handbook of Reading Research: Volume II. Lawrence Erlbaum, 1996.

[3]

Blake, E.H., Steventon, L., Edge, J., Foster, A. A field computer for animal trackers. In Proc. CHI-SA 2001, (2001). Retrieved January 15, 2008, from www.chi-sa.org.za/CHI-SA2001/cyber-tracker.pdf

Digital Library

[4]

Brett, P. Using multimedia: A descriptive investigation of incidental language learning. Computer Assisted Language Learning 11, 2(1998), 179--200.

[5]

Brewer, E., Demmer, M., Ho, M., Honicky, R.J., Pal, J., Plauché, M., Sonesh, S. The challenges of IT research for developing regions. IEEE Transactions 5, 2(2006), 15--23.

Digital Library

[6]

Census of India - India at a glance: Number of literates&literacy rates. Retrieved April 30, 2008, from http://www.censusindia.gov.in/Census_Data_2001/India_at_glance/literates1.aspx

[7]

Central Intelligence Agency. The World Factbook. Retrieved May 7, 2008 from https://www.cia.gov/library/publications/the-world-factbook/geos/xx.html

[8]

Chall, J. Learning to read: The great debate. New York: McGraw-Hill. 1983.

[9]

Danan, M. Reversed subtitling and dual coding theory: New directions for foreign language instruction. Language Learning 42, 4(2006), 497--527.

[10]

Dhakhwa, S., Hall, P.A.V., Ghimire, G.B., Manandhar, P., Thapa, I. Sambad - Computer interfaces for non-literates. In Proc. HCII 2007, (2007), 721--730.

Digital Library

[11]

Freedom Scientific. JAWS for Windows Overview. Retrieved September 2, 2008, from http://www.freedomscientific.com/fs_products/software_jaws.asp

[12]

Grisedale, S., Graves, M., Grunsteidl, A. Designing a graphical user interface for healthcare workers in rural India. In Proc. CHI '97, (1997), 471--478.

Digital Library

[13]

Hiebert, E.H., Kamil, M.L. (Eds.). Teaching and Learning Vocabulary. Lawrence Erlbaum, 2005.

[14]

Kothari, B., Takeda, J., Joshi, A., Pandey, A. Same language subtitling: A butterfly for literacy? International Journal of Lifelong Education 21, 1(2002), 55--66.

[15]

Medhi, I., Prasad, A., Toyama, K. Optimal audio-visual representations for illiterate users of computers. In Proc. WWW 2007, (2007), 873--882.

Digital Library

[16]

Medhi, I., Sagar, A., Toyama, K. Text-free user interfaces for illiterate and semiliterate users. In Proc. ICTD 2006, (2006), 72--82.

[17]

Moffatt, K., McGrenere, J., Purves, B., Klawe, M. The participatory design of a sound and image enhanced daily planner for people with aphasia. In Proc. CHI 2004, (2004), 407--414.

Digital Library

[18]

Languages spoken by more than 10 million people. MSN Encarta. Retrieved September 1, 2008, from http://encarta.msn.com/media_701500404/Languages_Spoken_by_More_Than_10_Million_People.html

[19]

Nag, S. Early reading in Kannada: The pace of acquisition of orthographic knowledge and phonemic awareness. Journal of Research in Reading 30, 1(2007), 7--22.

[20]

Parikh, T., Ghosh, K., Chavan, A. Design studies for a financial management system for micro-credit groups in rural India. In Proc. CUU 2003, (2003), 15--22.

Digital Library

[21]

Parikh, T., Javid, P., Kumar, S., Ghosh, K., Toyama, K. Mobile phones and paper documents: Evaluating a new approach for capturing microfinance data in rural India. In Proc. CHI 2006, (2006), 551--560.

Digital Library

[22]

Plauché, M., Prabaker, M. Tamil market: A spoken dialog system for rural India. In CHI Extended Abstracts 2006, (2006), 1619--1624.

Digital Library

[23]

Prasad, A., Medhi, I., Toyama, K., Balakrishnan, R. Exploring the feasibility of video mail for illiterate users. In Proc. AVI 2008, (2008), 103--110.

Digital Library

[24]

Shakeel, H., Best, M.L. Community Knowledge Sharing: An internet application to support communications across literacy levels. In Proc. Technology and Society, (2002), 37--44.

[25]

Sherwani, J., Ali, N., Mirza, S., Fatma, A., Memom, Y., Karim, M., Tongia, R., Rosefeld, R. HealthLine: Speech-based access to health information by low-literate users. In Proc. ICTD 2007, (2007).

[26]

Sin, M., Escobedo, M., Best, M. A directory service for multi-literate users. In Proc. ICME 2004, (2004), 1295--1298.

Cited By

Ilakiyaselvan NDhandapani AKhadar Nawas KBhattacharya A(2024)AgriAid: An Intelligent Farmer Companion Using Deep Learning Approach2024 International Conference on Intelligent and Innovative Technologies in Computing, Electrical and Electronics (IITCEE)10.1109/IITCEE59897.2024.10467751(1-6)Online publication date: 24-Jan-2024
https://doi.org/10.1109/IITCEE59897.2024.10467751
Islam MKhan NInan TSarker I(2023)Designing User Interfaces for Illiterate and Semi-Literate Users: A Systematic Review and Future Research AgendaSAGE Open10.1177/2158244023117274113:2(215824402311727)Online publication date: 16-May-2023
https://doi.org/10.1177/21582440231172741
Hasan MSaxena DRubaiat YAhamed SGuha S(2023)Design Recommendations towards Developing a Smartphone-Based Point-of-Care Tool for Rural Bangladeshi UsersInternational Journal of Human–Computer Interaction10.1080/10447318.2023.217546240:4(965-985)Online publication date: 16-Feb-2023
https://doi.org/10.1080/10447318.2023.2175462
Show More Cited By

Index Terms

Comparing semiliterate and illiterate users' ability to transition from audio+text to text-only interaction
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
    2. Interaction paradigms

Recommendations

The role of accessibility in a universal web
W4A '14: Proceedings of the 11th Web for All Conference

"Universal design" is the process of creating products that are usable by people with the widest possible range of abilities, operating within the widest possible range of situations; whereas "accessibility" primarily refers to design for people with ...
Text formats and web design for visually impaired and dyslexic readers-Clear Text for All

The Royal National Institute of the Blind (RNIB) has produced a Clear Print booklet, which contains recommendations for the production of Clear Print for the blind and partially sighted. The British Dyslexia Association (BDA) has produced a Dyslexia ...
Designing for people who do not read easily
BCS-HCI '08: Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction - Volume 2

Many people do not read easily for all sorts of reasons: social and cultural, because of impairments, or because of their context. Even in the area of impairments, design for people with learning disabilities might be very different from design for ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2009

2426 pages

ISBN:9781605582467

DOI:10.1145/1518701

General Chairs:
Dan R. Olsen
Brigham Young University
,
Richard B. Arthur
Brigham Young University
,
Program Chairs:
Ken Hinckley
Microsoft Research
,
Meredith Ringel Morris
Microsoft Research
,
Scott Hudson
Carnegie Mellon University
,
Saul Greenberg
University of Calgary

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 April 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '09

Sponsor:

CHI '09: CHI Conference on Human Factors in Computing Systems

April 4 - 9, 2009

MA, Boston, USA

Acceptance Rates

CHI '09 Paper Acceptance Rate 277 of 1,130 submissions, 25%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

32
Total Citations
View Citations
713
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)1

Reflects downloads up to 01 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ilakiyaselvan NDhandapani AKhadar Nawas KBhattacharya A(2024)AgriAid: An Intelligent Farmer Companion Using Deep Learning Approach2024 International Conference on Intelligent and Innovative Technologies in Computing, Electrical and Electronics (IITCEE)10.1109/IITCEE59897.2024.10467751(1-6)Online publication date: 24-Jan-2024
https://doi.org/10.1109/IITCEE59897.2024.10467751
Islam MKhan NInan TSarker I(2023)Designing User Interfaces for Illiterate and Semi-Literate Users: A Systematic Review and Future Research AgendaSAGE Open10.1177/2158244023117274113:2(215824402311727)Online publication date: 16-May-2023
https://doi.org/10.1177/21582440231172741
Hasan MSaxena DRubaiat YAhamed SGuha S(2023)Design Recommendations towards Developing a Smartphone-Based Point-of-Care Tool for Rural Bangladeshi UsersInternational Journal of Human–Computer Interaction10.1080/10447318.2023.217546240:4(965-985)Online publication date: 16-Feb-2023
https://doi.org/10.1080/10447318.2023.2175462
Atinaf MAnteneh SKifle M(2023)Socio-technical design principles for a multi-stakeholder agriculture extension information system in EthiopiaInformation Technology for Development10.1080/02681102.2023.227930930:3(493-521)Online publication date: 10-Nov-2023
https://doi.org/10.1080/02681102.2023.2279309
Hayat SRextin ABilal A(2021)Understanding the usability issues in contact management of illiterate and semi-literate usersPLOS ONE10.1371/journal.pone.025971916:12(e0259719)Online publication date: 2-Dec-2021
https://doi.org/10.1371/journal.pone.0259719
Srivastava AKapania STuli ASingh P(2021)Actionable UI Design Guidelines for Smartphone Applications Inclusive of Low-Literate UsersProceedings of the ACM on Human-Computer Interaction10.1145/34492105:CSCW1(1-30)Online publication date: 22-Apr-2021
https://dl.acm.org/doi/10.1145/3449210
Giesteira BPereira E(2018)HCI4D Guidelines for Interactive ContentEmerging Trends, Techniques, and Tools for Massive Open Online Course (MOOC) Management10.4018/978-1-5225-5011-2.ch003(49-77)Online publication date: 2018
https://doi.org/10.4018/978-1-5225-5011-2.ch003
Jain MKumar PBhansali ILiao QTruong KPatel S(2018)FarmChatProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/32870482:4(1-22)Online publication date: 27-Dec-2018
https://dl.acm.org/doi/10.1145/3287048
Sharma SKallioniemi PHeimonen THakulinen JTurunen MKeskinen TGiannakos MJaccheri LDivitini M(2018)Overcoming socio-technical challenges for cross-cultural collaborative applicationsProceedings of the 17th ACM Conference on Interaction Design and Children10.1145/3202185.3202730(325-336)Online publication date: 19-Jun-2018
https://dl.acm.org/doi/10.1145/3202185.3202730
Shah HSengupta A(2018)Designing mobile based computational support for low-literate community health workersInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2018.01.007115(1-8)Online publication date: Jul-2018
https://doi.org/10.1016/j.ijhcs.2018.01.007
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents