research-article

The use of automatic text simplification to provide reading assistance to deaf and hard-of-hearing individuals in computing fields

Author:

Oliver AlonzoAuthors Info & Claims

ACM SIGACCESS Accessibility and Computing, Issue 132

Article No.: 3, Page 1

https://doi.org/10.1145/3523265.3523268

Published: 01 March 2022 Publication History

Abstract

Automatic Text Simplification (ATS) aims to rewrite text in a way that reduces its linguistic complexity while preserving its original meaning. While some prior research has explored using ATS to provide reading assistance to different user groups, relatively little work has investigated its use for Deaf and Hard-of-hearing (DHH) adults or readers in a particular domain. In this project, we investigate the use of ATS-based reading assistance tools for DHH individuals in the computing and information technology (IT) fields, motivated by prior work suggesting that computing professions often require reading about new technologies in order to stay current in the profession. Employing a variety of research methods, we investigate questions including the needs and interests of DHH individuals in the computing and IT fields for ATS-based reading assistance tools and their preferences for different interface parameters of these tools. We also investigate how to evaluate these technologies with this particular user group and how they may benefit from using these tools. This summary presents the motivation for this work, positions it in the context of the related literature, and outlines the proposed solution, our current progress and the project's contributions.

References

[1]

Oliver Alonzo, Lisa Elliot, Becca Dingman, and Matt Huenerfauth. 2020. Reading Experiences and Interest in Reading-Assistance Tools Among Deaf and Hard-of- Hearing Computing Professionals. In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility (Virtual Event, Greece) (ASSETS '20). Association for Computing Machinery, New York, NY, USA, 13. https://doi.org/

Digital Library

[2]

Oliver Alonzo, Matthew Seita, Abraham Glasser, and Matt Huenerfauth. 2020. Automatic Text Simplification Tools for Deaf and Hard of Hearing Adults: Benefits of Lexical Simplification and Providing Users with Autonomy. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1-13.

Digital Library

[3]

Oliver Alonzo, Jessica Trussell, Becca Dingman, and Matt Huenerfauth. 2021. Comparison of Methods for Evaluating Complexity of Simplified Texts among Deaf and Hard-of-Hearing Adults at Different Literacy Levels. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21). Association for Computing Machinery, New York, NY, USA. 3445038

Digital Library

[4]

Larwan Berke, Sushant Kafle, and Matt Huenerfauth. 2018. Methods for Evaluation of Imperfect Captioning Tools by Deaf or Hard-of-Hearing Users at Different Reading Literacy Levels. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). ACM, New York, NY, USA, Article 91, 12 pages.

Digital Library

[5]

Joachim Bingel, Gustavo Paetzold, and Anders Søgaard. 2018. Lexi: A tool for adaptive, personalized text simplification. In Proceedings of the 27th International Conference on Computational Linguistics. Association for Computational Linguistics, Santa Fe, New Mexico, USA, 245-258. https://www.aclweb.org/anthology/ C18- 1021

[6]

Stefan Bott, Horacio Saggion, and David Figueroa. 2012. A Hybrid System for Spanish Text Simplification. In Proceedings of the Third Workshop on Speech and Language Processing for Assistive Technologies (Montreal, Canada) (SLPAT '12). Association for Computational Linguistics, Stroudsburg, PA, USA, 75-84. http://dl.acm.org/citation.cfm?id=2392855.2392865

Digital Library

[7]

Ashwin Devaraj, Iain J Marshall, Byron C Wallace, and Junyi Jessy Li. 2021. Paragraph-level Simplification of Medical Texts. arXiv preprint arXiv:2104.05767 (2021).

[8]

Siobhan Devlin and Gary Unthank. 2006. Helping Aphasic People Process Online Information. In Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility (Portland, Oregon, USA) (Assets '06). ACM, New York, NY, USA, 225-226.

Digital Library

[9]

Organization for Economic Co-operation and Development. 2012. Survey of Adult Skills (PIAAC). http://skills.oecd.org/Survey_of_Adult_Skills_US.pdf

[10]

Dhananjai Hariharan, Sedeeq Al-khazraji, and Matt Huenerfauth. 2018. Evaluation of an English Word Look-Up Tool for Web-Browsing with Sign Language Video for Deaf Readers. In International Conference on Universal Access in Human- Computer Interaction. Springer, 205-215.

[11]

Matt Huenerfauth and Hernisa Kacorri. 2015. Best practices for conducting evaluations of sign language animation. In 30th Annual International Technology and Persons with Disabilities Conference Scientific/Research Proceedings. California State University, Northridge.

[12]

Kentaro Inui, Atsushi Fujita, Tetsuro Takahashi, Ryu Iida, and Tomoya Iwakura. 2003. Text Simplification for Reading Assistance: A Project Note. In Proceedings of the Second International Workshop on Paraphrasing - Volume 16 (Sapporo, Japan) (PARAPHRASE '03). Association for Computational Linguistics, Stroudsburg, PA, USA,9-16.

Digital Library

[13]

Poorna Kushalnagar, Scott Smith, Melinda Hopper, Claire Ryan, Micah Rinkevich, and Raja Kushalnagar. 2018. Making cancer health text on the Internet easier to read for deaf people who use American Sign Language. Journal of Cancer Education 33, 1 (2018), 134-140.

[14]

Slavina Lozanova, Ivelina Stoyanova, Svetlozara Leseva, Svetla Koeva, and Boian Savtchev. 2013. Text modification for Bulgarian sign language users. In Proceedings of the Second Workshop on Predicting and Improving Text Readability for Target Reader Populations. 39-48.

[15]

John L Luckner and C Michele Handley. 2008. A summary of the reading com- prehension research undertaken with students who are deaf or hard of hearing. American Annals of the Deaf 153, 1 (2008), 6-36.

[16]

Mounica Maddela and Wei Xu. 2018. A Word-Complexity Lexicon and A Neural Readability Ranking Model for Lexical Simplification. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Brussels, Belgium, 3749-3760. https://doi.org/10. 18653/v1/D18- 1410

[17]

Angrosh Annayappan Mandya, Tadashi Nomoto, and Advaith Siddharthan.2014. Lexico-syntactic text simplification and compression with typed dependencies. In 25th International Conference on Computational Linguistics.

[18]

Hugo Nicolau, André Rodrigues, André Santos, Tiago Guerreiro, Kyle Montague, and Joa~o Guerreiro. 2019. The Design Space of Nonvisual Word Completion. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility (Pittsburgh, PA, USA) (ASSETS '19). Association for Computing Machinery, New York, NY, USA, 249-261.

Digital Library

[19]

Gustavo Paetzold and Lucia Specia. 2016. Understanding the Lexical Simplification Needs of Non-Native Speakers of English. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers. The COLING 2016 Organizing Committee, Osaka, Japan, 717-727. https://www.aclweb.org/anthology/C16- 1069

[20]

Luz Rello, Ricardo Baeza-Yates, Stefan Bott, and Horacio Saggion. 2013. Simplify or Help?: Text Simplification Strategies for People with Dyslexia. In Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility (Rio de Janeiro, Brazil) (W4A '13). ACM, New York, NY, USA, Article 15, 10 pages.

Digital Library

[21]

Luz Rello, Ricardo Baeza-Yates, Laura Dempere-Marco, and Horacio Saggion. 2013. Frequent words improve readability and short words improve understandability for people with dyslexia. In IFIP Conference on Human-Computer Interaction (INTERACT 2013). Springer, 203-219.

[22]

Luz Rello, Roberto Carlini, Ricardo Baeza-Yates, and Jefrey P. Bigham. 2015. A Plug-in to Aid Online Reading in Spanish. In Proceedings of the 12th Web for All Conference (Florence, Italy) (W4A '15). Association for Computing Machinery, New York, NY, USA, Article 7, 4 pages.

Digital Library

[23]

Horacio Saggion, Sanja S?tajner, Stefan Bott, Simon Mille, Luz Rello, and Biljana Drndarevic. 2015. Making It Simplext: Implementation and Evaluation of a Text Simplification System for Spanish. ACM Trans. Access. Comput. 6, 4, Article 14 (May 2015), 36 pages.

Digital Library

[24]

Matthew Shardlow. 2014. Out in the Open: Finding and Categorising Errors in the Lexical Simplification Pipeline. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14). European Language Resources Association (ELRA), Reykjavik, Iceland, 1583-1590. http://www.lrec- conf.org/proceedings/lrec2014/pdf/479_Paper.pdf

[25]

C. B. Traxler. 2000. The Stanford Achievement Test, 9th Edition: National Norming and Performance Standards for Deaf and Hard-of-Hearing Students. Journal of Deaf Studies and Deaf Education 5, 4 (Jan 2000), 337-348. https://doi.org/10.1093/ deafed/5.4.337

[26]

Willian Massami Watanabe, Arnaldo Candido Junior, Vinícius Rodriguez Uzeda, Renata Pontin de Mattos Fortes, Thiago Alexandre Salgueiro Pardo, and Sandra Maria Aluísio. 2009. Facilita: Reading Assistance for Low-literacy Readers. In Proceedings of the 27th ACM International Conference on Design of Communication (Bloomington, Indiana, USA) (SIGDOC '09). ACM, New York, NY, USA, 29-36.

Digital Library

[27]

Victoria Yaneva, Constantin Orasan, Le An Ha, and Natalia Ponomareva. 2019. A Survey of the Perceived Text Adaptation Needs of Adults with Autism. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2019). INCOMA Ltd., Varna, Bulgaria, 1356-1363. - 954- 452- 056- 4_155

[28]

Xingxing Zhang and Mirella Lapata. 2017. Sentence Simplification with Deep Reinforcement Learning. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Copenhagen, Denmark, 584-594. - 1062

Cited By

Wu GQian JCastelo Quispe SChen SRulff JSilva C(2024)ARTiST: Automated Text Simplification for Task Guidance in Augmented RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642772(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642772
Alshanqiti AAlbouq SAlkhodre ANamoun ANabil E(2022)Employing a Multilingual Transformer Model for Segmenting Unpunctuated Arabic TextApplied Sciences10.3390/app12201055912:20(10559)Online publication date: 19-Oct-2022
https://doi.org/10.3390/app122010559

Recommendations

Automatic Text Simplification Tools for Deaf and Hard of Hearing Adults: Benefits of Lexical Simplification and Providing Users with Autonomy
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Automatic Text Simplification (ATS), which replaces text with simpler equivalents, is rapidly improving. While some research has examined ATS reading-assistance tools, little has examined preferences of adults who are deaf or hard-of-hearing (DHH), and ...
Reading Experiences and Interest in Reading-Assistance Tools Among Deaf and Hard-of-Hearing Computing Professionals
ASSETS '20: Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility

Automatic Text Simplification (ATS) software replaces text with simpler alternatives. While some prior research has explored its use as a reading assistance technology, including some empirical findings suggesting benefits for deploying this technology ...
Reading-Assistance Tools Among Deaf and Hard-of-Hearing Computing Professionals in the U.S.: Their Reading Experiences, Interests and Perceptions of Social Accessibility
Automatic Text Simplification (ATS) software aims at automatically rewrite complex text to make it simpler to read. Prior research has explored the use of ATS as a reading assistance technology, identifying benefits from providing these technologies to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM SIGACCESS Accessibility and Computing

ACM SIGACCESS Accessibility and Computing Just Accepted

January 2022

7 pages

ISSN:1558-2337

EISSN:1558-1187

DOI:10.1145/3523265

Editor:
André Rodrigues
University of Lisbon

Issue’s Table of Contents

Copyright © 2022 Copyright is held by the owner/author(s).

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 March 2022

Published in SIGACCESS , Issue 132

Check for updates

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
58
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)2

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wu GQian JCastelo Quispe SChen SRulff JSilva C(2024)ARTiST: Automated Text Simplification for Task Guidance in Augmented RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642772(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642772
Alshanqiti AAlbouq SAlkhodre ANamoun ANabil E(2022)Employing a Multilingual Transformer Model for Segmenting Unpunctuated Arabic TextApplied Sciences10.3390/app12201055912:20(10559)Online publication date: 19-Oct-2022
https://doi.org/10.3390/app122010559

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Issue’s Table of Contents