research-article

Accessible Gaming Through Better Captions: A Study on Captions Preferences and Inclusivity of Deaf and Hard-of-Hearing Players

Authors: Wajdi Aljedaani, Marcelo M. Eler, Lorene E Keeland, Hamed Jalali, Khaled Al-Raddah, Mohamed Wiem MkaouerAuthors Info & Claims

W4A '24: Proceedings of the 21st International Web for All Conference

Pages 75 - 86

https://doi.org/10.1145/3677846.3677858

Published: 22 October 2024 Publication History

Abstract

The increasing popularity of video games has fostered the accessibility demands for a wider range of players, including people who are deaf or hard of hearing (d/Deaf). Recent studies manifested that caption practices in video games are essential for providing an inclusive gaming experience for d/Deaf players. However, there is a lack of consistent caption practices in video games, which can make it difficult for d/Deaf players to understand the audio-visual content. This study highlights the importance of standardized captions in video games for deaf and hard-of-hearing individuals. To do this, we conducted a survey-based study with 73 deaf and hard-of-hearing individuals to collect participants’ preferences and feedback on caption practices and the need for consistency. The open-ended comments from participants revealed interesting feedback regarding caption styles and valuable feedback on a variety of caption appearances. We also provide comprehensive captioning best practices for video game developers based on user preferences. This work contributes to the literature by providing an opportunity for researchers and the gaming industry to improve the accessibility and usability of gaming captions for players with hearing impairments.

References

[1]

2024. Study replication package. https://github.com/wajdialjedaani/W4ALL_Captioning.

[2]

Wajdi Aljedaani, Mona Aljedaani, Eman Abdullah AlOmar, Mohamed Wiem Mkaouer, Stephanie Ludi, and Yousef Bani Khalaf. 2021. I cannot see you—the perspectives of deaf students to online learning during covid-19 pandemic: Saudi arabia case study. Education Sciences 11, 11 (2021), 712.

[3]

Wajdi Aljedaani, Mona Aljedaani, Mohamed Wiem Mkaouer, and Stephanie Ludi. 2023. Teachers perspectives on transition to online teaching deaf and hard-of-hearing students during the covid-19 pandemic: A case study. In Proceedings of the 16th Innovations in Software Engineering Conference. 1–10.

Digital Library

[4]

Wajdi Aljedaani, Mohammed Alkahtani, Stephanie Ludi, Mohamed Wiem Mkaouer, Marcelo M Eler, Marouane Kessentini, and Ali Ouni. 2023. The state of accessibility in blackboard: Survey and user reviews case study. In Proceedings of the 20th International Web for All Conference. 84–95.

Digital Library

[5]

Wajdi Aljedaani, Rrezarta Krasniqi, Sanaa Aljedaani, Mohamed Wiem Mkaouer, Stephanie Ludi, and Khaled Al-Raddah. 2023. If online learning works for you, what about deaf students? Emerging challenges of online learning for deaf and hearing-impaired students during COVID-19: a literature review. Universal access in the information society 22, 3 (2023), 1027–1046.

[6]

Wajdi Aljedaani, Mohamed Wiem Mkaouer, Marcelo Medeiros Eler, and Marouane Kessentini. 2024. Empirical Investigation of Accessibility Bug Reports in Mobile Platforms: A Chromium Case Study. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1–17.

Digital Library

[7]

Wajdi Aljedaani, Mohamed Wiem Mkaouer, Stephanie Ludi, and Yasir Javed. 2022. Automatic classification of accessibility user reviews in android apps. In 2022 7th international conference on data science and machine learning applications (CDMA). IEEE, 133–138.

[8]

Wajdi Aljedaani, Mohamed Wiem Mkaouer, Stephanie Ludi, Ali Ouni, and Ilyes Jenhani. 2022. On the identification of accessibility bug reports in open source systems. In Proceedings of the 19th international web for all conference. 1–11.

Digital Library

[9]

Wajdi Aljedaani, Furqan Rustam, Stephanie Ludi, Ali Ouni, and Mohamed Wiem Mkaouer. 2021. Learning sentiment analysis for accessibility user reviews. In 2021 36th IEEE/ACM International conference on automated software engineering workshops (ASEW). IEEE, 239–246.

[10]

Eman Abdullah AlOmar, Wajdi Aljedaani, Murtaza Tamjeed, Mohamed Wiem Mkaouer, and Yasmine N El-Glaly. 2021. Finding the needle in a haystack: On the automatic identification of accessibility user reviews. In Proceedings of the 2021 CHI conference on human factors in computing systems. 1–15.

Digital Library

[11]

Akhter Al Amin, Joseph Mendis, Raja Kushalnagar, Christian Vogler, and Matt Huenerfauth. 2023. Who is speaking: Unpacking In-text Speaker Identification Preference of Viewers who are Deaf and Hard of Hearing while Watching Live Captioned Television Program. In Proceedings of the 20th International Web for All Conference. 44–53.

Digital Library

[12]

Pauliina Baltzar, Lobna Hassan, and Markku Turunen. 2023. “It’s Easier to Play Alone”: A Survey Study of Gaming With Disabilities. Journal of Electronic Gaming and Esports 1, 1 (2023).

[13]

BBC. 2022. BBC Subtitle Guidelines — bbc.co.uk. https://www.bbc.co.uk/accessibility/forproducts/guides/subtitles. [Accessed 23-08-2023].

[14]

Jen Beeston, Christopher Power, Paul Cairns, and Mark Barlet. 2018. Accessible player experiences (APX): The players. In International conference on computers helping people with special needs. Springer, 245–253.

Digital Library

[15]

Michael Bernard and Melissa Mills. 2000. So, what size and type of font should I use on my website. Usability news 2, 2 (2000), 1–5.

[16]

Cooper Biancur. 2021. Adopting Accessibility Guidelines for Videogames to Collectible Card Games. (2021).

[17]

Sheisa Bittencourt, Alan Bittencourt, and Regina de Oliveira Heidrich. 2022. Accessibility Features in Digital Games that Provide a Better User-Experience for Deaf Players: A Proposal for Analysis Methodology. In Handbook of Usability and User-Experience. CRC Press, 135–156.

[18]

Christopher Blake, Dorothée Hefner, Christian Roth, Christoph Klimmt, and Peter Vorderer. 2012. Cognitive processes involved in video game identification. In Entertainment Computing-ICEC 2012: 11th International Conference, ICEC 2012, Bremen, Germany, September 26-29, 2012. Proceedings 11. Springer, 75–84.

Digital Library

[19]

Mark Brown and Sky LaRell Anderson. 2021. Designing for disability: Evaluating the state of accessibility design in video games. Games and Culture 16, 6 (2021), 702–718.

[20]

Matheus Cezarotto, Pamela Martinez, and Barbara Chamberlin. 2022. Redesigning for accessibility: Design decisions and compromises in educational game design. International Journal of Serious Games 9, 1 (2022), 17–33.

[21]

Bader Chaarani, Joseph Ortigara, DeKang Yuan, Hannah Loso, Alexandra Potter, and Hugh P Garavan. 2022. Association of video gaming with cognitive performance among children. JAMA network open 5, 10 (2022), e2235721–e2235721.

[22]

Tomás Costal. 2018. Why is that creature grunting? The use of SDH subtitles in video games<? br?> from an accessibility perspective. Translation and Translanguaging in Multilingual Contexts 4, 1 (2018), 151–177.

[23]

Robert Costello, Murray Lambert, and Florian Kern. 2019. How Can Accessibility for Deaf and Hearing-Impaired Players be Improved in Video Games? International Journal of R&D Innovation Strategy (IJRDIS) 1, 1 (2019), 16–32.

[24]

Mikołaj Deckert and Krzysztof Hejduk. 2022. Can video game subtitling shape player satisfaction? Perspectives (2022), 1–17.

[25]

M Deryagin. 2017. What video game subtitling got wrong in 2017. Recuperado el 15 (2017).

[26]

Anna Dimkou. 2023. Accessibility and Audiovisual Translation: Subtitling for D/deaf and Hard-of-Hearing audiences in Greece. Ph. D. Dissertation. Aristotle University of Thessaloniki, Greece.

[27]

Rafael dos Passos Canteri, Laura Sánchez García, Tânya Amara de Felipe, Ludmilla Fernandes Oliveira Galvao, and Diego Roberto Antunes. 2019. Conceptual Framework to Support a Web Authoring Tool of Educational Games for Deaf Children. In CSEDU (2). 226–235.

[28]

Rafael dos Passos Canteri, Laura Sánchez Garcıa, Tanya Amara Felipe de Souza, and Carlos Eduardo Andrade Iatskiu. 2015. Video games in education of deaf children. In 17th International Conference on Enterprise Information Systems, Vol. 3. 122–129.

[29]

Paulo Sérgio Henrique Dos Santos, Alberto Dumont Alves Oliveira, Thais Bonjorni Nobre De Jesus, Wajdi Aljedaani, and Marcelo Medeiros Eler. 2023. Evolution may come with a price: analyzing user reviews to understand the impact of updates on mobile apps accessibility. In Proceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems. 1–11.

Digital Library

[30]

PopCap Games. 2008. Survey:’Disabled Gamers’ Comprise 20% of Casual Video Games Audience.

[31]

Victoria García-Prieto, Ignacio Aguaded, Antonio García-Rojas, et al. 2022. Diversity and public television: analysis of subtitling as an accessibility service. (2022).

[32]

Diana C Garofalo, Howard A Rosenblum, Yuan Zhang, Ying Chen, Paul S Appelbaum, and Maya Sabatello. 2022. Increasing inclusivity in precision medicine research: Views of deaf and hard of hearing individuals. Genetics in Medicine 24, 3 (2022), 712–721.

[33]

Anabela Gomes, Nelson Simão, and Ana Rita Teixeira. 2023. PipeBlind: A Game Adaptation for Blind. In International Conference on Human-Computer Interaction. Springer, 298–305.

[34]

Gareth Griffiths. 2009. Subtitles: Increasing game accessibility, comprehension. Online]. Disponible en: http://www. gamasutra. com/view/feature/3922/subtitles_increasing_ game_. php.(Consultado el día 12/04/2012) (2009).

[35]

William Grussenmeyer and Eelke Folmer. 2017. Accessible touchscreen technology for people with visual impairments: a survey. ACM Transactions on Accessible Computing (TACCESS) 9, 2 (2017), 1–31.

[36]

Carmen Mangiron Hevia. 2007. Video games localisation: Posing new challenges to the translator. Perspectives 14, 4 (2007), 306–323.

[37]

Josh Howarth. 2023. How Many Gamers Are There? (New 2023 Statistics) — explodingtopics.com. https://explodingtopics.com/blog/number-of-gamers. [Accessed 19-08-2023].

[38]

Angel Jaramillo-Alcázar, Eduardo Venegas, Santiago Criollo-C, and Sergio Luján-Mora. 2021. An approach to accessible serious games for people with dyslexia. Sustainability 13, 5 (2021), 2507.

[39]

Ehsan Jooyaeian and Masood Khoshsaligheh. 2022. Translation solutions in professional video game localization in Iran. Games and Culture 17, 7-8 (2022), 1054–1074.

[40]

Mansureh Kebritchi et al. 2008. Examining the pedagogical foundations of modern educational computer games. Computers & Education 51, 4 (2008), 1729–1743.

[41]

Masood Khoshsaligheh and Saeed Ameri. 2020. Video game localisation in Iran: a survey of users’ profile, gaming habits and preferences. The Translator 26, 2 (2020), 190–208.

[42]

Barbara A Kitchenham and Shari Lawrence Pfleeger. 2002. Principles of survey research part 2: designing a survey. ACM SIGSOFT Software Engineering Notes 27, 1 (2002), 18–20.

[43]

Wootaek Lim, Inseon Jang, and Chunghyun Ahn. 2014. Dynamic Subtitle Authoring Method Based on Audio Analysis for the Hearing Impaired. In Computers Helping People with Special Needs: 14th International Conference, ICCHP 2014, Paris, France, July 9-11, 2014, Proceedings, Part I 14. Springer, 53–60.

[44]

Frank R Lin, John K Niparko, and Luigi Ferrucci. 2011. Hearing loss prevalence in the United States. Archives of internal medicine 171, 20 (2011), 1851–1853.

[45]

Carmen Mangiron. 2013. Subtitling in game localisation: a descriptive study. Perspectives 21, 1 (2013), 42–56.

[46]

Carme Mangiron. 2016. Reception of game subtitles: an empirical study. The Translator 22, 1 (2016), 72–93.

[47]

Josefa Molina-López and Nuria Medina-Medina. 2019. Design proto-patterns to improve the interaction in video games of people with color blindness. In Proceedings of the XX International Conference on Human Computer Interaction. 1–2.

Digital Library

[48]

World Health Organization. 2021. World report on hearing — who.int. https://www.who.int/publications/i/item/9789240020481. [Accessed 19-08-2023].

[49]

Anthony Palomba. 2020. Gaming industry. The Rowman & Littlefield handbook of media management and business 2 (2020), 285.

[50]

Christopher Power, Paul Cairns, Mark Barlet, Gregory Haynes, Jen Beeston, and Triskal DeHaven. 2021. Validation and Prioritization of Design Options for Accessible Player Experiences. Interacting with Computers 33, 6 (2021), 641–656.

[51]

Martin Riopel, Lucian Nenciovici, Patrice Potvin, Pierre Chastenay, Patrick Charland, Jérémie Blanchette Sarrasin, and Steve Masson. 2019. Impact of serious games on science learning achievement compared with more conventional instruction: an overview and a meta-analysis. Studies in Science Education 55, 2 (2019), 169–214.

[52]

Mateusz Sajna. 2013. Translation of video games and films–a comparative analysis of selected technical problems. Homo Ludens 1, 5 (2013), 2013.

[53]

Graham Satchell. 2011. ’Subtitle glasses’ for deaf people — bbc.com. https://www.bbc.com/news/av/technology-14654339. [Accessed 07-09-2023].

[54]

Alessia Sciberras. 2021. Exploring video game subtitling: a local user-oriented reception study. Master’s thesis. University of Malta.

[55]

Statista. 2023. Global video game users 2027 | Statista — statista.com. https://www.statista.com/statistics/748044/number-video-gamers-world/. [Accessed 12-09-2023].

[56]

Agnieszka Szarkowska and Julianna Boczkowska. 2022. Colour coding subtitles in multilingual films–a reception study. Perspectives 30, 3 (2022), 520–536.

[57]

Arthur Theil, Lea Buchweitz, Annika S Schulz, and Oliver Korn. 2022. Understanding the perceptions and experiences of the deafblind community about digital games. Disability and Rehabilitation: Assistive Technology (2022), 1–10.

[58]

Javier Torrente, Ángel del Blanco, Pablo Moreno-Ger, Iván Martínez-Ortiz, and Baltasar Fernández-Manjón. 2009. Implementing accessibility in educational videogames with. In Proceedings of the first ACM international workshop on Multimedia technologies for distance learning. 57–66.

Digital Library

[59]

Carmen Van Ommen and Barbara S Chaparro. 2021. Assessing video game satisfaction of gamers with disabilities. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 65. SAGE Publications Sage CA: Los Angeles, CA, 822–826.

[60]

Carmen A Van Ommen and Barbara S Chaparro. 2022. Exploring video game satisfaction of gamers with disabilities. In International Conference on Human-Computer Interaction. Springer, 392–405.

Digital Library

[61]

Sam von Gillern and Brady Nash. 2023. Accessibility in video gaming: An overview and implications for English language arts education. Journal of Adolescent & Adult Literacy (2023).

[62]

Gareth Ford Williams. 2009. bbc. co. uk. Online Subtitling Editorial Guidelines V1. 1.

[63]

Bei Yuan, Eelke Folmer, and Frederick C Harris. 2011. Game accessibility: a survey. Universal Access in the information Society 10 (2011), 81–100.

[64]

Soledad Zárate. 2021. Captioning and subtitling for d/deaf and hard of hearing audiences. UCL Press.

Cited By

Alghamdi AAljedaani WJalali HLudi SEler M(2024)Understanding developer challenges and trends in web accessibility: a stack overflow analysisUniversal Access in the Information Society10.1007/s10209-024-01174-3Online publication date: 19-Nov-2024
https://doi.org/10.1007/s10209-024-01174-3

Index Terms

Accessible Gaming Through Better Captions: A Study on Captions Preferences and Inclusivity of Deaf and Hard-of-Hearing Players
1. Human-centered computing
  1. Accessibility
    1. Empirical studies in accessibility
  2. Interaction design
    1. Empirical studies in interaction design

Recommendations

Accessible Player Experiences (APX): The Players
Computers Helping People with Special Needs
Abstract
In research and practice into the accessibility of digital games, much of the work has focused on how to make games accessible to people with disabilities. With an increasing number of people with disabilities playing mainstream commercial games, ...
See-Through Captions: Real-Time Captioning on Transparent Display for Deaf and Hard-of-Hearing People
ASSETS '21: Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility

Real-time captioning is a useful technique for deaf and hard-of-hearing (DHH) people to talk to hearing people. With the improvement in device performance and the accuracy of automatic speech recognition (ASR), real-time captioning is becoming an ...
Accessible Play: Towards Designing a Framework for Customizable Accessibility in Games
CHI PLAY Companion '23: Companion Proceedings of the Annual Symposium on Computer-Human Interaction in Play

Video games are an important form of entertainment and have become an increasingly popular pastime in the 21st Century. However, many people with disabilities are still excluded from gaming due to accessibility barriers. While some progress has been ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

W4A '24: Proceedings of the 21st International Web for All Conference

May 2024

220 pages

ISBN:9798400710308

DOI:10.1145/3677846

Copyright © 2024 Copyright is held by the owner/author(s). Publication rights licensed to ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 October 2024

Check for updates

Author Tags

Qualifiers

Research-article

Conference

W4A '24

W4A '24: The 21st International Web for All Conference

May 13 - 14, 2024

Singapore, Singapore

Acceptance Rates

Overall Acceptance Rate 171 of 371 submissions, 46%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
46
Total Downloads

Downloads (Last 12 months)46
Downloads (Last 6 weeks)43

Reflects downloads up to 09 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Alghamdi AAljedaani WJalali HLudi SEler M(2024)Understanding developer challenges and trends in web accessibility: a stack overflow analysisUniversal Access in the Information Society10.1007/s10209-024-01174-3Online publication date: 19-Nov-2024
https://doi.org/10.1007/s10209-024-01174-3

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View full text|Download PDF

View Table of Contents