Audio rendering smart TV apps through mobile devices
Pages 675 - 689
Abstract
TV service providers now offer a variety of features, including broadcast-related ones like electronic programme guides, catch-up and recording features, but also Internet access and a variety of TV applications. These new features turn TV devices into more versatile and interesting platforms, but also clog the screen with more content than ever. Since this content is mainly visual, this means that TVs have even more inaccessible content for visually impaired people. This paper presents the design of a solution that audio renders the TV application’s user interface through a mobile device. Resorting to a mix of accessibility experts and user studies, we compared multiple feedback versions containing different contextual information. Participants reported that the use of repetitive sentences should be avoided; concise feedback feels smoother and quicker but, for some, lacks information while extended feedback can be annoying and take too much time though is appropriate for learning phases. For menus, most participants suggested to include the position of an element and the number of elements. The results helped to identify the critical information to convey to the user and to tailor two modes differing in the amount of contextual information provided, suitable for differently skilled users. Additionally, we condensed the findings into a list of design guidelines which can be generalized to other auditory interfaces meant to be operated by a VI user.
References
[1]
Affi, D., Dumoulin, J., Bertini, M., Mugellini, E., Abou Khaled, O., Del Bimbo, A.: Sensitv: Smart emotional system for impaired people’s tv. In: Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video, ACM, New York, NY, USA, TVX ’15, pp. 125–130, (2015) https://doi.org/10.1145/2745197.2755512
[2]
Alonso F, Fuertes JL, González ÁL, and Martínez L Miesenberger K, Klaus J, Zagler W, and Karshmer A User-interface modelling for blind users Computers Helping People with Special Needs 2008 Berlin Springer 789-796
[3]
Andrês Sanoja, S.G.: Block-o-matic: a web page segmentation tool and its evaluation. In: 29ème journées “Base de données avancées”, BDA’13 (2013)
[4]
Apple Accessibility: Tv that everyone can control. http://www.apple.com/accessibility/tv/vision/, accessed 18 September (2018)
[5]
Apple Inc Vision accessibility—iphone—apple. https://www.apple.com/lae/accessibility/iphone/vision/, accessed 07 July (2019)
[6]
Ariyasu, K., Kawakita, H., Handa, T., Kaneko, H.: Tactile sensibility presentation service for smart tv. In: 2014 IEEE 3rd Global Conference on Consumer Electronics (GCCE), pp. 236–237, (2014) https://doi.org/10.1109/GCCE.2014.7031287
[7]
Ashok, V., Borodin, Y., Puzis, Y., Ramakrishnan, I.V.: Capti-speak: a speech-enabled web screen reader. In: Proceedings of the 12th Web for All Conference, ACM, New York, NY, USA, W4A ’15, pp. 22:1–22:10, (2015) https://doi.org/10.1145/2745555.2746660
[8]
Bhowmick, A., Hazarika, S.M.: An insight into assistive technology for the visually impaired and blind people: state-of-the-art and future trends. Journal on Multimodal User Interfaces pp. 1–24, (2017). https://doi.org/10.1007/s12193-016-0235-6
[9]
Bigham, J.P., Prince, C.M., Ladner, R.E.: Webanywhere: a screen reader on-the-go. In: Proceedings of the 2008 International Cross-disciplinary Conference on Web Accessibility (W4A), ACM, New York, NY, USA, W4A ’08, pp. 73–82 (2008). https://doi.org/10.1145/1368044.1368060
[10]
Brewster SA Using nonspeech sounds to provide navigation cues ACM Trans. Comput.-Hum. Interact. 1998 5 3 224-259
[11]
Brewster SA and Crease MG Correcting menu usability problems with sound Behav. Inf. Technol. 1999 18 3 165-177
[12]
Coelho, J., Duarte, C., Biswas, P., Langdon, P.: Developing accessible tv applications. In: The Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility, ACM, New York, NY, USA, ASSETS ’11, pp. 131–138, (2011). https://doi.org/10.1145/2049536.2049561
[13]
Comcast: Comcast launches new accessible tv features ahead of 2018 paralympics. (2018). https://corporate.comcast.com/stories/comcast-launches-new-accessible-tv-features-ahead-of-2018-paralympics. Accessed 26 April 2019
[14]
Comcast Study: Visually impaired adults tune-in to television almost as much as general public. https://corporate.comcast.com/press/releases/study-visually-impaired-adults-tune-in-to-television-almost-as-much-as-general-public. Accessed 26 April 2019 (2018)
[15]
Costa D and Duarte C Visually impaired people and the emerging connected tv: a comparative study of tv and web applications’ accessibility Univ. Access Inf. Soc. 2017 16 1 197-214
[16]
Courtois, C., D’heer, E.: Second screen applications and tablet users: constellation, awareness, experience, and interest. In: Proceedings of the 10th European Conference on Interactive Tv and Video, ACM, New York, NY, USA, EuroiTV ’12, pp. 153–156, (2012). https://doi.org/10.1145/2325616.2325646
[17]
De Rosa, A., Justice, D.: Webreader: A screen reader for everyone, everywhere. In: Proceedings of the 13th Web for All Conference, ACM, New York, NY, USA, W4A ’16, pp. 10:1–10:2, (2016). https://doi.org/10.1145/2899475.2899510
[18]
Duarte, C., Costa, D., Feiteira, P., Costa, D.: Building an Adaptive Multimodal Framework for Resource Constrained Systems, Springer London, London, pp. 173–191. (2015). https://doi.org/10.1007/978-1-4471-6708-2_9
[19]
Epelde G, Valencia X, Carrasco E, Posada J, Abascal J, Diaz-Orueta U, Zinnikus I, and Husodo-Schulz C Providing universally accessible interactive services through tv sets: implementation and validation with elderly users Multimed. Tools Appl. 2013 67 2 497-528
[20]
Freedom Scientific Blindness solution: Jaws®. http://www.freedomscientific.com/Products/Blindness/JAWS. Accessed 18 September (2018)
[21]
Godard, N., Pecci, I., Isokoski, P., Weslide: Gestural text entry for elderly users of interactive television. In: Proceedings of the 11th European Conference on Interactive TV and Video, ACM, New York, NY, USA, EuroITV ’13, pp. 55–58, (2013). https://doi.org/10.1145/2465958.2465963
[22]
Google Android tv help: android tv accessibility features. https://support.google.com/androidtv/answer/6123320?hl=en. Accessed 18 September (2018)
[23]
Google Get started on android with talkback. https://support.google.com/accessibility/android/answer/6283677?hl=en. Accessed 07 July (2019)
[24]
Guerreiro, J., Gonçalves, D.: Faster text-to-speeches: enhancing blind people’s information scanning with faster concurrent speech. In: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility, ACM, New York, NY, USA, ASSETS ’15, pp. 3–11, (2015). https://doi.org/10.1145/2700648.2809840
[25]
Jassi, I.S., Ruchika, S., Pulakhandam, S., Mukherjee, S., Ashwin, T.S., Reddy, G.R.M.: Ember: a smartphone web browser interface for the blind. In: Proceedings of the 7th International Symposium on Visual Information Communication and Interaction, ACM, New York, NY, USA, VINCI ’14, pp. 106:112, (2014). https://doi.org/10.1145/2636240.2636847
[26]
Johnston, M., Stent, A.J.: Epg: speech access to program guides for people with disabilities. In: Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility, ACM, New York, NY, USA, ASSETS ’10, pp. 257–258, (2010). https://doi.org/10.1145/1878803.1878859
[27]
Kim K.J.R.H.J: ’heart-to-feel’: A new audio description coding scheme for the visually impaired on affective cinematography and emotive vibration. In: Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video, TVX ’14 (2014)
[28]
Kuber, R., Yu, W., McAllister, G.: Towards developing assistive haptic feedback for visually impaired internet users. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI ’07, pp 1525–1534, (2007). https://doi.org/10.1145/1240624.1240854
[29]
Kuber R, Yu W, and O’Modhrain MS Nordahl R, Serafin S, Fontana F, and Brewster S Tactile web browsing for blind users Haptic and Audio Interaction Design 2010 Berlin Springer 75-84
[30]
Magnusson, C., Tan, C.C.S., Yu, W.: Haptic access to 3d objects on the web. In: Proceeding of the Eurohaptics 2006, p. 4 (2006)
[31]
Mynatt ED Transforming graphical interfaces into auditory interfaces for blind users Hum.-Comput. Interact. 1997 12 1 7-45
[32]
Nandakumar, A., Murray, J.: Companion apps for long arc tv series: Supporting new viewers in complex storyworlds with tightly synchronized context-sensitive annotations. In: Proceedings of the 2014 ACM International Conference on Interactive Experiences for TV and Online Video, ACM, New York, NY, USA, TVX ’14, pp. 3–10, (2014). https://doi.org/10.1145/2602299.2602317
[33]
National Institute of Deafness and Other Communication Disorders (NIDCD) Assistive devices for people with hearing, voice, speech, or language disorders. http://www.nidcd.nih.gov/health/hearing/pages/assistive-devices.aspx, Accessed 26 February 2016, (2011)
[34]
Norman DA and Draper SW User Centered System Design. New Perspectives on Human-Computer Interaction 1986 Hillsdale, NJ, USA L. Erlbaum Associates Inc.
[35]
NV Access (2019) Nvda. https://www.nvaccess.org/about-nvda/. Accessed 07 July (2019)
[36]
Oliveira, R., Ferraz de Abreu, J., Almeida, A.M.: An approach to identify requirements for an itv audio description service. In: Proceedings of the 9th International Interactive Conference on Interactive Television, ACM, New York, NY, USA, EuroITV ’11, pp. 227–230, (2011). https://doi.org/10.1145/2000119.2000166
[37]
Rajapakse, R., Dias, M., Weerasekara, K., Dharmaratne, A., Wimalaratne, P.: Audio user interface for visually impaired computer users: in a two dimensional audio environment. In: Proceedings of World Academy of Science, Engineering and Technology (2012)
[38]
Samsung Accessibility settings for your tv. https://www.samsung.com/us/support/answer/ANS00062238/. Accessed 18 September (2018)
[39]
Sanoja, A., Gançarski, S.: Block-o-Matic: a Web Page Segmentation Tool and its Evaluation. 29ème journées ”Base de données avancées”, BDA’13, https://hal.archives-ouvertes.fr/hal-00881693, poster (2013)
[40]
Schmeidler, E., Kirchner, C.: Adding audio description. does it make a difference? J. Vis. Impairment Blind. 197–212 (2001)
[41]
Silva, P., Amer, Y., Tsikerdanos, W., Shedd, J., Restrepo, I., Murray, J.: A game of thrones companion: Orienting viewers to complex storyworlds via synchronized visualizations. In: Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video, ACM, New York, NY, USA, TVX ’15, pp. 167–172, (2015). https://doi.org/10.1145/2745197.2755519
[42]
Union EB Digital TV Accessibility: Report on the Current Status in European Countries 2008 European Blind Union Tech. Rep
[43]
Vargas, M.L.M.: Combining speech and earcons to assist menu navigation. In: Proceedings of the 9th International Conference on Auditory Display (ICAD2003) (2003)
Index Terms
- Audio rendering smart TV apps through mobile devices
Index terms have been assigned to the content through auto-classification.
Recommendations
Interactive TV Services on Mobile Devices
The convergence of multimedia, Internet, and wireless technologies is changing traditional passive TV into a more interactive experience. In this article, experts share their experiences in designing an interactive TV platform, providing readers with ...
ShapeShifting TV: interactive screen media narratives
This paper presents a paradigm, called ShapeShifting TV, for the realisation of interactive TV narratives or, more generally, of interactive screen-media narratives. These are productions whose narrations respond on the fly (i.e. in real time) to ...
Interactive TV narratives: Opportunities, progress, and challenges
This article is motivated by the question whether television should do more than simply offer interactive services alongside (and separately from) traditional linear programs, in the context of its dominance being seriously challenged and threatened by ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
© The Author(s), under exclusive licence to Springer-Verlag GmbH, DE part of Springer Nature 2021.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 01 August 2022
Qualifiers
- Research-article
Funding Sources
- Fundação para a Ciência e a Tecnologia (PT)
- Reitoria da Universidade de Lisboa
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 29 Nov 2024
Other Metrics
Citations
View Options
View options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in