Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3308558.3313605acmotherconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article
Open access

“It's almost like they're trying to hide it”: How User-Provided Image Descriptions Have Failed to Make Twitter Accessible

Published: 13 May 2019 Publication History

Abstract

To make images on Twitter and other social media platforms accessible to screen reader users, image descriptions (alternative text) need to be added that describe the information contained within the image. The lack of alternative text has been an enduring accessibility problem since the “alt” attribute was added in HTML 2.0 over 20 years ago, and the rise of user-generated content has only increased the number of images shared. As of 2016, Twitter provides users the ability to turn on a feature that allows descriptions to be added to images in their tweets, presumably in an effort to combat this accessibility problem. What has remained unknown is whether simply enabling users to provide alternative text has an impact on experienced accessibility. In this paper, we present a study of 1.09 million tweets with images, finding that only 0.1% of those tweets included descriptions. In a separate analysis of the timelines of 94 blind Twitter users, we found that these image tweets included descriptions more often. Even users with the feature turned on only write descriptions for about half of the images they tweet. To better understand why users provide alternative text descriptions (or not), we interviewed 20 Twitter users who have written image descriptions. Users did not remember to add alternative text, did not have time to add it, or did not know what to include when writing the descriptions. Our findings indicate that simply making it possible to provide image descriptions is not enough, and reveal future directions for automated tools that may support users in writing high-quality descriptions.

References

[1]
Adobe. 2018. Add alternative text. https://www.adobe.com/accessibility/products/acrobat/pdf-repair-add-alternative-text.html
[2]
Apple. 2018. Supporting VoiceOver in Your App. https://developer.apple.com/documentation/uikit/accessibility/supporting_voiceover_in_your_app
[3]
Julian Ausserhofer and Axel Maireder. 2013. National politics on Twitter: Structures and topics of a networked public sphere. Information, Communication & Society 16, 3 (2013), 291-314.
[4]
Tim Berners-Lee and Dan Connolly. 1995. HTML 2.0 Specification. W3C: http://www. w3. org/MarkUp/html-spec 34 (1995).
[5]
Jeffrey P Bigham, Ryan S Kaminsky, Richard E Ladner, Oscar M Danielsson, and Gordon L Hempton. 2006. WebInSight: Making Web Images Accessible. In Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility - Assets '06. 181.
[6]
Erin L. Brady, Yu Zhong, Meredith Ringel Morris, and Jeffrey P. Bigham. 2013. Investigating the appropriateness of social network question asking as a resource for blind users. In Proceedings of the 2013 conference on Computer supported cooperative work - CSCW '13. ACM Press, New York, New York, USA, 1225.
[7]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (jan 2006), 77-101. arXiv:arXiv:1011.1669v3
[8]
C-SPAN. 2018. @cspan/Members of Congress on Twitter. https://twitter.com/cspan/lists/members-of-congress{Online; accessed 2-November-2018}.
[9]
W3 Consortium 1998. HTML 4.0 specification. Technical Report. Technical report, W3 Consortium, 1998. http://www. w3. org/TR/REC-html40.
[10]
W3 Consotrium. {n. d.}. Web Content Accesisbility Guidelines (WCAG) 2.1. https://www.w3.org/TR/WCAG21/
[11]
Cameron Cundiff. 2015. alt-text-bot: automatic text descriptions of images on Twitter. https://devpost.com/software/alt-text-bot
[12]
Daniel Dardailler. 1997. The ALT-server (” An eye for an alt”).
[13]
Pierre Geurts, Damien Ernst, and Louis Wehenkel. 2006. Extremely randomized trees. Machine learning 63, 1 (2006), 3-42.
[14]
Google. 2018. Content labels. https://support.google.com/accessibility/android/answer/7158690?hl=en
[15]
Darren Guinness, Edward Cutrell, and Meredith Ringel Morris. 2018. Caption Crawler: Enabling Reusable Alternative Text Descriptions Using Reverse Image Search. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI '18). ACM, New York, NY, USA, Article 518, 11 pages.
[16]
Stephanie Hackett, Bambang Parmanto, and Xiaoming Zeng. 2004. Accessibility of Internet Websites Through Time. In Proceedings of the 6th International ACM SIGACCESS Conference on Computers and Accessibility(Assets '04). ACM, New York, NY, USA, 32-39.
[17]
Xiaodong He and Li Deng. 2017. Deep Learning for Image-to-Text Generation: A Technical Overview. IEEE Signal Processing Magazine 34, 6 (nov 2017), 109-116.
[18]
Instagram. 2018. Creating a More Accessible Instagram. https://instagram-press.com/blog/2018/11/28/creating-a-more-accessible-instagram/
[19]
@JohnMu. 2018. Alt text is extremely helpful for Google Images - if you want your images to rank there. Even if you use lazy-loading, you know which image will be loaded, so get that information in there as early as possible & test what it renders as.https://twitter.com/JohnMu/status/1036901608880254976
[20]
Mary L McHugh. 2012. Interrater reliability: the kappa statistic. Biochemia medica: Biochemia medica 22, 3 (2012), 276-282.
[21]
Microsoft. 2017. Seeing AI | Talking camera app for those with a visual impairment. https://www.microsoft.com/en-us/seeing-ai/
[22]
Microsoft. 2018. Add alternative text to a shape, picture, chart, SmartArt graphic, or other object. https://support.office.com/en-us/article/add-alternative-text-to-a-shape-picture-chart-smartart-graphic-or-other-object-44989b2a-903c-4d9a-b742-6a75b451c669
[23]
Valerie S. Morash, Yue-Ting Siu, Joshua A. Miele, Lucia Hasty, and Steven Landau. 2015. Guiding Novice Web Workers in Making Image Descriptions Using Templates. ACM Trans. Access. Comput. 7, 4, Article 12 (Nov. 2015), 21 pages.
[24]
Meredith Ringel Morris, Annuska Zolyomi, Catherine Yao, Sina Bahram, Jeffrey P. Bigham, and Shaun K. Kane. 2016. ”With most of it being pictures now, I rarely use it”. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16. 5506-5516.
[25]
Elliot Salisbury, Ece Kamar, and Meredith Ringel Morris. 2017. Toward Scalable Social Alt Text: Conversational Crowdsourcing as a Tool for Refining Vision-to-Language Technology for the Blind. Aaai Hcomp 17Hcomp(2017), 147-156. www.aaai.orghttps://www.microsoft.com/en-us/research/wp-content/uploads/2017/08/scalable_social_alttext.pdf
[26]
Hironobu Takagi, Shinya Kawanaka, Masatomo Kobayashi, Takashi Itoh, and Chieko Asakawa. 2008. Social Accessibility: Achieving Accessibility Through Collaborative Metadata Authoring. In Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility(Assets '08). ACM, New York, NY, USA, 193-200.
[27]
@todd. 2016. Accessible images for everyone. https://blog.twitter.com/official/en_us/a/2016/accessible-images-for-everyone.html
[28]
Andranik Tumasjan, Timm Oliver Sprenger, Philipp G Sandner, and Isabell M Welpe. 2010. Predicting elections with twitter: What 140 characters reveal about political sentiment.Icwsm 10, 1 (2010), 178-185.
[29]
Twitter. 2018. About your Twitter timeline. https://help.twitter.com/en/using-twitter/twitter-timeline
[30]
Twitter. 2018. How to make images accessible for people. https://help.twitter.com/en/using-twitter/picture-descriptions
[31]
Twitter. 2018. Post, retrieve and engage with Tweets. https://developer.twitter.com/en/docs/tweets/post-and-engage/api-reference/get-statuses-lookup.html
[32]
Twitter. 2018. Sample realtime Tweets. https://developer.twitter.com/en/docs/tweets/sample-realtime/guides/recovery-and-redundancy
[33]
Wikipedia contributors. 2018. List of most-followed Twitter accounts - Wikipedia, The Free Encyclopedia. https://en.wikipedia.org/w/index.php?title=List_of_most-followed_Twitter_accounts&oldid=866718146{Online; accessed 2-November-2018}.
[34]
Shaomei Wu and Lada A. Adamic. 2014. Visually impaired users on an online social network. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI '14. ACM Press, New York, New York, USA, 3133-3142.
[35]
Shaomei Wu, Jake M. Hofman, Winter A. Mason, and Duncan J. Watts. 2011. Who Says What to Whom on Twitter. In Proceedings of the 20th International Conference on World Wide Web(WWW '11). ACM, New York, NY, USA, 705-714.
[36]
Shaomei Wu, Jeffrey Wieland, Omid Farivar, and Julie Schiller. 2017. Automatic alt-text: Computer-generated image descriptions for blind users on a social network service. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 1180-1192.
[37]
Yuhang Zhao, Shaomei Wu, Lindsay Reynolds, and Shiri Azenkot. 2017. The Effect of Computer-Generated Descriptions on Photo-Sharing Experiences of People with Visual Impairments. Proc. ACM Hum.-Comput. Interact. 1, CSCW, Article 121 (Dec. 2017), 22 pages.

Cited By

View all
  • (2024)ImageExplorer Deployment: Understanding Text-Based and Touch-Based Image Exploration in the WildProceedings of the 21st International Web for All Conference10.1145/3677846.3677861(59-69)Online publication date: 13-May-2024
  • (2024)Musical Performances in Virtual Reality with Spatial and View-Dependent Audio Descriptions for Blind and Low-Vision UsersProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3688492(1-5)Online publication date: 27-Oct-2024
  • (2024)Context-Aware Image Descriptions for Web AccessibilityProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675658(1-17)Online publication date: 27-Oct-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
WWW '19: The World Wide Web Conference
May 2019
3620 pages
ISBN:9781450366748
DOI:10.1145/3308558
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

  • IW3C2: International World Wide Web Conference Committee

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 May 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Accessibility
  2. Alternative Text
  3. Blind
  4. Image Description
  5. Twitter

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

WWW '19
WWW '19: The Web Conference
May 13 - 17, 2019
CA, San Francisco, USA

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)629
  • Downloads (Last 6 weeks)109
Reflects downloads up to 19 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)ImageExplorer Deployment: Understanding Text-Based and Touch-Based Image Exploration in the WildProceedings of the 21st International Web for All Conference10.1145/3677846.3677861(59-69)Online publication date: 13-May-2024
  • (2024)Musical Performances in Virtual Reality with Spatial and View-Dependent Audio Descriptions for Blind and Low-Vision UsersProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3688492(1-5)Online publication date: 27-Oct-2024
  • (2024)Context-Aware Image Descriptions for Web AccessibilityProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675658(1-17)Online publication date: 27-Oct-2024
  • (2024)Towards Accessible Musical Performances in Virtual Reality: Designing a Conceptual Framework for Omnidirectional Audio DescriptionsProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675618(1-17)Online publication date: 27-Oct-2024
  • (2024)“Not Only Annoying but Dangerous”: devising an ecology of protections for photosensitive social media usersProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675610(1-14)Online publication date: 27-Oct-2024
  • (2024)WorldScribe: Towards Context-Aware Live Visual DescriptionsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676375(1-18)Online publication date: 13-Oct-2024
  • (2024)From Automation to User Empowerment: Investigating the Role of a Semi-automatic Tool in Social Media AccessibilityACM Transactions on Accessible Computing10.1145/364764317:3(1-25)Online publication date: 27-Sep-2024
  • (2024)Party Face Congratulations! Exploring Design Ideas to Help Sighted Users with Emoji Accessibility when Messaging with Screen Reader UsersProceedings of the ACM on Human-Computer Interaction10.1145/36410148:CSCW1(1-31)Online publication date: 26-Apr-2024
  • (2024)FigurA11y: AI Assistance for Writing Scientific Alt TextProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645212(886-906)Online publication date: 18-Mar-2024
  • (2024)Pic2Tac: Creating Accessible Tactile Images using Semantic Information from PhotographsProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633377(1-12)Online publication date: 11-Feb-2024
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media