research-article

Effect of Potential Issues Flagged by Automated Tools on Web Accessibility Evaluation Results: A Case Study on University Department Websites

Authors:

Georgios Akritidis,

Christos KatsanosAuthors Info & Claims

PCI '21: Proceedings of the 25th Pan-Hellenic Conference on Informatics

Pages 113 - 117

https://doi.org/10.1145/3503823.3503845

Published: 22 February 2022 Publication History

Abstract

Web accessibility expresses the ease with which one can interact with a website effectively, regardless of disabilities and devices used. Despite the availability of relevant guidelines and technologies, many websites remain inaccessible. This may be due to the amount of manual effort required to ensure that a website conforms to web accessibility guidelines, such as the Web Content Accessibility Guidelines (WCAG). Software tools have been proposed to facilitate the process. However, these tools report many potential accessibility issues that require human judgment, and thus substantial manual resources. This paper investigates the effect of such potential issues reported by automated tools on web accessibility evaluation results. To this end, 441 university department websites were evaluated against WCAG 2 using the Siteimprove Accessibility Checker. Results found a significant effect of the manual inspection of potential issues on the accessibility results obtained. Regression analysis was used to predict the number of the semi-automatically identified accessibility issues based on the automatically identified ones.

References

[1]

Yakup Akgül. 2021. Accessibility, usability, quality performance, and readability evaluation of university websites of Turkey: a comparative study of state and private universities. Universal Access in the Information Society 20 (1), 157–170.

Digital Library

[2]

Hend S. Al-Khalifa. 2012. The accessibility of Saudi Arabia government Web sites: an exploratory study. Universal Access in the Information Society 11 (2), 201–210.

Digital Library

[3]

Muhammad Bakhsh and Amjad Mehmood. 2012. Web accessibility for disabled: a case study of government websites in Pakistan. In 2012 10th International Conference on Frontiers of Information Technology, 342–347.

Digital Library

[4]

Mrinal Kanti Baowaly and Moniruzzaman Bhuiyan. 2012. Accessibility analysis and evaluation of Bangladesh government websites. In 2012 International Conference on Informatics, Electronics Vision (ICIEV), 46–51.

[5]

Tim Berners-Lee. 1997. W3C leads program to make the Web accessible for people with disabilities (Press release). Retrieved from http://www.w3.org/Press/WAI-Launch.html

[6]

Milton Campoverde-Molina, Sergio Luján-Mora, and Llorenç Valverde. 2021. Accessibility of university websites worldwide: a systematic literature review. Universal Access in the Information Society.

[7]

Andy P Field. 2013. Discovering statistics using IBM SPSS statistics (4th ed.). SAGE, London.

Digital Library

[8]

Orazio Gambino, Roberto Pirrone, and Fabrizio Di Giorgio. 2016. Accessibility of the Italian institutional web pages: a survey on the compliance of the Italian public administration web pages to the Stanca Act and its 22 technical requirements for web accessibility. Universal Access in the Information Society 15 (2), 305–312.

Digital Library

[9]

Shawn Lawton Henry, Shadi Abou-Zahra, and Judy Brewer. 2014. The role of accessibility in a universal web. In Proceedings of the 11th Web for All Conference (W4A ’14), Association for Computing Machinery, New York, NY, USA, 1–4.

Digital Library

[10]

W3C Web Accessibility Initiative (WAI). Web Content Accessibility Guidelines (WCAG) overview. Web Accessibility Initiative (WAI). Retrieved from https://www.w3.org/WAI/standards-guidelines/wcag/

[11]

Wan Abdul Rahim Wan Mohd Isa, Maslina Abdul Aziz, and Muhammad Raimi Bin Abdul Razak. 2011. Evaluating the accessibility of Small and Medium Enterprise (SME) websites in Malaysia. In 2011 International Conference on User Science and Engineering, 135–140.

[12]

Christos Katsanos, Athanasios Tsakoumis, and Nikolaos Avouris. 2009. Web accessibility: Design of an educational system to support guidelines learning. In Proceedings of PCI 2009, Corfu, Greece, 155–164.

[13]

Christos Katsanos, Nikolaos Tselios, Athanasios Tsakoumis, and Nikolaos Avouris. 2012. Learning about web accessibility: A project based tool-mediated approach. Education and Information Technologies 17 (1), 79–94.

Digital Library

[14]

Hila Laufer Nir and Arie Rimmerman. 2018. Evaluation of Web content accessibility in an Israeli institution of higher education. Universal Access in the Information Society 17 (3), 663–673.

Digital Library

[15]

Carlos Máñez-Carvajal, Jose Francisco Cervera-Mérida, and Rocío Fernández-Piqueras. 2021. Web accessibility evaluation of top-ranking university Web sites in Spain, Chile and Mexico. Universal Access in the Information Society 20 (1), 179–184.

Digital Library

[16]

Subhajit Panda and Rupak Chakravarty. 2020. Evaluating the web accessibility of IIT libraries: a study of Web Content Accessibility Guidelines. Performance Measurement and Metrics 21 (3), 121–145.

[17]

Helen Petrie, Andreas Savva, and Christopher Power. 2015. Towards a unified definition of web accessibility. In Proceedings of the 12th International Web for All Conference (W4A ’15), Association for Computing Machinery, New York, NY, USA, 1–13.

Digital Library

[18]

Silas Formunyuy Verkijika and Lizette De Wet. 2020. Accessibility of South African university websites. Universal Access in the Information Society 19 (1), 201–210.

[19]

W3C. 1999. Web Content Accessibility Guidelines 1.0. Retrieved from http://www.w3.org/TR/WCAG10/

[20]

W3C. 2008. Web content accessibility guidelines 2.0. Retrieved from http://www.w3.org/TR/2008/REC-WCAG20-20081211/

[21]

W3C. 2018. Web Content Accessibility Guidelines (WCAG) 2.1. Retrieved from https://www.w3.org/TR/WCAG21/

Cited By

Chatziemmanouil TKatsanos C(2024)Accessibility Academy: Interactive Learning of the WCAG 2.1 Web Accessibility Guidelines2024 IEEE Global Engineering Education Conference (EDUCON)10.1109/EDUCON60312.2024.10578915(1-7)Online publication date: 8-May-2024
https://doi.org/10.1109/EDUCON60312.2024.10578915
Hadadi SSarsenbayeva ZKay J(2023)Starting well on design for accessibility: analysis of W3C's 167 accessibility evaluation tools for the design phaseProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3614474(1-7)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3614474

Index Terms

Effect of Potential Issues Flagged by Automated Tools on Web Accessibility Evaluation Results: A Case Study on University Department Websites

Index terms have been assigned to the content through auto-classification.

Recommendations

Web Accessibility Evaluation Tools: A Survey and Some Improvements

Web Content Accessibility Guidelines (WCAG) from W3C consist of a set of 65 checkpoints or specifications that Web pages should accomplish in order to be accessible to people with disabilities or using alternative browsers. Many of these 65 checkpoints ...
Evaluation of the web accessibility of university web portal: Case Study: Universidad Tecnica Particular de Loja
ICETC '17: Proceedings of the 9th International Conference on Education Technology and Computers

Promoting accessibility allows that everyone can access a service, regardless of their cognitive, physical or technical abilities. Then, it is important to make a site accessible for everyone, especially the public and private intuitions should consider ...
Automated Evaluation Tools for Web and Mobile Accessibility: proposal of a new adaptive interface tool
Abstract
This work focuses on the issues encountered when using current evaluation tools to assess the accessibility and usability of web and mobile applications. Therefore, we present a case study, where we tested three accessibility assessment tools ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

PCI '21: Proceedings of the 25th Pan-Hellenic Conference on Informatics

November 2021

499 pages

ISBN:9781450395557

DOI:10.1145/3503823

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 February 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

PCI 2021

PCI 2021: 25th Pan-Hellenic Conference on Informatics

November 26 - 28, 2021

Volos, Greece

Acceptance Rates

Overall Acceptance Rate 190 of 390 submissions, 49%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
95
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)2

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chatziemmanouil TKatsanos C(2024)Accessibility Academy: Interactive Learning of the WCAG 2.1 Web Accessibility Guidelines2024 IEEE Global Engineering Education Conference (EDUCON)10.1109/EDUCON60312.2024.10578915(1-7)Online publication date: 8-May-2024
https://doi.org/10.1109/EDUCON60312.2024.10578915
Hadadi SSarsenbayeva ZKay J(2023)Starting well on design for accessibility: analysis of W3C's 167 accessibility evaluation tools for the design phaseProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3614474(1-7)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3614474

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents