Article

Quantitative metrics for measuring web accessibility

Authors:

Julio AbascalAuthors Info & Claims

W4A '07: Proceedings of the 2007 international cross-disciplinary conference on Web accessibility (W4A)

Pages 99 - 107

https://doi.org/10.1145/1243441.1243465

Published: 07 May 2007 Publication History

Get Access

Abstract

This paper raises the need for quantitative accessibility measurement and proposes three different application scenarios where quantitative accessibility metrics are useful: Quality Assurance within Web Engineering, Information Retrieval and accessibility monitoring. We propose a quantitative metric which is automatically calculated from reports of automatic evaluation tools. In order to prove the reliability of the metric, 15 websites (1363 web pages) are measured based on results yielded by 2 evaluation tools: EvalAccess and LIFT. Statistical analysis of results shows that the metric is dependent on the evaluation tool. However, Spearman's test produces high correlation between results of different tools. Therefore, we conclude that the metric is reliable for ranking purposes in Information Retrieval and accessibility monitoring scenarios and can also be partially applied in a Web Engineering scenario.

References

[1]

Abascal, J., Arrue, M., Fajardo, I., Garay, N., and Tomás, J. Use of Guidelines to automatically verify web accessibility. International Journal on Universal Access in the Information Society (UAIS) 3(1), 71--79, 2004, Springer.

Digital Library

Google Scholar

[2]

Arrue, M., Vigo, M., and Abascal, J. Quantitative Metrics for Web Accessibility Evaluation. In Proceedings of ICWE 2005 Workshop on Web Metrics and Measurement. University of Wollongong School of IT and Computer Science.

Google Scholar

[3]

Brajnik, G. Comparing accessibility evaluation tools: a method for tool effectiveness. Universal Access in the Information Society (UAIS) 3(3-4), 252-263, 2004, Springer.

Digital Library

Google Scholar

[4]

Bühler, C., Heck, H., Perlick, O., Nietzio, A., and Ullveit-Moe, N. Interpreting Results from Large Scale Automatic Evaluation of Web Accessibility. In K. Miesenberger et. al (Eds.). Computers Helping People with Special Needs 2006. Lecture Notes in Computer Science 4061. Springer, 184--191.

Digital Library

Google Scholar

[5]

Google Accessible Search. Available at http://labs.google.com/accessible/

Google Scholar

[6]

Hackett, S., Parmanto, B., and Zeng, X. Accessibility of Internet websites through time. In Proceedings of 6th International ACM SIGACCESS Conference on Computers and Accessibility 2004, pp. 32--39.

Digital Library

Google Scholar

[7]

Ivory, M., Yu, S., and Gronemyer, K. Search result exploration: a preliminary study of blind and sighted users' decision making and performance. CHI Extended Abstracts 2004, pp. 1453--1456.

Digital Library

Google Scholar

[8]

Mich, L., Franch, and M. Gaio, L. Evaluating and Designing the Quality of Web Sites. IEEE MultiMedia 10(1), 34--43, 2003.

Digital Library

Google Scholar

[9]

Olsina, L. and Rossi, G. Measuring Web Application Quality with WebQEM. IEEE Multimedia 9(4), 20--29, 2002.

Digital Library

Google Scholar

[10]

Snaprud, M. H., Ulltveit-Moe, N., Pillai, A. B., and Olsen M. G. A Proposed Architecture for Large Scale Web Accessibility Assessment. In K. Miesenberger et al. (Eds.). Computers Helping People with Special Needs 2006. Lecture Notes in Computer Science 4061, pp. 234--241, Springer.

Crossref

Google Scholar

[11]

Sullivan, T. and Matson, R. Barriers to use: usability and content accessibility on the Web's most popular sites. Proceedings of ACM Conference on Universal Usability 2000, pp. 139--144.

Digital Library

Google Scholar

Cited By

View all

Mowar PGupta MJain M(2024)Breaking the News Barrier: Towards Understanding News Consumption Practices among BVI Individuals in IndiaProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675608(1-11)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675608
Martins BDuarte C(2024)Large-scale study of web accessibility metricsUniversal Access in the Information Society10.1007/s10209-022-00956-x23:1(411-434)Online publication date: 1-Mar-2024
https://dl.acm.org/doi/10.1007/s10209-022-00956-x
Onay Durdu PSoydemir Ö(2022)A Systematic Review of Web Accessibility MetricsApp and Website Accessibility Developments and Compliance Strategies10.4018/978-1-7998-7848-3.ch004(77-108)Online publication date: 2022
https://doi.org/10.4018/978-1-7998-7848-3.ch004
Show More Cited By

Index Terms

Quantitative metrics for measuring web accessibility

Recommendations

An evaluation of web accessibility metrics based on their attributes
SIGDOC '08: Proceedings of the 26th annual ACM international conference on Design of communication

Accessibility is a concept related to providing access to Web content to people with different abilities and people using different devices. A number of metrics have been proposed in the last years to help to obtain quantitative Web accessibility ...
Automatic web accessibility metrics: Where we are and where we can go

The fact that several web accessibility metrics exist may be evidence of a lack of a comparison framework that highlights how well they work and for what purposes they are appropriate. In this paper we aim at formulating such a framework, demonstrating ...
Analysis and integration of web accessibility metrics
W4A '10: Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A)

"Analysis and Integration of Web Accessibility Metrics" was presented as a grade thesis. It included the development of "OceanAcc", an evaluation and analysis tool that performs a semi-automatic evaluation process. With little user intervention, can ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

W4A '07: Proceedings of the 2007 international cross-disciplinary conference on Web accessibility (W4A)

May 2007

179 pages

ISBN:1595935908

DOI:10.1145/1243441

Conference Chairs:
Simon Harper
University of Manchester, UK
,
Yeliz Yesilada
University of Manchester, UK

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Acceptance Rates

W4A '07 Paper Acceptance Rate 11 of 27 submissions, 41%;

Overall Acceptance Rate 171 of 371 submissions, 46%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

94
Total Citations
View Citations
1,988
Total Downloads

Downloads (Last 12 months)70
Downloads (Last 6 weeks)4

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Mowar PGupta MJain M(2024)Breaking the News Barrier: Towards Understanding News Consumption Practices among BVI Individuals in IndiaProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675608(1-11)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675608
Martins BDuarte C(2024)Large-scale study of web accessibility metricsUniversal Access in the Information Society10.1007/s10209-022-00956-x23:1(411-434)Online publication date: 1-Mar-2024
https://dl.acm.org/doi/10.1007/s10209-022-00956-x
Onay Durdu PSoydemir Ö(2022)A Systematic Review of Web Accessibility MetricsApp and Website Accessibility Developments and Compliance Strategies10.4018/978-1-7998-7848-3.ch004(77-108)Online publication date: 2022
https://doi.org/10.4018/978-1-7998-7848-3.ch004
Renaud KColes-Kemp L(2022)Accessible and Inclusive Cyber Security: A Nuanced and Complex ChallengeSN Computer Science10.1007/s42979-022-01239-13:5Online publication date: 22-Jun-2022
https://doi.org/10.1007/s42979-022-01239-1
Moreno LMartínez P(2021)Accessibility Compliance for E-Government WebsitesResearch Anthology on Digital Transformation, Organizational Change, and the Impact of Remote Work10.4018/978-1-7998-7297-9.ch019(354-373)Online publication date: 2021
https://doi.org/10.4018/978-1-7998-7297-9.ch019
Teixeira PEusébio CTeixeira L(2021)Diversity of Web accessibility in tourism: Evidence based on a literature reviewTechnology and Disability10.3233/TAD-21034133:4(253-272)Online publication date: 17-Nov-2021
https://doi.org/10.3233/TAD-210341
Casare ABasso TMoraes R(2021)User Experience and Trustworthiness Measurement: Challenges in the Context of e-Commerce ApplicationsProceedings of the Future Technologies Conference (FTC) 2021, Volume 110.1007/978-3-030-89906-6_13(173-192)Online publication date: 24-Oct-2021
https://doi.org/10.1007/978-3-030-89906-6_13
Pesantez-Cabrera PAcosta MJimbo VSinchi PCedillo P(2020)Towards an evaluation method of how accessible serious games are to older adults2020 IEEE 8th International Conference on Serious Games and Applications for Health (SeGAH)10.1109/SeGAH49190.2020.9201655(1-8)Online publication date: Aug-2020
https://doi.org/10.1109/SeGAH49190.2020.9201655
Moreno LMartínez P(2019)Accessibility Compliance for E-Government WebsitesInternational Journal of Electronic Government Research10.4018/IJEGR.201904010115:2(1-18)Online publication date: 1-Apr-2019
https://dl.acm.org/doi/10.4018/IJEGR.2019040101
Marco LAlonso ÁQuemada J(2019)An Identity Model for Providing Inclusive Services and ApplicationsApplied Sciences10.3390/app91838139:18(3813)Online publication date: 11-Sep-2019
https://doi.org/10.3390/app9183813
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

An evaluation of web accessibility metrics based on their attributes

Automatic web accessibility metrics: Where we are and where we can go

Analysis and integration of web accessibility metrics