Article

A Comparative Study of Accessibility and Usability of Norwegian University Websites for Screen Reader Users Based on User Experience and Automated Assessment

Authors:

Prabin Parajuli,

Evelyn EikaAuthors Info & Claims

Universal Access in Human-Computer Interaction. Design Approaches and Supporting Technologies: 14th International Conference, UAHCI 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, July 19–24, 2020, Proceedings, Part I

Pages 300 - 310

https://doi.org/10.1007/978-3-030-49282-3_21

Published: 19 July 2020 Publication History

Abstract

Websites are essential for learners’ access to information. However, due to the lack of accessibility and usability of websites, students with disabilities who solely rely on screen readers face challenges accessing webpage contents. This study explores accessibility and usability issues frequently encountered by screen reader students while interacting with Norwegian university webpages. An evaluation using automated tools showed that none of the university websites met the minimum WCAG 2.1 guidelines. Sixteen visually impaired participants were recruited and assigned five usability tasks on four different university websites. The results show that participants encountered usability and accessibility issues on all four websites. Recommendations for increased accessibility are proposed based on the findings.

References

[1]

Kuakiatwong, S., Whittier, D.: Evaluating web accessibility and usability for totally blind users at Thailand Cyber University. ProQuest Dissertations Publishing (2011)

[2]

Carmel T and Alan B The school website: facilitating communication engagement and learning Br. J. Edu. Technol. 2016 47 2 421-436

[3]

Sandnes, F., Jian, H., Hagen, S., Talberg, O.: Student evaluation of the learning management system fronter from an HCI perspective. In: International Conference on Engineering Education–ICEE (2007)

[4]

Steinfeld E and Maisel JD Universal Design: Creating Inclusive Environments 2012 Hoboken Wiley

[5]

W3C: Introduction to Web Accessibility (2019). https://www.w3.org/WAI/fundamentals/accessibility-intro/. Accessed 22 Apr 2019

[6]

Kamal IW, Alsmadi IM, Wahsheh HA, and Al-Kabi MN Evaluating web accessibility metrics for Jordanian Universities Int. J. Adv. Comput. Sci. Appl. 2016 7 7 113-122

[7]

W3C: Accessibility, Usability, and Inclusion: Related Aspects of a Web for All (2016). https://www.w3.org/WAI/intro/usable. Accessed May 2018

[8]

Sierkowski, B.: Achieving web accessibility. In: Proceedings of the 30th Annual ACM SIGUCCS Conference on User Services, pp. 288–291. ACM (2002)

[9]

Lazar J, Dudley-Sponaugle A, and Greenidge K-D Improving web accessibility: a study of webmaster perceptions Comput. Hum. Behav. 2004 20 2 269-288

[10]

ISO.: Ergonomics of human-system interaction - Part 11: Usability: Definitions and concepts (ISO 9241–11:2018) (2018)

[11]

Martyn C, Chetz C, and Anne J Embedding accessibility and usability: considerations for e-learning research and development projects Res. Learn. Technol. 2007 15 3 231-245

[12]

Sunil B, Ravi B, and Edna W Mapping product usability Int. J. Oper. Prod. Manag. 2002 22 10 1071-1089

[13]

Nielsen J Usability 101: Introduction to Usability 2003 Boca Raton CRC Press

[14]

W3C: Accessibility, Usability, and Inclusion (2016). https://www.w3.org/WAI/fundamentals/accessibility-usability-inclusion/. Accessed 15 May 2019

[15]

Kadayat, B.B., Eika, E.: Impact of sentence length on the readability of web for screen reader users. In: Antona, M., Stephanidis, C. (eds.) HCII 2020, LNCS, vol. 12188, pp. 261–271. Springer, Cham (2020)

[16]

Kurt S Accessibility of Turkish university Web sites Univ. Access Inf. Soc. 2017 16 2 505-515

Digital Library

[17]

Kurt S The accessibility of university web sites: the case of Turkish universities Univ. Access Inf. Soc. 2011 10 1 101-110

Digital Library

[18]

Lazar J, Allen A, Kleinman J, and Malarkey C What frustrates screen reader users on the web: a study of 100 blind users Int. J. Hum. Comput. Interact. 2007 22 3 247-269

[19]

Thompson T, Burgstahler S, and Moore EJ Web accessibility: a longitudinal study of college and university home pages in the northwestern United States Disabil. Rehabil. Assist. Technol. 2010 5 2 108-114

[20]

Kesswani N and Kumar S Accessibility analysis of websites of educational institutions Perspect. Sci. 2016 8 210-212

[21]

Masood Rana M, Fakrudeen M, and Rana U Evaluating web accessibility of university web sites in the Kingdom of Saudi Arabia Int. J. Technol. Knowl. Soc. 2011 7 3 15

[22]

Ismail A and Kuppusamy K Accessibility of Indian universities’ homepages: an exploratory study J. King Saud Univ. Comput. Inf. Sci. 2018 30 2 268-278

[23]

Harper KA and DeWaters J A quest for website accessibility in higher education institutions Internet Higher Educ. 2008 11 3–4 160-164

[24]

Menzi-Cetin N, Alemdağ E, Tüzün H, and Yıldız M Evaluation of a university website’s usability for visually impaired students Univ. Access Inf. Soc. 2017 16 1 151-160

Digital Library

[25]

Lazar J, Olalere A, and Wentz B Investigating the accessibility and usability of job application web sites for blind users J. Usabil. Stud. 2012 7 2 68-87

Digital Library

[26]

Eika, E., Sandnes, F.E.: Assessing the reading level of web texts for WCAG2.0 compliance—can it be done automatically? In: Di Bucchianico, G., Kercher, P. (eds.) Advances in Design for Inclusion, pp. 361–371. Springer, Cham (2016).

[27]

Eika E and Sandnes FE Antona M and Stephanidis C Authoring WCAG2.0-compliant texts for the web through text readability visualization Universal Access in Human-Computer Interaction. Methods, Techniques, and Best Practices 2016 Cham Springer 49-58

[28]

Eika E Universally designed text on the web: towards readability criteria based on anti-patterns Stud. Health Technol. Inform 2016 229 461-470

[29]

Lazar J and Greenidge K-D One year older, but not necessarily wiser: an evaluation of homepage accessibility problems over time Univ. Access Inf. Soc. 2006 4 4 285-291

Digital Library

[30]

Hackett S and Parmanto B Homepage not enough when evaluating web site accessibility Internet Res. 2009 19 1 78-87

[31]

WebAIM.: WAVE Web Accessibility Tool (2019). https://wave.webaim.org/. Accessed 05 Apr 2019

[32]

Total Validator: Total Validator (2019). https://www.totalvalidator.com/. Accessed 08 Apr 2019

[33]

Vigo, M., Brown, J., Conway, V.: Benchmarking web accessibility evaluation tools: measuring the harm of sole reliance on automated tests. In: Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility. ACM (2013)

[34]

W3C: Web Accessibility Evaluation Tool Lists (2006). https://www.w3.org/WAI/ER/tools/. Accessed 05 Apr 2019

[35]

W3C: Research Report on Web Accessibility Metrics (2012). https://www.w3.org/TR/accessibility-metrics-report/. Accessed 11 Apr 2019

[36]

W3C: Understanding Conformance|Understanding WCAG 2.0. https://www.w3.org/WAI/WCAG21/Understanding/conformance. Accessed 12 Apr 2019

[37]

Brooke J SUS-a quick and dirty usability scale Usabil. Eval. Ind. 1996 189 194 4-7

[38]

UIUX Trend: Measuring and Interpreting System Usability Scale (SUS) (2017). https://uiuxtrend.com/measuring-system-usability-scale-sus/. Accessed 7 Apr 2019

[39]

Sauro, J.: Measuring usability with the system usability scale (SUS) (2011). https://measuringu.com/sus/. Accessed 22 Nov 2018

[40]

W3C: Easy Checks - A First Review of Web Accessibility (2017). https://www.w3.org/WAI/test-evaluate/preliminary/. Accessed 24 Apr 2019

[41]

Ismailova R and Inal Y Accessibility evaluation of top university websites: a comparative study of Kyrgyzstan, Azerbaijan, Kazakhstan and Turkey Univ. Access Inf. Soc. 2018 17 2 437-445

Digital Library

[42]

Verkijika SF and De Wet L Accessibility of South African university websites Univ. Access Inf. Soc. 2018 19 1 201-210

[43]

Alahmadi T and Drew S Accessibility evaluation of top-ranking university websites in world, Oceania, and Arab categories for home, admission, and course description webpages J. Open Flex. Dist. Learn. 2017 21 1 7-24

[44]

Molinero AM and Frederick GK Reliability in automated evaluation tools for web accessibility standards compliance Issues Inf. Syst. 2006 7 2 218-222

[45]

Hasan L Evaluating the usability of educational websites based on students’ preferences of design characteristics Int. Arab J. e-Technol. 2014 3 3 179-193

[46]

Zhang, P., Dran, G.V., Blake, P., Pipithsuksunt, V.: A comparison of the most important website features in different domains: an empirical study of user perceptions. In: AMCIS 2000 Proceedings (2000)

[47]

Pearson JM, Pearson A, and Green D Determining the importance of key criteria in web usability Manag. Res. News 2007 30 11 816-828

[48]

Tanyeri U and Tüfekçi A Bir yükseköğretim uzaktan eğitim programının görme engellilerin kullanımı açısından değerlendirilmesi: GÜUEP örneği 2010 Turkey Antalya

[49]

Jard C, Jéron T, Tanguy L, and Viho C Wu J, Chanson ST, and Gao Q Remote testing can be as powerful as local testing Formal Methods for Protocol Engineering and Distributed Systems 1999 Boston Springer 25-40

Cited By

Sandnes FEika E(2023)A Visualization Bookmarklet for Assessing the Readability of Texts on the WebProceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3594806.3596526(237-238)Online publication date: 5-Jul-2023
https://dl.acm.org/doi/10.1145/3594806.3596526
Hulleberg OLandgraff Granum HGullberg Hansen SMoen MVicient Monllaó CInal Y(2023)The Awareness and Practices of Web Developers Toward Sustainable Web DesignDesign, User Experience, and Usability10.1007/978-3-031-35699-5_11(134-145)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-35699-5_11
Sarwar UEika E(2020)Towards More Efficient Screen Reader Web Access with Automatic Summary Generation and Text TaggingComputers Helping People with Special Needs10.1007/978-3-030-58796-3_36(303-313)Online publication date: 9-Sep-2020
https://dl.acm.org/doi/10.1007/978-3-030-58796-3_36

Recommendations

Accessibility, usability, quality performance, and readability evaluation of university websites of Turkey: a comparative study of state and private universities
Abstract
Today, the web constitutes an essential segment of higher education institutions. Using their websites, universities can effectively, efficiently, and satisfactorily provide information and services to their target groups, regardless of ...
An interface agent for non-visual, accessible web automation
UIST Adjunct Proceedings '12: Adjunct proceedings of the 25th annual ACM symposium on User interface software and technology

The Web is far less usable and accessible for the users with visual impairments than it is for the sighted people. Web automation has the potential to bridge the divide between the ways visually impaired people and sighted people access the Web, and ...
Groupware Accessibility for Persons with Disabilities
UAHCI '09: Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and Services

The accessibility issues of Groupware applications prevent visually impaired and other persons with disabilities access to these highly graphical interfaces. To address the accessibility issues persons with disabilities have with Groupware, a recent ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

Universal Access in Human-Computer Interaction. Design Approaches and Supporting Technologies: 14th International Conference, UAHCI 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, July 19–24, 2020, Proceedings, Part I

Jul 2020

533 pages

ISBN:978-3-030-49281-6

DOI:10.1007/978-3-030-49282-3

Editors:
Margherita Antona
Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece
,
Constantine Stephanidis
University of Crete and Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

© Springer Nature Switzerland AG 2020.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 19 July 2020

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sandnes FEika E(2023)A Visualization Bookmarklet for Assessing the Readability of Texts on the WebProceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3594806.3596526(237-238)Online publication date: 5-Jul-2023
https://dl.acm.org/doi/10.1145/3594806.3596526
Hulleberg OLandgraff Granum HGullberg Hansen SMoen MVicient Monllaó CInal Y(2023)The Awareness and Practices of Web Developers Toward Sustainable Web DesignDesign, User Experience, and Usability10.1007/978-3-031-35699-5_11(134-145)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-35699-5_11
Sarwar UEika E(2020)Towards More Efficient Screen Reader Web Access with Automatic Summary Generation and Text TaggingComputers Helping People with Special Needs10.1007/978-3-030-58796-3_36(303-313)Online publication date: 9-Sep-2020
https://dl.acm.org/doi/10.1007/978-3-030-58796-3_36

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents