Abstract
Landmarks are defined in the ARIA—Accessible Rich Internet Applications specification, and are important regions of web applications that blind users access through keyboard shortcuts. However, ARIA landmarks are not always included in web applications, given developer’s lack of knowledge of accessibility guidelines and specifications. The primary goal of this study was to investigate the efficacy in using supervised machine learning for identifying ARIA landmarks in web applications. In this paper, we present an approach for identifying landmarks based on classification of elements in web applications. Our approach uses a classification model with features extracted from the structure of web applications. Then, we cluster elements of the web application based on their landmarks class probability, position and size in the web application, reporting only the element with the highest probability as a landmark for each cluster. Our goal was to use landmarks correctly implemented in web applications to fit a classifier and then use this classifier to identify landmarks in web applications which did not implement them. Our evaluation reported different accuracy results for each landmark, identifying multiple landmarks in web applications with precision values higher than 0.75 to the landmarks: banner, contentinfo, navigation, region and search. The conducted evaluation showed the potential of the proposed approach in the identification of specific types of landmarks and quantifies the amount of elements that could be automatically identified and adapted, enhancing the accessibility of web applications. Furthermore, the results set a baseline accuracy for future studies in the area.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability
To favor the replicability of this methodology, the data of the web applications and all the steps necessary for generating the LEARNING and TEST DATASET, model evaluation, landmarks prediction, clustering and report generation were made available in an open-source project https://github.com/watinha/aria-landmarks-identification [38].
Notes
References
International Organization for Standardization: ISO/IEC 25010: Systems and software engineering-systems and Software Quality Requirements and Evaluation (SQuaRE). System and software quality models Geneva (2011)
W3C: Web Content Accessibility Guidelines (WCAG) 2.1. W3C Recommendation (2018). https://www.w3.org/TR/WCAG21/
W3C: Accessible Rich Internet Applications (WAI-ARIA) 1.1. W3C Recommendation (2017). http://www.w3.org/TR/wai-aria/
Agrawal, G., Kumar, D., Singh, M., Dani, D.: Evaluating accessibility and usability of airline websites. In: Singh, M., Gupta, P.K., Tyagi, V., Flusser, J., Ören, T., Kashyap, R. (eds.) Advances in Computing and Data Sciences, pp. 392–402. Springer, Singapore (2019)
Teixeira, P., Eusébio, C., Teixeira, L.: Website accessibility in the hospitality industry: a study in the central region of Portugal. Int. J. Tour. Policy 11(3), 222–246 (2021). https://doi.org/10.1504/IJTP.2021.118666
Máñez-Carvajal, C., Cervera-Mérida, J.F., Fernández-Piqueras, R.: Web accessibility evaluation of top-ranking university web sites in Spain, Chile and Mexico. Univers. Access Inf. Soc. 20(1), 179–184 (2021). https://doi.org/10.1007/s10209-019-00702-w
Alajarmeh, N.: Evaluating the accessibility of public health websites: an exploratory cross-country study. Univers. Access Inf. Soc. 21(3), 771–789 (2022). https://doi.org/10.1007/s10209-020-00788-7
Macakoğlu, ŞS., Peker, S.: Accessibility evaluation of university hospital websites in turkey. Univers. Access Inf. Soc. (2022). https://doi.org/10.1007/s10209-022-00886-8
Mohammadi, M.K., Esichaikul, V., Mohammadi, A.: Accessibility and usability evaluation of university websites in afghanistan: a comparison between public and private universities. Univers. Access Inf. Soc. (2022). https://doi.org/10.1007/s10209-022-00896-6
Antonelli, H.L., Rodrigues, S.S., Watanabe, W.M., de Mattos Fortes, R.P.: A survey on accessibility awareness of brazilian web developers. In: Proceedings of the 8th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-Exclusion. DSAI 2018, pp. 71–79. Association for Computing Machinery, New York, NY, USA (2018). https://doi.org/10.1145/3218585.3218598
Leite, M.V.R., Scatalon, L.P., Freire, A.P., Eler, M.M.: Accessibility in the mobile development industry in Brazil: awareness, knowledge, adoption, motivations and barriers. J. Syst. Softw. 177, 110942 (2021). https://doi.org/10.1016/j.jss.2021.110942
Hanson, V.L., Richards, J.T.: Progress on website accessibility? ACM Trans. Web 7(1), 2–1230 (2013). https://doi.org/10.1145/2435215.2435217
Bi, T., Xia, X., Lo, D., Grundy, J., Zimmermann, T., Ford, D.: Accessibility in software practice: a practitioner’s perspective. ACM Trans. Softw. Eng. Methodol. (2022). https://doi.org/10.1145/3503508
Watanabe, W.M., de Lemos, G., Antonelli, H.L., de Mattos Fortes, R.P., Silva, G.C.: Code complexity impact of widgets accessibility implementation in javascript open-source libraries. In: Proceedings of the Brazilian Symposium on Multimedia and the Web. WebMedia ’21, pp. 9–16. Association for Computing Machinery, New York, NY, USA (2021). https://doi.org/10.1145/3470482.3479613
W3C: WAI-ARIA Authoring Practices 1.1. W3C Group Note (2022). https://www.w3.org/TR/wai-aria-practices-1.1
WHATWG: HTML. WHATWG Living Standard (2022). https://html.spec.whatwg.org/multipage/
WHATWG: DOM. WHATWG Living Standard (2022). https://dom.spec.whatwg.org/
WebAIM—Web Accessibility in Mind: Screen Reader User Survey #9 Results. WebAIM (2021). https://webaim.org/projects/screenreadersurvey9/
Watanabe, W.M., Geraldo, R.J., Fortes, R.P.d.M.: Keyboard navigation mechanisms in tab widgets: An investigation on ARIA’s conformance. In: Proceedings of the 29th Annual ACM Symposium on Applied Computing. SAC ’14, 721–726. ACM, New York, NY, USA (2014). https://doi.org/10.1145/2554850.2554947
Watanabe, W.M., Geraldo, R.J., De Mattos Fortes, R.P.: Keyboard navigation mechanisms in widgets: An investigation on aria’s implementations. J. Web Eng. 14(1–2), 41–62 (2015). https://doi.org/10.5555/2871254.2871258
Watanabe, W.M., Dias, A.L., Fortes, R.P.D.M.: Fona: quantitative metric to measure focus navigation on rich internet applications. ACM Trans. Web 9(4), 20–12028 (2015). https://doi.org/10.1145/2812812
Watanabe, W.M., Fortes, R.P., Dias, A.L.: Acceptance tests for validating aria requirements in widgets. Univers. Access Inf. Soc. 16(1), 3–27 (2017). https://doi.org/10.1007/s10209-015-0437-9
Chen, A., Harper, S., Lunn, D., Brown, A.: Widget identification: a high-level approach to accessibility. World Wide Web 16(1), 73–89 (2013). https://doi.org/10.1007/s11280-012-0156-6
Melnyk, V., Ashok, V., Puzis, Y., Soviak, A., Borodin, Y., Ramakrishnan, I.V.: Widget Classification with Applications to Web Accessibility, 341–358. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-08245-5_20
Antonelli, H.L., Igawa, R.A., Fortes, R.P.D.M., Rizo, E.H., Watanabe, W.M.: Drop-down menu widget identification using html structure changes classification. ACM Trans. Access. Comput. (2018). https://doi.org/10.1145/3178854
Rizo, E.H., de Mattos Fortes, R.P., Antonelli, H.L., Watanabe, W.M.: Automatic identification of widgets and their subcomponents based on a classification pipeline for dom mutation records. In: Proceedings of the 16th International Web for All Conference. W4A ’19. Association for Computing Machinery, New York, NY, USA (2019). https://doi.org/10.1145/3315002.3317555
Aydin, A.S., Feiz, S., Ashok, V., Ramakrishnan, I.: Sail: Saliency-driven injection of aria landmarks. In: Proceedings of the 25th International Conference on Intelligent User Interfaces. IUI ’20, 111–115. Association for Computing Machinery, New York, NY, USA (2020). https://doi.org/10.1145/3377325.3377540
Fernandes, N., Lopes, R., Carriço, L.: On web accessibility evaluation environments. In: Proceedings of the International Cross-Disciplinary Conference on Web Accessibility. W4A ’11, 4–1410. ACM, New York, NY, USA (2011). https://doi.org/10.1145/1969289.1969295
Silva, J.S.R., Freire, A.P., Cardoso, P.C.F.: When headers are not there: Design and user evaluation of an automatic topicalisation and labelling tool to aid the exploration of web documents by blind users. In: Proceedings of the 19th International Web for All Conference. W4A ’22. Association for Computing Machinery, New York, NY, USA (2022). https://doi.org/10.1145/3493612.3520470
Quinlan, J.R.: Induction of decision trees. Mach. Learn. 1(1), 81–106 (1986). https://doi.org/10.1023/A:1022643204877
Rokach, L., Maimon, O.: 9. Decision Trees, Springer, Boston, MA 165–192 (2005). https://doi.org/10.1007/0-387-25465-X_9
Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001). https://doi.org/10.1023/A:1010933404324
Liu, Y., Bi, J.-W., Fan, Z.-P.: A method for multi-class sentiment classification based on an improved one-vs-one (ovo) strategy and the support vector machine (svm) algorithm. Inf. Sci. 394–395(1), 38–52 (2017). https://doi.org/10.1016/j.ins.2017.02.016
Yin, S., Yin, J.: Tuning kernel parameters for SVM based on expected square distance ratio. Inf. Sci. 370–371(1), 92–102 (2016). https://doi.org/10.1016/j.ins.2016.07.047
Cover, T., Hart, P.: Nearest neighbor pattern classification. IEEE Trans. Inf. Theory 13(1), 21–27 (1967). https://doi.org/10.1109/TIT.1967.1053964
Powers, D.M.W.: Evaluation: from precision, recall and f-measure to roc, informedness, markedness and correlation. J. Mach. Learn. Technol. 2(1), 37–63 (2011). https://doi.org/10.48550/ARXIV.2010.16061
Kumar, V., Minz, S.: Feature selection: a literature review. Smart Comput. Rev. 4(3), 211–229 (2014). https://doi.org/10.6029/smartcr.2014.03.007
Watanabe, W.M.: watinha/aria-landmarks-identification: v1.0. Zenodo (2022). https://doi.org/10.5281/zenodo.6803930
Watanabe, W.M.: ARIA—Accessible Rich Internet Applications Landmarks classified dataset. Zenodo (2022). https://doi.org/10.5281/zenodo.6803921
Acknowledgements
We thank UTFPR, DACOM-CP and PPGI supporting this research.
Funding
The authors did not receive support from any organization for the submitted work.
Author information
Authors and Affiliations
Contributions
WMW performed the methodology, software and writing—original draft. RWN performed the conceptualization and validation. GdL performed the conceptualization.
Corresponding author
Ethics declarations
Conflict of interest
The authors have no competing interests to declare that are relevant to the content of this article.
Ethical approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Human and animal rights
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Watanabe, W.M., de Lemos, G. & Nascimento, R.W. Accessibility landmarks identification in web applications based on DOM elements classification. Univ Access Inf Soc 23, 765–777 (2024). https://doi.org/10.1007/s10209-022-00959-8
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10209-022-00959-8