research-article

Using acceptance tests to validate accessibility requirements in RIA

Authors:

Willian Massami Watanabe,

Renata P. M. Fortes,

Ana Luiza DiasAuthors Info & Claims

W4A '12: Proceedings of the International Cross-Disciplinary Conference on Web Accessibility

Article No.: 15, Pages 1 - 10

https://doi.org/10.1145/2207016.2207022

Published: 16 April 2012 Publication History

Abstract

Accessibility stands as a quality requirement for Web applications. However, current accessibility automatic evaluation tools are not capable of evaluating DOM dynamic generated content that characterizes Ajax applications and RIAs - Rich Internet Applications. In this context, this paper describes an approach for testing accessibility requirements in RIA, by using acceptance tests. The authors had implemented a set of assistive technology user scenarios in the acceptance tests, in order to guarantee keyboard accessibility in web applications. As the scenarios were implemented as acceptance tests scenarios, they provide accessibility analysis over all layers of the software, from server-side to client-side implementations (JavaScript and dynamically generated DOM elements) in RIA. The test scenarios are automatically executed, and by doing so, fit the Continuous Integration process of constant delivery of new functionalities in Web projects.

References

[1]

IEEE standard for software verification and validation plans. Technical report, 1986.

[2]

B. C. Araújo, A. C. Rocha, A. Xavier, A. I. Muniz, and F. P. Garcia. Web-based tool for automatic acceptance test execution and scripting for programmers and customers. In Proceedings of the 2007 Euro American conference on Telematics and information systems, EATIS '07, pages 56:1--56:4, New York, NY, USA, 2007. ACM.

Digital Library

[3]

K. Beck. Test-driven development: by example. Addison-Wesley, Boston, 2003.

Digital Library

[4]

Y. Borodin, J. P. Bigham, G. Dausch, and I. V. Ramakrishnan. More than meets the eye: a survey of screen-reader browsing strategies. In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A), W4A '10, pages 13:1--13:10, New York, NY, USA, 2010. ACM.

Digital Library

[5]

G. Brajnik. Beyond conformance: The role of accessibility evaluation methods. In Web Information Systems Engineering - WISE 2008 Workshops, volume 5176 of Lecture Notes in Computer Science, pages 63--80. Springer Berlin/Heidelberg, 2008.

Digital Library

[6]

G. Brajnik, Y. Yesilada, and S. Harper. Testability and validity of wcag 2.0: the expertise effect. In Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility, volume 1 of ASSETS '10, pages 43--50, New York, NY, USA, 2010. ACM.

Digital Library

[7]

S. Bratt. Breaking barriers to a read/write web that empowers all. In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A), W4A '10, pages 1:1--1:1, New York, NY, USA, 2010. ACM.

Digital Library

[8]

F. Cannizzo, R. Clutton, and R. Ramesh. Pushing the boundaries of testing and continuous integration. In Proceedings of the Agile 2008, pages 501--505, Washington, DC, USA, 2008. IEEE Computer Society.

Digital Library

[9]

M. Cooper. Accessibility of emerging rich web technologies: web 2.0 and the semantic web. In Proceedings of the 2007 international cross-disciplinary conference on Web accessibility (W4A), W4A '07, pages 93--98, New York, NY, USA, 2007. ACM.

Digital Library

[10]

M. Fowler and M. Foemmel. Continuous integration, http://www.martinfowler.com/articles/-continuousIntegration.html, 2005.

[11]

A. P. Freire, R. P. M. Fortes, M. A. S. Turine, and D. M. B. Paiva. An evaluation of web accessibility metrics based on their attributes. In SIGDOC '08: Proceedings of the 26th annual ACM international conference on Design of communication, pages 73--80, New York, NY, USA, 2008. ACM.

Digital Library

[12]

A. P. Freire, R. Goularte, and R. P. M. Fortes. Techniques for developing more accessible web applications: a survey towards a process classification. In SIGDOC '07: Proceedings of the 25th annual ACM international conference on Design of communication, pages 162--169, New York, NY, USA, 2007. ACM.

Digital Library

[13]

A. P. Freire, C. M. Russo, and R. P. M. Fortes. A survey on the accessibility awareness of people involved in web development projects in brazil. In W4A '08: Proceedings of the 2008 international cross-disciplinary conference on Web accessibility (W4A), pages 87--96, New York, NY, USA, 2008. ACM.

Digital Library

[14]

J. Gehtland, D. Almaer, and B. Galbraith. Pragmatic Ajax: A Web 2.0 Primer. Pragmatic Bookshelf, 2006.

Digital Library

[15]

B. Gibson. Enabling an accessible web 2.0. In Proceedings of the 2007 international cross-disciplinary conference on Web accessibility (W4A), W4A '07, pages 1--6, New York, NY, USA, 2007. ACM.

Digital Library

[16]

P. Hsia, J. Gao, J. Samuel, D. Kung, Y. Toyoshima, and C. Chen. Behavior-based acceptance testing of software systems: a formal scenario approach. In Computer Software and Applications Conference, 1994. COMPSAC 94. Proceedings., Eighteenth Annual International, pages 293--298, nov 1994.

[17]

B. Kelly, D. Sloan, S. Brown, J. Seale, H. Petrie, P. Lauke, and S. Ball. Accessibility 2.0: people, policies and processes. In W4A '07: Proceedings of the 2007 international cross-disciplinary conference on Web accessibility (W4A), pages 138--147, New York, NY, USA, 2007. ACM.

Digital Library

[18]

B. Kelly, D. Sloan, L. Phipps, H. Petrie, and F. Hamilton. Forcing standardization or accommodating diversity?: a framework for applying the wcag in the real world. In W4A '05: Proceedings of the 2005 International Cross-Disciplinary Workshop on Web Accessibility (W4A), pages 46--54, New York, NY, USA, 2005. ACM.

Digital Library

[19]

H. K. N. Leung and P. W. L. Wong. A study of user acceptance tests. Software Quality Control, 6:137--149, October 1997.

Digital Library

[20]

F. Matheson. Designing for a moving target. In Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles, volume 1 of NordiCHI '06, pages 495--496, New York, NY, USA, 2006. ACM.

Digital Library

[21]

M. Naftali, W. Watanabe, and D. Sloan. W4a 2010: a web accessibility conference report from the google w4a student award winners. SIGWEB Newsl., pages 1:1--1:5, September 2010.

Digital Library

[22]

J. Nielsen and R. L. Mack, editors. Usability inspection methods. John Wiley & Sons, Inc., New York, NY, USA, 1994.

Digital Library

[23]

L. G. Reid and A. Snow-Weaver. Wcag 2.0: a web accessibility standard for the evolving web. In W4A '08: Proceedings of the 2008 international cross-disciplinary conference on Web accessibility (W4A), pages 109--115, New York, NY, USA, 2008. ACM.

Digital Library

[24]

P. Thiessen and S. Hockema. Wai-aria live regions: ebuddy im as a case example. In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A), W4A '10, pages 33:1--33:9, New York, NY, USA, 2010. ACM.

Digital Library

[25]

J. M. Umbach. Web 2.0 - the new commons. Feliciter. Canadian Library Association. HighBeam Research., January 2006.

[26]

C. A. Velasco, D. Denev, D. Stegemann, and Y. Mohamad. A web compliance engineering framework to support the development of accessible rich internet applications. In W4A '08: Proceedings of the 2008 international cross-disciplinary conference on Web accessibility (W4A), pages 45--49, New York, NY, USA, 2008. ACM.

Digital Library

[27]

M. Vigo, M. Arrue, G. Brajnik, R. Lomuscio, and J. Abascal. Quantitative metrics for measuring web accessibility. In W4A '07: Proceedings of the 2007 international cross-disciplinary conference on Web accessibility (W4A), pages 99--107, New York, NY, USA, 2007. ACM.

Digital Library

[28]

W3C. Web content accessibility guidelines 1.0. W3C Recommendation, May 1999.

[29]

W3C. Web content accessibility guidelines (wcag) 2.0. W3C Recommendation, December 2008.

[30]

W3C. Wai-aria 1.0 authoring practices - an author's guide to understanding and implementing accessible rich internet applications. W3C Working Draft, September 2010.

[31]

W3C. Accessible rich internet applications - (wai-aria) version 1.0. W3C Candidate Recommendation, January 2011.

[32]

T. Watanabe. Experimental evaluation of usability and accessibility of heading elements. In W4A '07: Proceedings of the 2007 international cross-disciplinary conference on Web accessibility (W4A), pages 157--164, New York, NY, USA, 2007. ACM.

Digital Library

[33]

W. M. Watanabe, D. F. Neto, T. J. Bittar, and R. P. M. Fortes. Wcag conformance approach based on model-driven development and webml. In Proceedings of the 28th ACM International Conference on Design of Communication, SIGDOC '10, pages 167--174, New York, NY, USA, 2010. ACM.

Digital Library

Cited By

Chiou PWinn RAlotaibi AHalfond WRoychoudhury APaiva AAbreu RStorey M(2024)Automatically Detecting Reflow Accessibility Issues in Responsive Web PagesProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3639229(1-13)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3597503.3639229
Chiou PAlotaibi AHalfond W(2023)BAGEL: An Approach to Automatically Detect Navigation-Based Web Accessibility Barriers for Keyboard UsersProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580749(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580749
Chiou PAlotaibi AHalfond WGrundy JPollock LPenta M(2023)Detecting Dialog-Related Keyboard Navigation Failures in Web ApplicationsProceedings of the 45th International Conference on Software Engineering10.1109/ICSE48619.2023.00120(1368-1380)Online publication date: 14-May-2023
https://dl.acm.org/doi/10.1109/ICSE48619.2023.00120
Show More Cited By

Index Terms

Using acceptance tests to validate accessibility requirements in RIA

Recommendations

Acceptance tests for validating ARIA requirements in widgets
Abstract
Accessibility refers to a quality requirement for web applications. However, current accessibility automatic evaluation tools cannot evaluate dynamic generated content that characterizes Ajax applications and RIAs. In this context, this paper ...
Essential components of mobile web accessibility
W4A '13: Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility

The Web Accessibility Initiative (WAI) of the World Wide Web Consortium (W3C) develops strategies, guidelines, and resources to make the Web accessible to people with disabilities. This includes ensuring that core web technologies such as HTML and CSS ...
User tests demonstration: real experiences in measuring web accessibility needs for people with disabilities and the elderly
W4A '09: Proceedings of the 2009 International Cross-Disciplinary Conference on Web Accessibililty (W4A)

A practical user test session with people with disabilities and the elderly is presented. The background and expert knowledge on web accessibility evaluation of ONCE Foundation, CIDAT and Technosite will be used to carry out a demonstrative workshop on ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

W4A '12: Proceedings of the International Cross-Disciplinary Conference on Web Accessibility

April 2012

189 pages

ISBN:9781450310192

DOI:10.1145/2207016

General Chairs:
Markel Vigo
University of Manchester, UK
,
Julio Abascal
University of the Basque Country, Spain
,
Program Chairs:
Rui Lopes
Google
,
Paola Salomoni
University of Bologna, Italy

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Google Inc.
Interaction-Design.org: Interaction-Design.org
Microsoft: Microsoft
Zakon Group
IW3C2: International World Wide Web Conference Committee

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 April 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Fundação de Amparo à Pesquisa do Estado de São Paulo

Conference

W4A '12

Sponsor:

Interaction-Design.org
Microsoft
IW3C2

W4A '12: International Cross-Disciplinary Conference on Web Accessibility

April 16 - 17, 2012

Lyon, France

Acceptance Rates

Overall Acceptance Rate 171 of 371 submissions, 46%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

38
Total Citations
View Citations
492
Total Downloads

Downloads (Last 12 months)25
Downloads (Last 6 weeks)3

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chiou PWinn RAlotaibi AHalfond WRoychoudhury APaiva AAbreu RStorey M(2024)Automatically Detecting Reflow Accessibility Issues in Responsive Web PagesProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3639229(1-13)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3597503.3639229
Chiou PAlotaibi AHalfond W(2023)BAGEL: An Approach to Automatically Detect Navigation-Based Web Accessibility Barriers for Keyboard UsersProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580749(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580749
Chiou PAlotaibi AHalfond WGrundy JPollock LPenta M(2023)Detecting Dialog-Related Keyboard Navigation Failures in Web ApplicationsProceedings of the 45th International Conference on Software Engineering10.1109/ICSE48619.2023.00120(1368-1380)Online publication date: 14-May-2023
https://dl.acm.org/doi/10.1109/ICSE48619.2023.00120
Okafor OAljedaani WLudi S(2022)Comparative Analysis of Accessibility Testing Tools and Their Limitations in RIAsHCI International 2022 – Late Breaking Papers: HCI for Health, Well-being, Universal Access and Healthy Aging10.1007/978-3-031-17902-0_34(479-500)Online publication date: 16-Oct-2022
https://doi.org/10.1007/978-3-031-17902-0_34
Staron M(2022)Introduction to the Metrics ThemeAccelerating Digital Transformation10.1007/978-3-031-10873-0_9(155-161)Online publication date: 20-Oct-2022
https://doi.org/10.1007/978-3-031-10873-0_9
Jongeling RCiccozzi FCicchetti ACarlson J(2022)Chapter 6 Lightweight Consistency Checking for Agile Model-Based Development in PracticeAccelerating Digital Transformation10.1007/978-3-031-10873-0_8(131-151)Online publication date: 20-Oct-2022
https://doi.org/10.1007/978-3-031-10873-0_8
Berger CEklund U(2022)Chapter 5 Expectations and Challenges from Scaling Agile in Mechatronics-Driven Companies – A Comparative Case StudyAccelerating Digital Transformation10.1007/978-3-031-10873-0_7(119-130)Online publication date: 20-Oct-2022
https://doi.org/10.1007/978-3-031-10873-0_7
Martini ABesker TBosch J(2022)Chapter 4 Technical Debt Tracking: Current State of Practice: A Survey and Multiple Case Study in 15 Large OrganizationsAccelerating Digital Transformation10.1007/978-3-031-10873-0_6(87-118)Online publication date: 20-Oct-2022
https://doi.org/10.1007/978-3-031-10873-0_6
Berger CCarlson J(2022)Introduction to the Continuous Architecture ThemeAccelerating Digital Transformation10.1007/978-3-031-10873-0_5(85-86)Online publication date: 20-Oct-2022
https://doi.org/10.1007/978-3-031-10873-0_5
Mårtensson TStåhl DMartini ABosch J(2022)Chapter 3 Efficient and Effective Exploratory Testing of Large-Scale Software SystemsAccelerating Digital Transformation10.1007/978-3-031-10873-0_4(51-81)Online publication date: 20-Oct-2022
https://doi.org/10.1007/978-3-031-10873-0_4
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents