research-article

Determining usability requirements into a call-for-tenders: a case study on the development of a healthcare system

Author:

Timo JokelaAuthors Info & Claims

NordiCHI '10: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries

Pages 256 - 265

https://doi.org/10.1145/1868914.1868946

Published: 16 October 2010 Publication History

Abstract

Systems of public organizations, the development of which is acquired through public tendering, often suffer from poor usability. To resolve this issue, we explored how to determine usability requirements into a call-for-tenders. Our case is a usability-critical healthcare system to be developed for a city in Finland. We explored different options, and ended up with two measures: task completion success rate for defining effectiveness requirements, and a complementary measure that we call design solution success rate. We could not find appropriate ways for defining requirements that directly address efficiency and user satisfaction. Our case shows that the tendering context sets specific restrictions to the selection of usability measures, especially from the viewpoint of target setting and objective verification.

References

[1]

ANSI, Common Industry Format for Usability Test Reports. 2001: NCITS 354--2001.

[2]

Artman, H. Procurer Usability Requirements: Negotiations in Contract Development. in NordiCHI 2002. 2002. Århus.

Digital Library

[3]

Artman, H. and S. Zällh, Finding a way to usability: procurement of a taxi dispatch system. 2005.

[4]

Bangor, A., P. Kortum, and J. Miller, Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale. Journal of Usability Studies, 2009. 4(3): p. 114--123.

[5]

Bevan, N., et al., Guide to specifying and evaluating usability as part of a contract, version1.0. PRUE project. 2002, Serco Usability Services: London. p. 47.

[6]

Brooke, J., SUS - A "quick and dirty" usability scale. 1986, Digital Equipment Co. Ltd.

[7]

Chin, J. P., V. A. Diehl, and K. L. Norman. Development of an instrument measuring user satisfaction of the human-computer interface. in Proceedings of SIGCHI '88. 1988. New York.

Digital Library

[8]

Good, M., et al. User-derived impact analysis as a tool for usability engineering. in Conference Proceedings on Human Factors in Computing Systems. 1986. Boston.

Digital Library

[9]

Gulliksen, J., et al., Key Principles of User-Centred Systems Design. Behaviour & Information Technology, 2003. 22(6): p. 397--409.

[10]

Hix, D. and H. R. Hartson, Developing User Interfaces: Ensuring Usability Through Product & Process. 1993, New York: John Wiley & Sons. 416.

Digital Library

[11]

Hornbaek, K., Current practice in measuring usability: Challenges to usability studies and research. Int. J. Human-Computer Studies, 2006. 64.

Digital Library

[12]

Hornbaek, K. and E. L.-C. Law. Meta-Analysis of Correlations Among Usability Measures. in CHI 2007 Proceedings. 2007. San Jose.

Digital Library

[13]

ISO/IEC, 9241-11 Ergonomic requirements for office work with visual display terminals (VDT)s - Part 11 Guidance on usability. 1998: ISO/IEC 9241--11: 1998 (E).

[14]

ISO/IEC, 9241-110 Ergonomics of human-system interaction -- Part 110: Dialogue principles. 2006: ISO/IEC 9241--110: 2006 (E).

[15]

ISO/IEC, 25062 Common Industry Format (CIF) for usability test reports. 2006: ISO/IEC 13407: 2006 (E).

[16]

Jeffrey, W. and &al, Voluntary Voting System Guidelines Recommendations to the Election Assistance Commission. 2007, Technical Guidelines Development Committee, United States Election Assistance Commission.

[17]

Jokela, T. A Two-Level Approach for Determining Measurable Usability Targets. in 5th COST294--MAUSE Open Workshop on Valid Useful User Experience Measurement (VUUM). 2008. Reykjavik, Island.

[18]

Jokela, T., Usability Guided Interaction Design (in Finnish). 2010: Väylä-Yhtiöt Oy.

[19]

Jokela, T., et al., Quantitative Usability Requirements in the Development of the User Interface of a Mobile Phone. A Case Study. Personal and Ubiquitous Computing, 2006. 10(6): p. 345--355.

Digital Library

[20]

Kirakowski, J. and M. Corbett, SUMI: The software usability measurement inventory. British Journal of Educational Technology, 1993. 24(3): p. 210--212.

[21]

Lauesen, S. Usability requirements in a tender process. in OZCHI'98. 1998. Adelaide.

Digital Library

[22]

Law, E., et al. Towards a UX Manifesto. 2007. Lancaster, UK: http://www.cost294.org.

[23]

Lehtonen, T., et al., To Which Extent Usability Truly Matters? A Study on Usability Requirements in Call-for-Tenders of Software Systems, Issued by Public Authorities. Manuscript (in review for publication). 2010.

[24]

Markensten, E. and H. Artman. Procuring a Usable System Using Unemployed Personas in NordiCHI 2004. 2004. Tampere.

Digital Library

[25]

Nielsen, J., Success Rate: The Simplest Usability Metric. http://www.useit.com/alertbox/20010218.html. 2001.

[26]

Nielsen, J., Usability Engineering. 1993, San Diego: Academic Press, Inc. 358.

Digital Library

[27]

NIST, Proposed Industry Format for Usability Requirements. Draft version 0.62. 8-Aug-04. 2004.

[28]

Sauro, J. and J. S. Dumas. Comparison of Three One-Question, Post-Task Usability Questionnaires. in CHI 2009. 2009. Boston.

Digital Library

[29]

Whiteside, J., J. Bennett, and K. Holtzblatt, Usability Engineering: Our Experience and Evolution, in Handbook of human-computer interaction, M. Helander, Editor. 1988, North-Holland: Amsterdam. p. 791--817.

[30]

Wixon, D. and C. Wilson, The Usability Engineering Framework for Product Design and Evaluation, in Handbook of Human-Computer Interaction, M. Helander, T. Landauer, and P. Prabhu, Editors. 1997, Elsevier Science B. V: Amsterdam. p. 653--688.

Cited By

Zahlsen ØSvanæs DFaxvaag ADahl YLamas DSarapuu HŠmorgun IBerget G(2020)Understanding the Impact of Boundary Conditions on Participatory Activities.Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society10.1145/3419249.3420129(1-11)Online publication date: 25-Oct-2020
https://dl.acm.org/doi/10.1145/3419249.3420129
Nieminen MLaine JTeräs SRunonen MKalakoski VValtonen TLukander JJokela TKaipio JLääveri TKushniruk ABoryzki ERoto VHäkkilä JVäänänen-Vainio-Mattila KJuhlin OOlsson THvannberg E(2014)How to involve users in government system procurement?Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational10.1145/2639189.2654832(805-808)Online publication date: 26-Oct-2014
https://dl.acm.org/doi/10.1145/2639189.2654832
Jokela TLaine JNieminen M(2013)Usability in RFP’s: The Current Practice and Outline for the FutureHuman-Computer Interaction. Applications and Services10.1007/978-3-642-39262-7_12(101-106)Online publication date: 2013
https://doi.org/10.1007/978-3-642-39262-7_12
Show More Cited By

Index Terms

Determining usability requirements into a call-for-tenders: a case study on the development of a healthcare system
1. Human-centered computing

Recommendations

To what extent usability truly matters?: a study on usability requirements in call-for-tenders of software systems issued by public authorities
NordiCHI '10: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries

Systems in public organizations widely suffer from poor usability. We analyzed to what extent public authorities require usability, through examining 38 call-for-tenders that were issued during a period of three months in Finland. We found six ...
Determining high level quantitative usability requirements: a case study
HCI'07: Proceedings of the 12th international conference on Human-computer interaction: interaction design and usability

High-level quantitative usability requirements were determined for a public health care system. The requirements determination process was iterative, and the requirements were refined step-by-step. The usability requirements are categorized first ...
Usability requirements for requirement engineering tools
IHM '14: Proceedings of the 26th Conference on l'Interaction Homme-Machine

Requirement engineering (RE) tools are necessary for several reasons: they allow engineers to manage an increasing amount of information, to maintain traceability between requirements, solution and tests, and to evaluate requirement change impact on the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

NordiCHI '10: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries

October 2010

889 pages

ISBN:9781605589343

DOI:10.1145/1868914

General Chairs:
Ebba Þóra Hvannberg
University of Iceland, Iceland
,
Marta Kristín Lárusdóttir
Reykjavik University, Iceland
,
Program Chairs:
Ann Blandford
University College London
,
Jan Gulliksen
Royal Institute of Technology, Sweden

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Reykjavik University
University of Iceland

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

NordiCHI '10

Sponsor:

NordiCHI '10: 6th Nordic Conference on Human-Computer Interaction

October 16 - 20, 2010

Reykjavik, Iceland

Acceptance Rates

Overall Acceptance Rate 379 of 1,572 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
296
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zahlsen ØSvanæs DFaxvaag ADahl YLamas DSarapuu HŠmorgun IBerget G(2020)Understanding the Impact of Boundary Conditions on Participatory Activities.Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society10.1145/3419249.3420129(1-11)Online publication date: 25-Oct-2020
https://dl.acm.org/doi/10.1145/3419249.3420129
Nieminen MLaine JTeräs SRunonen MKalakoski VValtonen TLukander JJokela TKaipio JLääveri TKushniruk ABoryzki ERoto VHäkkilä JVäänänen-Vainio-Mattila KJuhlin OOlsson THvannberg E(2014)How to involve users in government system procurement?Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational10.1145/2639189.2654832(805-808)Online publication date: 26-Oct-2014
https://dl.acm.org/doi/10.1145/2639189.2654832
Jokela TLaine JNieminen M(2013)Usability in RFP’s: The Current Practice and Outline for the FutureHuman-Computer Interaction. Applications and Services10.1007/978-3-642-39262-7_12(101-106)Online publication date: 2013
https://doi.org/10.1007/978-3-642-39262-7_12
Jokela TBuie E(2012)Getting UX Into the ContractUsability in Government Systems10.1016/B978-0-12-391063-9.00048-1(251-265)Online publication date: 2012
https://doi.org/10.1016/B978-0-12-391063-9.00048-1
Lehtonen TKumpulainen JLiukkonen TJokela THvannberg ELárusdóttir MBlandford AGulliksen J(2010)To what extent usability truly matters?Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries10.1145/1868914.1869013(719-722)Online publication date: 16-Oct-2010
https://dl.acm.org/doi/10.1145/1868914.1869013

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents