short-paper

PSSUQ-GR: A First Step Towards Standardization of the Post-Study System Usability Questionnaire in Greek

Authors:

Christos Katsanos,

Nikolaos Tselios,

Alexandros LiapisAuthors Info & Claims

CHI Greece 2021: CHI Greece 2021: 1st International Conference of the ACM Greek SIGCHI Chapter

Article No.: 23, Pages 1 - 6

https://doi.org/10.1145/3489410.3489433

Published: 25 November 2021 Publication History

Abstract

Perceived usability is an important requirement of interactive systems, affecting greatly the overall user experience. The Post-Study System Usability Questionnaire (PSSUQ) is a popular instrument, developed in English, for assessing perceived usability of interactive systems. In this paper, a first step towards standardization of a Greek version of PSSUQ, the PSSUQ-GR, is presented. To this end, the PSSUQ was translated and adapted to Greek by two HCI experts. Next, 359 participants interacted with two websites and then completed the System Usability Scale (SUS) and the PSSUQ-GR immediately after interacting with each website. Factor analysis successfully revealed a three-factor structure of the PSSUQ-GR with 12 items and item-subscales alignment close to the original PSSUQ. Reliability analysis using Cronbach's alpha indicated that the PSSUQ-GR scale and the three subscales have a high reliability. In addition, the participants’ SUS scores and PSSUQ-GR scores were significantly and strongly correlated, which supports the validity of the PSSUQ-GR. Thus, this study found that the PSSUQ-GR (N=12 items) is a reliable and valid tool for measuring perceived usability, with a factor structure consistent with the English version of the PSSUQ.

References

[1]

Abeer A. Al-Hassan, Bareeq AlGhannam, Mohammad Bin Naser, and Haneen Alabdulrazzaq. 2021. An Arabic translation of the Computer System Usability Questionnaire (CSUQ) with psychometric evaluation using Kuwait university portal. International Journal of Human–Computer Interaction online, 1–8.

[2]

Aaron Bangor, Philip Kortum, and James Miller. 2009. Determining what individual SUS Scores mean: adding an adjective rating scale. J. Usability Stud. 4 (3), 114–123.

Digital Library

[3]

Mehmet Ilker Berkman and Dilek Karahoca. 2016. Re-Assessing the Usability Metric for User Experience (UMUX) scale. Journal of Usability Studies 11 (3), 89–109.

Digital Library

[4]

Bojan Blažica and James R. Lewis. 2015. A Slovene translation of the System Usability Scale: the SUS-SI. International Journal of Human–Computer Interaction 31 (2), 112–117.

[5]

Anna Borkowska and Katarzyna Jach. 2017. Pre-testing of Polish translation of System Usability Scale (SUS). In Proceedings of 37th International Conference on Information Systems Architecture and Technology, Springer International Publishing, Cham, 143–153.

[6]

John Brooke. 1996. SUS: a “quick and dirty” usability scale. In Usability Evaluation in Industry, P. W. Jordan, B Thomas, B. A. Weerdmeester and A. L. McClelland (eds.). Taylor and Francis, London.

[7]

John Brooke. 2013. SUS: A retrospective. Journal of Usability Studies 8 (2), 29–40.

Digital Library

[8]

John P. Chin, Virginia A. Diehl, and Kent L. Norman. 1988. Development of an instrument measuring user satisfaction of the human-computer interface. In Proceedings of the SIGCHI conference on Human factors in computing systems (CHI ’88), ACM, New York, NY, USA, 213–218.

Digital Library

[9]

Denizhan Demi̇rkol and Çağla Şeneler. 2018. A Turkish translation of the System Usability Scale: the SUS-TR. Uşak Üniversitesi Sosyal Bilimler Dergisi 11 (3), 237–253.

[10]

Oğuzhan Erdinç and James R. Lewis. 2013. Psychometric Evaluation of the T-CSUQ: The Turkish version of the Computer System Usability Questionnaire. International Journal of Human–Computer Interaction 29 (5), 319–326.

[11]

Kraig Finstad. 2010. The Usability Metric for User Experience. Interacting with Computers 22 (5), 323–327.

Digital Library

[12]

Julie Christine S. Hvidt, Lone Fisker Christensen, Christian Sibbersen, Stig Helweg-Jørgensen, Jens Peter Hansen, and Mia Beck Lichtenstein. 2020. Translation and validation of the System Usability Scale in a Danish mental health setting using digital technologies in treatment interventions. International Journal of Human–Computer Interaction 36 (8), 709–716.

[13]

Richard A. Kass and Howard E. A. Tinsley. 1979. Factor analysis. Journal of Leisure Research 11 (2), 120–138.

[14]

Christos Katsanos, Nikolaos Tselios, and Michalis Xenos. 2012. Perceived usability evaluation of learning management systems: a first step towards standardization of the System Usability Scale in Greek. In 2012 16th Panhellenic Conference on Informatics, 302–307.

Digital Library

[15]

Philip Kortum and Aaron Bangor. 2013. Usability ratings for everyday products measured with the system usability scale. International Journal of Human-Computer Interaction 29 (2), 67–76.

[16]

Thomas K. Landauer. 1997. Behavioral research methods in Human-Computer Interaction. In Handbook of Human-Computer Interaction (Second Edition), Marting G. Helander, Thomas K. Landauer and Prasad V. Prabhu (eds.). North-Holland, Amsterdam, 203–227.

[17]

James R. Lewis. 1991. An after-scenario questionnaire for usability studies: psychometric evaluation over three trials. ACM SIGCHI Bulletin 23 (4), 79.

Digital Library

[18]

James R. Lewis. 1995. IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. International Journal of Human-Computer Interaction 7 (1), 57–78.

Digital Library

[19]

James R. Lewis. 2018. Measuring perceived usability: The CSUQ, SUS, and UMUX. International Journal of Human–Computer Interaction 34 (12), 1148–1156.

[20]

James R. Lewis and Jeff Sauro. 2009. The factor structure of the System Usability Scale. In Proceedings of the 1st International Conference on Human Centered Design: Held as Part of HCI International 2009 (HCD 09), Springer-Verlag, Berlin, Heidelberg, 94–103.

Digital Library

[21]

Han X. Lin, Yee-Yin Choong, and Gavriel Salvendy. 1997. A proposed index of usability: A method for comparing the relative usability of different software systems. Behaviour & Information Technology 16 (4–5), 267–277.

[22]

Arnold Lund. 2001. Measuring usability with the USE questionnaire. Usability and User Experience Newsletter of the STC Usability SIG. Retrieved from http://www.stcsig.org/usability/newsletter/0110_measuring_with_use.html

[23]

Jum Nunnally and Ira Bernstein. 1994. Psychometric theory (3rd ed.). McGraw-Hill Humanities/Social Sciences/Languages.

[24]

Konstantina Orfanou, Nikolaos Tselios, and Christos Katsanos. 2015. Perceived usability evaluation of learning management systems: Empirical evaluation of the System Usability Scale. The International Review of Research in Open and Distributed Learning 16 (2), 227–246.

[25]

Jeff Sauro. 2014. 4 steps to translating a questionnaire. MeasuringU. Retrieved July 18, 2021 from https://measuringu.com/translation/

[26]

Jeff Sauro and James R. Lewis. 2009. Correlations among prototypical usability metrics: evidence for the construct of usability. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Association for Computing Machinery, New York, NY, USA, 1609–1618.

Digital Library

[27]

Fereshteh Taheri, Amir Kavusi, Yoosef Faghihnia Torshozi, Ali Asghar Farshad, and Mahnaz Saremi. 2017. Assessment of validity and reliability of Persian version of System Usability Scale (SUS) for traffic signs. Iran Occupational Health 14 (1), 12–22.

[28]

Prokopia Vlachogianni and Nikolaos Tselios. 2021. Perceived usability evaluation of educational technology using the System Usability Scale (SUS): A systematic review. Journal of Research on Technology in Education online, 1–18.

[29]

Yuhui Wang, Tian Lei, and Xinxiong Liu. 2020. Chinese System Usability Scale: translation, revision, psychological measurement. International Journal of Human–Computer Interaction 36 (10), 953–963.

Cited By

Natsiavas PNikolaidis GPliatsika JChytas AGiannios GKaranikas HGrammatikopoulou MZachariadou MDimitriadis VNikolopoulos SKompatsiaris I(2024)The PrescIT platform: An interoperable Clinical Decision Support System for ePrescription to Prevent Adverse Drug Reactions and Drug-Drug InteractionsDrug Safety10.1007/s40264-024-01455-z47:10(1051-1059)Online publication date: 20-Jul-2024
https://doi.org/10.1007/s40264-024-01455-z
Vlachogianni PTselios N(2023)Perceived Usability Evaluation of Educational Technology Using the Post-Study System Usability Questionnaire (PSSUQ): A Systematic ReviewSustainability10.3390/su15171295415:17(12954)Online publication date: 28-Aug-2023
https://doi.org/10.3390/su151712954
Wang YXie YQiao YXia ZChen Y(2023)Chinese CSUQ: Cross-Cultural Adaptation and Evaluation of Measurement PropertiesInternational Journal of Human–Computer Interaction10.1080/10447318.2023.226679540:22(7623-7641)Online publication date: 11-Oct-2023
https://doi.org/10.1080/10447318.2023.2266795

Index Terms

PSSUQ-GR: A First Step Towards Standardization of the Post-Study System Usability Questionnaire in Greek
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
  2. Interaction design

Index terms have been assigned to the content through auto-classification.

Recommendations

GR-UMUX and GR-UMUX-LITE: A First Step Towards Standardization of the Usability Metric for User Experience and its LITE Version in Greek
PCI '23: Proceedings of the 27th Pan-Hellenic Conference on Progress in Computing and Informatics

Users' perceptions of their experience with interactive systems is particularly important for the product's success. The Usability Metric for User Experience (UMUX) is a four-item questionnaire used for the subjective assessment of a system's perceived ...
Questionnaire experience and the hybrid System Usability Scale: Using a novel concept to evaluate a new instrument
Highlights
- The article presents an online study, in which a Hybrid System Usability Scale was compared with the original System Usability Scale.
- Besides traditional psychometric criteria (i.e. validity, reliability and sensitivity), measures of ...
Abstract
This article presents the concept of questionnaire experience (QX), intending to add a new element to the psychometric evaluation of questionnaires, which may eventually help increase the validity and reliability of instruments. The application ...
A usability evaluation of the Google Home with non-native English speakers using the system usability scale

Advancements in multidisciplinary research have made voice user interfaces (VUIs) become a reality in both research and commercialisation. Although the existing research has indicated that VUIs are useful in people's daily lives (e.g., personal assistant),...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

CHI Greece 2021: CHI Greece 2021: 1st International Conference of the ACM Greek SIGCHI Chapter

November 2021

172 pages

ISBN:9781450385787

DOI:10.1145/3489410

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 November 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

CHI Greece 2021

CHI Greece 2021: 1st International Conference of the ACM Greek SIGCHI Chapter

November 25 - 27, 2021

Online (Athens, Greece), Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
275
Total Downloads

Downloads (Last 12 months)85
Downloads (Last 6 weeks)6

Reflects downloads up to 13 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Natsiavas PNikolaidis GPliatsika JChytas AGiannios GKaranikas HGrammatikopoulou MZachariadou MDimitriadis VNikolopoulos SKompatsiaris I(2024)The PrescIT platform: An interoperable Clinical Decision Support System for ePrescription to Prevent Adverse Drug Reactions and Drug-Drug InteractionsDrug Safety10.1007/s40264-024-01455-z47:10(1051-1059)Online publication date: 20-Jul-2024
https://doi.org/10.1007/s40264-024-01455-z
Vlachogianni PTselios N(2023)Perceived Usability Evaluation of Educational Technology Using the Post-Study System Usability Questionnaire (PSSUQ): A Systematic ReviewSustainability10.3390/su15171295415:17(12954)Online publication date: 28-Aug-2023
https://doi.org/10.3390/su151712954
Wang YXie YQiao YXia ZChen Y(2023)Chinese CSUQ: Cross-Cultural Adaptation and Evaluation of Measurement PropertiesInternational Journal of Human–Computer Interaction10.1080/10447318.2023.226679540:22(7623-7641)Online publication date: 11-Oct-2023
https://doi.org/10.1080/10447318.2023.2266795

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten