research-article

Evaluation by Inspection: Comparing Methods of Practical, Cognitive and Semiotic Basis

Authors:

Silvia Amélia Bim,

Luciana Cardoso de Castro Salgado,

Carla Faria LeitãoAuthors Info & Claims

IHC '16: Proceedings of the 15th Brazilian Symposium on Human Factors in Computing Systems

Article No.: 9, Pages 1 - 10

https://doi.org/10.1145/3033701.3033710

Published: 04 October 2016 Publication History

Abstract

This paper presents a study comparing three inspection methods: Heuristic Evaluation, Cognitive Walkthrough and Semiotic Inspection Method. The objective is to enlighten the novice on HCI methodology improvement and, at the same time, offer new perspectives to experts on the subject. In order to do this, an analysis of the methods applicability on mobile devices is presented, as well as a set of parameters related to the time needed to apply each of the methods, the kind of knowledge generated and the insights created while applying each method. The results suggest that the inspection methods of cognitive and semiotic basis are especially interesting to generate new scientific knowledge in HCI.

References

[1]

Simone D.J. Barbosa, Bruno S. Silva. 2010. Interação Humano-Computador. Editora Campus-Elsevier.

[2]

Bruno Bonifácio, Horácio Oliveira, and Tayana Conte. 2010. Avaliação de usabilidade de aplicações em dispositivos móveis. In Proceedings of the IX Symposium on Human Factors in Computing Systems (IHC '10). Brazilian Computer Society, Porto Alegre, Brazil, Brazil, 269--270.

Digital Library

[3]

Raluca Budiu and Jakob Nielsen. 2010. Usability of Mobile Websites and Applications -- Design Guidelines for Improving the User Experience of Mobile Sites and Apps. 2nd Edition. Nielsen Norman Group.

[4]

Luiz P. D. Corrêa, F. R. S. Coutinho, Raquel O. Prates, and Luiz Chaimowicz. 2012. Uso do MIS para avaliar signos sonoros: quando um problema de comunicabilidade se torna um problema de acessibilidade. In Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems (IHC '12). Brazilian Computer Society, Porto Alegre, Brazil, Brazil, 47--56.

Digital Library

[5]

John W. Creswell. 2009. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. 3rd Edition. Los Angeles: Sage Publications.

[6]

Clarisse S. de Souza, C.S. 2005. The Semiotic Engineering of Human-Computer Interaction. Cambridge. The MIT Press.

Digital Library

[7]

Clarisse S. de Souza, Carla F. Leitão, Raquel O. Prates, and Elton J. a Silva. 2006. The semiotic inspection method. In Proceedings of VII Brazilian symposium on Human factors in computing systems (IHC '06). ACM, New York, NY, USA, 148--157.

Digital Library

[8]

Clarisse S. de Souza, Carla F. Leitão. 2009. Semiotic Engineering Methods for Scientific Research in HCI. Morgan Claypool.

Digital Library

[9]

Jonathan Lazar, Jinjuan H. Feng, Harry Hochheiser. 2010. Research Methods in Human-Computer Interaction, Wiley.

Digital Library

[10]

Aron Lopes, Vinicius Pereira and Cristiano Maciel. 2015. Aplicabilidade do Método de Inspeção Semiótica em Jogos Eletrônicos Interativos. In Proceedings of XIV Brazilian symposium on Human factors in computing systems (IHC '15). Porto Alegre, RS: SBC.

[11]

Jakob Nielsen. 1994. Heuristic evaluation. In Nielsen, J., and Mack, R. L. (Eds.), Usability Inspection Methods. New York, John Wiley & Sons. 25--64.

Digital Library

[12]

Donald A. Norman. 1986. Cognitive Engineering. In D. A. Norman and S. W. Draper (Eds.) User Centered System Design. 1986. Hillsdale. 31--61.

[13]

Judith S. Olson and Wendy A. Kellogg. (org.) 2014. Ways of Knowing in HCI. Springer Publishing Company, Incorporated.

Digital Library

[14]

Yvonne Rogers, Helen Sharp, and Jenny Preece. 2015. Interaction Design: Beyond Human - Computer Interaction (4rd ed.). Wiley Publishing.

[15]

Luciana C.C. Salgado, Sílvia A. Bim, Clarisse S. de Souza. 2006. Comparação entre os métodos de avaliação de base cognitiva e semiótica. In Proceedings of VII Brazilian symposium on Human factors in computing systems (IHC '06). Porto Alegre, RS: SBC, 2006. v. 1.

Digital Library

[16]

Cathleen Wharton, John Rieman, Clayton Lewis, Peter Polson. 1994. The cognitive walkthrough method: A practitioner's guide. In Nielsen, J., and Mack, R. L. (Eds.) Usability Inspection Methods. New York. John Wiley & Sons. 105--140.

Digital Library

Cited By

Da Silva WSilva MSalgado L(2023)Encouraging learners to seek and explain communicability issues about Consent RequestProceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638097(1-11)Online publication date: 16-Oct-2023
https://dl.acm.org/doi/10.1145/3638067.3638097
Melo Dda Silva TMonteiro ISampaio AMeireles CBraz LCruz GVasconcelos D(2022)Digital Government and User Experience: how the combination of evaluation methods can contribute to the improvement of m-gov applicationsProceedings of the XVIII Brazilian Symposium on Information Systems10.1145/3535511.3535553(1-9)Online publication date: 16-May-2022
https://dl.acm.org/doi/10.1145/3535511.3535553

Index Terms

Evaluation by Inspection: Comparing Methods of Practical, Cognitive and Semiotic Basis
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

The semiotic inspection method
IHC '06: Proceedings of VII Brazilian symposium on Human factors in computing systems

This paper describes semiotic inspection, a semiotic engineering evaluation method. It briefly identifies the essence of theory-based evaluation methods in HCI. Then it provides a detailed description and illustration of this method, which is based on a ...
Usability inspection methods after 15 years of research and practice
SIGDOC '07: Proceedings of the 25th annual ACM international conference on Design of communication

Usability inspection methods, such as heuristic evaluation, the cognitive walkthrough, formal usability inspections, and the pluralistic usability walkthrough, were introduced fifteen years ago. Since then, these methods, analyses of their comparative ...
Assessing the semiotic inspection method: the evaluators' perspective
IHC '12: Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems

This paper presents an assessment of the Semiotic Inspection Method aimed at understanding its costs, benefits, advantages and disadvantages from the evaluators' perspective. We applied a questionnaire to novice evaluators and interviewed the authors of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

IHC '16: Proceedings of the 15th Brazilian Symposium on Human Factors in Computing Systems

October 2016

431 pages

ISBN:9781450352352

DOI:10.1145/3033701

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SBC: Sociedade Brasileira de Computação
CNPq: Conselho Nacional de Desenvolvimento Cientifico e Tecn
SIGCHI: ACM Special Interest Group on Computer-Human Interaction
CGIBR: Comite Gestor da Internet no Brazil

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 October 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

IHC '16

IHC '16: XV Brazilian Symposium on Human Factors in Computing Systems

October 4 - 7, 2016

São Paulo, Brazil

Acceptance Rates

IHC '16 Paper Acceptance Rate 58 of 158 submissions, 37%;

Overall Acceptance Rate 331 of 973 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
175
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Da Silva WSilva MSalgado L(2023)Encouraging learners to seek and explain communicability issues about Consent RequestProceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638097(1-11)Online publication date: 16-Oct-2023
https://dl.acm.org/doi/10.1145/3638067.3638097
Melo Dda Silva TMonteiro ISampaio AMeireles CBraz LCruz GVasconcelos D(2022)Digital Government and User Experience: how the combination of evaluation methods can contribute to the improvement of m-gov applicationsProceedings of the XVIII Brazilian Symposium on Information Systems10.1145/3535511.3535553(1-9)Online publication date: 16-May-2022
https://dl.acm.org/doi/10.1145/3535511.3535553

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents