research-article

An analysis of deictic signs in computer interfaces: : contributions to the Semiotic Inspection Method

Authors:

Aron Daniel Lopes,

Vinicius Carvalho Pereira,

Cristiano MacielAuthors Info & Claims

Volume 40, Issue C

Pages 51 - 64

https://doi.org/10.1016/j.jvlc.2017.01.001

Published: 01 June 2017 Publication History

Abstract

In this paper we discuss the concept of deictic sign as a component of the conceptual framework of Linguistics and Semiotics that can be added to Semiotic Inspection Method (SIM) in case the method is adapted to better approach digital games. Deictic signs should be here understood as signs that stablish an indexical relation with the objects they refer to, thus placing them in terms of space, time and person with a reference to the moment of communication though the interface. This paper analyzes such kind of signs in digital games; to do so, it discusses in detail the deictic aspects that SIM could not inspect when it was applied to the interfaces of the games Ingress, Kinectimals and Just Dance Now. As a result, we show that the category of deictic signs can be added to SIM when this method is adapted to systems that make explicit indexical references.

References

[1]

Clarisse Sieckenius de Souza, The Semiotic Engineering of Human-computer Interaction, MIT press, 2005.

[2]

A. Lopes, C. Maciel, V. Pereira, Aplicabilidade do Método de Inspeção Semiótica em Jogos Eletrônicos Interativos, in: Proceedings of theXIV Simpósio Brasileiro de Fatores Humanos em Sistemas Computacionais - IHC'15, 2015, Salvador. Porto Alegre: Sociedade Brasileira de Computação. v. 1. p. 302-311, 2015.

[3]

E. Oliveira, L. Luz, R. Prates, "Aplicação semi-estruturada do método de inspeção semiótica: estudo de caso para o domínio educacional, "In Proceedings of the VIII Brazilian Symposium on Human Factors in Computing Systems, pp. 50–59. Sociedade Brasileira de Computação, 2008.

[4]

L. Corrêa, F.S. Coutinho, R. Prates, L. Chaimowicz, Uso do MIS para avaliar signos sonoros: quando um problema de comunicabilidade se torna um problema de acessibilidade, in: Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems, pp. 47–56. Brazilian Computer Society, 2012.

[5]

C. de Souza, C. Leitão, R. Prates, E. da Silva, The semiotic inspection method, In Proceedings of VII Brazilian symposium on Human factors in computing systems, pp. 148–157. ACM, 2006.

[6]

Clarisse Sieckenius de Souza, Semiotic engineering: bringing designers and users together at interaction time, Interact. Comput. 17 (3) (2005) 317–341.

[7]

Kranstedt, Alfred, Peter Kühnlein, Ipke Wachsmuth. "Deixis in multimodal human computer interaction: An interdisciplinary approach." International Gesture Workshop. Springer Berlin Heidelberg, 2003.

[8]

Louis Hjelmslev, and Francis J. Whitfield. Prolegomena to a Theory of Language. (1961).

[9]

Johan Huizinga, Umberto Eco, and Corinna van Schendel. Homo ludens. Routledge and Kegan Paul 1985.

[10]

Roman Jakobson, 1995. Closing statement: Linguistics and poetics. Style in language 350 (1960): 377.

[11]

Barbara Kitchenham, Procedures for Performing Systematic Reviews, 33, Keele University, Keele, UK, 2004, pp. 1–26.

[12]

Aron Daniel Lopes, Aplicabilidade do Método de Inspeção Semiótica em Jogos Eletrônicos Interativos. Trabalho de conclusão de curso, Universidade Federal de Mato Grosso, 2015.

[13]

Roger Cailloi, Meyer Barash, Man, Play, and Games, University of Illinois Press, 1961.

[14]

D. Peixoto, R. Prates, E. Resende, Semiotic inspection method in the context of educational simulation games, in Proceedings of the 2010 ACM Symposium on Applied Computing, pp. 1207–1212. ACM, 2010.

[15]

Raquel O. Prates, Clarisse S. De Souza, e.Simone D.J. Barbosa, Methods and tools: a method for evaluating the communicability of user interfaces, Interactions 7.1 (2000) 31–38.

[16]

Charles Sanders Peirce, Justus Buchler (Ed.), 'Logic as Semiotic: The Theory of Signs', Philosophical Writings of Peirce, Dover, New York, 1955.

[17]

Soraia d. Souza Reis, Raquel Oliveira Prates, Avaliação do Método de Inspeção Semiótica. Dissertação (Mestrado), Universidade Federal de Minas Gerais, Março, 2012.

[18]

B. Ribeiro, F. Lucchese, Z. Castañeda, Interfaces de Jogos Digitais. Acesso em 10 de Novembro, 2014. Disponível em: <〈http://www.dca.fee.unicamp.br/~martino/disciplinas/ia369/trabalhos/t3g3.pdf〉>, 2009.

[19]

Katie Salen, e.Eric Zimmerman, Rules of Play: Game Design Fundamentals, MIT press, 2004.

Digital Library

[20]

Paul Schuytema. 2008. Game Design: A Practical Approach. Charles River Media, 2007.

[21]

Clarisse Sieckenius De Souza, Carla Faria Leitão (Eds.), Semiotic Engineering Methods for Scientific Research in HCI. 1, 1, Morgan & Claypool, San Francisco, California, 2009, p. 122.

[22]

Chris Crawford, The Art of Computer Game Design, Osborne/McGraw-Hill, Berkeley, CA, 1984, (ix, 12, 13, 56).

[23]

Heloisa Vieira da Rocha, Maria Cecília C. Baranauskas. Design e avaliação de interfaces humano–computador. Campinas–SP: Nied/Unicamp, 2003. 48, 108.

[24]

Holger Diessel, Deixis and demonstratives, Klaus von Heusinger, Claudia Maienborn, Paul Portner (Eds.), Semantics. An International Handbook of Natural Language Meaning, 2, de Gruyter, Berlin; New York, 2012.

[25]

S. Dewi, Deixis Analysis in The Child in the Grave written by Hans Christian Andersen. [S.l.]. 10, 2013.

[26]

Stephen C. Levinson. Deixis and pragmatic. L. Horn G. Ward (eds.), Oxford: Blackwell, p. 97–121, 2004.

[27]

B. Purwo, Pragmatik dan pengajaran bahasa: Menyibak Kurikulum. [S.l.]: Kanisius, 1984.

[28]

S. Anderson, L. Keenan Edward, "Deixis. Language typology and syntactic description, vol. 3: Grammatical categories and the lexicon, ed. by Timothy Shopen, 259–308.", 1985.

[29]

Natália S.Santos, Lidia S. Ferreira, Emanuelly FM Barros, and Raquel O. Prates. "Uma análise comparativa dos métodos de avaliação de sistemas colaborativos fundamentados na engenharia semiótica", in: Proceedings of the 12th Brazilian Symposium on Human Factors in Computing Systems, pp. 218–227. Brazilian Computer Society, 2013.

[30]

Edmond Couchot. 2003. A tecnologia na arte: da fotografia à realidade virtual. Editora da UFRGS.

[31]

Bill Moggridge, Bill Atkinson, Designing interactions. [S.l.], 56, MIT press, Cambridge, 2007.

Cited By

Leitão CPereira VMaciel CGasparini IPiccolo LZaina LPereira R(2017)Exploring the Communication of Cultural Perspectives in Death-Related Interactive SystemsProceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems10.1145/3160504.3160527(1-10)Online publication date: 23-Oct-2017
https://dl.acm.org/doi/10.1145/3160504.3160527

Index Terms

An analysis of deictic signs in computer interfaces: contributions to the Semiotic Inspection Method

Index terms have been assigned to the content through auto-classification.

Recommendations

Here's What I Can Do: Chatbots' Strategies to Convey Their Features to Users
IHC '17: Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems

Chatbots have been around since the 1960's, but recently they have risen in popularity especially due to new compatibility with social networks and messenger applications. Chatbots are different from traditional user interfaces, for they unveil ...
Supporting Negotiation Behavior with Haptics-Enabled Human-Computer Interfaces

An active research goal for human-computer interaction is to allow humans to communicate with computers in an intuitive and natural fashion, especially in real-life interaction scenarios. One approach that has been advocated to achieve this has been to ...
Natural language with integrated deictic and graphic gestures
HLT '89: Proceedings of the workshop on Speech and Natural Language

People frequently and effectively integrate deictic and graphic gestures with their natural language (NL) when conducting human-to-human dialogue. Similar multi-modal communication can facilitate human interaction with modern sophisticated information ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Journal of Visual Languages and Computing

Journal of Visual Languages and Computing Volume 40, Issue C

Jun 2017

131 pages

ISSN:1045-926X

Issue’s Table of Contents

Elsevier Ltd.

Publisher

Academic Press, Inc.

United States

Publication History

Published: 01 June 2017

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Leitão CPereira VMaciel CGasparini IPiccolo LZaina LPereira R(2017)Exploring the Communication of Cultural Perspectives in Death-Related Interactive SystemsProceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems10.1145/3160504.3160527(1-10)Online publication date: 23-Oct-2017
https://dl.acm.org/doi/10.1145/3160504.3160527

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents