research-article

UUX-Posts: a tool for extracting and classifying postings related to the use of a system

Authors:

Marília Soares Mendes,

Elizabeth Sucupira FurtadoAuthors Info & Claims

CLIHC '17: Proceedings of the 8th Latin American Conference on Human-Computer Interaction

Article No.: 2, Pages 1 - 8

https://doi.org/10.1145/3151470.3151471

Published: 08 November 2017 Publication History

Abstract

Systems Evaluation through user narratives has been a recent evaluation technique and has seen valuable results on a usability and user experience about the system. In previous work, we have researched as a user writes detailed comments about the system itself where it is online and use us to evaluate the system. However, the process of collecting and sorting user posts has become a laborious process. In this way, this article presents the UUX-Posts - A tool for extracting and classifying posts about the uses of a certain system by its users. This work contributes to UUX tests, which aim to identify Usability and UX problems by analyzing user opinions (by text).

References

[1]

Ariello, G. E.; Kaestner, C. A. A. Tratamento de textos e algoritmos sobre grafos para a análise de redes sociais. In: Seminário de Iniciação Científica e Tecnológica da UTFPR, Curitiba, 2017.

[2]

Bargas-avila, Javier A.; Hornbæk, Kasper. Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience. In CHI 2011, Vancouver, p. 2689--2698, 2011.

Digital Library

[3]

Benamara, F., Cesarano, C., Picariello, A. and Reforgiato, D. 2007. Sentiment analysis: adjectives and adverbs are better than adjectives alone. In ICWMS 2007, Boulder, CO USA, p. 1--7, 2007.

[4]

Bevan, N. 2009. What is the difference between the purpose of usability and user experience evaluation methods? In UXEM'09, INTERACT 2009, Uppsala, Sweden, p. 24--28, 2009.

[5]

Diakopoulos, N.; Naaman, M.; Kivran-Swaine, F. Diamonds in the Rough: Social Media Visual Analytics for Journalistic Inquiry. IEEE Symposium on Visual Analytics Science and Technology, October 24-29, Salt Lake City, Utah, USA, 2010

[6]

Elmasri, R; Navathe, S., B. Fundamentals of database systems. 6a Ed., 2011.

Digital Library

[7]

Freitas, L.; Silva, T.; Mendes,. M. Avaliação do Spotify -- uma experiência de avaliação textual utilizando a metodologia MALTU. In IHC 2016, São Paulo, Brazil (2016)

[8]

Gaizauskas, R. e Wilks, Y. Information extraction: beyond document retrieval. In Computational Linguistics and Chinese Language Processing, vol.3, no.2, 17--60, 1998.

[9]

Hassenzahl, M., Tractinsky, N. 2006. User experience - a research agenda, Behaviour & Information Technology. In Behaviour & Information Technology, Taylor & Francis Group content, p. 91--97, 2011.

[10]

Hedegaard, S.; Simonsen, J. G. Extracting Usability and User Experience Information from Online User Reviews. In: CHI: Changing Perspectives, Paris, 2013.

Digital Library

[11]

Imran et al. Extracting Information Nuggets from Disaster-Related Messages in Social Media. In: International ISCRAM Conference, 10, Baden-Baden, 2013.

[12]

ISO DIS 9241 - 210:2008. Ergonomics of human system interaction - Part 210: Human -centred design for interactive systems (formerly known as 13407).

[13]

Ketola, Pekka; Roto, Virpi. Exploring user experience measurement needs. 5th COST294-MAUSE Open Workshop on Valid Useful User Experience Measurement, 2008.

[14]

Korhonen, Hannu; Arrasvuori, Juha; Väänänen-Vainio-Mattila, Kaisa. Let users tell the story. In CHI 2010, The ACM Press, Atlanta, p. 4051--4056, 2010.

Digital Library

[15]

Mendes, M. S.: MALTU - Model for evaluation of interaction in social systems from the Users Textual Language. 200 f. Thesis (PhD in computer science) -- Federal University of Ceará (UFC), Fortaleza, CE -- Brazil (2015)

[16]

Mendes, M., Furtado, E., Castro, M. F.: Do users write about the system in use? An investigation from messages in Natural Language on Twitter. In 7th Euro American Association on Telematics and Information Systems (2014)

Digital Library

[17]

Mendes, M. S.; Furtado, E. S.; Castro, M. F. Do users write about the system in use? An investigation from messages in Natural Language on Twitter. 7th Euro American Association on Telematics and Information Systems (EATIS 2014), Valparaiso, Chile (2014)

Digital Library

[18]

Silva, T.; Freitas, L.; Mendes,. M. Além das avaliações tradicionais: a visão dos usuários nas lojas de aplicativos. In IHC 2017, Joinville, Brazil (2017)

[19]

Mendes, M. S.; Furtado, E. S.; Furtado, V.; Castro, M. F. Investigating Usability and User Experience from the user postings in Social Systems. In HCI International, (2015)

[20]

Mendes, M., Furtado, E., Theophilo, F., Castro, M. F.: A Study about the usability evaluation of Social Systems from messages in Natural Language. In CLIHC 2013 (2013).

[21]

Olsson, T.; Salo, M. Narratives of satisfying and unsatisfying experiences of current mobile augmented reality applications. In CHI 2012, The ACM Press, p. 2779--2788, 2012.

Digital Library

[22]

Partala, T.; Kallinen, A. Understanding the most satisfying and unsatisfying user experiences: Emotions, psychological needs, and context. In Interacting with Computers 24, p. 25--34, 2012

Digital Library

[23]

Preece, J., Rogers, Y. and Sharp,H. 2002. Interaction design:Beyond human-computer interaction. Wiley.

Digital Library

[24]

Taboada, M.; Brooke, J.; Tofiloski, M.; Voll, K.; Stede, M. Lexicon-basedmethods for sentiment analysis. In Association for Computational Linguistics, v. 37, n. 2, 2011.

Digital Library

[25]

Tuch, A. N., Trusell, R. N., And Hornbæk, K.: Analyzing Users' Narratives to Understand Experience with Interactive Products. In CHI 2013, The ACM Press, p. 2079--2088, 2013.

Digital Library

[26]

Lima, A. M. S., Silva, P. B. S., Cruz, L. A., Mendes, M. S. Investigating the polarity of user postings in a Social System. HCII 2017.

Cited By

Costa RSoares TLunardi GValle PSilva W(2024)Professionals' Perceptions of the Interaction between User Experience and Machine LearningProceedings of the 20th Brazilian Symposium on Information Systems10.1145/3658271.3658341(1-9)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3658271.3658341
Chromik MLachner FButz ALamas DSarapuu HŠmorgun IBerget G(2020)ML for UX? - An Inventory and Predictions on the Use of Machine Learning Techniques for UX ResearchProceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society10.1145/3419249.3420163(1-11)Online publication date: 25-Oct-2020
https://dl.acm.org/doi/10.1145/3419249.3420163
Furtado EMendes MOliveira DLima L(2020)An Analysis of UX Based on Users’ Emotional Intention and Values, Both Expressed Through Twitter PostsSoftware Ecosystems, Sustainability and Human Values in the Social Web10.1007/978-3-030-46130-0_5(79-98)Online publication date: 23-Apr-2020
https://doi.org/10.1007/978-3-030-46130-0_5
Show More Cited By

Index Terms

UUX-Posts: a tool for extracting and classifying postings related to the use of a system
1. Human-centered computing

Recommendations

Beyond traditional evaluations: user's view in app stores
IHC '17: Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems

The choice of apps by users in App Stores is influenced by other users' ratings (reviews and star ratings). However, it is unclear what the relationship between user appraisal and an Usability and User eXperience (UUX) evaluation. In this paper, we will ...
An Experience of Textual Evaluation Using the MALTU Methodology
Social Computing and Social Media. Technologies and Analytics
Abstract
This paper presents an experience of textual evaluation in Usability and User eXperience in an academic system. The methodology used for the textual evaluation was MALTU. In this study, we analyzed 650 postings from an academic system and these ...
Evaluation of Spotify: an evaluation textual experience using the Maltu methodology
IHC '16: Proceedings of the 15th Brazilian Symposium on Human Factors in Computing Systems

This paper presents a textual evaluation experience in Usability and User eXperience of Spotify application. The methodology used for the textual evaluation was MALTU. In this study, we collected 100 users' postings from a popular website (Reclame Aqui) ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

CLIHC '17: Proceedings of the 8th Latin American Conference on Human-Computer Interaction

November 2017

136 pages

ISBN:9781450354295

DOI:10.1145/3151470

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 November 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CLIHC '17

CLIHC '17: 8th Latin American Conference on Human-Computer Interaction

November 8 - 10, 2017

Antigua Guatemala, Guatemala

Acceptance Rates

Overall Acceptance Rate 14 of 42 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
142
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Costa RSoares TLunardi GValle PSilva W(2024)Professionals' Perceptions of the Interaction between User Experience and Machine LearningProceedings of the 20th Brazilian Symposium on Information Systems10.1145/3658271.3658341(1-9)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3658271.3658341
Chromik MLachner FButz ALamas DSarapuu HŠmorgun IBerget G(2020)ML for UX? - An Inventory and Predictions on the Use of Machine Learning Techniques for UX ResearchProceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society10.1145/3419249.3420163(1-11)Online publication date: 25-Oct-2020
https://dl.acm.org/doi/10.1145/3419249.3420163
Furtado EMendes MOliveira DLima L(2020)An Analysis of UX Based on Users’ Emotional Intention and Values, Both Expressed Through Twitter PostsSoftware Ecosystems, Sustainability and Human Values in the Social Web10.1007/978-3-030-46130-0_5(79-98)Online publication date: 23-Apr-2020
https://doi.org/10.1007/978-3-030-46130-0_5
Silva PSilva TMendes MFurtado MGuimaraes RSaibel Santos Cde Santana VKronbauer A(2019)Temporal analysis of posts related to useProceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems10.1145/3357155.3358482(1-10)Online publication date: 22-Oct-2019
https://dl.acm.org/doi/10.1145/3357155.3358482
Lima AMendes MCruz L(2019)Enrichment of dictionaries to improve the automatic classification of feelings in postings related to the use of systemsProceedings of the XV Brazilian Symposium on Information Systems10.1145/3330204.3330219(1-8)Online publication date: 20-May-2019
https://dl.acm.org/doi/10.1145/3330204.3330219
Darin TCoelho BBorges B(2019)Which Instrument Should I Use? Supporting Decision-Making About the Evaluation of User ExperienceDesign, User Experience, and Usability. Practice and Case Studies10.1007/978-3-030-23535-2_4(49-67)Online publication date: 26-Jul-2019
https://dl.acm.org/doi/10.1007/978-3-030-23535-2_4
Mendes MFurtado E(2018)An Experience of Textual Evaluation Using the MALTU MethodologySocial Computing and Social Media. Technologies and Analytics10.1007/978-3-319-91485-5_18(236-246)Online publication date: 31-May-2018
https://doi.org/10.1007/978-3-319-91485-5_18
da Silva TFreitas LMendes MGasparini IPiccolo LZaina LPereira R(2017)Beyond traditional evaluationsProceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems10.1145/3160504.3160548(1-10)Online publication date: 23-Oct-2017
https://dl.acm.org/doi/10.1145/3160504.3160548

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents