demonstration

Automated Usability Tests for Mobile Devices through Live Emotions Logging

Authors:

MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

Pages 636 - 643

https://doi.org/10.1145/2786567.2792902

Published: 24 August 2015 Publication History

Get Access

Abstract

Usability tests for mobile phones software present several consistent obstacles. The issue of observing users' interaction within a controlled and supervised environment versus unsupervised field tests is a significant one. Additionally, the burden of frequently time-consuming and expensive usability tests for small software development teams are evident. This work proposes the use of a system to implement emotions logging in automated usability tests for mobile phones. We do this by efficiently, easily and cost-effectively assessing the users' affective state by evaluating their expressive reactions during a mobile software usability evaluation process. These reactions are collected using the front camera on mobile devices.

References

[1]

Lettner, Florian, and Clemens Holzmann. "Automated and unsupervised user interaction logging as basis for usability evaluation of mobile applications." In Proceedings of the 10th International Conference on Advances in Mobile Computing & Multimedia, pp. 118--127. ACM, 2012.

Digital Library

Google Scholar

[2]

de Lera, Eva, and Muriel Garreta-Domingo. "Ten emotion heuristics: guidelines for assessing the user's affective dimension easily and cost-effectively." In Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI... but not as we know it-Volume 2, pp. 163--166. British Computer Society, 2007.

Digital Library

Google Scholar

[3]

Spillers, F.: Emotion as a Cognitive Artifact and the Design Implications for Products that are Perceived as Pleasurable. Retrieved on 18 February, 2007 from http://www.experiencedynamics.com/pdfs/published_works/Spillers-EmotionDesign-Proceedings.pdf

Google Scholar

[4]

Madrigal, D., and McClain, B. Usability for mobile devices, September 2010. http://www.uxmatters.com/mt/archives/2010/09/usabilityfor-mobile-devices.php.

Google Scholar

[5]

Oztoprak, A., and Erbug, C. Field versus laboratory usability testing: A first comparison. Tech. rep., Department of Industrial Design - Middle East Technical University, Faculty of Architecture, 2008.

Google Scholar

[6]

Picard, R. W., and Daily, S.B. Evaluating affective interactions: Alternatives to asking what users feel. Presented at CHI 2005 Workshop 'Evaluating Affective Interfaces' (Portland, OR, April 2--7,2005).Anderson, R.E. Social impacts of computing:

Google Scholar

[7]

Codes of professional ethics. Social Science Computing Review 10, 2 (1992), 453--469.

Google Scholar

[8]

Google Scholar

[9]

Harty, Julian. "Finding Usability Bugs with Automated Tests." Commun. ACM 54, no. 2 (2011): 44--49.

Digital Library

Google Scholar

[10]

Madrigal, D., and McClain, B. Usability for mobile devices, September 2010. http://www.uxmatters.com/mt/archives/2010/09/usabilityfor-mobile-devices.php

Google Scholar

[11]

Hertzum, M. User testing in industry: A case study of laboratory, workshop, and field tests. In Proceedings of the 5th ERCIM Workshop on "User Interfaces for All" (1999).

Google Scholar

[12]

Kaikkonen, A., Kallio, T., Kekäläinen, A., Kankainen, A., and Cankar, M. Usability testing of mobile applications: A comparison between laboratory and field testing. Journal of Usability Studies 1 (2005), 4--16.

Digital Library

Google Scholar

[13]

J Staiano, M Menendez, A Battocchi, A De Angeli, N Sebe, UX Mate: From facial expressions to UX evaluation, Proceedings of the Designing Interactive Systems Conference, 741--750, ACM DIS 2012;

Digital Library

Google Scholar

[14]

Intel RealSense SDK - https://software.intel.com/en-us/intel-realsense-sdk

Google Scholar

Cited By

View all

Romeiro CAraújo P(2022)Definition of Guideline-Based Metrics to Evaluate AAL Ecosystem’s UsabilityHuman Behavior and Emerging Technologies10.1155/2022/89390722022(1-19)Online publication date: 14-Nov-2022
https://doi.org/10.1155/2022/8939072
Júnior MAmalfitano DGarcés LFasolino AAndrade SDelamaro M(2022)Dynamic Testing Techniques of Non-functional Requirements in Mobile Apps: A Systematic Mapping StudyACM Computing Surveys10.1145/350790354:10s(1-38)Online publication date: 13-Sep-2022
https://dl.acm.org/doi/10.1145/3507903
Novielli NGrassi DLanubile FSerebrenik A(2022)Sensor-Based Emotion Recognition in Software Development: Facial Expressions as Gold Standard2022 10th International Conference on Affective Computing and Intelligent Interaction (ACII)10.1109/ACII55700.2022.9953808(1-8)Online publication date: 18-Oct-2022
https://doi.org/10.1109/ACII55700.2022.9953808
Show More Cited By

Index Terms

Automated Usability Tests for Mobile Devices through Live Emotions Logging
1. Human-centered computing

Recommendations

Affective-ready, contextual and automated usability test for mobile software
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

This work proposes the use of system to perform affective-ready, contextual and automated usability tests for mobile software. Our proposal augments the traditional methods of software usability evaluation by monitoring users' location, weather ...
Emotions, experiences and usability in real-life mobile phone use
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Positive emotional experiences with an interactive product are assumed to lead to good user experience and, ultimately, to product success. However, the path from emotional experiences to product evaluation may not be direct, as emotions fluctuate over ...
Mobile Phone Usability Questionnaire (MPUQ) and Automated Usability Evaluation
Proceedings of the 13th International Conference on Human-Computer Interaction. Part I: New Trends

The mobile phone has become one of the most popular products amongst today's consumers. The Mobile Phone Usability Questionnaire (MPUQ) was developed to provide an effective subjective usability measurement tool, tailored specifically to the mobile ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

August 2015

697 pages

ISBN:9781450336536

DOI:10.1145/2786567

General Chairs:
Sebastian Boring
University of Copenhagen, Denmark
,
Enrico Rukzio
University of Ulm, Germany
,
Program Chairs:
Hans Gellersen
Lancaster University, UK
,
Ken Hinckley
Microsoft Research Redmond, USA

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 August 2015

Check for updates

Author Tags

Qualifiers

Demonstration
Research
Refereed limited

Conference

MobileHCI '15

Sponsor:

SIGCHI

MobileHCI '15: 17th International Conference on Human-Computer Interaction with Mobile Devices and Services

August 24 - 27, 2015

Copenhagen, Denmark

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
251
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Romeiro CAraújo P(2022)Definition of Guideline-Based Metrics to Evaluate AAL Ecosystem’s UsabilityHuman Behavior and Emerging Technologies10.1155/2022/89390722022(1-19)Online publication date: 14-Nov-2022
https://doi.org/10.1155/2022/8939072
Júnior MAmalfitano DGarcés LFasolino AAndrade SDelamaro M(2022)Dynamic Testing Techniques of Non-functional Requirements in Mobile Apps: A Systematic Mapping StudyACM Computing Surveys10.1145/350790354:10s(1-38)Online publication date: 13-Sep-2022
https://dl.acm.org/doi/10.1145/3507903
Novielli NGrassi DLanubile FSerebrenik A(2022)Sensor-Based Emotion Recognition in Software Development: Facial Expressions as Gold Standard2022 10th International Conference on Affective Computing and Intelligent Interaction (ACII)10.1109/ACII55700.2022.9953808(1-8)Online publication date: 18-Oct-2022
https://doi.org/10.1109/ACII55700.2022.9953808
Hwang HLee Y(2021)Usability Problem Identification Based on Explainable Neural Network in Asynchronous Testing EnvironmentInteracting with Computers10.1093/iwc/iwab01833:2(155-166)Online publication date: 5-Aug-2021
https://doi.org/10.1093/iwc/iwab018
Benvenuti DBuda EFraioli FMarrella ACatarci T(2021)Detecting and Explaining Usability Issues of Consumer Electronic ProductsHuman-Computer Interaction – INTERACT 202110.1007/978-3-030-85610-6_18(298-319)Online publication date: 26-Aug-2021
https://doi.org/10.1007/978-3-030-85610-6_18
de Souza Veriscimo EBernardes Júnior JDigiampietri L(2021)Facial Emotion Recognition in UX Evaluation: A Systematic ReviewHuman-Computer Interaction. Theory, Methods and Tools10.1007/978-3-030-78462-1_40(521-534)Online publication date: 3-Jul-2021
https://doi.org/10.1007/978-3-030-78462-1_40
Chromik MLachner FButz ALamas DSarapuu HŠmorgun IBerget G(2020)ML for UX? - An Inventory and Predictions on the Use of Machine Learning Techniques for UX ResearchProceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society10.1145/3419249.3420163(1-11)Online publication date: 25-Oct-2020
https://dl.acm.org/doi/10.1145/3419249.3420163
Johanssen JBernius JBruegge B(2019)Toward usability problem identification based on user emotions derived from facial expressionsProceedings of the 4th International Workshop on Emotion Awareness in Software Engineering10.1109/SEmotion.2019.00008(1-7)Online publication date: 28-May-2019
https://dl.acm.org/doi/10.1109/SEmotion.2019.00008
Duran-Saez RFerre XZhu HLiu Q(2017)Task Analysis-Based User Event Logging for Mobile Applications2017 IEEE 25th International Requirements Engineering Conference Workshops (REW)10.1109/REW.2017.45(152-155)Online publication date: Sep-2017
https://doi.org/10.1109/REW.2017.45
Ferre XVillalba EJulio HZhu H(2017)Extending Mobile App Analytics for Usability Test LoggingHuman-Computer Interaction – INTERACT 201710.1007/978-3-319-67687-6_9(114-131)Online publication date: 21-Sep-2017
https://doi.org/10.1007/978-3-319-67687-6_9

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Affective-ready, contextual and automated usability test for mobile software

Emotions, experiences and usability in real-life mobile phone use

Mobile Phone Usability Questionnaire (MPUQ) and Automated Usability Evaluation