Activity evaluation: a video-based approach to iterative prototype design
Authors: 
Grace Eden, Florian Evéquoz, Esther González-Martínez, Antoine Widmer, Roger Schaer, Marcel Henry, Henning MüllerAuthors Info & Claims
Pages 314 - 320
Abstract
Naturalistic prototype evaluation is an approach that can be used to assess a technology's potential practical application in real-world settings and situations (its usefulness) and to evaluate the interface (its usability). This paper discusses our development of a novel prototype evaluation technique; the Activity Evaluation Framework (AEF). AEF is informed by a sociological orientation, Ethnomethodology and uses video in the analysis of participants' 'talk-in-interaction' as they interact with technology. We discuss the use of AEF as a systematic and robust qualitative technique for the evaluation of both the usefulness and usability of prototypes.
Supplementary Material
Supplemental material.
- Download
- 600.12 KB
References
[1]
Deborah Tatar. 1989. Using video-based observation to shape the design of new technology. SIGCHI Bulletin, 21, 2: 108--111.
[2]
Monika Büscher. 2005. Social life under the microscope?. Sociological Research Online.
[3]
Marina Jirotka and Paul Luff. 2006. Supporting requirements with video-based analysis. IEEE Software, 23, 3 : 42--44.
[4]
Jon Hindmarsh and Christian Heath. 2007. Video-based studies of work. Sociology Compass, 1, 1: 156--173.
[5]
Lucy Suchman and Randall H. Trigg. 1991. Understanding practice: Video as a medium for reflection and design. In Greenbaum, J., Kyng, M. (eds.) Design at Work: Cooperative Design of Computer Systems. Hillsdale, Lawrence Erlbaum Associates: 65--89.
[6]
Grace de la Flor, Paul Luff, Marina Jirotka, John Pybus, Ruth Kirkham and Annamaria Carusi. (2010). The case of the Disappearing Ox: Seeing through digital images to an analysis of ancient Texts. In Proceedings of 28th ACM Conference on Human Factors in Computing Systems (CHI 2010), New York, ACM: 473--482.
[7]
Kaj Grønbæk. 1990. Supporting active user involvement in prototyping. Scandinavian Journal of Information Systems, 2: 3--24.
[8]
Terry Winograd and Fernando Flores. 1987. Understanding computers and cognition. Reading: Addison-Wesley.
[9]
Andy Crabtree. 2003. Designing Collaborative Systems: A Practical Guide to Ethnography. London :Springer.
[10]
Lucy Suchman. 2007. Human-machine reconfigurations: plans and situated actions, Cambridge : Cambridge University Press.
[11]
John C. Tang and Larry J. Leifer. 1991. An observational methodology for studying group design activity. Research in Engineering Design, 2: 209--219.
[12]
Silvia Urquijo, Stephen Scrivener and Hilary Palmén. 1993. The use of breakdown analysis in synchronous CSCW system design. In Proceedings of the 3rd European Conference on Computer-Supported Cooperative Work, (ECSCW '93), Dordrecht, Springer: 281--294.
[13]
David Martin, Tom Rodden, Mark Rouncefield, Ian Sommerville and Stephen Viller. 2001. Finding patterns in fieldwork. In Proceedings of the 7th European Conference on Computer-Supported Cooperative Work (ECSCW '01), Dordrecht, Springer: 39--58.
[14]
Harold Garfinkel. 1996. Ethnomethodology's programme. Social Psychology Quarterly, 59, 1: 5--21.
[15]
Harold Garfinkel. 1967. Studies in Ethnomethodology. Englewood Cliffs: Prentice-Hall.
[16]
Lucy Suchman and Randall H. Trigg. 1991. Understanding practice: Video as a medium for reflection and design. In Greenbaum, J., Kyng, M. (eds.) Design at Work: Cooperative Design of Computer Systems. Hillsdale, Lawrence Erlbaum Associates: 65--89.
Recommendations
Prototype evaluation and user-needs analysis in the early design of emerging technologies
HCI'07: Proceedings of the 12th international conference on Human-computer interaction: interaction design and usabilityThis paper presents two case studies of prototype evaluation as a tool for user needs elicitation for emerging technologies. In the first user evaluation, a high-fidelity virtual reality prototype is used. In the second one, a low-fidelity mixed reality ...
Virtual and augmented reality for cultural computing and heritage: a case study of virtual exploration of underwater archaeological sites (preprint)
The paper presents different issues dealing with both the preservation of cultural heritage using virtual reality (VR) and augmented reality (AR) technologies in a cultural context. While the VR/AR technologies are mentioned, the attention is paid to ...
Virtual and augmented reality for cultural computing and heritage: a case study of virtual exploration of underwater archaeological sites (preprint)
Special Issue on Cultural TechnologyThe paper presents different issues dealing with both the preservation of cultural heritage using virtual reality (VR) and augmented reality (AR) technologies in a cultural context. While the VR/AR technologies are mentioned, the attention is paid to ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2016
346 pages
Copyright © 2016 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 25 October 2016
Check for updates
Author Tags
Qualifiers
- Extended-abstract
Conference
IHM '16
IHM '16: 28ème conférence francophone sur l'Interaction Homme-Machine
October 25 - 28, 2016
Fribourg, Switzerland
Acceptance Rates
IHM '16 Paper Acceptance Rate 21 of 33 submissions, 64%;
Overall Acceptance Rate 103 of 199 submissions, 52%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 64Total Downloads
- Downloads (Last 12 months)4
- Downloads (Last 6 weeks)0
Reflects downloads up to 18 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in