Article

User-centred design and evaluation of ubiquitous services

Authors:

Janienke Sturm,

Jacques TerkenAuthors Info & Claims

SIGDOC '05: Proceedings of the 23rd annual international conference on Design of communication: documenting & designing for pervasive information

Pages 138 - 145

https://doi.org/10.1145/1085313.1085346

Published: 21 September 2005 Publication History

Abstract

Theoretical and technological progress has revived the interest in the design of services for the support of co-located human-human communication and collaboration, witnessing the start of several large-scale projects over the last few years. Most of these projects focus on meetings and/or lecture situations. However, user-centred design and evaluation frameworks for co-located communication and collaboration are a major concern. In this paper, we summarise the prevalent approaches towards user-centred design and evaluation, and we develop two different services. In one service, participants in a small-group meeting receive real-time feedback about observable properties of the meeting that are directly related to the social dynamics, such as individual amount of speaking time or eye-gaze patterns. In the other service, teachers in a classroom receive real-time feedback about the activities and attention level of participants in the lecture. We also propose ways to address the different dimensions that are relevant to the design and evaluation of these services (the individual, the social and the organisational dimension), bringing together methods from different disciplines.

References

[1]

Weiser, M. (1993): 'Some Computer Science Issues in Ubiquitous Computing', Communications of the ACM, 36, 75--84.

Digital Library

[2]

Weiser M. and Seely Brown, J. (1996): 'The Coming Age of Calm Technology', in P. J. Denning and R. M. Metcalfe "Beyond Calculation - The Next Fifty Years of Computing", Copernicus/An Imprint of Springer-Verlag.

Digital Library

[3]

Grudin, J. (1994):'Groupware and social dynamics: Eight challenges for developers', Communications of the ACM, 37(1), 92--105.

Digital Library

[4]

http://chil.server.de

[5]

http://www.ipsi.fraunhofer.de

[6]

Johanson, B., Fox, A., and Winograd, T. (2002): 'The Interactive Workspaces Project: Experiences with Ubiquitous Computing Rooms', IEEE Pervasive Computing Magazine, 1(2).

Digital Library

[7]

Oh, A., Tuchinda, R. and Wu, L. (2001): 'Meeting Manager: A Collaborative Tool in the Intelligent room', Proceedings of Student Oxygen Workshop, 2001.

[8]

http://www.m4project.org

[9]

Renals, S. and Ellis, D. (2003): 'Audio Information Access from Meeting Rooms', Proceedings of ICASSP 2003, Hong Kong.

[10]

http://www.amiproject.org

[11]

McCowan, I., Gatica-Perez, D., Bengio, D., Moore, D., and Bourlard, H. (2003): 'Towards Computer Understanding of Human Interactions', Proceedings European Symposium on Ambient Intelligence (EUSAI) (invited keynote paper), Eindhoven.

[12]

http://www.icsi.berkeley.edu

[13]

Whittaker, S., Hyland, P., and Wiley, M. (1994): 'Filochat: Handwritten Notes Provide Access To Recorded Conversations', Proceedings of CHI '94, Boston, Massachusetts, USA.

Digital Library

[14]

Wilcox, L.D., Schilit, B.N., and Sawhney, N. (1997): 'Dynomite: A Dynamically Organized Ink and Audio Notebook', Proceedings of CHI'97, 186--193.

Digital Library

[15]

Fox, H. (2003): 'The eFacilitator: A Meeting Capture Application and Infrastructure for Intelligent Environments', Proceedings of Student Oxygen Workshop, 2003.

[16]

Abowd, G.D. (1999): 'Classroom 2000: An Experiment with the Instrumentation of a Living Educational Environment', IBM Systems Journal, Special issue on Pervasive computing, 38(4), 508--530.

Digital Library

[17]

DiMicco, J.M., Pandolfo, A., and Bender, W. (2004): 'Influencing Group Participation with a Shared Display', Computer Supported Cooperative Work, ACM Press, USA. pp. 614--623.

Digital Library

[18]

Katagiri, Y., Bono, M., and Suzuki, N. (2004): 'Capture Conversational Participation in a Ubiquitous Sensor Environment', Pervasive Workshop on Memory and Sharing of Experiences.

[19]

Goguen, J.A., and Linde, C. (1993): 'Techniques for Requirements Elicitation, Requirements Engineering', IEEE Computer, pp. 152--164.

[20]

Dix, A., Finlay J., Abowd, G., Beale, R., Human Computer Interaction, Prentice Hall, 2004.

Digital Library

[21]

Bardra, K.E. (2000): 'Scenario-Based Design of Cooperative Systems Re-designing an Hospital Information System in Denmark', Group Decision and Negotiation, 9, 237--250.

[22]

Pinelle, D., and Gutwin, C. (2003): 'Task Analysis for Groupware Usability Evaluation: Modeling Shared-Workspace Tasks with the Mechanics of Collaboration', ACM transactions on Computer-Human Interaction, 10(4), 281--311.

Digital Library

[23]

Abowd, G.D. and Mynatt, E.D. (2000): 'Charting Past, Present, and Future Research in Ubiquitous Computing', ACM Transactions on Computer Human Interaction, Special Issue on HCI.

Digital Library

[24]

Ehrlich, K. (1999): 'Designing Groupware Applications: A Work-Centered Design Approach', in Beaudouin-Lafon (ed.): Computer Supported Cooperative Work, 1999, John Wiley & Sons Ltd.

[25]

Wellner, P., Flynn, M., and Guillemot, M. (2005): 'Browsing Recorded Meetings with Ferret', in Bengio, S. and Bourlard, H. (Eds.) MLMI, pp.12--21, Springer-Verlag Berlin Heidelberg.

Digital Library

[26]

Wilcox, L.D., Schilit, B.N., and Sawhney, N. (1997): 'Dynomite: A Dynamically Organized Ink and Audio Notebook', Proceedings of CHI'97, 186--193.

Digital Library

[27]

Mynatt, E.D., Igarshi, T., Edward, W.K., and LaMarca, A. (1999): 'Flatland: New dimensions in office whiteboards', ACM conference on Human Factors in Computing Systems.

Digital Library

[28]

Poltrock, S., Grudin, J., Dumais, S., Fidel, R., Bruce, H., and Pejtersen, A.M. (2003) 'Information seeking and sharing in design teams', Proceedings of the 2003 international ACM SIGGROUP conference on Supporting group work, November 09-12, 2003.

Digital Library

[29]

Crabtree, A. (2003): Designing Collaborative Systems: A Practical Guide to Ethnography, London: Springer-Verlag.

Digital Library

[30]

Ramage, M. (1999): 'Evaluation of Cooperative Systems', Ph.D. thesis, Cooperative System Engineering Group, Lancaster University.

[31]

Van der Veer, G.C., Welie, M.V, and Thorborg, D. (1999): 'Modeling Complex Processes in GTA', Ergonomics, 42(11).

[32]

Brotherton, J.A. (2001): 'Enriching Everyday Experiences through the Automated Capture and Access of Live Experiences: eClass: Building, Observing and Understanding the Impact of Capture and Access in an Educational Domain', Ph.D. Thesis, Georgia Tech.

Digital Library

[33]

Brotherton, J.A. and Abowd, G.D. (2004): 'Lessons Learned from eClass: Assessing Automated Capture and Access in the Classroom', ACM Transactions on Computer-Human Interaction, Vol. 11, no.2, June 2004, pp. 121--155.

Digital Library

[34]

Steves, P.M., Morse, E., Gutwin, C., and Greenberg, S. (2001): 'A Comparison of Usage Evaluation and Inspection Methods for Assessing Groupware Usability', Proceedings of Group 2001.

Digital Library

[35]

Neale, D.C., Carroll, J.M. and Rosson, M.B. (2004): 'Evaluating Computer-Supported Cooperative Work: Models and Frameworks', ACM Press: Proceedings of CSCW'04, Chicago, pp. 112--121.

Digital Library

[36]

Horvitz, E., Kadie, C., Paek, T., and Hovel, D. (2003): 'Models of Attention in Computing and Communication: From Principles to Applications', Communications of the ACM, 46 (3), 52--59.

Digital Library

[37]

Paris, C.P., Sala, E., and Cannon-Bowers, J.A. (2000): 'Teamwork in Multi-person System: A Review and Analysis', Ergonomics, 43(8), 1052--1075.

[38]

Bing, J.W. (2001): 'Developing a Consulting Tool to Measure Process Change on Global Teams: The Global Team Process Questionnaire™, paper presented at the 2001 Academy of Human Resource Development Conference, Tulsa, OK.

Cited By

Akhigbe B(2021)UcEF for Semantic IRAdvanced Concepts, Methods, and Applications in Semantic Computing10.4018/978-1-7998-6697-8.ch010(190-217)Online publication date: 2021
https://doi.org/10.4018/978-1-7998-6697-8.ch010
Carvalho RAndrade Rde Oliveira K(2018)AQUArIUM - A suite of software measures for HCI quality evaluation of ubiquitous mobile applicationsJournal of Systems and Software10.1016/j.jss.2017.11.022136:C(101-136)Online publication date: 1-Feb-2018
https://dl.acm.org/doi/10.1016/j.jss.2017.11.022
Amin SHijji MIqbal RHarrop WChang V(2017)Fuzzy expert system-based framework for flood management in Saudi ArabiaCluster Computing10.1007/s10586-017-1465-4Online publication date: 19-Dec-2017
https://doi.org/10.1007/s10586-017-1465-4
Show More Cited By

Index Terms

User-centred design and evaluation of ubiquitous services

Recommendations

User-centered design, activity-centered design, and goal-directed design: a review of three methods for designing web applications
SIGDOC '09: Proceedings of the 27th ACM international conference on Design of communication

When conducting research with users in order to design web applications, the practitioner has a variety of methods from which to choose. This paper examines three such methods'User-Centered Design (UCD), Goal-Directed Design (GDD), and Activity-Centered ...
Comparing collaboration and individual personas for the design and evaluation of collaboration software
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Collaboration personas are a tool that can be used to design for groups. Prior work posits that collaboration personas can improve tool adoption by helping designers create collaboration tools that are better targeted to the goals, needs, and ...
Evaluating meeting support tools
Special Issue: User-centred design and evaluation of ubiquitous groupware

Many attempts are underway for developing meeting support tools, but less attention is paid to the evaluation of meetingware. This article describes the development and testing of an instrument for evaluating meeting tools. First, we specified the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGDOC '05: Proceedings of the 23rd annual international conference on Design of communication: documenting & designing for pervasive information

September 2005

176 pages

ISBN:1595931759

DOI:10.1145/1085313

General Chair:
Scott Tilley
Florida Institute of Technology, USA
,
Program Chair:
Robert M. Newman
Coventry University, UK

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 September 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGDOC05

Sponsor:

SIGDOC05: ACM 23rd Annual International Conference on Documentation

September 21 - 23, 2005

Coventry, United Kingdom

Acceptance Rates

Overall Acceptance Rate 355 of 582 submissions, 61%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

32
Total Citations
View Citations
1,396
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)3

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Akhigbe B(2021)UcEF for Semantic IRAdvanced Concepts, Methods, and Applications in Semantic Computing10.4018/978-1-7998-6697-8.ch010(190-217)Online publication date: 2021
https://doi.org/10.4018/978-1-7998-6697-8.ch010
Carvalho RAndrade Rde Oliveira K(2018)AQUArIUM - A suite of software measures for HCI quality evaluation of ubiquitous mobile applicationsJournal of Systems and Software10.1016/j.jss.2017.11.022136:C(101-136)Online publication date: 1-Feb-2018
https://dl.acm.org/doi/10.1016/j.jss.2017.11.022
Amin SHijji MIqbal RHarrop WChang V(2017)Fuzzy expert system-based framework for flood management in Saudi ArabiaCluster Computing10.1007/s10586-017-1465-4Online publication date: 19-Dec-2017
https://doi.org/10.1007/s10586-017-1465-4
Maniak TIqbal RDoctor F(2017)Traffic Modelling, Visualisation and Prediction for Urban Mobility ManagementAdvances in Hybridization of Intelligent Methods10.1007/978-3-319-66790-4_4(57-70)Online publication date: 15-Oct-2017
https://doi.org/10.1007/978-3-319-66790-4_4
da Silva Junior Dde Souza PMaciel C(2016)Establishing Guidelines for User Quality of Experience in Ubiquitous SystemsDistributed, Ambient and Pervasive Interactions10.1007/978-3-319-39862-4_5(46-57)Online publication date: 21-Jun-2016
https://doi.org/10.1007/978-3-319-39862-4_5
Marcinkowski MFonseca F(2016)The conditions of peak empiricism in big data and interaction designJournal of the Association for Information Science and Technology10.1002/asi.2349767:6(1279-1288)Online publication date: 1-Jun-2016
https://dl.acm.org/doi/10.1002/asi.23497
Jimenez-Molina AKo I(2015)Cognitive resource-aware unobtrusive service provisioning in ambient intelligence environmentsJournal of Ambient Intelligence and Smart Environments10.5555/2750726.27507317:1(37-57)Online publication date: 1-Jan-2015
https://dl.acm.org/doi/10.5555/2750726.2750731
Jimenez-Molina AKo I(2015)Cognitive resource-aware unobtrusive service provisioning in ambient intelligence environmentsJournal of Ambient Intelligence and Smart Environments10.5555/2724694.27246997:1(37-57)Online publication date: 1-Jan-2015
https://dl.acm.org/doi/10.5555/2724694.2724699
Santos Rde Oliveira KAndrade RSantos ILima E(2013)A Quality Model for Human-Computer Interaction Evaluation in Ubiquitous SystemsHuman Computer Interaction10.1007/978-3-319-03068-5_13(63-70)Online publication date: 2013
https://doi.org/10.1007/978-3-319-03068-5_13
Nava-Muñoz SMorán A(2012)CANoE: A Context-Aware Notification Model to Support the Care of Older Adults in a Nursing HomeSensors10.3390/s12091147712:9(11477-11504)Online publication date: 24-Aug-2012
https://doi.org/10.3390/s120911477
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents