Abstract
In this paper we describe an user evaluation that aimed to understand how a group of endusers interpret a visual analytics tool in the context of service delivery. It is common for service factories to have an organization devoted to handle incidents. Many incident management systems have strict controls on how fast incidents should be handled, often subjected to penalties when targets are not met.We call Time-Bounded Incident Management (TBIM) those systems, which require clearly defined incident resolution times. In our project, research scientists proposed a method and a visual representation named Workload Profile Chart (WPC) that had as primary goal to understand the area of incident management in a service delivery department. The objective of this visual representation is to help characterizing the performance of TBIM systems and diagnosing major issues such as resource and skill allocation problems, abnormal behavior, and incident characteristics. Researchers wanted to understand if end-users, the quality analysts (QAs), would comprehend the charts and would be able to use them to identify problems and propose effective improvement actions related to TBIM activities. The study was conducted with ten QAs of a service delivery department of a IT company based in Brazil. The data was analyzed using descriptive statistical and qualitative methods. As a result, participants were mainly guided by the axes titles and chart legends to interpret the visualizations, and not always understood what kind of data the chart was displaying. Those results served as insights of how QAs think when analyzing TBIM information in a service delivery department and what improvements in the visual representation tool may be proposed to facilitate their activity. At last we identified evidences of how to design better visual analytics tools based on participant’s perceptions and interpretations of color differences and verbal information in chart labels and legend.
Chapter PDF
Similar content being viewed by others
References
de Souza, C.R.B., Pinhanez, C.S., Cavalcante, V.F.: Information Needs of System Administrators in Information Technology Service Factories. In: Proceedings of the 5th ACM Symposium on Computer Human Interaction for Management of Information Technology, CHIMIT 2011, pp. 3:1–3:10. ACM, New York (2011)
ITIL: Common ITIL Terms, http://itsm.the-hamster.com/itsm4.htm (accessed February 03, 2013)
Card, S.K., Mackinlay, J.D., Shneiderman, B.: Readings in Information Visualization: Using Vision to Think. Morgan Kaufmann Publishers Inc., San Francisco (1999)
Spence, R.: Information visualization. ACM Press books. Addison-Wesley, Harlow, England (2001)
Tufte, E.R.: Envisioning Information. Graphics Press, Cheshire (1990)
Ware, C.: Information Visualization - Perception for Design. Morgan Kaufmann, San Francisco (2004)
Hetzler, E.G., Turner, A.: Analysis Experiences Using Information Visualization. IEEE Computer Graphics and Applications 24(5), 22–26 (2004)
Toker, D., Conati, C., Steichen, B., Carenini, G.: Individual User Characteristics and Information Visualization: Connecting the Dots Through Eye Tracking. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2013, pp. 295–304. ACM, New York (2013)
Bertin, J.: Semiology of Graphics: Diagrams, Networks, Maps. Esri Press, Redlands (2011)
Tufte, E.R.: Visual Explanations: Images and Quantities, Evidence and Narrative. Graphics Press, Cheshire (1997)
Viegas, F.B., Wattenberg, M., Van Ham, F., Kriss, J., McKeon, M.: Manyeyes: A site for visualization at internet scale. IEEE Transactions on Visualization and Computer Graphics 13(6), 1121–1128 (2007)
Cavalcante, V.F., Pinhanez, C.S., de Paula, R.A., Andrade, C.S., de Souza, C.R.B.: Data-driven analytical tools for characterization of productivity and service quality issues in IT service factories. Journal of Service Research: JSR (2013)
Cooper, A.: The Inmates are Running the Asylum: Why High-Tech Products Drive Us Crazy and How to Restore the Sanity. SAMS, Indianapolis (1999)
Sharp, H., Rogers, Y., Preece, J.: Interaction Design: Beyond Human-Computer Interaction, 2nd edn. Wiley, Indianapolis (2007)
Ericsson, K.A., Simon, H.: Protocol analysis: Verbal reports as data. MIT Press, Cambridge (1993)
Nielsen, J., Macks, R.L.: Usability Inspection Methods (1994)
Lawson, B.: How Designers Think: The Design Process Demystified, 4th edn. (2005)
Creswell, J.W.: Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. SAGE Publications (2009)
Iliinsky, N.: Choosing visual properties for successful visualizations, http://public.dhe.ibm.com/common/ssi/ecm/en/ytw03323usen/YTW03323USEN.PDF (accessed February 03, 2013)
Cleveland, W.S., McGill, R.: Graphical perception: Theory, experimentation, and application to the development of graphical methods. Journal of the American Statistical Association 79(387), 531–554 (1984)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Candello, H., Fernandes Cavalcante, V., Braz, A., De Paula, R.A. (2014). A Validation Study of a Visual Analytics Tool with End Users. In: Marcus, A. (eds) Design, User Experience, and Usability. User Experience Design Practice. DUXU 2014. Lecture Notes in Computer Science, vol 8520. Springer, Cham. https://doi.org/10.1007/978-3-319-07638-6_37
Download citation
DOI: https://doi.org/10.1007/978-3-319-07638-6_37
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07637-9
Online ISBN: 978-3-319-07638-6
eBook Packages: Computer ScienceComputer Science (R0)