research-article

Evaluating the effectiveness of visualization techniques for schematic diagrams in maintenance tasks

Authors:

Ross Maciejewski,

David S. Ebert,

Timothy D. Ropp,

Krystal ThomasAuthors Info & Claims

APGV '10: Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization

Pages 33 - 40

https://doi.org/10.1145/1836248.1836254

Published: 23 July 2010 Publication History

Abstract

In order to perform daily maintenance and repair tasks in complex electrical and mechanical systems, technicians commonly utilize a large number of diagrams and documents detailing system properties in both electronic and print formats. In electronic document views, users typically are only provided with traditional pan and zoom features; however, recent advances in information visualization and illustrative rendering styles should allow users to analyze documents in a more timely and accurate fashion. In this paper, we evaluate the effectiveness of rendering techniques focusing on methods of document/diagram highlighting, distortion, and navigation while preserving contextual information between related diagrams. We utilize our previously developed interactive visualization system (SDViz) for technical diagrams for a series of quantitative studies and an in-field evaluation of the system in terms of usability and usefulness. In the quantitative studies, subjects perform small tasks that are similar to actual maintenance work while using tools provided by our system. First, the effects of highlighting within a diagram and between multiple diagrams are evaluated. Second, we analyze the value of preserving highlighting as well as spatial information when switching between related diagrams, and then we present the effectiveness of distortion within a diagram. Finally, we discuss a field study of the system and report the results of our findings.

References

[1]

Agrawala, M., Phan, D., Heiser, J., Haymaker, J., Klingner, J., Hanrahan, P., and Tversky, B. 2003. Designing effective step-by-step assembly instructions. ACM Trans. Graph. 22, 3, 828--837.

Digital Library

[2]

Barnard, Y., and Reiss, M. 2006. User-centred innovation of electronic documentation for maintenance. In Developments in Human Factors in Transportation, Design and Evaluation, 129--142.

[3]

Barnard, Y., Reiss, M., and Mazoyer, P. 2006. Mental models of users of aircraft maintenance documentation. In Proceedings of the International Conference on Human-Computer Interaction in Aeronautics, 232--239.

[4]

Bier, E. A., Stone, M. C., Pier, K., Buxton, W., and DeRose, T. D. 1993. Toolglass and magic lenses: the see-through interface. In SIGGRAPH '93: Proceedings of the 20th annual conference on Computer graphics and interactive techniques, ACM, New York, NY, USA, 73--80.

Digital Library

[5]

Carpendale, S., Ligh, J., and Pattison, E. 2004. Achieving higher magnification in context. In UIST '04: Proceedings of the 17th annual ACM symposium on User interface software and technology, 71--80.

Digital Library

[6]

Farrar, M. S. 1996. Magic Squares. BookSurge Publishing.

[7]

Ferwerda, J., Rushmeier, H., and Watson, B., 2002. Visualization 2002 tutorial: Pschychometrics 101: How to design, conduct, and analyze perceptual studies of computer graphics visualization techniques.

[8]

Gabbard, J. L., Hix, D., and Swan, J. E. 1999. User-centered design and evaluation of virtual environments. IEEE Computer Graphics and Applications 19, 6, 51--59.

Digital Library

[9]

Greenberg, S., and Buxton, B. 2008. Usability evaluation considered harmful (some of the time). In Proceedings of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, ACM, 111--120.

Digital Library

[10]

Healey, C. G. 2001. Combining Perception and Impressionist Techniques for Nonphotorealistic Visualization of Multidimensional Data. In Non-Photorelistic Rendering in Scientific Visualization, C. G. Healey, Ed., SIGGRAPH 2001 Course Notes.

[11]

Heiser, J., Tversky, B., Agrawala, M., and Hanrahan, P. 2003. Cognitive design principles for visualizations: Revealing and instantiating. In CogSci '03: Proceedings of 25th annual meeting of the cognitive science society, 545--550.

[12]

Heiser, J., Phan, D., Agrawala, M., Tversky, B., and Hanrahan, P. 2004. Identification and validation of cognitive design principles for automated generation of assembly instructions. In AVI '04: Proceedings of the working conference on Advanced visual interfaces, ACM, 311--319.

Digital Library

[13]

Jackson, C. D., Acevedo, D., Laidlaw, D. H., Drury, F., Vote, E., and Keefe, D. 2003. Designer-critiqued comparison of 2d vector visualization methods: a pilot study. In SIGGRAPH '03: ACM SIGGRAPH 2003 Sketches & Applications, ACM, New York, NY, USA, 1--1.

Digital Library

[14]

Johnson, C., and Hansen, C. 2004. Visualization Handbook. Academic Press, Inc., Orlando, FL, USA.

Digital Library

[15]

Laskowski, S., and Plaisant, C. 2005. Evaluation methodologies for visual analytics. In Illuminating the Path: The Research and Development Agenda for Visual Analytics, J. J. Thomas and K. A. Cook, Eds. IEEE Computer Society, Los Alamitos, CA, 150--157.

[16]

Likert, R. 1932. A technique for the measurement of attitudes. Archives of Psychology 22, 140, 1--55.

[17]

North, C. 2006. Toward measuring insight. IEEE Computer Graphics and Applications 26, 3, 6--9.

Digital Library

[18]

Plaisant, C., Fekete, J. D., and Grinstein, G. 2008. Promoting insight-based evaluation of visualizations: From contest to benchmark repository. IEEE Transactions on Visualization and Computer Graphics 14, 1 (January), 120--134.

Digital Library

[19]

Plaisant, C., Grinstein, G., Scholtz, J., Whiting, M., O'Connell, T., Laskowski, S., Chien, L., Tat, A., Wright, W., Görg, C., Liu, Z., Parekh, N., Singhal, K., and Stasko, J. 2008. Evaluating visual analytics at the 2007 vast symposium contest. IEEE Computer Graphics and Applications 28, 2 (March), 12--21.

Digital Library

[20]

Rauschenbach, U., Jeschke, S., and Schumann, H. 2001. General rectangular fisheye views for 2d graphics. Elsevier Science, vol. 24, 609--617.

[21]

Rauschenbach, U. 1999. The rectangular fish eye view as an efficient method for the transmission and display of large images. In ICIP '99: Proceedings of IEEE International Conference on Image Processing, 115--119.

[22]

Reuter, L. H., Tukey, P., Maloney, L. T., Pani, J. R., and Smith, S. 1990. Human perception and visualization. In VIS '90: Proceedings of the 1st conference on Visualization '90, 401--406.

Digital Library

[23]

Scholtz, J. 2006. Beyond usability: Evaluation aspects of visual analytic environments. In IEEE Symposium onf Visual Analytics Science And Technology, 145--150.

[24]

Tory, M., and Möller, T. 2005. Evaluating visualizations: Do expert reviews work? IEEE Computer Graphics and Applications 25, 5, 8--11.

Digital Library

[25]

Ware, C. 2004. Information Visualization: Perception for Design, vol. 2nd edition. Morgan Kaufmann.

Digital Library

[26]

Woo, I., Kim, S., Maciejewski, R., Ebert, D. S., Ropp, T. D., and Thomas, K. 2009. Sdviz: A context-preserving interactive visualization system for technical diagrams. Computer Graphics Forum 28, 943--950.

Digital Library

Cited By

Wen ZLiu YTan SChen JZhu MHan DYin JXu MChen W(2024)Quantivine: A Visualization Approach for Large-Scale Quantum Circuit Representation and AnalysisIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332714830:1(573-583)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TVCG.2023.3327148
Borgen KRopp TWeldon W(2021)Assessment of Augmented Reality Technology’s Impact on Speed of Learning and Task Performance in Aeronautical Engineering Technology EducationThe International Journal of Aerospace Psychology10.1080/24721840.2021.1881403(1-11)Online publication date: 19-Feb-2021
https://doi.org/10.1080/24721840.2021.1881403
Marshall GJay CFreitas A(2021)Structuralist Analysis for Neural Network System DiagramsDiagrammatic Representation and Inference10.1007/978-3-030-86062-2_49(480-487)Online publication date: 21-Sep-2021
https://doi.org/10.1007/978-3-030-86062-2_49
Show More Cited By

Index Terms

Evaluating the effectiveness of visualization techniques for schematic diagrams in maintenance tasks
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Graphics input devices

Recommendations

Off-screen visualization techniques for class diagrams
SOFTVIS '10: Proceedings of the 5th international symposium on Software visualization

Visual representations of node-link diagrams are very important for the software development process. In many situations large diagrams - probably consisting of hundreds of nodes and edges - have to be edited and explored. In state-of-the-art modeling ...
A Study on the Effectiveness of Tree-Maps as Tree Visualization Techniques
Abstract
Tree Structure visualization techniques are one of the important techniques to support the analysis of large hierarchical structure data. They are typically used as tree structure node-link diagram. However, it is difficult to visualize the ...
Interactive Lens Visualization Techniques
VISUALIZATION '99: Proceedings of the 10th IEEE Visualization 1999 Conference (VIS '99)

This paper describes new techniques for minimally immersive visualization of 3D scalar and vector fields, and visualization of document corpora. In our glyph-based visualization system, the user interacts with the 3D volume of glyphs using a pair of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

APGV '10: Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization

July 2010

171 pages

ISBN:9781450302487

DOI:10.1145/1836248

Conference Chairs:
Diego Gutierrez
Universidad de Zaragoza
,
Joe Kearney
University of Iowa
,
Program Chairs:
Marty Banks
University of California, Berkeley
,
Katerina Mania
Technical University of Crete

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 July 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

APGV '10

Sponsor:

SIGGRAPH

APGV '10: ACM Symposium on Applied Perception in Graphics & Visualization 2010

July 23 - 24, 2010

California, Los Angeles

Acceptance Rates

Overall Acceptance Rate 19 of 33 submissions, 58%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
382
Total Downloads

Downloads (Last 12 months)26
Downloads (Last 6 weeks)1

Reflects downloads up to 14 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wen ZLiu YTan SChen JZhu MHan DYin JXu MChen W(2024)Quantivine: A Visualization Approach for Large-Scale Quantum Circuit Representation and AnalysisIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332714830:1(573-583)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TVCG.2023.3327148
Borgen KRopp TWeldon W(2021)Assessment of Augmented Reality Technology’s Impact on Speed of Learning and Task Performance in Aeronautical Engineering Technology EducationThe International Journal of Aerospace Psychology10.1080/24721840.2021.1881403(1-11)Online publication date: 19-Feb-2021
https://doi.org/10.1080/24721840.2021.1881403
Marshall GJay CFreitas A(2021)Structuralist Analysis for Neural Network System DiagramsDiagrammatic Representation and Inference10.1007/978-3-030-86062-2_49(480-487)Online publication date: 21-Sep-2021
https://doi.org/10.1007/978-3-030-86062-2_49
Le T(2021)An approach to evaluating the efficiency of a solution for visualization problemConcurrency and Computation: Practice and Experience10.1002/cpe.632235:15Online publication date: 18-Apr-2021
https://doi.org/10.1002/cpe.6322
Lakier MAnnett MWigdor D(2018)AutomaticsACM Transactions on Computer-Human Interaction10.1145/318506525:4(1-44)Online publication date: 9-Aug-2018
https://dl.acm.org/doi/10.1145/3185065
Kaipa KMorato CGupta S(2018)Design of Hybrid Cells to Facilitate Safe and Efficient Human–Robot Collaboration During Assembly OperationsJournal of Computing and Information Science in Engineering10.1115/1.403906118:3(031004)Online publication date: 12-Jun-2018
https://doi.org/10.1115/1.4039061
Kaipa KMorato CLiu JGupta S(2017)Toward Automated Generation of Multimodal Assembly Instructions for Human OperatorsDisciplinary Convergence in Systems Engineering Research10.1007/978-3-319-62217-0_62(885-897)Online publication date: 26-Nov-2017
https://doi.org/10.1007/978-3-319-62217-0_62
Wu HSpagnuolo MĎurikovič R(2016)Focus+context metro map layout and annotationProceedings of the 32nd Spring Conference on Computer Graphics10.1145/2948628.2948642(41-47)Online publication date: 27-Apr-2016
https://dl.acm.org/doi/10.1145/2948628.2948642
Cohe ALiutkus BBailly GEagan JLecolinet E(2016)SchemeLens: A Content-Aware Vector-Based Fisheye Technique for Navigating Large Systems DiagramsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2015.246703522:1(330-338)Online publication date: 31-Jan-2016
https://doi.org/10.1109/TVCG.2015.2467035
Golovin S(2016)Representation of replacement rules in the form of a matrixJournal of Quality in Maintenance Engineering10.1108/JQME-06-2015-002222:2(164-179)Online publication date: 9-May-2016
https://doi.org/10.1108/JQME-06-2015-0022
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents