research-article

Bottom-up vs. Top-down: Trade-offs in Efficiency, Understanding, Freedom and Creativity with InfoVis Tools

Authors:

Gonzalo Gabriel Méndez,

Miguel A. NacentaAuthors Info & Claims

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Pages 841 - 852

https://doi.org/10.1145/3025453.3025942

Published: 02 May 2017 Publication History

Abstract

The emergence of tools that support fast-and-easy visualization creation by non-experts has made the benefits of InfoVis widely accessible. Key features of these tools include attribute-level operations, automated mappings, and visualization templates. However, these features shield people from lower-level visualization design steps, such as the specific mapping of data points to visuals. In contrast, recent research promotes constructive visualization where individual data units and visuals are directly manipulated. We present a qualitative study comparing people's visualization processes using two visualization tools: one promoting a top-down approach to visualization construction (Tableau Desktop) and one implementing a bottom-up constructive visualization approach (iVoLVER). Our results show how the two approaches influence: 1) the visualization process, 2) decisions on the visualization design, 3) the feeling of control and authorship, and 4) the willingness to explore alternative designs. We discuss the complex trade-offs between the two approaches and outline considerations for designing better visualization tools.

Supplementary Material

ZIP File (pn3872-file4.zip)

Download
2.84 MB

suppl.mov (pn3872p.mp4)

Supplemental video

Download
806.81 KB

References

[1]

Greg Abram and Lloyd Treinish. 1995. An Extended Data-Flow Architecture for Data Analysis and Visualization. In Proceedings of the 6th Conference on Visualization '95 (VIS '95). IEEE Computer Society, Washington, DC, USA, 263--. http://dl.acm.org/citation.cfm?id=832271.833845

[2]

Edith Ackermann. 2001. Piagets constructivism, Paperts constructionism: Whats the difference. Future of learning group publication 5, 3 (2001), 438.

[3]

Jaques Bertin. 1999. Readings in Information Visualization. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, Chapter Graphics and Graphic Information Processing, 62--65. http://dl.acm.org/citation.cfm?id=300679.300683

[4]

Jacques Bertin. 2010. Semiology of Graphics: Diagrams, Networks, Maps (1 edition ed.). ESRI Press, Redlands, Calif.

[5]

Alex Bigelow, Steven Drucker, Danyel Fisher, and Miriah Meyer. 2014. Reflections on How Designers Design with Data. In Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces (AVI '14). ACM, NY, NY, USA, 17--24.

Digital Library

[6]

Alan F. Blackwell. 2006. Psychological Issues in End-User Programming. Springer Netherlands, Dordrecht, 9--30.

[7]

Jeremy Boy, Ronald A. Rensink, Enrico Bertini, and Jean-Daniel Fekete. 2014. A Principled Way of Assessing Visualization Literacy. IEEE Transactions on Visualization and Computer Graphics 20, 12 (Dec 2014), 1963--1972.

[8]

Richard E Boyatzis. 1998. Transforming qualitative information: Thematic analysis and code development. Sage.

[9]

Stuart K. Card and Jock Mackinlay. 1997. The structure of the information visualization design space. In Information Visualization, 1997. Proceedings., IEEE Symposium on. 92--99.

[10]

Stuart K Card, Jock D Mackinlay, and Ben Shneiderman. 1999. Readings in information visualization: using vision to think. Morgan Kaufmann.

[11]

Ed H. Chi. 2000. A taxonomy of visualization techniques using the data state reference model. In Information Visualization, 2000. InfoVis 2000. IEEE Symposium on. 69--75.

[12]

William S Cleveland and Robert McGill. 1984. Graphical Perception: Theory, Experimentation, and Application to the Development of Graphical Methods. J. Amer. Statist. Assoc. 79, 387 (1984), 531--554.

[13]

William S. Cleveland and Robert McGill. 1987. Graphical Perception: The Visual Decoding of Quantitative Information on Graphical Displays of Data. Journal of the Royal Statistical Society. Series A (General) 150, 3 (1987), pp. 192--229. http://www.jstor.org/stable/2981473

[14]

Allen Cypher and Daniel Conrad Halbert. 1993. Watch what I do: programming by demonstration. MIT press.

Digital Library

[15]

Selan dos Santos and Ken Brodlie. 2004. Gaining understanding of multivariate and multidimensional data through visualization. Computers & Graphics 28, 3 (2004), 311 -- 325.

[16]

Niklas Elmqvist, John Stasko, and Philippas Tsigas. 2008. DataMeadow: A Visual Canvas for Analysis of Large-scale Multivariate Data. Information Visualization 7, 1 (March 2008), 18--33.

Digital Library

[17]

Lars Grammel, Chris Bennett, Melanie Tory, and Margaret-Anne Storey. 2013. A Survey of Visualization Construction User Interfaces. In EuroVis Short Papers, Mario Hlawitschka and Tino Weinkauf (Eds.). The Eurographics Association. EuroVisShort2013.019-023

[18]

Lars Grammel, Melanie Tory, and Margaret-Anne Storey. 2010. How Information Visualization Novices Construct Visualizations. IEEE Transactions on Visualization and Computer Graphics 16, 6 (Nov 2010), 943--952.

Digital Library

[19]

Christian Heath, Jon Hindmarsh, and Paul Luff. 2010. Video in qualitative research. Sage Publications.

[20]

John A Hortin. 1980. Visual Literacy and Visual Thinking. (1980).

[21]

Jessica Hullman, Eytan Adar, and Priti Shah. 2011. Benefitting InfoVis with Visual Difficulties. IEEE Transactions on Visualization and Computer Graphics 17, 12 (Dec 2011), 2213--2222.

Digital Library

[22]

Samuel Huron. 2014. Constructive Visualization : A token-based paradigm allowing to assemble dynamic visual representation for non-experts. Theses. Universite Paris Sud - Paris XI. https://tel.archives-ouvertes.fr/tel-01126892

[23]

Samuel Huron, Sheelagh Carpendale, Alice Thudt, Anthony Tang, and Michael Mauerer. 2014a. Constructive Visualization. In Proceedings of the 2014 Conference on Designing Interactive Systems (DIS '14). ACM, NY, NY, USA, 433--442.

Digital Library

[24]

Samuel Huron, Yvonne Jansen, and Sheelagh Carpendale. 2014b. Constructing Visual Representations: Investigating the Use of Tangible Tokens. Visualization and Computer Graphics, IEEE Transactions on 20, 12 (Dec 2014), 2102--2111.

[25]

Samuel Huron, Alice Thudt, Bon Adriel Aseniero, Anthony Tang, and Sheelagh Carpendale. 2016. Constructive Visualization: A New Paradigm to Empower People to Author Visualization. In SURFNET / Designing Digital Surface Applications, Frank Maurer (Ed.). NSERC Surfnet, University of Calgary, Chapter 9, 169--191. http://dspace.ucalgary.ca/handle/1880/50450

[26]

Yvonne Jansen and Pierre Dragicevic. 2013. An Interaction Model for Visualizations Beyond The Desktop. IEEE Transactions on Visualization and Computer Graphics 19, 12 (Dec 2013), 2396--2405.

Digital Library

[27]

Waqas Javed and Niklas Elmqvist. 2013. ExPlates: Spatializing Interactive Analysis to Scaffold Visual Exploration. Computer Graphics Forum 32, 3pt4 (2013), 441--450.

Digital Library

[28]

Henry Lieberman. 2000. Your wish is my command: Giving users the power to instruct their software. Morgen Kaufmann (2000).

[29]

Kwan-Liu Ma. 1999. Image Graphs - a Novel Approach to Visual Data Exploration. In Proceedings of the Conference on Visualization '99: Celebrating Ten Years (VIS '99). IEEE Computer Society Press, Los Alamitos, CA, USA, 81--88. http://dl.acm.org/citation.cfm?id=319351.319360

Digital Library

[30]

Adam V Maltese, Joseph A Harsh, and Dubravka Svetina. 2015. Data visualization literacy: investigating data interpretation along the novice--expert continuum. Journal of College Science Teaching 45, 1 (2015), 84.

[31]

Gonzalo Gabriel Méndez, Miguel A. Nacenta, and Sebastien Vandenheste. 2016. iVoLVER: Interactive Visual Language for Visualization Extraction and Reconstruction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NY, NY, USA, 4073--4085.

Digital Library

[32]

Tamara Munzner. 2014. Visualization Analysis and Design (har/psc edition ed.). A K Peters/CRC Press, Boca Raton. http://www.cs.ubc.ca/tmm/vadbook

[33]

Kostas Pantazos and Søren Lauesen. 2012. Constructing Visualizations with InfoVis Tools-An Evaluation from a user Perspective. GRAPP/IVAPP 2012 (2012), 731--736.

[34]

Seymour Papert and Idit Harel. 1991. Situating Constructionism. In Constructionism. Ablex Publishing Corporation.

[35]

Jean Piaget. 2013. Child's Conception of Space: Selected Works. Vol. 4. Routledge.

[36]

Jonathan C. Roberts, Chris Headleand, and Panagiotis D. Ritsos. 2016. Sketching Designs Using the Five Design-Sheet Methodology. IEEE Transactions on Visualization and Computer Graphics 22, 1 (Jan 2016), 419--428.

Digital Library

[37]

Arvind Satyanarayan and Jeffrey Heer. 2014. Lyra: An Interactive Visualization Design Environment. Computer Graphics Forum 33, 3 (June 2014), 351--360.

[38]

Randall B. Smith. 1987. Experiences with the Alternate Reality Kit: An Example of the Tension Between Literalism and Magic. In Proceedings of the SIGCHI/GI Conference on Human Factors in Computing Systems and Graphics Interface (CHI '87). ACM, NY, NY, USA, 61--67.

Digital Library

[39]

Robert Spence. 2001. Information visualization. Vol. 1. Springer.

[40]

Bret Victor. 2013. Drawing Dynamic Visualizations. Recorded at the Stanford HCI seminar. (2013). https://vimeo.com/66085662

[41]

Fernanda B. Viegas, Martin Wattenberg, Frank van Ham, Jesse Kriss, and Matt McKeon. 2007. ManyEyes: a Site for Visualization at Internet Scale. IEEE Transactions on Visualization and Computer Graphics 13, 6 (Nov. 2007), 1121--1128.

Digital Library

[42]

Jagoda Walny, Samuel Huron, and Sheelagh Carpendale. 2015. An Exploratory Study of Data Sketching for Visual Representation. Computer Graphics Forum 34, 3 (2015), 231--240.

[43]

Colin Ware. 2010. Visual thinking: For design. Morgan Kaufmann.

[44]

Tiffany Wun, Jennifer Payne, Samuel Huron, and Sheelagh Carpendale. 2016. Comparing Bar Chart Authoring with Microsoft Excel and Tangible Tiles. Computer Graphics Forum (2016).

Cited By

Spahiu BPalmonari MAlva Principe RRula A(2024)Understanding the structure of knowledge graphs with ABSTAT profilesSemantic Web10.3233/SW-22318115:5(1519-1545)Online publication date: 9-Oct-2024
https://doi.org/10.3233/SW-223181
Halaharvi SMéndez GMansoor HYong QMilani AStorey MNacenta M(2024)P-Inti: Interactive Visual Representation of Programming Concepts for Learning and Instruction2024 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)10.1109/VL/HCC60511.2024.00030(199-210)Online publication date: 2-Sep-2024
https://doi.org/10.1109/VL/HCC60511.2024.00030
Fernandez CFreitas JBlikstein Pde Deus Lopes R(2024)The design space of visualization tools for data science education: literature review and framework for future designsInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2024.100698(100698)Online publication date: Oct-2024
https://doi.org/10.1016/j.ijcci.2024.100698
Show More Cited By

Index Terms

Bottom-up vs. Top-down: Trade-offs in Efficiency, Understanding, Freedom and Creativity with InfoVis Tools
1. Human-centered computing
2. Software and its engineering
  1. Software notations and tools
    1. Context specific languages
      1. Visual languages

Recommendations

Considering Agency and Data Granularity in the Design of Visualization Tools
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Previous research has identified trade-offs when it comes to designing visualization tools. While constructive "bottom-up' tools promote a hands-on, user-driven design process that enables a deep understanding and control of the visual mapping, ...
Constructing Interactive Visualizations with iVoLVER
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

iVoLVER, the Interactive Visual Language for Visualization Extraction and Reconstruction, is a web-based pen and touch system that graphically supports the construction of interactive visualizations and allows the extraction of data from different types ...
iVoLVER: A Visual Language for Constructing Visualizations from In-the-Wild Data
ISS '17: Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces

iVoLVER, the Interactive Visual Language for Visualization Extraction and Reconstruction, is a web-based pen-and-touch interface that graphically supports construction of interactive visualizations. iVoLVER is designed to enable data extraction from ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

May 2017

7138 pages

ISBN:9781450346559

DOI:10.1145/3025453

General Chairs:
Gloria Mark
University of California Irvine
,
Susan Fussell
Cornell University
,
Program Chairs:
Cliff Lampe
University of Michigan
,
m.c. schraefel
University of Southampton
,
Juan Pablo Hourcade
University of Iowa
,
Caroline Appert
Université Paris-Sud
,
Daniel Wigdor
University of Toronto

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Secretaría de Educación Superior, Ciencia, Tecnología e Innovación

Conference

CHI '17

Sponsor:

SIGCHI

CHI '17: CHI Conference on Human Factors in Computing Systems

May 6 - 11, 2017

Colorado, Denver, USA

Acceptance Rates

CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

41
Total Citations
View Citations
1,250
Total Downloads

Downloads (Last 12 months)69
Downloads (Last 6 weeks)18

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Spahiu BPalmonari MAlva Principe RRula A(2024)Understanding the structure of knowledge graphs with ABSTAT profilesSemantic Web10.3233/SW-22318115:5(1519-1545)Online publication date: 9-Oct-2024
https://doi.org/10.3233/SW-223181
Halaharvi SMéndez GMansoor HYong QMilani AStorey MNacenta M(2024)P-Inti: Interactive Visual Representation of Programming Concepts for Learning and Instruction2024 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)10.1109/VL/HCC60511.2024.00030(199-210)Online publication date: 2-Sep-2024
https://doi.org/10.1109/VL/HCC60511.2024.00030
Fernandez CFreitas JBlikstein Pde Deus Lopes R(2024)The design space of visualization tools for data science education: literature review and framework for future designsInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2024.100698(100698)Online publication date: Oct-2024
https://doi.org/10.1016/j.ijcci.2024.100698
Rubab SZaman MRashid UYu LWu Y(2024)Audio-visual training and feedback to learn touch-based gesturesJournal of Visualization10.1007/s12650-024-01012-x27:6(1117-1142)Online publication date: 17-Jun-2024
https://doi.org/10.1007/s12650-024-01012-x
Petrescu M(2024)Bypassing Defaults in Data Visualization Design Processes: A Tableau Case StudyCreative Tools and the Softwarization of Cultural Production10.1007/978-3-031-45693-0_10(197-218)Online publication date: 18-Jan-2024
https://doi.org/10.1007/978-3-031-45693-0_10
Li JRawn ERitchie JTran O'Leary JFollmer S(2023)Beyond the Artifact: Power as a Lens for Creativity Support ToolsProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606831(1-15)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606831
Han GJung JKim YSeo J(2023)DataHaloProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580828(1-21)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580828
L’Yi SWang QGehlenborg N(2023)The Role of Visualization in Genomics Data Analysis Workflows: The Interviews2023 IEEE Visualization and Visual Analytics (VIS)10.1109/VIS54172.2023.00029(101-105)Online publication date: 21-Oct-2023
https://doi.org/10.1109/VIS54172.2023.00029
Bae SVanukuru RYang RGyory PZhou RDo ESzafir D(2023)Cultivating Visualization Literacy for Children Through Curiosity and PlayIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.320944229:1(257-267)Online publication date: Jan-2023
https://doi.org/10.1109/TVCG.2022.3209442
Parsons P(2023)Preparing Future Data Visualization Designers for Professional Practice2023 IEEE VIS Workshop on Visualization Education, Literacy, and Activities (EduVis)10.1109/EduVis60792.2023.00010(22-27)Online publication date: 22-Oct-2023
https://doi.org/10.1109/EduVis60792.2023.00010
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents