research-article

Interaction Techniques for Visual Exploration Using Embedded Word-Scale Visualizations

Authors:

Tanja Blascheck,

Petra Isenberg,

Wesley WillettAuthors Info & Claims

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Pages 1 - 13

https://doi.org/10.1145/3313831.3376842

Published: 23 April 2020 Publication History

Abstract

We describe a design space of view manipulation interactions for small data-driven contextual visualizations (word-scale visualizations). These interaction techniques support an active reading experience and engage readers through exploration of embedded visualizations whose placement and content connect them to specific terms in a document. A reader could, for example, use our proposed interaction techniques to explore word-scale visualizations of stock market trends for companies listed in a market overview article. When readers wish to engage more deeply with the data, they can collect, arrange, compare, and navigate the document using the embedded word-scale visualizations, permitting more visualization-centric analyses. We support our design space with a concrete implementation, illustrate it with examples from three application domains, and report results from two experiments. The experiments show how view manipulation interactions helped readers examine embedded visualizations more quickly and with less scrolling and yielded qualitative feedback on usability and future opportunities.

Supplemental Material

MP4 File

Preview video

Download
7.59 MB

SBV File

Preview video captions

Download
.54 KB

References

[1]

Last read: March 2019. MarketWatch. (Last read: March 2019). https://www.marketwatch.com.

[2]

Last read: September 2019. Dictionary.com. (Last read: September 2019). https://www.dictionary.com.

[3]

Eytan Adar, Daniel S Weld, Brian N Bershad, and Steven S Gribble. 2007. Why we search: visualizing and predicting user behavior. In Proceedings of the 16th International Conference on World Wide Web. ACM, 161--170.

Digital Library

[4]

Benjamin Bach, Nathalie Henry Riche, Sheelagh Carpendale, and Hanspeter P'ster. 2017. The emerging genre of data comics. Computer Graphics and Applications 37, 3 (2017), 6--13.

Digital Library

[5]

Benjamin Bach, Nathalie Henry Riche, Tim Dwyer, Tara Madhayastha, Jean-Daniel Fekete, and Thomas Grabowski. 2015. Small MultiPiles: Piling time to explore temporal patterns in dynamic networks. Computer Graphics Forum 34, 3 (2015), 31--40.

Digital Library

[6]

Sriram Karthik Badam, Zhicheng Liu, and Niklas Elmqvist. 2019. Elastic documents: Coupling text and tables through contextual visualizations for enhanced document reading. IEEE Transactions on Visualization and Computer Graphics 25, 1 (2019), 661--671.

Digital Library

[7]

Sebastian Baltes, Oliver Moseler, Fabian Beck, and Stephan Diehl. 2015. Navigate, understand, communicate: How developers locate performance bugs. In ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). IEEE, 1--10.

[8]

Fabian Beck, Yasett Acurana, Tanja Blascheck, Rudolf Netzel, and Daniel Weiskopf. 2016. An expert evaluation of word-sized visualizations for analyzing eye movement data. In IEEE Second Workshop on Eye Tracking and Visualization (ETVIS). IEEE, 50--54.

[9]

Fabian Beck, Tanja Blascheck, Thomas Ertl, and Daniel Weiskopf. 2016. Word-sized eye tracking visualizations. In Burch M., Chuang L., Fisher B., Schmidt A., Weiskopf D. (eds) Eye Tracking and Visualization. ETVIS 2015. Springer.

[10]

Fabian Beck, Sebastian Koch, and Daniel Weiskopf. 2015. Visual analysis and dissemination of scientific literature collections with SurVis. IEEE Transactions on Visualization and Computer Graphics 22, 1 (2015), 180--189.

Digital Library

[11]

Fabian Beck, Oliver Moseler, Stephan Diehl, and Günter Daniel Rey. 2013. In situ understanding of performance bottlenecks through visually augmented code. In 21st International Conference on Program Comprehension (ICPC). IEEE, 63--72.

[12]

Fabian Beck and Daniel Weiskopf. 2017. Word-sized graphics for scienti?c texts. IEEE Transactions on Visualization and Computer Graphics 23, 6 (2017), 1576--1587.

Digital Library

[13]

Richard A Becker and William S Cleveland. 1987. Brushing scatterplots. Technometrics 29, 2 (1987), 127--142.

Digital Library

[14]

Jacques Bertin. 1967. Sémiologie graphique: Les diagrammes-Les réseaux-Les cartes. Mouton/Gauthier-Villars.

[15]

Jacques Bertin. 1983. Semiology of Graphics: Diagrams, Networks, Maps. University of Wisconsin Press, Madison, WI, USA.

Digital Library

[16]

Anastasia Bezerianos, Fanny Chevalier, Pierre Dragicevic, Niklas Elmqvist, and Jean-Daniel Fekete. 2010. GraphDice: A system for exploring multivariate social networks. Computer Graphics Forum 29, 3 (2010), 863--872.

Digital Library

[17]

Tanja Blascheck, Lindsay MacDonald Vermeulen, Jo Vermeulen, Charles Perin, Wesley Willett, Thomas Ertl, and Sheelagh Carpendale. 2019. Exploration strategies for discovery of interactivity in visualizations. IEEE Transactions on Visualization and Computer Graphics 25, 2 (2019), 1407--1420.

[18]

Jeremy Boy, Louis Eveillard, Françoise Detienne, and Jean-Daniel Fekete. 2016. Suggested Interactivity: Seeking Perceived Affordances for Information Visualization. IEEE Transactions on Visualization and Computer Graphics 22, 1 (2016), 10. To appear.

Digital Library

[19]

Ulrik Brandes, Bobo Nick, Brigitte Rockstroh, and Astrid Steffen. 2013. Gestaltlines. Computer Graphics Forum 32, 3 (2013), 171--180.

Digital Library

[20]

Richard Brath, Peter MacMurchy, and Ebad Banissi. 2019. The design space of SparkWords. In EuroVis 2019 - Short Papers. The Eurographics Association, 127--131.

[21]

Aaron Bycoffe. Last read: September 2019. The Endorsement Primary. (Last read: September 2019). https://projects.fivethirtyeight.com/ 2016-endorsement-primary/.

[22]

Jack Callahan, Don Hopkins, Mark Weiser, and Ben Shneiderman. 1988. An empirical comparison of pie vs. linear menus. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). ACM, 95--100.

Digital Library

[23]

Bay-Wei Chang, Jock Mackinlay, and Polle T Zellweger. 2000. Fluidly revealing information in fluid documents. In Proceedings of Smart Graphics. AAAI, Menlo Park, CA, USA, 178--181.

[24]

John B Cole and Paul M VanRaden. 2010. Visualization of results from genomic evaluations. Journal of Dairy Science 93, 6 (2010), 2727--2740.

[25]

Christopher Collins, Sheelagh Carpendale, and Gerald Penn. 2009. Docuburst: Visualizing document content using language structure. Computer Graphics Forum 28, 3 (2009), 1039--1046.

Digital Library

[26]

Pierre Dragicevic. 2016. Fair statistical communication in HCI. In Modern Statistical Methods for HCI. Springer, 291--330.

[27]

Pierre Dragicevic, Yvonne Jansen, Abhraneel Sarma, Matthew Kay, and Fanny Chevalier. 2019. Increasing the transparency of research papers with explorable multiverse analyses. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). ACM.

Digital Library

[28]

Niklas Elmqvist, Andrew Vande Moere, Hans-Christian Jetter, Daniel Cernea, Harald Reiterer, and TJ Jankun-Kelly. 2011. Fluid interaction for information visualization. Information Visualization 10, 4 (2011), 327--340.

Digital Library

[29]

Leo D Frishberg. 2011. Interactive sparklines: A dynamic display of quantitative information. In Extended Abstracts on Human Factors in Computing Systems (CHI). ACM, 589--604.

Digital Library

[30]

Sohaib Ghani, Nathalie Henry Riche, and Niklas Elmqvist. 2011. Dynamic insets for context-aware graph navigation. Computer Graphics Forum 30, 3 (2011), 861--870.

Digital Library

[31]

Michael Gleicher, Danielle Albers, Rick Walker, Ilir Jusu?, Charles D Hansen, and Jonathan C Roberts. 2011. Visual comparison for information visualization. Information Visualization 10, 4 (2011), 289--309.

Digital Library

[32]

Pascal Gof?n, Jeremy Boy, Wesley Willett, and Petra Isenberg. 2016. An exploratory study of word-scale graphics in data-rich text documents. IEEE Transactions on Visualization and Computer Graphics 23, 10 (2016), 2275--2287.

Digital Library

[33]

Pascal Gof?n, Wesley Willett, Jean-Daniel Fekete, and Petra Isenberg. 2014. Exploring the placement and design of word-scale visualizations. IEEE Transactions on Visualization and Computer Graphics 20, 12 (2014), 2291--2300.

[34]

Pascal Gof?n, Wesley Willett, Jean-Daniel Fekete, and Petra Isenberg. 2015. Design considerations for Enhancing Word-Scale Visualizations with Interaction. In Posters of the IEEE Conference on Information Visualization (InfoVis). IEEE, Los Alamitos, CA, USA.

[35]

Jeffrey Heer and Ben Shneiderman. 2012. Interactive Dynamics for Visual Analysis. Communications of the ACM 55, 4 (2012), 45--54.

Digital Library

[36]

Jane Hoffswell, Arvind Satyanarayan, and Jeffrey Heer. 2018. Augmenting code with in situ visualizations to aid program understanding. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). ACM, 532.

Digital Library

[37]

Steffen Koch, Michael John, Michael Wörner, Andreas Müller, and Thomas Ertl. 2014. VarifocalReader -- in-depth visual analysis of large text documents. IEEE Transactions on Visualization and Computer Graphics 20, 12 (2014), 1723--1732.

[38]

Nicholas Kong, Marti A Hearst, and Maneesh Agrawala. 2014. Extracting references between text and charts via crowdsourcing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). ACM, 31--40.

Digital Library

[39]

Shahid Latif and Fabian Beck. 2018. Visually augmenting documents with data. Computing in Science Engineering 20, 6 (2018), 96--103.

Digital Library

[40]

Shahid Latif and Fabian Beck. 2019. VIS author pro?les: Interactive descriptions of publication records combining text and visualization. IEEE Transactions on Visualization and Computer Graphics 25, 1 (2019), 152--161.

Digital Library

[41]

Shahid Latif, Diao Liu, and Fabian Beck. 2018. Exploring interactive linking between text and visualization. In EuroVis 2018 - Short Papers. Eurographics Association, 91--94.

[42]

Tomer Moscovich, Fanny Chevalier, Nathalie Henry Riche, Emmanuel Pietriga, and Jean-Daniel Fekete. 2009. Topology-Aware Navigation in Large Networks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). ACM, 2319--2328.

Digital Library

[43]

Daniela Oelke, David Spretke, Andreas Stoffel, and Daniel A Keim. 2012. Visual readability analysis: How to make your writings easier to read. IEEE Transactions on Visualization and Computer Graphics 18, 5 (2012), 662--674.

Digital Library

[44]

Jonas Parnow. 2015. Micro Visualizations: How can Micro Visualisations enhance text comprehension, memorability, and exploitation? Design Master Thesis. Potsdam University of Applied Sciences, Potsdam, Germany. http://www.microvis.info.

[45]

Jonas Parnow and Marian Dörk. 2015. Micro Visualizations: Data-driven typography and graphical text enhancement. In Posters of the Conference on Information Visualization (InfoVis). IEEE.

[46]

Charles Perin, Pierre Dragicevic, and Jean-Daniel Fekete. 2015. Crossets: manipulating multiple sliders by crossing. In Proceedings of the 41st Graphics Interface Conference. Canadian Information Processing Society, 233--240.

Digital Library

[47]

Charles Perin, Romain Vuillemot, and Jean-Daniel Fekete. 2013. SoccerStories: A kick-off for visual soccer analysis. IEEE Transactions on Visualization and Computer Graphics 19, 12 (2013), 2506--2515.

Digital Library

[48]

Jeffrey M Rzeszotarski and Aniket Kittur. 2014. Kinetica: naturalistic multi-touch data visualization. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). ACM, 897--906.

Digital Library

[49]

Edward Segel and Jeffrey Heer. 2010. Narrative visualization: Telling stories with data. IEEE Transactions on Visualization and Computer Graphics 16, 6 (2010), 1139--1148.

Digital Library

[50]

John Stasko, Carsten Gorg, Zhicheng Liu, and Kanupriya Singhal. 2007. Jigsaw: Supporting investigative analysis through interactive visualization. In Proceedings of the IEEE Symposium on Visual Analytics Science and Technology (VAST). IEEE, 131--138.

Digital Library

[51]

Markus Steinberger, Manuela Waldner, Marc Streit, Alexander Lex, and Dieter Schmalstieg. 2011. Context-preserving visual links. IEEE Transactions on Visualization and Computer Graphics 17, 12 (2011), 2249--2258.

Digital Library

[52]

Bongwon Suh, Allison Woodruff, Ruth Rosenholtz, and Alyssa Glass. 2002. Popout Prism: Adding perceptual principles to overview+detail document interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). ACM, 251--258.

Digital Library

[53]

Ben Swift, Andrew Sorensen, Henry Gardner, and John cyberphysical programming. In 1st International Workshop on Live Programming (LIVE). IEEE, 27--30.

[54]

Christian Tominski, Camilla Forsell, and Jimmy Johansson. 2012. Interaction support for visual comparison inspired by natural behavior. IEEE Transactions on Visualization and Computer Graphics 18, 12 (2012), 2719--2728.

Digital Library

[55]

Edward R. Tufte. 2001. The visual display of quantitative information. Graphics Press, Cheshire, CT.

Digital Library

[56]

Edward R. Tufte. 2006. Beautiful evidence. Graphics Press, Cheshire, CT.

Digital Library

[57]

Stef van den Elzen and Jarke J van Wijk. 2013. Small multiples, large singles: A new approach for visual data exploration. Computer Graphics Forum 32, 3pt2 (2013), 191--200.

Digital Library

[58]

Frank Van Ham, Martin Wattenberg, and Fernanda B Viégas. 2009. Mapping text with phrase nets. IEEE Transactions on Visualization and Computer Graphics 15, 6 (2009), 1169--1176.

Digital Library

[59]

Bret Victor. Last read: March 2019. Explorable explanation. (Last read: March 2019). http://worrydream.com/ExplorableExplanations/.

[60]

Fernanda B Viegas, Martin Wattenberg, and Jonathan Feinberg. 2009. Participatory visualization with wordle. IEEE Transactions on Visualization and Computer Graphics 15, 6 (2009), 1137--1144.

Digital Library

[61]

Gareth Watts. Last read: March 2019. jQuery Sparklines. (Last read: March 2019). https://omnipotent.net/jquery.sparkline/.

[62]

Ji Soo Yi, Youn ah Kang, John T Stasko, and Julie A Jacko. 2007. Toward a deeper understanding of the role of interaction in information visualization. IEEE Transactions on Visualization and Computer Graphics 13, 6 (2007), 1224--1231.

Digital Library

[63]

Dongwook Yoon, Nicholas Chen, and François Guimbretière. 2013. TextTearing: Opening white space for digital ink annotation. In Proceedings of the Conference on User Interface Software and Technology (UIST). ACM, 107--112.

Digital Library

[64]

Polle Zellweger, Bay-Wei Chang, and Jock D Mackinlay. 1998. Fluid Links for Informed and Incremental Link Transitions. In Proceedings of the Ninth ACM Conference on Hypertext and Hypermedia: Links, Objects, Time and Space-Structure in Hypermedia Systems: Links, Objects, Time and Space-Structure in Hypermedia Systems, Vol. 98. ACM, Hosking. 2013. Visual code annotations for 50--57.

Digital Library

Cited By

Masson DMalacria SCasiez GVogel D(2023)Charagraph: Interactive Generation of Charts for Realtime Annotation of Data-Rich ParagraphsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581091(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581091
Huth FBlascheck TKoch SErtl T(2023)Studies and design considerations for animated transitions between small-scale visualizationsJournal of Visualization10.1007/s12650-023-00937-z26:6(1421-1443)Online publication date: 28-Aug-2023
https://dl.acm.org/doi/10.1007/s12650-023-00937-z
Huth FBlascheck TKoch SErtl T(2022)Animated Transitions for Small-Scale VisualizationsProceedings of the 15th International Symposium on Visual Information Communication and Interaction10.1145/3554944.3554945(1-8)Online publication date: 16-Aug-2022
https://dl.acm.org/doi/10.1145/3554944.3554945
Show More Cited By

Index Terms

Interaction Techniques for Visual Exploration Using Embedded Word-Scale Visualizations
1. Human-centered computing
  1. Visualization

Recommendations

Exploring the Effect of Word-Scale Visualizations on Reading Behavior
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems

We studied how the integration of small visualizations (word-scale visualizations) into a sentence affects reading speed and memorization during a brief reading task. In particular, we were interested in how different placement types with their inherent ...
Visualizing web search results using glyphs: Design and evaluation of a flower metaphor

While the Web provides a lot of useful information to managers and decision makers in organizations for decision support, it requires a lot of time and cognitive effort for users to sift through a search result list returned by search engines to find ...
Visual exploration of time-oriented patient data for chronic diseases: design study and evaluation
USAB'11: Proceedings of the 7th conference on Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society: information Quality in e-Health

Medical care, particularly for chronic diseases, accumulates a huge amount of patient data over extensive time periods that needs to be accessed and analyzed accordingly. Information Visualization methods hold great promises in turning data deluge into ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

April 2020

10688 pages

ISBN:9781450367080

DOI:10.1145/3313831

General Chairs:
Regina Bernhaupt
Eindhoven University of Technology, Netherlands
,
Florian 'Floyd' Mueller
Monash University, Australia
,
David Verweij
Newcastle University, UK
,
Josh Andres
RMIT, Australia
,
Program Chairs:
Joanna McGrenere
University of British Columbia, Canada
,
Andy Cockburn
University of Canterbury, New Zealand
,
Ignacio Avellino
University of Maryland Baltimore County, USA
,
Alix Goguey
Grenoble Alpes University, France
,
Pernille Bjørn
University of Copenhagen, Denmark
,
Shengdong (Shen) Zhao
National University of Singapore, Singapore
,
Briane Paul Samson
Future University Hakodate, Japan & De La Salle University, Philippines
,
Rafal Kocielnik
University of Washington, USA

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 April 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '20

Sponsor:

SIGCHI

CHI '20: CHI Conference on Human Factors in Computing Systems

April 25 - 30, 2020

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
672
Total Downloads

Downloads (Last 12 months)82
Downloads (Last 6 weeks)9

Reflects downloads up to 19 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Masson DMalacria SCasiez GVogel D(2023)Charagraph: Interactive Generation of Charts for Realtime Annotation of Data-Rich ParagraphsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581091(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581091
Huth FBlascheck TKoch SErtl T(2023)Studies and design considerations for animated transitions between small-scale visualizationsJournal of Visualization10.1007/s12650-023-00937-z26:6(1421-1443)Online publication date: 28-Aug-2023
https://dl.acm.org/doi/10.1007/s12650-023-00937-z
Huth FBlascheck TKoch SErtl T(2022)Animated Transitions for Small-Scale VisualizationsProceedings of the 15th International Symposium on Visual Information Communication and Interaction10.1145/3554944.3554945(1-8)Online publication date: 16-Aug-2022
https://dl.acm.org/doi/10.1145/3554944.3554945
Rachatasumrit NBragg JZhang AWeld D(2022)CiteRead: Integrating Localized Citation Contexts into Scientific Paper ReadingProceedings of the 27th International Conference on Intelligent User Interfaces10.1145/3490099.3511162(707-719)Online publication date: 22-Mar-2022
https://dl.acm.org/doi/10.1145/3490099.3511162
Latif SZhou ZKim YBeck FKim N(2022)Kori: Interactive Synthesis of Text and Charts in Data DocumentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.311480228:1(184-194)Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1109/TVCG.2021.3114802
Mosca AOttley AChang RKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Does Interaction Improve Bayesian Reasoning with Visualization?Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445176(1-14)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445176
LYi SJo JSeo J(2021)Comparative Layouts Revisited: Design Space, Guidelines, and Future DirectionsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.303041927:2(1525-1535)Online publication date: Feb-2021
https://doi.org/10.1109/TVCG.2020.3030419

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten