Designing an Interactive Visualization System for Monitoring Participant Compliance in a Large-Scale, Longitudinal Study
Authors: 
Poorna Talkad Sukumar, Thomas Breideband, Gonzalo J. Martinez, Megan Caruso, Sierra Rose, Cooper Steputis, Sidney D'Mello, Gloria Mark, Aaron StriegelAuthors Info & Claims
Article No.: 52, Pages 1 - 8
Abstract
Frequent monitoring of participant compliance is necessary when conducting large-scale, longitudinal studies to ensure that the collected data is of sufficiently high quality. While the need for achieving high compliance has been underscored and there are discussions on incentives and factors affecting compliance, little is shared about the actual processes and tools used for monitoring compliance in such studies. Monitoring participant compliance with respect to multi-modal data can be a tedious process, especially if there are only a few personnel involved. In this case study, we describe the iterative design of an interactive visualization system we developed for monitoring compliance and refined based on changing requirements in an ongoing study. We find that the visualization system, leveraging the digital medium, both facilitates the exploratory tasks of monitoring participant compliance and supports asynchronous collaboration among non-co-located researchers. Our documented requirements for checking participant compliance as well as the design of the visualization system can help inform the compliance-monitoring process in future studies.
References
[1]
Accessed: 10-05-2020. D3.js - Data-Driven Documents. https://d3js.org/
[2]
Accessed: 10-05-2020. ExpiWell. https://app.expiwell.com/home
[3]
Accessed: 10-05-2020. Future of Work Research Study – Intelligent Facilitation of Teamwork via Longitudinal Sensing in Context. https://sites.uci.edu/futureofwork/
[4]
Andrea Cuttone, Sune Lehmann, and Jakob Eg Larsen. 2013. A mobile personal informatics system with interactive visualizations of mobility and social interactions. In Proceedings of the 1st ACM international workshop on Personal data meets distributed multimedia. 27–30.
[5]
Evanthia Dimara, Anastasia Bezerianos, and Pierre Dragicevic. 2016. The attraction effect in information visualization. IEEE transactions on visualization and computer graphics 23, 1(2016), 471–480.
[6]
Evanthia Dimara, Anastasia Bezerianos, and Pierre Dragicevic. 2017. Conceptual and methodological issues in evaluating multidimensional visualizations for decision support. IEEE transactions on visualization and computer graphics 24, 1(2017), 749–759.
[7]
Louis Faust, Rachael Purta, David Hachen, Aaron Striegel, Christian Poellabauer, Omar Lizardo, and Nitesh V Chawla. 2017. Exploring compliance: Observations from a large scale fitbit study. In Proceedings of the 2nd International Workshop on Social Sensing. 55–60.
[8]
Jean-Daniel Fekete, Jarke J Van Wijk, John T Stasko, and Chris North. 2008. The value of information visualization. In Information visualization. Springer, 1–18.
[9]
Steven Franconeri. Accessed: 10-05-2020. Which Visualization? A Quick Reference. http://experception.net/Franconeri_ExperCeptionDotNet_DataVisQuickRef.pdf
[10]
Daniel Harrison, Paul Marshall, Nadia Berthouze, and Jon Bird. 2014. Tracking physical activity: problems related to running longitudinal studies with commercial devices. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication. 699–702.
[11]
Jeffrey Heer, Fernanda B Viégas, and Martin Wattenberg. 2007. Voyagers and voyeurs: supporting asynchronous collaborative information visualization. In Proceedings of the SIGCHI conference on Human factors in computing systems. 1029–1038.
[12]
Stephen Kasica, Charles Berret, and Tamara Munzner. 2020. Table Scraps: An Actionable Framework for Multi-Table Data Wrangling From An Artifact Study of Computational Journalism. arxiv:2009.02373 [cs.HC]
[13]
Stephen M Mattingly, Julie M Gregg, Pino Audia, Ayse Elvan Bayraktaroglu, Andrew T Campbell, Nitesh V Chawla, Vedant Das Swain, Munmun De Choudhury, Sidney K D’Mello, Anind K Dey, 2019. The Tesserae project: Large-scale, longitudinal, in situ, multimodal sensing of information workers. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. 1–8.
[14]
Karel Mundnich, Brandon M Booth, Michelle l’Hommedieu, Tiantian Feng, Benjamin Girault, Justin L’Hommedieu, Mackenzie Wildman, Sophia Skaaden, Amrutha Nadarajan, Jennifer L Villatte, 2020. TILES-2018: A longitudinal physiologic and behavioral data set of hospital workers. arXiv preprint arXiv:2003.08474(2020).
[15]
Tamara Munzner. 2014. Visualization analysis and design. CRC press.
[16]
Rachael Purta, Stephen Mattingly, Lixing Song, Omar Lizardo, David Hachen, Christian Poellabauer, and Aaron Striegel. 2016. Experiences measuring sleep and physical activity patterns across a large college cohort with fitbits. In Proceedings of the 2016 ACM international symposium on wearable computers. 28–35.
[17]
Arkadiusz Stopczynski, Vedran Sekara, Piotr Sapiezynski, Andrea Cuttone, Mette My Madsen, Jakob Eg Larsen, and Sune Lehmann. 2014. Measuring large-scale social networks with high resolution. PloS one 9, 4 (2014), e95978.
[18]
Aaron Striegel, Shu Liu, Lei Meng, Christian Poellabauer, David Hachen, and Omar Lizardo. 2013. Lessons learned from the netsense smartphone study. ACM SIGCOMM Computer Communication Review 43, 4 (2013), 51–56.
[19]
Poorna Talkad Sukumar, Gonzalo J. Martinez, Ted Grover, Gloria Mark, Sidney K. D’Mello, Nitesh V. Chawla, Stephen M. Mattingly, and Aaron D. Striegel. 2020. Characterizing Exploratory Behaviors on a Personal Visualization Interface Using Interaction Logs. In EuroVis 2020 - Short Papers, Andreas Kerren, Christoph Garth, and G. Elisabeta Marai (Eds.). The Eurographics Association. https://doi.org/10.2312/evs.20201052
[20]
Fernanda B Viegas, Martin Wattenberg, Frank Van Ham, Jesse Kriss, and Matt McKeon. 2007. Manyeyes: a site for visualization at internet scale. IEEE transactions on visualization and computer graphics 13, 6(2007), 1121–1128.
[21]
Rui Wang, Fanglin Chen, Zhenyu Chen, Tianxing Li, Gabriella Harari, Stefanie Tignor, Xia Zhou, Dror Ben-Zeev, and Andrew T Campbell. 2014. StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones. In Proceedings of the 2014 ACM international joint conference on pervasive and ubiquitous computing. 3–14.
[22]
Claus O Wilke. 2019. Fundamentals of data visualization: a primer on making informative and compelling figures. O’Reilly Media.
Recommendations
Participants' compliance and experiences with self-tracking using a smartphone sensing app
UbiComp '17: Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable ComputersSelf-tracking studies using smartphone sensing apps provide researchers with a great deal of detailed personal behavioral data. These methods promise to provide many insights into the links between everyday behaviors and well-being outcomes (e.g., ...
Compliance to personal data protection principles
We examined how organizations' privacy policy meet the compliance requirement.We found privately-owned organizations have higher compliance level.Sectors with more personal sensitive data have significantly higher compliance score.Government sectors ...
Domain-specific language for event-based compliance monitoring in process-driven SOAs
Organizations today are required to adhere to a number of compliance concerns from laws, regulations and policies. Compliance is achieved through defining and implementing so-called controls in the organizations' business processes. Organizations that ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
May 2021
2965 pages
ISBN:9781450380959
DOI:10.1145/3411763
Copyright © 2021 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 08 May 2021
Check for updates
Author Tags
Qualifiers
- Extended-abstract
- Research
- Refereed limited
Funding Sources
Conference
CHI '21
Sponsor:
Acceptance Rates
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%
Upcoming Conference
CHI '25
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 476Total Downloads
- Downloads (Last 12 months)193
- Downloads (Last 6 weeks)23
Reflects downloads up to 21 Nov 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in