research-article

SensorViz: Visualizing Sensor Data Across Different Stages of Prototyping Interactive Objects

Authors:

Dishita Turakhia,

Michael Wessely,

Stefanie MuellerAuthors Info & Claims

DIS '22: Proceedings of the 2022 ACM Designing Interactive Systems Conference

Pages 987 - 1001

https://doi.org/10.1145/3532106.3533481

Published: 13 June 2022 Publication History

Abstract

In this paper, we propose SensorViz, a visualization tool that supports novice makers during different stages of prototyping with sensors. SensorViz provides three modes of visualization: (1) visualizing datasheet specifications before buying sensors, (2) visualizing sensor interaction with the environment via AR before building the physical prototype, and (3) visualizing live/recorded sensor data to test the assembled prototype. SensorViz includes a library of visualization primitives for different types of sensor data and a sensor database builder, which once a new sensor is added automatically creates a matching visualization by composing visualization primitives. Our user study with 12 makers shows that users are more effective in selecting sensors and configuring sensor layouts using SensorViz compared to traditional prototyping utilizing datasheets and manual testing on the prototype. Our post hoc interviews indicate that SensorViz reduces trial and error by allowing makers to explore sensor positions on the prototype early in the design process.

Supplemental Material

ZIP File

Supplemental video and questions

Download
137.57 MB

References

[1]

Fraser Anderson, Tovi Grossman, and George Fitzmaurice. 2017. Trigger-Action-Circuits: Leveraging Generative Design to Enable Novices to Design and Build Circuitry. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC, Canada) (UIST ’17). Association for Computing Machinery, New York, NY, USA, 331–342. https://doi.org/10.1145/3126594.3126637

Digital Library

[2]

Daniel Ashbrook, Shitao Stan Guo, and Alan Lambie. 2016. Towards Augmented Fabrication: Combining Fabricated and Existing Objects. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems(San Jose, California, USA) (CHI EA ’16). Association for Computing Machinery, New York, NY, USA, 1510–1518. https://doi.org/10.1145/2851581.2892509

Digital Library

[3]

AUTODESK. 2019. TINKERCAD. https://www.tinkercad.com/

[4]

Elham Beheshti, David Kim, Gabrielle Ecanow, and Michael S. Horn. 2017. Looking Inside the Wires: Understanding Museum Visitor Learning with an Augmented Circuit Exhibit. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 1583–1594. https://doi.org/10.1145/3025453.3025479

Digital Library

[5]

Tracey Booth, Simone Stumpf, Jon Bird, and Sara Jones. 2016. Crossed Wires: Investigating the Problems of End-User Developers in a Physical Computing Task. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 3485–3497. https://doi.org/10.1145/2858036.2858533

Digital Library

[6]

Adrien Bousseau, Theophanis Tsandilas, Lora Oehlberg, and Wendy E. Mackay. 2016. How Novices Sketch and Prototype Hand-Fabricated Objects. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 397–408. https://doi.org/10.1145/2858036.2858159

Digital Library

[7]

N Bressa, H Korsgaard, A Tabard, S Houben, and J Vermeulen. 2022. What’s the Situation with Situated Visualization? A Survey and Perspectives on Situatedness. In IEEE Trans Vis Comput Graph. (Toronto, Ontario, Canada) (vol. 28,1). 107–117. https://doi.org/10.1109/TVCG.2021.3114835

Digital Library

[8]

Marion Buchenau and Jane Fulton Suri. 2000. Experience Prototyping. In Proceedings of the 3rd Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (New York City, New York, USA) (DIS ’00). Association for Computing Machinery, New York, NY, USA, 424–433. https://doi.org/10.1145/347642.347802

Digital Library

[9]

Joshua Chan, Tarun Pondicherry, and Paulo Blikstein. 2013. LightUp: An Augmented, Learning Platform for Electronics. In Proceedings of the 12th International Conference on Interaction Design and Children (New York, New York, USA) (IDC ’13). Association for Computing Machinery, New York, NY, USA, 491–494. https://doi.org/10.1145/2485760.2485812

Digital Library

[10]

Kayla DesPortes, Aditya Anupam, Neeti Pathak, and Betsy DiSalvo. 2016. BitBlox: A Redesign of the Breadboard. In Proceedings of the The 15th International Conference on Interaction Design and Children (Manchester, United Kingdom) (IDC ’16). Association for Computing Machinery, New York, NY, USA, 255–261. https://doi.org/10.1145/2930674.2930708

Digital Library

[11]

Daniel Drew, Julie L. Newcomb, William McGrath, Filip Maksimovic, David Mellis, and Björn Hartmann. 2016. The Toastboard: Ubiquitous Instrumentation and Automated Checking of Breadboarded Circuits. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16). Association for Computing Machinery, New York, NY, USA, 677–686. https://doi.org/10.1145/2984511.2984566

Digital Library

[12]

Alix Ducros, Clemens N. Klokmose, and Aurélien Tabard. 2019. Situated Sketching and Enactment for Pervasive Displays. In Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces (Daejeon, Republic of Korea) (ISS ’19). Association for Computing Machinery, New York, NY, USA, 217–228. https://doi.org/10.1145/3343055.3359702

Digital Library

[13]

Fologram. 2021. Fologram. https://www.fologram.com

[14]

Michael Gschwandtner, Roland Kwitt, Andreas Uhl, and Wolfgang Pree. 2011. BlenSor: Blender sensor simulation toolbox. In International Symposium on Visual Computing. Springer, 199–208. https://doi.org/10.1007/978-3-642-24031-7_20

[15]

Michael D. Jones, Zann Anderson, Casey Walker, and Kevin Seppi. 2018. PHUI-Kit: Interface Layout and Fabrication on Curved 3D Printed Objects. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3173574.3173684

Digital Library

[16]

Yoonji Kim, Youngkyung Choi, Daye Kang, Minkyeong Lee, Tek-Jin Nam, and Andrea Bianchi. 2019. HeyTeddy: Conversational Test-Driven Development for Physical Computing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 4, Article 139 (dec 2019), 21 pages. https://doi.org/10.1145/3369838

Digital Library

[17]

Yoonji Kim, Youngkyung Choi, Hyein Lee, Geehyuk Lee, and Andrea Bianchi. 2019. VirtualComponent: A Mixed-Reality Tool for Designing and Tuning Breadboarded Circuits. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300407

Digital Library

[18]

Yoonji Kim, Hyein Lee, Ramkrishna Prasad, Seungwoo Je, Youngkyung Choi, Daniel Ashbrook, Ian Oakley, and Andrea Bianchi. 2020. SchemaBoard: Supporting Correct Assembly of Schematic Circuits Using Dynamic In-Situ Visualization. Association for Computing Machinery, New York, NY, USA, 987–998. https://doi.org/10.1145/3379337.3415887

Digital Library

[19]

David Ledo, Jo Vermeulen, Sheelagh Carpendale, Saul Greenberg, Lora Oehlberg, and Sebastian Boring. 2019. Astral: Prototyping Mobile and Smart Object Interactive Behaviours Using Familiar Applications. In Proceedings of the 2019 on Designing Interactive Systems Conference (San Diego, CA, USA) (DIS ’19). Association for Computing Machinery, New York, NY, USA, 711–724. https://doi.org/10.1145/3322276.3322329

Digital Library

[20]

Woojin Lee, Ramkrishna Prasad, Seungwoo Je, Yoonji Kim, Ian Oakley, Daniel Ashbrook, and Andrea Bianchi. 2021. VirtualWire: Supporting Rapid Prototyping with Instant Reconfigurations of Wires in Breadboarded Circuits. In Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction (Salzburg, Austria) (TEI ’21). Association for Computing Machinery, New York, NY, USA, Article 4, 12 pages. https://doi.org/10.1145/3430524.3440623

Digital Library

[21]

Germán Leiva, Jens Emil Grønbæk, Clemens Nylandsted Klokmose, Cuong Nguyen, Rubaiat Habib Kazi, and Paul Asente. 2021. Rapido: Prototyping Interactive AR Experiences through Programming by Demonstration. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 626–637. https://doi.org/10.1145/3472749.3474774

Digital Library

[22]

Jo-Yu Lo, Da-Yuan Huang, Tzu-Sheng Kuo, Chen-Kuo Sun, Jun Gong, Teddy Seyed, Xing-Dong Yang, and Bing-Yu Chen. 2019. AutoFritz: Autocomplete for Prototyping Virtual Breadboard Circuits. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300633

Digital Library

[23]

Will McGrath, Daniel Drew, Jeremy Warner, Majeed Kazemitabaar, Mitchell Karchemsky, David Mellis, and Björn Hartmann. 2017. BifröSt: Visualizing and Checking Behavior of Embedded Systems across Hardware and Software. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC, Canada) (UIST ’17). Association for Computing Machinery, New York, NY, USA, 299–310. https://doi.org/10.1145/3126594.3126658

Digital Library

[24]

Iulian Radu, Tugce Joy, and Bertrand Schneider. 2021. Virtual Makerspaces: Merging AR/VR/MR to Enable Remote Collaborations in Physical Maker Activities. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI EA ’21). Association for Computing Machinery, New York, NY, USA, Article 202, 5 pages. https://doi.org/10.1145/3411763.3451561

Digital Library

[25]

Iulian Radu and Bertrand Schneider. 2019. What Can We Learn from Augmented Reality (AR)? Benefits and Drawbacks of AR for Inquiry-Based Learning of Physics. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300774

Digital Library

[26]

Sparkfun. 2019. Sparkfun 3D Model Component Library. https://github.com/sparkfun/3D_Models

[27]

Stanford Artificial Intelligence Laboratory et al.[n.d.]. Robotic Operating System. https://www.ros.org

[28]

Evan Strasnick, Maneesh Agrawala, and Sean Follmer. 2017. Scanalog: Interactive Design and Debugging of Analog Circuits with Programmable Hardware. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC, Canada) (UIST ’17). Association for Computing Machinery, New York, NY, USA, 321–330. https://doi.org/10.1145/3126594.3126618

Digital Library

[29]

Inc. The MathWorks. 1994. Sensor Fusion and Tracking. https://www.mathworks.com/products/sensor-fusion-and-tracking.html

[30]

Austin L. Toombs. 2017. Hackerspace Tropes, Identities, and Community Values. In Proceedings of the 2017 Conference on Designing Interactive Systems (Edinburgh, United Kingdom) (DIS ’17). Association for Computing Machinery, New York, NY, USA, 1079–1091. https://doi.org/10.1145/3064663.3064760

Digital Library

[31]

Dishita G Turakhia, Andrew Wong, Yini Qi, Lotta-Gili Blumberg, Yoonji Kim, and Stefanie Mueller. 2021. Adapt2Learn: A Toolkit for Configuring the Learning Algorithm for Adaptive Physical Tools for Motor-Skill Learning. In Designing Interactive Systems Conference 2021(Virtual Event, USA) (DIS ’21). Association for Computing Machinery, New York, NY, USA, 1301–1312. https://doi.org/10.1145/3461778.3462128

Digital Library

[32]

Nobuyuki Umetani and Ryan Schmidt. 2017. SurfCuit: Surface-Mounted Circuits on 3D Prints. IEEE Computer Graphics and Applications 37, 3 (2017), 52–60. https://doi.org/10.1109/MCG.2017.40

Digital Library

[33]

Tianyi Wang, Ke Huo, Pratik Chawla, Guiming Chen, Siddharth Banerjee, and Karthik Ramani. 2018. Plain2Fun: Augmenting Ordinary Objects with Surface Painted Circuits. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI EA ’18). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3170427.3188655

Digital Library

[34]

Te-Yen Wu, Hao-Ping Shen, Yu-Chian Wu, Yu-An Chen, Pin-Sung Ku, Ming-Wei Hsu, Jun-You Liu, Yu-Chih Lin, and Mike Y. Chen. 2017. CurrentViz: Sensing and Visualizing Electric Current Flows of Breadboarded Circuits. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC, Canada) (UIST ’17). Association for Computing Machinery, New York, NY, USA, 343–349. https://doi.org/10.1145/3126594.3126646

Digital Library

[35]

Junyi Zhu, Lotta-Gili Blumberg, Yunyi Zhu, Martin Nisser, Ethan Levi Carlson, Xin Wen, Kevin Shum, Jessica Ayeley Quaye, and Stefanie Mueller. 2020. CurveBoards: Integrating Breadboards into Physical Objects to Prototype Function in the Context of Form. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376617

Digital Library

[36]

Junyi Zhu, Yunyi Zhu, Jiaming Cui, Leon Cheng, Jackson Snowden, Mark Chounlakone, Michael Wessely, and Stefanie Mueller. 2020. MorphSensor: A 3D Electronic Design Tool for Reforming Sensor Modules. Association for Computing Machinery, New York, NY, USA, 541–553. https://doi.org/10.1145/3379337.3415898

Digital Library

Cited By

Lima ATrevisan D(2024)Challenges and Opportunities in Using Electronic Prototyping as a Maker ToolProceedings of the XXIII Brazilian Symposium on Human Factors in Computing Systems10.1145/3702038.3702092(1-15)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3702038.3702092
Turakhia DJiang PMueller S(2023)The Reflective Make-AR In-Action: Using Augmented Reality for Reflection-based Learning of MakerskillsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585850(1-6)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585850
Zhu J(2022)Design and Fabricate Personal Health Sensing DevicesAdjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526114.3558528(1-4)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526114.3558528

Recommendations

Visualizing sensor data: towards an experiment and validation platform
HCSE'12: Proceedings of the 4th international conference on Human-Centered Software Engineering

In the last decade, technological improvement on sensors increasingly motivates the use of sensor data in numerous application domains such as environmental, health, transportation, etc. Progressively, with the advances on user terminals, there is a ...
Visualizing and Analyzing Video Content With Interactive Scalable Maps

Visualizing and communicating insights through maps offers an intuitive and familiar way to explore large-scale dynamic relational data. In this paper, we present VideoMap, which is a novel approach for presenting and interacting with relational video ...
Visualizing multidimensional data with Glyph SPLOMs
EuroVis '14: Proceedings of the 16th Eurographics Conference on Visualization

Scatterplot matrices or SPLOMs provide a feasible method of visualizing and representing multi-dimensional data especially for a small number of dimensions. For very high dimensional data, we introduce a novel technique to summarize a SPLOM, as a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '22: Proceedings of the 2022 ACM Designing Interactive Systems Conference

June 2022

1947 pages

ISBN:9781450393584

DOI:10.1145/3532106

Editors:
Florian `Floyd' Mueller
Monash University, Melbourne, Australia
,
Stefan Greuter
Deakin University, Melbourne, Australia
,
Rohit Ashok Khot
RMIT University, Melbourne, Australia
,
Penny Sweetser
The Australian National University, Canberra, Australia
,
Marianna Obrist
University College London, UK

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 June 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Data Availability

Supplemental video and questions https://dl.acm.org/doi/10.1145/3532106.3533481#p987-kim-supplement.zip

Funding Sources

National Research Foundation of Korea (NRF)

Conference

DIS '22

Sponsor:

SIGCHI

DIS '22: Designing Interactive Systems Conference

June 13 - 17, 2022

Virtual Event, Australia

Acceptance Rates

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
321
Total Downloads

Downloads (Last 12 months)91
Downloads (Last 6 weeks)12

Reflects downloads up to 22 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lima ATrevisan D(2024)Challenges and Opportunities in Using Electronic Prototyping as a Maker ToolProceedings of the XXIII Brazilian Symposium on Human Factors in Computing Systems10.1145/3702038.3702092(1-15)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3702038.3702092
Turakhia DJiang PMueller S(2023)The Reflective Make-AR In-Action: Using Augmented Reality for Reflection-based Learning of MakerskillsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585850(1-6)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585850
Zhu J(2022)Design and Fabricate Personal Health Sensing DevicesAdjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526114.3558528(1-4)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526114.3558528

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents