abstract

Public Access

Drill Sergeant: Supporting Physical Construction Projects through an Ecosystem of Augmented Tools

Authors:

Michelle Nguyen,

Valkyrie Savage,

Björn HartmannAuthors Info & Claims

CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Pages 1607 - 1614

https://doi.org/10.1145/2851581.2892429

Published: 07 May 2016 Publication History

Abstract

Mapping techniques from software tutorials onto physical craft processes can assist novices in building multi-material assemblies. By providing in-situ step instructions and progress tracking, generating dynamic feedback on technique, and adapting tutorial content to a user's specific context and preferences, an ecosystem of smart tools can guide users through complete project tutorials. We demonstrate how such techniques can be enabled by augmenting common workshop tools (drill/driver, saw, router) with measurement, state sensing and interactive feedback; and by sequencing instructions across multiple tools. We validate the benefits of a smart tool ecosystem through reflections on a series of author-created design examples and informal feedback from four fab lab users.

References

[1]

Stavros Antifakos, Florian Michahelles, and Bernt Schiele. 2002. Proactive Instructions for Furniture Assembly. In Proceedings of the 4th International Conference on Ubiquitous Computing. Springer-Verlag, London, UK, UK, 351-360. http://dl.acm.org/citation.cfm?id=647988.741481

Digital Library

[2]

Autodesk Inc. 2015. Instructables. http://instructables.com. (2015).

[3]

Lawrence Bergman, Vittorio Castelli, Tessa Lau, and Daniel Oblinger. 2005. DocWizards: A System for Authoring Follow-me Documentation Wizards. In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology (UIST '05). ACM, New York, NY, USA, 191-200.

Digital Library

[4]

Floraine Berthouzoz, Wilmot Li, Mira Dontcheva, and Maneesh Agrawala. 2011. A Framework for Content-adaptive Photo Manipulation Macros: Application to Face, Landscape, and Global Manipulations. ACM Trans. Graph. 30, 5, Article 120 (Oct. 2011), 14 pages.

Digital Library

[5]

Ankit Gupta, Dieter Fox, Brian Curless, and Michael Cohen. 2012. DuploTrack: A Real-time System for Authoring and Guiding Duplo Block Assembly. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 389-402.

Digital Library

[6]

Clare J. Hooper, Anne Preston, Madeline Balaam, Paul Seedhouse, Daniel Jackson, Cuong Pham, Cassim Ladha, Karim Ladha, Thomas Plötz, and Patrick Olivier. 2012. The French Kitchen: Task-based Learning in an Instrumented Kitchen. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp '12). ACM, New York, NY, USA, 193-202.

Digital Library

[7]

Wendy Ju, Rebecca Hurwitz, Tilke Judd, and Bonny Lee. CounterActive: An Interactive Cookbook for the Kitchen Counter (CHI EA '01). ACM, 269-270.

Digital Library

[8]

Jarrod Knibbe, Tovi Grossman, and George Fitzmaurice. 2015. Smart Makerspace: An Immersive Instructional Space for Physical Tasks. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (ITS '15). ACM, New York, NY, USA, 83-92.

Digital Library

[9]

Wei Li, Tovi Grossman, and George Fitzmaurice. 2012. GamiCAD: A Gamified Tutorial System for First Time Autocad Users. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 103-112.

Digital Library

[10]

John Nelson and Joyce Nelson. 2005. The Big Book of Weekend Woodworking: 150 Easy Projects. Lark Crafts.

[11]

Ohan Oda, Carmine Elvezio, Mengu Sukan, Steve Feiner, and Barbara Tversky. Virtual Replicas for Remote Assistance in Virtual and Augmented Reality (UIST '15). To appear.

Digital Library

[12]

Alec Rivers, Andrew Adams, and Frédo Durand. 2012a. Sculpting by Numbers. ACM Trans. Graph. 31, 6, Article 157 (Nov. 2012), 7 pages.

Digital Library

[13]

Alec Rivers, Ilan E. Moyer, and Frédo Durand. 2012b. Position-correcting Tools for 2D Digital Fabrication. ACM Trans. Graph. 31, 4, Article 88 (July 2012), 7 pages.

Digital Library

[14]

Ayaka Sato, Keita Watanabe, and Jun Rekimoto. 2013. MimiCook: A Cooking Assistant System with Situated Guidance. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction (TEI '14). ACM, New York, NY, USA, 121-124.

Digital Library

[15]

Phillip Schmidt. 2012. PlyDesign: 73 Distinctive DIY Projects in Plywood. Storey Publishing.

[16]

Elliot Soloway, Mark Guzdial, and Kenneth E. Hay. 1994. Learner-centered Design: The Challenge for HCI in the 21st Century. interactions 1, 2 (April 1994), 36-48.

Digital Library

[17]

Cristen Torrey, Elizabeth F. Churchill, and David W. McDonald. 2009. Learning How: The Search for Craft Knowledge on the Internet. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 1371-1380.

Digital Library

[18]

Christian Weichel, Jason Alexander, Abhijit Karnik, and Hans Gellersen. SPATA: Spatio-Tangible Tools for Fabrication-Aware Design (TEI '15). ACM, 189-196.

Digital Library

[19]

Christian Weichel, Manfred Lau, David Kim, Nicolas Villar, and Hans W. Gellersen. MixFab: A Mixed-reality Environment for Personal Fabrication (CHI '14). ACM, 3855-3864.

Digital Library

[20]

Wikipedia. 2015. Camera Resectioning. https://en.wikipedia.org/wiki/Camera_resectioning. (2015).

[21]

Karl D.D. Willis, Cheng Xu, Kuan-Ju Wu, Golan Levin, and Mark D. Gross. Interactive Fabrication: New Interfaces for Digital Fabrication (TEI '11). ACM, 69-72.

Digital Library

[22]

A. Zoran, R. Shilkrot, P. Goyal, P. Maes, and J.A. Paradiso. 2014a. The Wise Chisel: The Rise of the Smart Handheld Tool. Pervasive Computing, IEEE 13, 3 (July 2014), 48-57.

[23]

Amit Zoran, Roy Shilkrot, Suranga Nanyakkara, and Joseph Paradiso. 2014b. The Hybrid Artisans: A Case Study in Smart Tools. ACM Trans. Comput.-Hum. Interact. 21, 3, Article 15 (June 2014), 29 pages.

Digital Library

Cited By

Hanton OFraser MRoudaut A(2024)DisplayFab: The State of the Art and a Roadmap in the Personal Fabrication of Free-Form Displays Using Active Materials and Additive Manufacturing.Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642708(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642708
Lakhdhir SNayar CAnderson FFournier HHolsti LKondratova IPerin CSomanath S(2024)GlucoMaker: Enabling Collaborative Customization of Glucose MonitorsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642435(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642435
Childs EMohammad FStevens LBurbelo HAwoke ARewkowski NManocha D(2024)An Overview of Enhancing Distance Learning Through Emerging Augmented and Virtual Reality TechnologiesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.326457730:8(4480-4496)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3264577
Show More Cited By

Index Terms

Drill Sergeant: Supporting Physical Construction Projects through an Ecosystem of Augmented Tools
1. Human-centered computing

Recommendations

I-Draw: towards a freehand drawing assistant
OzCHI '14: Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: the Future of Design

In this paper we present I-Draw, a drawing tool to assist free hand drawings on physical surfaces. We explore the interaction design space that combines the digital capabilities with the traditional drawing process. I-Draw device has been conceptualised ...
Towards Authoring Tools For DIY Tutorials: From Tutorial User Strategies to Guidelines (Free Template Included!)
MuC '23: Proceedings of Mensch und Computer 2023

Tutorials are essential for knowledge exchange in the DIY community. However, they often have quality issues leading to misunderstandings, mistakes, and safety risks. This indicates a need for research into how to design interactive systems that reduce ...
Tutorial Authorship and Hybrid Designers: The Joy (and Frustration) of DIY Tutorials
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Tutorials are critical to the success and vitality of DIY practices. In this paper, we elevate the importance of tutorial authorship as one way to maintain and improve the quality of tutorials in DIY. We discuss the role interaction designers can play ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

May 2016

3954 pages

ISBN:9781450340823

DOI:10.1145/2851581

General Chairs:
Jofish Kaye
Yahoo
,
Allison Druin
University of Maryland / National Park Service
,
Program Chairs:
Cliff Lampe
University of Michigan
,
Dan Morris
Microsoft
,
Juan Pablo Hourcade
University of Iowa

Copyright © 2016 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2016

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

NSF
MARCO and DARPA

Conference

CHI'16

Sponsor:

SIGCHI

CHI'16: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2016

California, San Jose, USA

Acceptance Rates

CHI EA '16 Paper Acceptance Rate 1,000 of 5,000 submissions, 20%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

42
Total Citations
View Citations
766
Total Downloads

Downloads (Last 12 months)130
Downloads (Last 6 weeks)22

Reflects downloads up to 29 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hanton OFraser MRoudaut A(2024)DisplayFab: The State of the Art and a Roadmap in the Personal Fabrication of Free-Form Displays Using Active Materials and Additive Manufacturing.Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642708(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642708
Lakhdhir SNayar CAnderson FFournier HHolsti LKondratova IPerin CSomanath S(2024)GlucoMaker: Enabling Collaborative Customization of Glucose MonitorsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642435(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642435
Childs EMohammad FStevens LBurbelo HAwoke ARewkowski NManocha D(2024)An Overview of Enhancing Distance Learning Through Emerging Augmented and Virtual Reality TechnologiesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.326457730:8(4480-4496)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3264577
Hwang AOza NCallison-Burch CHead A(2023)Rewriting the Script: Adapting Text Instructions for Voice InteractionProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596059(2233-2248)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596059
Albaugh LHudson SYao L(2023)An Augmented Knitting Machine for Operational Assistance and Guided ImprovisationProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581549(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581549
Liu ZZhu ZJiang EHuang FVillanueva AQian XWang TRamani K(2023)InstruMentAR: Auto-Generation of Augmented Reality Tutorials for Operating Digital Instruments Through Recording Embodied DemonstrationProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581442(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581442
Ramakers RLeen DKim JLuyten KHouben SVeuskens T(2023)Measurement Patterns: User-Oriented Strategies for Dealing with Measurements and Dimensions in Making ProcessesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581157(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581157
Haltner PGoddy-Worlu RForren JNicholas CReilly D(2023)A Comparative Evaluation of AR Embodiments vs. Videos and Figures for Learning Bead Weaving2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00136(1191-1200)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00136
Letter MWolf K(2022)Tangible Version Control: Exploring a Physical Object’s Alternative VersionsExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519686(1-7)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519686
Cao YFuste AHeun V(2022)MobileTutAR: a Lightweight Augmented Reality Tutorial System using Spatially Situated Human Segmentation VideosExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519639(1-8)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519639
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents