research-article

Maestro: Designing a System for Real-Time Orchestration of 3D Modeling Workshops

Authors:

Volodymyr Dziubak,

Ben Lafreniere,

George FitzmauriceAuthors Info & Claims

UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

Pages 287 - 298

https://doi.org/10.1145/3242587.3242606

Published: 11 October 2018 Publication History

Abstract

Instructors of 3D design workshops for children face many challenges, including maintaining awareness of students' progress, helping students who need additional attention, and creating a fun experience while still achieving learning goals. To help address these challenges, we developed Maestro, a workshop orchestration system that visualizes students' progress, automatically detects and draws attention to common challenges faced by students, and provides mechanisms to address common student challenges as they occur. We present the design of Maestro, and the results of a case-study evaluation with an experienced facilitator and 13 children. The facilitator appreciated Maestro's real-time indications of which students were successfully following her tutorial demonstration, and recognized the system's potential to "extend her reach" while helping struggling students. Participant interaction data from the study provided support for our follow-along detection algorithm, and the capability to remind students to use 3D navigation.

Supplementary Material

suppl.mov (ufp1129.mp4)

Supplemental video

Download
81.14 MB

suppl.mov (ufp1129p.mp4)

Supplemental video

Download
7.83 MB

MP4 File (p287-dziubak.mp4)

Download
291.21 MB

References

[1]

David Akers, Matthew Simpson, Robin Jeffries, and Terry Winograd. 2009. Undo and Erase Events as Indicators of Usability Problems. Proceedings of the International Conference on Human Factors in Computing Systems

Digital Library

[2]

John R. Anderson, Albert T. Corbett, Kenneth R. Koedinger, and Ray. Pelletier. 1995. Cognitive Tutors: Lessons Learned. Journal of the Learning Sciences 4 (2), 167--207

[3]

Arnold E. Kimberly and Matthew D. Pistilli. 2012. Course Signals at Purdue: Using Learning Analytics to Increase Student Success. Proceedings of the International Conference on Learning Analytics and Knowledge, 267--270

Digital Library

[4]

Ryan Baker, Sujith Gowda, Albert Corbett, and Jaclyn Ocumpaugh. 2012. Towards Automatically Detecting Whether Student Learning is Shallow. Intelligent Tutoring Systems, 444--453. Springer Berlin/Heidenberg

Digital Library

[5]

Ryan S. Baker. 2016. Stupid Tutoring Systems, Intelligent Humans. International Journal of Artificial Intelligence in Education 26 (2), 600--614

[6]

Ryan S. Baker, Sidney K. D'Mello, Mercedes T. Rodrigo, and Arthur C. Graesser. 2010. Better to be Frustrated than Bored: the Incidence and Persistence of Affect During Interactions with Three Different Computer-based Learning Environments. International Journal of human-computer studies 68 (4), 223--241

Digital Library

[7]

Ryan S. Baker and Kalina Yacef. 2009. The State of Educational Data Mining in 2009 : A Review and Future Visions. Journal of Educational Data Mining 1 (1), 3--16

[8]

Je Beck and Jack Mostow. 2008. How Who Should Practice: Using Learning Decomposition to Evaluate the Efficacy of Different Types of Practice for Different Types of Students. Intelligent Tutoring Systems, 353--362

Digital Library

[9]

William Billingsley and Paul Kwan. 2016. Indirect Interaction : A Computing Lecture for Five to Seven Year-Olds. Proceedings of the Conference Companion Pulblication on Designing Interactive Systems, 145--148

Digital Library

[10]

Zach Broderick, Cristine O'Connor, Courtney Mulcahy, Neil Hefferman, and Cristina Heffernan. 2011. Increasing Parent Engagement in Student Learning Using an Intelligent Tutoring System. Journal of Interactive Learning Research 22(4), 523--550

[11]

Hsiang-Ting Chen, Tovi Grossman, Wei Li-Yi, Ryan M. Schmidt, Bjorn Hartmann, George Fitzmaurice, and Maneesh Agrawala. 2014. History Assisted View Authoring for 3D Models. Proceedings of the ACM Conference on Human Factors in Computing Systems, 2027--2036

Digital Library

[12]

Sharon Lynn Chu, Francis Quek, Sourabh Bhangaonkar, Amy Boettcher Ging, and Kumar Sridharamurthy. 2015. Making the Maker: A Means-to-an-Ends Approach to Nurturing the Maker Mindset in Elementary-Aged Children. International Journal of Child-Computer Interaction 5, 11--19

Digital Library

[13]

Cristina Conati, Abigail Gertner, and Kurt Vanlehn. 2002. Using Bayesian Networks to Manage Uncertainty in Student Modeling. User Modelling and User-Adapted Interaction 12(4), 371--417

Digital Library

[14]

Juliet Corbin and Strauss Anselm. 2008. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. SAGE Publications Inc.

[15]

Daniel Fitton, Janet C. Read, and John Dempsey. 2015. Exploring Children's Designs for Maker Technologies. Proceedings of the International Conference on Interaction Design and Children, 379--382

Digital Library

[16]

Adam Fourney and Ben Lafreniere. 2014. InterTwine: Creating Interapplication Information Scent to Support Coordinated Use of Software. Proceedings of the ACM Symposium on User Interface Software and Technology, 429--438

Digital Library

[17]

Leonel Morales Diaz, Laura S Gaytan-lugo, and Lissette Fleck. 2015. Profiling styles of use in Alice: Identifying patterns of use by observing participants in workshops with Alice. Blocks and Beyond Workshop, 2015 IEEE, 19--24

Digital Library

[18]

Tovi Grossman, Justin Matejka, and George Fitzmaurice. 2010. Chronicle: Capture, Exploration, and Playback of Document Workflow Histories. Proceedings of annual ACM Symposium on User Interface Software and Technology, 143--152

Digital Library

[19]

Julio Guerra, Roya Hosseini, Sibel Somyurek, and Peter Brusilovsky. 2016. An Intelligent Interface for Learning Content: Combining an Open Learner Model and Social Comparison to Support Self-Regulated Learning and Engagement. Proceedings of the International Conference on Intelligent User Interfaces, 152--163

Digital Library

[20]

Philip J Guo. 2015. Codeopticon: Real-Time, One-To- Many Human Tutoring for Computer Programming. Proceedings of the ACM Symposium on User Interface Software & Technology, 599--608

Digital Library

[21]

Nathaniel Hudson, Celena Alcock, and Parmit K Chilana. 2016. Understanding Newcomers to 3D Printing: Motivations, Workflows, and Barriers of Casual Makers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: 384--396

Digital Library

[22]

Nathaniel Hudson, Benjamin Lafreniere, Parmit K. Chilana, and Tovi Grossman. 2018. Investigating how online help and learning resources support children's use of 3D design software. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 10

Digital Library

[23]

Judy Kay, 1997. Learner Know Thyself: Student Models to Give Learner Control and Responsibility. International Conference on Computers in Education, 17--24

[24]

Ben Lafreniere, Tovi Grossman, and George Fitzmaurice. 2013. Community Enhanced Tutorials: Improving Tutorials with Multiple Demonstrations. Proceedings of International Conference on Human Factors in Computing Systems, 1779--1788

Digital Library

[25]

Tessa A. Lau and Daniel S. Weld. 1998. Programming by Demonstration: An Inductive Learning Formulation. Proceedings of the International Conference on Intelligent User Interfaces, 145--152

Digital Library

[26]

Wei Li, Tovi Grossman, and George Fitzmaurice. 2014. CADament: a Gamified Multiplayer Software Tutorial System. Proceedings of the International Conference on Human Factors in Computing Systems, 3369--3378

Digital Library

[27]

Chee Kit Looi, Wenli Chen, and Foo Keong Ng. 2010. Collaborative Activities Enabled by GroupScribbles: An Exploratory Study of Learning Effectiveness. Computers and Education 54(1), 14--26

Digital Library

[28]

Zeny F Mateo. 2010. Creating Active Learning in a Large Introductory Statistics Class Using Clicker Technology. Data and context in statistics education: Towards an evidence-based society. Proceedings of the International Conference on Teaching Statistics

[29]

V. R. Raghuveer, B. K. Tripathy, Taranveer Singh, and Saarthak Khanna. 2014. Reinforcement learning approach towards effective content recommendation in MOOC environments. International IEEE Conference on MOOC, Innovation and Technology in Education, 285--289

[30]

Susan Bull and Judy Kay. 2010. Open learner models. Advances in intelligent tutoring systems, 301--322

[31]

Thomas H Park, Rachel M Magee, Susan Wiedenbeck, and Andrea Forte. 2013. Children as Webmakers : Designing a Web Editor for Beginners. Interaction Design and Children, 419--422

Digital Library

[32]

Suporn Pongnumkul, Mira Dontcheva, Wilmot Li, Jue Wang, Lubomir Bourdev, Shai Avidan, and Michael F. Cohen. 2011. Pause-and-Play: Automatically Linking Screencast Video Tutorials with Applications. Proceedings of the ACM Symposium on User Interface Software and Technology, 135--144

Digital Library

[33]

Gabriela T. Richard and Yasmin B. Kafai. 2015. Making physical and digital games with e-textiles. Proceedings of the International Conference on Interaction Design and Children, 399--402

Digital Library

[34]

Oliver Stickel, Dominik Hornung, Konstantin Aal, Markus Rohde, and Volker Wulf. 2015. 3D Printing with marginalized children-an exploration in a Palestinian refugee camp. Proceedings of the European Conference on Computer Supported Cooperative Work, 19--23

[35]

Keith J. Topping. 1996. The Effectiveness of Peer Tutoring in Further and Higher Education: A Typology and Review of the Literature. Higher Education 32(3), 321--345

[36]

David Verweij, Saskia Bakker, and Berry Eggen. 2017. FireFlies2: Interactive tangible pixels to enable distributed cognition in classroom techologies. In Proceedings of the ACM Conference on Interactive Surfaces and Spaces, 260--269

Digital Library

[37]

Juan Diego Zapata-Rivera and Irvin R. Katz. 2014. Keeping Your Audience in Mind: Applying Audience Analysis to the Design of Interactive Score Reports. Assessment in Education: Principles, Policy & Practice 21(4), 442--463

Cited By

Iantorno MPandeliev V(2024)Teaching Software to Diverse UX Design Cohorts: From Flipped Classrooms to Computer-Based ScaffoldingProceedings of the 6th Annual Symposium on HCI Education10.1145/3658619.3658632(1-11)Online publication date: 5-Jun-2024
https://dl.acm.org/doi/10.1145/3658619.3658632
Baghestani ALatulipe CBunt A(2024)Older Adults' Collaborative Learning Dynamics When Exploring Feature-Rich SoftwareProceedings of the ACM on Human-Computer Interaction10.1145/36373788:CSCW1(1-27)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637378
Zhang JHan BDong ZWen RLee GHoermann SZhang WPiumsomboon T(2024)Virtual Triplets: A Mixed Modal Synchronous and Asynchronous Collaboration with Human-Agent Interaction in Virtual RealityExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650766(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650766
Show More Cited By

Index Terms

Maestro: Designing a System for Real-Time Orchestration of 3D Modeling Workshops
1. Applied computing
  1. Education
2. Human-centered computing

Recommendations

CircuitStyle: A System for Peripherally Reinforcing Best Practices in Hardware Computing
UIST '19: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology

Instructors of hardware computing face many challenges including maintaining awareness of student progress, allocating their time adequately between lecturing and helping individual students, and keeping students engaged even while debugging problems. ...
PABS 2015: 1st Workshop on Performance Analysis of Big Data Systems
ICPE '15: Proceedings of the 6th ACM/SPEC International Conference on Performance Engineering

The first ACM international workshop on performance analysis of big data system is held in Austin, Texas, USA on February 1, 2015 and co-located with the ACM fifth International Conference on Performance Engineering (ICPE). The main objective of the ...
Analytics-enabled teaching as design: reconceptualisation and call for research
LAK '18: Proceedings of the 8th International Conference on Learning Analytics and Knowledge

As a human-centred educational practice and field of research, learning analytics must account for key stakeholders in teaching and learning. The focus of this paper is on the role of institutions to support teachers to incorporate learning analytics ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

October 2018

1016 pages

ISBN:9781450359481

DOI:10.1145/3242587

General Chairs:
Patrick Baudisch
Hasso-Plattner Institute, Germany
,
Albrecht Schmidt
LMU, Germany
,
Program Chair:
Andy Wilson
Microsoft Research, USA

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 October 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '18

Sponsor:

UIST '18: The 31st Annual ACM Symposium on User Interface Software and Technology

October 14, 2018

Berlin, Germany

Acceptance Rates

UIST '18 Paper Acceptance Rate 80 of 375 submissions, 21%;

Overall Acceptance Rate 842 of 3,967 submissions, 21%

Upcoming Conference

UIST '24

Sponsor:
sigchi
sigchi

The 37th Annual ACM Symposium on User Interface Software and Technology

October 13 - 16, 2024

Pittsburgh , PA , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
430
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Iantorno MPandeliev V(2024)Teaching Software to Diverse UX Design Cohorts: From Flipped Classrooms to Computer-Based ScaffoldingProceedings of the 6th Annual Symposium on HCI Education10.1145/3658619.3658632(1-11)Online publication date: 5-Jun-2024
https://dl.acm.org/doi/10.1145/3658619.3658632
Baghestani ALatulipe CBunt A(2024)Older Adults' Collaborative Learning Dynamics When Exploring Feature-Rich SoftwareProceedings of the ACM on Human-Computer Interaction10.1145/36373788:CSCW1(1-27)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637378
Zhang JHan BDong ZWen RLee GHoermann SZhang WPiumsomboon T(2024)Virtual Triplets: A Mixed Modal Synchronous and Asynchronous Collaboration with Human-Agent Interaction in Virtual RealityExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650766(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650766
Sarmiento JWise AWise AMartinez-Maldonado RHilliger I(2022)Participatory and Co-Design of Learning Analytics: An Initial Review of the LiteratureLAK22: 12th International Learning Analytics and Knowledge Conference10.1145/3506860.3506910(535-541)Online publication date: 21-Mar-2022
https://dl.acm.org/doi/10.1145/3506860.3506910
Bhaduri SBiddy QBush JSuresh ASumner TRoussou MShahid SFails JLandoni M(2021)3DnST: A Framework Towards Understanding Children’s Interaction with Tinkercad and Enhancing Spatial Thinking SkillsProceedings of the 20th Annual ACM Interaction Design and Children Conference10.1145/3459990.3460717(257-267)Online publication date: 24-Jun-2021
https://dl.acm.org/doi/10.1145/3459990.3460717
Stark JAnderson FFitzmaurice GSomanath SWakkary RAndersen KOdom WDesjardins APetersen M(2020)MakeAwareProceedings of the 2020 ACM Designing Interactive Systems Conference10.1145/3357236.3395472(1005-1016)Online publication date: 3-Jul-2020
https://dl.acm.org/doi/10.1145/3357236.3395472
Davis JGong JSun YChilana PYang XGuimbretière FBernstein MReinecke K(2019)CircuitStyleProceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332165.3347920(109-120)Online publication date: 17-Oct-2019
https://dl.acm.org/doi/10.1145/3332165.3347920

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents