short-paper

MAES:TRO: a practice system to track, record, and observe for novice orchestral conductors

Authors:

Ekaterina Ivanova,

Lulu Wang,

Yihe Fu,

Jeffrey GadzalaAuthors Info & Claims

CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

Pages 203 - 208

https://doi.org/10.1145/2559206.2580929

Published: 26 April 2014 Publication History

Get Access

Abstract

Conductors use their entire bodies to communicate with an orchestra to guide musicians through a piece of music. Currently, novice conductors learn basic conducting techniques through solo practice, which lacks factors that exist in a live orchestra rehearsal. We propose MAES:TRO: a conducting practice room that provides an immersive rehearsal experience and utilizes hand gestures, body orientation, and eye-gaze directions to directly alter a musical score. With the use of auditory/visual feedback and a report of incorrect beat, tempo, and instrumental emphasis, conductors are able to self-reflect and improve basic techniques. Our user testing of a low-fidelity prototype showed the system's potential to improve the effectiveness of novice conductor's solo practice.

Supplementary Material

ZIP File (sdc0125-file4.zip)

MAES:TRO

Download
4.64 MB

References

[1]

Asteriadis, S., Chatzitofis, A., Zarpalas, D., Alexiadis, D. S., and Daras, P. Estimating human motion from multiple Kinect sensors. In Proc. MIRAGE '13, ACM Press (2013), New York, NY, USA.

Digital Library

Google Scholar

[2]

Battisti, F. On Becoming a Conductor: Lessons and Meditations on the Art of Conducting. Meredith Music Publications: Galesville, MD, USA, 2007.

Google Scholar

[3]

Bergee, M. J. An exploratory comparison of novice, intermediate, and expert orchestral conductors. International Journal of Music Education 23, April (2005), 23--36.

Crossref

Google Scholar

[4]

Holtzblatt, K. and Jones, S. Contextual inquiry: A participatory technique for system design. In Participatory Design: Principles and Practice. Hillsdale, NJ, USA, 1993.

Google Scholar

[5]

Han S., Kim J. B. and Kim, J. Follow-Me! Conducting a virtual concert. In UIST Adjunct Proc. '12, ACM Press (2012), 65--66.

Digital Library

Google Scholar

[6]

Kennedy, M. The Oxford Dictionary of Music (2nd Ed.) Oxford University Press: USA, 2006.

Google Scholar

[7]

Lee, E., Karrer, T., Kiel, H., Wolf, M., Dedenbach, S., Borchers, J., and Grüll, I. iSymphony: An adaptive interactive orchestral conducting system for digital audio and video streams. In Proc. CHI 2006, ACM Press (2006), 259--262.

Digital Library

Google Scholar

[8]

Nakra, T. M. Inside the Conductor's Jacket: Analysis, Interpretation and Musical Synthesis of Expressive Gesture. Doctoral dissertation. MIT: Cambridge, MA, USA, 2000.

Google Scholar

[9]

Raphael, C. The informatics philharmonic. Communications of the ACM 54, 3(2011), 87--93.

Digital Library

Google Scholar

[10]

Siegel, M. and Beck, J. Slow change interaction design: A theoretical sketch exploring the mindsets required for creating interactive technologies that facilitate attitudinal and behavioral change over time. Interactions January-February (2014), 28--35.

Digital Library

Google Scholar

[11]

Wakin, D. The maestro's mojo. The New York Times. (2012) http://tinyurl.com/77a335n.

Google Scholar

Cited By

View all

Wei BAlmeda STam EAbrahamson D(2024)Demonstration of Sympathetic Orchestra: An Interactive Conducting Education System for Responsive, Tacit Skill DevelopmentAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686783(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686783
Salgian AHsu LMilkosky NVickerman D(2015)Conductor Tutoring Using the Microsoft KinectAdvances in Visual Computing10.1007/978-3-319-27863-6_3(24-34)Online publication date: 18-Dec-2015
https://doi.org/10.1007/978-3-319-27863-6_3

Index Terms

MAES:TRO: a practice system to track, record, and observe for novice orchestral conductors
1. Human-centered computing
  1. Interaction design
    1. Interaction design process and methods
      1. User centered design

Recommendations

iSymphony: an adaptive interactive orchestral conducting system for digital audio and video streams
CHI EA '06: CHI '06 Extended Abstracts on Human Factors in Computing Systems

We present iSymphony, an interactive orchestral conducting system for digital audio and video that adaptively adjusts to the user's conducting style. Using a digital baton, users may control the tempo, volume, and instrument emphasis of a digital audio ...
Improving orchestral conducting systems in public spaces: examining the temporal characteristics and conceptual models of conducting gestures
CHI '05: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Designing interactive conducting exhibits for public spaces poses unique challenges, primarily because the conceptual model of conducting music varies amongst users. In a user study, we compared how conductors and non-conductors place their beats when ...
Conducting a realistic electronic orchestra
UIST '01: Proceedings of the 14th annual ACM symposium on User interface software and technology

Personal Orchestra is the first system to let users conduct an actual audio and video recording of an orchestra, using an infrared baton to control tempo, volume, and instrument sections. A gesture recognition algorithm interprets user input, and a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

April 2014

2620 pages

ISBN:9781450324748

DOI:10.1145/2559206

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI EA '14 Paper Acceptance Rate 1,000 of 3,200 submissions, 31%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
219
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)1

Reflects downloads up to 01 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Wei BAlmeda STam EAbrahamson D(2024)Demonstration of Sympathetic Orchestra: An Interactive Conducting Education System for Responsive, Tacit Skill DevelopmentAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686783(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686783
Salgian AHsu LMilkosky NVickerman D(2015)Conductor Tutoring Using the Microsoft KinectAdvances in Visual Computing10.1007/978-3-319-27863-6_3(24-34)Online publication date: 18-Dec-2015
https://doi.org/10.1007/978-3-319-27863-6_3

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

iSymphony: an adaptive interactive orchestral conducting system for digital audio and video streams

Improving orchestral conducting systems in public spaces: examining the temporal characteristics and conceptual models of conducting gestures

Conducting a realistic electronic orchestra