Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/2544114.2544123acmconferencesArticle/Chapter ViewAbstractPublication PagesamConference Proceedingsconference-collections
research-article

Gestural user interface for audio multitrack real-time stereo mixing

Published: 18 September 2013 Publication History

Abstract

Sound mixing is a well-established task applied (directly or indirectly) in many fields of music and sound production. For example, in the case of classical music orchestras, their conductors perform sound mixing by specifying the reproduction gain of specific groups of musical instruments or of the entire orchestra. Moreover, modern sound artists and performers also employ sound mixing when they compose music or improvise in real-time. In this work a system is presented that incorporates a gestural interface for real-time multitrack sound mixing. The proposed gestural sound mixing control scheme is implemented on an open hardware micro-controller board, using common sensor modules. The gestures employed are as close as possible to the ones particularly used by the orchestra conductors. The system overall performance is also evaluated in terms of the achieved user experience through subjective tests.

References

[1]
Arduino. Software. http://arduino.cc/en/main/software, 2005. {Online; accessed 20-April-2013}.
[2]
Arduino. ArduinoBoardMega. http://arduino.cc/en/Main/arduinoBoardMega, 2009. {Online; accessed 20-April-2013}.
[3]
K. Drossos, R. Kotsakis, G. Kalliris, and A. Floros. Sound events and emotions: Investigating the relation of rhythmic characteristics and arousal. In Fourth International Conference on Information, Intelligence, Systems and Applications, IISA 2013. IEEE, July 2013.
[4]
K. Drossos, S. Mimilakis, A. Floros, and N. Kanellopoulos. Stereo goes mobile: Spatial enhancement for short-distance loudspeaker setups. In Eighth International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIH-MSP, pages 432--435. IEEE, July 2012.
[5]
N. Grigoriou, A. Floros, and K. Drossos. Binaural mixing using gestural control interaction. In Proceedings of the 5th Audio Mostly Conference: A Conference on Interaction with Sound, AM '10. ACM, September 2010.
[6]
C. Kiefer, N. Collins, and G. Fitzpatrick. Evaluating the wiimote as a musical controller. In International Computer Music Conference, ICMC, August 2008.
[7]
J. M. Morrell, D. J. Reiss, and T. Stockman. Auditory cues for gestural control of multi-track audio. In The 17th International Conference on Auditory Display, ICAD-2011, June 2011.
[8]
V. I. Pavlovic, R. Sharma, and T. S. Huang. Visual interpretation of hand gestures for human computer interaction: a review. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7):667--695, July 1997.
[9]
A. Pirhonen, S. Brewster, and C. Holguin. Gestural and audio metaphors as a means of control for mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '02, pages 291--298, 2002.
[10]
V. Pulkki. Virtual sound source positioning using vector base amplitude panning. Journal of Audio Engineering Society (JAES), 45(6):456--466, June 1997.
[11]
V. Pulkki. Localization of amplitude-panned virtual sources ii: Two- and three-dimensional panning. Journal of Audio Engineering Society (JAES), 49(9):753--767, September 2001.
[12]
P. Quinn, C. Dodds, and D. Knox. Use of novel controllers in surround sound production. In Audio Mostly 2009 - the 4th Conference on Interaction with Sound, AM '09, September 2009.
[13]
E. Sato, T. Yamaguchi, and F. Harashima. Natural interface using pointing behavior for human-robot gestural interaction. IEEE Transactions on Industrial Electronics, 54(2):1105--1112, April 2007.
[14]
R. Selfridge and J. Reiss. Interactive mixing using wii controller. In 130th Audio Engineering Society Convention, AES Convention. AES, May 2011.
[15]
W. O. Site. What is Wii. http://www.nintendo.com/wii/what-is-wii/, 2013. {Online; accessed 13-May-2013}.

Cited By

View all
  • (2015)Accessible games for blind children, empowered by binaural soundProceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments10.1145/2769493.2769546(1-8)Online publication date: 1-Jul-2015

Index Terms

  1. Gestural user interface for audio multitrack real-time stereo mixing

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    AM '13: Proceedings of the 8th Audio Mostly Conference
    September 2013
    132 pages
    ISBN:9781450326599
    DOI:10.1145/2544114
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 18 September 2013

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. gestural interaction
    2. gestural real-time sound mixing
    3. real-time interaction
    4. real-time sound mixing

    Qualifiers

    • Research-article

    Conference

    AM '13
    Sponsor:
    AM '13: Audio Mostly 2013
    September 18 - 20, 2013
    Piteå, Sweden

    Acceptance Rates

    Overall Acceptance Rate 177 of 275 submissions, 64%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)7
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 21 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2015)Accessible games for blind children, empowered by binaural soundProceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments10.1145/2769493.2769546(1-8)Online publication date: 1-Jul-2015

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media