short-paper

Finding my beat: personalised rhythmic filtering for mobile music interaction

Authors:

Roderick Murray-SmithAuthors Info & Claims

MobileHCI '13: Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services

Pages 21 - 30

https://doi.org/10.1145/2493190.2493220

Published: 27 August 2013 Publication History

Abstract

A novel interaction style is presented, allowing in-pocket music selection by tapping a song's rhythm on a device's touchscreen or body. We introduce the use of rhythmic queries for music retrieval, employing a trained generative model to improve query recognition. We identify rhythm as a fundamental feature of music which can be reproduced easily by listeners, making it an effective and simple interaction technique for retrieving music. We observe that users vary in which instruments they entrain with and our work is the first to model such variability. An experiment was performed, showing that after training the generative model, retrieval performance improved two-fold. All rhythmic queries returned a highly ranked result with the trained generative model, compared with 47% using existing methods. We conclude that generative models of subjective user queries can yield significant performance gains for music retrieval and enable novel interaction techniques such as rhythmic filtering.

References

[1]

Böck, S., Krebs, F., and Schedl, M. Evaluating the Online Capabilities of Onset Detection Methods. In Proc. ISMIR 2012 (2012), 49--54.

[2]

Crossan, A., and Murray-Smith, R. Rhythmic Interaction for Song Filtering on a Mobile Device. Haptics and Audio Interface Design (2006), 45--55.

Digital Library

[3]

Drake, C., and Ben El Heni, J. Synchronizing with Music: Intercultural Differences. Annals of the New York Academy of Sciences 999 (2003), 429--437.

[4]

Drake, C., and Bertrand, D. The Quest for Universals in Temporal Processing in Music. Annals of the New York Academy of Science 930 (2001), 17--27.

[5]

Ghomi, E., Faure, G., Huot, S., and Chapuis, O. Using rhythmic patterns as an input method. Proc. CHI (2012), 1253--1262.

Digital Library

[6]

Hanna, P. Query by tapping system based on alignment algorithm. In Proc. ICASSP (2009), 1881--1884.

Digital Library

[7]

Jang, J., Lee, H., and Yeh, C.-H. Query by Tapping: A New Paradigm for Content-based Music Retrieval from Acoustic Input. Proc. PCM (2001).

Digital Library

[8]

Karaganis, J., and Renkema, L. Copy Culture in the US and Germany. American Assembly, 2013.

[9]

Lafferty, J., and Zhai, C. Document language models, query models, and risk minimization for information retrieval. In Proc. SIGIR 2001, ACM (2001), 111--119.

Digital Library

[10]

Lantz, V., and Murray-Smith, R. Rhythmic interaction with a mobile device. In Proc. NordiCHI, ACM (2004), 97--100.

Digital Library

[11]

Lee, J., Downie, J., and Cunningham, S. Challenges in cross-cultural/multilingual music information seeking. In Proc. of MIR, Citeseer (2005), 1--7.

[12]

Leong, T., Vetere, F., and Howard, S. The serendipity shuffle. In Proc. OZCHI (2005), 25--28.

Digital Library

[13]

Manabe, H., and Fukumoto, M. Headphone taps: a simple technique to add input function to regular headphones. In Proc. MobileHCI 2012, ACM (2012), 177--179.

Digital Library

[14]

Masri, P. Computer modelling of sound for transformation and synthesis of musical signals. PhD thesis, University of Bristol, 1996.

[15]

Monahan, C. B., and Carterette, E. C. Pitch and duration as determinants of musical space. Music Perception 3, 1--32 (1985).

[16]

Mongeau, M., and Sankoff, D. Comparison of musical sequences. Computers and the Humanities (1990).

[17]

Pohl, H., and Murray-Smith, R. Focused and casual interactions: Allowing users to vary their level of engagement. In Proc. CHI (2013).

Digital Library

[18]

Quiñones, M. Listening in Shuffle Mode. Lied und populare Kultur/Song and Popular Culture, 2007 (2007), 11--22.

[19]

Rico, J., and Brewster, S. Usable gestures for mobile interfaces: evaluating social acceptability. In Proc. CHI (2010).

Digital Library

[20]

Saponas, T. S., Harrison, C., and Benko, H. Pockettouch: through-fabric capacitive touch input. In Proceedings of the 24th annual ACM symposium on User interface software and technology, UIST '11, ACM (2011), 303--308.

Digital Library

[21]

Smith, T. F., and Waterman, M. S. Identification of common molecular subsequences. Molecular Biology 147, 1 (1981), 195--197.

[22]

Stober, S. Adaptive Methods for User-Centered Organization of Music Collections. PhD thesis, Otto-von-Guericke-University, Magdeburg, 2011.

[23]

Stowell, D., Plumbley, M., and Mary, Q. Adaptive whitening for improved real-time audio onset detection. Proc. ICMC 2007 (2007).

[24]

Trehub, S. E. Human processing predispositions and musical universals. In The Origins of Music, N. L. Wallin, B. Merker, and S. Brown, Eds. MIT Press, 2000, ch. 23, 427--448.

[25]

Wobbrock, J. O. Tapsongs: tapping rhythm-based passwords on a single binary sensor. In Proc. UIST (2009), 93--96.

Digital Library

Cited By

Yi-yan WWen CJing-ze TWei-chi HYa-feng NWen-jun YCheng-qi X(2024)Design recommendations of target size and tracking speed under circular and square trajectories for smooth pursuit with Euclidean algorithm in eye-control systemDisplays10.1016/j.displa.2023.10260881(102608)Online publication date: Jan-2024
https://doi.org/10.1016/j.displa.2023.102608
Reyes GWu JJuneja NGoldshtein MEdwards WAbowd GStarner T(2018)SynchroWatchProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/31611621:4(1-26)Online publication date: 8-Jan-2018
https://dl.acm.org/doi/10.1145/3161162
Velloso ECarter MNewn JEsteves AClarke CGellersen H(2017)Motion CorrelationACM Transactions on Computer-Human Interaction10.1145/306493724:3(1-35)Online publication date: 28-Apr-2017
https://dl.acm.org/doi/10.1145/3064937
Show More Cited By

Index Terms

Finding my beat: personalised rhythmic filtering for mobile music interaction
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Standstill to the 'beat': differences in involuntary movement responses to simple and complex rhythms
AM '20: Proceedings of the 15th International Audio Mostly Conference

Previous studies have shown that movement-inducing properties of music largely depend on the rhythmic complexity of the stimuli. However, little is known about how simple isochronous beat patterns differ from more complex rhythmic structures in their ...
Synchronization and fluctuation of rhythm in musical cooperative performance
HCII'11: Proceedings of the 14th international conference on Human-computer interaction: design and development approaches - Volume Part I

A live musical performance gives us better impression than recorded music heard from a portable music player. From player's point of view, live performance also gives better impression than playing music with metronome or recorded music. Thus, the ...
Generative Audio and Real-Time Soundtrack Synthesis in Gaming Environments: An exploration of how dynamically rendered soundtracks can introduce new artistic sound design opportunities and enhance the immersion of interactive audio spaces.
OzCHI '20: Proceedings of the 32nd Australian Conference on Human-Computer Interaction

An important yet oft-overlooked front in the scope of interactive media, audio technologies have remained relatively stagnant compared to groundbreaking advancements made in fields such as visual fidelity and virtual reality. This paper explores the use ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '13: Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services

August 2013

662 pages

ISBN:9781450322737

DOI:10.1145/2493190

General Chairs:
Michael Rohs
University of Hannover, Germany
,
Albrecht Schmidt
University of Stuttgart, Germany
,
Program Chairs:
Daniel Ashbrook
Samsung, USA
,
Enrico Rukzio
University of Ulm, Germany and Lancaster University, UK

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 August 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

MobileHCI '13

Sponsor:

SIGCHI

MobileHCI '13: 15th International Conference on Human-Computer Interaction with Mobile Devices and Services

August 27 - 30, 2013

Munich, Germany

Acceptance Rates

MobileHCI '13 Paper Acceptance Rate 53 of 238 submissions, 22%;

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
361
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yi-yan WWen CJing-ze TWei-chi HYa-feng NWen-jun YCheng-qi X(2024)Design recommendations of target size and tracking speed under circular and square trajectories for smooth pursuit with Euclidean algorithm in eye-control systemDisplays10.1016/j.displa.2023.10260881(102608)Online publication date: Jan-2024
https://doi.org/10.1016/j.displa.2023.102608
Reyes GWu JJuneja NGoldshtein MEdwards WAbowd GStarner T(2018)SynchroWatchProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/31611621:4(1-26)Online publication date: 8-Jan-2018
https://dl.acm.org/doi/10.1145/3161162
Velloso ECarter MNewn JEsteves AClarke CGellersen H(2017)Motion CorrelationACM Transactions on Computer-Human Interaction10.1145/306493724:3(1-35)Online publication date: 28-Apr-2017
https://dl.acm.org/doi/10.1145/3064937
Boland DMcLachlan RMurray-Smith RBoring SRukzio EGellersen HHinckley K(2015)Engaging with Mobile Music RetrievalProceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/2785830.2785846(484-493)Online publication date: 24-Aug-2015
https://dl.acm.org/doi/10.1145/2785830.2785846
Nansen BVetere FRobertson TDowns JBrereton MDurick J(2014)Reciprocal HabituationACM Transactions on Computer-Human Interaction10.1145/261757321:3(1-20)Online publication date: 16-Jun-2014
https://dl.acm.org/doi/10.1145/2617573

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents