research-article

PaperComposer: creating interactive paper interfaces for music composition

Authors:

Jérémie Garcia,

Theophanis Tsandilas,

Wendy MackayAuthors Info & Claims

IHM '14: Proceedings of the 26th Conference on l'Interaction Homme-Machine

Pages 1 - 8

https://doi.org/10.1145/2670444.2670450

Published: 28 October 2014 Publication History

Abstract

Interactive paper technologies offer new opportunities for supporting the highly individual practices of creative artists, such as contemporary music composers, who express and explore their ideas on both paper and the computer. We introduce PaperComposer, a graphical interface builder that allows users to create a personalized interactive paper interface that they can connect to their own computer-based musical data. We also present an API that facilitates the development of interactive paper components for PaperComposer. We describe one public demonstration of a novel musical interface designed for children and our collaborations with composers to create two novel interactive music interfaces that reflected their individual composition styles.

References

[1]

Agon, C., Bresson, J. and Assayag, G. 2006. The OM composers' book Vol.1 & Vol.2. Collection Musique/Sciences.

[2]

Arai, T., Aust, D. and Hudson, S. E. 1997. PaperLink: a technique for hyperlinking from real paper to electronic content. In Proc. ACM/CHI '97, 327--334.

Digital Library

[3]

Bigo, L., Garcia, J., Spicher, A. and Mackay, W. E. 2012. PaperTonnetz: Music Composition with Interactive Paper Tonnetz. In Proc. SMC'12, 219--225.

[4]

Bresson, J. and Agon, C. 2008. Scores, Programs, and Time Representation: The Sheet Object in OpenMusic. Computer Music Journal. 32-4, 31--47.

Digital Library

[5]

Douglas, D. H. and Peucker, T. K. 1973. Algorithms for the reduction of the number of points required to represent a digitized line or its caricature. Cartographica: The International Journal for Geographic Information and Geovisualization. 10, 2, 112--122.

[6]

Forsberg, A., Dieterich, M. and Zeleznik, R. 1998. The music notepad. In Proc. UIST '98, 203--210.

Digital Library

[7]

Garcia, J., Tsandilas, T., Agon, C. and Mackay, W. 2011. InkSplorer: Exploring Musical Ideas on Paper and Computer. In Proc. NIME '11, 361--366.

[8]

Garcia, J., Tsandilas, T., Agon, C. and Mackay, W. 2012. Interactive paper substrates to support musical creation. In Proc. ACM/CHI '12, 1825--1828.

Digital Library

[9]

Garcia, J., Tsandilas, T., Agon, C. and Mackay, W. E. 2014. Structured observation with polyphony: a multifaceted tool for studying music composition. In Proc. ACM/DIS '14, 199--208.

Digital Library

[10]

Hadjieleftheriou, M., Hoel, E. and Tsotras, V. J. 2005. SaIL: A Spatial Index Library for Efficient Application Integration. GeoInformatica. 9, 4, 367--389.

Digital Library

[11]

Hall, P. and Sallis, F. 2004. A handbook to twentieth-century musical sketches. Cambridge University Press.

[12]

Healey, P. G. T., Jean-Baptiste Thiebaut and Thiebaut, J.-B. 2007. Sketching Musical Compositions. In Proc. CogSci' 07, 1079--1084.

[13]

Heinrichs, F., Steimle, J., Schreiber, D. and Mühlhäuser, M. 2010. Letras: an architecture and framework for ubiquitous pen-and-paper interaction. In Proc. ACM/EICS '10, 193--198.

Digital Library

[14]

Hurter, C., Lesbordes, R., Letondal, C., Vinot, J.-L. and Conversy, S. 2012. Strip'TIC: Exploring Automatic Paper Strip for Air Traffic Controllers. In Proc of AVI '12, 225.

Digital Library

[15]

Lee, K. C., Phon-Amnuaisuk, S. and Ting, C. Y. 2010. A comparison of HMM, Naïve Bayesian, and Markov model in exploiting knowledge content in digital ink: A case study on handwritten music notation recognition. IEEE International Conference on Multimedia and Expo, 292--297.

[16]

Letondal, C., Mackay, W. E. and Donin, N. 2007. Paperoles et musique. In Proc. ACM/IHM, 167--174.

Digital Library

[17]

Newman, T. U. 2008. The Creative Process of Music Composition: A Qualitative Self-study. ProQuest.

[18]

Norrie, M. C., Signer, B. and Weibel, N. 2006. General framework for the rapid development of interactive paper applications. In Proc. CoPADD. 6, 9--12.

[19]

Signer, B., Kurmann, U. and Norrie, M. 2007. iGesture: a general gesture recognition framework. In Proc. ICDAR '07, 954--958.

Digital Library

[20]

Song, H., Guimbretiere, F., Grossman, T. and Fitzmaurice, G. 2010. MouseLight: bimanual interactions on digital paper using a pen and a spatially-aware mobile projector. In Proc. ACM/CHI '10, 2451

Digital Library

[21]

Tsandilas, T. 2012. Interpreting strokes on paper with a mobile assistant. In Proc. UIST '12, 299.

Digital Library

[22]

Tsandilas, T., Letondal, C. and Mackay, W. E. 2009. Musink: composing music through augmented drawing. In Proc. ACM/CHI 09, 819--828.

Digital Library

[23]

Wright, M. and Freed, A. 1997. Open Sound Control: A New Protocol for Communicating with Sound Synthesizers. In Proc. ICMC'97, 101--104.

[24]

Yeh, R. B., Paepcke, A. and Klemmer, S. R. 2008. Iterative design and evaluation of an event architecture for pen-and-paper interfaces. In Proc. UIST '08, 111.

Digital Library

Cited By

Mackay WMackay W(2023)Réimaginer nos interactions avec le monde numériqueRéimaginer nos interactions avec le monde numérique10.4000/books.cdf.14422Online publication date: 12-Jan-2023
https://doi.org/10.4000/books.cdf.14422
Bailey G(2019)Bridging the Gap Between the Digital and Print Reading ExperienceInternational Journal of Mobile Human Computer Interaction10.4018/IJMHCI.201910010211:4(16-30)Online publication date: Oct-2019
https://doi.org/10.4018/IJMHCI.2019100102
Malloch JGarcia JWanderley MMackay WBeaudouin-Lafon MHuot S(2019)A Design Workbench for Interactive Music SystemsNew Directions in Music and Human-Computer Interaction10.1007/978-3-319-92069-6_2(23-40)Online publication date: 7-Feb-2019
https://doi.org/10.1007/978-3-319-92069-6_2

Index Terms

PaperComposer: creating interactive paper interfaces for music composition
1. Applied computing
  1. Arts and humanities
    1. Sound and music computing
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Graphical user interfaces

Recommendations

Structured observation with polyphony: a multifaceted tool for studying music composition
DIS '14: Proceedings of the 2014 conference on Designing interactive systems

Contemporary music composition is a highly creative and disciplined activity that requires free expression of ideas and sophisticated computer programming. This paper presents a technique for structured observation of expert creative behavior, as well ...
Musink: composing music through augmented drawing
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We focus on the creative use of paper in the music composition process, particularly the interaction between paper and end-user programming. When expressing musical ideas, composers draw in a precise way, not just sketch. Working in close collaboration ...
Music Composition Using Combination of Genetic Algorithms and Recurrent Neural Networks
HIS '08: Proceedings of the 2008 8th International Conference on Hybrid Intelligent Systems

Creativity has a fundamental role in music composition. One of the theories, which exist about creativity, is combination-theory. In this paper the suitability of genetic algorithms and recurrent neural networks for modeling this theory is considered. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

IHM '14: Proceedings of the 26th Conference on l'Interaction Homme-Machine

October 2014

237 pages

ISBN:9781450329354

DOI:10.1145/2670444

General Chairs:
Géry Casiez
Université Lille 1
,
Thomas Pietrzak
Université Lille 1
,
Program Chairs:
Olivier Chapuis
CNRS & Univ. Paris-Sud
,
Stéphane Conversy
ENAC & Univ. de Toulouse

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

AFIHM: Ass. Francophone d'Interaction Homme-Machine
INRIA: Institut Natl de Recherche en Info et en Automatique

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 October 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Agence Nationale de la Recherche

Conference

IHM '14

Sponsor:

AFIHM
INRIA

IHM '14: 26e conference francophone sur l'Interaction Homme-Machine

October 28 - 31, 2014

Villeneuve d'Ascq, France

Acceptance Rates

IHM '14 Paper Acceptance Rate 18 of 32 submissions, 56%;

Overall Acceptance Rate 103 of 199 submissions, 52%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
175
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 20 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Mackay WMackay W(2023)Réimaginer nos interactions avec le monde numériqueRéimaginer nos interactions avec le monde numérique10.4000/books.cdf.14422Online publication date: 12-Jan-2023
https://doi.org/10.4000/books.cdf.14422
Bailey G(2019)Bridging the Gap Between the Digital and Print Reading ExperienceInternational Journal of Mobile Human Computer Interaction10.4018/IJMHCI.201910010211:4(16-30)Online publication date: Oct-2019
https://doi.org/10.4018/IJMHCI.2019100102
Malloch JGarcia JWanderley MMackay WBeaudouin-Lafon MHuot S(2019)A Design Workbench for Interactive Music SystemsNew Directions in Music and Human-Computer Interaction10.1007/978-3-319-92069-6_2(23-40)Online publication date: 7-Feb-2019
https://doi.org/10.1007/978-3-319-92069-6_2
Wang DZhao CKong J(2017)The Fusion of an Ultrasonic and Spatially Aware System in a Mobile-Interaction DeviceSymmetry10.3390/sym90801379:8(137)Online publication date: 30-Jul-2017
https://doi.org/10.3390/sym9080137

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents