Abstract
Structure in music can mean many things: repetition, tonality, the existence of and focus on different “musical dimensions”, such as rhythm, timbre, etc. Here, we are concerned with repetitive structures in music, such as sections that repeat within a song (verses, choruses, etc.). We are also concerned mainly with hierarchical repetition (e.g., within a verse, there may be a phrase or riff that recurs multiple times). Existing annotated music datasets tend to be either small in terms of items in the corpus, but with detailed annotatations, or larger as a corpus, but with linear annotations only. In this paper, we 1) develop a method for taking a linear annotation as input, and converting it to a hierarchical annotation as output, where such hierarchies exist in the input, and 2) introduce a web-based interface (https://pendular-graph.glitch.me/) where hierarchical annotations of 909 songs can be explored and played back, in synchrony with a visual representation of note content.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Barlow, H., Morgenstern, S.: A Dictionary of Musical Themes. Crown Publishers (1948)
Benetos, E., Dixon, S., Duan, Z., Ewert, S.: Automatic music transcription: an overview. IEEE Signal Process. Mag. 36(1), 20–30 (2018)
Bent, I.D., Pople, A.: Analysis. In: Sadie, S., Tyrrell, J. (eds.) The New Grove Dictionary of Music and Musicians, 2nd edn, vol. 1, pp. 526–589. Macmillan, London (2001)
Bruhn, S.: J.S. Bach’s Well-Tempered Clavier: In-depth Analysis and Interpretation, vol. 4. Siglind Bruhn (1993)
Chen, T.P., Su, L.: The musical schemagram: time-scale visualization of repeated patterns in music. In: 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), pp. 1642–1648. IEEE (2018)
Collins, T.: Discovery of repeated themes and sections (2013). https://www.music-ir.org/mirex/wiki/2013:Discovery_of_Repeated_Themes_%26_Sections
Collins, T., Arzt, A., Flossmann, S., Widmer, G.: SIARCT-CFP: improving precision and the discovery of inexact musical patterns in point-set representations. In: Proceedings of the International Society for Music Information Retrieval Conference, Curitiba, pp. 549–554 (2013)
Collins, T., Coulon, C.: MAIA Util: an NPM package for bridging web audio with music-theoretic concepts. In: Proceedings of the Web Audio Conference, pp. 47–52 (2019)
Conklin, D., Witten, I.H.: Multiple viewpoint systems for music prediction. J. New Music Res. 24(1), 51–73 (1995)
Crawford, T., Badkobeh, G., Lewis, D.: Searching page-images of early music scanned with OMR: a scalable solution using minimal absent words. In: Proceedings of the International Society for Music Information Retrieval Conference, Paris, pp. 233–239 (2018)
Dai, S., Yu, H., Dannenberg, R.B.: What is missing in deep music generation? a study of repetition and structure in popular music. In: Proceedings of the International Society for Music Information Retrieval Conference, Bengaluru, pp. 659–666 (2022)
Dai, S., Zhang, H., Dannenberg, R.B.: Automatic analysis and influence of hierarchical structure on melody, rhythm and harmony in popular music. In: Proceedings of the Joint Conference on AI Music Creativity (2020)
De Prisco, R., Malandrino, D., Pirozzi, D., Zaccagnino, G., Zaccagnino, R.: Understanding the structure of musical compositions: is visualization an effective approach? Inf. Vis. 16(2), 139–152 (2017)
Deutsch, D.: The processing of structured and unstructured tonal sequences. Percept. Psychophys. 28(5), 381–389 (1980)
Deutsch, D., Feroe, J.: The internal representation of pitch sequences in tonal music. Psychol. Rev. 88(6), 503 (1981)
Endrjukaite, T., Kosugi, N.: Music visualization technique of repetitive structure representation to support intuitive estimation of music affinity and lightness. J. Mob. Multim. 8(1), 49–71 (2012)
Goto, M., Ogata, J., Yoshii, K., Fujihara, H., Mauch, M., Nakano, T.: PodCastle and Songle: crowdsourcing-based web services for spoken document retrieval and active music listening. In: Information Theory and Applications Workshop, pp. 298–299 (2012)
Hawthorne, C., Simon, I., Swavely, R., Manilow, E., Engel, J.: Sequence-to-sequence piano transcription with transformers. In: Proceedings of the International Society for Music Information Retrieval Conference, pp. 246–253 (2021)
Hayashi, A., Itoh, T., Matsubara, M.: Colorscore: visualization and condensation of structure of classical music. In: Knowledge Visualization Currents: From Text to Art to Culture, pp. 113–128 (2013)
Lamere, P.: The Infinite Jukebox (2012). https://eternalbox.dev/jukebox_index.html
Lerdahl, F., Jackendoff, R.: A Generative Theory of Tonal Music. MIT Press, Cambridge (1983)
Mann, Y.: Interactive music with Tone.js. In: Proceedings of the International Web Audio Conference (2015)
Meyer, L.B.: Emotion and Meaning in Music. University of Chicago Press (2008)
Nikrang, A., Collins, T., Widmer, G.: PatternViewer: an application for exploring repetitive and tonal structure. In: Late-Breaking News and Demos of the International Society for Music Information Retrieval Conference, Taipei (2014)
Schoenberg, A.: Fundamentals of Musical Composition. Faber and Faber (1967)
Schoenberg, A.: Style and Idea: Selected Writings. University of California Press (2010)
Tomašević, D., Wells, S., Ren, I.Y., Volk, A., Pesek, M.: Exploring annotations for musical pattern discovery gathered with digital annotation tools. J. Math. Music 15(2), 194–207 (2021)
Walshaw, C.: The ABC music standard 2.1 technical report (2011). https://abcnotation.com
Wang, Z., et al.: POP909: a pop-song dataset for music arrangement generation. In: Proceedings of the International Society for Music Information Retrieval Conference, Montreal, pp. 38–45 (2020)
Wattenberg, M.: Shape of song (2002). http://www.turbulence.org/Works/song/
Wattenberg, M.: Arc diagrams: visualizing structure in strings. In: IEEE Symposium on Information Visualization, pp. 110–116 (2002)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Gao, C., Collins, T. (2023). The Pendular Graph: Visualising Hierarchical Repetitive Structure in Point-Set Representations of the POP909 Music Dataset. In: Mori, H., Asahi, Y., Coman, A., Vasilache, S., Rauterberg, M. (eds) HCI International 2023 – Late Breaking Papers. HCII 2023. Lecture Notes in Computer Science, vol 14056. Springer, Cham. https://doi.org/10.1007/978-3-031-48044-7_1
Download citation
DOI: https://doi.org/10.1007/978-3-031-48044-7_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-48043-0
Online ISBN: 978-3-031-48044-7
eBook Packages: Computer ScienceComputer Science (R0)