Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3678299.3678318acmotherconferencesArticle/Chapter ViewAbstractPublication PagesamConference Proceedingsconference-collections
research-article
Open access

Micropolyphony and Stochastic Compositional Techniques as Tools for the Sonification of Magnetic Storms

Published: 18 September 2024 Publication History

Abstract

In today's rapidly evolving world, interdisciplinary collaboration and effective science communication are more crucial than ever. Data sonification has emerged as a valuable tool for disseminating scientific knowledge to the public in accessible formats. This technique is increasingly prevalent in astronomy and astrophysics, from scientific to creative applications. However, not all methods of assigning data to musical features lead to efficient sonification. Research suggests that achieving a pleasant sound result and creating familiarity can increase efficiency by engaging the listener's perception. Based on the above, we propose a sonification approach that employs micropolyphony and stochastic compositional techniques to represent magnetic storm phenomena. The first part of this paper provides a brief historical overview of sonification in scientific contexts, followed by a comprehensive survey of existing literature that applies sonification to represent physical phenomena in space sciences, with a focus on solar activity. The second part discusses the proposed sonification technique and mapping methodology to represent various intensities of geomagnetic disturbances, including extreme events. In addition to pitch-intensity assignment, we incorporate sound features such as sound density, dissonance, and complexity to engage the listener with concepts related to the storm, such as disturbance, turbulence, and danger. Combined action of individual elements such as pitch range expansion and rhythms acceleration in conjunction with micropolyphonic canon and superposition of successive dissonant minor second interval, merged to a dense and dynamic sound mass reflecting the storm's complex and intense nature.

Supplemental Material

ZIP File
Sound material from the sonification of four magnetic storms and a period where no event occures.

References

[1]
Robert Alexander, Thomas H. Zurbuchen, Jason Gilbert, Susan Lepri, and Jim Raines. 2010. Sonification of ACE level 2 solar wind data. In proceedings of the 16th International Conference on Auditory Display (ICAD2010), Washington, DC, USA. 9-15 June, 2010. Ed. Eoin Brazil. International Community for Auditory Display, 2010
[2]
Anon. Sonification: A tool for research, outreach, and inclusion in ... Retrieved 2024 from https://www.unoosa.org/documents/pdf/Space4PersonswithDisabilites/UNOOSA_Special_Report_on_Sonification_2023.pdf 
[3]
Marc Ballora. 2014 Sonification Strategies for the Film Rhythms of the Universe. Presented at the 20th International Conference on Auditory Display (ICAD2014), June 22-25, 2014, New York, NY. https://smartech.gatech.edu/handle/1853/52075 
[4]
Marc Ballora. 2017. Sonification of solar wind. Youtube. Retrieved 2023 from https://www.youtube.com/watch?v=VPo4iOZRkls
[5]
Stephen Barrass and Gregory Kramer. 1999. Using sonification. Multimedia Systems 7, 1 (January 1999), 23–31.
[6]
Amy Bauer. 2012 Canon as an agent of revelation in the music of Ligeti. In Contemporary Music and Spirituality. Retrieved from https://escholarship.org/uc/item/46d198sj
[7]
Núria Bonet. 2019. Musical borrowing in sonification. Organized Sound 24, 02 (August 2019), 184–194.
[8]
Edward Childs. 2002. Achorripsis: A sonification of probability distributions. In proceedings of the 2002 International Conference on Auditory Display. 2002.
[9]
Jane Piper Clendinning. 1989. Contrapuntal techniques in the music of Gyorgy Ligeti. PhD Thesis, Yale University.
[10]
Christian Dayé and Alberto de Campo. 2006. Sounds sequential: Sonification in the Social Sciences. Interdisciplinary Science Reviews 31, 4 (December 2006), 349–364.
[11]
Wanda L. Diaz-Merced 2011. Sonification of Astronomical Data. Proceedings of the International Astronomical Union 7, S285 (September 2011), 133–136.
[12]
Charles Dodge - Earth's Magnetic Field. YouTube. Retrieved August 5, 2024 from https://www.youtube.com/watch?v=j5MHsnc67yw
[13]
Eric Drott. 2011. Lines, masses, micropolyphony: Ligeti's Kyrie and the “Crisis of the figure.” Perspectives of New Music49, 1 (2011), 4–46.
[14]
Gaël Dubus and Roberto Bresin. 2013. A systematic review of mapping strategies for the sonification of physical quantities. PLoS ONE 8, 12 (December 2013).
[15]
Florian Grond and Thomas Hermann. 2011. Aesthetic strategies in sonification. AI & SOCIETY 27, 2 (August 2011), 213–222.
[16]
Jamie Ferguson and Stephen A. Brewster. 2018. Investigating Perceptual Congruence between Data and Display Dimensions in Sonification. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, Paper 611, 1–9. https://doi.org/10.1145/3173574.3174185
[17]
Daniel George, Duncan Meacher, Mark Ballora, and Chad Hanna. 2018. A Carillon of Black Holes. (2018).  arXiv.Org. https://arxiv.org/abs/1803.08090
[18]
Jason St George, Kim Sung Young, and Hans-Peter Bischof. 2018. Sonification of simulated black hole merger data. In proceedings of the International Conference on Modeling, Simulation and Visualization Methods (MSV). The Steering Committee of The World Congress in Computer Science, Computer Engineering and Applied Computing (WorldComp),
[19]
W.D. Gonzalez 1994. What is a geomagnetic storm? Journal of Geophysical Research: Space Physics 99, A4 (April 1994), 5771–5792.
[20]
Thomas Hermann, Andy Hunt, and John G. Neuhoff. 2011. The sonification handbook, Berlin: Logos Verlag. 
[21]
Mihu Iliescu. 2005. Glissandi and Traces: A study of the relationship between musical and extra-musical fields. In Proceedings of the International Symposium Iannis Xenakis (Athens, May 2005)
[22]
Gregory Kramer, Bruce Walker, Terri Bonebright, Perry Cook, John H. Flowers, Nadine Miner, and John Neuhoff. 2010. Sonification report: Status of the field and research agenda.
[23]
Orly Lahav, Nuha Chagab, and Vadim Talis. 2016. Use of a sonification system for science learning by people who are blind. Journal of Assistive Technologies 10, 4 (December 2016), 187–198.
[24]
Andrei Lăpușteanu, Anca Morar, Alin Moldoveanu, Maria-Anca Băluțoiu, and Florica Moldoveanu. 2024. A review of Sonification Solutions in Assistive Systems for visually impaired people. Disability and Rehabilitation: Assistive Technology (March 2024), 1–16.
[25]
PerMagnus Lindborg, Sara Lenzi, and Manni Chen. 2023. Climate data sonification and visualization: An analysis of topics, aesthetics, and characteristics in 32 recent projects. Frontiers in Psychology 13 (January 2023).
[26]
Sergio Luque. 2009. The stochastic synthesis of Iannis Xenakis. Leonardo Music Journal 19 (December 2009), 77–84.
[27]
Stephanie Mayville. 2014. The Compositional Techniques and Influences behind Ligeti's' Atmosphères. Intermezzo, 1, 30-38
[28]
Emmanouel Rovithis. 2019. Hearing the Magnetic Storm. SOUNDCLOUD. Retrieved 2023 from https://soundcloud.com/rovithis/hearing-the-magnetic-storm
[29]
Ryan McGee, Jatila Van der Veen, JoAnn Kuchera-Morin, Basak Alper, Philip Lubin. 2011. Sonifying the Cosmic Microwave Background. In proceedings of the 17th International Conference on Auditory Display (ICAD2011), Budapest, Hungary. 20-23 June, 2011. International Community for Auditory Display, 2011.
[30]
George Mihalas, Minodora Andor, Anca Tudor. 2020 Adding Sound to Medical Data. Stud Health Technol Inform. Sep 4;273:38-53. 33087591.
[31]
Diego Minciacchi, David Rosenboom, Riccardo Bravi, and Erez James Cohen. 2020. Editorial: Sonification, perceptualizing biological information. Frontiers in Neuroscience 14 (June 2020).
[32]
E. Oughton, J. Copic, A. Skelton, V.Kesaite, Z. Y. Yeo, S. J. Ruffle, M. Tuveson, A. W. Coburn, and D. Ralph. 2016. Helios Solar Storm Scenario. Cambridge Risk Framework series. Centre for Risk Studies. University of Cambridge.
[33]
Marty Quinn. 2011. Walk on the Sun: An interactive image sonification exhibit. AI & SOCIETY 27, 2 (September 2011), 303–305.
[34]
Michael Quinton, Iain McGregor, and David Benyon. 2016. Sonifying the Solar System. In proceedings of the 22nd International Conference on Auditory Display (ICAD2016), Canberra, Australia 2-8 Jule, 2016. International Community for Auditory Display, 2016.
[35]
Niklas Ronnberg. 2019. Musical Elements in Sonification Support Visual Perception. In Proceedings of the 31st European Conference on Cognitive Ergonomics (ECCE '19). Association for Computing Machinery, New York, NY, USA, 114–117. https://doi.org/10.1145/3335082.3335097
[36]
Seth Shafer, Timothy Larson, and Elaine diFalco. 2019. The sonification of solar harmonics (SOSH) project. In proceedings of the 25th International Conference on Auditory Display (ICAD 2019) 23-27 June 2019, Northumbria University, Newcastle upon Tyne, UK. https://doi.org/10.21785/icad2019.011
[37]
Nik Sawe, Chris Chafe, and Jeffrey Treviño. 2020. Using data sonification to overcome Science Literacy, numeracy, and visualization barriers in science communication. Frontiers in Communication 5 (July 2020).
[38]
Volker Straebel. 2010. The Sonification Metaphor in Instrumental Music and Sonification's Romantic Implications. Proceedings of the 16th International Conference on Auditory Display (ICAD2010), Washington, DC, USA. 9-15 June, 2010. Ed. Eoin Brazil. International Community for Auditory Display, 2010. http://hdl.handle.net/1853/50066
[39]
Stephen Taylor. 2017. From Program Music to Sonification: Representation and the Evolution of Music and Language. Presented at the 23rd International Conference on Auditory Display (ICAD2017), June 20-23, 2017, Pennsylvania State University, State College, PA, USA. https://doi.org/10.21785/icad2017.060
[40]
Yukina Takano, Reiji Suzuki, Takaya Arita; September 4–8, 2017. Virtual experience of complex dynamics emerging in a social particle swarm model by sonification Proceedings of fgtthe ECAL 2017, the Fourteenth European Conference on Artificial Life. ECAL 2017, the Fourteenth European Conference on Artificial Life. Lyon, France. (pp. pp. 388-395). ASME. https://doi.org/10.1162/isal_a_066
[41]
Ed M. Thieberger and Charles Dodge. 1995. An interview with Charles Dodge. Computer Music Journal 19, 1 (1995), 11.
[42]
Brianna J. Tomlinson, Michael R. Winters, Christopher Latina, Smruthi Bhat, Milap Rane, and Bruce N. Walker. 2017. Solar System Sonification: Exploring Earth and its Neighbors Through Sound" Presented at the 23rd International Conference on Auditory Display (ICAD2017), June 20-23, 2017, Pennsylvania State University, State College, PA, USA. https://doi.org/10.21785/icad2017.027
[43]
Juan M. Toro and Paola Crespo-Bojorque. 2017. Consonance processing in the absence of relevant experience: Evidence from Nonhuman Animals. Comparative Cognition & Behavior Reviews 12 (2017), 33–44.
[44]
Iannis Xenakis. 1966. The Origins of Stochastic Music. Tempo, 78 (1966), 9–12.
[45]
xSonify download | SourceForge.net. SourceForge. Retrieved 2024 from https://sourceforge.net/projects/xsonify/
[46]
David Worrall. 2018. Sonification: A Prehistory". Presented at the 24th International Conference on Auditory Display (ICAD2018), June 10-15, 2018, Michigan Technological University, Houghton, MI, USA. https://doi.org/10.21785/icad2018.019
[47]
A. Zanella, C.M. Harrison, S. Lenzi, J. Cooke, P. Damsma, and S.W. Fleming. 2022. Sonification and Sound Design for Astronomy Research, education and public engagement. Nature Astronomy 6, 11 (August 2022), 1241–1248.

Index Terms

  1. Micropolyphony and Stochastic Compositional Techniques as Tools for the Sonification of Magnetic Storms

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    AM '24: Proceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures
    September 2024
    565 pages
    ISBN:9798400709685
    DOI:10.1145/3678299
    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 18 September 2024

    Check for updates

    Author Tags

    1. Magnetic Storms
    2. Micropolyphony
    3. Sonification
    4. Sonification in Space Sciences
    5. Stochastic Music

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    AM '24

    Acceptance Rates

    Overall Acceptance Rate 177 of 275 submissions, 64%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 83
      Total Downloads
    • Downloads (Last 12 months)83
    • Downloads (Last 6 weeks)25
    Reflects downloads up to 09 Jan 2025

    Other Metrics

    Citations

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media