research-article

Evaluation of psychoacoustic sound parameters for sonification

Authors:

Jamie Ferguson,

Stephen A. BrewsterAuthors Info & Claims

ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal Interaction

Pages 120 - 127

https://doi.org/10.1145/3136755.3136783

Published: 03 November 2017 Publication History

Abstract

Sonification designers have little theory or experimental evidence to guide the design of data-to-sound mappings. Many mappings use acoustic representations of data values which do not correspond with the listener's perception of how that data value should sound during sonification. This research evaluates data-to-sound mappings that are based on psychoacoustic sensations, in an attempt to move towards using data-to-sound mappings that are aligned with the listener's perception of the data value's auditory connotations. Multiple psychoacoustic parameters were evaluated over two experiments, which were designed in the context of a domain-specific problem - detecting the level of focus of an astronomical image through auditory display. Recommendations for designing sonification systems with psychoacoustic sound parameters are presented based on our results.

References

[1]

Penny Bergman, Anders Sköld, Daniel Västfjäll, and Niklas Fransson. 2009. Perceptual and emotional categorization of sound. The Journal of the Acoustical Society of America 126, 6 (2009), 3156–3167.

[2]

Gary Bradski and Adrian Kaehler. 2008. Learning OpenCV: Computer vision with the OpenCV library. " O’Reilly Media, Inc.".

[3]

Stephen Anthony Brewster. 1994. Providing a structured method for integrating non-speech audio into human-computer interfaces. Ph.D. Dissertation. University of York York, UK.

[4]

Lorna M Brown, Stephen A Brewster, and Helen C Purchase. 2005. A first investigation into the effectiveness of tactons. In Eurohaptics Conference, 2005 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator ICMI’17, November 13–17, 2017, Glasgow, UK Jamie Ferguson and Stephen A. Brewster Systems, 2005. World Haptics 2005. First Joint. IEEE, 167–176.

Digital Library

[5]

A L Diaz-merced et al. 2008. Sonification for the Analysis of Plasma Bubbles at 21 MHz. Sun and Geosphere 3, 1 (2008), 42–54.

[6]

Gaël Dubus and Roberto Bresin. 2013. A systematic review of mapping strategies for the sonification of physical quantities. PloS one 8, 12 (2013), e82491.

[7]

AA Ekdale. 2002. Sonification of paleontologic data: hearing fossil shapes. In Abstracts with Programs, Geological Society of America, Vol. 33.

[8]

Hugo Fastl. 1982. Fluctuation strength and temporal masking patterns of amplitude-modulated broadband noise. Hearing Research 8, 1 (1982), 59–69.

[9]

Sam Ferguson, Densil Cabrera, Kirsty Beilharz, and Hong-Jun Song. 2006. Using psychoacoustical models for information sonification. In ICAD 2006, Proceedings of the International Conference on Auditory Display. Georgia Institute of Technology.

[10]

James W Grau and Deborah K Nelson. 1988. The distinction between integral and separable dimensions: Evidence for the integrality of pitch and loudness. Journal of Experimental Psychology: General 117, 4 (1988), 347.

[11]

S Hatano and T Hashimoto. 2000. Booming index as a measure for evaluating booming sensation. In Proc. Inter-Noise.

[12]

Thomas Hermann, Andy Hunt, and John G Neuhoff. 2011. The sonification handbook. Logos Verlag Berlin.

[13]

Phil N Johnson-Laird, Olivia E Kang, and Yuan Chang Leong. 2012. On musical dissonance. Music Perception: An Interdisciplinary Journal 30, 1 (2012), 19–35.

[14]

Johan Kildal and Stephen A Brewster. 2006. Non-visual overviews of complex data sets. In CHI’06 Extended Abstracts on Human Factors in Computing Systems. ACM, 947–952.

Digital Library

[15]

G Kramer, BN Walker, T Bonebright, P Cook, J Flowers, N Miner, J Neuhoff, R Bargar, S Barrass, J Berger, et al. 1999. The sonification report: Status of the field and research agenda. report prepared for the national science foundation by members of the international community for auditory display. International Community for Auditory Display (ICAD), Santa Fe, NM (1999).

[16]

Richard Lyon. 2000. Designing for product sound quality. CRC Press.

[17]

Sophie Maluski, Claire Churchill, and Trevor J Cox. 2004. Sound quality testing and labelling of domestic appliances in the UK. In Proceedings of Internoise.

[18]

John G Neuhoff and Laurie M Heller. 2005. One small step: Sound sources and events as the basis for auditory graphs. Georgia Institute of Technology.

[19]

Harry Ferdinand Olson. 1967. Music, physics and engineering. Vol. 1769. Courier Corporation.

[20]

JMS Pearce. 2005. Selected observations on amusia. European neurology 54, 3 (2005), 145–148.

[21]

S Camille Peres and David M Lane. 2005. Auditory graphs: The effects of redundant dimensions and divided attention. In ICAD 2005, Proceedings of the International Conference on Auditory Display. Georgia Institute of Technology.

[22]

Hardial S Sagoo. 1988. Reduction of noise levels in vaccum cleaners. Ph.D. Dissertation. Aston University.

[23]

Shin-ichi Sato, Jin You, and Jin Yong Jeon. 2007. Sound quality characteristics of refrigerator noise in real living environments with relation to psychoacoustical and autocorrelation function parameters. The Journal of the Acoustical Society of America 122, 1 (2007), 314–325.

[24]

Jan Schnupp, Israel Nelken, and Andrew King. 2011. Auditory neuroscience: Making sense of sound. MIT press.

[25]

A Väljamäe, T Steffert, S Holland, X Marimon, R Benitez, S Mealla, A Oliveira, and S Jordà. 2013. A review of real-time EEG sonification research. In ICAD 2013-Proceedings of the International Conference on Auditory Display. Georgia Institute of Technology.

[26]

Bruce N. Walker. 2002. Magnitude Estimation of Conceptual Data Dimensions for Use in Sonification. Journal of Experimental Psychology: Applied 8, 4 (2002), 211–221.

[27]

Bruce N Walker and Gregory Kramer. 2005. Mappings and metaphors in auditory displays: An experimental assessment. ACM Transactions on Applied Perception (TAP) 2, 4 (2005), 407–412.

Digital Library

[28]

Bruce N Walker, Gregory Kramer, and David M Lane. 2000. Psychophysical scaling of sonification mappings. In ICAD 2000, Proceedings of the International Conference on Auditory Display. Georgia Institute of Technology.

[29]

Eberhard Zwicker. 1961. Subdivision of the audible frequency range into critical bands (Frequenzgruppen). The Journal of the Acoustical Society of America 33, 2 (1961), 248–248.

Cited By

Casado JGarcía B(2024) A multimodal approach to data analysis in astronomy: sonouno applications in photometry and spectroscopy RAS Techniques and Instruments10.1093/rasti/rzae0423:1(625-635)Online publication date: 24-Oct-2024
https://doi.org/10.1093/rasti/rzae042
Rodríguez Mateos DTapia López A(2023)Sonificación y periodismo: la representación de datos mediante sonidosRevista de Comunicación10.26441/RC22.1-2023-302222:1Online publication date: 15-Jan-2023
https://doi.org/10.26441/RC22.1-2023-3022
Elbirt JAl-Faris A(2023)Development of a Data Sonification Tool to Transcend Standard Visualization Analyses2023 International Conference on Computational Science and Computational Intelligence (CSCI)10.1109/CSCI62032.2023.00265(1603-1606)Online publication date: 13-Dec-2023
https://doi.org/10.1109/CSCI62032.2023.00265
Show More Cited By

Index Terms

Evaluation of psychoacoustic sound parameters for sonification
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques
      1. Auditory feedback

Recommendations

Investigating Perceptual Congruence between Data and Display Dimensions in Sonification
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

The relationships between sounds and their perceived meaning and connotations are complex, making auditory perception an important factor to consider when designing sonification systems. Listeners often have a mental model of how a data variable should ...
Lyricon Lyrics + Earcons Improves Identification of Auditory Cues
Proceedings, Part II, of the 4th International Conference on Design, User Experience, and Usability: Users and Interactions - Volume 9187

Auditory researchers have developed various non-speech cues in designing auditory user interfaces. A preliminary study of "lyricons" lyricsï ź+ï źearcons [1] has provided a novel approach to devising auditory cues in electronic products, by combining ...
Soundscape, sonification, and sound activism

In this article, the author will argue that the act of listening through public soundwalks and other formal and informal exercises builds environmental and social awareness and promotes changes in social and cultural practices. By examining the act of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal Interaction

November 2017

676 pages

ISBN:9781450355438

DOI:10.1145/3136755

General Chairs:
Edward Lank
University of Waterloo, Canada
,
Alessandro Vinciarelli
University of Glasgow, UK
,
Program Chairs:
Eve Hoggan
Aarhus University, Denmark
,
Sriram Subramanian
University of Sussex, UK
,
Stephen A. Brewster
University of Glasgow, UK

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 November 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICMI '17

Sponsor:

SIGCHI

ICMI '17: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 13 - 17, 2017

Glasgow, UK

Acceptance Rates

ICMI '17 Paper Acceptance Rate 65 of 149 submissions, 44%;

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
367
Total Downloads

Downloads (Last 12 months)32
Downloads (Last 6 weeks)1

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Casado JGarcía B(2024) A multimodal approach to data analysis in astronomy: sonouno applications in photometry and spectroscopy RAS Techniques and Instruments10.1093/rasti/rzae0423:1(625-635)Online publication date: 24-Oct-2024
https://doi.org/10.1093/rasti/rzae042
Rodríguez Mateos DTapia López A(2023)Sonificación y periodismo: la representación de datos mediante sonidosRevista de Comunicación10.26441/RC22.1-2023-302222:1Online publication date: 15-Jan-2023
https://doi.org/10.26441/RC22.1-2023-3022
Elbirt JAl-Faris A(2023)Development of a Data Sonification Tool to Transcend Standard Visualization Analyses2023 International Conference on Computational Science and Computational Intelligence (CSCI)10.1109/CSCI62032.2023.00265(1603-1606)Online publication date: 13-Dec-2023
https://doi.org/10.1109/CSCI62032.2023.00265
Enge KRind AIber MHöldrich RAigner W(2023)Towards a unified terminology for sonification and visualizationPersonal and Ubiquitous Computing10.1007/s00779-023-01720-527:5(1949-1963)Online publication date: 21-Aug-2023
https://doi.org/10.1007/s00779-023-01720-5
Woodring IOwen C(2022)Results of Preliminary Studies on the Perception of the Relationships between Objects Presented in a Cartesian SpaceTechnologies10.3390/technologies1001002010:1(20)Online publication date: 30-Jan-2022
https://doi.org/10.3390/technologies10010020
Sharma G(2022)Physiological Sensing for Media Perception & Activity RecognitionProceedings of the 2022 International Conference on Multimodal Interaction10.1145/3536221.3557026(696-700)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3536221.3557026
Holloway LGoncu CIlsar AButler MMarriott K(2022)Infosonics: Accessible Infographics for People who are Blind using Sonification and VoiceProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517465(1-13)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517465
Ferguson JFreeman EBrewster S(2021)Investigating the Effect of Polarity in Auditory and Vibrotactile Displays Under Cognitive LoadProceedings of the 2021 International Conference on Multimodal Interaction10.1145/3462244.3479911(379-386)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3462244.3479911
Woodring IOwen CMakedon F(2021)An Empirical Study of User Perception of Audio Stimuli in Relation to a Cartesian SpaceProceedings of the 14th PErvasive Technologies Related to Assistive Environments Conference10.1145/3453892.3453897(8-15)Online publication date: 29-Jun-2021
https://dl.acm.org/doi/10.1145/3453892.3453897
Ferguson JBrewster SBrewster SFitzpatrick GCox AKostakos V(2019)Modulating Personal Audio to Convey InformationExtended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290607.3312988(1-6)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290607.3312988
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents