Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3478431.3499304acmconferencesArticle/Chapter ViewAbstractPublication PagessigcseConference Proceedingsconference-collections
research-article

The Sounds of Sorting Algorithms: Sonification as a Pedagogical Tool

Published: 22 February 2022 Publication History

Abstract

Much work already exists on algorithm visualization-the graphical representation of an algorithm's behavior-and its benefits for student learning. Visualization, however, offers limited benefit for students with visual impairments. This paper explores algorithm sonification-the representation of an algorithm's behavior using sound. To simplify the creation of sonifications for modern algorithms, this paper presents a new Thread Safe Audio Library (TSAL). To illustrate how to create sonifications, the authors have added TSAL calls to four common sorting algorithm implementations, so that as the program accesses a value being sorted, the program plays a tone whose pitch is scaled to that value's magnitude. In the resulting sonifications, one can (in real time) hear the behavioral differences of the different sorting algorithms as they run, and directly experience how fast (or slow) the algorithms sort the same sequence, compared to one another. This paper presents experimental evidence that the sonifications improve students' long-term recall of the four sorting algorithms' relative speeds. The paper also discusses other potential uses of sonification.

Supplementary Material

MP4 File (SIGCSE22-V1fp185v.mp4)
Many students find visualization to be an engaging way to learn, but visualization is of limited use to students with visual impairments. In this talk, we explore algorithm sonification: the addition of sound to an algorithm's implementation to hear it solving its problem in real-time. To simplify the creation of sonifications of modern algorithms, we created a new tool: the Thread Safe Audio Library (TSAL). We demonstrate the use of TSAL by presenting sonifications of Bubble Sort, Insert Sort, Merge Sort, and Quick Sort; in doing so, we learn that each of these algorithms has a unique sonic signature. To gauge the effects of sonification on learning, we performed a controlled experiment to determine the effects of sonification on students' long-term recall of specific algorithmic details. Despite having small experimental groups of sighted students, our experimental results indicate that sonification significantly improved the students' long-term recall of these algorithms' relative speeds.

References

[1]
J. Adams, P. Crain, C. Dilley, C. Hazlett, E. Koning, S. Nelesen, J. Unger. TSGL: A Tool for Visualizing Multithreaded Behavior, Journal of Parallel and Distributed Computing, Volume 118, Issue P1, Aug 2018, pp. 233--246.
[2]
S. Bhunia and M. Tehranipoor, Chapter 8-Side-Channel Attacks, in Hardware Security: A Hands-On Learning Approach, Morgan-Kaufmann, 2019, pp. 193--218.
[3]
T. Bingmann, The Sound of Sorting - "Audibilization" and Visualization of Sorting Algorithms. Online, accessed 2021--12-01: https://panthema.net/2013/sound-of-sorting/.
[4]
T. Bingmann, 15 Sorting Algorithms in 6 Minutes. Online, accessed 2021--12-01: https://www.youtube.com/watch?v=kPRA0W1kECg,
[5]
M. Blattner, D. Sumikawa and R. Greenberg. Earcons and icons: their structure and common design principles. Human Computer Interaction, 4:1 (March 1989), pp. 11--44.
[6]
P. Burk, et al. PortAudio: Portable, Cross-Platform Audio I/O. Online, accessed 2021--12-01: http://www.portaudio.com.
[7]
C. Cannam, C. Landone, and M. Sandler. Sonic Visualiser: An Open Source Application for Viewing, Analysing, and Annotating Music Audio Files, Proceedings of the ACM Multimedia 2010 International Conference, October, 2010, pp. 1467--1468.
[8]
S. Carr, J. Mayo, and C.K. Shene. ThreadMentor: a Pedagogical Tool for Multithreaded Programming, Journal on Educational Resources in Computing (JERIC), 3(1), March 2003, Article 1.
[9]
A. Danner, T. Newhall, K. Webb. ParaVis: A Library for Visualizing and Debugging Parallel Applications, Proc. of 9th NSF/TCPP Workshop on Parallel and Distributed Computing Education (EduPar-19), in conjunction with IEEE IPDPS'19, Rio de Janeiro, Brazil, May 2019.
[10]
C. DiGiano and R. Baecker. Program Aurelization: Sound Enhancements to the Programming Environment. Proc. of the Conference on Graphics Interface '92. Morgan Kaufmann Publishers, 1992, pp. 44--52.
[11]
C. DiGiano and R. Baecker. LogoMedia: A Sound-Enhanced Programming Environment for Monitoring Program Behavior. Proc. of the 1993 Conference on Human Factors in Computing Systems (CHI'93), pp. 301--302.
[12]
S. Garzonis, S. Jones, T. Jay, E. O'Neill. Auditory icon and earcon mobile service notifications: intuitiveness, learnability, memorability and preference. Proc. SIGCHI Conf. on Human Factors in Computing Systems, April 2009. pp. 1513--1522.
[13]
W. Gaver. The SonicFinder: an interface that uses auditory icons. Human Computer Interaction. 4:1 (March 1989), pp. 67--94.
[14]
M. Guzdial, D. Ranum, B. Miller, B. Simon, B. Ericson, S. Rebelsky, J. Davis, K. Deepak, D. Blank. Variations on a theme: role of media in motivating computing education. Proc. of the 41st ACM SIGCSE Symposium on CS Education, March 2010, pp. 66--67.
[15]
G. Kramer, B. Walker. T. Bonebright, P. Cook, J. Flowers, N. Miner and J. Neuhoff. "Sonification Report: Status of the Field and Research Agenda" (2010). Faculty Publications, Department of Psychology, University of Nebraska-Lincoln. Online, accessed 2021--12-01: https://digitalcommons.unl.edu/psychfacpub/444.
[16]
C. Morrison, N. Villar, A. Thieme, Z. Ashktorab, E. Taysom, O. Salandin, D. Cletheroe, G. Saul, A. Blackwell, D. Edge, M. Grayson & H. Zhang. Torino: A Tangible Programming Language Inclusive of Children with Visual Disabilities, Human--Computer Interaction, 35:3 (2020). pp. 191--239.
[17]
T. Naps, S. Rogers, G. Rößling and R. Ross, Animation and visualization in the curriculum: opportunities, challenges, and successes. Proc. of the 37th ACM SIGCSE Symposium on Computer Science Education (SIGCSE'06), March 2006. pp. 328--329.
[18]
A Thieme, C Morrison, N Villar, M Grayson, and S Lindley (June 2017). Enabling collaboration in learning computer programing inclusive of children with vision impairments. Proc. of the 2017 Conference on Designing Interactive Systems, June, 2017. pp. 739--752.
[19]
C. Shaffer, M. Cooper, A. Alon, M. Akbar, M. Stewart, S. Ponce, S. Edwards. Algorithm Visualization: The State of the Field. ACM Transactions on Computing Education, 10(3), Aug. 2010. Article 9.
[20]
J. Soni and R. Goodman, A Mind At Play, Simon & Schuster, 2017, pp. 108--109.

Cited By

View all
  • (2024)Engaging CS1 Students with Audio Themed AssignmentsJournal of Computing Sciences in Colleges10.5555/3665609.366562039:8(158-172)Online publication date: 17-May-2024
  • (2024)Capturing Cancer as Music: Cancer Mechanisms Expressed through MusificationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642153(1-11)Online publication date: 11-May-2024
  • (2024)Beyond Vision Impairments: Redefining the Scope of Accessible Data RepresentationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.335656630:12(7619-7636)Online publication date: Dec-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGCSE 2022: Proceedings of the 53rd ACM Technical Symposium on Computer Science Education - Volume 1
February 2022
1049 pages
ISBN:9781450390705
DOI:10.1145/3478431
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 February 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. accessibility
  2. algorithm
  3. audio
  4. graphics
  5. hearing
  6. media
  7. sonification
  8. sorting
  9. sound
  10. visualization

Qualifiers

  • Research-article

Funding Sources

  • NSF-DUE

Conference

SIGCSE 2022
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,595 of 4,542 submissions, 35%

Upcoming Conference

SIGCSE TS 2025
The 56th ACM Technical Symposium on Computer Science Education
February 26 - March 1, 2025
Pittsburgh , PA , USA

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)47
  • Downloads (Last 6 weeks)3
Reflects downloads up to 08 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Engaging CS1 Students with Audio Themed AssignmentsJournal of Computing Sciences in Colleges10.5555/3665609.366562039:8(158-172)Online publication date: 17-May-2024
  • (2024)Capturing Cancer as Music: Cancer Mechanisms Expressed through MusificationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642153(1-11)Online publication date: 11-May-2024
  • (2024)Beyond Vision Impairments: Redefining the Scope of Accessible Data RepresentationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.335656630:12(7619-7636)Online publication date: Dec-2024
  • (2022)Stop Reinventing the Wheel! Promoting Community Software in Computing EducationProceedings of the 2022 Working Group Reports on Innovation and Technology in Computer Science Education10.1145/3571785.3574129(261-292)Online publication date: 27-Dec-2022

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media