Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3526114.3561354acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
poster

DAWBalloon: An Intuitive Musical Interface Using Floating Balloons

Published: 28 October 2022 Publication History

Abstract

The development of music synthesis technology has created a way to enjoy listening to music and actively manipulate it. However, it is difficult for an amateur to combine sounds or change pitches to operate a DAW (Digital Audio Workstation). Therefore, we focused on ultrasonic levitation and haptic feedback to develop an appropriate interface for DAW. We propose "DAWBalloon", a system that uses ultrasonic levitation arrays to visualize rhythms using floating balloons as a metaphor for musical elements and to combine sounds by manipulating the balloons. DAWBalloon realizes the intuitive manipulation of sounds in three dimensions, even for people without knowledge of music.

References

[1]
Irmandy Wicaksono, Caroline Rozendo, Runzhou Ye, Jaleesa Trapp, V. Michael Bove Jr., Canan Dagdeviren, and Hiroshi Ishii. 2018. PerForm: Deformable Interface for Exploring Sound through Shapes. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI EA ’18). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3170427.3188478
[2]
Aubrey Colter, Patlapa Davivongsa, Donald Derek Haddad, Halla Moore, Brian Tice, and Hiroshi Ishii. 2016. SoundFORMS: Manipulating Sound Through Touch. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (San Jose, California, USA) (CHI EA ’16). Association for Computing Machinery, New York, NY, USA, 2425–2430. https://doi.org/10.1145/2851581.2892414
[3]
Irmandy Wicaksono and Joseph Paradiso. 2017. FabricKeyboard: Multimodal Textile Sensate Media as an Expressive and Deformable Musical Interface.
[4]
Hiroshi Ishii, Ali Mazalek, and Jay Lee. 2001. Bottles as a Minimal Interface to Access Digital Information. In CHI ’01 Extended Abstracts on Human Factors in Computing Systems (Seattle, Washington) (CHI EA ’01). Association for Computing Machinery, New York, NY, USA, 187–188. https://doi.org/10.1145/634067.634180
[5]
The Green Cat Collective: Sand Noise Device An Augmented Reality Musical Sandbox.
[6]
Eric Singer. 2003. Sonic Banana: A Novel Bend-Sensor-Based MIDI Controller. In NIME.
[7]
Yuya Kikukawa, Toshiki Yoshiike, Tatsuhiko Suzuki, Takaharu Kanai, Tetsuaki Baba, and Kumiko Kushiyama. 2013. A design process of musical interface “PocoPoco”: An interactive artwork case study. International Journal of Asia Digital Art and Design Association 17, 1 (2013), 26–35. https://doi.org/10.20668/adada.17.1_26
[8]
Tobias Alrøe, Jonas Grann, Erik Grönvall, Marianne Graves Petersen, and Jesper L. Rasmussen. 2012. Aerial Tunes: Exploring Interaction Qualities of Mid-Air Displays. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design (Copenhagen, Denmark) (NordiCHI ’12). Association for Computing Machinery, New York, NY, USA, 514–523. https://doi.org/10.1145/2399016.2399095
[9]
Takuro Furumoto, Takumi Kasai, Masahiro Fujiwara, Yasutoshi Makino, and Hiroyuki Shinoda. 2021. Midair Balloon Interface: A Soft and Lightweight Midair Object for Proximate Interactions. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 783–795. https://dl.acm.org/doi/10.1145/3472749.3474786
[10]
Rafael Morales, Asier Marzo, Sriram Subramanian, and Diego Martínez. 2019. LeviProps: Animating Levitated Optimized Fabric Structures Using Holographic Acoustic Tweezers. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 651–661. https://doi.org/10.1145/3332165.3347882
[11]
Ryuji Hirayama, Diego Martinez Plasencia, Nobuyuki Masuda, and Sriram Subramanian. 2019. A volumetric display for visual, tactile and audio presentation using acoustic trapping. Nature 575, 7782 (14 Nov. 2019), 320–323. https://doi.org/10.1038/s41586-019-1739-5 Publisher Copyright: © 2019, The Author(s), under exclusive licence to Springer Nature Limited.

Index Terms

  1. DAWBalloon: An Intuitive Musical Interface Using Floating Balloons
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      UIST '22 Adjunct: Adjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology
      October 2022
      413 pages
      ISBN:9781450393218
      DOI:10.1145/3526114
      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 28 October 2022

      Check for updates

      Qualifiers

      • Poster
      • Research
      • Refereed limited

      Conference

      UIST '22

      Acceptance Rates

      Overall Acceptance Rate 561 of 2,567 submissions, 22%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 134
        Total Downloads
      • Downloads (Last 12 months)39
      • Downloads (Last 6 weeks)5
      Reflects downloads up to 22 Nov 2024

      Other Metrics

      Citations

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media