Article

Performance visualization: a new challenge to music through visualization

Authors:

Rumi Hiraga,

Reiko Mizaki,

Issei FujishiroAuthors Info & Claims

MULTIMEDIA '02: Proceedings of the tenth ACM international conference on Multimedia

Pages 239 - 242

https://doi.org/10.1145/641007.641054

Published: 01 December 2002 Publication History

Get Access

Abstract

This paper describes performance visualization with its purposes, significance, and our prototype system. Performance visualization provides us with a new user interface for music systems, a non-subjective explanation and judgment for musical expression, and a visual aid to understand, analyze, and compare performances and their musical structures. It will also introduce a more challenging research on designing a musical data mining interface not by tags nor by contents but by the mood. Other challenges include finding qualitative characteristics of music with analysis methods for information visualization and synesthesia between visualized and sonified information. We will describe which information should be shown on the visualized figures for expressive performance. Then we will show our prototype system to visualize expressive performance consisting of several instruments.

References

[1]

R. B. Dannenberg. Music representation issues, techniques, and systems. Computer Music Journal, 17(3):20--30, 1993.

Crossref

Google Scholar

[2]

J. Foote. Visualizing music and audio using self-similarity. In ACM Multimedia99, pages 77--80, 1999.

Digital Library

Google Scholar

[3]

R. Hiraga. Case study: A look of performance. In DVD of IEEE Visualization, 2002.

Digital Library

Google Scholar

[4]

R. Hiraga, S. Igarashi, and Y. Matsuura. Visualized music expression in an object-oriented environment. In Proc. of ICMC, pages 483--486, 1996.

Google Scholar

[5]

R. Hiraga, F. Watanabe, and I. Fujishiro. Music learning through visualization. In Proc. of WEB Delivering Music, 2002.

Digital Library

Google Scholar

[6]

F. Lerdahl and R. Jackendoff. A Generative Theory of Tonal Music. The MIT Press, 1996.

Google Scholar

[7]

R. Miyazaki and I. Fujishiro. Interactive poster: 3d visualization of midi dataset. In DVD of IEEE Visualization, 2002.

Google Scholar

[8]

E. Narmour. The Analysis and Cognition of Melodic Complexity: The Implication-Realization Model. The University of Chicago Press, 1992.

Google Scholar

[9]

RENCON. http://shouchan.ei.tuat.ac.jp/-rencon/en/index.html.

Google Scholar

[10]

G. G. Robertson, J. D. Mackinlay, and S. K. Card. Conetrees: Animated 3d visualizaitons of hierarchical information. In Proc. of ACM Conf. on Human Factors in Comp. Sys., pages 189--194, 1992.

Digital Library

Google Scholar

[11]

B. Shneiderman. Designing the User Interface Strategies for Effective Human-Computer Interaction, 3rd Ed. Addison-Wesley, 1998.

Digital Library

Google Scholar

[12]

S. M. Smith and G. N. Williams. A visualization of music. In Proceedings of IEEE Visualization, 1997.

Digital Library

Google Scholar

Cited By

View all

Choi YJeon JLee CNoh YHong J(2024)A Way for Deaf and Hard of Hearing People to Enjoy Music by Exploring and Customizing Cross-modal Music ConceptsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642665(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642665
Han KYou WShi SSun L(2024)Hearing with the eyes: modulating lyrics typography for music visualizationThe Visual Computer10.1007/s00371-023-03239-540:11(8345-8361)Online publication date: 19-Jan-2024
https://doi.org/10.1007/s00371-023-03239-5
Lima HSantos CMeiguins B(2021)A Survey of Music Visualization TechniquesACM Computing Surveys10.1145/346183554:7(1-29)Online publication date: 18-Jul-2021
https://dl.acm.org/doi/10.1145/3461835
Show More Cited By

Index Terms

Performance visualization: a new challenge to music through visualization

Recommendations

Integrating Visualization (and Visualization Experts) with Performance Analysis
PERMAVOST '22: Proceedings of the 2nd Workshop on Performance EngineeRing, Modelling, Analysis, and VisualizatiOn Strategy

Identifying and understanding poor performance is an increasingly difficult task due to the growing complexity and scale of target applications and systems. Visualization is an important tool for exploratory and comprehension-centered goals, leading to ...
Parallel Performance Visualization: From Practice to Theory

Parallel performance visualization presents fundamental challenges--complex data sets, the artificial aspects of parallel computation, the need for integrated analysis and visual models, and the dependence on the user's mental perspective. Despite these ...
Performance visualization for large-scale computing systems: a literature review
HCII'11: Proceedings of the 14th international conference on Human-computer interaction: design and development approaches - Volume Part I

Recently the need for extreme scale computing solutions presents demands for powerful and easy to use performance visualization tools. This paper presents a review of existing research on performance visualization for large-scale systems. A general ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MULTIMEDIA '02: Proceedings of the tenth ACM international conference on Multimedia

December 2002

683 pages

ISBN:158113620X

DOI:10.1145/641007

Conference Chair:
Lawrence Rowe
UC Berkeley
,
General Chair:
Bernard Merialdo
Institut EURECOM
,
Program Chairs:
Max Muhlhauser
TU Darmstadt
,
Keith Ross
Institut EURECOM
,
Nevenka Dimitrova
Phillips Research

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2002

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tag

performance visualization

Qualifiers

Article

Conference

MM02

Sponsor:

MM02: ACM Multimedia 2002

December 1 - 6, 2002

Juan-les-Pins, France

Acceptance Rates

MULTIMEDIA '02 Paper Acceptance Rate 46 of 330 submissions, 14%;

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
1,165
Total Downloads

Downloads (Last 12 months)51
Downloads (Last 6 weeks)2

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Choi YJeon JLee CNoh YHong J(2024)A Way for Deaf and Hard of Hearing People to Enjoy Music by Exploring and Customizing Cross-modal Music ConceptsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642665(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642665
Han KYou WShi SSun L(2024)Hearing with the eyes: modulating lyrics typography for music visualizationThe Visual Computer10.1007/s00371-023-03239-540:11(8345-8361)Online publication date: 19-Jan-2024
https://doi.org/10.1007/s00371-023-03239-5
Lima HSantos CMeiguins B(2021)A Survey of Music Visualization TechniquesACM Computing Surveys10.1145/346183554:7(1-29)Online publication date: 18-Jul-2021
https://dl.acm.org/doi/10.1145/3461835
Reddy GRompapas D(2021)Liquid Hands: Evoking Emotional States via Augmented Reality Music VisualizationsProceedings of the 2021 ACM International Conference on Interactive Media Experiences10.1145/3452918.3465496(305-310)Online publication date: 21-Jun-2021
https://dl.acm.org/doi/10.1145/3452918.3465496
Subramaniam ABarthet MFazekas GBarthet MStockman T(2017)Mood VisualiserProceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences10.1145/3123514.3123517(1-8)Online publication date: 23-Aug-2017
https://dl.acm.org/doi/10.1145/3123514.3123517
Fonteles JRodrigues MBasso V(2013)Creating and evaluating a particle system for music visualizationJournal of Visual Languages and Computing10.1016/j.jvlc.2013.10.00224:6(472-482)Online publication date: 1-Dec-2013
https://dl.acm.org/doi/10.1016/j.jvlc.2013.10.002
Puzoń BKosugi N(2011)Extraction and visualization of the repetitive structure of music in acoustic dataProceedings of the 13th International Conference on Information Integration and Web-based Applications and Services10.1145/2095536.2095563(152-159)Online publication date: 5-Dec-2011
https://dl.acm.org/doi/10.1145/2095536.2095563
Kosugi NPardede ETaniar DPardede E(2010)MisualProceedings of the 12th International Conference on Information Integration and Web-based Applications & Services10.1145/1967486.1967581(609-616)Online publication date: 8-Nov-2010
https://dl.acm.org/doi/10.1145/1967486.1967581
Brown ABrereton MViller SKraal B(2010)Visualizing digital media interactionsProceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction10.1145/1952222.1952264(196-199)Online publication date: 22-Nov-2010
https://dl.acm.org/doi/10.1145/1952222.1952264
Chan WQu HMak W(2010)Visualizing the Semantic Structure in Classical Music WorksIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2009.6316:1(161-173)Online publication date: 1-Jan-2010
https://dl.acm.org/doi/10.1109/TVCG.2009.63
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Integrating Visualization (and Visualization Experts) with Performance Analysis

Parallel Performance Visualization: From Practice to Theory

Performance visualization for large-scale computing systems: a literature review