research-article

Toward high-quality modal contact sound

Authors:

Doug L. JamesAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 30, Issue 4

Article No.: 38, Pages 1 - 12

https://doi.org/10.1145/2010324.1964933

Published: 25 July 2011 Publication History

Abstract

Contact sound models based on linear modal analysis are commonly used with rigid body dynamics. Unfortunately, treating vibrating objects as "rigid" during collision and contact processing fundamentally limits the range of sounds that can be computed, and contact solvers for rigid body animation can be ill-suited for modal contact sound synthesis, producing various sound artifacts. In this paper, we resolve modal vibrations in both collision and frictional contact processing stages, thereby enabling non-rigid sound phenomena such as micro-collisions, vibrational energy exchange, and chattering. We propose a frictional multibody contact formulation and modified Staggered Projections solver which is well-suited to sound rendering and avoids noise artifacts associated with spatial and temporal contact-force fluctuations which plague prior methods. To enable practical animation and sound synthesis of numerous bodies with many coupled modes, we propose a novel asynchronous integrator with model-level adaptivity built into the frictional contact solver. Vibrational contact damping is modeled to approximate contact-dependent sound dissipation. Results are provided that demonstrate high-quality contact resolution with sound.

Supplementary Material

Supplemental material. (a38-zheng.zip)

Download
173.64 MB

MP4 File (tp019_11.mp4)

Download
20.24 MB

References

[1]

Anderson, E., Bai, Z., Bischof, C., Blackford, S., Demmel, J., Dongarra, J., Du Croz, J., Greenbaum, A., Hammarling, S., McKenney, A., and Sorensen, D. 1999. LAPACK Users' Guide, third ed. Society for Industrial and Applied Mathematics, Philadelphia, PA.

[2]

Anitescu, M., and Potra, F. 1997. Formulating dynamic multi-rigid-body contact problems with friction as solvable linear complementarity problems. Nonlinear Dynamics 14, 231--247.

[3]

Baraff, D. 1990. Curved surfaces and coherence for non-penetrating rigid body simulation. In Computer Graphics (Proceedings of SIGGRAPH 90), 19--28.

[4]

Baraff, D. 1991. Coping with friction for non-penetrating rigid body simulation. In Computer Graphics (Proceedings of SIGGRAPH 91), 31--40.

[5]

Baraff, D. 1993. Issues in computing contact forces for non-penetrating rigid bodies. Algorithmica 10, 2-4, 292--352.

Digital Library

[6]

Bonneel, N., Drettakis, G., Tsingos, N., Viaud-Delmon, I., and James, D. 2008. Fast modal sounds with scalable frequency-domain synthesis. ACM Transactions on Graphics 27, 3 (Aug.), 24:1--24:9.

Digital Library

[7]

Brogliato, B. 1999. Nonsmooth Mechanics, second ed. Springer.

[8]

Capell, S., Green, S., Curless, B., Duchamp, T., and Popović, Z. 2002. A multiresolution framework for dynamic deformations. In ACM SIGGRAPH Symposium on Computer Animation, 41--48.

[9]

Chadwick, J. N., An, S. S., and James, D. L. 2009. Harmonic Shells: A practical nonlinear sound model for near-rigid thin shells. ACM Trans. Graph. 28, 5, 1--10.

Digital Library

[10]

Cottle, R., Pang, J., and Stone, R. 1992. The linear complementarity problem. Academic Press.

[11]

Debunne, G., Desbrun, M., Cani, M.-P., and Barr, A. H. 2001. Dynamic real-time deformations using space & time adaptive sampling. In Proceedings of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 31--36.

[12]

Doel, K., Knott, D., and Pai, D. 2004. Interactive simulation of complex audiovisual scenes. Presence: Teleoperators & Virtual Environments 13, 1, 99--111.

[13]

Erleben, K. 2007. Velocity-based shock propagation for multi-body dynamics animation. ACM Transactions on Graphics 26, 2 (June), 12:1--12:20.

Digital Library

[14]

Gaver, W. 1993. Synthesizing auditory icons. In Proceedings of the INTERACT'93 and CHI'93 conference on Human factors in computing systems, ACM, 228--235.

[15]

Gill, P., Murray, W., and Wright, M. 1981. Practical Optimization. Academic Press, London, UK.

[16]

Gottschalk, S., Lin, M., and Manocha, D. 1996. OBB-Tree: A Hierarchical Structure for Rapid Interference Detection. In Proceedings of SIGGRAPH 96, Computer Graphics Proceedings, Annual Conference Series, 171--180.

[17]

Grinspun, E., Krysl, P., and Schröder, P. 2002. CHARMS: A Simple Framework for Adaptive Simulation. ACM Transactions on Graphics 21, 3 (July), 281--290.

Digital Library

[18]

Guendelman, E., Bridson, R., and Fedkiw, R. P. 2003. Nonconvex rigid bodies with stacking. vol. 22, 871--878.

[19]

Hahn, J. K. 1988. Realistic animation of rigid bodies. In Computer Graphics (Proceedings of SIGGRAPH 88), 299--308.

[20]

Harmon, D., Vouga, E., Smith, B., Tamstorf, R., and Grinspun, E. 2009. Asynchronous contact mechanics. ACM Transactions on Graphics 28, 3 (July), 87:1--87:12.

Digital Library

[21]

James, D. L., and Pai, D. K. 2004. BD-Tree: Output-sensitive collision detection for reduced deformable models. ACM Transactions on Graphics 23, 3 (Aug.), 393--398.

Digital Library

[22]

James, D. L., Barbic, J., and Pai, D. K. 2006. Precomputed Acoustic Transfer: Output-sensitive, accurate sound generation for geometrically complex vibration sources. ACM Transactions on Graphics 25, 3 (July), 987--995.

Digital Library

[23]

Jefferson, D. 1985. Virtual time. ACM Transaction on Programming Languages and Systems 7, 3 (July), 404--425.

Digital Library

[24]

Kaufman, D. M., Sueda, S., James, D. L., and Pai, D. K. 2008. Staggered projections for frictional contact in multibody systems. ACM Transactions on Graphics 27, 5 (Dec.), 164:1--164:11.

Digital Library

[25]

Kim, T., and James, D. L. 2009. Skipping steps in deformable simulation with online model reduction. ACM Transactions on Graphics 28, 5 (Dec.), 123:1--123:9.

Digital Library

[26]

Klatzky, R., Pai, D., and Krotkov, E. 2000. Perception of material from contact sounds. Presence: Teleoperators & Virtual Environments 9, 4, 399--410.

Digital Library

[27]

Kry, P. G., and Pai, D. K. 2003. Continuous contact simulation for smooth surfaces. ACM Trans. Graph. 22, 1, 106--129.

Digital Library

[28]

Lötstedt, P. 1982. Mechanical systems of rigid bodies subject to unilateral constraints. SIAM J. of Appl. Math. 42, 2, 281--296.

[29]

Milenkovic, V. J., and Schmidl, H. 2001. Optimization-based animation. In Proc. of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 37--46.

[30]

Mirtich, B. 2000. Timewarp rigid body simulation. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 193--200.

Digital Library

[31]

Moore, M., and Wilhelms, J. 1988. Collision detection and response for computer animation. In Computer Graphics (Proceedings of SIGGRAPH 88), 289--298.

[32]

Moreau, J. 1966. Quadratic programming in mechanics: One-sided constraints. J. of SIAM Control 4, 1, 153--158.

[33]

O'Brien, J. F., Cook, P. R., and Essl, G. 2001. Synthesizing sounds from physically based motion. In Proceedings of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 529--536.

[34]

O'Brien, J. F., Shen, C., and Gatchalian, C. M. 2002. Synthesizing sounds from rigid-body simulations. In 2002 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 175--182.

[35]

Pai, D. K., van den Doel, K., James, D. L., Lang, J., Lloyd, J. E., Richmond, J. L., and Yau, S. H. 2001. Scanning physical interaction behavior of 3d objects. In Proceedings of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 87--96.

[36]

Raghuvanshi, N., and Lin, M. C. 2006. Interactive Sound Synthesis for Large Scale Environments. In SI3D '06: Proceedings of the 2006 symposium on Interactive 3D graphics and games, ACM Press, New York, NY, USA, 101--108.

[37]

Raghuvanshi, N., Snyder, J., Mehra, R., Lin, M., and Govindaraju, N. 2010. Precomputed wave simulation for real-time sound propagation of dynamic sources in complex scenes. ACM Transactions on Graphics 29, 4 (July), 68:1--68:11.

Digital Library

[38]

Ren, Z., Yeh, H., and Lin, M. 2010. Synthesizing contact sounds between textured objects. In IEEE Virtual Reality.

[39]

Schittkowski, K. 2005. QL: A Fortran code for convex quadratic programming-users guide, version 2.11. Research Report, Department of Mathematics, University of Bayreuth.

[40]

Shabana, A. A. 1990. Theory of Vibration, Volume II: Discrete and Continuous Systems, first ed. Springer-Verlag, New York, NY.

[41]

Stewart, D., and Trinkle, J. 1996. An implicit time-stepping scheme for rigid-body dynamics with inelastic collisions and coulomb friction. Inter. J. for Numerical Methods in Engineering 39, 2673--2691.

[42]

Stewart, D. 2000. Rigid-body dynamics with friction and impact. SIAM Review 42, 1, 3--39.

Digital Library

[43]

Takala, T., and Hahn, J. 1992. Sound rendering. In Computer Graphics (Proceedings of SIGGRAPH 92), 211--220.

[44]

van den Doel, K., and Pai, D. 1996. Synthesis of shape dependent sounds with physical modeling. In Proc. of the International Conference on Auditory Display.

[45]

van den Doel, K., Kry, P. G., and Pai, D. K. 2001. FoleyAutomatic: Physically-Based Sound Effects for Interactive Simulation and Animation. In Proceedings of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 537--544.

[46]

Wasfy, T., and Noor, A. 2003. Computational strategies for flexible multibody systems. Appl. Mech. Rev. 56, 6.

[47]

Wriggers, P. 2006. Computational Contact Mechanics, second ed. Springer Berlin Heidelberg.

[48]

Zheng, C., and James, D. L. 2010. Rigid-body fracture sound with precomputed soundbanks. ACM Transactions on Graphics 29, 4 (July), 69:1--69:13.

Digital Library

Cited By

Crespel OHohnadel EMetivet TBertails-Descoubes F(2024)Contact detection between curved fibres: high order makes a differenceACM Transactions on Graphics10.1145/365819143:4(1-23)Online publication date: 19-Jul-2024
https://dl.acm.org/doi/10.1145/3658191
McDermott JAgarwal VTraer J(2024)Physics, ecological acoustics and the auditory systemCurrent Biology10.1016/j.cub.2024.05.05634:20(R1006-R1013)Online publication date: Oct-2024
https://doi.org/10.1016/j.cub.2024.05.056
Lu SCulbertson H(2023)Active Acoustic Sensing for Robot Manipulation2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS55552.2023.10342481(3161-3168)Online publication date: 1-Oct-2023
https://doi.org/10.1109/IROS55552.2023.10342481
Show More Cited By

Recommendations

Toward high-quality modal contact sound
SIGGRAPH '11: ACM SIGGRAPH 2011 papers

Contact sound models based on linear modal analysis are commonly used with rigid body dynamics. Unfortunately, treating vibrating objects as "rigid" during collision and contact processing fundamentally limits the range of sounds that can be computed, ...
Precomputed acceleration noise for improved rigid-body sound

We introduce an efficient method for synthesizing acceleration noise -- sound produced when an object experiences abrupt rigid-body acceleration due to collisions or other contact events. We approach this in two main steps. First, we estimate continuous ...
Eigenmode compression for modal sound models

We propose and evaluate a method for significantly compressing modal sound models, thereby making them far more practical for audiovisual applications. The dense eigenmode matrix, needed to compute the sound model's response to contact forces, can ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 30, Issue 4

July 2011

829 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/2010324

Issue’s Table of Contents

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 July 2011

Published in TOG Volume 30, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Division of Information and Intelligent Systems

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

59
Total Citations
View Citations
948
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)1

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Crespel OHohnadel EMetivet TBertails-Descoubes F(2024)Contact detection between curved fibres: high order makes a differenceACM Transactions on Graphics10.1145/365819143:4(1-23)Online publication date: 19-Jul-2024
https://dl.acm.org/doi/10.1145/3658191
McDermott JAgarwal VTraer J(2024)Physics, ecological acoustics and the auditory systemCurrent Biology10.1016/j.cub.2024.05.05634:20(R1006-R1013)Online publication date: Oct-2024
https://doi.org/10.1016/j.cub.2024.05.056
Lu SCulbertson H(2023)Active Acoustic Sensing for Robot Manipulation2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS55552.2023.10342481(3161-3168)Online publication date: 1-Oct-2023
https://doi.org/10.1109/IROS55552.2023.10342481
Liu SManocha D(2022)Sound Synthesis, Propagation, and RenderingSynthesis Lectures on Visual Computing10.2200/S01162ED1V01Y202201VCP03311:2(1-110)Online publication date: 24-Mar-2022
https://doi.org/10.2200/S01162ED1V01Y202201VCP033
Takahashi TBatty C(2022)ElastoMonolithACM Transactions on Graphics10.1145/3550454.355547441:6(1-19)Online publication date: 30-Nov-2022
https://dl.acm.org/doi/10.1145/3550454.3555474
Wilson JRewkowski NLin M(2022)Audio-Visual Depth and Material Estimation for Robot Navigation2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS47612.2022.9981549(9239-9246)Online publication date: 23-Oct-2022
https://doi.org/10.1109/IROS47612.2022.9981549
Fagerstrom JSchlecht SValimaki V(2021)One-to-Many Conversion for Percussive Samples2021 24th International Conference on Digital Audio Effects (DAFx)10.23919/DAFx51585.2021.9768256(129-135)Online publication date: 8-Sep-2021
https://doi.org/10.23919/DAFx51585.2021.9768256
Agarwal VCusimano MTraer JMcDermott J(2021)Object-Based Synthesis of Scraping and Rolling Sounds Based on Non-Linear Physical Constraints2021 24th International Conference on Digital Audio Effects (DAFx)10.23919/DAFx51585.2021.9768225(136-143)Online publication date: 8-Sep-2021
https://doi.org/10.23919/DAFx51585.2021.9768225
Tang PZehnder JCoros SThomaszewski B(2020)A harmonic balance approach for designing compliant mechanical systems with nonlinear periodic motionsACM Transactions on Graphics10.1145/3414685.341776539:6(1-14)Online publication date: 27-Nov-2020
https://dl.acm.org/doi/10.1145/3414685.3417765
Pillwein SLeimer KBirsak MMusialski P(2020)On elastic geodesic grids and their planar to spatial deploymentACM Transactions on Graphics10.1145/3386569.339249039:4(125:1-125:12)Online publication date: 12-Aug-2020
https://dl.acm.org/doi/10.1145/3386569.3392490
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents