Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3587423.3595518acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
course

Deep Learning for Physics Simulation

Published: 24 July 2023 Publication History

Abstract

Numerical simulation of physical systems has become an increasingly important scientific tool supporting various research fields. Despite its remarkable success, simulating intricate physical systems typically requires advanced domain-specific knowledge, meticulous implementation, and enormous computational resources. With the surge of deep learning in the last decade, there has been a growing interest in the machine-learning and graphics communities to address these limitations of numerical simulation with deep learning. This course provides a gentle introduction to this topic for audiences interested in exploring this trend but with little to modest machine-learning or physics-simulation backgrounds. We begin with a brief overview of the numerical simulation framework on which we ground our discussion of deep-learning methods. Next, the course provides a possible classification of several hybrid simulation strategies based on the roles of learning and physics insights incorporated. We then review the implications of such deep-learning strategies and discuss some practical considerations in combining deep learning and physics simulation. Finally, we briefly mention several advanced machine-learning techniques for further exploration. The full course information can be found in https://people.iiis.tsinghua.edu.cn/~taodu/dl4sim/.

References

[1]
Anurag Ajay, Jiajun Wu, Nima Fazeli, Maria Bauza, Leslie P Kaelbling, Joshua B Tenenbaum, and Alberto Rodriguez. 2018. Augmenting Physical Simulators with Stochastic Neural Networks: Case Study of Planar Pushing and Bouncing. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).
[2]
Joe Allen. 1972. The Apollo 15 Hammer-Feather Drop. Retrieved February 18, 2023 from https://moon.nasa.gov/resources/331/the-apollo-15-hammer-feather-drop/
[3]
Faisal As'ad, Philip Avery, and Charbel Farhat. 2022. A Mechanics-Informed Artificial Neural Network Approach in Data-Driven Constitutive Modeling. Internat. J. Numer. Methods Engrg. 123, 12 (2022), 2738--2759. arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/nme.6957
[4]
Uri M. Ascher and Linda R. Petzold. 1998. Computer Methods for Ordinary Differential Equations and Differential-Algebraic Equations (1st ed.). Society for Industrial and Applied Mathematics, USA.
[5]
Yohai Bar-Sinai, Stephan Hoyer, Jason Hickey, and Michael P. Brenner. 2019. Learning Data-Driven Discretizations for Partial Differential Equations. Proceedings of the National Academy of Sciences 116, 31 (2019), 15344--15349. arXiv:https://www.pnas.org/content/116/31/15344.full.pdf
[6]
Adam W. Bargteil, Tamar Shinar, and Paul G. Kry. 2020. An Introduction to Physics-Based Animation. In SIGGRAPH Asia 2020 Courses (Virtual Event) (SA '20). Association for Computing Machinery, New York, NY, USA, Article 5, 57 pages.
[7]
Robert Bridson, Ronald Fedkiw, and Matthias Müller-Fischer. 2006. Fluid Simulation: SIGGRAPH 2006 Course Notes. In ACM SIGGRAPH 2006 Courses (Boston, Massachusetts) (SIGGRAPH '06). Association for Computing Machinery, New York, NY, USA, 1--87.
[8]
Steven L Brunton, Joshua L Proctor, and J Nathan Kutz. 2016. Discovering Governing Equations from Data by Sparse Identification of Nonlinear Dynamical Systems. Proceedings of the National Academy of Sciences 113 (2016), 3932--3937. Issue 15.
[9]
Shengze Cai, Zhicheng Wang, Frederik Fuest, Young Jin Jeon, Callum Gray, and George Em Karniadakis. 2021. Flow over an Espresso Cup: Inferring 3-D Velocity and Pressure Fields from Tomographic Background Oriented Schlieren via Physics-Informed Neural Networks. Journal of Fluid Mechanics 915 (2021), A102.
[10]
Peter Yichen Chen, Maurizio M. Chiaramonte, Eitan Grinspun, and Kevin Carlberg. 2023. Model Reduction for the Material Point Method via an Implicit Neural Representation of the Deformation Map. J. Comput. Phys. 478 (2023), 111908.
[11]
Zhao Chen, Yang Liu, and Hao Sun. 2021. Physics-Informed Learning of Governing Equations from Scarce Data. Nature Communications 12 (2021), 6136. Issue 1.
[12]
Stelian Coros, Miles Macklin, Bernhard Thomaszewski, and Nils Thürey. 2021. Differentiable Simulation. In SIGGRAPH Asia 2021 Courses (Tokyo, Japan) (SA '21). Association for Computing Machinery, New York, NY, USA, Article 3, 142 pages.
[13]
Tao Du, Josie Hughes, Sebastien Wah, Wojciech Matusik, and Daniela Rus. 2021. Underwater Soft Robot Modeling and Control With Differentiable Simulation. IEEE Robotics and Automation Letters 6, 3 (2021), 4994--5001.
[14]
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative Adversarial Nets. In Advances in Neural Information Processing Systems, Z. Ghahramani, M. Welling, C. Cortes, N. Lawrence, and K.Q. Weinberger (Eds.), Vol. 27. Curran Associates, Inc. https://proceedings.neurips.cc/paper/2014/file/5ca3e9b122f61f8f06494c97b1afccf3-Paper.pdf
[15]
Jemin Hwangbo, Joonho Lee, Alexey Dosovitskiy, Dario Bellicoso, Vassilios Tsounis, Vladlen Koltun, and Marco Hutter. 2019. Learning Agile and Dynamic Motor Skills for Legged Robots. Science Robotics 4, 26 (2019), eaau5872. arXiv:https://www.science.org/doi/pdf/10.1126/scirobotics.aau5872
[16]
Geoffrey Irving, Joseph Teran, and Ronald Fedkiw. 2006. Tetrahedral and Hexahedral Invertible Finite Elements. Graphical Models 68, 2 (2006), 66--89. Special Issue on SCA 2004.
[17]
Chenfanfu Jiang, Craig Schroeder, Joseph Teran, Alexey Stomakhin, and Andrew Selle. 2016. The Material Point Method for Simulating Continuum Materials. In ACM SIGGRAPH 2016 Courses (Anaheim, California) (SIGGRAPH '16). Association for Computing Machinery, New York, NY, USA, Article 24, 52 pages.
[18]
Claes Johnson. 2012. Numerical Solution of Partial Differential Equations by the Finite Element Method. Courier Corporation.
[19]
George Em Karniadakis, Ioannis G Kevrekidis, Lu Lu, Paris Perdikaris, Sifan Wang, and Liu Yang. 2021. Physics-Informed Machine Learning. Nature Reviews Physics 3 (2021), 422--440. Issue 6.
[20]
Byungsoo Kim, Vinicius C. Azevedo, Nils Thuerey, Theodore Kim, Markus Gross, and Barbara Solenthaler. 2019. Deep Fluids: A Generative Network for Parameterized Fluid Simulations. Computer Graphics Forum 38, 2, 59--70. arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/cgf.13619
[21]
Theodore Kim and David Eberle. 2020. Dynamic Deformables: Implementation and Production Practicalities. In ACM SIGGRAPH 2020 Courses (Virtual Event, USA) (SIGGRAPH '20). Association for Computing Machinery, New York, NY, USA, Article 23, 182 pages.
[22]
Venkat Krishnamurthy and Marc Levoy. 1996. Fitting Smooth Surfaces to Dense Polygon Meshes. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques. 313--324.
[23]
Xuan Li, Yadi Cao, Minchen Li, Yin Yang, Craig Schroeder, and Chenfanfu Jiang. 2022. PlasticityNet: Learning to Simulate Metal, Sand, and Snow for Optimization Time Integration. In Advances in Neural Information Processing Systems.
[24]
Yichen Li, Peter Yichen Chen, Tao Du, and Wojciech Matusik. 2023. Learning Preconditioner for Conjugate Gradient PDE Solvers (ICML'23). JMLR.org.
[25]
Yunzhu Li, Jiajun Wu, Russ Tedrake, Joshua B Tenenbaum, and Antonio Torralba. 2019. Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluids. In International Conference on Learning Representations (ICLR).
[26]
Pingchuan Ma, Peter Yichen Chen, Bolei Deng, Joshua B Tenenbaum, Tao Du, Chuang Gan, and Wojciech Matusik. 2023. Learning Neural Constitutive Laws From Motion Observations for Generalizable PDE Dynamics. (2023).
[27]
Elvis Nava, John Z Zhang, Mike Yan Michelis, TaoDu, Pingchuan Ma, Benjamin F. Grewe, Wojciech Matusik, and Robert Kevin Katzschmann. 2022. Fast Aquatic Swimmer Optimization with Differentiable Projective Dynamics and Neural Network Hydrodynamic Models. In Proceedings of the 39th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 162), Kamalika Chaudhuri, Stefanie Jegelka, Le Song, Csaba Szepesvari, Gang Niu, and Sivan Sabato (Eds.). PMLR, 16413--16427. https://proceedings.mlr.press/v162/nava22a.html
[28]
Jorge Nocedal and Stephen Wright. 2006. Numerical Optimization. Springer Science & Business Media.
[29]
Panayiotis Papadopoulos. 2008. Introduction to Continuum Mechanics. Berkeley, California (2008).
[30]
Tobias Pfaff, Meire Fortunato, Alvaro Sanchez-Gonzalez, and Peter W Battaglia. 2020. Learning Mesh-Based Simulation with Graph Networks. In International Conference on Learning Representations (ICLR).
[31]
Maziar Raissi, Paris Perdikaris, and George E Karniadakis. 2019. Physics-Informed Neural Networks: A Deep Learning Framework for Solving Forward and Inverse Problems Involving Nonlinear Partial Differential Equations. J. Comput. Phys. 378 (2019), 686--707.
[32]
Maziar Raissi, Alireza Yazdani, and George Em Karniadakis. 2020. Hidden Fluid Mechanics: Learning Velocity and Pressure Fields from Flow Visualizations. Science 367, 6481 (2020), 1026--1030. arXiv:https://www.science.org/doi/pdf/10.1126/science.aaw4741
[33]
Alvaro Sanchez-Gonzalez, Jonathan Godwin, Tobias Pfaff, Rex Ying, Jure Leskovec, and Peter W. Battaglia. 2020. Learning to Simulate Complex Physics with Graph Networks. In Proceedings of the 37th International Conference on Machine Learning (ICML'20). JMLR.org, Article 784, 10 pages.
[34]
Craig Schroeder. 2022. Practical Course on Computing Derivatives in Code. In ACM SIGGRAPH 2022 Courses (Vancouver, British Columbia, Canada) (SIGGRAPH '22). Association for Computing Machinery, New York, NY, USA, Article 12, 28 pages.
[35]
Siyuan Shen, Yin Yang, Tianjia Shao, He Wang, Chenfanfu Jiang, Lei Lan, and Kun Zhou. 2021. High-Order Differentiable Autoencoder for Nonlinear Model Reduction. ACM Trans. Graph. 40, 4, Article 68 (jul 2021), 15 pages.
[36]
Eftychios Sifakis and Jernej Barbic. 2012. FEM Simulation of 3D Deformable Solids: A Practitioner's Guide to Theory, Discretization and Model Reduction. In ACM SIGGRAPH 2012 Courses (Los Angeles, California) (SIGGRAPH '12). Association for Computing Machinery, New York, NY, USA, Article 20, 50 pages.
[37]
Breannan Smith, Fernando De Goes, and Theodore Kim. 2018. Stable Neo-Hookean Flesh Simulation. ACM Trans. Graph. 37, 2, Article 12 (mar 2018), 15 pages.
[38]
Justin Solomon. 2015. Numerical Algorithms: Methods for Computer Vision, Machine Learning, and Graphics. CRC press.
[39]
Jos Stam. 1999. Stable fluids. In Proceedings of the 26th annual conference on Computer graphics and interactive techniques. 121--128.
[40]
Jie Tan, Tingnan Zhang, Erwin Coumans, Atil Iscen, Yunfei Bai, Danijar Hafner, Steven Bohez, and Vincent Vanhoucke. 2018. Sim-to-Real: Learning Agile Locomotion for Quadruped Robots. (June 2018).
[41]
Jonathan Tompson, Kristofer Schlachter, Pablo Sprechmann, and Ken Perlin. 2017. Accelerating Eulerian Fluid Simulation With Convolutional Networks. In Proceedings of the 34th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 70), Doina Precup and Yee Whye Teh (Eds.). PMLR, 3424--3433. https://proceedings.mlr.press/v70/tompson17a.html
[42]
You Xie, Erik Franz, Mengyu Chu, and Nils Thuerey. 2018. TempoGAN: A Temporally Coherent, Volumetric GAN for Super-Resolution Fluid Flow. ACM Trans. Graph. 37, 4, Article 95 (jul 2018), 15 pages.
[43]
Hongyi Xu and Jernej Barbič. 2017. Example-Based Damping Design. ACM Trans. Graph. 36, 4, Article 53 (jul 2017), 14 pages.
[44]
Hongyi Xu, Funshing Sin, Yufeng Zhu, and Jernej Barbič. 2015. Nonlinear Material Design Using Principal Stretches. ACM Trans. Graph. 34, 4, Article 75 (jul 2015), 11 pages.
[45]
Wenhao Yu, Visak CV Kumar, Greg Turk, and C Karen Liu. 2018. Sim-to-Real Transfer for Biped Locomotion. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).
[46]
Andy Zeng, Shuran Song, Johnny Lee, Alberto Rodriguez, and Thomas Funkhouser. 2020. TossingBot: Learning to Throw Arbitrary Objects With Residual Physics. IEEE Transactions on Robotics 36, 4 (2020), 1307--1319.
[47]
John Z. Zhang, Yu Zhang, Pingchuan Ma, Elvis Nava, Tao Du, Philip Arm, Wojciech Matusik, and Robert K. Katzschmann. 2022. Sim2Real for Soft Robotic Fish via Differentiable Simulation. In 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 12598--12605.

Cited By

View all
  • (2024)Parameterized Quasi-Physical Simulators for Dexterous Manipulations TransferComputer Vision – ECCV 202410.1007/978-3-031-73229-4_10(164-182)Online publication date: 25-Oct-2024

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGGRAPH '23: ACM SIGGRAPH 2023 Courses
July 2023
2170 pages
ISBN:9798400701450
DOI:10.1145/3587423
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 July 2023

Check for updates

Qualifiers

  • Course

Conference

SIGGRAPH '23
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)622
  • Downloads (Last 6 weeks)57
Reflects downloads up to 12 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Parameterized Quasi-Physical Simulators for Dexterous Manipulations TransferComputer Vision – ECCV 202410.1007/978-3-031-73229-4_10(164-182)Online publication date: 25-Oct-2024

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media