Cited By
View all- Romanov V(2023)UNet Performance with Wafer Scale Engine (Optimization Case Study)2023 IEEE High Performance Extreme Computing Conference (HPEC)10.1109/HPEC58863.2023.10363451(1-6)Online publication date: 25-Sep-2023
Massively Distributed Finite-Volume Flux Computation
Authors: 
Ryuichi Sai, Mathias Jacquelin, Francois Hamon, Mauricio Araya-Polo, Randolph R. SettgastAuthors Info & Claims
Pages 1713 - 1720
Abstract
Designing large-scale geological carbon capture and storage projects and ensuring safe long-term CO2 containment – as a climate change mitigation strategy – requires fast and accurate numerical simulations. These simulations involve solving complex PDEs governing subsurface fluid flow using implicit finite-volume schemes widely based on Two-Point Flux Approximation (TPFA). This task is computationally and memory expensive, especially when performed on highly detailed geomodels. In most current HPC architectures, memory hierarchy and data management mechanisms are insufficient to overcome the challenges of large scale numerical simulations. Therefore, it is crucial to design algorithms that can exploit alternative and more balanced paradigms, such as dataflow and in-memory computing. This work introduces an algorithm for TPFA computations that exploits a dataflow architecture, such as Cerebras CS-2, which helps to significantly minimize memory bottlenecks. Our implementation achieves two orders of magnitude speedup compared to multiple reference implementations running on latest generations of NVIDIA GPUs.
Supplemental Material
MP4 File
Recording of "Massively Distributed Finite-Volume Flux Computation" presentation at ScalAH'23.
- Download
- 149.59 MB
References
[1]
Dennis Abts 2022. The Groq Software-defined Scale-out Tensor Streaming Multiprocessor : From chips-to-systems architectural overview. In 2022 IEEE Hot Chips 34 Symposium (HCS). 1–69. https://doi.org/10.1109/HCS55958.2022.9895630
[2]
Dennis Abts, Ibrahim Ahmed, Andrew Bitar, Matt Boyd, John Kim, Garrin Kimmell, and Andrew Ling. 2022. Challenges/Opportunities to Enable Dependable Scale-out System with Groq Deterministic Tensor-Streaming Processors. In 2022 52nd Annual IEEE/IFIP International Conference on Dependable Systems and Networks - Supplemental Volume (DSN-S). IEEE, 19–22. https://doi.org/10.1109/DSN-S54099.2022.00016
[3]
Mauricio Araya-Polo, Félix Rubio, Raúl de la Cruz, Mauricio Hanzich, José María Cela, and Daniele Paolo Scarpazza. 2009. 3D Seismic Imaging through Reverse-Time Migration on Homogeneous and Heterogeneous Multi-Core Processors. Sci. Program. 17, 1–2 (jan 2009), 185–198. https://doi.org/10.1155/2009/382638
[4]
David A. Beckingsale, Jason Burmark, Rich Hornung, Holger Jones, William Killian, Adam J. Kunen, Olga Pearce, Peter Robinson, Brian S. Ryujin, and Thomas RW Scogland. 2019. RAJA: Portable Performance for Large-Scale Scientific Applications. In 2019 IEEE/ACM International Workshop on Performance, Portability and Productivity in HPC (P3HPC). IEEE, 71–81. https://doi.org/10.1109/P3HPC49587.2019.00012
[5]
Q.M. Bui, F.P. Hamon, N. Castelletto, D. Osei-Kuffuor, R.R. Settgast, and J.A. White. 2021. Multigrid reduction preconditioning framework for coupled processes in porous and fractured media. Comput. Methods Appl. Mech. Eng. 387 (2021), 114111. https://doi.org/10.1016/j.cma.2021.114111
[6]
J. Camargo, F.P. Hamon, A. Mazuyer, T. Meckel, N. Castelletto, and J.A. White. 2022. Deformation Monitoring Feasibility for Offshore Carbon Storage in the Gulf-of-Mexico. Proceedings of the 16th Greenhouse Gas Control Technologies Conference (GHGT-16), October 2022.
[7]
A. Costa, M. Cusini, T. Jin, R.R. Settgast, and J.E. Dolbow. 2022. A multi-resolution approach to hydraulic fracture simulation. Int. J. of Fracture 237, 1 (2022), 165–188. https://doi.org/10.1007/s10704-022-00662-y
[8]
M. Cusini, A. Franceschini, L. Gazzola, T. Gazzola, J. Huang, F.P. Hamon, R.R. Settgast, N. Castelletto, and J.A. White. 2022. Field-scale simulation of geologic carbon sequestration in faulted and fractured natural formations. Technical Report. Lawrence Livermore National Lab.(LLNL), Livermore, CA (United States).
[9]
J. Huang, Y. Hao, R.R. Settgast, J.A. White, K. Mateen, and H. Gross. 2022. Validation and Application of a Three-Dimensional Model for Simulating Proppant Transport and Fracture Conductivity. Rock Mech. Rock Eng. (2022), 1–23. https://doi.org/10.1016/j.ijggc.2021.103488
[10]
Mathias Jacquelin, Mauricio Araya-Polo, and Jie Meng. 2022. Scalable Distributed High-Order Stencil Computations. In Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis (Dallas, Texas) (SC ’22). IEEE Press, Article 30, 13 pages.
[11]
B. Kahle and W.D. Hillis. 1989. The Connection Machine Model CM-1 Architecture. Thinking Machines Corporation. https://books.google.com/books?id=PCq7uAAACAAJ
[12]
Lawrence Livermore National Laboratory, Stanford University, TotalEnergies, and GEOS Contributors. 2023. GEOS: Next-gen simulation for geologic carbon storage. Website. Retrieved March 19, 2023 from https://www.geos.dev/
[13]
Knut-Andreas Lie. 2019. An introduction to reservoir simulation using MATLAB/GNU Octave: User guide for the MATLAB Reservoir Simulation Toolbox (MRST). Cambridge University Press.
[14]
Raghu Prabhakar and Sumti Jairath. 2021. SambaNova SN10 RDU:Accelerating Software 2.0 with Dataflow. In 2021 IEEE Hot Chips 33 Symposium (HCS). IEEE, 1–37. https://doi.org/10.1109/HCS52781.2021.9567250
[15]
Daniel Reed, Dennis Gannon, and Jack Dongarra. 2022. Reinventing High Performance Computing: Challenges and Opportunities. arxiv:2203.02544 [cs.DC]
[16]
Kamil Rocki 2020. Fast Stencil-Code Computation on a Wafer-Scale Processor. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (Atlanta, Georgia) (SC ’20). IEEE Press, Article 58, 14 pages.
Index Terms
- Massively Distributed Finite-Volume Flux Computation
Index terms have been assigned to the content through auto-classification.
Recommendations
Matrix-Free Finite Volume Kernels on a Dataflow Architecture
SC '24: Proceedings of the International Conference for High Performance Computing, Networking, Storage, and AnalysisFast and accurate numerical simulations are crucial for designing large-scale geological carbon storage projects ensuring safe long-term CO2 containment as a climate change mitigation strategy. These simulations involve solving numerous large and complex ...
Flux modelling in the finite-volume lattice Boltzmann approach
In this article, a novel approach for flux treatment is presented in conjunction with cell-centred Finite-Volume Lattice Boltzmann Method (FVLBM). The distribution functions are determined by using a pressure-based flux weighting factor on a D2Q9 ...
A high-order low-dispersion symmetry-preserving finite-volume method for compressible flow on curvilinear grids
A new high-order finite-volume method is presented that preserves the skew symmetry of convection for the compressible flow equations. The method is intended for Large-Eddy Simulations (LES) of compressible turbulent flows, in particular in the context ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
November 2023
2180 pages
ISBN:9798400707858
DOI:10.1145/3624062
Copyright © 2023 ACM.
Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of the United States government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 12 November 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
SC-W 2023
SC-W 2023: Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis
November 12 - 17, 2023
CO, Denver, USA
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 51Total Downloads
- Downloads (Last 12 months)47
- Downloads (Last 6 weeks)3
Reflects downloads up to 09 Dec 2024
Other Metrics
Citations
Cited By
View all- Romanov V(2023)UNet Performance with Wafer Scale Engine (Optimization Case Study)2023 IEEE High Performance Extreme Computing Conference (HPEC)10.1109/HPEC58863.2023.10363451(1-6)Online publication date: 25-Sep-2023
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format