Article

Free access

High performance reactive fluid flow simulations using adaptive mesh refinement on thousands of processors

Authors:

G. HenryAuthors Info & Claims

SC '00: Proceedings of the 2000 ACM/IEEE conference on Supercomputing

Pages 56 - es

Published: 01 November 2000 Publication History

Abstract

We present simulations and performance results of nuclear burning fronts in supernovae on the largest domain and at the finest spatial resolution studied to date. These simulations were performed on the Intel ASCI-Red machine at Sandia National Laboratories using FLASH, a code developed at the Center for Astrophysical Thermonuclear Flashes at the University of Chicago. FLASH is a modular, adaptive mesh, parallel simulation code capable of handling compressible, reactive fluid flows in astrophysical environments. FLASH is written primarily in Fortran 90, uses the Message-Passing Interface library for inter-processor communication and portability, and employs the PARAMESH package to manage a block-structured adaptive mesh that places blocks only where resolution is required and tracks rapidly changing flow features, such as detonation fronts, with ease. We describe the key algorithms and their implementation as well as the optimizations required to achieve sustained performance of 238 GFLOPS on 6420 processors of ASCI-Red in 64 bit arithmetic.

References

[1]

Berger,M.J.1982,Ph.D.Thesis,Stanford Univ.

[2]

Berger,M.J.&Oliger,J.1984,J.Comp.Phys.,53,484

[3]

Berger,M.J.&Collela,P.1989,J.Comp.Phys.,82,64

Digital Library

[4]

Calder,A.C.,Fryxell,B.,Rosner,R.,Kane,J.,Remington,B.A.,Dursi,L.J.,Olson,K.,R cker, P.M.,Timmes,F.X.,Zingale,M.,MacNeice,P.,&Tufo,H.2000,BAAS,32,704

[5]

Colella,P.&Glaz,H.M.1985,J.Comp.Phys.,59,264

[6]

Colella,P.&Woodward,P.1984,J.Comp.Phys.,54,174

[7]

DeZeeuw,D.&Powell,K.G.1993,J.Comp.Phys.,104,56

[8]

Dursi,J.,Niemeyer,J.,Calder,A.,Fryxell,B.,Lamb,D.,Olson,K.,R cker,P.,Rosner,R., Timmes,F.X.,Tufo,H.,&Zingale,M.2000,BAAS,31,1430

[9]

Fryxell,B.A.Olson,K.,Ricker,P.,Timmes,F.X.,Zingale,M.,Lamb,D.Q.,MacNeice,P.,Rosner, R.,&Tufo,H.2000,Astrophysical J.Supp.,n press

[10]

Gustafson,F.G.,Liniger,W.,&Wiloughby,R.1970,J.Assoc.Comput.Mach.,17,87

[11]

Gamezo,V.N.,Wheeler,J.C.,Khokhlov,A.M.,&Oran,E.S.1999,Astrophysical J.,512,827

[12]

Khokhlov,A.M.1997,Memo 6406-97-7950,(Naval Research Lab)

[13]

LeVeque,R.&Berger,M.2000,http://www.amath.washington.edu:80/~amrclaw/

[14]

Lohner,R.1987,Comp.Meth.App.Mech.Eng.,61,323

Digital Library

[15]

MacNe ce,P.,Olson,K.M.,Mobarry,C.,de Fainchtein,R.,&Packer,C.2000,Comp.Phys. Comm.,126,330

[16]

Muller,E.1997,Saas-Fee Advanced Course 27,eds.O.Ste ner &A.Gautschy (Berlin:Springer), p.343

[17]

Neeman,H.J.1996,Ph.D.Thes s,Univ.of Illinois

[18]

Parashar,M.&Browne,J.C.2000,in IMA Volume 117:Structured Adaptive Mesh Re .nement Gr d Methods,eds.S.B.Baden,N.P.Chr socho des,D.B.Gannon,&M.L.Norman (Berl n: Springer-Verlag)

[19]

Quinlan,J.J.1991,Ph.D.Thesis,Cran .eld Inst.Tech.

[20]

Sagan,H.1994,Space-Filling Curves (Berlin:Springer-Verlag)

[21]

Timmes,F.X.1999,Astrophysical J.Supp.,124,241

[22]

Timmes,F.X.,Zingale,M.,Olson,K.,Fryxell,B.,Ricker,P.,Calder,A.C.,Dursi,L.J.,Tufo,H., MacNe ce,P.,Truran,J.W.,&Rosner,R.2000,Astrophysical J.Supp.,n press

[23]

Timmes,F.X.,&Arnett,D.1999,Astrophysical J.Supp.,125,294

[24]

Timmes,F.X.,&Swesty,F.D.2000,Astrophysical J.Supp.,126,501

[25]

Tufo,H.M.,&Fischer,P.F.1999,Proc.Supercomputing 1999 (Portland,OR:IEEE Computer Soc.)

[26]

Tufo,H.M.,&Fischer,P.F.2000,J.Par.&Dist.Computing,in press

[27]

Warren,M.S.&Salmon,J.K.1993,Proc.Supercomputing 1993 (Wash ngton,D.C.:IEEE Computer Soc.),p.12

Digital Library

[28]

Zingale,M.,Timmes,F.X.,Fryxell,B.,Lamb,D.Q.,Olson,K.,Calder,A.C.,Dursi,L.J.,Ricker, P.,Rosner,R.,MacNeice,P.,&Tufo,H.2000,Astrophysical J.,in press

Cited By

Roychowdhury SMahmud SMartin ABalogh PPuleri DGounley JDraeger ERandles AMohror KArnold DBadia R(2023)Enhancing Adaptive Physics Refinement Simulations Through the Addition of Realistic Red Blood Cell CountsProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/3581784.3607105(1-13)Online publication date: 12-Nov-2023
https://dl.acm.org/doi/10.1145/3581784.3607105
Burstedde CGhattas OGurnis MIsaac TStadler GWarburton TWilcox LHess B(2010)Extreme-Scale AMRProceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis10.1109/SC.2010.25(1-12)Online publication date: 13-Nov-2010
https://dl.acm.org/doi/10.1109/SC.2010.25
Burstedde CGhattas OGurnis MStadler GTan ETu TWilcox LZhong STeller P(2008)Scalable adaptive mantle convection simulation on petascale supercomputersProceedings of the 2008 ACM/IEEE conference on Supercomputing10.5555/1413370.1413434(1-15)Online publication date: 15-Nov-2008
https://dl.acm.org/doi/10.5555/1413370.1413434
Show More Cited By

Index Terms

High performance reactive fluid flow simulations using adaptive mesh refinement on thousands of processors

Recommendations

A space-time parallel algorithm with adaptive mesh refinement for computational fluid dynamics
Abstract
This paper describes a space-time parallel algorithm with space-time adaptive mesh refinement (AMR). AMR with subcycling is added to multigrid reduction-in-time (MGRIT) in order to provide solution efficient adaptive grids with a reduction in work ...
Porous flow in particle-based fluid simulations

This paper presents the simulation of a fluid flowing through a porous deformable material. We introduce the physical principles governing porous flow, expressed by the Law of Darcy, into the Smoothed Particle Hydrodynamics (SPH) framework for ...
Parallel Algorithms for Adaptive Mesh Refinement

Computational methods based on the use of adaptively constructed nonuniform meshes reduce the amount of computation and storage necessary to perform many scientific calculations. The adaptive construction of such nonuniform meshes is an important part of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SC '00: Proceedings of the 2000 ACM/IEEE conference on Supercomputing

November 2000

889 pages

ISBN:0780398025

Conference Chair:
Louis Turcotte
Rose-Hulman Institute of Technology

Copyright © Copyright (c) 2000 Institute of Electrical and Electronics Engineers, Inc. All rights reserved.

Sponsors

SIGARCH: ACM Special Interest Group on Computer Architecture
IEEE-CS: Computer Society

In-Cooperation

SIAM: Society for Industrial and Applied Mathematics

Publisher

IEEE Computer Society

United States

Publication History

Published: 01 November 2000

Check for updates

Qualifiers

Article

Conference

SC '00

Sponsor:

SIGARCH
IEEE-CS

SC '00: International Conference for High Performance Computing, Networking, Storage and Analysis

November 4 - 10, 2000

Texas, Dallas, USA

Acceptance Rates

SC '00 Paper Acceptance Rate 62 of 179 submissions, 35%;

Overall Acceptance Rate 1,516 of 6,373 submissions, 24%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
329
Total Downloads

Downloads (Last 12 months)42
Downloads (Last 6 weeks)11

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Roychowdhury SMahmud SMartin ABalogh PPuleri DGounley JDraeger ERandles AMohror KArnold DBadia R(2023)Enhancing Adaptive Physics Refinement Simulations Through the Addition of Realistic Red Blood Cell CountsProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/3581784.3607105(1-13)Online publication date: 12-Nov-2023
https://dl.acm.org/doi/10.1145/3581784.3607105
Burstedde CGhattas OGurnis MIsaac TStadler GWarburton TWilcox LHess B(2010)Extreme-Scale AMRProceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis10.1109/SC.2010.25(1-12)Online publication date: 13-Nov-2010
https://dl.acm.org/doi/10.1109/SC.2010.25
Burstedde CGhattas OGurnis MStadler GTan ETu TWilcox LZhong STeller P(2008)Scalable adaptive mantle convection simulation on petascale supercomputersProceedings of the 2008 ACM/IEEE conference on Supercomputing10.5555/1413370.1413434(1-15)Online publication date: 15-Nov-2008
https://dl.acm.org/doi/10.5555/1413370.1413434
Li XParashar M(2007)Hybrid Runtime Management of Space-Time Heterogeneity for Parallel Structured Adaptive ApplicationsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2007.103818:9(1202-1214)Online publication date: 1-Sep-2007
https://dl.acm.org/doi/10.1109/TPDS.2007.1038
TU TO'HALLARON DGHATTAS OKramer W(2005)Scalable Parallel Octree Meshing for TeraScale ApplicationsProceedings of the 2005 ACM/IEEE conference on Supercomputing10.1109/SC.2005.61Online publication date: 12-Nov-2005
https://dl.acm.org/doi/10.1109/SC.2005.61
Strout MHovland PDing CBlackburn S(2004)Metrics and models for reordering transformationsProceedings of the 2004 workshop on Memory system performance10.1145/1065895.1065899(23-34)Online publication date: 8-Jun-2004
https://dl.acm.org/doi/10.1145/1065895.1065899
Calder ADursi JFryxell BPlewa TWeirs GDupont TRobey HKane JRemington BTimmes FDimonte GHayes JZingale MDrake PRicker PStone JOlson K(2004)Validating Astrophysical Simulation CodesComputing in Science and Engineering10.1109/MCSE.2004.446:5(10-20)Online publication date: 1-Sep-2004
https://dl.acm.org/doi/10.1109/MCSE.2004.44
Wissink AHysom DHornung RBanerjee UGallivan KGonzalez A(2003)Enhancing scalability of parallel structured AMR calculationsProceedings of the 17th annual international conference on Supercomputing10.1145/782814.782861(336-347)Online publication date: 23-Jun-2003
https://dl.acm.org/doi/10.1145/782814.782861
Steensland JChandra SParashar M(2002)An Application-Centric Characterization of Domain-Based SFC Partitioners for Parallel SAMRIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2002.115826513:12(1275-1289)Online publication date: 1-Dec-2002
https://dl.acm.org/doi/10.1109/TPDS.2002.1158265
Ross RNurmi DCheng AZingale MSlocomb C(2001)A case study in application I/O on Linux clustersProceedings of the 2001 ACM/IEEE conference on Supercomputing10.1145/582034.582045(11-11)Online publication date: 10-Nov-2001
https://dl.acm.org/doi/10.1145/582034.582045
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents