-
Ookami: An A64FX Computing Resource
Authors:
A. C. Calder,
E. Siegmann,
C. Feldman,
S. Chheda,
D. C. Smolarski,
F. D. Swesty,
A. Curtis,
J. Dey,
D. Carlson,
B. Michalowicz,
R. J. Harrison
Abstract:
We present a look at Ookami, a project providing community access to a testbed supercomputer with the ARM-based A64FX processors developed by a collaboration between RIKEN and Fujitsu and deployed in the Japanese supercomputer Fugaku. We describe the project, provide details about the user base and education/training program, and present highlights from performance studies of two astrophysical sim…
▽ More
We present a look at Ookami, a project providing community access to a testbed supercomputer with the ARM-based A64FX processors developed by a collaboration between RIKEN and Fujitsu and deployed in the Japanese supercomputer Fugaku. We describe the project, provide details about the user base and education/training program, and present highlights from performance studies of two astrophysical simulation codes.
△ Less
Submitted 7 November, 2023;
originally announced November 2023.
-
Performance of an Astrophysical Radiation Hydrodynamics Code under Scalable Vector Extension Optimization
Authors:
Dennis C. Smolarski,
F. Douglas Swesty,
Alan C. Calder
Abstract:
We present results of a performance study of an astrophysical radiation hydrodynamics code, V2D, on the Arm-based A64FX processor developed by Fujitsu. The code solves sparse linear systems, a task for which the A64FX architecture should be well suited. We performed the performance analysis study on Ookami, an Apollo 80 platform utilizing the A64FX processor. We explored several compilers and perf…
▽ More
We present results of a performance study of an astrophysical radiation hydrodynamics code, V2D, on the Arm-based A64FX processor developed by Fujitsu. The code solves sparse linear systems, a task for which the A64FX architecture should be well suited. We performed the performance analysis study on Ookami, an Apollo 80 platform utilizing the A64FX processor. We explored several compilers and performance analysis packages and found the code did not perform as expected under scalable vector extension optimization, suggesting that a "deeper dive" into analyzing the code is worthwhile. However, a simple driver program that exercised basic sparse linear algebra routines used by V2D did show significant speedup with the use of the scalable vector extension optimization. We present the initial results from the study which used V2D on a relatively simple test problem that emphasized the repeated solution of sparse linear systems.
△ Less
Submitted 26 July, 2022;
originally announced July 2022.
-
Quantification of Incertitude in Black Box Simulation Codes
Authors:
Alan C. Calder,
Melissa M. Hoffman,
Donald E. Willcox,
Maximilian P. Katz,
F. Douglas Swesty,
Scott Ferson
Abstract:
We present early results from a study addressing the question of how one treats the propagation of incertitude, that is, epistemic uncertainty, in input parameters in astrophysical simulations. As an example, we look at the propagation of incertitude in control parameters for stellar winds in MESA stellar evolution simulations. We apply two methods of incertitude propagation, the Cauchy Deviates m…
▽ More
We present early results from a study addressing the question of how one treats the propagation of incertitude, that is, epistemic uncertainty, in input parameters in astrophysical simulations. As an example, we look at the propagation of incertitude in control parameters for stellar winds in MESA stellar evolution simulations. We apply two methods of incertitude propagation, the Cauchy Deviates method and the Quadratic Response Surface method, to quantify the output uncertainty in the final white dwarf mass given a range of values for wind parameters. The methodology we apply is applicable to the problem of propagating input incertitudes through any simulation code treated as a "black box," i.e. a code for which the algorithmic details are either inaccessible or prohibitively complicated. We have made the tools developed for this study freely available to the community.
△ Less
Submitted 24 May, 2018;
originally announced May 2018.
-
White Dwarf Mergers on Adaptive Meshes I. Methodology and Code Verification
Authors:
Max P. Katz,
Michael Zingale,
Alan C. Calder,
F. Douglas Swesty,
Ann S. Almgren,
Weiqun Zhang
Abstract:
The Type Ia supernova progenitor problem is one of the most perplexing and exciting problems in astrophysics, requiring detailed numerical modeling to complement observations of these explosions. One possible progenitor that has merited recent theoretical attention is the white dwarf merger scenario, which has the potential to naturally explain many of the observed characteristics of Type Ia super…
▽ More
The Type Ia supernova progenitor problem is one of the most perplexing and exciting problems in astrophysics, requiring detailed numerical modeling to complement observations of these explosions. One possible progenitor that has merited recent theoretical attention is the white dwarf merger scenario, which has the potential to naturally explain many of the observed characteristics of Type Ia supernovae. To date there have been relatively few self-consistent simulations of merging white dwarf systems using mesh-based hydrodynamics. This is the first paper in a series describing simulations of these systems using a hydrodynamics code with adaptive mesh refinement. In this paper we describe our numerical methodology and discuss our implementation in the compressible hydrodynamics code CASTRO, which solves the Euler equations, and the Poisson equation for self-gravity, and couples the gravitational and rotation forces to the hydrodynamics. Standard techniques for coupling gravitation and rotation forces to the hydrodynamics do not adequately conserve the total energy of the system for our problem, but recent advances in the literature allow progress and we discuss our implementation here. We present a set of test problems demonstrating the extent to which our software sufficiently models a system where large amounts of mass are advected on the computational domain over long timescales. Future papers in this series will describe our treatment of the initial conditions of these systems and will examine the early phases of the merger to determine its viability for triggering a thermonuclear detonation.
△ Less
Submitted 19 January, 2016; v1 submitted 18 December, 2015;
originally announced December 2015.
-
A Numerical Algorithm for Modeling Multigroup Neutrino-Radiation Hydrodynamics in Two Spatial Dimensions
Authors:
F. Douglas Swesty,
Eric S. Myra
Abstract:
It is now generally agreed that multidimensional, multigroup, radiation hydrodynamics is an indispensable element of any realistic model of stellar-core collapse, core-collapse supernovae, and protoneutron star instabilities. We have developed a new, two-dimensional, multigroup algorithm that can model neutrino-radiation-hydrodynamic flows in core-collapse supernovae. Our algorithm uses an appro…
▽ More
It is now generally agreed that multidimensional, multigroup, radiation hydrodynamics is an indispensable element of any realistic model of stellar-core collapse, core-collapse supernovae, and protoneutron star instabilities. We have developed a new, two-dimensional, multigroup algorithm that can model neutrino-radiation-hydrodynamic flows in core-collapse supernovae. Our algorithm uses an approach that is similar to the ZEUS family of algorithms, originally developed by Stone and Norman. However, we extend that previous work in three significant ways: First, we incorporate multispecies, multigroup, radiation hydrodynamics in a flux-limited-diffusion approximation. Our approach is capable of modeling pair-coupled neutrino-radiation hydrodynamics, and includes effects of Pauli blocking in the collision integrals. Blocking gives rise to nonlinearities in the discretized radiation-transport equations, which we evolve implicitly in time. We employ parallelized Newton-Krylov methods to obtain a solution of these nonlinear, implicit equations. Our second major extension to the ZEUS algorithm is inclusion of an electron conservation equation, which describes evolution of electron-number density in the hydrodynamic flow. This permits following the effects of deleptonization in a stellar core. In our third extension, we have modified the hydrodynamics algorithm to accommodate realistic, complex equations of state, including those having non-convex behavior. In this paper, >... <abstract continues>
△ Less
Submitted 12 July, 2006;
originally announced July 2006.
-
Multigroup Models of the Convective Epoch in Core Collapse Supernovae
Authors:
F. Douglas Swesty,
Eric S. Myra
Abstract:
Understanding the explosion mechanism of core collapse supernovae is a problem that has plagued nuclear astrophysicists since the first computational models of this phenomenon were carried out in the 1960s. Our current theories of this violent phenomenon center around multi-dimensional effects involving radiation-hydrodynamic flows of hot, dense matter and neutrinos. Modeling these multi-dimensi…
▽ More
Understanding the explosion mechanism of core collapse supernovae is a problem that has plagued nuclear astrophysicists since the first computational models of this phenomenon were carried out in the 1960s. Our current theories of this violent phenomenon center around multi-dimensional effects involving radiation-hydrodynamic flows of hot, dense matter and neutrinos. Modeling these multi-dimensional radiative flows presents a computational challenge that will continue to stress high-performance computing beyond the teraflop to the petaflop level. In this paper we describe a few of the scientific discoveries that we have made via terascale computational simulations of supernovae under the auspices of the SciDAC-funded Terascale Supernova Initiative.
△ Less
Submitted 12 July, 2005;
originally announced July 2005.
-
Advances in Multi-Dimensional Simulation of Core-Collapse Supernovae
Authors:
F. Douglas Swesty,
Eric S. Myra
Abstract:
We discuss recent advances in the radiative-hydrodynamic modeling of core collapse supernovae in multi-dimensions. A number of earlier attempts at fully radiation-hydrodynamic models utilized either the grey approximation to describe the neutrino distribution or utilized more sophisticated multigroup transport methods restricted to radial rays. In both cases these models have also neglected the…
▽ More
We discuss recent advances in the radiative-hydrodynamic modeling of core collapse supernovae in multi-dimensions. A number of earlier attempts at fully radiation-hydrodynamic models utilized either the grey approximation to describe the neutrino distribution or utilized more sophisticated multigroup transport methods restricted to radial rays. In both cases these models have also neglected the O(v/c) terms that couple the radiation and matter strongly in the optically thick regions of the collapsed core. In this paper we present some recent advances that resolve some shortcomings of earlier models.
△ Less
Submitted 8 June, 2005;
originally announced June 2005.
-
Numerical Models of Binary Neutron Star System Mergers. I.: Numerical Methods and Equilibrium Data for Newtonian Models
Authors:
F. Douglas Swesty,
Edward Y. M. Wang,
Alan C. Calder
Abstract:
The numerical modeling of binary neutron star mergers has become a subject of much interest in recent years. While a full and accurate model of this phenomenon would require the evolution of the equations of relativistic hydrodynamics along with the Einstein field equations, a qualitative study of the early stages on inspiral can be accomplished by either Newtonian or post-Newtonian models, whic…
▽ More
The numerical modeling of binary neutron star mergers has become a subject of much interest in recent years. While a full and accurate model of this phenomenon would require the evolution of the equations of relativistic hydrodynamics along with the Einstein field equations, a qualitative study of the early stages on inspiral can be accomplished by either Newtonian or post-Newtonian models, which are more tractable. In this paper we offer a comparison of results from both rotating and non-rotating (inertial) frame Newtonian calculations. We find that the rotating frame calculations offer significantly improved accuracy as compared with the inertial frame models. Furthermore, we show that inertial frame models exhibit significant and erroneous angular momentum loss during the simulations that leads to an unphysical inspiral of the two neutron stars. We also examine the dependence of the models on initial conditions by considering initial configurations that consist of spherical neutron stars as well as stars that are in equilibrium and which are tidally distorted. We compare our models those of Rasio & Shapiro (1992,1994a) and New & Tohline (1997). Finally, we investigate the use of the isolated star approximation for the construction of initial data.
△ Less
Submitted 10 November, 1999;
originally announced November 1999.
-
Numerical Models of Newtonian and Post-Newtonian Binary Neutron Star Mergers
Authors:
Edward Y. M. Wang,
F. Douglas Swesty,
Alan C. Calder
Abstract:
This article describes a comparison of two calculations of the merger of a binary neutron star (NS) system which is initially within the tidal instability as described by Rasio and Shapiro. The same initial data is used with one simulation involving a purely Newtonian evolution of the Euler equations for compressible fluids and another similarly evolved except there is an inclusion of a gravitat…
▽ More
This article describes a comparison of two calculations of the merger of a binary neutron star (NS) system which is initially within the tidal instability as described by Rasio and Shapiro. The same initial data is used with one simulation involving a purely Newtonian evolution of the Euler equations for compressible fluids and another similarly evolved except there is an inclusion of a gravitational radiation reaction (GRR) term at the 2.5 Post-Newtonian (PN) order as prescribed by Blanchet, Damour, and Schafer. The inclusion of GRR is to allow an approximation of the full relativistic effect which forces the inspiral of binary systems. The initial data is identical at the start of each evolution and only the inclusion of the 2.5PN term differs in the evolutions. We chose two co-rotating, gamma=2 polytropic stars with masses 1.4M_Solar, radii R=9.56km and central densities of 2.5E15 g/cm3. The initial binary separation is 2.9R, inside the region where the dynamical tidal instability has been shown to cause the merger of the two stars. Comparisons between measured quantities will indicate a substantial difference between the two evolutions. It will be shown that the effect of GRR on the dynamics of the merger is significant.
△ Less
Submitted 1 June, 1998;
originally announced June 1998.
-
Numerical Methods for Modeling Binary Neutron Star Systems
Authors:
Alan C. Calder,
F. Douglas Swesty,
Edward Y. M. Wang
Abstract:
We present initial results of our study of numerical methods for modeling neutron star mergers (NSMs) with simulations that perform the full hydrodynamic evolution required to capture tidal effects, particularly in the last several orbits. Our simulations evolve the Euler equations using a modification of the ZEUS-2D algorithm (Stone and Norman 1992). We describe some of the difficulties of mode…
▽ More
We present initial results of our study of numerical methods for modeling neutron star mergers (NSMs) with simulations that perform the full hydrodynamic evolution required to capture tidal effects, particularly in the last several orbits. Our simulations evolve the Euler equations using a modification of the ZEUS-2D algorithm (Stone and Norman 1992). We describe some of the difficulties of modeling NSMs and our approaches to these difficulties, and we discuss the motivation for the choice of performing simulations in a co-rotating reference frame. Our results establish what effects the choices of gravity coupling and reference frame have on the numerical accuracy of the simulation.
△ Less
Submitted 1 June, 1998;
originally announced June 1998.
-
Gray Models of convection in core collapse supernovae
Authors:
F. Douglas Swesty
Abstract:
One of the major difficulties encountered in modeling core collapse supernovae is obtaining an accurate description of the transport of neutrinos through the collapsed stellar core. The behavior of the neutrino distribution function transitions from an LTE distribution in the center of the core to a non-LTE distribution in the outer regions of the core. One method that has been recently employed…
▽ More
One of the major difficulties encountered in modeling core collapse supernovae is obtaining an accurate description of the transport of neutrinos through the collapsed stellar core. The behavior of the neutrino distribution function transitions from an LTE distribution in the center of the core to a non-LTE distribution in the outer regions of the core. One method that has been recently employed in order to model the flow of neutrinos in 2-D models is the gray approximation. This approximation assumes that the neutrino distribution can be described by a function that is parameterized in terms of a neutrino temperature and a neutrino chemical potential. However, these parameters must be assumed. Furthermore, the parameters will also differ between the LTE and NLTE regions. Additionally, within the gray approximation the location at which the neutrino distribution function transitions from LTE to NLTE must be assumed. By considering a series of models where the LTE/NLTE decoupling point is varied we show that the outcome of the numerical models is critically sensitive to the choice of the decoupling point when the gray approximation is employed. We also examine the effects of the neutrino--electron scattering (NES) rate which is difficult to correctly formulate within the gray approximation. We show that NES has a dramatic affect on the the overall neutrino heating rate and the dynamics of the model. This result conflicts with the results of high resolution multi-group models which model neutrino transport without employing the gray approximation.
△ Less
Submitted 24 May, 1998;
originally announced May 1998.
-
Newtonian and post-Newtonian binary neutron star mergers
Authors:
Hisa-aki Shinkai,
Wai-Mo Suen,
F. Douglas Swesty,
Malcolm Tobias,
Edward Y. M. Wang,
Clifford M. Will
Abstract:
We present two of our efforts directed toward the numerical analysis of neutron star mergers, which are the most plausible sources for gravitational wave detectors that should begin operating in the near future. First we present Newtonian 3D simulations including radiation reaction (2.5PN) effects. We discuss the gravitational wave signals and luminosity from the merger with/without radiation re…
▽ More
We present two of our efforts directed toward the numerical analysis of neutron star mergers, which are the most plausible sources for gravitational wave detectors that should begin operating in the near future. First we present Newtonian 3D simulations including radiation reaction (2.5PN) effects. We discuss the gravitational wave signals and luminosity from the merger with/without radiation reaction effects. Second we present the matching problem between post-Newtonian formulations and general relativity in numerical treatments. We prepare a spherical, static neutron star in a post-Newtonian matched spacetime, and find that discontinuities at the matching surface become smoothed out during fully relativistic evolution if we use a proper slicing condition.
△ Less
Submitted 14 October, 1997;
originally announced October 1997.
