-
AsterX: a new open-source GPU-accelerated GRMHD code for dynamical spacetimes
Authors:
Jay V. Kalinani,
Liwei Ji,
Lorenzo Ennoggi,
Federico G. Lopez Armengol,
Lucas Timotheo Sanches,
Bing-Jyun Tsao,
Steven R Brandt,
Manuela Campanelli,
Riccardo Ciolfi,
Bruno Giacomazzo,
Roland Haas,
Erik Schnetter,
Yosef Zlochower
Abstract:
We present AsterX, a novel open-source, GPU-accelerated, fully general relativistic magnetohydrodynamic (GRMHD) code designed for dynamic spacetimes in 3D Cartesian coordinates, and tailored for exascale computing. We utilize block-structured adaptive mesh refinement (AMR) through CarpetX, the new driver for the Einstein Toolkit, which is built on AMReX, a software framework for massively parallel…
▽ More
We present AsterX, a novel open-source, GPU-accelerated, fully general relativistic magnetohydrodynamic (GRMHD) code designed for dynamic spacetimes in 3D Cartesian coordinates, and tailored for exascale computing. We utilize block-structured adaptive mesh refinement (AMR) through CarpetX, the new driver for the Einstein Toolkit, which is built on AMReX, a software framework for massively parallel applications. AsterX employs the Valencia formulation for GRMHD, coupled with the 'Z4c' formalism for spacetime evolution, while incorporating high resolution shock capturing schemes to accurately handle the hydrodynamics. AsterX has undergone rigorous testing in both static and dynamic spacetime, demonstrating remarkable accuracy and agreement with other codes in literature. Benchmarking the code through scaling tests on OLCF's Frontier supercomputer, we demonstrate a weak scaling efficiency of about 67%-77% on 4096 nodes compared to an 8-node performance.
△ Less
Submitted 17 June, 2024;
originally announced June 2024.
-
Black Hole - Neutron Star Binary Mergers: The Impact of Stellar Compactness
Authors:
Bing-Jyun Tsao,
Bhavesh Khamesra,
Miguel Gracia-Linares,
Pablo Laguna
Abstract:
Recent gravitational wave observations include possible detections of black hole - neutron star binary mergers. As with binary black hole mergers, numerical simulations help characterize the sources. For binary systems with neutron star components, the simulations help to predict the imprint of tidal deformations and disruptions on the gravitational wave signals. In a previous study, we investigat…
▽ More
Recent gravitational wave observations include possible detections of black hole - neutron star binary mergers. As with binary black hole mergers, numerical simulations help characterize the sources. For binary systems with neutron star components, the simulations help to predict the imprint of tidal deformations and disruptions on the gravitational wave signals. In a previous study, we investigated how the mass of the black hole has an impact on the disruption of the neutron star and, as a consequence, on the shape of the gravitational waves emitted. We extend these results to study the effects of varying the compactness of the neutron star. We consider neutron star compactness in the 0.123 to 0.2 range for binaries with mass ratios of 3 and 5. As the compactness and the mass ratio increase, the binary system behaves during the late inspiral and merger more like a black hole binary. For the case with the highest mass ratio and most compact neutron star, the gravitational waves emitted, in terms of mismatches, are almost indistinguishable from those by a binary black hole. The disruption of the star significantly suppresses the kicks on the final black hole. The disruption also affects, although not dramatically, the spin of the final black hole. Lastly, for neutron stars with low compactness, the quasi-normal ringing of the black hole after the merger does not show a clean quasi-normal ringing because of the late accretion of debris from the neutron star.
△ Less
Submitted 15 April, 2024;
originally announced April 2024.
-
Mayawaves: Python Library for Interacting with the Einstein Toolkit and the MAYA Catalog
Authors:
Deborah Ferguson,
Surendra Anne,
Miguel Gracia-Linares,
Hector Iglesias,
Aasim Jan,
Erick Martinez,
Lu Lu,
Filippo Meoni,
Ryan Nowicki,
Max L. Trostel,
Bing-Jyun Tsao,
Finny Valorz
Abstract:
Numerical relativity simulations are crucial for studying black holes and have been instrumental in the detection of gravitational waves by the LVK. However, these simulations produce vast amounts of data that must be processed in order to perform studies, create models, and use them with gravitational wave detection pipelines. This paper introduces mayawaves, an open-source python library for pro…
▽ More
Numerical relativity simulations are crucial for studying black holes and have been instrumental in the detection of gravitational waves by the LVK. However, these simulations produce vast amounts of data that must be processed in order to perform studies, create models, and use them with gravitational wave detection pipelines. This paper introduces mayawaves, an open-source python library for processing, studying, and exporting numerical relativity simulations performed using the Einstein Toolkit and MAYA. Mayawaves streamlines the process of analyzing simulations with an intuitive interface, greatly reducing the learning curve for numerical relativity.
△ Less
Submitted 1 September, 2023;
originally announced September 2023.
-
Second MAYA Catalog of Binary Black Hole Numerical Relativity Waveforms
Authors:
Deborah Ferguson,
Evelyn Allsup,
Surendra Anne,
Galina Bouyer,
Miguel Gracia-Linares,
Hector Iglesias,
Aasim Jan,
Pablo Laguna,
Jacob Lange,
Erick Martinez,
Filippo Meoni,
Ryan Nowicki,
Deirdre Shoemaker,
Blake Steadham,
Max L. Trostel,
Bing-Jyun Tsao,
Finny Valorz
Abstract:
Numerical relativity waveforms are a critical resource in the quest to deepen our understanding of the dynamics of, and gravitational waves emitted from, merging binary systems. We present 181 new numerical relativity simulations as the second MAYA catalog of binary black hole waveforms (a sequel to the Georgia Tech waveform catalog). Most importantly, these include 55 high mass ratio (q >= 4), 48…
▽ More
Numerical relativity waveforms are a critical resource in the quest to deepen our understanding of the dynamics of, and gravitational waves emitted from, merging binary systems. We present 181 new numerical relativity simulations as the second MAYA catalog of binary black hole waveforms (a sequel to the Georgia Tech waveform catalog). Most importantly, these include 55 high mass ratio (q >= 4), 48 precessing, and 92 eccentric (e > 0.01) simulations, including 7 simulations which are both eccentric and precessing. With these significant additions, this new catalog fills in considerable gaps in existing public numerical relativity waveform catalogs. The waveforms presented in this catalog are shown to be convergent and are consistent with current gravitational wave models. They are available to the public at https://cgp.ph.utexas.edu/waveform.
△ Less
Submitted 13 September, 2023; v1 submitted 1 September, 2023;
originally announced September 2023.
-
Modeling Solids in Nuclear Astrophysics with Smoothed Particle Hydrodynamics
Authors:
Irina Sagert,
Oleg Korobkin,
Ingo Tews,
Bing-Jyun Tsao,
Hyun Lim,
Michael J. Falato,
Julien Loiseau
Abstract:
Smoothed Particle Hydrodynamics (SPH) is a frequently applied tool in computational astrophysics to solve the fluid dynamics equations governing the systems under study. For some problems, for example when involving asteroids and asteroid impacts, the additional inclusion of material strength is necessary in order to accurately describe the dynamics. In compact stars, that is white dwarfs and neut…
▽ More
Smoothed Particle Hydrodynamics (SPH) is a frequently applied tool in computational astrophysics to solve the fluid dynamics equations governing the systems under study. For some problems, for example when involving asteroids and asteroid impacts, the additional inclusion of material strength is necessary in order to accurately describe the dynamics. In compact stars, that is white dwarfs and neutron stars, solid components are also present. Neutron stars have a solid crust which is the strongest material known in nature. However, their dynamical evolution, when modeled via SPH or other computational fluid dynamics codes, is usually described as a purely fluid dynamics problem. Here, we present the first 3D simulations of neutron-star crustal toroidal oscillations including material strength with the Los Alamos National Laboratory SPH code FleCSPH. In the first half of the paper, we present the numerical implementation of solid material modeling together with standard tests. The second half is on the simulation of crustal oscillations in the fundamental toroidal mode. Here, we dedicate a large fraction of the paper to approaches which can suppress numerical noise in the solid. If not minimized, the latter can dominate the crustal motion in the simulations.
△ Less
Submitted 17 November, 2023; v1 submitted 3 November, 2022;
originally announced November 2022.
-
Modeling Neutron Star Oscillations in a Fixed General Relativistic Background Including Solid Crust Dynamics
Authors:
Bing-Jyun Tsao,
Irina Sagert,
Oleg Korobkin,
Ingo Tews,
Hyun Lim,
Gary Dilts,
Julien Loiseau
Abstract:
Measurements of the gravitational-wave signals from neutron star mergers allow scientists to learn about the interior of neutron stars and the properties of dense nuclear matter. The study of neutron star mergers is usually performed with computational fluid dynamics codes, mostly in Eulerian but also in Lagrangian formulation such as smoothed particle hydrodynamics (SPH). Codes include our best k…
▽ More
Measurements of the gravitational-wave signals from neutron star mergers allow scientists to learn about the interior of neutron stars and the properties of dense nuclear matter. The study of neutron star mergers is usually performed with computational fluid dynamics codes, mostly in Eulerian but also in Lagrangian formulation such as smoothed particle hydrodynamics (SPH). Codes include our best knowledge of nuclear matter in the form of an equation of state as well as effects of general relativity (GR). However, one important aspect of neutron stars is usually ignored: the solid nature of their crust. The solid matter in the crust is the strongest material known in nature which could lead to a multitude of possible observational effects that have not been studied in dynamical simulations yet. The crust could change the way a neutron star deforms during a merger, leaving an imprint in the gravitational wave signal. It could even shatter during the inspiral, producing a potentially observable electromagnetic signal. Here, we present a first study of the dynamical behavior of neutron stars with a solid crust and fixed GR background with FleCSPH. FleCSPH is a general-purpose SPH code, developed at Los Alamos National Laboratory. It features an efficient algorithm for gravitational interactions via the Fast Multipole Method, which, together with the implemented nuclear equation of state, makes it appropriate for astrophysical applications. The solid material dynamics is described via the elastic-perfectly plastic model with maximum-strain breaking. Despite its simplicity, the model reproduces the stress-strain curve of crustal material as extracted from microphysical simulations very well. We present first tests of our implementation via simulations of neutron star oscillations and give an outlook on our study of the dynamical behavior of the solid crust in neutron star merger events.
△ Less
Submitted 15 July, 2021;
originally announced July 2021.
-
Conservation of Angular Momentum in the Fast Multipole Method
Authors:
Oleg Korobkin,
Hyun Lim,
Irina Sagert,
Julien Loiseau,
Christopher Mauney,
M. Alexander R. Kaltenborn,
Bing-Jyun Tsao,
Wesley P. Even
Abstract:
Smoothed particle hydrodynamics (SPH) is positioned as having ideal conservation properties. When properly implemented, conservation of total mass, energy, and both linear and angular momentum is guaranteed exactly, up to machine precision. This is particularly important for some applications in computational astrophysics, such as binary dynamics, mergers, and accretion of compact objects (neutron…
▽ More
Smoothed particle hydrodynamics (SPH) is positioned as having ideal conservation properties. When properly implemented, conservation of total mass, energy, and both linear and angular momentum is guaranteed exactly, up to machine precision. This is particularly important for some applications in computational astrophysics, such as binary dynamics, mergers, and accretion of compact objects (neutron stars, black holes, and white dwarfs). However, in astrophysical applications that require the inclusion of gravity, calculating pairwise particle interactions becomes prohibitively expensive. In the Fast Multipole Method (FMM), they are, therefore, replaced with symmetric interactions between distant clusters of particles (contained in the tree nodes) Although such an algorithm is linear momentum-conserving, it introduces spurious torques that violate conservation of angular momentum. We present a modification of FMM that is free of spurious torques and conserves angular momentum explicitly. The new method has practically no computational overhead compared to the standard FMM.
△ Less
Submitted 15 July, 2021;
originally announced July 2021.
-
Hamilton-Jacobi hydrodynamics of pulsating relativistic stars
Authors:
John Ryan Westernacher-Schneider,
Charalampos Markakis,
Bing Jyun Tsao
Abstract:
The dynamics of self-gravitating fluid bodies is described by the Euler-Einstein system of partial differential equations. The break-down of well-posedness on the fluid-vacuum interface remains a challenging open problem, which is manifested in simulations of oscillating or inspiraling binary neutron-stars. We formulate and implement a well-posed canonical hydrodynamic scheme, suitable for neutron…
▽ More
The dynamics of self-gravitating fluid bodies is described by the Euler-Einstein system of partial differential equations. The break-down of well-posedness on the fluid-vacuum interface remains a challenging open problem, which is manifested in simulations of oscillating or inspiraling binary neutron-stars. We formulate and implement a well-posed canonical hydrodynamic scheme, suitable for neutron-star simulations in numerical general relativity. The scheme uses a variational principle by Carter-Lichnerowicz stating that barotropic fluid motions are conformally geodesic and Helmholtz's third theorem stating that initially irrotational flows remain irrotational. We apply this scheme in 3+1 numerical general relativity to evolve the canonical momentum of a fluid element via the Hamilton-Jacobi equation. We explore a regularization scheme for the Euler equations, that uses a fiducial atmosphere in hydrostatic equilibrium and allows the pressure to vanish, while preserving strong hyperbolicity on the vacuum boundary. The new regularization scheme resolves a larger number of radial oscillation modes compared to standard, non-equilibrium atmosphere treatments.
△ Less
Submitted 16 July, 2020; v1 submitted 8 December, 2019;
originally announced December 2019.
