-
AbacusSummit: A Massive Set of High-Accuracy, High-Resolution $N$-Body Simulations
Authors:
Nina A. Maksimova,
Lehman H. Garrison,
Daniel J. Eisenstein,
Boryana Hadzhiyska,
Sownak Bose,
Thomas P. Satterthwaite
Abstract:
We present the public data release of the AbacusSummit cosmological $N$-body simulation suite, produced with the $\texttt{Abacus}$ $N$-body code on the Summit supercomputer of the Oak Ridge Leadership Computing Facility. $\texttt{Abacus}$ achieves $\mathcal{O}\left(10^{-5}\right)$ median fractional force error at superlative speeds, calculating 70M particle updates per second per node at early tim…
▽ More
We present the public data release of the AbacusSummit cosmological $N$-body simulation suite, produced with the $\texttt{Abacus}$ $N$-body code on the Summit supercomputer of the Oak Ridge Leadership Computing Facility. $\texttt{Abacus}$ achieves $\mathcal{O}\left(10^{-5}\right)$ median fractional force error at superlative speeds, calculating 70M particle updates per second per node at early times, and 45M particle updates per second per node at late times. The simulation suite totals roughly 60 trillion particles, the core of which is a set of 139 simulations with particle mass $2\times10^{9}\,h^{-1}\mathrm{M}_\odot$ in box size $2\,h^{-1}\mathrm{Gpc}$. The suite spans 97 cosmological models, including Planck 2018, previous flagship simulation cosmologies, and a linear derivative and cosmic emulator grid. A sub-suite of 1883 boxes of size $500\,h^{-1}\mathrm{Mpc}$ is available for covariance estimation. AbacusSummit data products span 33 epochs from $z=8$ to $0.1$ and include lightcones, full particle snapshots, halo catalogs, and particle subsets sampled consistently across redshift. AbacusSummit is the largest high-accuracy cosmological $N$-body data set produced to date.
△ Less
Submitted 21 October, 2021;
originally announced October 2021.
-
The $\texttt{Abacus}$ Cosmological $N$-body Code
Authors:
Lehman H. Garrison,
Daniel J. Eisenstein,
Douglas Ferrer,
Nina A. Maksimova,
Philip A. Pinto
Abstract:
We present $\texttt{Abacus}$, a fast and accurate cosmological $N$-body code based on a new method for calculating the gravitational potential from a static multipole mesh. The method analytically separates the near- and far-field forces, reducing the former to direct $1/r^2$ summation and the latter to a discrete convolution over multipoles. The method achieves 70 million particle updates per sec…
▽ More
We present $\texttt{Abacus}$, a fast and accurate cosmological $N$-body code based on a new method for calculating the gravitational potential from a static multipole mesh. The method analytically separates the near- and far-field forces, reducing the former to direct $1/r^2$ summation and the latter to a discrete convolution over multipoles. The method achieves 70 million particle updates per second per node of the Summit supercomputer, while maintaining a median fractional force error of $10^{-5}$. We express the simulation time step as an event-driven "pipeline", incorporating asynchronous events such as completion of co-processor work, Input/Output, and network communication. $\texttt{Abacus}$ has been used to produce the largest suite of $N$-body simulations to date, the $\texttt{AbacusSummit}$ suite of 60 trillion particles (Maksimova et al., 2021), incorporating on-the-fly halo finding. $\texttt{Abacus}$ enables the production of mock catalogs of the volume and resolution required by the coming generation of cosmological surveys.
△ Less
Submitted 21 October, 2021;
originally announced October 2021.
-
Checkpointing with cp: the POSIX Shared Memory System
Authors:
Lehman H. Garrison,
Daniel J. Eisenstein,
Nina A. Maksimova
Abstract:
We present the checkpointing scheme of Abacus, an $N$-body simulation code that allocates all persistent state in POSIX shared memory, or ramdisk. Checkpointing becomes as simple as copying files from ramdisk to external storage. The main simulation executable is invoked once per time step, memory map** the input state, computing the output state directly into ramdisk, and unmap** the input st…
▽ More
We present the checkpointing scheme of Abacus, an $N$-body simulation code that allocates all persistent state in POSIX shared memory, or ramdisk. Checkpointing becomes as simple as copying files from ramdisk to external storage. The main simulation executable is invoked once per time step, memory map** the input state, computing the output state directly into ramdisk, and unmap** the input state. The main executable remains unaware of the concept of checkpointing, with the top-level driver code launching a file-system copy between executable invocations when a checkpoint is needed. Since the only information flow is through files on ramdisk, the checkpoint must be correct so long as the simulation is correct. However, we find that with multi-GB of state, there is a significant overhead to unmap** the shared memory. This can be partially mitigated with multithreading, but ultimately, we do not recommend shared memory for use with a large state.
△ Less
Submitted 25 February, 2021;
originally announced February 2021.
-
Gravitational Wave -- Gauge Field Dynamics
Authors:
R. R. Caldwell,
C. Devulder,
N. A. Maksimova
Abstract:
The dynamics of a gravitational wave propagating through a cosmic gauge field are dramatically different than in vacuum. We show that a gravitational wave acquires an effective mass, is birefringent, and its normal modes are a linear combination of gravitational waves and gauge field excitations, leading to the phenomenon of gravitational wave -- gauge field oscillations. These surprising results…
▽ More
The dynamics of a gravitational wave propagating through a cosmic gauge field are dramatically different than in vacuum. We show that a gravitational wave acquires an effective mass, is birefringent, and its normal modes are a linear combination of gravitational waves and gauge field excitations, leading to the phenomenon of gravitational wave -- gauge field oscillations. These surprising results provide insight into gravitational phenomena and may suggest new approaches to a theory of quantum gravity.
△ Less
Submitted 1 June, 2017;
originally announced June 2017.
-
Gravitational Wave - Gauge Field Oscillations
Authors:
R. R. Caldwell,
C. Devulder,
N. A. Maksimova
Abstract:
Gravitational waves propagating through a stationary gauge field transform into gauge field waves and back again. When multiple families of flavor-space locked gauge fields are present, the gravitational and gauge field waves exhibit novel dynamics. At high frequencies, the system behaves like coupled oscillators in which the gravitational wave is the central pacemaker. Due to energy conservation…
▽ More
Gravitational waves propagating through a stationary gauge field transform into gauge field waves and back again. When multiple families of flavor-space locked gauge fields are present, the gravitational and gauge field waves exhibit novel dynamics. At high frequencies, the system behaves like coupled oscillators in which the gravitational wave is the central pacemaker. Due to energy conservation and exchange among the oscillators, the wave amplitudes lie on a multidimensional sphere, reminiscent of neutrino flavor oscillations. This phenomenon has implications for cosmological scenarios based on flavor-space locked gauge fields.
△ Less
Submitted 1 June, 2017; v1 submitted 29 April, 2016;
originally announced April 2016.
-
Spectral Distortion in a Radially Inhomogeneous Cosmology
Authors:
R. R. Caldwell,
N. A. Maksimova
Abstract:
The spectral distortion of the cosmic microwave background blackbody spectrum in a radially inhomogeneous spacetime, designed to exactly reproduce a LambdaCDM expansion history along the past light cone, is shown to exceed the upper bound established by COBE-FIRAS by a factor of approximately 3700. This simple observational test helps uncover a slew of pathological features that lie hidden inside…
▽ More
The spectral distortion of the cosmic microwave background blackbody spectrum in a radially inhomogeneous spacetime, designed to exactly reproduce a LambdaCDM expansion history along the past light cone, is shown to exceed the upper bound established by COBE-FIRAS by a factor of approximately 3700. This simple observational test helps uncover a slew of pathological features that lie hidden inside the past light cone, including a radially contracting phase at decoupling and, if followed to its logical extreme, a naked singularity at the radially inhomogeneous Big Bang.
△ Less
Submitted 15 October, 2013; v1 submitted 17 September, 2013;
originally announced September 2013.
