-
Computational Fluid Dynamics with the Coupled Discrete Unified Gas Kinetic Scheme (CDUGKS)
Authors:
Alvaro Zamora,
Elliott Slaughter,
Tom Abel
Abstract:
In this paper, we introduce our open source implementation of the Coupled Discrete Unified Gas Kinetic Scheme (CDUGKS) of https://journals.aps.org/pre/abstract/10.1103/PhysRevE.98.053310, a phase space scheme capable of handling a wide range of flow regimes. We demonstrate its performance on several problems including a number of well known test problems from the astrophysical fluid dynamics liter…
▽ More
In this paper, we introduce our open source implementation of the Coupled Discrete Unified Gas Kinetic Scheme (CDUGKS) of https://journals.aps.org/pre/abstract/10.1103/PhysRevE.98.053310, a phase space scheme capable of handling a wide range of flow regimes. We demonstrate its performance on several problems including a number of well known test problems from the astrophysical fluid dynamics literature such as the 1D Sod shock tube, 2D Kelvin-Helmholtz instability, 1D thermoacoustic wave, a triangular Gresho vortex, a sine wave velocity perturbation. For these problems, we show that the code can simulate flows ranging from the inviscid/Eulerian regime to the free-streaming regime, capturing shocks and emergent diffusive processes in the appropriate regimes. We also use a variety of Prandtl numbers to demonstrate the scheme's ability to simulate different thermal conductivities at fixed viscosity. The scheme is second-order accurate in space and time and, unlike many solvers, uses a time step that is independent of the mean free path of the gas. Our code (MP-CDUGKS) is public under a CC0 1.0 Universal license and is available on https://github.com/alvarozamora/CDUGKS
△ Less
Submitted 24 April, 2023; v1 submitted 18 August, 2022;
originally announced August 2022.
-
Scaling and Acceleration of Three-dimensional Structure Determination for Single-Particle Imaging Experiments with SpiniFEL
Authors:
Hsing-Yin Chang,
Elliott Slaughter,
Seema Mirchandaney,
Jeffrey Donatelli,
Chun Hong Yoon
Abstract:
The Linac Coherent Light Source (LCLS) is an X- ray free electron laser (XFEL) facility enabling the study of the structure and dynamics of single macromolecules. A major upgrade will bring the repetition rate of the X-ray source from 120 to 1 million pulses per second. Exascale high performance computing (HPC) capabilities will be required to process the corresponding data rates. We present Spini…
▽ More
The Linac Coherent Light Source (LCLS) is an X- ray free electron laser (XFEL) facility enabling the study of the structure and dynamics of single macromolecules. A major upgrade will bring the repetition rate of the X-ray source from 120 to 1 million pulses per second. Exascale high performance computing (HPC) capabilities will be required to process the corresponding data rates. We present SpiniFEL, an application used for structure determination of proteins from single-particle imaging (SPI) experiments. An emerging technique for imaging individual proteins and other large molecular complexes by outrunning radiation damage, SPI breaks free from the need for crystallization (which is difficult for some proteins) and allows for imaging molecular dynamics at near ambient conditions. SpiniFEL is being developed to run on supercomputers in near real-time while an experiment is taking place, so that the feedback about the data can guide the data collection strategy. We describe here how we reformulated the mathematical framework for parallelizable implementation and accelerated the most compute intensive parts of the application. We also describe the use of Pygion, a Python interface for the Legion task-based programming model and compare to our existing MPI+GPU implementation.
△ Less
Submitted 11 September, 2021;
originally announced September 2021.
-
MOOSE: Enabling Massively Parallel Multiphysics Simulation
Authors:
Cody J. Permann,
Derek R. Gaston,
David Andrs,
Robert W. Carlsen,
Fande Kong,
Alexander D. Lindsay,
Jason M. Miller,
John W. Peterson,
Andrew E. Slaughter,
Roy H. Stogner,
Richard C. Martineau
Abstract:
Harnessing modern parallel computing resources to achieve complex multi-physics simulations is a daunting task. The Multiphysics Object Oriented Simulation Environment (MOOSE) aims to enable such development by providing simplified interfaces for specification of partial differential equations, boundary conditions, material properties, and all aspects of a simulation without the need to consider t…
▽ More
Harnessing modern parallel computing resources to achieve complex multi-physics simulations is a daunting task. The Multiphysics Object Oriented Simulation Environment (MOOSE) aims to enable such development by providing simplified interfaces for specification of partial differential equations, boundary conditions, material properties, and all aspects of a simulation without the need to consider the parallel, adaptive, nonlinear, finite-element solve that is handled internally. Through the use of interfaces and inheritance, each portion of a simulation becomes reusable and composable in a manner that allows disparate research groups to share code and create an ecosystem of growing capability that lowers the barrier for the creation of multiphysics simulation codes. Included within the framework is a unique capability for building multiscale, multiphysics simulations through simultaneous execution of multiple sub-applications with data transfers between the scales. Other capabilities include automatic differentiation, scaling to a large number of processors, hybrid parallelism, and mesh adaptivity. To date, MOOSE-based applications have been created in areas of science and engineering such as nuclear physics, geothermal science, magneto-hydrodynamics, seismic events, compressible and incompressible fluid flow, microstructure evolution, and advanced manufacturing processes.
△ Less
Submitted 11 November, 2019;
originally announced November 2019.
