-
Posterior exploration for computationally intensive forward models
Authors:
Mikkel B. Lykkegaard,
Colin Fox,
Dave Higdon,
C. Shane Reese,
J. David Moulton
Abstract:
In this chapter, we address the challenge of exploring the posterior distributions of Bayesian inverse problems with computationally intensive forward models. We consider various multivariate proposal distributions, and compare them with single-site Metropolis updates. We show how fast, approximate models can be leveraged to improve the MCMC sampling efficiency.
In this chapter, we address the challenge of exploring the posterior distributions of Bayesian inverse problems with computationally intensive forward models. We consider various multivariate proposal distributions, and compare them with single-site Metropolis updates. We show how fast, approximate models can be leveraged to improve the MCMC sampling efficiency.
△ Less
Submitted 1 May, 2024;
originally announced May 2024.
-
A cast of thousands: How the IDEAS Productivity project has advanced software productivity and sustainability
Authors:
Lois Curfman McInnes,
Michael Heroux,
David E. Bernholdt,
Anshu Dubey,
Elsa Gonsiorowski,
Rinku Gupta,
Osni Marques,
J. David Moulton,
Hai Ah Nam,
Boyana Norris,
Elaine M. Raybourn,
Jim Willenbring,
Ann Almgren,
Ross Bartlett,
Kita Cranfill,
Stephen Fickas,
Don Frederick,
William Godoy,
Patricia Grubel,
Rebecca Hartman-Baker,
Axel Huebl,
Rose Lynch,
Addi Malviya Thakur,
Reed Milewicz,
Mark C. Miller
, et al. (9 additional authors not shown)
Abstract:
Computational and data-enabled science and engineering are revolutionizing advances throughout science and society, at all scales of computing. For example, teams in the U.S. DOE Exascale Computing Project have been tackling new frontiers in modeling, simulation, and analysis by exploiting unprecedented exascale computing capabilities-building an advanced software ecosystem that supports next-gene…
▽ More
Computational and data-enabled science and engineering are revolutionizing advances throughout science and society, at all scales of computing. For example, teams in the U.S. DOE Exascale Computing Project have been tackling new frontiers in modeling, simulation, and analysis by exploiting unprecedented exascale computing capabilities-building an advanced software ecosystem that supports next-generation applications and addresses disruptive changes in computer architectures. However, concerns are growing about the productivity of the developers of scientific software, its sustainability, and the trustworthiness of the results that it produces. Members of the IDEAS project serve as catalysts to address these challenges through fostering software communities, incubating and curating methodologies and resources, and disseminating knowledge to advance developer productivity and software sustainability. This paper discusses how these synergistic activities are advancing scientific discovery-mitigating technical risks by building a firmer foundation for reproducible, sustainable science at all scales of computing, from laptops to clusters to exascale and beyond.
△ Less
Submitted 16 February, 2024; v1 submitted 3 November, 2023;
originally announced November 2023.
-
Flow and Transport in Three-Dimensional Discrete Fracture Matrix Models using Mimetic Finite Difference on a Conforming Multi-Dimensional Mesh
Authors:
Jeffrey D. Hyman,
Matthew R. Sweeney,
Carl W. Gable,
Daniil Svyatsky,
Konstantin Lipnikov,
J. David Moulton
Abstract:
We present a comprehensive workflow to simulate single-phase flow and transport in fractured porous media using the discrete fracture matrix approach. The workflow has three primary parts: (1) a method for conforming mesh generation of and around a three-dimensional fracture network, (2) the discretization of the governing equations using a second-order mimetic finite difference method, and (3) im…
▽ More
We present a comprehensive workflow to simulate single-phase flow and transport in fractured porous media using the discrete fracture matrix approach. The workflow has three primary parts: (1) a method for conforming mesh generation of and around a three-dimensional fracture network, (2) the discretization of the governing equations using a second-order mimetic finite difference method, and (3) implementation of numerical methods for high-performance computing environments. A method to create a conforming Delaunay tetrahedralization of the volume surrounding the fracture network, where the triangular cells of the fracture mesh are faces in the volume mesh, that addresses pathological cases which commonly arise and degrade mesh quality is also provided. Our open-source subsurface simulator uses a hierarchy of process kernels (one kernel per physical process) that allows for both strong and weak coupling of the fracture and matrix domains. We provide verification tests based on analytic solutions for flow and transport, as well as numerical convergence. We also provide multiple expositions of the method in complex fracture networks. In the first example, we demonstrate that the method is robust by considering two scenarios where the fracture network acts as a barrier to flow, as the primary pathway, or offers the same resistance as the surrounding matrix. In the second test, flow and transport through a three-dimensional stochastically generated network containing 257 fractures is presented.
△ Less
Submitted 20 December, 2021;
originally announced December 2021.
-
Scaling Structured Multigrid to 500K+ Cores through Coarse-Grid Redistribution
Authors:
Andrew Reisner,
Luke N. Olson,
J. David Moulton
Abstract:
The efficient solution of sparse, linear systems resulting from the discretization of partial differential equations is crucial to the performance of many physics-based simulations. The algorithmic optimality of multilevel approaches for common discretizations makes them a good candidate for an efficient parallel solver. Yet, modern architectures for high-performance computing systems continue to…
▽ More
The efficient solution of sparse, linear systems resulting from the discretization of partial differential equations is crucial to the performance of many physics-based simulations. The algorithmic optimality of multilevel approaches for common discretizations makes them a good candidate for an efficient parallel solver. Yet, modern architectures for high-performance computing systems continue to challenge the parallel scalability of multilevel solvers. While algebraic multigrid methods are robust for solving a variety of problems, the increasing importance of data locality and cost of data movement in modern architectures motivates the need to carefully exploit structure in the problem.
Robust logically structured variational multigrid methods, such as Black Box Multigrid (BoxMG), maintain structure throughout the multigrid hierarchy. This avoids indirection and increased coarse-grid communication costs typical in parallel algebraic multigrid. Nevertheless, the parallel scalability of structured multigrid is challenged by coarse-grid problems where the overhead in communication dominates computation. In this paper, an algorithm is introduced for redistributing coarse-grid problems through incremental agglomeration. Guided by a predictive performance model, this algorithm provides robust redistribution decisions for structured multilevel solvers.
A two-dimensional diffusion problem is used to demonstrate the significant gain in performance of this algorithm over the previous approach that used agglomeration to one processor. In addition, the parallel scalability of this approach is demonstrated on two large-scale computing systems, with solves on up to 500K+ cores.
△ Less
Submitted 6 March, 2018;
originally announced March 2018.
-
xSDK Foundations: Toward an Extreme-scale Scientific Software Development Kit
Authors:
Roscoe Bartlett,
Irina Demeshko,
Todd Gamblin,
Glenn Hammond,
Michael Heroux,
Jeffrey Johnson,
Alicia Klinvex,
Xiaoye Li,
Lois Curfman McInnes,
J. David Moulton,
Daniel Osei-Kuffuor,
Jason Sarich,
Barry Smith,
Jim Willenbring,
Ulrike Meier Yang
Abstract:
Extreme-scale computational science increasingly demands multiscale and multiphysics formulations. Combining software developed by independent groups is imperative: no single team has resources for all predictive science and decision support capabilities. Scientific libraries provide high-quality, reusable software components for constructing applications with improved robustness and portability.…
▽ More
Extreme-scale computational science increasingly demands multiscale and multiphysics formulations. Combining software developed by independent groups is imperative: no single team has resources for all predictive science and decision support capabilities. Scientific libraries provide high-quality, reusable software components for constructing applications with improved robustness and portability. However, without coordination, many libraries cannot be easily composed. Namespace collisions, inconsistent arguments, lack of third-party software versioning, and additional difficulties make composition costly.
The Extreme-scale Scientific Software Development Kit (xSDK) defines community policies to improve code quality and compatibility across independently developed packages (hypre, PETSc, SuperLU, Trilinos, and Alquimia) and provides a foundation for addressing broader issues in software interoperability, performance portability, and sustainability. The xSDK provides turnkey installation of member software and seamless combination of aggregate capabilities, and it marks first steps toward extreme-scale scientific software ecosystems from which future applications can be composed rapidly with assured quality and scalability.
△ Less
Submitted 27 February, 2017;
originally announced February 2017.
-
Convergence analysis of the mimetic finite difference method for elliptic problems with staggered discretization of the diffusion coefficients
Authors:
G. Manzini,
K. Lipnikov,
J. D. Moulton,
M. Shashkov
Abstract:
We study the convergence of the new family of mimetic finite difference schemes for linear diffusion problems recently proposed in [38]. In contrast to the conventional approach, the diffusion coefficient enters both the primary mimetic operator, i.e., the discrete divergence, and the inner product in the space of gradients. The diffusion coefficient is therefore evaluated on different mesh locati…
▽ More
We study the convergence of the new family of mimetic finite difference schemes for linear diffusion problems recently proposed in [38]. In contrast to the conventional approach, the diffusion coefficient enters both the primary mimetic operator, i.e., the discrete divergence, and the inner product in the space of gradients. The diffusion coefficient is therefore evaluated on different mesh locations, i.e., inside mesh cells and on mesh faces. Such a staggered discretization may provide the exibility necessary for future development of efficient numerical schemes for nonlinear problems, especially for problems with degenerate coefficients. These new mimetic schemes preserve symmetry and positive-definiteness of the continuum problem, which allow us to use efficient algebraic solvers such as the preconditioned Conjugate Gradient method. We show that these schemes are inf-sup stable and establish a priori error estimates for the approximation of the scalar and vector solution fields. Numerical examples confirm the convergence analysis and the effectiveness of the method in providing accurate approximations.
△ Less
Submitted 6 December, 2016;
originally announced December 2016.
-
Algebraic Multigrid Preconditioners for Multiphase Flow in Porous Media
Authors:
Quan M. Bui,
Howard C. Elman,
J. D. Moulton
Abstract:
Multiphase flow is a critical process in a wide range of applications, including carbon sequestration, contaminant remediation, and groundwater management. Typically, this process is modeled by a nonlinear system of partial differential equations derived by considering the mass conservation of each phase (e.g., oil, water), along with constitutive laws for the relationship of phase velocity to pha…
▽ More
Multiphase flow is a critical process in a wide range of applications, including carbon sequestration, contaminant remediation, and groundwater management. Typically, this process is modeled by a nonlinear system of partial differential equations derived by considering the mass conservation of each phase (e.g., oil, water), along with constitutive laws for the relationship of phase velocity to phase pressure. In this study, we develop and study efficient solution algorithms for solving the algebraic systems of equations derived from a fully coupled and time-implicit treatment of models of multiphase flow. We explore the performance of several preconditioners based on algebraic multigrid (AMG) for solving the linearized problem, including "black-box" AMG applied directly to the system, a new version of constrained pressure residual multigrid (CPR-AMG) preconditioning, and a new preconditioner derived using an approximate Schur complement arising from the block factorization of the Jacobian. We show that the new methods are the most robust with respect to problem character as determined by varying effects of capillary pressures, and we show that the block factorization preconditioner is both efficient and scales optimally with problem size.
△ Less
Submitted 1 November, 2016;
originally announced November 2016.
-
On the velocity space discretization for the Vlasov-Poisson system: comparison between Hermite spectral and Particle-in-Cell methods. Part 2: fully-implicit scheme
Authors:
E. Camporeale,
G. L. Delzanno,
B. K. Bergen,
J. D. Moulton
Abstract:
We describe a spectral method for the numerical solution of the Vlasov-Poisson system where the velocity space is decomposed by means of an Hermite basis, and the configuration space is discretized via a Fourier decomposition. The novelty of our approach is an implicit time discretization that allows exact conservation of charge, momentum and energy. The computational efficiency and the cost-effec…
▽ More
We describe a spectral method for the numerical solution of the Vlasov-Poisson system where the velocity space is decomposed by means of an Hermite basis, and the configuration space is discretized via a Fourier decomposition. The novelty of our approach is an implicit time discretization that allows exact conservation of charge, momentum and energy. The computational efficiency and the cost-effectiveness of this method are compared to the fully-implicit PIC method recently introduced by Markidis and Lapenta (2011) and Chen et al. (2011). The following examples are discussed: Langmuir wave, Landau dam**, ion-acoustic wave, two-stream instability. The Fourier-Hermite spectral method can achieve solutions that are several orders of magnitude more accurate at a fraction of the cost with respect to PIC. This paper concludes the study presented in Camporeale et al. (2013) where the same method has been described for a semi-implicit time discretization, and was compared against an explicit PIC.
△ Less
Submitted 17 December, 2013;
originally announced December 2013.
-
CPIC: a Curvilinear Particle-In-Cell code for plasma-material interaction studies
Authors:
Gian Luca Delzanno,
Enrico Camporeale,
J. David Moulton,
Joseph E. Borovsky,
Elizabeth A. MacDonald,
Michelle F. Thomsen
Abstract:
We describe a new electrostatic Particle-In-Cell (PIC) code in curvilinear geometry called Curvilinear PIC (CPIC). The code models the microscopic (kinetic) evolution of a plasma with the PIC method, coupled with an adaptive computational grid that can conform to arbitrarily shaped domains. CPIC is particularly suited for multiscale problems associated with the interaction of complex objects with…
▽ More
We describe a new electrostatic Particle-In-Cell (PIC) code in curvilinear geometry called Curvilinear PIC (CPIC). The code models the microscopic (kinetic) evolution of a plasma with the PIC method, coupled with an adaptive computational grid that can conform to arbitrarily shaped domains. CPIC is particularly suited for multiscale problems associated with the interaction of complex objects with plasmas. A map is introduced between the physical space and the logical space, where the grid is uniform and Cartesian. In CPIC, most operations are performed in logical space. CPIC was designed following criteria of versatility, robustness and performance. Its main features are the use of structured meshes, a scalable field solver based on the black box multigrid algorithm and a hybrid mover, where particles' position is in logical space while the velocity is in physical space. Test examples involving the interaction of a plasma with material boundaries are presented.
△ Less
Submitted 10 November, 2013;
originally announced November 2013.
-
On the velocity space discretization for the Vlasov-Poisson system: comparison between Hermite spectral and Particle-in-Cell methods. Part 1: semi-implicit scheme
Authors:
Enrico Camporeale,
Gian Luca Delzanno,
Benjamin K. Bergen,
J. David Moulton
Abstract:
We discuss a spectral method for the numerical solution of the Vlasov-Poisson system where the velocity space is decomposed by means of an Hermite basis. We describe a semi-implicit time discretization that extends the range of numerical stability relative to an explicit scheme. We also introduce and discuss the effects of an artificial collisional operator, which is necessary to take care of the…
▽ More
We discuss a spectral method for the numerical solution of the Vlasov-Poisson system where the velocity space is decomposed by means of an Hermite basis. We describe a semi-implicit time discretization that extends the range of numerical stability relative to an explicit scheme. We also introduce and discuss the effects of an artificial collisional operator, which is necessary to take care of the velocity space filamentation problem, unavoidable in collisionless plasmas. The computational efficiency and the cost-effectiveness of this method are compared to a Particle-in-Cell (PIC) method in the case of a two-dimensional phase space. The following examples are discussed: Langmuir wave, Landau dam**, ion-acoustic wave, two-stream instability, and plasma echo. The Hermite spectral method can achieve solutions that are several orders of magnitude more accurate (at a fraction of the cost) with respect to the PIC method.
△ Less
Submitted 17 December, 2013; v1 submitted 8 November, 2013;
originally announced November 2013.
-
A hybrid HDMR for mixed multiscale finite element method with application for flows in random porous media
Authors:
Lijian Jiang,
J. David Moulton,
Jia Wei
Abstract:
Stochastic modeling has become a popular approach to quantify uncertainty in flows through heterogeneous porous media. The uncertainty in heterogeneous structure properties is often parameterized by a high-dimensional random variable. This leads to a deterministic problem in a high-dimensional parameter space and the numerical computation becomes very challengeable as the dimension of the paramete…
▽ More
Stochastic modeling has become a popular approach to quantify uncertainty in flows through heterogeneous porous media. The uncertainty in heterogeneous structure properties is often parameterized by a high-dimensional random variable. This leads to a deterministic problem in a high-dimensional parameter space and the numerical computation becomes very challengeable as the dimension of the parameter space increases. To efficiently tackle the high-dimensionality, we propose a hybrid high dimensional model representation (HDMR) technique, through which the high-dimensional stochastic model is decomposed into a moderate-dimensional stochastic model in a most active random space and a few one-dimensional stochastic models. The derived low-dimensional stochastic models are solved by incorporating sparse grid stochastic collocation method into the proposed hybrid HDMR. The porous media properties such as permeability are often heterogeneous. To treat the heterogeneity, we use a mixed multiscale finite element method (MMsFEM) to simulate each of derived stochastic models. To capture the non-local spatial features of the porous media and the important effects of random variables, we can hierarchically incorporate the global information individually from each of random parameters. This significantly enhances the accuracy of the multiscale simulation. The synergy of the hybrid HDMR and the MMsFEM reduces the stochastic model of flows in both stochastic space and physical space, and significantly decreases the computation complexity. We carefully analyze the proposed HDMR technique and the derived stochastic MMsFEM. A few numerical experiments are carried out for two-phase flows in random porous media and support the efficiency and accuracy of the MMsFEM based on the hybrid HDMR.
△ Less
Submitted 21 October, 2013; v1 submitted 27 November, 2012;
originally announced November 2012.
-
Expanded mixed multiscale finite element methods and their applications for flows in porous media
Authors:
Lijian Jiang,
Dylan Copeland,
J. David Moulton
Abstract:
We develop a family of expanded mixed Multiscale Finite Element Methods (MsFEMs) and their hybridizations for second-order elliptic equations. This formulation expands the standard mixed Multiscale Finite Element formulation in the sense that four unknowns (hybrid formulation) are solved simultaneously: pressure, gradient of pressure, velocity and Lagrange multipliers. We use multiscale basis func…
▽ More
We develop a family of expanded mixed Multiscale Finite Element Methods (MsFEMs) and their hybridizations for second-order elliptic equations. This formulation expands the standard mixed Multiscale Finite Element formulation in the sense that four unknowns (hybrid formulation) are solved simultaneously: pressure, gradient of pressure, velocity and Lagrange multipliers. We use multiscale basis functions for the both velocity and gradient of pressure. In the expanded mixed MsFEM framework, we consider both cases of separable-scale and non-separable spatial scales. We specifically analyze the methods in three categories: periodic separable scales, $G$- convergence separable scales, and continuum scales. When there is no scale separation, using some global information can improve accuracy for the expanded mixed MsFEMs. We present rigorous convergence analysis for expanded mixed MsFEMs. The analysis includes both conforming and nonconforming expanded mixed MsFEM. Numerical results are presented for various multiscale models and flows in porous media with shales to illustrate the efficiency of the expanded mixed MsFEMs.
△ Less
Submitted 20 May, 2012; v1 submitted 10 May, 2011;
originally announced May 2011.
