Showing 1–28 of 28 results for author: Bortz, D M

WgLaSDI: Weak-Form Greedy Latent Space Dynamics Identification

Authors: Xiaolong He, April Tran, David M. Bortz, Youngsoo Choi

Abstract: The parametric greedy latent space dynamics identification (gLaSDI) framework has demonstrated promising potential for accurate and efficient modeling of high-dimensional nonlinear physical systems. However, it remains challenging to handle noisy data. To enhance robustness against noise, we incorporate the weak-form estimation of nonlinear dynamics (WENDy) into gLaSDI. In the proposed weak-form g… ▽ More The parametric greedy latent space dynamics identification (gLaSDI) framework has demonstrated promising potential for accurate and efficient modeling of high-dimensional nonlinear physical systems. However, it remains challenging to handle noisy data. To enhance robustness against noise, we incorporate the weak-form estimation of nonlinear dynamics (WENDy) into gLaSDI. In the proposed weak-form gLaSDI (WgLaSDI) framework, an autoencoder and WENDy are trained simultaneously to discover intrinsic nonlinear latent-space dynamics of high-dimensional data. Compared to the standard sparse identification of nonlinear dynamics (SINDy) employed in gLaSDI, WENDy enables variance reduction and robust latent space discovery, therefore leading to more accurate and efficient reduced-order modeling. Furthermore, the greedy physics-informed active learning in WgLaSDI enables adaptive sampling of optimal training data on the fly for enhanced modeling accuracy. The effectiveness of the proposed framework is demonstrated by modeling various nonlinear dynamical problems, including viscous and inviscid Burgers' equations, time-dependent radial advection, and the Vlasov equation for plasma physics. With data that contains 5-10% Gaussian white noise, WgLaSDI outperforms gLaSDI by orders of magnitude, achieving 1-7% relative errors. Compared with the high-fidelity models, WgLaSDI achieves 121 to 1,779x speed-up. △ Less

Submitted 29 June, 2024; originally announced July 2024.

A Comprehensive Review of Latent Space Dynamics Identification Algorithms for Intrusive and Non-Intrusive Reduced-Order-Modeling

Authors: Christophe Bonneville, Xiaolong He, April Tran, Jun Sur Park, William Fries, Daniel A. Messenger, Siu Wun Cheung, Yeonjong Shin, David M. Bortz, Debojyoti Ghosh, Jiun-Shyan Chen, Jonathan Belof, Youngsoo Choi

Abstract: Numerical solvers of partial differential equations (PDEs) have been widely employed for simulating physical systems. However, the computational cost remains a major bottleneck in various scientific and engineering applications, which has motivated the development of reduced-order models (ROMs). Recently, machine-learning-based ROMs have gained significant popularity and are promising for addressi… ▽ More Numerical solvers of partial differential equations (PDEs) have been widely employed for simulating physical systems. However, the computational cost remains a major bottleneck in various scientific and engineering applications, which has motivated the development of reduced-order models (ROMs). Recently, machine-learning-based ROMs have gained significant popularity and are promising for addressing some limitations of traditional ROM methods, especially for advection dominated systems. In this chapter, we focus on a particular framework known as Latent Space Dynamics Identification (LaSDI), which transforms the high-fidelity data, governed by a PDE, to simpler and low-dimensional latent-space data, governed by ordinary differential equations (ODEs). These ODEs can be learned and subsequently interpolated to make ROM predictions. Each building block of LaSDI can be easily modulated depending on the application, which makes the LaSDI framework highly flexible. In particular, we present strategies to enforce the laws of thermodynamics into LaSDI models (tLaSDI), enhance robustness in the presence of noise through the weak form (WLaSDI), select high-fidelity training data efficiently through active learning (gLaSDI, GPLaSDI), and quantify the ROM prediction uncertainty through Gaussian processes (GPLaSDI). We demonstrate the performance of different LaSDI approaches on Burgers equation, a non-linear heat conduction problem, and a plasma physics problem, showing that LaSDI algorithms can achieve relative errors of less than a few percent and up to thousands of times speed-ups. △ Less

Submitted 15 March, 2024; originally announced March 2024.

Weak-Form Latent Space Dynamics Identification

Authors: April Tran, Xiaolong He, Daniel A. Messenger, Youngsoo Choi, David M. Bortz

Abstract: Recent work in data-driven modeling has demonstrated that a weak formulation of model equations enhances the noise robustness of a wide range of computational methods. In this paper, we demonstrate the power of the weak form to enhance the LaSDI (Latent Space Dynamics Identification) algorithm, a recently developed data-driven reduced order modeling technique. We introduce a weak form-based vers… ▽ More Recent work in data-driven modeling has demonstrated that a weak formulation of model equations enhances the noise robustness of a wide range of computational methods. In this paper, we demonstrate the power of the weak form to enhance the LaSDI (Latent Space Dynamics Identification) algorithm, a recently developed data-driven reduced order modeling technique. We introduce a weak form-based version WLaSDI (Weak-form Latent Space Dynamics Identification). WLaSDI first compresses data, then projects onto the test functions and learns the local latent space models. Notably, WLaSDI demonstrates significantly enhanced robustness to noise. With WLaSDI, the local latent space is obtained using weak-form equation learning techniques. Compared to the standard sparse identification of nonlinear dynamics (SINDy) used in LaSDI, the variance reduction of the weak form guarantees a robust and precise latent space recovery, hence allowing for a fast, robust, and accurate simulation. We demonstrate the efficacy of WLaSDI vs. LaSDI on several common benchmark examples including viscid and inviscid Burgers', radial advection, and heat conduction. For instance, in the case of 1D inviscid Burgers' simulations with the addition of up to 100% Gaussian white noise, the relative error remains consistently below 6% for WLaSDI, while it can exceed 10,000% for LaSDI. Similarly, for radial advection simulations, the relative errors stay below 15% for WLaSDI, in stark contrast to the potential errors of up to 10,000% with LaSDI. Moreover, speedups of several orders of magnitude can be obtained with WLaSDI. For example applying WLaSDI to 1D Burgers' yields a 140X speedup compared to the corresponding full order model. Python code to reproduce the results in this work is available at (https://github.com/MathBioCU/PyWSINDy_ODE) and (https://github.com/MathBioCU/PyWLaSDI). △ Less

Submitted 20 November, 2023; originally announced November 2023.

Comments: 21 pages, 15 figures

Coarse-Graining Hamiltonian Systems Using WSINDy

Authors: Daniel A. Messenger, Joshua W. Burby, David M. Bortz

Abstract: The Weak-form Sparse Identification of Nonlinear Dynamics algorithm (WSINDy) has been demonstrated to offer coarse-graining capabilities in the context of interacting particle systems (https://doi.org/10.1016/j.physd.2022.133406). In this work we extend this capability to the problem of coarse-graining Hamiltonian dynamics which possess approximate symmetries associated with timescale separation.… ▽ More The Weak-form Sparse Identification of Nonlinear Dynamics algorithm (WSINDy) has been demonstrated to offer coarse-graining capabilities in the context of interacting particle systems (https://doi.org/10.1016/j.physd.2022.133406). In this work we extend this capability to the problem of coarse-graining Hamiltonian dynamics which possess approximate symmetries associated with timescale separation. Such approximate symmetries often lead to the existence of a Hamiltonian system of reduced dimension that may be used to efficiently capture the dynamics of the symmetry-invariant dependent variables. Deriving such reduced systems, or approximating them numerically, is an ongoing challenge. We demonstrate that WSINDy can successfully identify this reduced Hamiltonian system in the presence of large intrinsic perturbations while remaining robust to extrinsic noise. This is significant in part due to the nontrivial means by which such systems are derived analytically. WSINDy also naturally preserves the Hamiltonian structure by restricting to a trial basis of Hamiltonian vector fields. The methodology is computational efficient, often requiring only a single trajectory to learn the global reduced Hamiltonian, and avoiding forward solves in the learning process. Using nearly-periodic Hamiltonian systems as a prototypical class of systems with approximate symmetries, we show that WSINDy robustly identifies the correct leading-order system, with dimension reduced by at least two, upon observation of the relevant degrees of freedom. We also provide a contribution to averaging theory by proving that first-order averaging at the level of vector fields preserves Hamiltonian structure in nearly-periodic Hamiltonian systems. We provide physically relevant examples, namely coupled oscillator dynamics, the Hénon-Heiles system for stellar motion within a galaxy, and the dynamics of charged particles. △ Less

Submitted 29 November, 2023; v1 submitted 9 October, 2023; originally announced October 2023.

Direct Estimation of Parameters in ODE Models Using WENDy: Weak-form Estimation of Nonlinear Dynamics

Authors: David M. Bortz, Daniel A. Messenger, Vanja Dukic

Abstract: We introduce the Weak-form Estimation of Nonlinear Dynamics (WENDy) method for estimating model parameters for non-linear systems of ODEs. Without relying on any numerical differential equation solvers, WENDy computes accurate estimates and is robust to large (biologically relevant) levels of measurement noise. For low dimensional systems with modest amounts of data, WENDy is competitive with conv… ▽ More We introduce the Weak-form Estimation of Nonlinear Dynamics (WENDy) method for estimating model parameters for non-linear systems of ODEs. Without relying on any numerical differential equation solvers, WENDy computes accurate estimates and is robust to large (biologically relevant) levels of measurement noise. For low dimensional systems with modest amounts of data, WENDy is competitive with conventional forward solver-based nonlinear least squares methods in terms of speed and accuracy. For both higher dimensional systems and stiff systems, WENDy is typically both faster (often by orders of magnitude) and more accurate than forward solver-based approaches. The core mathematical idea involves an efficient conversion of the strong form representation of a model to its weak form, and then solving a regression problem to perform parameter inference. The core statistical idea rests on the Errors-In-Variables framework, which necessitates the use of the iteratively reweighted least squares algorithm. Further improvements are obtained by using orthonormal test functions, created from a set of C-infinity bump functions of varying support sizes. We demonstrate the high robustness and computational efficiency by applying WENDy to estimate parameters in some common models from population biology, neuroscience, and biochemistry, including logistic growth, Lotka-Volterra, FitzHugh-Nagumo, Hindmarsh-Rose, and a Protein Transduction Benchmark model. Software and code for reproducing the examples is available at (https://github.com/MathBioCU/WENDy). △ Less

Submitted 8 April, 2023; v1 submitted 26 February, 2023; originally announced February 2023.

Comments: 28 pages, 16 figures

MSC Class: 35D30; 62FXX; 62JXX; 65L09; 65M32; 92-08

Asymptotic consistency of the WSINDy algorithm in the limit of continuum data

Authors: Daniel A. Messenger, David M. Bortz

Abstract: In this work we study the asymptotic consistency of the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy) in the identification of differential equations from noisy samples of solutions. We prove that the WSINDy estimator is unconditionally asymptotically consistent for a wide class of models which includes the Navier-Stokes equations and the Kuramoto-Sivashinsky equation. W… ▽ More In this work we study the asymptotic consistency of the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy) in the identification of differential equations from noisy samples of solutions. We prove that the WSINDy estimator is unconditionally asymptotically consistent for a wide class of models which includes the Navier-Stokes equations and the Kuramoto-Sivashinsky equation. We thus provide a mathematically rigorous explanation for the observed robustness to noise of weak-form equation learning. Conversely, we also show that in general the WSINDy estimator is only conditionally asymptotically consistent, yielding discovery of spurious terms with probability one if the noise level is above some critical threshold and the nonlinearities exhibit sufficiently fast growth. We derive explicit bounds on the critical noise threshold in the case of Gaussian white noise and provide an explicit characterization of these spurious terms in the case of trigonometric and/or polynomial model nonlinearities. However, a silver lining to this negative result is that if the data is suitably denoised (a simple moving average filter is sufficient), then we recover unconditional asymptotic consistency on the class of models with locally-Lipschitz nonlinearities. Altogether, our results reveal several important aspects of weak-form equation learning which may be used to improve future algorithms. We demonstrate our results numerically using the Lorenz system, the cubic oscillator, a viscous Burgers growth model, and a Kuramoto-Sivashinsky-type higher-order PDE. △ Less

Submitted 29 November, 2022; originally announced November 2022.

Asymptotic Analysis of a General Multi-Structured Population Model

Authors: Sabina L. Altus, Jeffrey C. Cameron, David M. Bortz

Abstract: Structured populations are ubiquitous across the biological sciences. Mathematical models of these populations allow us to understand how individual physiological traits drive the overall dynamics in aggregate. For example, linear age- or age-and-size-structured models establish constraints on individual growth under which the age- or age-and-size- distribution stabilizes, even as the population c… ▽ More Structured populations are ubiquitous across the biological sciences. Mathematical models of these populations allow us to understand how individual physiological traits drive the overall dynamics in aggregate. For example, linear age- or age-and-size-structured models establish constraints on individual growth under which the age- or age-and-size- distribution stabilizes, even as the population continues to grow without bound. However, individuals in real-world populations exhibit far more structural features than simply age and size. Notably, cyanobacteria contain carboxysome organelles which are central to carbon fixation and can be older (if inherited from parent cells) or younger (if created after division) than the envelo** cell. Motivated by a desire to understand how carboxysome age impacts growth at the colony level, we develop a multi-structured model which allows for an arbitrary (but finite) number of structure variables. We then derive and solve the renewal equation for cell division to obtain an asymptotic solution, and show that, under certain conditions, a stable structural distribution is reached. △ Less

Submitted 22 April, 2022; originally announced April 2022.

MSC Class: 35A30; 47D06; 92D25

Online Weak-form Sparse Identification of Partial Differential Equations

Authors: Daniel A. Messenger, Emiliano Dall'Anese, David M. Bortz

Abstract: This paper presents an online algorithm for identification of partial differential equations (PDEs) based on the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy). The algorithm is online in a sense that if performs the identification task by processing solution snapshots that arrive sequentially. The core of the method combines a weak-form discretization of candidate PDEs w… ▽ More This paper presents an online algorithm for identification of partial differential equations (PDEs) based on the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy). The algorithm is online in a sense that if performs the identification task by processing solution snapshots that arrive sequentially. The core of the method combines a weak-form discretization of candidate PDEs with an online proximal gradient descent approach to the sparse regression problem. In particular, we do not regularize the $\ell_0$-pseudo-norm, instead finding that directly applying its proximal operator (which corresponds to a hard thresholding) leads to efficient online system identification from noisy data. We demonstrate the success of the method on the Kuramoto-Sivashinsky equation, the nonlinear wave equation with time-varying wavespeed, and the linear wave equation, in one, two, and three spatial dimensions, respectively. In particular, our examples show that the method is capable of identifying and tracking systems with coefficients that vary abruptly in time, and offers a streaming alternative to problems in higher dimensions. △ Less

Submitted 8 March, 2022; originally announced March 2022.

Comments: 21 pages, 4 figures

MSC Class: 62J07; 68T05; 93-10

Learning Mean-Field Equations from Particle Data Using WSINDy

Authors: Daniel A. Messenger, David M. Bortz

Abstract: We develop a weak-form sparse identification method for interacting particle systems (IPS) with the primary goals of reducing computational complexity for large particle number $N$ and offering robustness to either intrinsic or extrinsic noise. In particular, we use concepts from mean-field theory of IPS in combination with the weak-form sparse identification of nonlinear dynamics algorithm (WSIND… ▽ More We develop a weak-form sparse identification method for interacting particle systems (IPS) with the primary goals of reducing computational complexity for large particle number $N$ and offering robustness to either intrinsic or extrinsic noise. In particular, we use concepts from mean-field theory of IPS in combination with the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy) to provide a fast and reliable system identification scheme for recovering the governing stochastic differential equations for an IPS when the number of particles per experiment $N$ is on the order of several thousand and the number of experiments $M$ is less than 100. This is in contrast to existing work showing that system identification for $N$ less than 100 and $M$ on the order of several thousand is feasible using strong-form methods. We prove that under some standard regularity assumptions the scheme converges with rate $\mathcal{O}(N^{-1/2})$ in the ordinary least squares setting and we demonstrate the convergence rate numerically on several systems in one and two spatial dimensions. Our examples include a canonical problem from homogenization theory (as a first step towards learning coarse-grained models), the dynamics of an attractive-repulsive swarm, and the IPS description of the parabolic-elliptic Keller-Segel model for chemotaxis. △ Less

Submitted 14 October, 2021; originally announced October 2021.

Analytical singular value decomposition for a class of stoichiometry matrices

Authors: Jacqueline M. Wentz, David M. Bortz

Abstract: We present the analytical singular value decomposition of the stoichiometry matrix for a spatially discrete reaction-diffusion system on a one dimensional domain. The domain has two subregions which share a single common boundary. Each of the subregions is further partitioned into a finite number of compartments. Chemical reactions can occur within a compartment, whereas diffusion is represented a… ▽ More We present the analytical singular value decomposition of the stoichiometry matrix for a spatially discrete reaction-diffusion system on a one dimensional domain. The domain has two subregions which share a single common boundary. Each of the subregions is further partitioned into a finite number of compartments. Chemical reactions can occur within a compartment, whereas diffusion is represented as movement between adjacent compartments. Inspired by biology, we study both 1) the case where the reactions on each side of the boundary are different and only certain species diffuse across the boundary as well as 2) the case with spatially homogenous reactions and diffusion. We write the stoichiometry matrix for these two classes of systems using a Kronecker product formulation. For the first scenario, we apply linear perturbation theory to derive an approximate singular value decomposition in the limit as diffusion becomes much faster than reactions. For the second scenario, we derive an exact analytical singular value decomposition for all relative diffusion and reaction time scales. By writing the stoichiometry matrix using Kronecker products, we show that the singular vectors and values can also be written concisely using Kronecker products. Ultimately, we find that the singular value decomposition of the reaction-diffusion stoichiometry matrix depends on the singular value decompositions of smaller matrices. These smaller matrices represent modified versions of the reaction-only stoichiometry matrices and the analytically known diffusion-only stoichiometry matrix. Our results provide a mathematical framework that can be used to study complex biochemical systems with metabolic compartments. MATLAB code for calculating the SVD equations is available at \url{www.github.com/MathBioCU/ReacDiffStoicSVD}. △ Less

Submitted 27 April, 2021; originally announced April 2021.

Weak SINDy For Partial Differential Equations

Authors: Daniel A. Messenger, David M. Bortz

Abstract: Sparse Identification of Nonlinear Dynamics (SINDy) is a method of system discovery that has been shown to successfully recover governing dynamical systems from data (Brunton et al., PNAS, '16; Rudy et al., Sci. Adv. '17). Recently, several groups have independently discovered that the weak formulation provides orders of magnitude better robustness to noise. Here we extend our Weak SINDy (WSINDy)… ▽ More Sparse Identification of Nonlinear Dynamics (SINDy) is a method of system discovery that has been shown to successfully recover governing dynamical systems from data (Brunton et al., PNAS, '16; Rudy et al., Sci. Adv. '17). Recently, several groups have independently discovered that the weak formulation provides orders of magnitude better robustness to noise. Here we extend our Weak SINDy (WSINDy) framework introduced in (arXiv:2005.04339) to the setting of partial differential equations (PDEs). The elimination of pointwise derivative approximations via the weak form enables effective machine-precision recovery of model coefficients from noise-free data (i.e. below the tolerance of the simulation scheme) as well as robust identification of PDEs in the large noise regime (with signal-to-noise ratio approaching one in many well-known cases). This is accomplished by discretizing a convolutional weak form of the PDE and exploiting separability of test functions for efficient model identification using the Fast Fourier Transform. The resulting WSINDy algorithm for PDEs has a worst-case computational complexity of $\mathcal{O}(N^{D+1}\log(N))$ for datasets with $N$ points in each of $D+1$ dimensions (i.e. $\mathcal{O}(\log(N))$ operations per datapoint). Furthermore, our Fourier-based implementation reveals a connection between robustness to noise and the spectra of test functions, which we utilize in an \textit{a priori} selection algorithm for test functions. Finally, we introduce a learning algorithm for the threshold in sequential-thresholding least-squares (STLS) that enables model identification from large libraries, and we utilize scale-invariance at the continuum level to identify PDEs from poorly-scaled datasets. We demonstrate WSINDy's robustness, speed and accuracy on several challenging PDEs. △ Less

Submitted 21 December, 2020; v1 submitted 6 July, 2020; originally announced July 2020.

Comments: Code used in this manuscript is publicly available on GitHub at https://github.com/dm973/WSINDy PDE

Weak SINDy: Galerkin-Based Data-Driven Model Selection

Authors: Daniel A. Messenger, David M. Bortz

Abstract: We present a weak formulation and discretization of the system discovery problem from noisy measurement data. This method of learning differential equations from data fits into a new class of algorithms that replace pointwise derivative approximations with linear transformations and a variance reduction technique. Our approach improves on the standard SINDy algorithm by orders of magnitude. We fir… ▽ More We present a weak formulation and discretization of the system discovery problem from noisy measurement data. This method of learning differential equations from data fits into a new class of algorithms that replace pointwise derivative approximations with linear transformations and a variance reduction technique. Our approach improves on the standard SINDy algorithm by orders of magnitude. We first show that in the noise-free regime, this so-called Weak SINDy (WSINDy) framework is capable of recovering the dynamic coefficients to very high accuracy, with the number of significant digits equal to the tolerance of the data simulation scheme. Next we show that the weak form naturally accounts for white noise by identifying the correct nonlinearities with coefficient error scaling favorably with the signal-to-noise ratio while significantly reducing the size of linear systems in the algorithm. In doing so, we combine the ease of implementation of the SINDy algorithm with the natural noise-reduction of integration to arrive at a more robust and user-friendly method of sparse recovery that correctly identifies systems in both small-noise and large-noise regimes. △ Less

Submitted 3 July, 2020; v1 submitted 8 May, 2020; originally announced May 2020.

Comments: Added link to code on Github

Competitive Exclusion in a DAE Model for Microbial Electrolysis Cells

Authors: Harry J. Dudley, Zhiyong Jason Ren, David M. Bortz

Abstract: Microbial electrolysis cells (MECs) employ electroactive bacteria to perform extracellular electron transfer, enabling hydrogen generation from biodegradable substrates. In previous work, we developed and analyzed a differential-algebraic equation (DAE) model for MECs. The model resembles a chemostat with ordinary differential equations (ODEs) for concentrations of substrate, microorganisms, and a… ▽ More Microbial electrolysis cells (MECs) employ electroactive bacteria to perform extracellular electron transfer, enabling hydrogen generation from biodegradable substrates. In previous work, we developed and analyzed a differential-algebraic equation (DAE) model for MECs. The model resembles a chemostat with ordinary differential equations (ODEs) for concentrations of substrate, microorganisms, and an extracellular mediator involved in electron transfer. There is also an algebraic constraint for electric current and hydrogen production. Our goal is to determine the outcome of competition between methanogenic archaea and electroactive bacteria, because only the latter contribute to electric current and resulting hydrogen production. We investigate asymptotic stability in two industrially relevant versions of the model. An important aspect of chemostats models is the principle of competitive exclusion -- only microbes which grow at the lowest substrate concentration will survive as $t\to\infty$. We show that if methanogens grow at the lowest substrate concentration, then the equilibrium corresponding to competitive exclusion by methanogens is globally asymptotically stable. The analogous result for electroactive bacteria is not necessarily true. We show that local asymptotic stability of exclusion by electroactive bacteria is not guaranteed, even in a simplified version of the model. In this case, even if electroactive bacteria can grow at the lowest substrate concentration, a few additional conditions are required to guarantee local asymptotic stability. We also provide numerical simulations supporting these arguments. Our results suggest operating conditions that are most conducive to success of electroactive bacteria and the resulting current and hydrogen production in MECs. This will help identify when methane production or electricity and hydrogen production are favored. △ Less

Submitted 6 July, 2020; v1 submitted 5 June, 2019; originally announced June 2019.

Boundedness of a class of discretized reaction-diffusion systems

Authors: Jacqueline M. Wentz, David M. Bortz

Abstract: Although the spatially continuous version of the reaction-diffusion equation has been well studied, in some instances a spatially-discretized representation provides a more realistic approximation of biological processes. Indeed, mathematically the discretized and continuous systems can lead to different predictions of biological dynamics. It is well known in the continuous case that the incorpora… ▽ More Although the spatially continuous version of the reaction-diffusion equation has been well studied, in some instances a spatially-discretized representation provides a more realistic approximation of biological processes. Indeed, mathematically the discretized and continuous systems can lead to different predictions of biological dynamics. It is well known in the continuous case that the incorporation of diffusion can cause diffusion-driven blow-up with respect to the $L^{\infty}$ norm. However, this does not imply diffusion-driven blow-up will occur in the discretized version of the system. For example, in a continuous reaction-diffusion system with Dirichlet boundary conditions and nonnegative solutions, diffusion-driven blow up occurs even when the total species concentration is non-increasing. For systems that instead have homogeneous Neumann boundary conditions, it is currently unknown whether this deviation between the continuous and discretized system can occur. Therefore, it is worth examining the discretized system independently of the continuous system. Since no criteria exist for the boundedness of the discretized system, the focus of this paper is to determine sufficient conditions to guarantee the system with diffusion remains bounded for all time. We consider reaction-diffusion systems on a 1D domain with homogeneous Neumann boundary conditions and non-negative initial data and solutions. We define a Lyapunov-like function and show that its existence guarantees that the discretized reaction-diffusion system is bounded. These results are considered in the context of three example systems for which Lyapunov-like functions can and cannot be found. △ Less

Submitted 14 February, 2020; v1 submitted 22 March, 2019; originally announced March 2019.

MSC Class: 34C11; 35K57; 37B25; 37F99; 65N40

The Influence of Numerical Error on an Inverse Problem Methodology in PDE Models

Authors: John T. Nardini, D. M. Bortz

Abstract: The inverse problem methodology is a commonly-used framework in the sciences for parameter estimation and inference. It is typically performed by fitting a mathematical model to noisy experimental data. There are two significant sources of error in the process: 1.\ Noise from the measurement and collection of experimental data and 2.\ numerical error in approximating the true solution to the mathe… ▽ More The inverse problem methodology is a commonly-used framework in the sciences for parameter estimation and inference. It is typically performed by fitting a mathematical model to noisy experimental data. There are two significant sources of error in the process: 1.\ Noise from the measurement and collection of experimental data and 2.\ numerical error in approximating the true solution to the mathematical model. Little attention has been paid to how this second source of error alters the results of an inverse problem. As a first step towards a better understanding of this problem, we present a modeling and simulation study using a simple advection-driven PDE model. We present both analytical and computational results concerning how the different sources of error impact the least squares cost function as well as parameter estimation and uncertainty quantification. We investigate residual patterns to derive an autocorrelative statistical model that can improve parameter estimation and confidence interval computation for first order methods. Building on the results of our investigation, we provide guidelines for practitioners to determine when numerical or experimental error is the main source of error in their inference, along with suggestions of how to efficiently improve their results. △ Less

Submitted 15 July, 2018; originally announced July 2018.

Comments: 43 pages, 9 Figures, IOP format

A Posteriori Error Analysis of Fluid-Stucture Interactions: Time Dependent Error

Authors: Jay A. Stotsky, David M. Bortz

Abstract: A posteriori error analysis is a technique to quantify the error in particular simulations of a numerical approximation method. In this article, we use such an approach to analyze how various error components propagate in certain moving boundary problems. We study quasi-steady state simulations where slowly moving boundaries remain in mechanical equilibrium with a surrounding fluid. Such problems… ▽ More A posteriori error analysis is a technique to quantify the error in particular simulations of a numerical approximation method. In this article, we use such an approach to analyze how various error components propagate in certain moving boundary problems. We study quasi-steady state simulations where slowly moving boundaries remain in mechanical equilibrium with a surrounding fluid. Such problems can be numerically approximated with the Method of Regularized Stokelets(MRS), a popular method used for studying viscous fluid-structure interactions, especially in biological applications. Our approach to monitoring the regularization error of the MRS is novel, along with the derivation of linearized adjoint equations to the governing equations of the MRS with a elastic elements. Our main numerical results provide a clear illustration of how the error evolves over time in several MRS simulations. △ Less

Submitted 9 July, 2018; originally announced July 2018.

Comments: 14 pages, 6 figures

MSC Class: 65L99

On the existence of non-trivial steady-state size-distributions for a class of flocculation equations

Authors: Inom Mirzaev, David M. Bortz

Abstract: Flocculation is the process whereby particles (i.e., flocs) in suspension reversibly combine and separate. The process is widespread in soft matter and aerosol physics as well as environmental science and engineering. We consider a general size-structured flocculation model, which describes the evolution of floc size distribution in an aqueous environment. Our work provides a unified treatment for… ▽ More Flocculation is the process whereby particles (i.e., flocs) in suspension reversibly combine and separate. The process is widespread in soft matter and aerosol physics as well as environmental science and engineering. We consider a general size-structured flocculation model, which describes the evolution of floc size distribution in an aqueous environment. Our work provides a unified treatment for many size-structured models in the environmental, industrial, medical, and marine engineering literature. In particular, the mathematical model considered in this work accounts for basic biological phenomena in a population of microorganisms including growth, death, sedimentation, predation, surface erosion, renewal, fragmentation and aggregation. The central objective of this work is to prove existence of positive steady states of this generalized flocculation model. Using results from fixed point theory we derive conditions for the existence of continuous, non-trivial stationary solutions. We further develop a numerical scheme based on spectral collocation method to approximate these positive stationary solutions. We explore the stationary solutions of the model for various biologically relevant parameters and give valuable insights for the efficient removal of suspended particles. △ Less

Submitted 23 April, 2018; v1 submitted 30 March, 2018; originally announced April 2018.

Comments: arXiv admin note: substantial text overlap with arXiv:1507.07127

Sensitivity and Bifurcation Analysis of a DAE Model for a Microbial Electrolysis Cell

Authors: Harry J. Dudley, Lu Lu, Zhiyong Jason Ren, David M. Bortz

Abstract: Microbial electrolysis cells (MECs) are a promising new technology for producing hydrogen cheaply, efficiently, and sustainably. However, to scale up this technology, we need a better understanding of the processes in the devices. In this effort, we present a differential-algebraic equation (DAE) model of a microbial electrolysis cell with an algebraic constraint on current. We then perform sensit… ▽ More Microbial electrolysis cells (MECs) are a promising new technology for producing hydrogen cheaply, efficiently, and sustainably. However, to scale up this technology, we need a better understanding of the processes in the devices. In this effort, we present a differential-algebraic equation (DAE) model of a microbial electrolysis cell with an algebraic constraint on current. We then perform sensitivity and bifurcation analysis for the DAE system. The model can be applied either to batch-cycle MECs or to continuous-flow MECs. We conduct differential-algebraic sensitivity analysis after fitting simulations to current density data for a batch-cycle MEC. The sensitivity analysis suggests which parameters have the greatest influence on the current density at particular times during the experiment. In particular, growth and consumption parameters for exoelectrogenic bacteria have a strong effect prior to the peak current density. An alternative strategy to maximizing peak current density is maintaining a long term stable equilibrium with non-zero current density in a continuous-flow MEC. We characterize the minimum dilution rate required for a stable nonzero current equilibrium and demonstrate transcritical bifurcations in the dilution rate parameter that exchange stability between several curves of equilibria. Specifically, increasing the dilution rate transitions the system through three regimes where the stable equilibrium exhibits (i) competitive exclusion by methanogens, (ii) coexistence, and (iii) competitive exclusion by exolectrogens. Positive long term current production is only feasible in the final two regimes. These results suggest how to modify system parameters to increase peak current density in a batch-cycle MEC or to increase the long term current density equilibrium value in a continuous-flow MEC. △ Less

Submitted 17 February, 2018; originally announced February 2018.

MSC Class: 37N25; 92C40

Investigation of a Structured Fisher's Equation with Applications in Biochemistry

Authors: John T. Nardini, D. M. Bortz

Abstract: Recent biological research has sought to understand how biochemical signaling pathways, such as the mitogen-activated protein kinase (MAPK) family, influence the migration of a population of cells during wound healing. Fisher's Equation has been used extensively to model experimental wound healing assays due to its simple nature and known traveling wave solutions. This partial differential equatio… ▽ More Recent biological research has sought to understand how biochemical signaling pathways, such as the mitogen-activated protein kinase (MAPK) family, influence the migration of a population of cells during wound healing. Fisher's Equation has been used extensively to model experimental wound healing assays due to its simple nature and known traveling wave solutions. This partial differential equation with independent variables of time and space cannot account for the effects of biochemical activity on wound healing, however. To this end, we derive a structured Fisher's Equation with independent variables of time, space, and biochemical pathway activity level and prove the existence of a self-similar traveling wave solution to this equation. We also consider a more complicated model with different phenotypes based on MAPK activation and numerically investigate how various temporal patterns of biochemical activity can lead to increased and decreased rates of population migration. △ Less

Submitted 15 December, 2016; originally announced December 2016.

Comments: 28 pages, 8 figures

A numerical framework for computing steady states of size-structured population models and their stability

Authors: Inom Mirzaev, David M. Bortz

Abstract: Structured population models are a class of general evolution equations which are widely used in the study of biological systems. Many theoretical methods are available for establishing existence and stability of steady states of general evolution equations. However, except for very special cases, finding an analytical form of stationary solutions for evolution equations is a challenging task. In… ▽ More Structured population models are a class of general evolution equations which are widely used in the study of biological systems. Many theoretical methods are available for establishing existence and stability of steady states of general evolution equations. However, except for very special cases, finding an analytical form of stationary solutions for evolution equations is a challenging task. In the present paper, we develop a numerical framework for computing approximations to stationary solutions of general evolution equations, which can also be used to produce existence and stability regions for steady states. In particular, we use the Trotter-Kato Theorem to approximate the infinitesimal generator of an evolution equation on a finite dimensional space, which in turn reduces the evolution equation into a system of ordinary differential equations. Consequently, we approximate and study the asymptotic behavior of stationary solutions. We illustrate the convergence of our numerical framework by applying it to a linear Sinko-Streifer structured population model for which the exact form of the steady state is known. To further illustrate the utility of our approach, we apply our framework to nonlinear population balance equation, which is an extension of well-known Smoluchowksi coagulation-fragmentation model to biological populations. We also demonstrate that our numerical framework can be used to gain insight about the theoretical stability of the stationary solutions of the evolution equations. Furthermore, the open source Python program that we have developed for our numerical simulations is freely available from our Github repository (github.com/MathBioCU). △ Less

Submitted 22 February, 2016; originally announced February 2016.

Inverse Problems for a Class of Conditional Probability Measure-Dependent Evolution Equations

Authors: David M. Bortz, Erin C. Byrne, Inom Mirzaev

Abstract: We investigate the inverse problem of identifying a conditional probability measure in a measure-dependent dynamical system. We provide existence and well-posedness results and outline a discretization scheme for approximating a measure. For this scheme, we prove general method stability. The work is motivated by Partial Differential Equation (PDE) models of flocculation for which the shape of t… ▽ More We investigate the inverse problem of identifying a conditional probability measure in a measure-dependent dynamical system. We provide existence and well-posedness results and outline a discretization scheme for approximating a measure. For this scheme, we prove general method stability. The work is motivated by Partial Differential Equation (PDE) models of flocculation for which the shape of the post-fragmentation conditional probability measure greatly impacts the solution dynamics. To illustrate our methodology, we apply the theory to a particular PDE model that arises in the study of population dynamics for flocculating bacterial aggregates in suspension, and provide numerical evidence for the utility of the approach. △ Less

Submitted 5 October, 2015; originally announced October 2015.

Stability of steady states for a class of flocculation equations with growth and removal

Authors: Inom Mirzaev, David M. Bortz

Abstract: Flocculation is the process whereby particles (i.e., flocs) in suspension reversibly combine and separate. The process is widespread in soft matter and aerosol physics as well as environmental science and engineering. We consider a general size-structured flocculation model, which describes the evolution of flocs in an aqueous environment. Our work provides a unified treatment for many size-struct… ▽ More Flocculation is the process whereby particles (i.e., flocs) in suspension reversibly combine and separate. The process is widespread in soft matter and aerosol physics as well as environmental science and engineering. We consider a general size-structured flocculation model, which describes the evolution of flocs in an aqueous environment. Our work provides a unified treatment for many size-structured models in the environmental, industrial, medical, and marine engineering literature. In particular, our model accounts for basic biological phenomena in a population of microorganisms including growth, death, sedimentation, predation, renewal, fragmentation and aggregation. Our central goal in this paper is to rigorously investigate the long-term behavior of this generalized flocculation model. Using results from fixed point theory we derive conditions for the existence of continuous, non-trivial stationary solutions. We further apply the principle of linearized stability and semigroup compactness arguments to provide sufficient conditions for local exponential stability of stationary solutions as well as sufficient conditions for instability. Abstract. The end results of this analytical development are relatively simple inequality-criteria which thus allows for the rapid evaluation of the existence and stability of a non-trivial stationary solution. To our knowledge, this work is the first to derive precise existence and stability criteria for such a generalized model. Lastly, we also provide an illustrating application of this criteria to several flocculation models. △ Less

Submitted 25 July, 2015; originally announced July 2015.

Variable Viscosity and Density Biofilm Simulations using an Immersed Boundary Method, Part II: Experimental Validation and the Heterogeneous Rheology-IBM

Authors: Jay A. Stotsky, Jason F. Hammond, Leonid Pavlovsky, Elizabeth J. Stewart, John G. Younger, Michael J. Solomon, David M. Bortz

Abstract: The goal of this work is to develop a numerical simulation that accurately captures the biomechanical response of bacterial biofilms and their associated extracellular matrix (ECM). In this, the second of a two-part effort, the primary focus is on formally presenting the heterogeneous rheology Immersed Boundary Method (hrIBM) and validating our model against experimental results. With this extensi… ▽ More The goal of this work is to develop a numerical simulation that accurately captures the biomechanical response of bacterial biofilms and their associated extracellular matrix (ECM). In this, the second of a two-part effort, the primary focus is on formally presenting the heterogeneous rheology Immersed Boundary Method (hrIBM) and validating our model against experimental results. With this extension of the Immersed Bounadry Method (IBM), we use the techniques originally developed in Part I, (Hammond et al. (2014) ) to treat the biofilm as a viscoelastic fluid possessing variable rheological properties anchored to a set of moving locations (i.e., the bacteria locations). We validate our modeling approach from Part I by comparing dynamic moduli and compliance moduli computed from our model to data from mechanical characterization experiments on Staphylococcus epidermidis biofilms. The experimental setup is described in Pavlovsky et al. (2013) in which biofilms are grown and tested in a parallel plate rheometer. Matlab code used to produce results in this paper will be available at https://github.com/MathBioCU/BiofilmSim. △ Less

Submitted 29 April, 2015; v1 submitted 27 April, 2015; originally announced April 2015.

Comments: 26 pages, 8 figures, 6 tables

MSC Class: 65N22; 74F10; 65M06

Criteria for linearized stability for a size-structured population model

Authors: Inom Mirzaev, David M. Bortz

Abstract: We consider a size-structured aggregation and growth model of phytoplankton community proposed by Ackleh and Fitzpatrick [2]. The model accounts for basic biological phenomena in phytoplankton community such as growth, gravitational sedimentation, predation by zooplankton, fecundity, and aggregation. Our primary goal in this paper is to investigate the long-term behavior of the proposed aggregatio… ▽ More We consider a size-structured aggregation and growth model of phytoplankton community proposed by Ackleh and Fitzpatrick [2]. The model accounts for basic biological phenomena in phytoplankton community such as growth, gravitational sedimentation, predation by zooplankton, fecundity, and aggregation. Our primary goal in this paper is to investigate the long-term behavior of the proposed aggregation and growth model. Particularly, using the well-known principle of linearized stability and semigroup compactness arguments, we provide sufficient conditions for local exponential asymptotic stability of zero solution as well as sufficient conditions for instability. We express these conditions in the form of an easy to compute characteristic function, which depends on the functional relationship between growth, sedimentation and fecundity. Our results can be used to predict long-term phytoplankton dynamic △ Less

Submitted 9 February, 2015; originally announced February 2015.

Analytical Equilibrium Solutions of Biochemical Systems with Synthesis and Degradation

Authors: Inom Mirzaev, David Matthew Bortz

Abstract: Analyzing qualitative behaviors of biochemical reactions using its associated network structure has proven useful in diverse branches of biology. As an extension of our previous work, we introduce a graph-based framework to calculate steady state solutions of biochemical reaction networks with synthesis and degradation. Our approach is based on a labeled directed graph $G$ and the associated syste… ▽ More Analyzing qualitative behaviors of biochemical reactions using its associated network structure has proven useful in diverse branches of biology. As an extension of our previous work, we introduce a graph-based framework to calculate steady state solutions of biochemical reaction networks with synthesis and degradation. Our approach is based on a labeled directed graph $G$ and the associated system of linear non-homogeneous differential equations with first order degradation and zeroth order synthesis. We also present a theorem which provides necessary and sufficient conditions for the dynamics to engender a unique stable steady state. Although the dynamics are linear, one can apply this framework to nonlinear systems by encoding nonlinearity into the edge labels. We answer open question from our previous work concerning the non-positiveness of the elements in the inverse of a perturbed Laplacian matrix. Moreover, we provide a graph theoretical framework for the computation of the inverse of a such matrix. This also completes our previous framework and makes it purely graph theoretical. Lately, we demonstrate the utility of this framework by applying it to a mathematical model of insulin secretion through ion channels and glucose metabolism in pancreatic $β$-cells. △ Less

Submitted 25 April, 2014; originally announced April 2014.

Comments: 28 pages

Numerical simulation of solutions and moments of the smoluchowski coagulation equation

Authors: Dustin D. Keck, David M. Bortz

Abstract: Researchers have employed variations of the Smoluchowski coagulation equation to model a wide variety of both organic and inorganic phenomena and with relatively few known analytical solutions, numerical solutions play an important role in studying this equation. In this article, we consider numerical approximations, focusing on how different discretization schemes impact the accuracy of approxima… ▽ More Researchers have employed variations of the Smoluchowski coagulation equation to model a wide variety of both organic and inorganic phenomena and with relatively few known analytical solutions, numerical solutions play an important role in studying this equation. In this article, we consider numerical approximations, focusing on how different discretization schemes impact the accuracy of approximate solution moments. Pursuing the eventual goal of comparing simulated solutions to experimental data, we must carefully choose the numerical method most appropriate to the type of data we attain. Within this context, we compare and contrast the accuracy and computational cost of a finite element approach and a finite volume-based scheme. Our study provides theoretical and numerical evidence that the finite element approach achieves much more accuracy when the system aggregates slowly, and it does so with much less computation cost. Conversely, the finite volume method is slightly more accurate approximating the zeroth moment when the system aggregates quickly and is much more accurate approximating the first moment in general. Lastly, our study also provides numerical evidence that the finite element method (conventionally considered first order) actually belongs to a class of discontinuous Galerkin methods that exhibit superconvergence, or second order in our case. △ Less

Submitted 27 December, 2013; originally announced December 2013.

Spatially Heterogeneous Biofilm Simulations using an Immersed Boundary Method with Lagrangian Nodes Defined by Bacterial Locations

Authors: Jason F. Hammond, Elizabeth J. Stewart, John G. Younger, Michael J. Solomon, David M. Bortz

Abstract: In this work we consider how surface-adherent bacterial biofilm communities respond in flowing systems. We simulate the fluid-structure interaction and separation process using the immersed boundary method. In these simulations we model and simulate different density and viscosity values of the biofilm than that of the surrounding fluid. The simulation also includes breakable springs connecting th… ▽ More In this work we consider how surface-adherent bacterial biofilm communities respond in flowing systems. We simulate the fluid-structure interaction and separation process using the immersed boundary method. In these simulations we model and simulate different density and viscosity values of the biofilm than that of the surrounding fluid. The simulation also includes breakable springs connecting the bacteria in the biofilm. This allows the inclusion of erosion and detachment into the simulation. We use the incompressible Navier-Stokes (N-S) equations to describe the motion of the flowing fluid. We discretize the fluid equations using finite differences and use a geometric multigrid method to solve the resulting equations at each time step. The use of multigrid is necessary because of the dramatically different densities and viscosities between the biofilm and the surrounding fluid. We investigate and simulate the model in both two and three dimensions. Our method differs from previous attempts of using IBM for modeling biofilm/flow interactions in the following ways: the density and viscosity of the biofilm can differ from the surrounding fluid, and the Lagrangian node locations correspond to experimentally measured bacterial cell locations from 3D images taken of Staphylococcus epidermidis in a biofilm. △ Less

Submitted 14 February, 2013; originally announced February 2013.

Comments: 43 pages, 18 figures, 9 tables

Propagation of fronts in the Fisher-Kolmogorov equation with spatially varying diffusion

Authors: Christopher W. Curtis, David M. Bortz

Abstract: The propagation of fronts in the Fisher-Kolmogorov equation with spatially varying diffusion coefficients is studied. Using coordinate changes, WKB approximations, and multiple scales analysis, we provide an analytic framework that describes propagation of the front up to the minimum of the diffusion coefficient. We also present results showing the behavior of the front after it passes the minimum… ▽ More The propagation of fronts in the Fisher-Kolmogorov equation with spatially varying diffusion coefficients is studied. Using coordinate changes, WKB approximations, and multiple scales analysis, we provide an analytic framework that describes propagation of the front up to the minimum of the diffusion coefficient. We also present results showing the behavior of the front after it passes the minimum. In each case, we show that standard traveling coordinate frames do not properly describe front propagation. Lastly, we provide numerical simulations to support our analysis and to show, that around the minimum, the motion of the front is arrested on asymptotically significant timescales. △ Less

Submitted 16 September, 2012; v1 submitted 4 July, 2012; originally announced July 2012.

Comments: 8 pages, 5 figures

MSC Class: 35K57; 35C07