Showing 1–36 of 36 results for author: Goyal, P

GS-PINN: Greedy Sampling for Parameter Estimation in Partial Differential Equations

Authors: Ali Forootani, Harshit Kapadia, Sridhar Chellappa, Pawan Goyal, Peter Benner

Abstract: Partial differential equation parameter estimation is a mathematical and computational process used to estimate the unknown parameters in a partial differential equation model from observational data. This paper employs a greedy sampling approach based on the Discrete Empirical Interpolation Method to identify the most informative samples in a dataset associated with a partial differential equatio… ▽ More Partial differential equation parameter estimation is a mathematical and computational process used to estimate the unknown parameters in a partial differential equation model from observational data. This paper employs a greedy sampling approach based on the Discrete Empirical Interpolation Method to identify the most informative samples in a dataset associated with a partial differential equation to estimate its parameters. Greedy samples are used to train a physics-informed neural network architecture which maps the nonlinear relation between spatio-temporal data and the measured values. To prove the impact of greedy samples on the training of the physics-informed neural network for parameter estimation of a partial differential equation, their performance is compared with random samples taken from the given dataset. Our simulation results show that for all considered partial differential equations, greedy samples outperform random samples, i.e., we can estimate parameters with a significantly lower number of samples while simultaneously reducing the relative estimation error. A Python package is also prepared to support different phases of the proposed algorithm, including data prepossessing, greedy sampling, neural network training, and comparison. △ Less

Submitted 14 May, 2024; originally announced May 2024.

Stability-Certified Learning of Control Systems with Quadratic Nonlinearities

Authors: Igor Pontes Duff, Pawan Goyal, Peter Benner

Abstract: This work primarily focuses on an operator inference methodology aimed at constructing low-dimensional dynamical models based on a priori hypotheses about their structure, often informed by established physics or expert insights. Stability is a fundamental attribute of dynamical systems, yet it is not always assured in models derived through inference. Our main objective is to develop a method tha… ▽ More This work primarily focuses on an operator inference methodology aimed at constructing low-dimensional dynamical models based on a priori hypotheses about their structure, often informed by established physics or expert insights. Stability is a fundamental attribute of dynamical systems, yet it is not always assured in models derived through inference. Our main objective is to develop a method that facilitates the inference of quadratic control dynamical systems with inherent stability guarantees. To this aim, we investigate the stability characteristics of control systems with energy-preserving nonlinearities, thereby identifying conditions under which such systems are bounded-input bounded-state stable. These insights are subsequently applied to the learning process, yielding inferred models that are inherently stable by design. The efficacy of our proposed framework is demonstrated through a couple of numerical examples. △ Less

Submitted 1 March, 2024; originally announced March 2024.

Comments: 12 pages, 4 figures

Learning reduced-order Quadratic-Linear models in Process Engineering using Operator Inference

Authors: Ion Victor Gosea, Luisa Peterson, Pawan Goyal, Jens Bremer, Kai Sundmacher, Peter Benner

Abstract: In this work, we address the challenge of efficiently modeling dynamical systems in process engineering. We use reduced-order model learning, specifically operator inference. This is a non-intrusive, data-driven method for learning dynamical systems from time-domain data. The application in our study is carbon dioxide methanation, an important reaction within the Power-to-X framework, to demonstra… ▽ More In this work, we address the challenge of efficiently modeling dynamical systems in process engineering. We use reduced-order model learning, specifically operator inference. This is a non-intrusive, data-driven method for learning dynamical systems from time-domain data. The application in our study is carbon dioxide methanation, an important reaction within the Power-to-X framework, to demonstrate its potential. The numerical results show the ability of the reduced-order models constructed with operator inference to provide a reduced yet accurate surrogate solution. This represents an important milestone towards the implementation of fast and reliable digital twin architectures. △ Less

Submitted 27 February, 2024; originally announced February 2024.

Comments: 10 pages, 3 figures

Balanced Truncation of Descriptor Systems with a Quadratic Output

Authors: Jennifer Przybilla, Igor Pontes Duff, Pawan Goyal, Peter Benner

Abstract: This work discusses model reduction for differential-algebraic systems with quadratic output equations. Under mild conditions, these systems can be transformed into a Weierstraß canonical form and, thus, be decoupled into differential equations and algebraic equations. The corresponding decoupled states are referred to as proper and improper states. Due to the quadratic function of the state as an… ▽ More This work discusses model reduction for differential-algebraic systems with quadratic output equations. Under mild conditions, these systems can be transformed into a Weierstraß canonical form and, thus, be decoupled into differential equations and algebraic equations. The corresponding decoupled states are referred to as proper and improper states. Due to the quadratic function of the state as an output, the proper and improper states are coupled in the output equation, which imposes a challenge from a model reduction viewpoint. Kee** the coupling in mind, our goal in this work is to find important subspaces of the proper and improper states and to reduce the system accordingly. To that end, we first propose the system's matrices, the so-called Gramians, to characterize the system's dominant subspaces. We pay particular attention to the computation of the observability Gramians that take into account the nonlinear coupling between the proper and the improper states. We furthermore show that the proposed Gramians are related to certain kernel functions, which are used to identify important subspaces. This allows us to propose a reduction algorithm to obtain reduced-order systems by removing the subspaces that are difficult to reach, as well as, difficult to observe. Moreover, we quantify the error between the full-order and reduced-order models and demonstrate the proposed methodology using three numerical experiments. △ Less

Submitted 22 February, 2024; originally announced February 2024.

A Robust SINDy Approach by Combining Neural Networks and an Integral Form

Authors: Ali Forootani, Pawan Goyal, Peter Benner

Abstract: The discovery of governing equations from data has been an active field of research for decades. One widely used methodology for this purpose is sparse regression for nonlinear dynamics, known as SINDy. Despite several attempts, noisy and scarce data still pose a severe challenge to the success of the SINDy approach. In this work, we discuss a robust method to discover nonlinear governing equation… ▽ More The discovery of governing equations from data has been an active field of research for decades. One widely used methodology for this purpose is sparse regression for nonlinear dynamics, known as SINDy. Despite several attempts, noisy and scarce data still pose a severe challenge to the success of the SINDy approach. In this work, we discuss a robust method to discover nonlinear governing equations from noisy and scarce data. To do this, we make use of neural networks to learn an implicit representation based on measurement data so that not only it produces the output in the vicinity of the measurements but also the time-evolution of output can be described by a dynamical system. Additionally, we learn such a dynamic system in the spirit of the SINDy framework. Leveraging the implicit representation using neural networks, we obtain the derivative information -- required for SINDy -- using an automatic differentiation tool. To enhance the robustness of our methodology, we further incorporate an integral condition on the output of the implicit networks. Furthermore, we extend our methodology to handle data collected from multiple initial conditions. We demonstrate the efficiency of the proposed methodology to discover governing equations under noisy and scarce data regimes by means of several examples and compare its performance with existing methods. △ Less

Submitted 13 September, 2023; originally announced September 2023.

Deep Learning for Structure-Preserving Universal Stable Koopman-Inspired Embeddings for Nonlinear Canonical Hamiltonian Dynamics

Authors: Pawan Goyal, Süleyman Yıldız, Peter Benner

Abstract: Discovering a suitable coordinate transformation for nonlinear systems enables the construction of simpler models, facilitating prediction, control, and optimization for complex nonlinear systems. To that end, Koopman operator theory offers a framework for global linearization for nonlinear systems, thereby allowing the usage of linear tools for design studies. In this work, we focus on the identi… ▽ More Discovering a suitable coordinate transformation for nonlinear systems enables the construction of simpler models, facilitating prediction, control, and optimization for complex nonlinear systems. To that end, Koopman operator theory offers a framework for global linearization for nonlinear systems, thereby allowing the usage of linear tools for design studies. In this work, we focus on the identification of global linearized embeddings for canonical nonlinear Hamiltonian systems through a symplectic transformation. While this task is often challenging, we leverage the power of deep learning to discover the desired embeddings. Furthermore, to overcome the shortcomings of Koopman operators for systems with continuous spectra, we apply the lifting principle and learn global cubicized embeddings. Additionally, a key emphasis is paid to enforce the bounded stability for the dynamics of the discovered embeddings. We demonstrate the capabilities of deep learning in acquiring compact symplectic coordinate transformation and the corresponding simple dynamical models, fostering data-driven learning of nonlinear canonical Hamiltonian systems, even those with continuous spectra. △ Less

Submitted 26 August, 2023; originally announced August 2023.

Guaranteed Stable Quadratic Models and their applications in SINDy and Operator Inference

Authors: Pawan Goyal, Igor Pontes Duff, Peter Benner

Abstract: Scientific machine learning for inferring dynamical systems combines data-driven modeling, physics-based modeling, and empirical knowledge. It plays an essential role in engineering design and digital twinning. In this work, we primarily focus on an operator inference methodology that builds dynamical models, preferably in low-dimension, with a prior hypothesis on the model structure, often determ… ▽ More Scientific machine learning for inferring dynamical systems combines data-driven modeling, physics-based modeling, and empirical knowledge. It plays an essential role in engineering design and digital twinning. In this work, we primarily focus on an operator inference methodology that builds dynamical models, preferably in low-dimension, with a prior hypothesis on the model structure, often determined by known physics or given by experts. Then, for inference, we aim to learn the operators of a model by setting up an appropriate optimization problem. One of the critical properties of dynamical systems is stability. However, this property is not guaranteed by the inferred models. In this work, we propose inference formulations to learn quadratic models, which are stable by design. Precisely, we discuss the parameterization of quadratic systems that are locally and globally stable. Moreover, for quadratic systems with no stable point yet bounded (e.g., chaotic Lorenz model), we discuss how to parameterize such bounded behaviors in the learning process. Using those parameterizations, we set up inference problems, which are then solved using a gradient-based optimization method. Furthermore, to avoid numerical derivatives and still learn continuous systems, we make use of an integral form of differential equations. We present several numerical examples, illustrating the preservation of stability and discussing its comparison with the existing state-of-the-art approach to infer operators. By means of numerical examples, we also demonstrate how the proposed methods are employed to discover governing equations and energy-preserving models. △ Less

Submitted 7 January, 2024; v1 submitted 26 August, 2023; originally announced August 2023.

Parameterized Interpolation of Passive Systems

Authors: Peter Benner, Pawan Goyal, Paul Van Dooren

Abstract: We study the tangential interpolation problem for a passive transfer function in standard state-space form. We derive new interpolation conditions based on the computation of a deflating subspace associated with a selection of spectral zeros of a parameterized para-Hermitian transfer function. We show that this technique improves the robustness of the low order model and that it can also be applie… ▽ More We study the tangential interpolation problem for a passive transfer function in standard state-space form. We derive new interpolation conditions based on the computation of a deflating subspace associated with a selection of spectral zeros of a parameterized para-Hermitian transfer function. We show that this technique improves the robustness of the low order model and that it can also be applied to non-passive systems, provided they have sufficiently many spectral zeros in the open right half plane. We analyze the accuracy needed for the computation of the deflating subspace, in order to still have a passive lower order model and we derive a novel selection procedure of spectral zeros in order to obtain low order models with a small approximation error. △ Less

Submitted 7 August, 2023; originally announced August 2023.

MSC Class: 93A30; 93C05; 93D09

Linearly Implicit Global Energy Preserving Reduced-order Models for Cubic Hamiltonian Systems

Authors: Süleyman Yildiz, Pawan Goyal, Peter Benner

Abstract: This work discusses the model reduction problem for large-scale multi-symplectic PDEs with cubic invariants. For this, we present a linearly implicit global energy-preserving method to construct reduced-order models. This allows to construct reduced-order models in the form of Hamiltonian systems suitable for long-time integration. Furthermore, We prove that the constructed reduced-order models pr… ▽ More This work discusses the model reduction problem for large-scale multi-symplectic PDEs with cubic invariants. For this, we present a linearly implicit global energy-preserving method to construct reduced-order models. This allows to construct reduced-order models in the form of Hamiltonian systems suitable for long-time integration. Furthermore, We prove that the constructed reduced-order models preserve global energy, and the spatially discrete equations also preserve the spatially-discrete local energy conversation law. We illustrate the efficiency of the proposed method using three numerical examples, namely a linear wave equation, the Korteweg-de Vries equation, and the Camassa-Holm equation, and present a comparison with the classical POD-Galerkin method. △ Less

Submitted 4 August, 2023; originally announced August 2023.

Rank-Minimizing and Structured Model Inference

Authors: Pawan Goyal, Benjamin Peherstorfer, Peter Benner

Abstract: While extracting information from data with machine learning plays an increasingly important role, physical laws and other first principles continue to provide critical insights about systems and processes of interest in science and engineering. This work introduces a method that infers models from data with physical insights encoded in the form of structure and that minimizes the model order so t… ▽ More While extracting information from data with machine learning plays an increasingly important role, physical laws and other first principles continue to provide critical insights about systems and processes of interest in science and engineering. This work introduces a method that infers models from data with physical insights encoded in the form of structure and that minimizes the model order so that the training data are fitted well while redundant degrees of freedom without conditions and sufficient data to fix them are automatically eliminated. The models are formulated via solution matrices of specific instances of generalized Sylvester equations that enforce interpolation of the training data and relate the model order to the rank of the solution matrices. The proposed method numerically solves the Sylvester equations for minimal-rank solutions and so obtains models of low order. Numerical experiments demonstrate that the combination of structure preservation and rank minimization leads to accurate models with orders of magnitude fewer degrees of freedom than models of comparable prediction quality that are learned with structure preservation alone. △ Less

Submitted 19 February, 2023; originally announced February 2023.

Inference of Continuous Linear Systems from Data with Guaranteed Stability

Authors: Pawan Goyal, Igor Pontes Duff, Peter Benner

Abstract: Machine-learning technologies for learning dynamical systems from data play an important role in engineering design. This research focuses on learning continuous linear models from data. Stability, a key feature of dynamic systems, is especially important in design tasks such as prediction and control. Thus, there is a need to develop methodologies that provide stability guarantees. To that end, w… ▽ More Machine-learning technologies for learning dynamical systems from data play an important role in engineering design. This research focuses on learning continuous linear models from data. Stability, a key feature of dynamic systems, is especially important in design tasks such as prediction and control. Thus, there is a need to develop methodologies that provide stability guarantees. To that end, we leverage the parameterization of stable matrices proposed in [Gillis/Sharma, Automatica, 2017] to realize the desired models. Furthermore, to avoid the estimation of derivative information to learn continuous systems, we formulate the inference problem in an integral form. We also discuss a few extensions, including those related to control systems. Numerical experiments show that the combination of a stable matrix parameterization and an integral form of differential equations allows us to learn stable systems without requiring derivative information, which can be challenging to obtain in situations with noisy or limited data. △ Less

Submitted 24 January, 2023; originally announced January 2023.

Dominant Subspaces of High-Fidelity Nonlinear Structured Parametric Dynamical Systems and Model Reduction

Authors: Pawan Goyal, Igor Pontes Duff, Peter Benner

Abstract: In this work, we investigate a model order reduction scheme for high-fidelity nonlinear structured parametric dynamical systems. More specifically, we consider a class of nonlinear dynamical systems whose nonlinear terms are polynomial functions, and the linear part corresponds to a linear structured model, such as second-order, time-delay, or fractional-order systems. Our approach relies on the V… ▽ More In this work, we investigate a model order reduction scheme for high-fidelity nonlinear structured parametric dynamical systems. More specifically, we consider a class of nonlinear dynamical systems whose nonlinear terms are polynomial functions, and the linear part corresponds to a linear structured model, such as second-order, time-delay, or fractional-order systems. Our approach relies on the Volterra series representation of these dynamical systems. Using this representation, we identify the kernels and, thus, the generalized multivariate transfer functions associated with these systems. Consequently, we present results allowing the construction of reduced-order models whose generalized transfer functions interpolate these of the original system at pre-defined frequency points. For efficient calculations, we also need the concept of a symmetric Kronecker product representation of a tensor and derive particular properties of them. Moreover, we propose an algorithm that extracts dominant subspaces from the prescribed interpolation conditions. This allows the construction of reduced-order models that preserve the structure. We also extend these results to parametric systems and a special case (delay in input/output). We demonstrate the efficiency of the proposed method by means of various numerical benchmarks. △ Less

Submitted 23 January, 2023; originally announced January 2023.

Almost commuting scheme of symplectic matrices and quantum Hamiltonian reduction

Authors: Pallav Goyal

Abstract: Losev introduced the scheme $X$ of almost commuting elements (i.e., elements commuting upto a rank one element) of $\mathfrak{g}=\mathfrak{sp}(V)$ for a symplectic vector space $V$ and discussed its algebro-geometric properties. We construct a Lagrangian subscheme $X^{nil}$ of $X$ and show that it is a complete intersection of dimension $\text{dim}(\mathfrak{g})+\frac{1}{2}\text{dim}(V)$ and compu… ▽ More Losev introduced the scheme $X$ of almost commuting elements (i.e., elements commuting upto a rank one element) of $\mathfrak{g}=\mathfrak{sp}(V)$ for a symplectic vector space $V$ and discussed its algebro-geometric properties. We construct a Lagrangian subscheme $X^{nil}$ of $X$ and show that it is a complete intersection of dimension $\text{dim}(\mathfrak{g})+\frac{1}{2}\text{dim}(V)$ and compute its irreducible components. We also study the quantum Hamiltonian reduction of the algebra $\mathcal{D}(\mathfrak{g})$ of differential operators on the Lie algebra $\mathfrak{g}$ tensored with the Weyl algebra with respect to the action of the symplectic group, and show that it is isomorphic to the spherical subalgebra of a certain rational Cherednik algebra of Type $C$. △ Less

Submitted 27 December, 2022; originally announced December 2022.

Generalized Quadratic Embeddings for Nonlinear Dynamics using Deep Learning

Authors: Pawan Goyal, Peter Benner

Abstract: The engineering design process often relies on mathematical modeling that can describe the underlying dynamic behavior. In this work, we present a data-driven methodology for modeling the dynamics of nonlinear systems. To simplify this task, we aim to identify a coordinate transformation that allows us to represent the dynamics of nonlinear systems using a common, simple model structure. The advan… ▽ More The engineering design process often relies on mathematical modeling that can describe the underlying dynamic behavior. In this work, we present a data-driven methodology for modeling the dynamics of nonlinear systems. To simplify this task, we aim to identify a coordinate transformation that allows us to represent the dynamics of nonlinear systems using a common, simple model structure. The advantage of a common simple model is that customized design tools developed for it can be applied to study a large variety of nonlinear systems. The simplest common model -- one can think of -- is linear, but linear systems often fall short in accurately capturing the complex dynamics of nonlinear systems. In this work, we propose using quadratic systems as the common structure, inspired by the lifting principle. According to this principle, smooth nonlinear systems can be expressed as quadratic systems in suitable coordinates without approximation errors. However, finding these coordinates solely from data is challenging. Here, we leverage deep learning to identify such lifted coordinates using only data, enabling a quadratic dynamical system to describe the system's dynamics. Additionally, we discuss the asymptotic stability of these quadratic dynamical systems. We illustrate the approach using data collected from various numerical examples, demonstrating its superior performance with the existing well-known techniques. △ Less

Submitted 4 January, 2024; v1 submitted 1 November, 2022; originally announced November 2022.

An Operator Inference Oriented Approach for Mechanical Systems

Authors: Yevgeniya Filanova, Igor Pontes Duff, Pawan Goyal, Peter Benner

Abstract: Model-order reduction techniques allow the construction of low-dimensional surrogate models that can accelerate engineering design processes. Often, these techniques are intrusive, meaning that they require direct access to underlying high-fidelity models. Accessing these models is laborious or may not even be possible in some cases. Therefore, there is an interest in develo** non-intrusive mode… ▽ More Model-order reduction techniques allow the construction of low-dimensional surrogate models that can accelerate engineering design processes. Often, these techniques are intrusive, meaning that they require direct access to underlying high-fidelity models. Accessing these models is laborious or may not even be possible in some cases. Therefore, there is an interest in develo** non-intrusive model reduction techniques to construct low-dimensional models directly from simulated or experimental data. In this work, we focus on a recent data-driven methodology, namely operator inference, that aims at inferring the reduced operators using only trajectories of high-fidelity models. We present an extension of operator inference for mechanical systems, preserving the second-order structure. We also study a particular case in which complete information about the external forces is available. In this formulation, the reduced operators having certain properties inspired by the original system matrices are enforced by adding constraints to the optimization problem. We illustrate the presented methodology using three numerical examples. △ Less

Submitted 2 December, 2022; v1 submitted 14 October, 2022; originally announced October 2022.

A quadratic decoder approach to nonintrusive reduced-order modeling of nonlinear dynamical systems

Authors: Peter Benner, Pawan Goyal, Jan Heiland, Igor Pontes

Abstract: Linear projection schemes like Proper Orthogonal Decomposition can efficiently reduce the dimensions of dynamical systems but are naturally limited, e.g., for convection-dominated problems. Nonlinear approaches have shown to outperform linear methods in terms of dimension reduction versus accuracy but, typically, come with a large computational overhead. In this work, we consider a quadratic reduc… ▽ More Linear projection schemes like Proper Orthogonal Decomposition can efficiently reduce the dimensions of dynamical systems but are naturally limited, e.g., for convection-dominated problems. Nonlinear approaches have shown to outperform linear methods in terms of dimension reduction versus accuracy but, typically, come with a large computational overhead. In this work, we consider a quadratic reduction scheme which induces nonlinear structures that are well accessible to tensorized linear algebra routines. We discuss that nonintrusive approaches can be used to simultaneously reduce the complexity in the equations and propose an operator inference formulation that respects dynamics on nonlinear manifolds. △ Less

Submitted 30 September, 2022; originally announced September 2022.

MSC Class: 37N10; 68T05; 76D05; 65F22; 93A15; 93C10

Neural ODEs with Irregular and Noisy Data

Authors: Pawan Goyal, Peter Benner

Abstract: Measurement noise is an integral part while collecting data of a physical process. Thus, noise removal is necessary to draw conclusions from these data, and it often becomes essential to construct dynamical models using these data. We discuss a methodology to learn differential equation(s) using noisy and irregular sampled measurements. In our methodology, the main innovation can be seen in the in… ▽ More Measurement noise is an integral part while collecting data of a physical process. Thus, noise removal is necessary to draw conclusions from these data, and it often becomes essential to construct dynamical models using these data. We discuss a methodology to learn differential equation(s) using noisy and irregular sampled measurements. In our methodology, the main innovation can be seen in the integration of deep neural networks with the neural ordinary differential equations (ODEs) approach. Precisely, we aim at learning a neural network that provides (approximately) an implicit representation of the data and an additional neural network that models the vector fields of the dependent variables. We combine these two networks by constraining using neural ODEs. The proposed framework to learn a model describing the vector field is highly effective under noisy measurements. The approach can handle scenarios where dependent variables are not available at the same temporal grid. Moreover, a particular structure, e.g., second-order with respect to time, can easily be incorporated. We demonstrate the effectiveness of the proposed method for learning models using data obtained from various differential equations and present a comparison with the neural ODE method that does not make any special treatment to noise. △ Less

Submitted 19 May, 2022; originally announced May 2022.

Comments: arXiv admin note: substantial text overlap with arXiv:2109.11446

Learning Dynamics from Noisy Measurements using Deep Learning with a Runge-Kutta Constraint

Authors: Pawan Goyal, Peter Benner

Abstract: Measurement noise is an integral part while collecting data of a physical process. Thus, noise removal is a necessary step to draw conclusions from these data, and it often becomes quite essential to construct dynamical models using these data. We discuss a methodology to learn differential equation(s) using noisy and sparsely sampled measurements. In our methodology, the main innovation can be se… ▽ More Measurement noise is an integral part while collecting data of a physical process. Thus, noise removal is a necessary step to draw conclusions from these data, and it often becomes quite essential to construct dynamical models using these data. We discuss a methodology to learn differential equation(s) using noisy and sparsely sampled measurements. In our methodology, the main innovation can be seen in of integration of deep neural networks with a classical numerical integration method. Precisely, we aim at learning a neural network that implicitly represents the data and an additional neural network that models the vector fields of the dependent variables. We combine these two networks by enforcing the constraint that the data at the next time-steps can be given by following a numerical integration scheme such as the fourth-order Runge-Kutta scheme. The proposed framework to learn a model predicting the vector field is highly effective under noisy measurements. The approach can handle scenarios where dependent variables are not available at the same temporal grid. We demonstrate the effectiveness of the proposed method to learning models using data obtained from various differential equations. The proposed approach provides a promising methodology to learn dynamic models, where the first-principle understanding remains opaque. △ Less

Submitted 23 September, 2021; originally announced September 2021.

A Greedy Data Collection Scheme For Linear Dynamical Systems

Authors: Karim Cherifi, Pawan Goyal, Peter Benner

Abstract: Mathematical models are essential to analyze and understand the dynamics of complex systems. Recently, data-driven methodologies have got a lot of attention which is leveraged by advancements in sensor technology. However, the quality of obtained data plays a vital role in learning a good and reliable model. Therefore, in this paper, we propose an efficient heuristic methodology to collect data bo… ▽ More Mathematical models are essential to analyze and understand the dynamics of complex systems. Recently, data-driven methodologies have got a lot of attention which is leveraged by advancements in sensor technology. However, the quality of obtained data plays a vital role in learning a good and reliable model. Therefore, in this paper, we propose an efficient heuristic methodology to collect data both in the frequency domain and time-domain, aiming at the best possible information gain from limited experimental data. The efficiency of the proposed methodology is illustrated by means of several examples, and also, its robustness in the presence of noisy data is shown. △ Less

Submitted 27 July, 2021; originally announced July 2021.

LQResNet: A Deep Neural Network Architecture for Learning Dynamic Processes

Authors: Pawan Goyal, Peter Benner

Abstract: Mathematical modeling is an essential step, for example, to analyze the transient behavior of a dynamical process and to perform engineering studies such as optimization and control. With the help of first-principles and expert knowledge, a dynamic model can be built, but for complex dynamic processes, appearing, e.g., in biology, chemical plants, neuroscience, financial markets, this often remain… ▽ More Mathematical modeling is an essential step, for example, to analyze the transient behavior of a dynamical process and to perform engineering studies such as optimization and control. With the help of first-principles and expert knowledge, a dynamic model can be built, but for complex dynamic processes, appearing, e.g., in biology, chemical plants, neuroscience, financial markets, this often remains an onerous task. Hence, data-driven modeling of the dynamics process becomes an attractive choice and is supported by the rapid advancement in sensor and measurement technology. A data-driven approach, namely operator inference framework, models a dynamic process, where a particular structure of the nonlinear term is assumed. In this work, we suggest combining the operator inference with certain deep neural network approaches to infer the unknown nonlinear dynamics of the system. The approach uses recent advancements in deep learning and possible prior knowledge of the process if possible. We also briefly discuss several extensions and advantages of the proposed methodology. We demonstrate that the proposed methodology accomplishes the desired tasks for dynamics processes encountered in neural dynamics and the glycolytic oscillator. △ Less

Submitted 27 March, 2021; v1 submitted 3 March, 2021; originally announced March 2021.

Random Sampling in Reproducing Kernel Subspace of Mixed Lebesgue Spaces

Authors: Prashant Goyal, Dhiraj Patel, Sivananthan Sampath

Abstract: In this article, we consider the random sampling in the image space $V$ of mixed Lebesgue space $L^{p,q}(\mathbb{R}^{n+1})$ under an idempotent integral operator. We assume some decay and regularity conditions of the kernel and approximate the unit sphere in $V$ on a bounded cube $C_{R,S}$ by a finite-dimensional subspace of $V$. Consequently, the set of concentrated functions is totally bounded.… ▽ More In this article, we consider the random sampling in the image space $V$ of mixed Lebesgue space $L^{p,q}(\mathbb{R}^{n+1})$ under an idempotent integral operator. We assume some decay and regularity conditions of the kernel and approximate the unit sphere in $V$ on a bounded cube $C_{R,S}$ by a finite-dimensional subspace of $V$. Consequently, the set of concentrated functions is totally bounded. We prove with an overwhelming probability that the random sample set uniformly distributed over $C_{R,S}$ is a stable set of sampling for the set of concentrated functions on $C_{R,S}$. Moreover, we propose an iterative scheme to reconstruct the concentrated signal from its random measurements. △ Less

Submitted 20 July, 2021; v1 submitted 17 February, 2021; originally announced February 2021.

Comments: Communicated

Operator Inference and Physics-Informed Learning of Low-Dimensional Models for Incompressible Flows

Authors: Peter Benner, Pawan Goyal, Jan Heiland, Igor Pontes Duff

Abstract: Reduced-order modeling has a long tradition in computational fluid dynamics. The ever-increasing significance of data for the synthesis of low-order models is well reflected in the recent successes of data-driven approaches such as Dynamic Mode Decomposition and Operator Inference. With this work, we suggest a new approach to learning structured low-order models for incompressible flow from data t… ▽ More Reduced-order modeling has a long tradition in computational fluid dynamics. The ever-increasing significance of data for the synthesis of low-order models is well reflected in the recent successes of data-driven approaches such as Dynamic Mode Decomposition and Operator Inference. With this work, we suggest a new approach to learning structured low-order models for incompressible flow from data that can be used for engineering studies such as control, optimization, and simulation. To that end, we utilize the intrinsic structure of the Navier-Stokes equations for incompressible flows and show that learning dynamics of the velocity and pressure can be decoupled, thus leading to an efficient operator inference approach for learning the underlying dynamics of incompressible flows. Furthermore, we show the operator inference performance in learning low-order models using two benchmark problems and compare with an intrusive method, namely proper orthogonal decomposition, and other data-driven approaches. △ Less

Submitted 7 December, 2020; v1 submitted 13 October, 2020; originally announced October 2020.

Comments: 23 pages, 14 figures

MSC Class: 37N10; 68T05; 76D05; 65F22; 93A15; 93C10

Data-Driven Learning of Reduced-order Dynamics for a Parametrized Shallow Water Equation

Authors: Süleyman Yıldız, Pawan Goyal, Peter Benner, Bülent Karasözen

Abstract: This paper discusses a non-intrusive data-driven model order reduction method that learns low-dimensional dynamical models for a parametrized shallow water equation. We consider the shallow water equation in non-traditional form (NTSWE). We focus on learning low-dimensional models in a non-intrusive way. That means, we assume not to have access to a discretized form of the NTSWE in any form. Inste… ▽ More This paper discusses a non-intrusive data-driven model order reduction method that learns low-dimensional dynamical models for a parametrized shallow water equation. We consider the shallow water equation in non-traditional form (NTSWE). We focus on learning low-dimensional models in a non-intrusive way. That means, we assume not to have access to a discretized form of the NTSWE in any form. Instead, we have snapshots that are obtained using a black-box solver. Consequently, we aim at learning reduced-order models only from the snapshots. Precisely, a reduced-order model is learnt by solving an appropriate least-squares optimization problem in a low-dimensional subspace. Furthermore, we discuss computational challenges that particularly arise from the optimization problem being ill-conditioned. Moreover, we extend the non-intrusive model order reduction framework to a parametric case where we make use of the parameter dependency at the level of the partial differential equation. We illustrate the efficiency of the proposed non-intrusive method to construct reduced-order models for NTSWE and compare it with an intrusive method (proper orthogonal decomposition). We furthermore discuss the predictive capabilities of both models outside the range of the training data. △ Less

Submitted 4 August, 2020; v1 submitted 28 July, 2020; originally announced July 2020.

Low-dimensional approximations of high-dimensional asset price models

Authors: Martin Redmann, Christian Bayer, Pawan Goyal

Abstract: We consider high-dimensional asset price models that are reduced in their dimension in order to reduce the complexity of the problem or the effect of the curse of dimensionality in the context of option pricing. We apply model order reduction (MOR) to obtain a reduced system. MOR has been previously studied for asymptotically stable controlled stochastic systems with zero initial conditions. Howev… ▽ More We consider high-dimensional asset price models that are reduced in their dimension in order to reduce the complexity of the problem or the effect of the curse of dimensionality in the context of option pricing. We apply model order reduction (MOR) to obtain a reduced system. MOR has been previously studied for asymptotically stable controlled stochastic systems with zero initial conditions. However, stochastic differential equations modeling price processes are uncontrolled, have non-zero initial states and are often unstable. Therefore, we extend MOR schemes and combine ideas of techniques known for deterministic systems. This leads to a method providing a good pathwise approximation. After explaining the reduction procedure, the error of the approximation is analyzed and the performance of the algorithm is shown conducting several numerical experiments. Within the numerics section, the benefit of the algorithm in the context of option pricing is pointed out. △ Less

Submitted 1 April, 2021; v1 submitted 15 March, 2020; originally announced March 2020.

MSC Class: Primary: 91G20; 91G60; 93A15 Secondary: 60H10; 65C30

Operator inference for non-intrusive model reduction of systems with non-polynomial nonlinear terms

Authors: Peter Benner, Pawan Goyal, Boris Kramer, Benjamin Peherstorfer, Karen Willcox

Abstract: This work presents a non-intrusive model reduction method to learn low-dimensional models of dynamical systems with non-polynomial nonlinear terms that are spatially local and that are given in analytic form. In contrast to state-of-the-art model reduction methods that are intrusive and thus require full knowledge of the governing equations and the operators of a full model of the discretized dyna… ▽ More This work presents a non-intrusive model reduction method to learn low-dimensional models of dynamical systems with non-polynomial nonlinear terms that are spatially local and that are given in analytic form. In contrast to state-of-the-art model reduction methods that are intrusive and thus require full knowledge of the governing equations and the operators of a full model of the discretized dynamical system, the proposed approach requires only the non-polynomial terms in analytic form and learns the rest of the dynamics from snapshots computed with a potentially black-box full-model solver. The proposed method learns operators for the linear and polynomially nonlinear dynamics via a least-squares problem, where the given non-polynomial terms are incorporated in the right-hand side. The least-squares problem is linear and thus can be solved efficiently in practice. The proposed method is demonstrated on three problems governed by partial differential equations, namely the diffusion-reaction Chafee-Infante model, a tubular reactor model for reactive flows, and a batch-chromatography model that describes a chemical separation process. The numerical results provide evidence that the proposed approach learns reduced models that achieve comparable accuracy as models constructed with state-of-the-art intrusive model reduction methods that require full knowledge of the governing equations. △ Less

Submitted 19 September, 2020; v1 submitted 22 February, 2020; originally announced February 2020.

Identification of Dominant Subspaces for Linear Structured Parametric Systems and Model Reduction

Authors: Peter Benner, Pawan Goyal, Igor Pontes Duff

Abstract: In this paper, we discuss a novel model reduction framework for generalized linear systems. The transfer functions of these systems are assumed to have a special structure, e.g., coming from second-order linear systems and time-delay systems, and they may also have parameter dependencies. Firstly, we investigate the connection between classic interpolation-based model reduction methods with the re… ▽ More In this paper, we discuss a novel model reduction framework for generalized linear systems. The transfer functions of these systems are assumed to have a special structure, e.g., coming from second-order linear systems and time-delay systems, and they may also have parameter dependencies. Firstly, we investigate the connection between classic interpolation-based model reduction methods with the reachability and observability subspaces of linear structured parametric systems. We show that if enough interpolation points are taken, the projection matrices of interpolation-based model reduction encode these subspaces. As a result, we are able to identify the dominant reachable and observable subspaces of the underlying system. Based on this, we propose a new model reduction algorithm combining these features leading to reduced-order systems. Furthermore, we pay special attention to computational aspects of the approach and discuss its applicability to a large-scale setting. We illustrate the efficiency of the proposed approach with several numerical large-scale benchmark examples. △ Less

Submitted 30 October, 2019; originally announced October 2019.

Data-Driven Identification of Rayleigh-Damped Second-Order Systems

Authors: Igor Pontes Duff, Pawan Goyal, Peter Benner

Abstract: In this paper, we present a data-driven approach to identify second-order systems, having internal Rayleigh dam**. This means that the dam** matrix is given as a linear combination of the mass and stiffness matrices. These systems typically appear when performing various engineering studies, e.g., vibrational and structural analysis. In an experimental setup, the frequency response of a system… ▽ More In this paper, we present a data-driven approach to identify second-order systems, having internal Rayleigh dam**. This means that the dam** matrix is given as a linear combination of the mass and stiffness matrices. These systems typically appear when performing various engineering studies, e.g., vibrational and structural analysis. In an experimental setup, the frequency response of a system can be measured via various approaches, for instance, by measuring the vibrations using an accelerometer. As a consequence, given frequency samples, the identification of the underlying system relies on rational approximation. To that aim, we propose an identification of the corresponding second-order system, extending the Loewner framework for this class of systems. The efficiency of the proposed method is demonstrated by means of various numerical benchmarks. △ Less

Submitted 2 October, 2019; originally announced October 2019.

Comments: 16 pages, 6 figures

Gramians, Energy Functionals and Balanced Truncation for Linear Dynamical Systems with Quadratic Outputs

Authors: Peter Benner, Pawan Goyal, Igor Pontes Duff

Abstract: Model order reduction is a technique that is used to construct low-order approximations of large-scale dynamical systems. In this paper, we investigate a balancing based model order reduction method for dynamical systems with a linear dynamical equation and a quadratic output function. To this aim, we propose a new algebraic observability Gramian for the system based on Hilbert space adjoint theor… ▽ More Model order reduction is a technique that is used to construct low-order approximations of large-scale dynamical systems. In this paper, we investigate a balancing based model order reduction method for dynamical systems with a linear dynamical equation and a quadratic output function. To this aim, we propose a new algebraic observability Gramian for the system based on Hilbert space adjoint theory. We then show the proposed Gramians satisfy a particular type of generalized Lyapunov equations and we investigate their connections to energy functionals, namely, the controllability and observability. This allows us to find the states that are hard to control and hard to observe via an appropriate balancing transformation. Truncation of such states yields reduced-order systems. Finally, based on $\mathcal H_2$ energy considerations, we, furthermore, derive error bounds, depending on the neglected singular values. The efficiency of the proposed method is demonstrated by means of two semi-discretized partial differential equations and is compared with the existing model reduction techniques in the literature. △ Less

Submitted 10 September, 2019; originally announced September 2019.

Comments: 26 pages

MSC Class: 34C20; 93A15; 93C10; 93C15

Interpolation-Based Model Order Reduction for Polynomial Parametric Systems

Authors: Peter Benner, Pawan Goyal

Abstract: In this work, we investigate a model order reduction scheme for polynomial parametric systems. We begin with defining the generalized multivariate transfer functions for the system. Based on this, we aim at constructing a reduced-order system, interpolating the defined generalized transfer functions at a given set of interpolation points. Furthermore, we provide a method, inspired by the Loewner a… ▽ More In this work, we investigate a model order reduction scheme for polynomial parametric systems. We begin with defining the generalized multivariate transfer functions for the system. Based on this, we aim at constructing a reduced-order system, interpolating the defined generalized transfer functions at a given set of interpolation points. Furthermore, we provide a method, inspired by the Loewner approach for linear and (quadratic-)bilinear systems, to determine a good-quality reduced-order system in an automatic way. We also discuss the computational issues related to the proposed method and a potential application of CUR matrix approximation in order to further speed-up simulations of reduced-order systems. We test the efficiency of the proposed methods via several numerical examples. △ Less

Submitted 26 April, 2019; originally announced April 2019.

Global Attractor For Weakly Damped, Forced Mkdv Equation Below Energy Space

Authors: Prashant Goyal

Abstract: We prove the existence of the global attractor in $ \dot H^s$, $s > 11/12$ for the weakly damped and forced mKdV on the one dimensional torus. The existence of global attractor below the energy space has not been known, though the global well-posedness below the energy space is established. We directly apply the I-method to the damped and forced mKdV, because the Miura transformation does not work… ▽ More We prove the existence of the global attractor in $ \dot H^s$, $s > 11/12$ for the weakly damped and forced mKdV on the one dimensional torus. The existence of global attractor below the energy space has not been known, though the global well-posedness below the energy space is established. We directly apply the I-method to the damped and forced mKdV, because the Miura transformation does not work for the mKdV with dam** and forcing terms. We need to make a close investigation into the trilinear estimates involving resonant frequencies, which are different from the bilinear estimates corresponding to the KdV. △ Less

Submitted 25 September, 2018; originally announced September 2018.

Comments: 34 pages. Submitted on December 15, 2017

Journal ref: Nagoya Mathematical Journal, 2019

Towards Time-Limited $\mathcal H_2$-Optimal Model Order Reduction

Authors: Pawan Goyal, Martin Redmann

Abstract: In order to solve partial differential equations numerically and accurately, a high order spatial discretization is usually needed. Model order reduction (MOR) techniques are often used to reduce the order of spatially-discretized systems and hence reduce computational complexity. A particular class of MOR techniques are $\mathcal H_2$-optimal methods such as the iterative rational Krylov subspace… ▽ More In order to solve partial differential equations numerically and accurately, a high order spatial discretization is usually needed. Model order reduction (MOR) techniques are often used to reduce the order of spatially-discretized systems and hence reduce computational complexity. A particular class of MOR techniques are $\mathcal H_2$-optimal methods such as the iterative rational Krylov subspace algorithm (IRKA) and related schemes. However, these methods are used to obtain good approximations on a infinite time-horizon. Thus, in this work, our main goal is to discuss MOR schemes for time-limited linear systems. For this, we propose an alternative time-limited $\mathcal H_2$-norm and show its connection with the time-limited Gramians. We then provide first-order optimality conditions for an optimal reduced order model (ROM) with respect to the time-limited $\mathcal H_2$-norm. Based on these optimality conditions, we propose an iterative scheme, which, upon convergence, aims at satisfying these conditions approximately. Then, we analyze how far away the obtained ROM due to the proposed algorithm is from satisfying the optimality conditions. We test the efficiency of the proposed iterative scheme using various numerical examples and illustrate that the newly proposed iterative method can lead to a better reduced-order compared to the unrestricted IRKA in the finite time interval of interest. △ Less

Submitted 1 December, 2017; originally announced December 2017.

MSC Class: 15A16; 15A24; 93A15; 93C05

An Iterative Model Reduction Scheme for Quadratic-Bilinear Descriptor Systems with an Application to Navier-Stokes Equations

Authors: Peter Benner, Pawan Goyal

Abstract: We discuss model reduction for a particular class of quadratic-bilinear (QB) descriptor systems. The main goal of this article is to extend the recently studied interpolation-based optimal model reduction framework for QBODEs [Benner et al. '16] to a class of descriptor systems in an efficient and reliable way. Recently, it has been shown in the case of linear or bilinear systems that a direct ext… ▽ More We discuss model reduction for a particular class of quadratic-bilinear (QB) descriptor systems. The main goal of this article is to extend the recently studied interpolation-based optimal model reduction framework for QBODEs [Benner et al. '16] to a class of descriptor systems in an efficient and reliable way. Recently, it has been shown in the case of linear or bilinear systems that a direct extension of interpolation-based model reduction techniques to descriptor systems, without any modifications, may lead to poor reduced-order systems. Therefore, for the analysis, we aim at transforming the considered QB descriptor system into an equivalent QBODE system by means of projectors for which standard model reduction techniques for QBODEs can be employed, including aforementioned interpolation scheme. Subsequently, we discuss related computational issues, thus resulting in a modified algorithm that allows us to construct \emph{near}--optimal reduced-order systems without explicitly computing the projectors used in the analysis. The efficiency of the proposed algorithm is illustrated by means of a numerical example, obtained via semi-discretization of the Navier-Stokes equations. △ Less

Submitted 2 May, 2017; originally announced May 2017.

Balanced Truncation Model Order Reduction For Quadratic-Bilinear Control Systems

Authors: Peter Benner, Pawan Goyal

Abstract: We discuss balanced truncation model order reduction for large-scale quadratic-bilinear (QB) systems. Balanced truncation for linear systems mainly involves the computation of the Gramians of the system, namely reachability and observability Gramians. These Gramians are extended to a general nonlinear setting in Scherpen (1993), where it is shown that Gramians for nonlinear systems are the solutio… ▽ More We discuss balanced truncation model order reduction for large-scale quadratic-bilinear (QB) systems. Balanced truncation for linear systems mainly involves the computation of the Gramians of the system, namely reachability and observability Gramians. These Gramians are extended to a general nonlinear setting in Scherpen (1993), where it is shown that Gramians for nonlinear systems are the solutions of state-dependent nonlinear Hamilton-Jacobi equations. Therefore, they are not only difficult to compute for large-scale systems but also hard to utilize in the model reduction framework. In this paper, we propose algebraic Gramians for QB systems based on the underlying Volterra series representation of QB systems and their Hilbert adjoint systems. We then show their relations with a certain type of generalized quadratic Lyapunov equation. Furthermore, we present how these algebraic Gramians and energy functionals relate to each other. Moreover, we characterize the reachability and observability of QB systems based on the proposed algebraic Gramians. This allows us to find those states that are hard to control and hard to observe via an appropriate transformation based on the Gramians. Truncating such states yields reduced-order systems. Additionally, we present a truncated version of the Gramians for QB systems and discuss their advantages in the model reduction framework. We also investigate the Lyapunov stability of the reduced-order systems. We finally illustrate the efficiency of the proposed balancing-type model reduction for QB systems by means of various semi-discretized nonlinear partial differential equations and show its competitiveness with the existing moment-matching methods for QB systems. △ Less

Submitted 29 April, 2017; originally announced May 2017.

MSC Class: 15A69; 34C20; 41A05; 49M05; 93A15; 93C10; 93C15

Invariant Theory of finite general linear groups modulo Frobenius powers

Authors: Pallav Goyal

Abstract: We prove some cases of a conjecture of Lewis, Reiner and Stanton regarding Hilbert series corresponding to the action of $Gl_n(\mathbb{F}_q)$ on a polynomial ring modulo Frobenius powers. We also give a few conjectures about the invariant ring for certain cases that we don't prove completely. We prove some cases of a conjecture of Lewis, Reiner and Stanton regarding Hilbert series corresponding to the action of $Gl_n(\mathbb{F}_q)$ on a polynomial ring modulo Frobenius powers. We also give a few conjectures about the invariant ring for certain cases that we don't prove completely. △ Less

Submitted 23 January, 2017; originally announced January 2017.

Journal ref: Communications in Algebra, 46:10 (2018), 4511-4529

$\mathcal H_2$-Quasi-Optimal Model Order Reduction for Quadratic-Bilinear Control Systems

Authors: Peter Benner, Pawan Goyal, Serkan Gugercin

Abstract: We investigate the optimal model reduction problem for large-scale quadratic-bilinear (QB) control systems. Our contributions are threefold. First, we discuss the variational analysis and the Volterra series formulation for QB systems. We then define the $\mathcal H_2$-norm for a QB system based on the kernels of the underlying Volterra series and also propose a truncated $\mathcal H_2$-norm. Next… ▽ More We investigate the optimal model reduction problem for large-scale quadratic-bilinear (QB) control systems. Our contributions are threefold. First, we discuss the variational analysis and the Volterra series formulation for QB systems. We then define the $\mathcal H_2$-norm for a QB system based on the kernels of the underlying Volterra series and also propose a truncated $\mathcal H_2$-norm. Next, we derive first-order necessary conditions for an optimal approximation, where optimality is measured in term of the truncated $\mathcal H_2$-norm of the error system. We then propose an iterative model reduction algorithm, which upon convergence yields a reduced-order system that approximately satisfies the newly derived optimality conditions. We also discuss an efficient computation of the reduced Hessian, using the special Kronecker structure of the Hessian of the system. We illustrate the efficiency of the proposed method by means of several numerical examples resulting from semi-discretized nonlinear partial differential equations and show its competitiveness with the existing model reduction schemes for QB systems such as moment-matching methods and balanced truncation. △ Less

Submitted 16 May, 2017; v1 submitted 11 October, 2016; originally announced October 2016.

Finding Even Subgraphs Even Faster

Authors: Prachi Goyal, Pranabendu Misra, Fahad Panolan, Geevarghese Philip, Saket Saurabh

Abstract: Problems of the following kind have been the focus of much recent research in the realm of parameterized complexity: Given an input graph (digraph) on $n$ vertices and a positive integer parameter $k$, find if there exist $k$ edges (arcs) whose deletion results in a graph that satisfies some specified parity constraints. In particular, when the objective is to obtain a connected graph in which all… ▽ More Problems of the following kind have been the focus of much recent research in the realm of parameterized complexity: Given an input graph (digraph) on $n$ vertices and a positive integer parameter $k$, find if there exist $k$ edges (arcs) whose deletion results in a graph that satisfies some specified parity constraints. In particular, when the objective is to obtain a connected graph in which all the vertices have even degrees---where the resulting graph is \emph{Eulerian}---the problem is called Undirected Eulerian Edge Deletion. The corresponding problem in digraphs where the resulting graph should be strongly connected and every vertex should have the same in-degree as its out-degree is called Directed Eulerian Edge Deletion. Cygan et al. [\emph{Algorithmica, 2014}] showed that these problems are fixed parameter tractable (FPT), and gave algorithms with the running time $2^{O(k \log k)}n^{O(1)}$. They also asked, as an open problem, whether there exist FPT algorithms which solve these problems in time $2^{O(k)}n^{O(1)}$. In this paper we answer their question in the affirmative: using the technique of computing \emph{representative families of co-graphic matroids} we design algorithms which solve these problems in time $2^{O(k)}n^{O(1)}$. The crucial insight we bring to these problems is to view the solution as an independent set of a co-graphic matroid. We believe that this view-point/approach will be useful in other problems where one of the constraints that need to be satisfied is that of connectivity. △ Less

Submitted 17 September, 2014; originally announced September 2014.