-
Strictly Decentralized Adaptive Estimation of External Fields using Reproducing Kernels
Authors:
Jia Guo,
Michael E. Kepler,
Sai Tej Paruchuri,
Haoran Wang,
Andrew J. Kurdila,
Daniel J. Stilwell
Abstract:
This paper describes an adaptive method in continuous time for the estimation of external fields by a team of $N$ agents. The agents $i$ each explore subdomains $Ω^i$ of a bounded subset of interest $Ω\subset X := \mathbb{R}^d$. Ideal adaptive estimates $\hat{g}^i_t$ are derived for each agent from a distributed parameter system (DPS) that takes values in the scalar-valued reproducing kernel Hilbe…
▽ More
This paper describes an adaptive method in continuous time for the estimation of external fields by a team of $N$ agents. The agents $i$ each explore subdomains $Ω^i$ of a bounded subset of interest $Ω\subset X := \mathbb{R}^d$. Ideal adaptive estimates $\hat{g}^i_t$ are derived for each agent from a distributed parameter system (DPS) that takes values in the scalar-valued reproducing kernel Hilbert space $H_X$ of functions over $X$. Approximations of the evolution of the ideal local estimate $\hat{g}^i_t$ of agent $i$ is constructed solely using observations made by agent $i$ on a fine time scale. Since the local estimates on the fine time scale are constructed independently for each agent, we say that the method is strictly decentralized. On a coarse time scale, the individual local estimates $\hat{g}^i_t$ are fused via the expression $\hat{g}_t:=\sum_{i=1}^NΨ^i \hat{g}^i_t$ that uses a partition of unity $\{Ψ^i\}_{1\leq i\leq N}$ subordinate to the cover $\{Ω^i\}_{i=1,\ldots,N}$ of $Ω$. Realizable algorithms are obtained by constructing finite dimensional approximations of the DPS in terms of scattered bases defined by each agent from samples along their trajectories. Rates of convergence of the error in the finite dimensional approximations are derived in terms of the fill distance of the samples that define the scattered centers in each subdomain. The qualitative performance of the convergence rates for the decentralized estimation method is illustrated via numerical simulations.
△ Less
Submitted 23 March, 2021;
originally announced March 2021.
-
Approximations of the Reproducing Kernel Hilbert Space (RKHS) Embedding Method over Manifolds
Authors:
Jia Guo,
Sai Tej Paruchuri,
Andrew J. Kurdila
Abstract:
The reproducing kernel Hilbert space (RKHS) embedding method is a recently introduced estimation approach that seeks to identify the unknown or uncertain function in the governing equations of a nonlinear set of ordinary differential equations (ODEs). While the original state estimate evolves in Euclidean space, the function estimate is constructed in an infinite-dimensional RKHS that must be appr…
▽ More
The reproducing kernel Hilbert space (RKHS) embedding method is a recently introduced estimation approach that seeks to identify the unknown or uncertain function in the governing equations of a nonlinear set of ordinary differential equations (ODEs). While the original state estimate evolves in Euclidean space, the function estimate is constructed in an infinite-dimensional RKHS that must be approximated in practice. When a finite-dimensional approximation is constructed using a basis defined in terms of shifted kernel functions centered at the observations along a trajectory, the RKHS embedding method can be understood as a data-driven approach. This paper derives sufficient conditions that ensure that approximations of the unknown function converge in a Sobolev norm over a submanifold that supports the dynamics. Moreover, the rate of convergence for the finite-dimensional approximations is derived in terms of the fill distance of the samples in the embedded manifold. Numerical simulation of an example problem is carried out to illustrate the qualitative nature of convergence results derived in the paper.
△ Less
Submitted 12 July, 2020;
originally announced July 2020.
-
Intrinsic and Extrinsic Approximation of Koopman Operators over Manifolds
Authors:
Sai Tej Paruchuri,
Jia Guo,
Michael Kepler,
Tim Ryan,
Haoran Wang,
Andrew J. Kurdila,
Daniel Stilwell
Abstract:
This paper derives rates of convergence of certain approximations of the Koopman operators that are associated with discrete, deterministic, continuous semiflows on a complete metric space $(X,d_X)$. Approximations are constructed in terms of reproducing kernel bases that are centered at samples taken along the system trajectory. It is proven that when the samples are dense in a certain type of sm…
▽ More
This paper derives rates of convergence of certain approximations of the Koopman operators that are associated with discrete, deterministic, continuous semiflows on a complete metric space $(X,d_X)$. Approximations are constructed in terms of reproducing kernel bases that are centered at samples taken along the system trajectory. It is proven that when the samples are dense in a certain type of smooth manifold $M\subseteq X$, the derived rates of convergence depend on the fill distance of samples along the trajectory in that manifold. Error bounds for projection-based and data-dependent approximations of the Koopman operator are derived in the paper. A discussion of how these bounds are realized in intrinsic and extrinsic approximation methods is given. Finally, a numerical example that illustrates qualitatively the convergence guarantees derived in the paper is given.
△ Less
Submitted 11 April, 2020;
originally announced April 2020.
-
RKHS Embedding for Estimating Nonlinear Piezoelectric Systems
Authors:
Sai Tej Paruchuri,
Jia Guo,
Andrew J. Kurdila
Abstract:
Nonlinearities in piezoelectric systems can arise from internal factors such as nonlinear constitutive laws or external factors like realizations of boundary conditions. It can be difficult or even impossible to derive detailed models from the first principles of all the sources of nonlinearity in a system. As a specific example, in traditional modeling techniques that use electric enthalpy densit…
▽ More
Nonlinearities in piezoelectric systems can arise from internal factors such as nonlinear constitutive laws or external factors like realizations of boundary conditions. It can be difficult or even impossible to derive detailed models from the first principles of all the sources of nonlinearity in a system. As a specific example, in traditional modeling techniques that use electric enthalpy density with higher-order terms, it can be problematic to choose which polynomial nonlinearities are essential. This paper introduces adaptive estimator techniques to estimate the nonlinearities that can arise in certain piezoelectric systems. Here an underlying assumption is that the nonlinearities can be modeled as functions in a reproducing kernel Hilbert space (RKHS). Unlike traditional modeling approaches, the approach discussed in this paper allows the development of models without knowledge of the precise form or structure of the nonlinearity. This approach can be viewed as a data-driven method to approximate the unknown nonlinear system. This paper introduces the theory behind the adaptive estimator and studies the effectiveness of this approach numerically for a class of nonlinear piezoelectric composite beams.
△ Less
Submitted 17 February, 2020;
originally announced February 2020.
-
Persistence of Excitation in Reproducing Kernel Hilbert Spaces, Positive Limit Sets, and Smooth Manifolds
Authors:
Andrew J. Kurdila,
Jia Guo,
Sai Tej Paruchuri,
Parag Bobade
Abstract:
This paper studies the relationship between the positive limit sets of continuous semiflows and the newly introduced definition of persistently excited (PE) sets and associated subspaces of reproducing kernel Hilbert (RKH) spaces. It is shown that if the RKH space contains a rich collection of cut-off functions, persistently excited sets are contained as subsets of the positive limit set of the se…
▽ More
This paper studies the relationship between the positive limit sets of continuous semiflows and the newly introduced definition of persistently excited (PE) sets and associated subspaces of reproducing kernel Hilbert (RKH) spaces. It is shown that if the RKH space contains a rich collection of cut-off functions, persistently excited sets are contained as subsets of the positive limit set of the semiflow. The paper demonstrates how the new PE condition can be used to guarantee convergence of function estimates in the RKH space embedding method for adaptive estimation. In particular, the paper is applied to uncertain ODE systems with positive limit sets given by certain types of smooth manifolds, and it establishes convergence of adaptive function estimates over the manifolds.
△ Less
Submitted 26 September, 2019;
originally announced September 2019.
-
Adaptive Estimation for Nonlinear Systems using Reproducing Kernel Hilbert Spaces
Authors:
Parag Bobade,
Suprotim Majumdar,
Savio Pereira,
Andrew J. Kurdila,
John B. Ferris
Abstract:
This paper extends a conventional, general framework for online adaptive estimation problems for systems governed by unknown nonlinear ordinary differential equations. The central feature of the theory introduced in this paper represents the unknown function as a member of a reproducing kernel Hilbert space (RKHS) and defines a distributed parameter system (DPS) that governs state estimates and es…
▽ More
This paper extends a conventional, general framework for online adaptive estimation problems for systems governed by unknown nonlinear ordinary differential equations. The central feature of the theory introduced in this paper represents the unknown function as a member of a reproducing kernel Hilbert space (RKHS) and defines a distributed parameter system (DPS) that governs state estimates and estimates of the unknown function. This paper 1) derives sufficient conditions for the existence and stability of the infinite dimensional online estimation problem, 2) derives existence and stability of finite dimensional approximations of the infinite dimensional approximations, and 3) determines sufficient conditions for the convergence of finite dimensional approximations to the infinite dimensional online estimates. A new condition for persistency of excitation in a RKHS in terms of its evaluation functionals is introduced in the paper that enables proof of convergence of the finite dimensional approximations of the unknown function in the RKHS. This paper studies two particular choices of the RKHS, those that are generated by exponential functions and those that are generated by multiscale kernels defined from a multiresolution analysis.
△ Less
Submitted 10 July, 2017; v1 submitted 5 July, 2017;
originally announced July 2017.
