-
Quantum Theory and Application of Contextual Optimal Transport
Authors:
Nicola Mariella,
Albert Akhriev,
Francesco Tacchino,
Christa Zoufal,
Juan Carlos Gonzalez-Espitia,
Benedek Harsanyi,
Eugene Koskin,
Ivano Tavernelli,
Stefan Woerner,
Marianna Rapsomaniki,
Sergiy Zhuk,
Jannis Born
Abstract:
Optimal Transport (OT) has fueled machine learning (ML) across many domains. When paired data measurements $(\boldsymbolμ, \boldsymbolν)$ are coupled to covariates, a challenging conditional distribution learning setting arises. Existing approaches for learning a $\textit{global}$ transport map parameterized through a potentially unseen context utilize Neural OT and largely rely on Brenier's theor…
▽ More
Optimal Transport (OT) has fueled machine learning (ML) across many domains. When paired data measurements $(\boldsymbolμ, \boldsymbolν)$ are coupled to covariates, a challenging conditional distribution learning setting arises. Existing approaches for learning a $\textit{global}$ transport map parameterized through a potentially unseen context utilize Neural OT and largely rely on Brenier's theorem. Here, we propose a first-of-its-kind quantum computing formulation for amortized optimization of contextualized transportation plans. We exploit a direct link between doubly stochastic matrices and unitary operators thus unravelling a natural connection between OT and quantum computation. We verify our method (QontOT) on synthetic and real data by predicting variations in cell type distributions conditioned on drug dosage. Importantly we conduct a 24-qubit hardware experiment on a task challenging for classical computers and report a performance that cannot be matched with our classical neural OT approach. In sum, this is a first step toward learning to predict contextualized transportation plans through quantum computing.
△ Less
Submitted 3 June, 2024; v1 submitted 22 February, 2024;
originally announced February 2024.
-
Quantum Optimization: Potential, Challenges, and the Path Forward
Authors:
Amira Abbas,
Andris Ambainis,
Brandon Augustino,
Andreas Bärtschi,
Harry Buhrman,
Carleton Coffrin,
Giorgio Cortiana,
Vedran Dunjko,
Daniel J. Egger,
Bruce G. Elmegreen,
Nicola Franco,
Filippo Fratini,
Bryce Fuller,
Julien Gacon,
Constantin Gonciulea,
Sander Gribling,
Swati Gupta,
Stuart Hadfield,
Raoul Heese,
Gerhard Kircher,
Thomas Kleinert,
Thorsten Koch,
Georgios Korpas,
Steve Lenk,
Jakub Marecek
, et al. (21 additional authors not shown)
Abstract:
Recent advances in quantum computers are demonstrating the ability to solve problems at a scale beyond brute force classical simulation. As such, a widespread interest in quantum algorithms has developed in many areas, with optimization being one of the most pronounced domains. Across computer science and physics, there are a number of algorithmic approaches, often with little linkage. This is fur…
▽ More
Recent advances in quantum computers are demonstrating the ability to solve problems at a scale beyond brute force classical simulation. As such, a widespread interest in quantum algorithms has developed in many areas, with optimization being one of the most pronounced domains. Across computer science and physics, there are a number of algorithmic approaches, often with little linkage. This is further complicated by the fragmented nature of the field of mathematical optimization, where major classes of optimization problems, such as combinatorial optimization, convex optimization, non-convex optimization, and stochastic extensions, have devoted communities. With these aspects in mind, this work draws on multiple approaches to study quantum optimization. Provably exact versus heuristic settings are first explained using computational complexity theory - highlighting where quantum advantage is possible in each context. Then, the core building blocks for quantum optimization algorithms are outlined to subsequently define prominent problem classes and identify key open questions that, if answered, will advance the field. The effects of scaling relevant problems on noisy quantum devices are also outlined in detail, alongside meaningful benchmarking problems. We underscore the importance of benchmarking by proposing clear metrics to conduct appropriate comparisons with classical optimization techniques. Lastly, we highlight two domains - finance and sustainability - as rich sources of optimization problems that could be used to benchmark, and eventually validate, the potential real-world impact of quantum optimization.
△ Less
Submitted 4 December, 2023;
originally announced December 2023.
-
Trotter error bounds and dynamic multi-product formulas for Hamiltonian simulation
Authors:
Sergiy Zhuk,
Niall Robertson,
Sergey Bravyi
Abstract:
Multi-product formulas (MPF) are linear combinations of Trotter circuits offering high-quality simulation of Hamiltonian time evolution with fewer Trotter steps. Here we report two contributions aimed at making multi-product formulas more viable for near-term quantum simulations. First, we extend the theory of Trotter error with commutator scaling developed by Childs, Su, Tran et al. to multi-prod…
▽ More
Multi-product formulas (MPF) are linear combinations of Trotter circuits offering high-quality simulation of Hamiltonian time evolution with fewer Trotter steps. Here we report two contributions aimed at making multi-product formulas more viable for near-term quantum simulations. First, we extend the theory of Trotter error with commutator scaling developed by Childs, Su, Tran et al. to multi-product formulas. Our result implies that multi-product formulas can achieve a quadratic reduction of Trotter error in 1-norm (nuclear norm) on arbitrary time intervals compared with the regular product formulas without increasing the required circuit depth or qubit connectivity. The number of circuit repetitions grows only by a constant factor. Second, we introduce dynamic multi-product formulas with time-dependent coefficients chosen to minimize a certain efficiently computable proxy for the Trotter error. We use a minimax estimation method to make dynamic multi-product formulas robust to uncertainty from algorithmic errors, sampling and hardware noise. We call this method Minimax MPF and we provide a rigorous bound on its error.
△ Less
Submitted 9 February, 2024; v1 submitted 21 June, 2023;
originally announced June 2023.
-
Super Resolution for Turbulent Flows in 2D: Stabilized Physics Informed Neural Networks
Authors:
Mykhaylo Zayats,
Małgorzata J. Zimoń,
Kyongmin Yeo,
Sergiy Zhuk
Abstract:
We propose a new design of a neural network for solving a zero shot super resolution problem for turbulent flows. We embed Luenberger-type observer into the network's architecture to inform the network of the physics of the process, and to provide error correction and stabilization mechanisms. In addition, to compensate for decrease of observer's performance due to the presence of unknown destabil…
▽ More
We propose a new design of a neural network for solving a zero shot super resolution problem for turbulent flows. We embed Luenberger-type observer into the network's architecture to inform the network of the physics of the process, and to provide error correction and stabilization mechanisms. In addition, to compensate for decrease of observer's performance due to the presence of unknown destabilizing forcing, the network is designed to estimate the contribution of the unknown forcing implicitly from the data over the course of training. By running a set of numerical experiments, we demonstrate that the proposed network does recover unknown forcing from data and is capable of predicting turbulent flows in high resolution from low resolution noisy observations.
△ Less
Submitted 15 April, 2022;
originally announced April 2022.
-
Detectability and global observer design for 2D Navier-Stokes equations with uncertain inputs
Authors:
Sergiy Zhuk,
Mykhaylo Zayats,
Emilia Fridman
Abstract:
We present simulation friendly detectability conditions for 2D Navier-Stokes Equation (NSE) with periodic boundary conditions, and describe a generic class of ``detectable'' observation operators: it includes pointwise evaluation of NSE's solution at interpolation nodes, and spatial average measurements. For ``detectable'' observation operators we design a global infinite-dimensional observer for…
▽ More
We present simulation friendly detectability conditions for 2D Navier-Stokes Equation (NSE) with periodic boundary conditions, and describe a generic class of ``detectable'' observation operators: it includes pointwise evaluation of NSE's solution at interpolation nodes, and spatial average measurements. For ``detectable'' observation operators we design a global infinite-dimensional observer for NSE with uncertain possibly destabilizing inputs: in our numerical experiments we illustrate $H^1$-sensitivity of NSE to small perturbations of initial conditions, yet the observer converges for known and uncertain inputs.
△ Less
Submitted 30 March, 2023; v1 submitted 14 October, 2021;
originally announced October 2021.
-
Non-Uniform Stability, Detectability, and, Sliding Mode Observer Design for Time Varying Systems with Unknown Inputs
Authors:
Markus Tranninger,
Sergiy Zhuk,
Martin Steinberger,
Leonid Fridman,
Martin Horn
Abstract:
This paper discusses stability and robustness properties of a recently proposed observer algorithm for linear time varying systems. The observer is based on the approximation and subsequent modification of the non-negative Lyapunov exponents which yields a (non-uniform) exponentially stable error system. Theoretical insights in the construction of the observer are given and the error system is ana…
▽ More
This paper discusses stability and robustness properties of a recently proposed observer algorithm for linear time varying systems. The observer is based on the approximation and subsequent modification of the non-negative Lyapunov exponents which yields a (non-uniform) exponentially stable error system. Theoretical insights in the construction of the observer are given and the error system is analyzed with respect to bounded unknown inputs. Therefor, new conditions for bounded input bounded state stability for linear time varying systems are presented. It is shown that for a specific class of linear time varying systems, a cascaded observer based on higher order sliding mode differentiators can be designed to achieve finite time exact reconstruction of the system states despite the unknown input. A numerical simulation example shows the applicability of the proposed approach.
△ Less
Submitted 17 September, 2018;
originally announced September 2018.
-
Bayesian Classifier for Route Prediction with Markov Chains
Authors:
Jonathan P. Epperlein,
Julien Monteil,
Mingming Liu,
Yingqi Gu,
Sergiy Zhuk,
Robert Shorten
Abstract:
We present here a general framework and a specific algorithm for predicting the destination, route, or more generally a pattern, of an ongoing journey, building on the recent work of [Y. Lassoued, J. Monteil, Y. Gu, G. Russo, R. Shorten, and M. Mevissen, "Hidden Markov model for route and destination prediction," in IEEE International Conference on Intelligent Transportation Systems, 2017]. In the…
▽ More
We present here a general framework and a specific algorithm for predicting the destination, route, or more generally a pattern, of an ongoing journey, building on the recent work of [Y. Lassoued, J. Monteil, Y. Gu, G. Russo, R. Shorten, and M. Mevissen, "Hidden Markov model for route and destination prediction," in IEEE International Conference on Intelligent Transportation Systems, 2017]. In the presented framework, known journey patterns are modelled as stochastic processes, emitting the road segments visited during the journey, and the ongoing journey is predicted by updating the posterior probability of each journey pattern given the road segments visited so far. In this contribution, we use Markov chains as models for the journey patterns, and consider the prediction as final, once one of the posterior probabilities crosses a predefined threshold. Despite the simplicity of both, examples run on a synthetic dataset demonstrate high accuracy of the made predictions.
△ Less
Submitted 31 August, 2018;
originally announced August 2018.
-
Exponentially convergent data assimilation algorithm for Navier-Stokes equations
Authors:
Jason Frank,
Tigran Tchrakian,
Sergiy Zhuk
Abstract:
The paper presents a new state estimation algorithm for a bilinear equation representing the Fourier- Galerkin (FG) approximation of the Navier-Stokes (NS) equations on a torus in R2. This state equation is subject to uncertain but bounded noise in the input (Kolmogorov forcing) and initial conditions, and its output is incomplete and contains bounded noise. The algorithm designs a time-dependent…
▽ More
The paper presents a new state estimation algorithm for a bilinear equation representing the Fourier- Galerkin (FG) approximation of the Navier-Stokes (NS) equations on a torus in R2. This state equation is subject to uncertain but bounded noise in the input (Kolmogorov forcing) and initial conditions, and its output is incomplete and contains bounded noise. The algorithm designs a time-dependent gain such that the estimation error converges to zero exponentially. The sufficient condition for the existence of the gain are formulated in the form of algebraic Riccati equations. To demonstrate the results we apply the proposed algorithm to the reconstruction a chaotic fluid flow from incomplete and noisy data.
△ Less
Submitted 23 December, 2017;
originally announced December 2017.
-
Localised sequential state estimation for advection dominated flows with non-Gaussian uncertainty description
Authors:
Emanuele Ragnoli,
Mykhaylo Zayats,
Fearghal O'Donncha,
Sergiy Zhuk
Abstract:
This paper presents a new iterative state estimation algorithm for advection dominated flows with non-Gaussian uncertainty description of $L^\infty$-type: uncertain initial condition and model error are assumed to be pointvise bounded in space and time, and the observation noise has uncertain but bounded second moments. The algorithm approximates this $L^\infty$-type bounding set by a union of pos…
▽ More
This paper presents a new iterative state estimation algorithm for advection dominated flows with non-Gaussian uncertainty description of $L^\infty$-type: uncertain initial condition and model error are assumed to be pointvise bounded in space and time, and the observation noise has uncertain but bounded second moments. The algorithm approximates this $L^\infty$-type bounding set by a union of possibly overlap** ellipsoids, which are localized (in space) on a number of sub-domains. On each sub-domain the state of the original system is estimated by the standard $L^2$-type filter (e.g. Kalman/minimax filter) which uses Gaussian/ellipsoidal uncertainty description and observations (if any) which correspond to this sub-domain. The resulting local state estimates are stitched together by the iterative d-ADN Schwartz method to reconstruct the state of the original system. The efficacy of the proposed method is demonstrated with a set of numerical examples.
△ Less
Submitted 3 December, 2017;
originally announced December 2017.
-
A detectability criterion and data assimilation for non-linear differential equations
Authors:
Jason Frank,
Sergiy Zhuk
Abstract:
In this paper we propose a new sequential data assimilation method for non-linear ordinary differential equations with compact state space. The method is designed so that the Lyapunov exponents of the corresponding estimation error dynamics are negative, i.e. the estimation error decays exponentially fast. The latter is shown to be the case for generic regular flow maps if and only if the observat…
▽ More
In this paper we propose a new sequential data assimilation method for non-linear ordinary differential equations with compact state space. The method is designed so that the Lyapunov exponents of the corresponding estimation error dynamics are negative, i.e. the estimation error decays exponentially fast. The latter is shown to be the case for generic regular flow maps if and only if the observation matrix H satisfies detectability conditions: the rank of H must be at least as great as the number of nonnegative Lyapunov exponents of the underlying attractor. Numerical experiments illustrate the exponential convergence of the method and the sharpness of the theory for the case of Lorenz96 and Burgers equations with incomplete and noisy observations.
△ Less
Submitted 14 November, 2017;
originally announced November 2017.
-
Minimax state estimates for abstract Neumann problems
Authors:
Alexander Nakonechnyi,
Sergiy Zhuk
Abstract:
The paper presents analytic expressions of minimax (worst-case) estimates for solutions of linear abstract Neumann problems in Hilbert space with uncertain (not necessarily bounded!) inputs and boundary conditions given incomplete observations with stochastic noise. The latter is assumed to have uncertain but bounded correlation operator. It is demonstrated that the minimax estimate is asymptotica…
▽ More
The paper presents analytic expressions of minimax (worst-case) estimates for solutions of linear abstract Neumann problems in Hilbert space with uncertain (not necessarily bounded!) inputs and boundary conditions given incomplete observations with stochastic noise. The latter is assumed to have uncertain but bounded correlation operator. It is demonstrated that the minimax estimate is asymptotically exact under mild assumptions on observations and bounding sets. A relationship between the proposed estimates and a robust pseudo-inversion of compact operators is revealed. This relationship is demonstrated on an academic numerical example: homogeneous Neumann problem for Poisson equation in two spatial dimensions.
△ Less
Submitted 24 December, 2017; v1 submitted 20 October, 2017;
originally announced October 2017.
-
Where computer vision can aid physics: dynamic cloud motion forecasting from satellite images
Authors:
Sergiy Zhuk,
Tigran Tchrakian,
Albert Akhriev,
Siyuan Lu,
Hendrik Hamann
Abstract:
This paper describes a new algorithm for solar energy forecasting from a sequence of Cloud Optical Depth (COD) images. The algorithm is based on the following simple observation: the dynamics of clouds represented by COD images resembles the motion (transport) of a density in a fluid flow. This suggests that, to forecast the motion of COD images, it is sufficient to forecast the flow. The latter,…
▽ More
This paper describes a new algorithm for solar energy forecasting from a sequence of Cloud Optical Depth (COD) images. The algorithm is based on the following simple observation: the dynamics of clouds represented by COD images resembles the motion (transport) of a density in a fluid flow. This suggests that, to forecast the motion of COD images, it is sufficient to forecast the flow. The latter, in turn, can be accomplished by fitting a parametric model of the fluid flow to the COD images observed in the past. Namely, the learning phase of the algorithm is composed of the following steps: (i) given a sequence of COD images, the snapshots of the optical flow are estimated from two consecutive COD images; (ii) these snapshots are then assimilated into a Navier-Stokes Equation (NSE), i.e. an initial velocity field for NSE is selected so that the corresponding NSE' solution is as close as possible to the optical flow snapshots. The prediction phase consists of utilizing a linear transport equation, which describes the propagation of COD images in the fluid flow predicted by NSE, to estimate the future motion of the COD images. The algorithm has been tested on COD images provided by two geostationary operational environmental satellites from NOAA serving the west-hemisphere.
△ Less
Submitted 30 September, 2017;
originally announced October 2017.
-
A Fast Distributed Data-Assimilation Algorithm for Divergence-Free Advection
Authors:
Tigran Tchrakian,
Sergiy Zhuk
Abstract:
In this paper, we introduce a new, fast data assimilation algorithm for a 2D linear advection equation with divergence-free coefficients. We first apply the nodal discontinuous Galerkin (DG) method to discretize the advection equation, and then employ a set of interconnected minimax state estimators (filters) which run in parallel on spatial elements possessing observations. The filters are interc…
▽ More
In this paper, we introduce a new, fast data assimilation algorithm for a 2D linear advection equation with divergence-free coefficients. We first apply the nodal discontinuous Galerkin (DG) method to discretize the advection equation, and then employ a set of interconnected minimax state estimators (filters) which run in parallel on spatial elements possessing observations. The filters are interconnected by means of numerical Lax-Friedrichs fluxes. Each filter is discretised in time by a symplectic Mobius time integrator which preserves all quadratic invariants of the estimation error dynamics. The cost of the proposed algorithm scales linearly with the number of elements. Examples are presented using both synthetic and real data. In the latter case, satellite images are assimilated into a 2D model representing the motion of clouds across the surface of the Earth.
△ Less
Submitted 19 July, 2018; v1 submitted 23 July, 2017;
originally announced July 2017.
-
Recovering Markov Models from Closed-Loop Data
Authors:
Jonathan P. Epperlein,
Robert Shorten,
Sergiy Zhuk
Abstract:
Situations in which recommender systems are used to augument decision making are becoming prevalent in many application domains. Almost always, these prediction tools (recommenders) are created with a view to affecting behavioural change. Clearly, successful applications actuating behavioural change, affect the original model underpinning the predictor, leading to an inconsistency. This feedback l…
▽ More
Situations in which recommender systems are used to augument decision making are becoming prevalent in many application domains. Almost always, these prediction tools (recommenders) are created with a view to affecting behavioural change. Clearly, successful applications actuating behavioural change, affect the original model underpinning the predictor, leading to an inconsistency. This feedback loop is often not considered in standard so-called Big Data learning techniques which rely upon machine learning/statistical learning machinery. The objective of this paper is to develop tools that recover unbiased user models in the presence of recommenders. More specifically, we assume that we observe a time series which is a trajectory of a Markov chain ${R}$ modulated by another Markov chain ${S}$, i.e. the transition matrix of ${R}$ is unknown and depends on the current state of ${S}$. The transition matrix of the latter is also unknown. In other words, at each time instant, ${S}$ selects a transition matrix for ${R}$ within a given set which consists of known and unknown matrices. The state of ${S}$, in turn, depends on the current state of ${R}$ thus introducing a feedback loop. We propose an Expectation-Maximization (EM) type algorithm, which estimates the transition matrices of ${S}$ and ${R}$. Experimental results are given to demonstrate the efficacy of the approach.
△ Less
Submitted 10 November, 2020; v1 submitted 20 June, 2017;
originally announced June 2017.
-
Minimax Observers for Linear DAEs
Authors:
Sergiy Zhuk,
Mihaly Petreczky
Abstract:
In this note we construct minimax observers for linear stationary DAEs with bounded uncertain inputs, given noisy measurements. We prove a new duality principle and show that a finite (infinite) horizon minimax observer exists if and only if the DAE is $\ell$-impulse observable ($\ell$-detectable) . Remarkably, the regularity of the DAE is not required.
In this note we construct minimax observers for linear stationary DAEs with bounded uncertain inputs, given noisy measurements. We prove a new duality principle and show that a finite (infinite) horizon minimax observer exists if and only if the DAE is $\ell$-impulse observable ($\ell$-detectable) . Remarkably, the regularity of the DAE is not required.
△ Less
Submitted 17 February, 2017; v1 submitted 29 August, 2016;
originally announced August 2016.
-
Worst-case multi-objective error estimation and adaptivity
Authors:
E. H. van Brummelen,
S. Zhuk,
G. J. van Zwieten
Abstract:
This paper introduces a new computational methodology for determining a-posteriori multi-objective error estimates for finite-element approximations, and for constructing corresponding (quasi-)optimal adaptive refinements of finite-element spaces. As opposed to the classical goal-oriented approaches, which consider only a single objective functional, the presented methodology applies to general cl…
▽ More
This paper introduces a new computational methodology for determining a-posteriori multi-objective error estimates for finite-element approximations, and for constructing corresponding (quasi-)optimal adaptive refinements of finite-element spaces. As opposed to the classical goal-oriented approaches, which consider only a single objective functional, the presented methodology applies to general closed convex subsets of the dual space and constructs a worst-case error estimate of the finite-element approximation error. This worst-case multi-objective error estimate conforms to a dual-weighted residual, in which the dual solution is associated with an approximate supporting functional of the objective set at the approximation error. We regard both standard approximation errors and data-incompatibility errors associated with incompatibility of boundary data with the trace of the finite-element space. Numerical experiments are presented to demonstrate the efficacy of applying the proposed worst-case multi-objective error in adaptive refinement procedures.
△ Less
Submitted 15 April, 2016;
originally announced April 2016.
-
General Optimization Framework for Robust and Regularized 3D Full Waveform Inversion
Authors:
Stephen Becker,
Lior Horesh,
Aleksandr Aravkin,
Sergiy Zhuk
Abstract:
Scarcity of hydrocarbon resources and high exploration risks motivate the development of high fidelity algorithms and computationally viable approaches to exploratory geophysics. Whereas early approaches considered least-squares minimization, recent developments have emphasized the importance of robust formulations, as well as formulations that allow disciplined encoding of prior information into…
▽ More
Scarcity of hydrocarbon resources and high exploration risks motivate the development of high fidelity algorithms and computationally viable approaches to exploratory geophysics. Whereas early approaches considered least-squares minimization, recent developments have emphasized the importance of robust formulations, as well as formulations that allow disciplined encoding of prior information into the inverse problem formulation. The cost of a more flexible optimization framework is a greater computational complexity, as least-squares optimization can be performed using straightforward methods (e.g., steepest descent, Gauss-Newton, L-BFGS), whilst incorporation of robust (non-smooth) penalties requires custom changes that may be difficult to implement in the context of a general seismic inversion workflow. In this study, we propose a generic, flexible optimization framework capable of incorporating a broad range of noise models, forward models, regularizers, and reparametrization transforms. This framework covers seamlessly robust noise models (such as Huber and Student's $t$), as well as sparse regularizers, projected constraints, and Total Variation regularization. The proposed framework is also expandable --- we explain the adjustments that are required for any new formulation to be included. Lastly, we conclude with few numerical examples demonstrating the versatility of the formulation.
△ Less
Submitted 17 April, 2015;
originally announced April 2015.
-
Solutions of differential-algebraic equations as outputs of LTI systems: application to LQ control problem
Authors:
Mihaly Petreczky,
Sergiy Zhuk
Abstract:
In this paper we synthesize behavioral ideas with geometric control theory and propose a unified geometric framework for representing all solutions of a Linear Time Invariant Differential-Algebraic Equation (DAE-LTI) as outputs of classical Linear Time Invariant systems (ODE-LTI). An algorithm for computing an ODE-LTI that generates solutions of a given DAE-LTI is described. It is shown that two d…
▽ More
In this paper we synthesize behavioral ideas with geometric control theory and propose a unified geometric framework for representing all solutions of a Linear Time Invariant Differential-Algebraic Equation (DAE-LTI) as outputs of classical Linear Time Invariant systems (ODE-LTI). An algorithm for computing an ODE-LTI that generates solutions of a given DAE-LTI is described. It is shown that two different ODE-LTIs which represent the same DAE-LTI are feedback equivalent. The proposed framework is then used to solve an LQ optimal control problem for DAE-LTIs with rectangular matrices.
△ Less
Submitted 31 October, 2016; v1 submitted 29 December, 2013;
originally announced December 2013.
-
Infinite horizon control and minimax observer design for linear DAEs
Authors:
Sergiy Zhuk,
Mihaly Petreczky
Abstract:
In this paper we construct an infinite horizon minimax state observer for a linear stationary differential-algebraic equation (DAE) with uncertain but bounded input and noisy output. We do not assume regularity or existence of a (unique) solution for any initial state of the DAE. Our approach is based on a generalization of Kalman's duality principle. The latter allows us to transform minimax stat…
▽ More
In this paper we construct an infinite horizon minimax state observer for a linear stationary differential-algebraic equation (DAE) with uncertain but bounded input and noisy output. We do not assume regularity or existence of a (unique) solution for any initial state of the DAE. Our approach is based on a generalization of Kalman's duality principle. The latter allows us to transform minimax state estimation problem into a dual control problem for the adjoint DAE: the state estimate in the original problem becomes the control input for the dual problem and the cost function of the latter is, in fact, the worst-case estimation error. Using geometric control theory, we construct an optimal control in the feed-back form and represent it as an output of a stable LTI system. The latter gives the minimax state estimator. In addition, we obtain a solution of infinite-horizon linear quadratic optimal control problem for DAEs.
△ Less
Submitted 13 September, 2013; v1 submitted 5 September, 2013;
originally announced September 2013.
-
Minimax state estimation for linear descriptor systems
Authors:
Sergiy Zhuk
Abstract:
Author's Summary of the dissertation for the degree of the Candidate of Science (physics and mathematics). The aim of the dissertation is to develop a generalized Kalman Duality concept applicable for linear unbounded non-invertible operators and introduce the minimax state estimation theory and algorithms for linear differential-algebraic equations. In particular, the dissertation pursues the fol…
▽ More
Author's Summary of the dissertation for the degree of the Candidate of Science (physics and mathematics). The aim of the dissertation is to develop a generalized Kalman Duality concept applicable for linear unbounded non-invertible operators and introduce the minimax state estimation theory and algorithms for linear differential-algebraic equations. In particular, the dissertation pursues the following goals: - develop generalized duality concept for the minimax state estimation theory for DAEs with unknown but bounded model error and random observation noise with unknown but bounded correlation operator; - derive the minimax state estimation theory for linear DAEs with unknown but bounded model error and random observation noise with unknown but bounded correlation operator; - describe how the DAE model propagates uncertain parameters; - estimate the worst-case error; - construct fast estimation algorithms in the form of filters; - develop a tool for model validation, that is to assess how good the model describes observed phenomena.
The dissertation contains the following new results: - generalized version of the Kalman duality principle is proposed allowing to handle unbounded linear model operators with non-trivial null-space; - new definitions of the minimax estimates for DAEs based on the generalized Kalman duality principle are proposed; - theorems of existence for minimax estimates are proved; - new minimax state estimation algorithms (in the form of filter and in the variational form) for DAE are proposed.
△ Less
Submitted 26 February, 2011;
originally announced February 2011.
-
Minimax state estimation for linear continuous differential-algebraic equations
Authors:
Sergiy Zhuk
Abstract:
This paper describes a minimax state estimation approach for linear Differential-Algebraic Equations (DAE) with uncertain parameters. The approach addresses continuous-time DAE with non-stationary rectangular matrices and uncertain bounded deterministic input. An observation's noise is supposed to be random with zero mean and unknown bounded correlation function. Main results are a Generalized Kal…
▽ More
This paper describes a minimax state estimation approach for linear Differential-Algebraic Equations (DAE) with uncertain parameters. The approach addresses continuous-time DAE with non-stationary rectangular matrices and uncertain bounded deterministic input. An observation's noise is supposed to be random with zero mean and unknown bounded correlation function. Main results are a Generalized Kalman Duality (GKD) principle and sub-optimal minimax state estimation algorithm. GKD is derived by means of Young-Fenhel duality theorem. GKD proves that the minimax estimate coincides with a solution to a Dual Control Problem (DCP) with DAE constraints. The latter is ill-posed and, therefore, the DCP is solved by means of Tikhonov regularization approach resulting a sub-optimal state estimation algorithm in the form of filter. We illustrate the approach by an synthetic example and we discuss connections with impulse-observability.
△ Less
Submitted 25 February, 2011; v1 submitted 18 May, 2010;
originally announced May 2010.
-
Recursive set-membership state estimation for linear non-causal time-variant differential- algebraic equation with continuous time
Authors:
Sergiy Zhuk
Abstract:
This paper describes a state estimation approach for non-causal time-varying linear descriptor equations with uncertain parameters. The uncertainty in the state equation and in the measurements is supposed to admit a set-membership description. The approach is based on the notion of the linear minimax estimation. Suboptimal minimax state estimation algorithm is introduced for DAEs with non-station…
▽ More
This paper describes a state estimation approach for non-causal time-varying linear descriptor equations with uncertain parameters. The uncertainty in the state equation and in the measurements is supposed to admit a set-membership description. The approach is based on the notion of the linear minimax estimation. Suboptimal minimax state estimation algorithm is introduced for DAEs with non-stationary rectangular matrices. Optimal algorithm is presented for DAEs with special structure of the matrices. A comparison of suboptimal and optimal algorithms is presented for 2D time-varying DAE with a singular matrix pencil.
△ Less
Submitted 15 March, 2010; v1 submitted 22 February, 2010;
originally announced February 2010.
-
Set-membership state estimation framework for uncertain linear differential-algebraic equations
Authors:
Serhiy Zhuk
Abstract:
We investigate a state estimation problem for the dynamical system described by uncertain linear operator equation in Hilbert space. The uncertainty is supposed to admit a set-membership description. We present explicit expressions for linear minimax estimation and error provided that any pair of uncertain parameters belongs to the quadratic bounding set. We introduce a new notion of minimax dir…
▽ More
We investigate a state estimation problem for the dynamical system described by uncertain linear operator equation in Hilbert space. The uncertainty is supposed to admit a set-membership description. We present explicit expressions for linear minimax estimation and error provided that any pair of uncertain parameters belongs to the quadratic bounding set. We introduce a new notion of minimax directional observability and index of non-causality for linear noncausal DAEs. Application of these notions to the state estimation problem for linear uncertain noncausal DAEs allows to derive new minimax recursive estimator for both continuous and discrete time. We illustrate the benefits of non-causality of the plant applying our approach to scalar nonlinear set-membership state estimation problem. Numerical example is presented.
△ Less
Submitted 21 April, 2009; v1 submitted 20 October, 2008;
originally announced October 2008.
-
State estimation for dynamical system described by linear equation with uncertainty
Authors:
Serhiy Zhuk
Abstract:
In this paper we investigate a problem of state estimation for the dynamical system described by the linear operator equation with unknown parameters in Hilbert space. We present explicit expressions for linear minimax estimation and error provided that any pair of uncertain parameters belongs to the quadratic bounding set. As an application of the main result we present the solution of minimax…
▽ More
In this paper we investigate a problem of state estimation for the dynamical system described by the linear operator equation with unknown parameters in Hilbert space. We present explicit expressions for linear minimax estimation and error provided that any pair of uncertain parameters belongs to the quadratic bounding set. As an application of the main result we present the solution of minimax estimation problem for the linear descriptor differential equation with constant matrices.
△ Less
Submitted 18 October, 2008;
originally announced October 2008.
-
Minimax state estimation for linear discrete-time differential-algebraic equations
Authors:
Sergiy M. Zhuk
Abstract:
This paper presents a state estimation approach for an uncertain linear equation with a non-invertible operator in Hilbert space. The approach addresses linear equations with uncertain deterministic input and noise in the measurements, which belong to a given convex closed bounded set. A new notion of a minimax observable subspace is introduced. By means of the presented approach, new equations de…
▽ More
This paper presents a state estimation approach for an uncertain linear equation with a non-invertible operator in Hilbert space. The approach addresses linear equations with uncertain deterministic input and noise in the measurements, which belong to a given convex closed bounded set. A new notion of a minimax observable subspace is introduced. By means of the presented approach, new equations describing the dynamics of a minimax recursive estimator for discrete-time non-causal differential-algebraic equations (DAEs) are presented. For the case of regular DAEs it is proved that the estimator's equation coincides with the equation describing the seminal Kalman filter. The properties of the estimator are illustrated by a numerical example.
△ Less
Submitted 26 July, 2010; v1 submitted 17 July, 2008;
originally announced July 2008.
-
Minimax State Estimation for a Dynamic System Described by a Differential-Algebraic Equation
Authors:
Serhiy M. Zhuk
Abstract:
In this report we address the linear state estimation problem: to estimate a linear transformation $\ell(\varphi)$ of the state $\varphi$ through an algorithm $\widehat{\ell(\varphi)}$ operating on measurements $y$, where $L\varphi=f,y=H\varphi+η$. We study the estimation problem in terms of the minimax estimation framework: to find a linear algorithm $\widehat{\widehat{\ell(\varphi)}}$ that min…
▽ More
In this report we address the linear state estimation problem: to estimate a linear transformation $\ell(\varphi)$ of the state $\varphi$ through an algorithm $\widehat{\ell(\varphi)}$ operating on measurements $y$, where $L\varphi=f,y=H\varphi+η$. We study the estimation problem in terms of the minimax estimation framework: to find a linear algorithm $\widehat{\widehat{\ell(\varphi)}}$ that minimizes the worst case error $\sup_{\varphi,η}d(\ell(\varphi),\widehat{\ell(\varphi)}) $. A key feature of the presented estimation approach is to fix a class of linear operators $L$, $H$; given any pair $L,H$ from that class we describe a class $\mathcal L$ of all solution operators $\ell$ such that the worst case error is finite.
We formulate a duality theorem (like Kalman duality principle) that is the estimation problem is equal to the optimal control problem if $G$ is convex bounded subset of the corresponding Hilbert space, $L$ is a closed linear map**. We obtain optimal estimations as solutions of the linear operator equations if $G$ is an ellipsoid. Then we apply this to the state estimation for the linear differential-algebraic equations (DAE). The minimax observer for DAE is represented in the form of the minimax filter. For discrete time DAEs we present the online minimax estimator.
△ Less
Submitted 27 June, 2008;
originally announced June 2008.
-
Recursive state estimation for noncausal discrete-time descriptor systems under uncertainties
Authors:
Serhiy M. Zhuk
Abstract:
This paper describes a method for the online state estimation of systems described by a general class of linear noncausal time-varying difference descriptor equations subject to uncertainties. The method is based on the notions of a linear minimax estimation and an index of causality introduced here for singular difference equations. The online minimax estimator is derived by the application of…
▽ More
This paper describes a method for the online state estimation of systems described by a general class of linear noncausal time-varying difference descriptor equations subject to uncertainties. The method is based on the notions of a linear minimax estimation and an index of causality introduced here for singular difference equations. The online minimax estimator is derived by the application of the dynamical programming and Moore's pseudoinverse theory to the minimax estimation problem. It coincides with Kalman's filter for regular systems. A numerical example of the state estimation for 2D noncasual descriptor system is presented.
Keywords: Kalman filtering, online state observer, guaranteed estimation, descriptor systems, singular systems, DAEs.
△ Less
Submitted 8 November, 2007;
originally announced November 2007.
-
On Some Properties of Linear Map** Induced by Linear Descriptor Differential Equation
Authors:
Serhiy Zhuk
Abstract:
In this paper we introduce linear map** D from WnF\subset Ln into Lm\times Rm, induced by linear differential equation d/dt Fx(t)-C(t)x(t)=f(t),Fx(t_0)=f_0. We prove that D is closed dense defined map** for any m\times n-matrix F. Also adjoint map** D* is constructed and its domain WmF is described. Some kind of so-called "integration by parts" formula for vectors from WnF, WmF is suggeste…
▽ More
In this paper we introduce linear map** D from WnF\subset Ln into Lm\times Rm, induced by linear differential equation d/dt Fx(t)-C(t)x(t)=f(t),Fx(t_0)=f_0. We prove that D is closed dense defined map** for any m\times n-matrix F. Also adjoint map** D* is constructed and its domain WmF is described. Some kind of so-called "integration by parts" formula for vectors from WnF, WmF is suggested. We obtain a necessary and sufficient condition for existence of generalized solution of equation Dx=(f,f_0). Also we find a sufficient criterion for closureness of the R(D) in Lm\times Rm which is formulated in terms of transparent conditions for blocks of matrix C(t). Some examples are supplied to illustrate obtained results.
△ Less
Submitted 23 May, 2007;
originally announced May 2007.
-
Minimax State Observation in Linear One Dimensional 2-Point Boundary Value Problems
Authors:
Serhiy Zhuk,
Serhiy Demidenko,
Alexander Nakonechniy
Abstract:
In this paper we study observation problem for linear 2-point BVP Dx=Bf assuming that information about system input f and random noise ηin system state observation model y=Hx+η…
▽ More
In this paper we study observation problem for linear 2-point BVP Dx=Bf assuming that information about system input f and random noise ηin system state observation model y=Hx+η$ is incomplete (f and Mηη' are some arbitrary elements of given sets). A criterion of guaranteed (minimax) estimation error finiteness is proposed. Representations of minimax estimations are obtained in terms of 2-point BVP solutions. It is proved that in general case we can only estimate a projection of system state onto some linear manifold $F$. In particular, $F=L_2$ if $dim N(D H) = 0$. Also we propose a procedure which decides if given linear functional belongs to $F$.
△ Less
Submitted 17 April, 2007;
originally announced April 2007.
-
Guaranteed Estimations for Linear Difference Descriptor Systems
Authors:
Serhiy M. Zhuk
Abstract:
This paper is devoted to guaranteed estimation (so-called minimax estimation) of linear functions, defined on the solutions domain of the linear descriptor difference equations (LDDE) system, where right-hand part and initial condition are arbitrary elements of the given set. Minimax estimations are build on the basis of system's state observation with unknown deterministic noise. Minimax filtra…
▽ More
This paper is devoted to guaranteed estimation (so-called minimax estimation) of linear functions, defined on the solutions domain of the linear descriptor difference equations (LDDE) system, where right-hand part and initial condition are arbitrary elements of the given set. Minimax estimations are build on the basis of system's state observation with unknown deterministic noise. Minimax filtration task is studied for LDDE system with special structure.
△ Less
Submitted 25 September, 2006;
originally announced September 2006.
