-
Monotone inclusion methods for a class of second-order non-potential mean-field games
Authors:
Levon Nurbekyan,
Siting Liu,
Yat Tin Chow
Abstract:
We propose a monotone splitting algorithm for solving a class of second-order non-potential mean-field games. Following [Achdou, Capuzzo-Dolcetta, "Mean Field Games: Numerical Methods," SINUM (2010)], we introduce a finite-difference scheme and observe that the scheme represents first-order optimality conditions for a primal-dual pair of monotone inclusions. Based on this observation, we prove tha…
▽ More
We propose a monotone splitting algorithm for solving a class of second-order non-potential mean-field games. Following [Achdou, Capuzzo-Dolcetta, "Mean Field Games: Numerical Methods," SINUM (2010)], we introduce a finite-difference scheme and observe that the scheme represents first-order optimality conditions for a primal-dual pair of monotone inclusions. Based on this observation, we prove that the finite-difference system obtains a solution that can be provably recovered by an extension of the celebrated primal-dual hybrid gradient (PDHG) algorithm.
△ Less
Submitted 29 March, 2024;
originally announced March 2024.
-
State-Augmented Linear Games with Antagonistic Error for High-Dimensional, Nonlinear Hamilton-Jacobi Reachability
Authors:
Will Sharpless,
Yat Tin Chow,
Sylvia Herbert
Abstract:
Hamilton-Jacobi Reachability (HJR) is a popular method for analyzing the liveness and safety of a dynamical system with bounded control and disturbance. The corresponding HJ value function offers a robust controller and characterizes the reachable sets, but is traditionally solved with Dynamic Programming (DP) and limited to systems of dimension less than six. Recently, the space-parallelizeable,…
▽ More
Hamilton-Jacobi Reachability (HJR) is a popular method for analyzing the liveness and safety of a dynamical system with bounded control and disturbance. The corresponding HJ value function offers a robust controller and characterizes the reachable sets, but is traditionally solved with Dynamic Programming (DP) and limited to systems of dimension less than six. Recently, the space-parallelizeable, generalized Hopf formula has been shown to also solve the HJ value with a nearly three-log increase in dimension limit, but is limited to linear systems. To extend this potential, we demonstrate how state-augmented (SA) spaces, which are well-known for their improved linearization accuracy, may be used to solve tighter, conservative approximations of the value function with any linear model in this SA space. Namely, we show that with a representation of the true dynamics in the SA space, a series of inequalities confirms that the value of a SA linear game with antagonistic error is a conservative envelope of the true value function. It follows that if the optimal controller for the HJ SA linear game with error may succeed, it will also succeed in the true system. Unlike previous methods, this result offers the ability to safely approximate reachable sets and their corresponding controllers with the Hopf formula in a non-convex manner. Finally, we demonstrate this in the slow manifold system for clarity, and in the controlled Van der Pol system with different lifting functions.
△ Less
Submitted 25 March, 2024;
originally announced March 2024.
-
Conservative Linear Envelopes for Nonlinear, High-Dimensional, Hamilton-Jacobi Reachability
Authors:
Will Sharpless,
Yat Tin Chow,
Sylvia Herbert
Abstract:
Hamilton-Jacobi reachability (HJR) provides a value function that encodes the set of states from which a system with bounded control inputs can reach or avoid a target despite any bounded disturbance, and the corresponding robust, optimal control policy. Though powerful, traditional methods for HJR rely on dynamic programming (DP) and suffer from exponential computation growth with respect to stat…
▽ More
Hamilton-Jacobi reachability (HJR) provides a value function that encodes the set of states from which a system with bounded control inputs can reach or avoid a target despite any bounded disturbance, and the corresponding robust, optimal control policy. Though powerful, traditional methods for HJR rely on dynamic programming (DP) and suffer from exponential computation growth with respect to state dimension. The recently favored Hopf formula mitigates this ``curse of dimensionality'' by providing an efficient and space-parallelizable approach for solving the reachability problem. However, the Hopf formula can only be applied to linear time-varying systems. To overcome this limitation, we show that the error between a nonlinear system and a linear model can be transformed into an adversarial bounded artificial disturbance. One may then solve the dimension-robust generalized Hopf formula for a linear game with this ``antagonistic error" to perform guaranteed conservative reachability analysis and control synthesis of nonlinear systems; this can be done for problem formulations in which no other HJR method is both computationally feasible and guaranteed. In addition, we offer several technical methods for reducing conservativeness in the analysis. We demonstrate the effectiveness of our results through one illustrative example (the controlled Van der Pol system) that can be compared to standard DP, and one higher-dimensional 15D example (a 5-agent pursuit-evasion game with Dubins cars).
△ Less
Submitted 12 April, 2024; v1 submitted 21 March, 2024;
originally announced March 2024.
-
Moving Anchor Extragradient Methods For Smooth Structured Minimax Problems
Authors:
James K. Alcala,
Yat Tin Chow,
Mahesh Sunkula
Abstract:
This work introduces a moving anchor acceleration technique to extragradient algorithms for smooth structured minimax problems. The moving anchor is introduced as a generalization of the original algorithmic anchoring framework, i.e. the EAG method introduced in [32], in hope of further acceleration. We show that the optimal order of convergence in terms of worst-case complexity on the squared gra…
▽ More
This work introduces a moving anchor acceleration technique to extragradient algorithms for smooth structured minimax problems. The moving anchor is introduced as a generalization of the original algorithmic anchoring framework, i.e. the EAG method introduced in [32], in hope of further acceleration. We show that the optimal order of convergence in terms of worst-case complexity on the squared gradient, O(1/k2), is achieved by our new method (where k is the number of iterations). We have also extended our algorithm to a more general nonconvex-nonconcave class of saddle point problems using the framework of [14], which slightly generalizes [32]. We obtain similar order-optimal complexity results in this extended case. In both problem settings, numerical results illustrate the efficacy of our moving anchor algorithm variants, in particular by attaining the theoretical optimal convergence rate for first order methods, as well as suggesting a better optimized constant in the big O notation which surpasses the traditional fixed anchor methods in many cases. A proximal-point preconditioned version of our algorithms is also introduced and analyzed to match optimal theoretical convergence rates.
△ Less
Submitted 25 August, 2023; v1 submitted 23 August, 2023;
originally announced August 2023.
-
Koopman-Hopf Hamilton-Jacobi Reachability and Control
Authors:
Will Sharpless,
Nikhil Shinde,
Matthew Kim,
Yat Tin Chow,
Sylvia Herbert
Abstract:
The Hopf formula for Hamilton-Jacobi reachability (HJR) analysis has been proposed to solve high-dimensional differential games, producing the set of initial states and corresponding controller required to reach (or avoid) a target despite bounded disturbances. As a space-parallelizable method, the Hopf formula avoids the curse of dimensionality that afflicts standard dynamic-programming HJR, but…
▽ More
The Hopf formula for Hamilton-Jacobi reachability (HJR) analysis has been proposed to solve high-dimensional differential games, producing the set of initial states and corresponding controller required to reach (or avoid) a target despite bounded disturbances. As a space-parallelizable method, the Hopf formula avoids the curse of dimensionality that afflicts standard dynamic-programming HJR, but is restricted to linear time-varying systems. To compute reachable sets for high-dimensional nonlinear systems, we pair the Hopf solution with Koopman theory for global linearization. By first lifting a nonlinear system to a linear space and then solving the Hopf formula, approximate reachable sets can be efficiently computed that are much more accurate than local linearizations. Furthermore, we construct a Koopman-Hopf disturbance-rejecting controller, and test its ability to drive a 10-dimensional nonlinear glycolysis model. We find that it significantly out-competes expectation-minimizing and game-theoretic model predictive controllers with the same Koopman linearization in the presence of bounded stochastic disturbance. In summary, we demonstrate a dimension-robust method to approximately solve HJR, allowing novel application to analyze and control high-dimensional, nonlinear systems with disturbance. An open-source toolbox in Julia is introduced for both Hopf and Koopman-Hopf reachability and control.
△ Less
Submitted 24 August, 2023; v1 submitted 21 March, 2023;
originally announced March 2023.
-
A numerical algorithm for inverse problem from partial boundary measurement arising from mean field game problem
Authors:
Yat Tin Chow,
Samy Wu Fung,
Siting Liu,
Levon Nurbekyan,
Stanley Osher
Abstract:
In this work, we consider a novel inverse problem in mean-field games (MFG). We aim to recover the MFG model parameters that govern the underlying interactions among the population based on a limited set of noisy partial observations of the population dynamics under the limited aperture. Due to its severe ill-posedness, obtaining a good quality reconstruction is very difficult. Nonetheless, it is…
▽ More
In this work, we consider a novel inverse problem in mean-field games (MFG). We aim to recover the MFG model parameters that govern the underlying interactions among the population based on a limited set of noisy partial observations of the population dynamics under the limited aperture. Due to its severe ill-posedness, obtaining a good quality reconstruction is very difficult. Nonetheless, it is vital to recover the model parameters stably and efficiently in order to uncover the underlying causes for population dynamics for practical needs.
Our work focuses on the simultaneous recovery of running cost and interaction energy in the MFG equations from a \emph{finite number of boundary measurements} of population profile and boundary movement. To achieve this goal, we formalize the inverse problem as a constrained optimization problem of a least squares residual functional under suitable norms. We then develop a fast and robust operator splitting algorithm to solve the optimization using techniques including harmonic extensions, three-operator splitting scheme, and primal-dual hybrid gradient method. Numerical experiments illustrate the effectiveness and robustness of the algorithm.
△ Less
Submitted 10 April, 2022;
originally announced April 2022.
-
Continuous data assimilation for two-phase flow: analysis and simulations
Authors:
Yat Tin Chow,
Wing Tat Leung,
Ali Pakzad
Abstract:
We propose, analyze, and test a novel continuous data assimilation two-phase flow algorithm for reservoir simulation. We show that the solutions of the algorithm, constructed using coarse mesh observations, converge at an exponential rate in time to the corresponding exact reference solution of the two-phase model. More precisely, we obtain a stability estimate which illustrates an exponential dec…
▽ More
We propose, analyze, and test a novel continuous data assimilation two-phase flow algorithm for reservoir simulation. We show that the solutions of the algorithm, constructed using coarse mesh observations, converge at an exponential rate in time to the corresponding exact reference solution of the two-phase model. More precisely, we obtain a stability estimate which illustrates an exponential decay of the residual error between the reference and approximate solution, until the error hits a threshold depending on the order of data resolution. Numerical computations are included to demonstrate the effectiveness of this approach, as well as variants with data on sub-domains. In particular, we demonstrate numerically that synchronization is achieved for data collected from a small fraction of the domain.
△ Less
Submitted 17 June, 2022; v1 submitted 26 October, 2021;
originally announced October 2021.
-
Surface concentration of transmission eigenfunctions
Authors:
Yat Tin Chow,
Youjun Deng,
Hongyu Liu,
Mahesh Sunkula
Abstract:
The transmission eigenvalue problem is a type of non-elliptic and non-selfadjoint spectral problem that arises in the wave scattering theory when invisibility/transparency occurs. The transmission eigenfunctions are the interior resonant modes inside the scattering medium. We are concerned with the geometric rigidity of the transmission eigenfunctions and show that they concentrate on the boundary…
▽ More
The transmission eigenvalue problem is a type of non-elliptic and non-selfadjoint spectral problem that arises in the wave scattering theory when invisibility/transparency occurs. The transmission eigenfunctions are the interior resonant modes inside the scattering medium. We are concerned with the geometric rigidity of the transmission eigenfunctions and show that they concentrate on the boundary surface of the underlying domain in two senses. This substantiates the recent numerical discovery in [10] on such an intriguing spectral phenomenon of the transmission resonance. Our argument is based on generalized Weyl's law and certain novel ergodic properties of the coupled boundary layer-potential operators which are employed to analyze the generalized transmission eigenfunctions.
△ Less
Submitted 21 April, 2023; v1 submitted 29 September, 2021;
originally announced September 2021.
-
Quantum integrable systems and concentration of plasmon resonance
Authors:
Habib Ammari,
Yat Tin Chow,
Hongyu Liu,
Mahesh Sunkula
Abstract:
We are concerned with the quantitative mathematical understanding of surface plasmon resonance (SPR) when $d \geq 3$. SPR is the resonant oscillation of conducting electrons at the interface between negative and positive permittivity materials and forms the fundamental basis of many cutting-edge applications of metamaterials. It is recently found that the SPR concentrates due to curvature effect.…
▽ More
We are concerned with the quantitative mathematical understanding of surface plasmon resonance (SPR) when $d \geq 3$. SPR is the resonant oscillation of conducting electrons at the interface between negative and positive permittivity materials and forms the fundamental basis of many cutting-edge applications of metamaterials. It is recently found that the SPR concentrates due to curvature effect. In this paper, we derive sharper and more explicit characterisations of the SPR concentration at high-curvature places in both the static and quasi-static regimes. The study can be boiled down to analyzing the geometries of the so-called Neumann-Poincaré (NP) operators, which are certain pseudo-differential operators sitting on the interfacial boundary. We propose to study the joint Hamiltonian flow of an integral system given by the moment map defined by the NP operator. Via considering the Heisenberg picture and lifting the joint flow to a joint wave propagator, we establish a more general version of quantum ergodicity on each leaf of the foliation of this integrable system, which can then be used to establish the desired SPR concentration results. The mathematical framework developed in this paper leverages the Heisenberg picture of quantization and extends some results of quantum integrable system via generalising the concept of quantum ergodicity, which can be of independent interest to the spectral theory and the potential theory.
△ Less
Submitted 27 September, 2022; v1 submitted 27 September, 2021;
originally announced September 2021.
-
A Direct Sampling Method for the Inversion of the Radon Transform
Authors:
Yat Tin Chow,
Fuqun Han,
Jun Zou
Abstract:
We propose a novel direct sampling method (DSM) for the effective and stable inversion of the Radon transform. The DSM is based on a generalization of the important almost orthogonality property in classical DSMs to fractional order Sobolev duality products and to a new family of probing functions. The fractional order duality product proves to be able to greatly enhance the robustness of the reco…
▽ More
We propose a novel direct sampling method (DSM) for the effective and stable inversion of the Radon transform. The DSM is based on a generalization of the important almost orthogonality property in classical DSMs to fractional order Sobolev duality products and to a new family of probing functions. The fractional order duality product proves to be able to greatly enhance the robustness of the reconstructions in some practically important but severely ill-posed inverse problems associated with the Radon transform. We present a detailed analysis to better understand the performance of the new probing and index functions, which are crucial to stable and effective numerical reconstructions. The DSM can be computed in a very fast and highly parallel manner. Numerical experiments are carried out to compare the DSM with a popular existing method, and to illustrate the efficiency, stability, and accuracy of the DSM.
△ Less
Submitted 21 October, 2020;
originally announced October 2020.
-
Recovery of a Time-Dependent Bottom Topography Function from the Shallow Water Equations via an Adjoint Approach
Authors:
Jolene Britton,
Yat Tin Chow,
Weitao Chen,
Yulong Xing
Abstract:
We develop an adjoint approach for recovering the topographical function included in the source term of one-dimensional hyperbolic balance laws. We focus on a specific system, namely the shallow water equations, in an effort to recover the riverbed topography. The novelty of this work is the ability to robustly recover the bottom topography using only noisy boundary data from one measurement event…
▽ More
We develop an adjoint approach for recovering the topographical function included in the source term of one-dimensional hyperbolic balance laws. We focus on a specific system, namely the shallow water equations, in an effort to recover the riverbed topography. The novelty of this work is the ability to robustly recover the bottom topography using only noisy boundary data from one measurement event and the inclusion of two regularization terms in the iterative update scheme. The adjoint scheme is determined from a linearization of the forward system and is used to compute the gradient of a cost function. The bottom topography function is recovered through an iterative process given by a three-operator splitting method which allows the feasibility to include two regularization terms. Numerous numerical tests demonstrate the robustness of the method regardless of the choice of initial guess and in the presence of discontinuities in the solution of the forward problem.
△ Less
Submitted 2 April, 2021; v1 submitted 29 May, 2020;
originally announced June 2020.
-
A Direct Sampling Method for Simultaneously Recovering Inhomogeneous Inclusions of Different Nature
Authors:
Yat Tin Chow,
Fuqun Han,
Jun Zou
Abstract:
In this work, we investigate a class of elliptic inverse problems and aim to simultaneously recover multiple inhomogeneous inclusions arising from two different physical parameters, using very limited boundary Cauchy data collected only at one or two measurement events. We propose a new fast, stable and highly parallelable direct sampling method (DSM) for the simultaneous reconstruction process. T…
▽ More
In this work, we investigate a class of elliptic inverse problems and aim to simultaneously recover multiple inhomogeneous inclusions arising from two different physical parameters, using very limited boundary Cauchy data collected only at one or two measurement events. We propose a new fast, stable and highly parallelable direct sampling method (DSM) for the simultaneous reconstruction process. Two groups of probing and index functions are constructed, and their desired properties are analyzed. In order to identify and decouple the multiple inhomogeneous inclusions of different physical nature, we introduce a new concept of mutually almost orthogonality property that generalizes the important concept of almost orthogonality property in classical DSMs for inhomogeneous inclusions of same physical nature. With the help of this new concept, we develop a reliable strategy to distinguish two different types of inhomogeneous inclusions with noisy data collected at one or two measurement events. We further improve the decoupling effect by choosing an appropriate boundary influx. Numerical experiments are presented to illustrate the robustness and efficiency of the proposed method.
△ Less
Submitted 4 June, 2020; v1 submitted 11 May, 2020;
originally announced May 2020.
-
On the zeroth law of turbulence for the stochastically forced Navier-Stokes equations
Authors:
Yat Tin Chow,
Ali Pakzad
Abstract:
We consider three-dimensional stochastically forced Navier-Stokes equations subjected to white-in-time (colored-in-space) forcing in the absence of boundaries. Upper and lower bounds of the mean value of the time-averaged energy dissipation rate, $\mathbb{E} [\langle\varepsilon \rangle] $, are derived directly from the equations. First, we show that for a weak (martingale) solution to the stochast…
▽ More
We consider three-dimensional stochastically forced Navier-Stokes equations subjected to white-in-time (colored-in-space) forcing in the absence of boundaries. Upper and lower bounds of the mean value of the time-averaged energy dissipation rate, $\mathbb{E} [\langle\varepsilon \rangle] $, are derived directly from the equations. First, we show that for a weak (martingale) solution to the stochastically forced Navier-Stokes equations, \[ \mathbb{E} [\langle\varepsilon \rangle] \leq G^2 + (2+ \frac{1}{Re})\frac{U^3}{L},\] where $G^2$ is the total energy rate supplied by the random force, $U$ is the root-mean-square velocity, $L$ is the longest length scale in the applied forcing function, and $Re$ is the Reynolds number. Under an additional assumption of energy equality, we also derive a lower bound if the energy rate given by the random force dominates the deterministic behavior of the flow in the sense that $G^2 > 2 F U$, where $F$ is the amplitude of the deterministic force. We obtain, \[\frac{1}{3} G^2 - \frac{1}{3} (2+ \frac{1}{Re})\frac{U^3}{L} \leq \mathbb{E} [\langle\varepsilon \rangle] \leq G^2 + (2+ \frac{1}{Re})\frac{U^3}{L}\,.\] In particular, under such assumptions, we obtain the zeroth law of turbulence in the absence of the deterministic force as, \[\mathbb{E} [\langle\varepsilon \rangle] = \frac{1}{2} G^2.\] Besides, we also obtain variance estimates of the dissipation rate for the model.
△ Less
Submitted 18 April, 2020;
originally announced April 2020.
-
Quantum ergodicity and localization of plasmon resonances
Authors:
Habib Ammari,
Yat Tin Chow,
Hongyu Liu
Abstract:
We are concerned with the geometric properties of the surface plasmon resonance (SPR). SPR is a non-radiative electromagnetic surface wave that propagates in a direction parallel to the negative permittivity/dielectric material interface. It is known that the SPR oscillation is very sensitive to the material interface. However, we show that the SPR oscillation asymptotically localizes at places wi…
▽ More
We are concerned with the geometric properties of the surface plasmon resonance (SPR). SPR is a non-radiative electromagnetic surface wave that propagates in a direction parallel to the negative permittivity/dielectric material interface. It is known that the SPR oscillation is very sensitive to the material interface. However, we show that the SPR oscillation asymptotically localizes at places with high magnitude of curvature in a certain sense. Our work leverages the Heisenberg picture of quantization and quantum ergodicity first derived by Shnirelman, Zelditch, Colin de Verdière and Helffer-Martinez-Robert, as well as certain novel and more general ergodic properties of the Neumann-Poincaré operator to analyze the SPR field, which are of independent interest to the spectral theory and the potential theory.
△ Less
Submitted 8 September, 2020; v1 submitted 7 March, 2020;
originally announced March 2020.
-
Surface-localized transmission eigenstates, super-resolution imaging and pseudo surface plasmon modes
Authors:
Yat Tin Chow,
Youjun Deng,
Youzi He,
Hongyu Liu,
Xianchao Wang
Abstract:
We present the discovery of a novel and intriguing global geometric structure of the (interior) transmission eigenfunctions associated with the Helmholtz system. It is shown in generic scenarios that there always exists a sequence of transmission eigenfunctions with the corresponding eigenvalues going to infinity such that those eigenfunctions are localized around the boundary of the domain. We pr…
▽ More
We present the discovery of a novel and intriguing global geometric structure of the (interior) transmission eigenfunctions associated with the Helmholtz system. It is shown in generic scenarios that there always exists a sequence of transmission eigenfunctions with the corresponding eigenvalues going to infinity such that those eigenfunctions are localized around the boundary of the domain. We provide a comprehensive and rigorous justification in the case within the radial geometry, whereas for the non-radial case, we conduct extensive numerical experiments to quantitatively verify the localizing behaviours. The discovery provides a new perspective on wave localization. As significant applications, we develop a novel inverse scattering scheme that can produce super-resolution imaging effects and propose a method of generating the so-called pseudo surface plasmon resonant (PSPR) modes with a potential sensing application.
△ Less
Submitted 14 December, 2020; v1 submitted 4 March, 2020;
originally announced March 2020.
-
Localized sensitivity analysis at high-curvature boundary points of reconstructing inclusions in transmission problems
Authors:
Habib Ammari,
Yat Tin Chow,
Hongyu Liu
Abstract:
In this paper, we are concerned with the recovery of the geometric shapes of inhomogeneous inclusions from the associated far field data in electrostatics and acoustic scattering. We present a local resolution analysis and show that the local shape around a boundary point with a high magnitude of mean curvature can be reconstructed more easily and stably. In proving this, we develop a novel mathem…
▽ More
In this paper, we are concerned with the recovery of the geometric shapes of inhomogeneous inclusions from the associated far field data in electrostatics and acoustic scattering. We present a local resolution analysis and show that the local shape around a boundary point with a high magnitude of mean curvature can be reconstructed more easily and stably. In proving this, we develop a novel mathematical scheme by analyzing the generalized polarisation tensors (GPTs) and the scattering coefficients (SCs) coming from the associated scattered fields, which in turn boils down to the analysis of the layer potential operators that sit inside the GPTs and SCs via the microlocal analysis. In a delicate and subtle manner, we decompose the reconstruction process into several steps, where all but one steps depend on the global geometry, and one particular step depends on the mean curvature at a given boundary point. Then by a sensitivity analysis with respect to local perturbations of the curvature of the boundary surface, we establish the local resolution effects. Our study opens up a new field of mathematical analysis on wave super-resolution imaging.
△ Less
Submitted 16 August, 2021; v1 submitted 2 November, 2019;
originally announced November 2019.
-
Optimal Mesh Size for Inverse Medium Scattering Problems
Authors:
Habib Ammari,
Yat Tin Chow,
Keji Liu
Abstract:
An optimal mesh size of the sampling region can help to reduce computational burden in practical applications. In this work, we investigate optimal choices of mesh sizes for the identifications of medium obstacles from either the far-field or near-field data in two and three dimensions. The results would have applications in the reconstruction process of inverse scattering problems.
An optimal mesh size of the sampling region can help to reduce computational burden in practical applications. In this work, we investigate optimal choices of mesh sizes for the identifications of medium obstacles from either the far-field or near-field data in two and three dimensions. The results would have applications in the reconstruction process of inverse scattering problems.
△ Less
Submitted 18 October, 2018;
originally announced October 2018.
-
Multilevel Optimal Transport: a Fast Approximation of Wasserstein-1 distances
Authors:
Jialin Liu,
Wotao Yin,
Wuchen Li,
Yat Tin Chow
Abstract:
We propose a fast algorithm for the calculation of the Wasserstein-1 distance, which is a particular type of optimal transport distance with homogeneous of degree one transport cost.
Our algorithm is built on multilevel primal-dual algorithms. Several numerical examples and a complexity analysis are provided to demonstrate its computational speed. On some commonly used image examples of size…
▽ More
We propose a fast algorithm for the calculation of the Wasserstein-1 distance, which is a particular type of optimal transport distance with homogeneous of degree one transport cost.
Our algorithm is built on multilevel primal-dual algorithms. Several numerical examples and a complexity analysis are provided to demonstrate its computational speed. On some commonly used image examples of size $512\times512$, the proposed algorithm gives solutions within $0.2\sim 1.5$ seconds on a single CPU, which is much faster than the state-of-the-art algorithms.
△ Less
Submitted 4 August, 2019; v1 submitted 28 September, 2018;
originally announced October 2018.
-
Optimal Human Navigation in Steep Terrain: a Hamilton-Jacobi-Bellman Approach
Authors:
Christian Parkinson,
David Arnold,
Andrea L. Bertozzi,
Yat Tin Chow,
Stanley Osher
Abstract:
We present a method for determining optimal walking paths in steep terrain using the level set method and an optimal control formulation. By viewing the walking direction as a control variable, we can determine the optimal control by solving a Hamilton-Jacobi-Bellman equation. We then calculate the optimal walking path by solving an ordinary differential equation. We demonstrate the effectiveness…
▽ More
We present a method for determining optimal walking paths in steep terrain using the level set method and an optimal control formulation. By viewing the walking direction as a control variable, we can determine the optimal control by solving a Hamilton-Jacobi-Bellman equation. We then calculate the optimal walking path by solving an ordinary differential equation. We demonstrate the effectiveness of our method by computing optimal paths which travel throughout mountainous regions of Yosemite National Park. We include details regarding the numerical implementation of our model and address a specific application of a law enforcement agency patrolling a nationally protected area.
△ Less
Submitted 21 June, 2018; v1 submitted 13 May, 2018;
originally announced May 2018.
-
Algorithm for Hamilton-Jacobi equations in density space via a generalized Hopf formula
Authors:
Yat Tin Chow,
Wuchen Li,
Stanley Osher,
Wotao Yin
Abstract:
We design fast numerical methods for Hamilton-Jacobi equations in density space (HJD), which arises in optimal transport and mean field games. We overcome the curse-of-infinite-dimensionality nature of HJD by proposing a generalized Hopf formula in density space. The formula transfers optimal control problems in density space, which are constrained minimizations supported on both spatial and time…
▽ More
We design fast numerical methods for Hamilton-Jacobi equations in density space (HJD), which arises in optimal transport and mean field games. We overcome the curse-of-infinite-dimensionality nature of HJD by proposing a generalized Hopf formula in density space. The formula transfers optimal control problems in density space, which are constrained minimizations supported on both spatial and time variables, to optimization problems over only spatial variables. This transformation allows us to compute HJD efficiently via multi-level approaches and coordinate descent methods.
△ Less
Submitted 4 May, 2018;
originally announced May 2018.
-
A Splitting Method For Overcoming the Curse of Dimensionality in Hamilton-Jacobi Equations Arising from Nonlinear Optimal Control and Differential Games with Applications to Trajectory Generation
Authors:
Alex Tong Lin,
Yat Tin Chow,
Stanley Osher
Abstract:
Recent observations have been made that bridge splitting methods arising from optimization, to the Hopf and Lax formulas for Hamilton-Jacobi Equations with Hamiltonians $H(p)$. This has produced extremely fast algorithms in computing solutions of these PDEs. More recent observations were made in generalizing the Hopf and Lax formulas to state-and-time-dependent cases $H(x,p,t)$. In this article, w…
▽ More
Recent observations have been made that bridge splitting methods arising from optimization, to the Hopf and Lax formulas for Hamilton-Jacobi Equations with Hamiltonians $H(p)$. This has produced extremely fast algorithms in computing solutions of these PDEs. More recent observations were made in generalizing the Hopf and Lax formulas to state-and-time-dependent cases $H(x,p,t)$. In this article, we apply a new splitting method based on the Primal Dual Hybrid Gradient algorithm (a.k.a. Chambolle-Pock) to nonlinear optimal control and differential games problems, based on techniques from the derivation of the new Hopf and Lax formulas, which allow us to compute solutions at points $(x,t)$ directly, i.e. without the use of grids in space. This algorithm also allows us to create trajectories directly. Thus we are able to lift the curse of dimensionality a bit, and therefore compute solutions in much higher dimensions than before. And in our numerical experiments, we actually observe that our computations scale polynomially in time. Furthermore, this new algorithm is embarrassingly parallelizable.
△ Less
Submitted 3 March, 2018;
originally announced March 2018.
-
A partial Laplacian as an infinitesimal generator on the Wasserstein space
Authors:
Yat Tin Chow,
Wilfrid Gangbo
Abstract:
We study stochastic processes on the Wasserstein space, together with their infinitesimal generators. One of these processes is modeled after Brownian motion and plays a central role in our work. Its infinitesimal generator defines a partial Laplacian on the space of Borel probability measures, and we use it to define heat flow on the Wasserstein space. We verify a distinctive smoothing effect of…
▽ More
We study stochastic processes on the Wasserstein space, together with their infinitesimal generators. One of these processes is modeled after Brownian motion and plays a central role in our work. Its infinitesimal generator defines a partial Laplacian on the space of Borel probability measures, and we use it to define heat flow on the Wasserstein space. We verify a distinctive smoothing effect of this flow for a particular class of initial conditions. To this end, we will develop a theory of Fourier analysis and conic surfaces in metric spaces. We note that the use of the infinitesimal generators has been instrumental in proving various theorems for Mean Field Games, and we anticipate they will play a key role in future studies of viscosity solutions of PDEs in the Wasserstein space.
△ Less
Submitted 28 October, 2017;
originally announced October 2017.
-
Time-Optimal Collaborative Guidance Using the Generalized Hopf Formula
Authors:
Matthew R. Kirchner,
Robert Mar,
Gary Hewer,
Jérôme Darbon,
Stanley Osher,
Y. T. Chow
Abstract:
Presented is a new method for calculating the time-optimal guidance control for a multiple vehicle pursuit-evasion system. A joint differential game of k pursuing vehicles relative to the evader is constructed, and a Hamilton-Jacobi-Isaacs (HJI) equation that describes the evolution of the value function is formulated. The value function is built such that the terminal cost is the squared distance…
▽ More
Presented is a new method for calculating the time-optimal guidance control for a multiple vehicle pursuit-evasion system. A joint differential game of k pursuing vehicles relative to the evader is constructed, and a Hamilton-Jacobi-Isaacs (HJI) equation that describes the evolution of the value function is formulated. The value function is built such that the terminal cost is the squared distance from the boundary of the terminal surface. Additionally, all vehicles are assumed to have bounded controls. Typically, a joint state space constructed in this way would have too large a dimension to be solved with existing grid-based approaches. The value function is computed efficiently in high-dimensional space, without a discrete grid, using the generalized Hopf formula. The optimal time-to-reach is iteratively solved, and the optimal control is inferred from the gradient of the value function.
△ Less
Submitted 16 December, 2017; v1 submitted 19 September, 2017;
originally announced September 2017.
-
Algorithm for Overcoming the Curse of Dimensionality for State-dependent Hamilton-Jacobi equations
Authors:
Yat Tin Chow,
Jerome Darbon,
Stanley Osher,
Wotao Yin
Abstract:
In this paper, we develop algorithms to overcome the curse of dimensionality in possibly non-convex state-dependent Hamilton-Jacobi equations (HJ PDEs) arising from optimal control and differential game problems. The subproblems are independent and can be implemented in an embarrassingly parallel fashion. This is an ideal setup for perfect scaling in parallel computing. The algorithm is proposed t…
▽ More
In this paper, we develop algorithms to overcome the curse of dimensionality in possibly non-convex state-dependent Hamilton-Jacobi equations (HJ PDEs) arising from optimal control and differential game problems. The subproblems are independent and can be implemented in an embarrassingly parallel fashion. This is an ideal setup for perfect scaling in parallel computing. The algorithm is proposed to overcome the curse of dimensionality [1, 2] when solving HJ PDE. The major contribution of the paper is to change an optimization problem over a space of curves to an optimization problem of a single vector, which goes beyond [23]. We extend [5, 6, 8], and conjecture a (Lax-type) minimization principle when the Hamiltonian is convex, as well as a (Hopf-type) maximization principle when the Hamiltonian is non-convex. The conjectured Hopf-type maximization principle is a generalization of the well-known Hopf formula [11, 16, 30]. We validated formula under restricted assumptions, and bring our readers to [57] which validates that our conjectures in a more general setting after a previous version of our paper. We conjectured the weakest assumption is a psuedoconvexity assumption similar to [46]. The optimization problems are of the same dimension as that of the HJ PDE. We suggest a coordinate descent method for the minimization procedure in the generalized Lax/Hopf formula, and numerical differentiation is used to compute the derivatives. This method is preferable since the evaluation of the function value itself requires some computational effort, especially when we handle high dimensional optimization problem. The use of multiple initial guesses and a certificate of correctness are suggested to overcome possibly multiple local extrema since the optimization process is no longer convex. Our method is expected to have application in control theory and differential game problems, and elsewhere.
△ Less
Submitted 15 February, 2018; v1 submitted 8 April, 2017;
originally announced April 2017.
-
Cyclic Coordinate Update Algorithms for Fixed-Point Problems: Analysis and Applications
Authors:
Yat Tin Chow,
Tianyu Wu,
Wotao Yin
Abstract:
Many problems reduce to the fixed-point problem of solving $x=T(x)$. To this problem, we apply the coordinate-update algorithms, which update only one or a few components of $x$ at each step. When each update is cheap, these algorithms are faster than the full fixed-point iteration (which updates all the components).
In this paper, we focus on the coordinate-update algorithms based on the cyclic…
▽ More
Many problems reduce to the fixed-point problem of solving $x=T(x)$. To this problem, we apply the coordinate-update algorithms, which update only one or a few components of $x$ at each step. When each update is cheap, these algorithms are faster than the full fixed-point iteration (which updates all the components).
In this paper, we focus on the coordinate-update algorithms based on the cyclic selection rules, where the ordering of coordinates in each cycle is arbitrary. These algorithms are fast, but their convergence is unknown in the fixed-point setting.
When $T$ is a nonexpansive operator and has a fixed point, we show that the sequence of coordinate-update iterates converges to a fixed point under proper step sizes. This result applies to the primal-dual coordinate-update algorithms, which have applications to optimization problems with nonseparable nonsmooth objectives, as well as global linear constraints.
Numerically, we apply coordinate-update algorithms with the cyclic, shuffled cyclic, and random selection rules to $\ell_1$ robust least squares, a CT image reconstruction problem, as well as nonnegative matrix factorization. They converge much faster than the standard fixed-point iteration. Among the three rules, cyclic and shuffled cyclic rules are overall faster than the random rule.
△ Less
Submitted 2 March, 2017; v1 submitted 8 November, 2016;
originally announced November 2016.
-
Unique determination of the index of refraction from phase-less near-field data in two dimensions
Authors:
Yat Tin Chow,
Fadil Santosa,
Gunther Uhlmann
Abstract:
Motivated by non-destructive testing of optical fiber, we consider the problem of determining the index of refraction of a two-dimensional medium from magnitude of the total field resulting from known incident plane waves at a fixed frequency. The finiteness of the fiber cross section allows us to assume that the index of refraction is variable over a compact set. The measurement set is a closed c…
▽ More
Motivated by non-destructive testing of optical fiber, we consider the problem of determining the index of refraction of a two-dimensional medium from magnitude of the total field resulting from known incident plane waves at a fixed frequency. The finiteness of the fiber cross section allows us to assume that the index of refraction is variable over a compact set. The measurement set is a closed curve, e.g., a circle of fixed radius, containing the fiber cross section. We use complex geometric optics (CGO) solutions to show that the inverse problem for the unknown index of refraction is unique in $C^{k}$ for large enough $k$. The key tool in this work is the multi-term expansion of the CGO solutions which we rely on to address the uniqueness question.
△ Less
Submitted 29 July, 2016; v1 submitted 21 March, 2016;
originally announced March 2016.
-
Phased and phaseless domain reconstruction in inverse scattering problem via scattering coefficients
Authors:
Habib Ammari,
Yat Tin Chow,
Jun Zou
Abstract:
In this work we shall review the (phased) inverse scattering problem and then pursue the phaseless reconstruction from far-field data with the help of the concept of scattering coefficients. We perform sensitivity, resolution and stability analysis of both phased and phaseless problems and compare the degree of ill-posedness of the phased and phaseless reconstructions. The phaseless reconstruction…
▽ More
In this work we shall review the (phased) inverse scattering problem and then pursue the phaseless reconstruction from far-field data with the help of the concept of scattering coefficients. We perform sensitivity, resolution and stability analysis of both phased and phaseless problems and compare the degree of ill-posedness of the phased and phaseless reconstructions. The phaseless reconstruction is highly nonlinear and much more severely ill-posed. Algorithms are provided to solve both the phased and phaseless reconstructions in the linearized case. Stability is studied by estimating the condition number of the inversion process for both the phased and phaseless cases. An optimal strategy is suggested to attain the infimum of the condition numbers of the phaseless reconstruction, which may provide an important guidance for efficient phaseless measurements in practical applications. To the best of our knowledge, the stability analysis in terms of condition numbers are new for the phased and phaseless inverse scattering problems, and are very important to help us understand the degree of ill-posedness of these inverse problems. Numerical experiments are provided to illustrate the theoretical asymptotic behavior, as well as the effectiveness and robustness of the phaseless reconstruction algorithm.
△ Less
Submitted 14 October, 2015;
originally announced October 2015.
-
Analysis on Non-negative Factorizations and Applications
Authors:
Yat Tin Chow,
Kazufumi Ito,
Jun Zou
Abstract:
In this work we perform some mathematical analysis on non-negative matrix factorizations (NMF) and apply NMF to some imaging and inverse problems. We will propose a sparse low-rank approximation of big positive data and images in terms of tensor products of positive vectors, and investigate its effectiveness in terms of the number of tensor products to be used in the approximation. A new concept o…
▽ More
In this work we perform some mathematical analysis on non-negative matrix factorizations (NMF) and apply NMF to some imaging and inverse problems. We will propose a sparse low-rank approximation of big positive data and images in terms of tensor products of positive vectors, and investigate its effectiveness in terms of the number of tensor products to be used in the approximation. A new concept of multi-level analysis (MLA) framework is also suggested to extract major components in the matrix representing structures of different resolutions, but still preserving the positivity of the basis and sparsity of the approximation. We will also propose a semi-smooth Newton method based on primal-dual active sets for the non-negative factorization. Numerical results are given to demonstrate the effectiveness of the proposed method to capture features in images and structures of inverse problems under no a-priori assumption on the data structure, as well as to provide a sparse low-rank representation of the data.
△ Less
Submitted 23 April, 2015;
originally announced April 2015.
-
Direct Sampling Method for Diffusive Optical Tomography
Authors:
Yat Tin Chow,
Kazufumi Ito,
Keji Liu,
Jun Zou
Abstract:
In this work, we are concerned with the diffusive optical tomography (DOT) problem in the case when only one or two pairs of Cauchy data is available. We propose a simple and efficient direct sampling method (DSM) to locate inhomogeneities inside a homogeneous background and solve the DOT problem in both full and limited aperture cases. This new method is easy to implement and less expensive compu…
▽ More
In this work, we are concerned with the diffusive optical tomography (DOT) problem in the case when only one or two pairs of Cauchy data is available. We propose a simple and efficient direct sampling method (DSM) to locate inhomogeneities inside a homogeneous background and solve the DOT problem in both full and limited aperture cases. This new method is easy to implement and less expensive computationally. Numerical experiments demonstrate its effectiveness and robustness against noise in the data. This provides a new promising numerical strategy for the DOT problem.
△ Less
Submitted 6 October, 2014;
originally announced October 2014.
-
Optimal Shape Design by Partial Spectral Data
Authors:
Habib Ammari,
Yat Tin Chow,
Keji Liu,
Jun Zou
Abstract:
In this paper, we are concerned with a shape design problem, in which our target is to design, up to rigid transformations and scaling, the shape of an object given either its polarization tensor at multiple contrasts or the partial eigenvalues of its Neumann-Poincaré operator, which are known as the Fredholm eigenvalues. We begin by proposing to recover the eigenvalues of the Neumann-Poincaré ope…
▽ More
In this paper, we are concerned with a shape design problem, in which our target is to design, up to rigid transformations and scaling, the shape of an object given either its polarization tensor at multiple contrasts or the partial eigenvalues of its Neumann-Poincaré operator, which are known as the Fredholm eigenvalues. We begin by proposing to recover the eigenvalues of the Neumann-Poincaré operator from the polarization tensor by means of the holomorphic functional calculus. Then we develop a regularized Gauss-Newton optimization method for the shape reconstruction process. We present numerical results to demonstrate the effectiveness of the proposed methods and to illustrate important properties of the Fredholm eigenvalues and their associated eigenfunctions. Our results are expected to have important applications in the design of plasmon resonances in nanoparticles as well as in the multifrequency or pulsed imaging of small anomalies.
△ Less
Submitted 22 October, 2013;
originally announced October 2013.
-
The Concept of Heterogeneous Scattering Coefficients and Its Application in Inverse Medium Scattering
Authors:
Habib Ammari,
Yat Tin Chow,
Jun Zou
Abstract:
This work investigates the scattering coefficients for inverse medium scattering problems. It shows some fundamental properties of the coefficients such as symmetry and tensorial properties. The relationship between the scattering coefficients and the far-field pattern is also derived. Furthermore, the sensitivity of the scattering coefficients with respect to changes in the permittivity and perme…
▽ More
This work investigates the scattering coefficients for inverse medium scattering problems. It shows some fundamental properties of the coefficients such as symmetry and tensorial properties. The relationship between the scattering coefficients and the far-field pattern is also derived. Furthermore, the sensitivity of the scattering coefficients with respect to changes in the permittivity and permeability distributions is investigated. In the linearized case, explicit formulas for reconstructing permittivity and permeability distributions from the scattering coefficients is proposed. They relate the exponentially ill-posed character of the inverse medium scattering problem at a fixed frequency to the exponential decay of the scattering coefficients. Moreover, they show the stability of the reconstruction from multifrequency measurements. This provides a new direction for solving inverse medium scattering problems.
△ Less
Submitted 22 October, 2013;
originally announced October 2013.
