-
Empirical martingale projections via the adapted Wasserstein distance
Authors:
Jose Blanchet,
Johannes Wiesel,
Erica Zhang,
Zhenyuan Zhang
Abstract:
Given a collection of multidimensional pairs $\{(X_i,Y_i):1 \leq i\leq n\}$, we study the problem of projecting the associated suitably smoothed empirical measure onto the space of martingale couplings (i.e. distributions satisfying $\mathbb{E}[Y|X]=X$) using the adapted Wasserstein distance. We call the resulting distance the smoothed empirical martingale projection distance (SE-MPD), for which w…
▽ More
Given a collection of multidimensional pairs $\{(X_i,Y_i):1 \leq i\leq n\}$, we study the problem of projecting the associated suitably smoothed empirical measure onto the space of martingale couplings (i.e. distributions satisfying $\mathbb{E}[Y|X]=X$) using the adapted Wasserstein distance. We call the resulting distance the smoothed empirical martingale projection distance (SE-MPD), for which we obtain an explicit characterization. We also show that the space of martingale couplings remains invariant under the smoothing operation. We study the asymptotic limit of the SE-MPD, which converges at a parametric rate as the sample size increases if the pairs are either i.i.d. or satisfy appropriate mixing assumptions. Additional finite-sample results are also investigated. Using these results, we introduce a novel consistent martingale coupling hypothesis test, which we apply to test the existence of arbitrage opportunities in recently introduced neural network-based generative models for asset pricing calibration.
△ Less
Submitted 22 January, 2024;
originally announced January 2024.
-
Multi-objective variational curves
Authors:
C. Yalçın Kaya,
J. Lyle Noakes,
Erchuan Zhang
Abstract:
Riemannian cubics in tension are critical points of the linear combination of two objective functionals, namely the squared norms of the velocity and acceleration of a curve on a Riemannian manifold. We view this variational problem of finding a curve as a multi-objective optimization problem and construct the Pareto fronts for some given instances where the manifold is a sphere and where the mani…
▽ More
Riemannian cubics in tension are critical points of the linear combination of two objective functionals, namely the squared norms of the velocity and acceleration of a curve on a Riemannian manifold. We view this variational problem of finding a curve as a multi-objective optimization problem and construct the Pareto fronts for some given instances where the manifold is a sphere and where the manifold is a torus. The Pareto front for the curves on the torus turns out to be particularly interesting: the front is disconnected and it reveals two distinct Riemannian cubics with the same boundary data, which is the first known nontrivial instance of this kind. We also discuss some convexity conditions involving the Pareto fronts for curves on general Riemannian manifolds.
△ Less
Submitted 26 June, 2023;
originally announced June 2023.
-
Decay Rates and Eigenvalue Asymptotics for Abstract Strongly Coupled Hyperbolic Equations with Infinite Memory
Authors:
Hai E Zhang,
Gen Qi Xu,
Zhong Jie Han
Abstract:
In this paper, the asymptotic behavior of abstract strongly coupled hyperbolic equations with one infinite memory term is investigated, one specific case of which is the model for describing the dynamical behaviour of magnetic effected piezoelectric beams. A fractional operator is involved in the memory term depending on the parameter $a\in [0,1)$. By means of frequency domain analysis, it is prov…
▽ More
In this paper, the asymptotic behavior of abstract strongly coupled hyperbolic equations with one infinite memory term is investigated, one specific case of which is the model for describing the dynamical behaviour of magnetic effected piezoelectric beams. A fractional operator is involved in the memory term depending on the parameter $a\in [0,1)$. By means of frequency domain analysis, it is proved that the system can be indirectly stabilized polynomially by only one infinite memory term located on one of these two strongly coupled PDEs, and the explicit decay rates given as $t^{-\frac{1}{2-2a}}$ are only dependent on the parameter $a$. When considering the exponentially decreasing kernel, a detailed spectral analysis for the system operator is further provided. Specifically, the asymptotic expressions of the eigenvalues of the system operator are derived. Based on the expressions of the eigenvalues, the optimality of the obtained decay rates is further verified for this system.
△ Less
Submitted 13 May, 2023;
originally announced May 2023.
-
A Formula for Derived Sets in General Topology
Authors:
Eugene Zhang
Abstract:
In this paper, we present a general formula for derived sets in general topology. Consequently, more results can be proved in general topology involving derived sets and isolated point sets. More specifically, we can prove that isolated point sets are nowhere dense in general topological space.
In this paper, we present a general formula for derived sets in general topology. Consequently, more results can be proved in general topology involving derived sets and isolated point sets. More specifically, we can prove that isolated point sets are nowhere dense in general topological space.
△ Less
Submitted 12 May, 2023; v1 submitted 17 April, 2023;
originally announced April 2023.
-
Minimal Axiomatization of Boolean Algebras
Authors:
Eugene Zhang
Abstract:
In this paper, we present a new axiomatic system that is a minimal axiomatization of Boolean algebras. Furthermore, the symmetric difference is shown to be algebraically analogous to the modular difference of two numbers. Finally, a new method to prove equivalent relations in a Boolean algebra is also given.
In this paper, we present a new axiomatic system that is a minimal axiomatization of Boolean algebras. Furthermore, the symmetric difference is shown to be algebraically analogous to the modular difference of two numbers. Finally, a new method to prove equivalent relations in a Boolean algebra is also given.
△ Less
Submitted 28 October, 2023; v1 submitted 5 April, 2023;
originally announced April 2023.
-
Generalized Von Neumann Universe and Non-Well-Founded Sets
Authors:
Eugene Zhang
Abstract:
In this paper, a generalized version of the von Neumann universe known as the total universe is proposed to formally introduce non-well-founded sets that include infinitons, semi-infinitons and quasi-infinitons in Russell's paradox. All three infinitons are part of infinitely generated sets that are generators of non-well-founded sets. The total universe combines the well-founded sets with the non…
▽ More
In this paper, a generalized version of the von Neumann universe known as the total universe is proposed to formally introduce non-well-founded sets that include infinitons, semi-infinitons and quasi-infinitons in Russell's paradox. All three infinitons are part of infinitely generated sets that are generators of non-well-founded sets. The total universe combines the well-founded sets with the non-well-founded ones and turns out to be a model of ZF minus the axiom of regularity, which can be shown invalid in defining the well-founded sets. Also, the total universe is shown to be free of Russell's paradox.
△ Less
Submitted 2 April, 2023;
originally announced April 2023.
-
On the Independence Polynomial and Threshold of an Antiregular $k$-Hypergraph
Authors:
Erchuan Zhang
Abstract:
Given an integer $k\geq 3$ and an initial $k-1$ isolated vertices, an {\em antiregular $k$-hypergraph} is constructed by alternatively adding an isolated vertex (connected to no other vertices) or a dominating vertex (connected to every other $k-1$ vertices). Let $a_i$ be the number of independent sets of cardinality $i$ in a hypergraph $H$, then the {\em independence polynomial} of $H$ is defined…
▽ More
Given an integer $k\geq 3$ and an initial $k-1$ isolated vertices, an {\em antiregular $k$-hypergraph} is constructed by alternatively adding an isolated vertex (connected to no other vertices) or a dominating vertex (connected to every other $k-1$ vertices). Let $a_i$ be the number of independent sets of cardinality $i$ in a hypergraph $H$, then the {\em independence polynomial} of $H$ is defined as $I(H;x)=\sum_{i=0}^m a_i x^i$, where $m$ is the size of a maximum independent set. The main purpose of the present paper is to generalise some results of independence polynomials of antiregular graphs to the case of antiregular $k$-hypergraphs. In particular, we derive (semi-)closed formulas for the independence polynomials of antiregular $k$-hypergraphs and prove their log-concavity. Furthermore, we show that antiregular $k$-hypergraphs are {\em $T2$-threshold}, which means there exist a labeling $c$ of the vertex set and a threshold $τ$ such that for any vertex subset $S$ of cardinality $k$, $\sum_{i\in S}c(i)>τ$ if and only if $S$ is a hyperedge.
△ Less
Submitted 2 March, 2023;
originally announced March 2023.
-
On the Geometry Transferability of the Hybrid Iterative Numerical Solver for Differential Equations
Authors:
Adar Kahana,
Enrui Zhang,
Somdatta Goswami,
George EM Karniadakis,
Rishikesh Ranade,
Jay Pathak
Abstract:
The discovery of fast numerical solvers prompted a clear and rapid shift towards iterative techniques in many applications, especially in computational mechanics, due to the increased necessity for solving very large linear systems. Most numerical solvers are highly dependent on the problem geometry and discretization, facing issues when any of these properties change. The newly developed Hybrid I…
▽ More
The discovery of fast numerical solvers prompted a clear and rapid shift towards iterative techniques in many applications, especially in computational mechanics, due to the increased necessity for solving very large linear systems. Most numerical solvers are highly dependent on the problem geometry and discretization, facing issues when any of these properties change. The newly developed Hybrid Iterative Numerical Transferable Solver (HINTS) combines a standard solver with a neural operator to achieve better performance, focusing on a single geometry at a time. In this work, we explore the "T" in HINTS, i.e., the geometry transferability properties of HINTS. We first propose to directly employ HINTS built for a specific geometry to a different but related geometry without any adjustments. In addition, we propose the integration of an operator level transfer learning with HINTS to even further improve the convergence of HINTS on new geometries and discretizations. We conduct numerical experiments for a Darcy flow problem and a plane-strain elasticity problem. The results show that both the direct application of HINTS and the transfer learning enhanced HINTS are able to accurately solve these problems on different geometries. In addition, using transfer learning, HINTS is able to converge to machine zero even faster than the direct application of HINTS.
△ Less
Submitted 31 October, 2022;
originally announced October 2022.
-
A Hybrid Iterative Numerical Transferable Solver (HINTS) for PDEs Based on Deep Operator Network and Relaxation Methods
Authors:
Enrui Zhang,
Adar Kahana,
Eli Turkel,
Rishikesh Ranade,
Jay Pathak,
George Em Karniadakis
Abstract:
Iterative solvers of linear systems are a key component for the numerical solutions of partial differential equations (PDEs). While there have been intensive studies through past decades on classical methods such as Jacobi, Gauss-Seidel, conjugate gradient, multigrid methods and their more advanced variants, there is still a pressing need to develop faster, more robust and reliable solvers. Based…
▽ More
Iterative solvers of linear systems are a key component for the numerical solutions of partial differential equations (PDEs). While there have been intensive studies through past decades on classical methods such as Jacobi, Gauss-Seidel, conjugate gradient, multigrid methods and their more advanced variants, there is still a pressing need to develop faster, more robust and reliable solvers. Based on recent advances in scientific deep learning for operator regression, we propose HINTS, a hybrid, iterative, numerical, and transferable solver for differential equations. HINTS combines standard relaxation methods and the Deep Operator Network (DeepONet). Compared to standard numerical solvers, HINTS is capable of providing faster solutions for a wide class of differential equations, while preserving the accuracy close to machine zero. Through an eigenmode analysis, we find that the individual solvers in HINTS target distinct regions in the spectrum of eigenmodes, resulting in a uniform convergence rate and hence exceptional performance of the hybrid solver overall. Moreover, HINTS applies to equations in multidimensions, and is flexible with regards to computational domain and transferable to different discretizations.
△ Less
Submitted 28 August, 2022;
originally announced August 2022.
-
An optimal transport based characterization of convex order
Authors:
Johannes Wiesel,
Erica Zhang
Abstract:
For probability measures $μ,ν$ and $ρ$ define the cost functionals \begin{align*} C(μ,ρ):=\sup_{π\in Π(μ,ρ)} \int \langle x,y\rangle\, π(dx,dy),\quad C(ν,ρ):=\sup_{π\in Π(ν,ρ)} \int \langle x,y\rangle\, π(dx,dy), \end{align*} where $\langle\cdot, \cdot\rangle$ denotes the scalar product and $Π(\cdot,\cdot)$ is the set of couplings. We show that two probability measures $μ$ and $ν$ on…
▽ More
For probability measures $μ,ν$ and $ρ$ define the cost functionals \begin{align*} C(μ,ρ):=\sup_{π\in Π(μ,ρ)} \int \langle x,y\rangle\, π(dx,dy),\quad C(ν,ρ):=\sup_{π\in Π(ν,ρ)} \int \langle x,y\rangle\, π(dx,dy), \end{align*} where $\langle\cdot, \cdot\rangle$ denotes the scalar product and $Π(\cdot,\cdot)$ is the set of couplings. We show that two probability measures $μ$ and $ν$ on $\mathbb{R}^d$ with finite first moments are in convex order (i.e. $μ\preceq_cν$) iff $C(μ,ρ)\le C(ν,ρ)$ holds for all probability measures $ρ$ on $\mathbb{R}^d$ with bounded support. This generalizes a result by Carlier. Our proof relies on a quantitative bound for the infimum of $\int f\,dν-\int f\,dμ$ over all $1$-Lipschitz functions $f$, which is obtained through optimal transport duality and Brenier's theorem. Building on this result, we derive new proofs of well-known one-dimensional characterizations of convex order. We also describe new computational methods for investigating convex order and applications to model-independent arbitrage strategies in mathematical finance.
△ Less
Submitted 8 March, 2023; v1 submitted 4 July, 2022;
originally announced July 2022.
-
A model aggregation approach for high-dimensional large-scale optimization
Authors:
Haowei Wang,
Ercong Zhang,
Szu Hui Ng,
Giulia Pedrielli
Abstract:
Bayesian optimization (BO) has been widely used in machine learning and simulation optimization. With the increase in computational resources and storage capacities in these fields, high-dimensional and large-scale problems are becoming increasingly common. In this study, we propose a model aggregation method in the Bayesian optimization (MamBO) algorithm for efficiently solving high-dimensional l…
▽ More
Bayesian optimization (BO) has been widely used in machine learning and simulation optimization. With the increase in computational resources and storage capacities in these fields, high-dimensional and large-scale problems are becoming increasingly common. In this study, we propose a model aggregation method in the Bayesian optimization (MamBO) algorithm for efficiently solving high-dimensional large-scale optimization problems. MamBO uses a combination of subsampling and subspace embeddings to collectively address high dimensionality and large-scale issues; in addition, a model aggregation method is employed to address the surrogate model uncertainty issue that arises when embedding is applied. This surrogate model uncertainty issue is largely ignored in the embedding literature and practice, and it is exacerbated when the problem is high-dimensional and data are limited. Our proposed model aggregation method reduces these lower-dimensional surrogate model risks and improves the robustness of the BO algorithm. We derive an asymptotic bound for the proposed aggregated surrogate model and prove the convergence of MamBO. Benchmark numerical experiments indicate that our algorithm achieves superior or comparable performance to other commonly used high-dimensional BO algorithms. Moreover, we apply MamBO to a cascade classifier of a machine learning algorithm for face detection, and the results reveal that MamBO finds settings that achieve higher classification accuracy than the benchmark settings and is computationally faster than other high-dimensional BO algorithms.
△ Less
Submitted 1 June, 2022; v1 submitted 16 May, 2022;
originally announced May 2022.
-
Stability of Multi-dimensional Nonlinear Piezoelectric Beam with Viscoelastic Infinite Memory
Authors:
H. E Zhang,
G. Q. Xu,
Z. J. Han
Abstract:
The long time behavior of a kind of fully magnetic effected nonlinear piezoelectric beam with viscoelastic infinite memory is considered. The well-posedness of this nonlinear coupled PDEs system is showed by mean of the semigroup theories and Banach fixed point theorem. Based on frequency domain analysis, it is proved that the corresponding coupled linear system can be indirectly stabilized expone…
▽ More
The long time behavior of a kind of fully magnetic effected nonlinear piezoelectric beam with viscoelastic infinite memory is considered. The well-posedness of this nonlinear coupled PDEs system is showed by mean of the semigroup theories and Banach fixed point theorem. Based on frequency domain analysis, it is proved that the corresponding coupled linear system can be indirectly stabilized exponentially by only one viscoelastic infinite memory term, which is located on one equation of these strongly coupled PDEs. Then the exponential decay of the solution to the nonlinear coupled PDEs' system is established by the energy estimation method under certain condition.
△ Less
Submitted 5 September, 2022; v1 submitted 7 April, 2022;
originally announced April 2022.
-
On the exponential stability of Beck's Problem on a star-shaped graph
Authors:
Mahyar Mahinzaeim,
Gen Qi Xu,
Hai E Zhang
Abstract:
We deal with the as yet unresolved exponential stability problem for Beck's Problem on a metric star graph with three identical edges. The edges are stretched Euler--Bernoulli beams which are simply supported with respect to the outer vertices. At the inner vertex we have viscoelastic dam** acting on the slopes of the edges. We carry out a complete spectral analysis of the system operator associ…
▽ More
We deal with the as yet unresolved exponential stability problem for Beck's Problem on a metric star graph with three identical edges. The edges are stretched Euler--Bernoulli beams which are simply supported with respect to the outer vertices. At the inner vertex we have viscoelastic dam** acting on the slopes of the edges. We carry out a complete spectral analysis of the system operator associated with the abstract spectral problem in Hilbert space. Within this framework it is shown that the eigenvectors have the property of forming a Riesz (i.e.\ an unconditional) basis, which makes it possible to directly deduce the exponential stability of the corresponding $C_0$-semigroup using spectral information for the system operator alone. A physically interesting conclusion is that the particular choice of vertex conditions ensures the exponential stability even when the elasticity acting on the slopes of the edges is absent.
△ Less
Submitted 3 August, 2023; v1 submitted 31 May, 2021;
originally announced June 2021.
-
Surface Multigrid via Intrinsic Prolongation
Authors:
Hsueh-Ti Derek Liu,
Jiayi Eris Zhang,
Mirela Ben-Chen,
Alec Jacobson
Abstract:
This paper introduces a novel geometric multigrid solver for unstructured curved surfaces. Multigrid methods are highly efficient iterative methods for solving systems of linear equations. Despite the success in solving problems defined on structured domains, generalizing multigrid to unstructured curved domains remains a challenging problem. The critical missing ingredient is a prolongation opera…
▽ More
This paper introduces a novel geometric multigrid solver for unstructured curved surfaces. Multigrid methods are highly efficient iterative methods for solving systems of linear equations. Despite the success in solving problems defined on structured domains, generalizing multigrid to unstructured curved domains remains a challenging problem. The critical missing ingredient is a prolongation operator to transfer functions across different multigrid levels. We propose a novel method for computing the prolongation for triangulated surfaces based on intrinsic geometry, enabling an efficient geometric multigrid solver for curved surfaces. Our surface multigrid solver achieves better convergence than existing multigrid methods. Compared to direct solvers, our solver is orders of magnitude faster. We evaluate our method on many geometry processing applications and a wide variety of complex shapes with and without boundaries. By simply replacing the direct solver, we upgrade existing algorithms to interactive frame rates, and shift the computational bottleneck away from solving linear systems.
△ Less
Submitted 4 May, 2021; v1 submitted 28 April, 2021;
originally announced April 2021.
-
Photoacoustic Reconstruction Using Sparsity in Curvelet Frame: Image versus Data Domain
Authors:
Bolin Pan,
Simon R. Arridge,
Felix Lucka,
Ben T. Cox,
Nam Huynh,
Paul C. Beard,
Edward Z. Zhang,
Marta M. Betcke
Abstract:
Curvelet frame is of special significance for photoacoustic tomography (PAT) due to its sparsifying and microlocalisation properties. We derive a one-to-one map between wavefront directions in image and data spaces in PAT which suggests near equivalence between the recovery of the initial pressure and PAT data from compressed/subsampled measurements when assuming sparsity in Curvelet frame. As the…
▽ More
Curvelet frame is of special significance for photoacoustic tomography (PAT) due to its sparsifying and microlocalisation properties. We derive a one-to-one map between wavefront directions in image and data spaces in PAT which suggests near equivalence between the recovery of the initial pressure and PAT data from compressed/subsampled measurements when assuming sparsity in Curvelet frame. As the latter is computationally more tractable, investigation to which extent this equivalence holds conducted in this paper is of immediate practical significance. To this end we formulate and compare DR, a two step approach based on the recovery of the complete volume of the photoacoustic data from the subsampled data followed by the acoustic inversion, and p0R, a one step approach where the photoacoustic image (the initial pressure, p0) is directly recovered from the subsampled data. Effective representation of the photoacoustic data requires basis defined on the range of the photoacoustic forward operator. To this end we propose a novel wedge-restriction of Curvelet transform which enables us to construct such basis. Both recovery problems are formulated in a variational framework. As the Curvelet frame is heavily overdetermined, we use reweighted l1 norm penalties to enhance the sparsity of the solution. The data reconstruction problem DR is a standard compressed sensing recovery problem, which we solve using an ADMMtype algorithm, SALSA. Subsequently, the initial pressure is recovered using time reversal as implemented in the k-Wave Toolbox. The p0 reconstruction problem, p0R, aims to recover the photoacoustic image directly via FISTA, or ADMM when in addition including a non-negativity constraint. We compare and discuss the relative merits of the two approaches and illustrate them on 2D simulated and 3D real data in a fair and rigorous manner.
△ Less
Submitted 6 August, 2021; v1 submitted 25 November, 2020;
originally announced November 2020.
-
Extremal Pattern-Avoiding Words
Authors:
Natalya Ter-Saakov,
Emily Zhang
Abstract:
Recently, Grytczuk, Kordulewski, and Niewiadomski defined an extremal word over an alphabet $\mathbb{A}$ to be a word with the property that inserting any letter from $\mathbb{A}$ at any position in the word yields a given pattern. In this paper, we determine the number of extremal $XY_1XY_2X\dots XY_tX$-avoiding words on a $k$-letter alphabet. We also derive a lower bound on the shortest possible…
▽ More
Recently, Grytczuk, Kordulewski, and Niewiadomski defined an extremal word over an alphabet $\mathbb{A}$ to be a word with the property that inserting any letter from $\mathbb{A}$ at any position in the word yields a given pattern. In this paper, we determine the number of extremal $XY_1XY_2X\dots XY_tX$-avoiding words on a $k$-letter alphabet. We also derive a lower bound on the shortest possible length of an extremal square-free word on a $k$-letter alphabet that grows exponentially in $k$.
△ Less
Submitted 21 September, 2020;
originally announced September 2020.
-
On the Broadcast Dimension of a Graph
Authors:
Emily Zhang
Abstract:
A function $f:V(G)\rightarrow \mathbb{Z}^+ \cup \{0\}$ is a resolving broadcast of a graph $G$ if, for any distinct $x,y\in V(G)$, there exists a vertex $z\in V(G)$ with $f(z)>0$ such that $\min\{d(x,z), f(z)+1\} \neq \min\{d(y,z), f(z)+1\}.$ The broadcast dimension of $G$ is the minimum of $\sum_{v\in V(G)}f(v)$ over all resolving broadcasts $f$ of $G$. The concept of broadcast dimension was intr…
▽ More
A function $f:V(G)\rightarrow \mathbb{Z}^+ \cup \{0\}$ is a resolving broadcast of a graph $G$ if, for any distinct $x,y\in V(G)$, there exists a vertex $z\in V(G)$ with $f(z)>0$ such that $\min\{d(x,z), f(z)+1\} \neq \min\{d(y,z), f(z)+1\}.$ The broadcast dimension of $G$ is the minimum of $\sum_{v\in V(G)}f(v)$ over all resolving broadcasts $f$ of $G$. The concept of broadcast dimension was introduced by Geneson and Yi as a variant of metric dimension and has applications in areas such as network discovery and robot navigation.
In this paper, we derive an asymptotically tight lower bound on the broadcast dimension of an acyclic graph in the number of vertices, and we show that a lower bound by Geneson and Yi on the broadcast dimension of a general graph in the adjacency dimension is asymptotically tight. We also study the change in the broadcast dimension of a graph under a single edge deletion. We show that both the additive increase and decrease of the broadcast dimension of a graph under edge deletion is unbounded. Moreover, we show that under edge deletion, the broadcast dimension of any graph increases by a multiplicative factor of at most 3. These results fully answer three questions asked by Geneson and Yi.
△ Less
Submitted 3 August, 2020;
originally announced August 2020.
-
On the stability of optimization algorithms given by discretizations of the Euler-Lagrange ODE
Authors:
Rachel Walker,
Emily Zhang
Abstract:
The derivation of second-order ordinary differential equations (ODEs) as continuous-time limits of optimization algorithms has been shown to be an effective tool for the analysis of these algorithms. Additionally, discretizing generalizations of these ODEs can lead to new families of optimization methods. We study discretizations of an Euler-Lagrange equation which generate a large class of accele…
▽ More
The derivation of second-order ordinary differential equations (ODEs) as continuous-time limits of optimization algorithms has been shown to be an effective tool for the analysis of these algorithms. Additionally, discretizing generalizations of these ODEs can lead to new families of optimization methods. We study discretizations of an Euler-Lagrange equation which generate a large class of accelerated methods whose convergence rate is $O(\frac{1}{t^p})$ in continuous-time, where parameter $p$ is the order of the optimization method. Specifically, we address the question asking why a naive explicit-implicit Euler discretization of this solution produces an unstable algorithm, even for a strongly convex objective function. We prove that for a strongly convex $L$-smooth quadratic objective function and step size $δ<\frac{1}{L}$, the naive discretization will exhibit stable behavior when the number of iterations $k$ satisfies the inequality $k < (\frac{4}{Lp^2 δ^p})^{\frac{1}{p-2}}$. Additionally, we extend our analysis to the implicit and explicit Euler discretization methods to determine end behavior.
△ Less
Submitted 27 August, 2019;
originally announced August 2019.
-
On $d$--$σ$--stability in random metric spaces and its applications
Authors:
Tiexin Guo,
Erxin Zhang,
Yachao Wang,
Bixuan Yang
Abstract:
In 2010, the first author of this paper introduced the notion of $σ$--stability for a nonempty subset of an $L^0(\mathcal{F},K)$--module in [T.X. Guo, Relations between some basic results derived from two kinds of topologies for a random locally convex module, J. Funct. Anal. 258(2010), 3024--3047], this kind of $σ$--stability is purely algebraic and leads to a series of deep developments of rando…
▽ More
In 2010, the first author of this paper introduced the notion of $σ$--stability for a nonempty subset of an $L^0(\mathcal{F},K)$--module in [T.X. Guo, Relations between some basic results derived from two kinds of topologies for a random locally convex module, J. Funct. Anal. 258(2010), 3024--3047], this kind of $σ$--stability is purely algebraic and leads to a series of deep developments of random normed modules and random locally convex modules. Motivated by this, A. Jamneshan, M. Kupper and J. M. Zapata recently introduced another kind of $σ$--stability for a nonempty subset of a random metric space $(E,d)$, called $d$--$σ$--stability since it depends on the random metric $d$. $d$--$σ$--stability coincides with the previous $σ$--stability in the case of random normed modules, which motivates us in this paper to generalize the precise form of Ekeland's variational principle from a complete random normed module to a complete $d$--$σ$--stable random metric space. Besides, this paper also utilize $d$--$σ$--stability to generalize Nadler's fixed point theorem for a multivalued contraction map** from a complete metric space to a complete random metric space. To our surprise, our simple fixed point theorem, however, can derive the known basic fixed point theorems of contraction type for both random operators and $σ$--stable map**s on a complete random normed module. A lot of examples shows the study of random metric spaces is more complicated than that of random normed modules.
△ Less
Submitted 17 April, 2019; v1 submitted 15 April, 2019;
originally announced April 2019.
-
$L^0$--convex compactness and random normal structure in $L^0(\mathcal{F},B)$
Authors:
Tiexin Guo,
Erxin Zhang,
Yachao Wang,
George Yuan
Abstract:
Let $(B,\|\cdot\|)$ be a Banach space, $(Ω,\mathcal{F},P)$ a probability space and $L^0(\mathcal{F},B)$ the set of equivalence classes of strong random elements (or strongly measurable functions) from $(Ω,\mathcal{F},P)$ to $(B,\|\cdot\|)$. It is well known that $L^0(\mathcal{F},B)$ becomes a complete random normed module, which has played an important role in the process of applications of random…
▽ More
Let $(B,\|\cdot\|)$ be a Banach space, $(Ω,\mathcal{F},P)$ a probability space and $L^0(\mathcal{F},B)$ the set of equivalence classes of strong random elements (or strongly measurable functions) from $(Ω,\mathcal{F},P)$ to $(B,\|\cdot\|)$. It is well known that $L^0(\mathcal{F},B)$ becomes a complete random normed module, which has played an important role in the process of applications of random normed modules to the theory of Lebesgue--Bochner function spaces and random functional analysis. Let $V$ be a closed convex subset of $B$ and $L^0(\mathcal{F},V)$ the set of equivalence classes of strong random elements from $(Ω,\mathcal{F},P)$ to $(B,\|\cdot\|)$, the central purpose of this paper is to prove the following two results: (1). $L^0(\mathcal{F},V)$ is $L^0$--convexly compact if and only if $V$ is weakly compact; (2). $L^0(\mathcal{F},V)$ has random normal structure if $V$ is weakly compact and has normal structure. As an application, a general random fixed point theorem for a strong random nonexpansive operator is given, which generalizes and improves several well known results. We hope that our new method, namely skillfully combining measurable selection theorems, the theory of random normed modules and Banach space techniques, can be applied in the other related aspects.
△ Less
Submitted 7 April, 2019;
originally announced April 2019.
-
Limit Densities of Patterns in Permutation Inflations
Authors:
Tanya Khovanova,
Eric Zhang
Abstract:
Call a permutation $k$-inflatable if the sequence of its tensor products with uniform random permutations of increasing lengths has uniform $k$-point pattern densities. Previous work has shown that nontrivial $k$-inflatable permutations do not exist for $k \geq 4$. In this paper, we derive a general formula for the limit densities of patterns in the sequence of tensor products of a fixed permutati…
▽ More
Call a permutation $k$-inflatable if the sequence of its tensor products with uniform random permutations of increasing lengths has uniform $k$-point pattern densities. Previous work has shown that nontrivial $k$-inflatable permutations do not exist for $k \geq 4$. In this paper, we derive a general formula for the limit densities of patterns in the sequence of tensor products of a fixed permutation with each permutation from a convergent sequence. By applying this result, we completely characterize $3$-inflatable permutations and find explicit examples of $3$-inflatable permutations with various lengths, including the shortest examples with length $17$.
△ Less
Submitted 11 January, 2021; v1 submitted 22 September, 2018;
originally announced September 2018.
-
Enhancing Compressed Sensing 4D Photoacoustic Tomography by Simultaneous Motion Estimation
Authors:
Felix Lucka,
Nam Huynh,
Marta Betcke,
Edward Zhang,
Paul Beard,
Ben Cox,
Simon Arridge
Abstract:
A crucial limitation of current high-resolution 3D photoacoustic tomography (PAT) devices that employ sequential scanning is their long acquisition time. In previous work, we demonstrated how to use compressed sensing techniques to improve upon this: images with good spatial resolution and contrast can be obtained from suitably sub-sampled PAT data acquired by novel acoustic scanning systems if sp…
▽ More
A crucial limitation of current high-resolution 3D photoacoustic tomography (PAT) devices that employ sequential scanning is their long acquisition time. In previous work, we demonstrated how to use compressed sensing techniques to improve upon this: images with good spatial resolution and contrast can be obtained from suitably sub-sampled PAT data acquired by novel acoustic scanning systems if sparsity-constrained image reconstruction techniques such as total variation regularization are used. Now, we show how a further increase of image quality can be achieved for imaging dynamic processes in living tissue (4D PAT). The key idea is to exploit the additional temporal redundancy of the data by coupling the previously used spatial image reconstruction models with sparsity-constrained motion estimation models. While simulated data from a two-dimensional numerical phantom will be used to illustrate the main properties of this recently developed joint-image-reconstruction-and-motion-estimation framework, measured data from a dynamic experimental phantom will also be used to demonstrate their potential for challenging, large-scale, real-world, three-dimensional scenarios. The latter only becomes feasible if a carefully designed combination of tailored optimization schemes is employed, which we describe and examine in more detail.
△ Less
Submitted 15 June, 2018; v1 submitted 14 February, 2018;
originally announced February 2018.
-
Two fixed point theorems in complete random normed modules and their applications to backward stochastic equations
Authors:
Tiexin Guo,
Erxin Zhang,
Yachao Wang,
ZiChen Guo
Abstract:
This paper first proves two fixed point theorems in complete random normed modules, which are respectively the random generalizations of the classical Banach's contraction map** principle and Browder--Kirk's fixed point theorem. As applications, the first is used to give the existence and uniqueness of solutions to various kinds of backward stochastic equations under $L^0$--Lipschitz assumptions…
▽ More
This paper first proves two fixed point theorems in complete random normed modules, which are respectively the random generalizations of the classical Banach's contraction map** principle and Browder--Kirk's fixed point theorem. As applications, the first is used to give the existence and uniqueness of solutions to various kinds of backward stochastic equations under $L^0$--Lipschitz assumptions and the second is used to establish the existence of solutions to backward stochastic equations of nonexpansive type.
△ Less
Submitted 28 November, 2018; v1 submitted 28 January, 2018;
originally announced January 2018.
-
$L^0$--convex compactness and its applications to random convex optimization and random variational inequalities
Authors:
Tiexin Guo,
Erxin Zhang,
Yachao Wang,
Mingzhi Wu
Abstract:
In 2010, Gordan Žitković introduced the notion of convex compactness for a convex subset of a linear topological space and gave some important applications to both nonlinear analysis and mathematical economics in [ Gordan Žitković, Convex compactness and its applications, Math. Finance Econom. 3(1) (2010) 1--12 ]. Motivated by Gordan Žitković's idea, in this paper we introduce the notion of $L^0$-…
▽ More
In 2010, Gordan Žitković introduced the notion of convex compactness for a convex subset of a linear topological space and gave some important applications to both nonlinear analysis and mathematical economics in [ Gordan Žitković, Convex compactness and its applications, Math. Finance Econom. 3(1) (2010) 1--12 ]. Motivated by Gordan Žitković's idea, in this paper we introduce the notion of $L^0$--convex compactness for an $L^0$--convex subset of a topological module over the topological algebra $L^0(\mathcal{F},K)$, where $L^0(\mathcal{F},K)$ is the algebra of equivalence classes of random variables from a probability space $(Ω,\mathcal{F},P)$ to the scalar field $K$ of real numbers or complex numbers, endowed with the topology of convergence in probability. This paper continues to develop the theory of $L^0$--convex compactness by establishing various kinds of characterization theorems for $L^0$--convex subsets of a class of important topological modules--complete random normed modules, in particular, we make use of the theory of random conjugate spaces to give a characterization theorem of James type for a closed $L^0$--convex subset of a complete random normed module. As applications, we successfully generalize some basic theorems of classical convex optimization and variational inequalities from a convex function on a reflexive Banach space to an $L^0$--convex function on a random reflexive random normed module. Since the usual weak compactness method fails in the random setting of this paper and in particular, since the difficulties caused by the partial order structure of the range of an $L^0$--valued function also frequently occurs in the study of problems involved in this paper, we are forced to discover a series of new skills to meet the needs of this paper.
△ Less
Submitted 10 August, 2019; v1 submitted 20 September, 2017;
originally announced September 2017.
-
Acoustic Wave Field Reconstruction from Compressed Measurements with Application in Photoacoustic Tomography
Authors:
Marta M. Betcke,
Ben T. Cox,
Nam Huynh,
Edward Z. Zhang,
Paul C. Beard,
Simon R. Arridge
Abstract:
We present a method for the recovery of compressively sensed acoustic fields using patterned, instead of point-by-point, detection. From a limited number of such compressed measurements, we propose to reconstruct the field on the sensor plane in each time step independently assuming its sparsity in a Curvelet frame. A modification of the Curvelet frame is proposed to account for the smoothing effe…
▽ More
We present a method for the recovery of compressively sensed acoustic fields using patterned, instead of point-by-point, detection. From a limited number of such compressed measurements, we propose to reconstruct the field on the sensor plane in each time step independently assuming its sparsity in a Curvelet frame. A modification of the Curvelet frame is proposed to account for the smoothing effects of data acquisition and motivated by a frequency domain model for photoacoustic tomography. An ADMM type algorithm, SALSA, is used to recover the pointwise data in each individual time step from the patterned measurements. For photoacoustic applications, the photoacoustic image of the initial pressure is reconstructed using time reversal in ${\bf k}$-Wave Toolbox.
△ Less
Submitted 9 September, 2016;
originally announced September 2016.
-
Accelerated High-Resolution Photoacoustic Tomography via Compressed Sensing
Authors:
Simon Arridge,
Paul Beard,
Marta Betcke,
Ben Cox,
Nam Huynh,
Felix Lucka,
Olumide Ogunlade,
Edward Zhang
Abstract:
Current 3D photoacoustic tomography (PAT) systems offer either high image quality or high frame rates but are not able to deliver high spatial and temporal resolution simultaneously, which limits their ability to image dynamic processes in living tissue. A particular example is the planar Fabry-Perot (FP) scanner, which yields high-resolution images but takes several minutes to sequentially map th…
▽ More
Current 3D photoacoustic tomography (PAT) systems offer either high image quality or high frame rates but are not able to deliver high spatial and temporal resolution simultaneously, which limits their ability to image dynamic processes in living tissue. A particular example is the planar Fabry-Perot (FP) scanner, which yields high-resolution images but takes several minutes to sequentially map the photoacoustic field on the sensor plane, point-by-point. However, as the spatio-temporal complexity of many absorbing tissue structures is rather low, the data recorded in such a conventional, regularly sampled fashion is often highly redundant. We demonstrate that combining variational image reconstruction methods using spatial sparsity constraints with the development of novel PAT acquisition systems capable of sub-sampling the acoustic wave field can dramatically increase the acquisition speed while maintaining a good spatial resolution: First, we describe and model two general spatial sub-sampling schemes. Then, we discuss how to implement them using the FP scanner and demonstrate the potential of these novel compressed sensing PAT devices through simulated data from a realistic numerical phantom and through measured data from a dynamic experimental phantom as well as from in-vivo experiments. Our results show that images with good spatial resolution and contrast can be obtained from highly sub-sampled PAT data if variational image reconstruction methods that describe the tissues structures with suitable sparsity-constraints are used. In particular, we examine the use of total variation regularization enhanced by Bregman iterations. These novel reconstruction strategies offer new opportunities to dramatically increase the acquisition speed of PAT scanners that employ point-by-point sequential scanning as well as reducing the channel count of parallelized schemes that use detector arrays.
△ Less
Submitted 28 September, 2016; v1 submitted 30 April, 2016;
originally announced May 2016.
-
On random convex analysis
Authors:
Tiexin Guo,
Erxin Zhang,
Mingzhi Wu,
Bixuan Yang,
George Yuan,
Xiaolin Zeng
Abstract:
Recently, based on the idea of randomizing space theory, random convex analysis has been being developed in order to deal with the corresponding problems in random environments such as analysis of conditional convex risk measures and the related variational problems and optimization problems. Random convex analysis is convex analysis over random locally convex modules. Since random locally convex…
▽ More
Recently, based on the idea of randomizing space theory, random convex analysis has been being developed in order to deal with the corresponding problems in random environments such as analysis of conditional convex risk measures and the related variational problems and optimization problems. Random convex analysis is convex analysis over random locally convex modules. Since random locally convex modules have the more complicated topological and algebraic structures than ordinary locally convex spaces, establishing random convex analysis will encounter harder mathematical challenges than classical convex analysis so that there are still a lot of fundamentally important unsolved problems in random convex analysis. This paper is devoted to solving some important theoretic problems. First, we establish the inferior limit behavior of a proper lower semicontinuous $L^0$--convex function on a random locally convex module endowed with the locally $L^0$--convex topology, which makes perfect the Fenchel--Moreau duality theorem for such functions. Then, we investigate the relations among continuity, locally $L^0$--Lipschitzian continuity and almost surely sequent continuity of a proper $L^0$--convex function. And then, we establish the elegant relationships among subdifferentiability, Gâteaux--differentiability and Fréchét--differentiability for a proper $L^0$--convex function defined on random normed modules. At last, based on the Ekeland's variational principle for a proper lower semicontinuous $\bar{L}^0$--valued function, we show that $\varepsilon$--subdifferentials can be approximated by subdifferentials. We would like to emphasize that the success of this paper lies in simultaneously considering the $(\varepsilon, λ)$--topology and the locally $L^0$--convex topology for a random locally convex module.
△ Less
Submitted 8 September, 2017; v1 submitted 23 March, 2016;
originally announced March 2016.
