Showing 1–50 of 57 results for author: Tran, D

On Sums of Practical Numbers and Polygonal Numbers

Authors: Sai Teja Somu, Duc Van Khanh Tran

Abstract: Practical numbers are positive integers $n$ such that every positive integer less than or equal to $n$ can be written as a sum of distinct positive divisors of $n$. In this paper, we show that all positive integers can be written as a sum of a practical number and a triangular number, resolving a conjecture by Sun. We also show that all sufficiently large natural numbers can be written as a sum of… ▽ More Practical numbers are positive integers $n$ such that every positive integer less than or equal to $n$ can be written as a sum of distinct positive divisors of $n$. In this paper, we show that all positive integers can be written as a sum of a practical number and a triangular number, resolving a conjecture by Sun. We also show that all sufficiently large natural numbers can be written as a sum of a practical number and two $s$-gonal numbers. △ Less

Submitted 20 March, 2024; originally announced March 2024.

MSC Class: 11B83; 11D85; 11A99

Journal ref: Journal of Integer Sequences, 27(5), Article 24.5.1, 2024

A gradient flow method for smooth splines versus least-squares fitting on Riemannian manifolds

Authors: Chun-Chi Lin, The Dung Tran

Abstract: This article presents a novel resolution to the problem of spline interpolation versus least-squares fitting on smooth Riemannian manifolds utilizing the method of gradient flows of networks. This approach represents a contribution to both geometric control theory and statistical shape data analysis. Our work encompasses a rigorous proof for the existence of global solutions in Hölder spaces for t… ▽ More This article presents a novel resolution to the problem of spline interpolation versus least-squares fitting on smooth Riemannian manifolds utilizing the method of gradient flows of networks. This approach represents a contribution to both geometric control theory and statistical shape data analysis. Our work encompasses a rigorous proof for the existence of global solutions in Hölder spaces for the gradient flow. The asymptotic limits of these solutions establish the existence of the spline interpolation versus least-squares fitting problem on smooth Riemannian manifolds, offering a comprehensive solution. Notably, the constructive nature of the proof suggests potential numerical schemes for finding solutions. △ Less

Submitted 29 May, 2024; v1 submitted 28 February, 2024; originally announced February 2024.

Comments: the article is merged into another one of the authors' papers, arXiv:2312.10513

MSC Class: primary 35K52; 49J20; secondary 41A15; 35K25

Products and powers of principal symmetric ideals

Authors: Eric Dannetun, Riccardo Formenti, Bo Y. Gao, Juliann Geraci, Ross Kogel, Yuelin Li, Shreya Mandal, Vinuge Rupasinghe, Alexandra Seceleanu, Duc Van Khank Tran, Noah Walker

Abstract: Principal symmetric ideals were recently introduced by Harada, Seceleanu, and Sega, with a focus on their homological properties. They are ideals generated by the orbit of a single polynomial under permutations of variables in a polynomial ring. In this paper we seek to determine when a product of two principal symmetric ideals is principal symmetric and when all the powers of a principal symmetri… ▽ More Principal symmetric ideals were recently introduced by Harada, Seceleanu, and Sega, with a focus on their homological properties. They are ideals generated by the orbit of a single polynomial under permutations of variables in a polynomial ring. In this paper we seek to determine when a product of two principal symmetric ideals is principal symmetric and when all the powers of a principal symmetric ideal are again principal symmetric ideals. We characterize the ideals that have the latter property as being generated by polynomials invariant up to a scalar multiple under permutation of variables. Recognizing principal symmetric ideals is an open question for the purpose of which we produce certain obstructions. We also demonstrate that the Hilbert functions of symmetric monomial ideals are not all given by symmetric monomial ideals, in contrast to the non-symmetric case. △ Less

Submitted 17 June, 2024; v1 submitted 25 February, 2024; originally announced February 2024.

Comments: A flaw in the proof of Theorem 3.5 in version 1 = Theorem 3.6 in version 2 was remedied

MSC Class: Primary: 13A50; 13C13; Secondary: 13D40; 13F20

Fundamental Convergence Analysis of Sharpness-Aware Minimization

Authors: Pham Duy Khanh, Hoang-Chau Luong, Boris S. Mordukhovich, Dat Ba Tran

Abstract: The paper investigates the fundamental convergence properties of Sharpness-Aware Minimization (SAM), a recently proposed gradient-based optimization method (Foret et al., 2021) that significantly improves the generalization of deep neural networks. The convergence properties including the stationarity of accumulation points, the convergence of the sequence of gradients to the origin, the sequence… ▽ More The paper investigates the fundamental convergence properties of Sharpness-Aware Minimization (SAM), a recently proposed gradient-based optimization method (Foret et al., 2021) that significantly improves the generalization of deep neural networks. The convergence properties including the stationarity of accumulation points, the convergence of the sequence of gradients to the origin, the sequence of function values to the optimal value, and the sequence of iterates to the optimal solution are established for the method. The universality of the provided convergence analysis based on inexact gradient descent frameworks (Khanh et al., 2023b) allows its extensions to the normalized versions of SAM such as VaSSO (Li & Giannakis, 2023), RSAM (Liu et al., 2022), and to the unnormalized versions of SAM such as USAM (Andriushchenko & Flammarion, 2022). Numerical experiments are conducted on classification tasks using deep learning models to confirm the practical aspects of our analysis. △ Less

Submitted 29 February, 2024; v1 submitted 15 January, 2024; originally announced January 2024.

Comments: 21 pages

Higher-order Riemannian splines and the interpolation problem: an approach of gradient flows

Authors: Chun-Chi Lin, Dung The Tran

Abstract: In this paper, we resolve problems of spline interpolation, regardless of whether least-squares fitting is incorporated, on smooth Riemannian manifolds. Our approach leverages the concept of gradient flows for successively connected curves or networks, offering a fresh perspective on addressing such challenges. Notably, this method extends to the problem of spline interpolation on Lie groups, comm… ▽ More In this paper, we resolve problems of spline interpolation, regardless of whether least-squares fitting is incorporated, on smooth Riemannian manifolds. Our approach leverages the concept of gradient flows for successively connected curves or networks, offering a fresh perspective on addressing such challenges. Notably, this method extends to the problem of spline interpolation on Lie groups, commonly encountered in mechanical optimal control theory formulations, thus contributing to both geometric control theory and statistical shape data analysis. We rigorously establish the existence of global solutions in Hölder spaces for the gradient flow, with the asymptotic limits of these solutions confirming the existence to the problem of spline interpolation. This comprehensive solution underscores the constructive nature of our proof, hinting at potential numerical schemes for discovering solutions. △ Less

Submitted 5 June, 2024; v1 submitted 16 December, 2023; originally announced December 2023.

MSC Class: 35K52; 49J20; 41A15; 35K25

General Derivative-Free Optimization Methods under Global and Local Lipschitz Continuity of Gradients

Authors: Pham Duy Khanh, Boris S. Mordukhovich, Dat Ba Tran

Abstract: This paper addresses the study of derivative-free smooth optimization problems, where the gradient information on the objective function is unavailable. Two novel general derivative-free methods are proposed and developed for minimizing such functions with either global or local Lipschitz continuous gradients. The newly developed methods use gradient approximations based on finite differences, whe… ▽ More This paper addresses the study of derivative-free smooth optimization problems, where the gradient information on the objective function is unavailable. Two novel general derivative-free methods are proposed and developed for minimizing such functions with either global or local Lipschitz continuous gradients. The newly developed methods use gradient approximations based on finite differences, where finite difference intervals are automatically adapted to the magnitude of the exact gradients without knowing them exactly. The suggested algorithms achieve fundamental convergence results, including stationarity of accumulation points in general settings as well as global convergence with constructive convergence rates when the Kurdyka-Łojasiewicz property is imposed. The local convergence of the proposed algorithms to nonisolated local minimizers, along with their local convergence rates, is also analyzed under this property. Numerical experiences involving various convex, nonconvex, noiseless, and noisy functions demonstrate that the new methods exhibit essential advantages over other state-of-the-art methods in derivative-free optimization. △ Less

Submitted 28 November, 2023; originally announced November 2023.

Comments: 30 pages, 49 figures

MSC Class: 90C25; 90C26; 90C30; 90C56

Central limit theorems for Fréchet means on stratified spaces

Authors: Jonathan C. Mattingly, Ezra Miller, Do Tran

Abstract: Fréchet means of samples from a probability measure $μ$ on any smoothly stratified metric space M with curvature bounded above are shown to satisfy a central limit theorem (CLT). The methods and results proceed by introducing and proving analytic properties of the "escape vector" of any finitely supported measure $δ$ in M, which records infinitesimal variation of the Fréchet mean $\barμ$ of $μ$ in… ▽ More Fréchet means of samples from a probability measure $μ$ on any smoothly stratified metric space M with curvature bounded above are shown to satisfy a central limit theorem (CLT). The methods and results proceed by introducing and proving analytic properties of the "escape vector" of any finitely supported measure $δ$ in M, which records infinitesimal variation of the Fréchet mean $\barμ$ of $μ$ in response to perturbation of $μ$ by adding the mass $tδ$ for $t \to 0$. The CLT limiting distribution $N$ on the tangent cone $T$ at the Fréchet mean is characterized in four ways. The first uses tangential collapse $L$ to compare $T$ with a linear space and then applies a distortion map to the usual linear CLT to transfer back to $T$. Distortion is defined by applying escape after taking preimages under $L$. The second characterization constructs singular analogues of Gaussian measures on smoothly stratified spaces and expresses $N$ as the escape vector of any such "Gaussian mass". The third characterization expresses $N$ as the directional derivative, in the space of measures on $M$, of the barycenter map at $μ$ in the (random) direction given by any Gaussian mass. The final characterization expresses $N$ as the directional derivative, in the space $C$ of continuous real-valued functions on $T$, of a minimizer map, with the derivative taken at the Fréchet function $F \in C$ along the (random) direction given by the negative of the Gaussian tangent field induced by $μ$. Precise mild hypotheses on the measure $μ$ guarantee these CLTs, whose convergence is proved via the second characterization of $N$ by formulating a duality between Gaussian masses and Gaussian tangent fields. △ Less

Submitted 15 November, 2023; originally announced November 2023.

Comments: 66 pages. This is the last in a four-part series that started with shadow geometry, geometry of measures on stratified spaces, and a CLT for random tangent fields

MSC Class: Primary: 60F05; 53C23; 60D05; 60B05; 49J52; 62R20; 62R07; 57N80; 58A35; 47H14; 58C20; 49J50; 58Z05; 53C80; 62G20; 62R30; 28C99; Secondary: 58K30; 62G35; 92B10

A central limit theorem for random tangent fields on stratified spaces

Authors: Jonathan C. Mattingly, Ezra Miller, Do Tran

Abstract: Variation of empirical Fréchet means on a metric space with curvature bounded above is encoded via random fields indexed by unit tangent vectors. A central limit theorem shows these random tangent fields converge to a Gaussian such field and lays the foundation for more traditionally formulated central limit theorems in subsequent work. Variation of empirical Fréchet means on a metric space with curvature bounded above is encoded via random fields indexed by unit tangent vectors. A central limit theorem shows these random tangent fields converge to a Gaussian such field and lays the foundation for more traditionally formulated central limit theorems in subsequent work. △ Less

Submitted 15 February, 2024; v1 submitted 15 November, 2023; originally announced November 2023.

Comments: 16 pages. v1: This is the third in a four-part series, starting with shadow geometry and geometry of measures on stratified spaces, leading to central limit theorems for Fréchet means on stratified spaces. v2: updated intro and minor corrections

MSC Class: Primary: 60F05; 53C23; 60D05; 60B05; 49J52; 62R20; 62R07; 57N80; 58A35; 58Z05; 53C80; 62G20; 62R30; 28C99; Secondary: 58K30; 57R57; 92B10

Geometry of measures on smoothly stratified metric spaces

Authors: Jonathan C. Mattingly, Ezra Miller, Do Tran

Abstract: Any measure $μ$ on a CAT(k) space M that is stratified as a finite union of manifolds and has local exponential maps near the Fréchet mean $\barμ$ yields a continuous "tangential collapse" from the tangent cone of M at $\barμ$ to a vector space that preserves the Fréchet mean, restricts to an isometry on the "fluctuating cone" of directions in which the Fréchet mean can vary under perturbation of… ▽ More Any measure $μ$ on a CAT(k) space M that is stratified as a finite union of manifolds and has local exponential maps near the Fréchet mean $\barμ$ yields a continuous "tangential collapse" from the tangent cone of M at $\barμ$ to a vector space that preserves the Fréchet mean, restricts to an isometry on the "fluctuating cone" of directions in which the Fréchet mean can vary under perturbation of $μ$, and preserves angles between arbitrary and fluctuating tangent vectors at the Fréchet mean. △ Less

Submitted 15 November, 2023; originally announced November 2023.

Comments: 32 pages, 4 figures. This is the second in a four-part series starting with shadow geometry and leading to central limit theorems on stratified spaces

MSC Class: Primary: 60D05; 53C23; 28C99; 57N80; 58A35; 62G20; 49J52; 62R20; 62R07; 53C80; 58Z05; 60B05; 62R30; Secondary: 60F05; 58K30; 57R57; 92B10

Shadow geometry at singular points of CAT(k) spaces

Authors: Jonathan C. Mattingly, Ezra Miller, Do Tran

Abstract: In any CAT(k) space M, the "shadow" of a tangent vector Z at a point p is the set vectors that form an angle of πor more with Z. Taking logarithm maps at points approaching p along a fixed geodesic ray from p with tangent Z collapses the shadow to a single ray while leaving isometrically intact every convex cone that avoids the shadow of Z. In any CAT(k) space M, the "shadow" of a tangent vector Z at a point p is the set vectors that form an angle of πor more with Z. Taking logarithm maps at points approaching p along a fixed geodesic ray from p with tangent Z collapses the shadow to a single ray while leaving isometrically intact every convex cone that avoids the shadow of Z. △ Less

Submitted 15 November, 2023; originally announced November 2023.

Comments: 19 pages, 8 figures. This is the first in a four-part series leading to central limit theorems on stratified spaces

MSC Class: Primary: 53C23; 49J52; 58K30; 53C80; Secondary: 60F05; 60D05; 62R20; 62R07; 92B10

Some Results on Zumkeller Numbers

Authors: Sai Teja Somu, Andrzej Kukla, Duc Van Khanh Tran

Abstract: A positive integer $n$ is said to be a Zumkeller number or an integer-perfect number if the set of its positive divisors can be partitioned into two subsets of equal sums. In this paper, we prove several results regarding Zumkeller numbers. For any positive integer $m$, we prove that there are infinitely many positive integers $n$ for which $n+1,\cdots, n+m$ are all Zumkeller numbers. Additionally… ▽ More A positive integer $n$ is said to be a Zumkeller number or an integer-perfect number if the set of its positive divisors can be partitioned into two subsets of equal sums. In this paper, we prove several results regarding Zumkeller numbers. For any positive integer $m$, we prove that there are infinitely many positive integers $n$ for which $n+1,\cdots, n+m$ are all Zumkeller numbers. Additionally, we show that every positive integer greater than $94185$ can be expressed as a sum of two Zumkeller numbers and that all sufficiently large integers can be written as a sum of a Zumkeller number and a practical number. We also show that there are infinitely many positive integers that cannot be expressed as a sum of a Zumkeller number and a square or a prime. △ Less

Submitted 27 November, 2023; v1 submitted 21 October, 2023; originally announced October 2023.

MSC Class: 11B13; 11B25; 11P99

Robust Approximation Algorithms for Non-monotone $k$-Submodular Maximization under a Knapsack Constraint

Authors: Dung T. K. Ha, Canh V. Pham, Tan D. Tran, Huan X. Hoang

Abstract: The problem of non-monotone $k$-submodular maximization under a knapsack constraint ($\kSMK$) over the ground set size $n$ has been raised in many applications in machine learning, such as data summarization, information propagation, etc. However, existing algorithms for the problem are facing questioning of how to overcome the non-monotone case and how to fast return a good solution in case of th… ▽ More The problem of non-monotone $k$-submodular maximization under a knapsack constraint ($\kSMK$) over the ground set size $n$ has been raised in many applications in machine learning, such as data summarization, information propagation, etc. However, existing algorithms for the problem are facing questioning of how to overcome the non-monotone case and how to fast return a good solution in case of the big size of data. This paper introduces two deterministic approximation algorithms for the problem that competitively improve the query complexity of existing algorithms. Our first algorithm, $\LAA$, returns an approximation ratio of $1/19$ within $O(nk)$ query complexity. The second one, $\RLA$, improves the approximation ratio to $1/5-ε$ in $O(nk)$ queries, where $ε$ is an input parameter. Our algorithms are the first ones that provide constant approximation ratios within only $O(nk)$ query complexity for the non-monotone objective. They, therefore, need fewer the number of queries than state-of-the-the-art ones by a factor of $Ω(\log n)$. Besides the theoretical analysis, we have evaluated our proposed ones with several experiments in some instances: Influence Maximization and Sensor Placement for the problem. The results confirm that our algorithms ensure theoretical quality as the cutting-edge techniques and significantly reduce the number of queries. △ Less

Submitted 21 September, 2023; originally announced September 2023.

Comments: 12 pages

Report number: KSE-ID38

Classifying Primitive Solvable Permutation Groups of Rank 5 and 6

Authors: Anakin Dey, Kolton O'Neal, Duc Van Khanh Tran, Camron Upshur, Yong Yang

Abstract: Let $G$ be a finite solvable permutation group acting faithfully and primitively on a finite set $Ω$. Let $G_0$ be the stabilizer of a point $α\in Ω$ The rank of $G$ is defined as the number of orbits of $G_0$ in $Ω$, including the trivial orbit $\{α\}$. In this paper, we completely classify the cases where $G$ has rank 5 and 6, continuing the previous works on classifying groups of rank 4 o… ▽ More Let $G$ be a finite solvable permutation group acting faithfully and primitively on a finite set $Ω$. Let $G_0$ be the stabilizer of a point $α\in Ω$ The rank of $G$ is defined as the number of orbits of $G_0$ in $Ω$, including the trivial orbit $\{α\}$. In this paper, we completely classify the cases where $G$ has rank 5 and 6, continuing the previous works on classifying groups of rank 4 or lower. △ Less

Submitted 4 February, 2024; v1 submitted 24 August, 2023; originally announced August 2023.

Inexact proximal methods for weakly convex functions

Authors: Pham Duy Khanh, Boris Mordukhovich, Vo Thanh Phat, Dat Ba Tran

Abstract: This paper proposes and develops inexact proximal methods for finding stationary points of the sum of a smooth function and a nonsmooth weakly convex one, where an error is present in the calculation of the proximal map** of the nonsmooth term. A general framework for finding zeros of a continuous map** is derived from our previous paper on this subject to establish convergence properties of t… ▽ More This paper proposes and develops inexact proximal methods for finding stationary points of the sum of a smooth function and a nonsmooth weakly convex one, where an error is present in the calculation of the proximal map** of the nonsmooth term. A general framework for finding zeros of a continuous map** is derived from our previous paper on this subject to establish convergence properties of the inexact proximal point method when the smooth term is vanished and of the inexact proximal gradient method when the smooth term satisfies a descent condition. The inexact proximal point method achieves global convergence with constructive convergence rates when the Moreau envelope of the objective function satisfies the Kurdyka-Lojasiewicz (KL) property. Meanwhile, when the smooth term is twice continuously differentiable with a Lipschitz continuous gradient and a differentiable approximation of the objective function satisfies the KL property, the inexact proximal gradient method achieves the global convergence of iterates with constructive convergence rates. △ Less

Submitted 4 August, 2023; v1 submitted 28 July, 2023; originally announced July 2023.

Comments: 26 pages, 3 tables

MSC Class: 90C30; 90C52; 49M05

On Some Doubly Logarithmic Integrals

Authors: Duc Van Khanh Tran

Abstract: There have been many works on proving the integrals in the table of integrals compiled by Gradshteyn and Ryzhik, and in this paper we prove some doubly logarithmic integral identities in the Gradshteyn and Ryzhik table. There have been many works on proving the integrals in the table of integrals compiled by Gradshteyn and Ryzhik, and in this paper we prove some doubly logarithmic integral identities in the Gradshteyn and Ryzhik table. △ Less

Submitted 24 July, 2023; v1 submitted 18 July, 2023; originally announced July 2023.

MSC Class: 33B15; 11M06

Well-Rounded ideal lattices of cyclic cubic and quartic fields

Authors: Dat T. Tran, Nam H. Le, Ha T. N. Tran

Abstract: In this paper, we find criteria for when cyclic cubic and cyclic quartic fields have well-rounded ideal lattices. We show that every cyclic cubic field has at least one well-rounded ideal. We also prove that there exist families of cyclic quartic fields which have well-rounded ideals and explicitly construct their minimal bases. In addition, for a given prime number $p$, if a cyclic quartic field… ▽ More In this paper, we find criteria for when cyclic cubic and cyclic quartic fields have well-rounded ideal lattices. We show that every cyclic cubic field has at least one well-rounded ideal. We also prove that there exist families of cyclic quartic fields which have well-rounded ideals and explicitly construct their minimal bases. In addition, for a given prime number $p$, if a cyclic quartic field has a unique prime ideal above $p$, then we provide the necessary and sufficient conditions for that ideal to be well-rounded. Moreover, in cyclic quartic fields, we provide the prime decomposition of all odd prime numbers and construct an explicit integral basis for every prime ideal. △ Less

Submitted 13 October, 2023; v1 submitted 29 March, 2023; originally announced March 2023.

Comments: 42 pages

MSC Class: 11R16; 06B10; 06B99; 11Y40

Journal ref: Communications in Mathematics, Volume 31 (2023), Issue 2 (Special issue: Euclidean lattices: theory and applications) (October 18, 2023) cm:11138

A New Inexact Gradient Descent Method with Applications to Nonsmooth Convex Optimization

Authors: Pham Duy Khanh, Boris S. Mordukhovich, Dat Ba Tran

Abstract: The paper proposes and develops a novel inexact gradient method (IGD) for minimizing C1-smooth functions with Lipschitzian gradients, i.e., for problems of C1,1 optimization. We show that the sequence of gradients generated by IGD converges to zero. The convergence of iterates to stationary points is guaranteed under the Kurdyka- Lojasiewicz (KL) property of the objective function with convergence… ▽ More The paper proposes and develops a novel inexact gradient method (IGD) for minimizing C1-smooth functions with Lipschitzian gradients, i.e., for problems of C1,1 optimization. We show that the sequence of gradients generated by IGD converges to zero. The convergence of iterates to stationary points is guaranteed under the Kurdyka- Lojasiewicz (KL) property of the objective function with convergence rates depending on the KL exponent. The newly developed IGD is applied to designing two novel gradient-based methods of nonsmooth convex optimization such as the inexact proximal point methods (GIPPM) and the inexact augmented Lagrangian method (GIALM) for convex programs with linear equality constraints. These two methods inherit global convergence properties from IGD and are confirmed by numerical experiments to have practical advantages over some well-known algorithms of nonsmooth convex optimization. △ Less

Submitted 11 January, 2024; v1 submitted 15 March, 2023; originally announced March 2023.

Comments: 23 pages, 8 figures

Well-Rounded Twists of Ideal Lattices from Imaginary Quadratic Fields

Authors: Nam H. Le, Dat T. Tran, Ha T. N. Tran

Abstract: In this paper, we investigate the properties of well-rounded twists of a given ideal lattice of an imaginary quadratic field $K$. We show that every ideal lattice $I$ of $K$ has at least one well-rounded twist lattice. Moreover, we provide an explicit algorithm to compute all well-rounded twists of $I$. In this paper, we investigate the properties of well-rounded twists of a given ideal lattice of an imaginary quadratic field $K$. We show that every ideal lattice $I$ of $K$ has at least one well-rounded twist lattice. Moreover, we provide an explicit algorithm to compute all well-rounded twists of $I$. △ Less

Submitted 26 October, 2022; originally announced October 2022.

Comments: 24 pages

MSC Class: 11Y16; 11Y40; 11R11; 11H31

Journal ref: Journal of Algebra and Its Applications, Vol. 21, No. 07, 2250133 (2022)

Inexact reduced gradient methods in nonconvex optimization

Authors: Pham Duy Khanh, Boris S. Mordukhovich, Dat Ba Tran

Abstract: This paper proposes and develops new linesearch methods with inexact gradient information for finding stationary points of nonconvex continuously differentiable functions on finite-dimensional spaces. Some abstract convergence results for a broad class of linesearch methods are stablished. A general scheme for inexact reduced gradient (IRG) methods is proposed, where the errors in the gradient app… ▽ More This paper proposes and develops new linesearch methods with inexact gradient information for finding stationary points of nonconvex continuously differentiable functions on finite-dimensional spaces. Some abstract convergence results for a broad class of linesearch methods are stablished. A general scheme for inexact reduced gradient (IRG) methods is proposed, where the errors in the gradient approximation automatically adapt with the magnitudes of the exact gradients. The sequences of iterations are shown to obtain stationary accumulation points when different stepsize selections are employed. Convergence results with constructive convergence rates for the developed IRG methods are established under the Kurdyka- Lojasiewicz property. The obtained results for the IRG methods are confirmed by encouraging numerical experiments, which demonstrate advantages of automatically controlled errors in IRG methods over other frequently used error selections. △ Less

Submitted 30 December, 2022; v1 submitted 4 April, 2022; originally announced April 2022.

The Erdos-Falconer distance problem in the tree setting

Authors: Thang Pham, Steven Senger, Dung The Tran

Abstract: The recent breakthrough of Guth, Iosevich, Ou, and Wang (2019) on the Falconer distance problem states that for a compact set $A\subset \mathbb{R}^2$, if the Hausdorff dimension of $A$ is greater than $\frac{5}{4}$, then the distance set $Δ(A)$ has positive Lebesgue measure. In a very recent paper, Murphy, Petridis, Pham, Rudnev, and Stevens (2022) proved the prime field version of this result, na… ▽ More The recent breakthrough of Guth, Iosevich, Ou, and Wang (2019) on the Falconer distance problem states that for a compact set $A\subset \mathbb{R}^2$, if the Hausdorff dimension of $A$ is greater than $\frac{5}{4}$, then the distance set $Δ(A)$ has positive Lebesgue measure. In a very recent paper, Murphy, Petridis, Pham, Rudnev, and Stevens (2022) proved the prime field version of this result, namely, for $E\subset\mathbb{F}_p^2$ with $|E|\gg p^{5/4}$, there exist many points $x\in E$ such that the number of distinct distances from $x$ is at least $cp$. The main purpose of this paper is to provide extensions in a very general structure of pinned trees, which is inspired by the recent work due to Ou and Taylor (2021). △ Less

Submitted 26 July, 2022; v1 submitted 19 March, 2022; originally announced March 2022.

MSC Class: 52C10

Drift-Diffusion Dynamics and Phase Separation in Curved Cell Membranes and Dendritic Spines: Hybrid Discrete-Continuum Methods

Authors: Patrick D. Tran, Thomas A. Blanpied, Paul J. Atzberger

Abstract: We develop methods for investigating protein drift-diffusion dynamics in heterogeneous cell membranes and the roles played by geometry, diffusion, chemical kinetics, and phase separation. Our hybrid stochastic numerical methods combine discrete particle descriptions with continuum-level models for tracking the individual protein drift-diffusion dynamics when coupled to continuum fields. We show ho… ▽ More We develop methods for investigating protein drift-diffusion dynamics in heterogeneous cell membranes and the roles played by geometry, diffusion, chemical kinetics, and phase separation. Our hybrid stochastic numerical methods combine discrete particle descriptions with continuum-level models for tracking the individual protein drift-diffusion dynamics when coupled to continuum fields. We show how our approaches can be used to investigate phenomena motivated by protein kinetics within dendritic spines. The spine geometry is hypothesized to play an important biological role regulating synaptic strength, protein kinetics, and self-assembly of clusters. We perform simulation studies for model spine geometries varying the neck size to investigate how phase-separation and protein organization is influenced by different shapes. We also show how our methods can be used to study the roles of geometry in reaction-diffusion systems including Turing instabilities. Our methods provide general approaches for investigating protein kinetics and drift-diffusion dynamics within curved membrane structures. △ Less

Submitted 18 August, 2022; v1 submitted 2 October, 2021; originally announced October 2021.

Journal ref: APS Phys. Rev. E, 106, 044402, (2022)

Globally Convergent Coderivative-Based Generalized Newton Methods in Nonsmooth Optimization

Authors: Pham Duy Khanh, Boris Mordukhovich, Vo Thanh Phat, Dat Ba Tran

Abstract: This paper proposes and justifies two globally convergent Newton-type methods to solve unconstrained and constrained problems of nonsmooth optimization by using tools of variational analysis and generalized differentiation. Both methods are coderivative-based and employ generalized Hessians (coderivatives of subgradient map**s) associated with objective functions, which are either of class… ▽ More This paper proposes and justifies two globally convergent Newton-type methods to solve unconstrained and constrained problems of nonsmooth optimization by using tools of variational analysis and generalized differentiation. Both methods are coderivative-based and employ generalized Hessians (coderivatives of subgradient map**s) associated with objective functions, which are either of class $\mathcal{C}^{1,1}$, or are represented in the form of convex composite optimization, where one of the terms may be extended-real-valued. The proposed globally convergent algorithms are of two types. The first one extends the damped Newton method and requires positive-definiteness of the generalized Hessians for its well-posedness and efficient performance, while the other algorithm is of {the regularized Newton type} being well-defined when the generalized Hessians are merely positive-semidefinite. The obtained convergence rates for both methods are at least linear, but become superlinear under the semismooth$^*$ property of subgradient map**s. Problems of convex composite optimization are investigated with and without the strong convexity assumption {on smooth parts} of objective functions by implementing the machinery of forward-backward envelopes. Numerical experiments are conducted for Lasso problems and for box constrained quadratic programs with providing performance comparisons of the new algorithms and some other first-order and second-order methods that are highly recognized in nonsmooth optimization. △ Less

Submitted 25 April, 2023; v1 submitted 5 September, 2021; originally announced September 2021.

Comments: arXiv admin note: text overlap with arXiv:2101.10555

MSC Class: 90C31; 49J52; 49J53

Smeariness Begets Finite Sample Smeariness

Authors: Do Tran, Benjamin Eltzner, Stephan Huckemann

Abstract: Fréchet means are indispensable for nonparametric statistics on non-Euclidean spaces. For suitable random variables, in some sense, they "sense" topological and geometric structure. In particular, smeariness seems to indicate the presence of positive curvature. While smeariness may be considered more as an academical curiosity, occurring rarely, it has been recently demonstrated that finite sample… ▽ More Fréchet means are indispensable for nonparametric statistics on non-Euclidean spaces. For suitable random variables, in some sense, they "sense" topological and geometric structure. In particular, smeariness seems to indicate the presence of positive curvature. While smeariness may be considered more as an academical curiosity, occurring rarely, it has been recently demonstrated that finite sample smeariness (FSS) occurs regularly on circles, tori and spheres and affects a large class of typical probability distributions. FSS can be well described by the modulation measuring the quotient of rescaled expected sample mean variance and population variance. Under FSS it is larger than one - that is its value on Euclidean spaces - and this makes quantile based tests using tangent space approximations inapplicable. We show here that near smeary probability distributions there are always FSS probability distributions and as a first step towards the conjecture that all compact spaces feature smeary distributions, we establish directional smeariness under curvature bounds. △ Less

Submitted 28 February, 2021; originally announced March 2021.

Comments: 8 pages, 1 figure, conference submission to GSI 2021

Generalized Damped Newton Algorithms in Nonsmooth Optimization via Second-Order Subdifferentials

Authors: Pham Duy Khanh, Boris Mordukhovich, Vo Thanh Phat, Dat Ba Tran

Abstract: The paper proposes and develops new globally convergent algorithms of the generalized damped Newton type for solving important classes of nonsmooth optimization problems. These algorithms are based on the theory and calculations of second-order subdifferentials of nonsmooth functions with employing the machinery of second-order variational analysis and generalized differentiation. First we develop… ▽ More The paper proposes and develops new globally convergent algorithms of the generalized damped Newton type for solving important classes of nonsmooth optimization problems. These algorithms are based on the theory and calculations of second-order subdifferentials of nonsmooth functions with employing the machinery of second-order variational analysis and generalized differentiation. First we develop a globally superlinearly convergent damped Newton-type algorithm for the class of continuously differentiable functions with Lipschitzian gradients, which are nonsmooth of second order. Then we design such a globally convergent algorithm to solve a structured class of nonsmooth quadratic composite problems with extended-real-valued cost functions, which typically arise in machine learning and statistics. Finally, we present the results of numerical experiments and compare the performance of our main algorithm applied to an important class of Lasso problems with those achieved by other first-order and second-order optimization algorithms. △ Less

Submitted 18 January, 2022; v1 submitted 25 January, 2021; originally announced January 2021.

One-sided Shewhart control charts for monitoring the ratio of two normal variables in Short Production Runs

Authors: K. D. Tran, Q. U. A Khaliq, A. A. Nadi, H Tran, K. P. Tran

Abstract: Monitoring the ratio of two normal random variables plays an important role in several manufacturing environments. For short production runs, however, the control charts assumed infinite processes cannot function effectively to detect anomalies. In this paper, we tackle this problem by proposing two one-sided Shewhart-type charts to monitor the ratio of two normal random variables for an infinite… ▽ More Monitoring the ratio of two normal random variables plays an important role in several manufacturing environments. For short production runs, however, the control charts assumed infinite processes cannot function effectively to detect anomalies. In this paper, we tackle this problem by proposing two one-sided Shewhart-type charts to monitor the ratio of two normal random variables for an infinite horizon production. The statistical performance of the proposed charts is investigated using the truncated average run length as a performance measure in short production runs. In order to help the quality practitioner to implement these control charts, we have provided ready-to-use tables of the control limit parameters. An illustrative example from the food industry is given for illustration. △ Less

Submitted 3 October, 2020; originally announced October 2020.

MSC Class: 62P30

A Differential Game Approach for Beyond Visual Range Tactics

Authors: Eloy Garcia, David W. Casbeer, Dzung Tran, Meir Pachter

Abstract: An operational relevant conflict between teams of autonomous vehicles in the Beyond Visual Range domain is addressed in this paper. Optimal strategies are designed in order for a team of air interceptors to protect a high value asset and block the attacking team at a safe distance from such asset. The attacking agents take specific roles of leader and wingman and also devise their own optimal stra… ▽ More An operational relevant conflict between teams of autonomous vehicles in the Beyond Visual Range domain is addressed in this paper. Optimal strategies are designed in order for a team of air interceptors to protect a high value asset and block the attacking team at a safe distance from such asset. The attacking agents take specific roles of leader and wingman and also devise their own optimal strategies in order to launch an attack as close as possible from the asset. The problem is formulated as a zero-sum differential game between players with different speed over two stages: the attack and the retreat stages. For each stage the state-feedback optimal strategies of each player are derived in analytical form. △ Less

Submitted 22 September, 2020; originally announced September 2020.

Comments: 12 pages, 10 figures

Differentiation of measures on complete Riemannian manifolds

Authors: Jürgen Jost, Hông Vân Lê, Tat Dat Tran

Abstract: In this note we give a new proof of a version of the Besicovitch covering theorem, given in \cite{EG1992}, \cite{Bogachev2007} and extended in \cite{Federer1969}, for locally finite Borel measures on finite dimensional complete Riemannian manifolds $(M,g)$. As a consequence, we prove a differentiation theorem for Borel measures on $(M,g)$, which gives a formula for the Radon-Nikodym density of two… ▽ More In this note we give a new proof of a version of the Besicovitch covering theorem, given in \cite{EG1992}, \cite{Bogachev2007} and extended in \cite{Federer1969}, for locally finite Borel measures on finite dimensional complete Riemannian manifolds $(M,g)$. As a consequence, we prove a differentiation theorem for Borel measures on $(M,g)$, which gives a formula for the Radon-Nikodym density of two nonnegative locally finite Borel measures $ν_1, ν_2$ on $(M, g)$ such that $ν_1 \ll ν_2$, extending the known case when $(M, g)$ is a standard Euclidean space. △ Less

Submitted 30 August, 2020; originally announced August 2020.

Comments: 13 p., This is a revised version of the Appendix in our earlier e-print arXiv:1905.11448

Optimal Path Homotopy For Univariate Polynomials

Authors: Bao Duy Tran

Abstract: The goal of this paper is to study the path-following method for univariate polynomials. We propose to study the complexity and condition properties when the Newton method is applied as a correction operator. Then we study the geodesics and properties of the condition metric along those curves. Last, we compute approximations of geodesics and study how the condition number varies with the quality… ▽ More The goal of this paper is to study the path-following method for univariate polynomials. We propose to study the complexity and condition properties when the Newton method is applied as a correction operator. Then we study the geodesics and properties of the condition metric along those curves. Last, we compute approximations of geodesics and study how the condition number varies with the quality of the approximation. △ Less

Submitted 9 August, 2022; v1 submitted 4 August, 2020; originally announced August 2020.

On three-variable expanders over finite valuation rings

Authors: Nguyen Van The, Phuc D Tran, Le Quang Ham, Le Anh Vinh

Abstract: Let $\mathcal{R}$ be a finite valuation ring of order $q^r$. In this paper, we prove that for any quadratic polynomial $f(x,y,z) \in \mathcal{R}[x,y,z]$ that is of the form $axy+R(x)+S(y)+T(z)$ for some one-variable polynomials $R, S , T$, we have \[ |f(A,B,C)| \gg \min\left\{ q^r, \frac{|A||B||C|}{q^{2r-1}}\right\}\] for any $A, B, C \subset \mathcal{R}$. We also study the sum-product type proble… ▽ More Let $\mathcal{R}$ be a finite valuation ring of order $q^r$. In this paper, we prove that for any quadratic polynomial $f(x,y,z) \in \mathcal{R}[x,y,z]$ that is of the form $axy+R(x)+S(y)+T(z)$ for some one-variable polynomials $R, S , T$, we have \[ |f(A,B,C)| \gg \min\left\{ q^r, \frac{|A||B||C|}{q^{2r-1}}\right\}\] for any $A, B, C \subset \mathcal{R}$. We also study the sum-product type problems over finite valuation ring $\mathcal{R}.$ More precisely, we show that for any $A \subset \mathcal{R}$ with $|A| \gg q^{r-1/3}$ then $$\max\{ |A \cdot A|, |A^d + A^d|\},\max\{ |A + A|, |A^2 + A^2|\},\max\{|A-A|,|AA+AA|\} \gg |A|^{2/3}q^{r/3},$$ and $|f(A) + A| \gg |A|^{2/3}q^{r/3}$ for any one variable quadratic polynomial $f$. △ Less

Submitted 15 July, 2020; v1 submitted 10 July, 2020; originally announced July 2020.

Comments: Theorem 1.6 is cited because it has already proved

On the asymptotic behavior of the Diaconis and Freedman's chain in a multidimensional simplex

Authors: Marc Peigné, Tat Dat Tran

Abstract: In this paper, we give out a setting of an Diaconis and Freedman's chain in a multidimensional simplex and consider its asymptotic behavior. By using techniques in random iterated functions theory and quasi-compact operators theory, we first give out some sufficient conditions which ensure the existence and uniqueness of an invariant probability measure. In some particular cases, we give out expli… ▽ More In this paper, we give out a setting of an Diaconis and Freedman's chain in a multidimensional simplex and consider its asymptotic behavior. By using techniques in random iterated functions theory and quasi-compact operators theory, we first give out some sufficient conditions which ensure the existence and uniqueness of an invariant probability measure. In some particular cases, we give out explicit formulas of the invariant probability density. Moreover, we completely classify all behaviors of this chain in dimensional two. Eventually, some other settings of the chain are discussed. △ Less

Submitted 3 June, 2020; originally announced June 2020.

Comments: 21 pages, 9 figures. Comments are welcome

MSC Class: 60J05; 60F05

Some sum-product type estimates for two-variables over prime fields

Authors: Phuc D Tran, Nguyen Van The

Abstract: In this paper, we use a recent method given by Rudnev, Shakan, and Shkredov (2018) to improve results on sum-product type problems due to Pham and Mojarrad (2018). In this paper, we use a recent method given by Rudnev, Shakan, and Shkredov (2018) to improve results on sum-product type problems due to Pham and Mojarrad (2018). △ Less

Submitted 24 March, 2020; v1 submitted 22 November, 2019; originally announced November 2019.

Comments: 22 pages

Behavior of Fréchet mean and Central Limit Theorems on spheres

Authors: Do Tran

Abstract: We compute higher derivatives of the Fréchet function on spheres with an absolutely continuous and rotationally symmetric probability distribution. Consequences include (i)~a practical condition to test if the mode of the symmetric distribution is a local Fréchet mean; (ii)~a Central Limit Theorem on spheres with practical assumptions and an explicit limiting distribution; and (iii)~an answer to t… ▽ More We compute higher derivatives of the Fréchet function on spheres with an absolutely continuous and rotationally symmetric probability distribution. Consequences include (i)~a practical condition to test if the mode of the symmetric distribution is a local Fréchet mean; (ii)~a Central Limit Theorem on spheres with practical assumptions and an explicit limiting distribution; and (iii)~an answer to the question of whether the smeary effect can occur on spheres with absolutely continuous and rotationally symmetric distributions: with the method presented here, it can in dimension at least~$4$. △ Less

Submitted 24 April, 2020; v1 submitted 5 November, 2019; originally announced November 2019.

MSC Class: 60F05; 62H11

Probabilistic morphisms and Bayesian nonparametrics

Authors: Jürgen Jost, Hông Vân Lê, Tat Dat Tran

Abstract: In this paper we develop a functorial language of probabilistic morphisms and apply it to some basic problems in Bayesian nonparametrics. First we extend and unify the Kleisli category of probabilistic morphisms proposed by Lawvere and Giry with the category of statistical models proposed by Chentsov and Morse-Sacksteder. Then we introduce the notion of a Bayesian statistical model that formalizes… ▽ More In this paper we develop a functorial language of probabilistic morphisms and apply it to some basic problems in Bayesian nonparametrics. First we extend and unify the Kleisli category of probabilistic morphisms proposed by Lawvere and Giry with the category of statistical models proposed by Chentsov and Morse-Sacksteder. Then we introduce the notion of a Bayesian statistical model that formalizes the notion of a parameter space with a given prior distribution in Bayesian statistics. {We revisit the existence of a posterior distribution, using probabilistic morphisms}. In particular, we give an explicit formula for posterior distributions of the Bayesian statistical model, assuming that the underlying parameter space is a Souslin space and the sample space is a subset in a complete connected finite dimensional Riemannian manifold. Then we give a new proof of the existence of Dirichlet measures over any measurable space using a functorial property of the Dirichlet map constructed by Sethuraman. △ Less

Submitted 21 March, 2021; v1 submitted 27 May, 2019; originally announced May 2019.

Comments: Final version: 22 p. Version 2: minor corrections, Proposition 2.10 added, improved presentation, 39 p., version 1: 38 p. comments welcome!

MSC Class: 62G99; 18C20; 28C20

Journal ref: Eur. Phys. J. Plus (2021) 136:441

Stochastic FitzHugh-Nagumo neuron model in excitable regime embeds a leaky integrate-and-fire model

Authors: Marius E. Yamakou, Tat Dat Tran, Luu Hoang Duc, Juergen Jost

Abstract: In this paper, we provide a complete mathematical construction for a stochastic leaky-integrate-and-fire model (LIF) mimicking the interspike interval (ISI) statistics of a stochastic FitzHugh-Nagumo neuron model (FHN) in the excitable regime, where the unique fixed point is stable. Under specific types of noises, we prove that there exists a global random attractor for the stochastic FHN system.… ▽ More In this paper, we provide a complete mathematical construction for a stochastic leaky-integrate-and-fire model (LIF) mimicking the interspike interval (ISI) statistics of a stochastic FitzHugh-Nagumo neuron model (FHN) in the excitable regime, where the unique fixed point is stable. Under specific types of noises, we prove that there exists a global random attractor for the stochastic FHN system. The linearization method is then applied to estimate the firing time and to derive the associated radial equation representing a LIF equation. This result confirms the previous prediction in [Ditlevsen, S. and Greenwood, P. (2013). The Morris-Lecar neuron model embeds a leaky integrate-and-fire model. Journal of Mathematical Biology, 67(2):239-259] for the Morris-Lecar neuron model in the bistability regime consisting of a stable fixed point and a stable limit cycle. △ Less

Submitted 23 February, 2019; v1 submitted 19 June, 2018; originally announced June 2018.

Comments: 15 pages, 7 figures, 1 table. arXiv admin note: text overlap with arXiv:1108.0073 by other authors

MSC Class: 60GXX; 92BXX

Journal ref: J. Math. Biol. (2019) 79: 509

Contributions to the asymptotic study of Hermite driven processes

Authors: Thi Thanh Diu Tran

Abstract: This thesis consists of two parts. Part I is an introduction to Hermite processes, Hermite random fields, Fisher information and to the papers constituting the thesis. More precisely, in Section 1 we introduce Hermite processes in a nutshell, as well as some of its basic properties. It is the necessary background for the articles [a] and [c]. In Section 2 we consider briefly the multiparameter H… ▽ More This thesis consists of two parts. Part I is an introduction to Hermite processes, Hermite random fields, Fisher information and to the papers constituting the thesis. More precisely, in Section 1 we introduce Hermite processes in a nutshell, as well as some of its basic properties. It is the necessary background for the articles [a] and [c]. In Section 2 we consider briefly the multiparameter Hermite random fields and we study some less elementary facts which are used in the article [b]. In section 3, we recall some terminology about Fisher information related to the article [d]. Finally, our articles [a] to [d] are summarised in Section 4. Part II consists of the articles themselves: [a] T.T. Diu Tran (2017): Non-central limit theorem for quadratic functionals of Hermite-driven long memory moving average processes. \textit{Stochastic and Dynamics}, \textbf{18}, no. 4. [b] T.T. Diu Tran (2016): Asymptotic behavior for quadratic variations of non-Gaussian multiparameter Hermite random fields. Under revision for \textit{Probability and Mathematical Statistics}. [c] I. Nourdin, T.T. Diu Tran (2017): Statistical inference for Vasicek-type model driven by Hermite processes. Submitted to \textit{Stochastic Process and their Applications}. [d] T.T. Diu Tran (2017+): Fisher information and multivariate Fouth Moment Theorem. Main results have already been obtained. It should be submitted soon. △ Less

Submitted 15 February, 2018; originally announced February 2018.

Comments: PhD Thesis (Univ. Luxembourg). 129 pages. Related articles: arXiv:1607.08278, arXiv:1712.05915, arXiv:1611.03674 and forthcoming papers Link on Uni.Lux: http://orbilu.uni.lu/handle/10993/34790

Statistical inference for Vasicek-type model driven by Hermite processes

Authors: Ivan Nourdin, T. T. Diu Tran

Abstract: Let $Z$ denote a Hermite process of order $q \geq 1$ and self-similarity parameter $H \in (\frac{1}{2}, 1)$. This process is $H$-self-similar, has stationary increments and exhibits long-range dependence. When $q=1$, it corresponds to the fractional Brownian motion, whereas it is not Gaussian as soon as $q\geq 2$. In this paper, we deal with a Vasicek-type model driven by $Z$, of the form… ▽ More Let $Z$ denote a Hermite process of order $q \geq 1$ and self-similarity parameter $H \in (\frac{1}{2}, 1)$. This process is $H$-self-similar, has stationary increments and exhibits long-range dependence. When $q=1$, it corresponds to the fractional Brownian motion, whereas it is not Gaussian as soon as $q\geq 2$. In this paper, we deal with a Vasicek-type model driven by $Z$, of the form $dX_t = a(b - X_t)dt +dZ_t$. Here, $a > 0$ and $b \in \mathbb{R}$ are considered as unknown drift parameters. We provide estimators for $a$ and $b$ based on continuous-time observations. For all possible values of $H$ and $q$, we prove strong consistency and we analyze the asymptotic fluctuations. △ Less

Submitted 11 October, 2018; v1 submitted 16 December, 2017; originally announced December 2017.

Comments: 19 pages, revised according to referee's report

Tensor Representation in High-Frequency Financial Data for Price Change Prediction

Authors: Dat Thanh Tran, Martin Magris, Juho Kanniainen, Moncef Gabbouj, Alexandros Iosifidis

Abstract: Nowadays, with the availability of massive amount of trade data collected, the dynamics of the financial markets pose both a challenge and an opportunity for high frequency traders. In order to take advantage of the rapid, subtle movement of assets in High Frequency Trading (HFT), an automatic algorithm to analyze and detect patterns of price change based on transaction records must be available.… ▽ More Nowadays, with the availability of massive amount of trade data collected, the dynamics of the financial markets pose both a challenge and an opportunity for high frequency traders. In order to take advantage of the rapid, subtle movement of assets in High Frequency Trading (HFT), an automatic algorithm to analyze and detect patterns of price change based on transaction records must be available. The multichannel, time-series representation of financial data naturally suggests tensor-based learning algorithms. In this work, we investigate the effectiveness of two multilinear methods for the mid-price prediction problem against other existing methods. The experiments in a large scale dataset which contains more than 4 millions limit orders show that by utilizing tensor representation, multilinear models outperform vector-based approaches and other competing ones. △ Less

Submitted 28 November, 2017; v1 submitted 5 September, 2017; originally announced September 2017.

Comments: accepted in SSCI 2017, typos fixed

Journal ref: IEEE Symposium Series on Computational Intelligence (SSCI), 2017

Sparse Coding and Autoencoders

Authors: Akshay Rangamani, Anirbit Mukherjee, Amitabh Basu, Tejaswini Ganapathy, Ashish Arora, Sang Chin, Trac D. Tran

Abstract: In "Dictionary Learning" one tries to recover incoherent matrices $A^* \in \mathbb{R}^{n \times h}$ (typically overcomplete and whose columns are assumed to be normalized) and sparse vectors $x^* \in \mathbb{R}^h$ with a small support of size $h^p$ for some $0 <p < 1$ while having access to observations $y \in \mathbb{R}^n$ where $y = A^*x^*$. In this work we undertake a rigorous analysis of wheth… ▽ More In "Dictionary Learning" one tries to recover incoherent matrices $A^* \in \mathbb{R}^{n \times h}$ (typically overcomplete and whose columns are assumed to be normalized) and sparse vectors $x^* \in \mathbb{R}^h$ with a small support of size $h^p$ for some $0 <p < 1$ while having access to observations $y \in \mathbb{R}^n$ where $y = A^*x^*$. In this work we undertake a rigorous analysis of whether gradient descent on the squared loss of an autoencoder can solve the dictionary learning problem. The "Autoencoder" architecture we consider is a $\mathbb{R}^n \rightarrow \mathbb{R}^n$ map** with a single ReLU activation layer of size $h$. Under very mild distributional assumptions on $x^*$, we prove that the norm of the expected gradient of the standard squared loss function is asymptotically (in sparse code dimension) negligible for all points in a small neighborhood of $A^*$. This is supported with experimental evidence using synthetic data. We also conduct experiments to suggest that $A^*$ is a local minimum. Along the way we prove that a layer of ReLU gates can be set up to automatically recover the support of the sparse codes. This property holds independent of the loss function. We believe that it could be of independent interest. △ Less

Submitted 20 October, 2017; v1 submitted 11 August, 2017; originally announced August 2017.

Comments: In this new version of the paper with a small change in the distributional assumptions we are actually able to prove the asymptotic criticality of a neighbourhood of the ground truth dictionary for even just the standard squared loss of the ReLU autoencoder (unlike the regularized loss in the older version)

Convergence Properties for Discrete-time Nonlinear Systems

Authors: Duc N. Tran, Björn S. Rüffer, Christopher M. Kellett

Abstract: Three similar convergence notions are considered. Two of them are the long established notions of convergent dynamics and incremental stability. The other is the more recent notion of contraction analysis. All three convergence notions require that all solutions of a system converge to each other. In this paper, we investigate the differences between these convergence properties for discrete-time,… ▽ More Three similar convergence notions are considered. Two of them are the long established notions of convergent dynamics and incremental stability. The other is the more recent notion of contraction analysis. All three convergence notions require that all solutions of a system converge to each other. In this paper, we investigate the differences between these convergence properties for discrete-time, time-varying nonlinear systems by comparing the properties in pairs and using examples. We also demonstrate a time-varying smooth Lyapunov function characterization for each of these convergence notions, and, with appropriate assumptions, we provide several sufficient conditions to establish relationships between these properties in terms of Lyapunov functions. △ Less

Submitted 4 November, 2018; v1 submitted 15 December, 2016; originally announced December 2016.

MSC Class: 93C55 (Primary); 93D05; 93D30; 93C10 (Secondary)

Asymptotic behavior for quadratic variations of non-Gaussian multiparameter Hermite random fields

Authors: T. T. Diu Tran

Abstract: Let $(Z^{q, H}_t)_{t \in [0, 1]^d}$ denote a $d$-parameter Hermite random field of order $q \geq 1$ and self-similarity parameter $H = (H_1, \ldots, H_d) \in (\frac{1}{2}, 1)^d$. This process is $H$-self-similar, has stationary increments and exhibits long-range dependence. Particular examples include fractional Brownian motion ($q=1$, $d=1$), fractional Brownian sheet $(q=1, d \geq 2)$, Rosenblat… ▽ More Let $(Z^{q, H}_t)_{t \in [0, 1]^d}$ denote a $d$-parameter Hermite random field of order $q \geq 1$ and self-similarity parameter $H = (H_1, \ldots, H_d) \in (\frac{1}{2}, 1)^d$. This process is $H$-self-similar, has stationary increments and exhibits long-range dependence. Particular examples include fractional Brownian motion ($q=1$, $d=1$), fractional Brownian sheet $(q=1, d \geq 2)$, Rosenblatt process ($q=2$, $d=1$) as well as Rosenblatt sheet $(q=2, d \geq 2)$. For any $q \geq 2, d\geq 1$ and $H \in (\frac{1}{2}, 1)^d$ we show in this paper that a proper normalization of the quadratic variation of $Z^{q, H}$ converges in $L^2(Ω)$ to a standard $d$-parameter Rosenblatt random variable with self-similarity index $H" = 1+ (2H-2)/q$. △ Less

Submitted 21 December, 2017; v1 submitted 11 November, 2016; originally announced November 2016.

MSC Class: 60F05; 60G18; 60H05; 60H07

Ergodicity of scalar stochastic differential equations with Hölder continuous coefficients

Authors: Duc Hoang Luu, Tat Dat Tran, Jürgen Jost

Abstract: It is well-known that for a one dimensional stochastic differential equation driven by Brownian noise, with coefficient functions satisfying the assumptions of the Yamada-Watanabe theorem \cite{yamada1,yamada2} and the Feller test for explosions \cite{feller51,feller54}, there exists a unique stationary distribution with respect to the Markov semigroup of transition probabilities. We consider syst… ▽ More It is well-known that for a one dimensional stochastic differential equation driven by Brownian noise, with coefficient functions satisfying the assumptions of the Yamada-Watanabe theorem \cite{yamada1,yamada2} and the Feller test for explosions \cite{feller51,feller54}, there exists a unique stationary distribution with respect to the Markov semigroup of transition probabilities. We consider systems on a restricted domain $D$ of the phase space $\mathbb{R}$ and study the rate of convergence to the stationary distribution. Using a geometrical approach that uses the so called {\it free energy function} on the density function space, we prove that the density functions, which are solutions of the Fokker-Planck equation, converge to the stationary density function exponentially under the Kullback-Leibler {divergence}, thus also in the total variation norm. The results show that there is a relation between the Bakry-Emery curvature dimension condition and the dissipativity condition of the transformed system under the Fisher-Lamperti transformation. Several applications are discussed, including the Cox-Ingersoll-Ross model and the Ait-Sahalia model in finance and the Wright-Fisher model in population genetics. △ Less

Submitted 24 August, 2016; originally announced August 2016.

Non-Central Limit Theorem for Quadratic Functionals of Hermite-Driven Long Memory Moving Average Processes

Authors: T. T. Diu Tran

Abstract: Let $(Z_t^{(q, H)})_{t \geq 0}$ denote a Hermite process of order $q \geq 1$ and self-similarity parameter $H \in (\frac{1}{2}, 1)$. Consider the Hermite-driven moving average process $$X_t^{(q, H)} = \int_0^t x(t-u) dZ^{(q, H)}(u), \qquad t \geq 0.$$ In the special case of $x(u) = e^{-θu}, θ> 0$, $X$ is the non-stationary Hermite Ornstein-Uhlenbeck process of order $q$. Under suitable integrabili… ▽ More Let $(Z_t^{(q, H)})_{t \geq 0}$ denote a Hermite process of order $q \geq 1$ and self-similarity parameter $H \in (\frac{1}{2}, 1)$. Consider the Hermite-driven moving average process $$X_t^{(q, H)} = \int_0^t x(t-u) dZ^{(q, H)}(u), \qquad t \geq 0.$$ In the special case of $x(u) = e^{-θu}, θ> 0$, $X$ is the non-stationary Hermite Ornstein-Uhlenbeck process of order $q$. Under suitable integrability conditions on the kernel $x$, we prove that as $T \to \infty$, the normalized quadratic functional $$G_T^{(q, H)}(t)=\frac{1}{T^{2H_0 - 1}}\int_0^{Tt}\Big(\big(X_s^{(q, H)}\big)^2 - E\Big[\big(X_s^{(q, H)}\big)^2\Big]\Big) ds , \qquad t \geq 0,$$ where $H_0 = 1 + (H-1)/q$, converges in the sense of finite-dimensional distribution to the Rosenblatt process of parameter $H' = 1 + (2H-2)/q$, up to a multiplicative constant, irrespective of self-similarity parameter whenever $q \geq 2$. In the Gaussian case $(q=1)$, our result complements the study started by Nourdin \textit{et al} in arXiv:1502.03369, where either central or non-central limit theorems may arise depending on the value of self-similarity parameter. A crucial key in our analysis is an extension of the connection between the classical multiple Wiener-Itô integral and the one with respect to a random spectral measure (initiated by Taqqu (1979)), which may be independent of interest. △ Less

Submitted 18 May, 2017; v1 submitted 27 July, 2016; originally announced July 2016.

Comments: Accepted for publication in Stoch. Dyn

MSC Class: 60F05; 60G22; 60H05; 60H07

Control of Multiagent Formations

Authors: Dzung Tran, Tansel Yucelen

Abstract: This paper makes the first attempt to show how information exchange rules represented by a network having multiple layers (multiplex information networks) can be designed for enabling spatially evolving multiagent formations. Toward this goal, we consider the invariant formation problem and introduce a distributed control architecture that allows capable agents to spatially alter the resulting for… ▽ More This paper makes the first attempt to show how information exchange rules represented by a network having multiple layers (multiplex information networks) can be designed for enabling spatially evolving multiagent formations. Toward this goal, we consider the invariant formation problem and introduce a distributed control architecture that allows capable agents to spatially alter the resulting formation's density and orientation without requiring global information exchange ability. △ Less

Submitted 18 July, 2015; originally announced July 2015.

ICR: Iterative Convex Refinement for Sparse Signal Recovery Using Spike and Slab Priors

Authors: Hojjat S. Mousavi, Vishal Monga, Trac D. Tran

Abstract: In this letter, we address sparse signal recovery using spike and slab priors. In particular, we focus on a Bayesian framework where sparsity is enforced on reconstruction coefficients via probabilistic priors. The optimization resulting from spike and slab prior maximization is known to be a hard non-convex problem, and existing solutions involve simplifying assumptions and/or relaxations. We pro… ▽ More In this letter, we address sparse signal recovery using spike and slab priors. In particular, we focus on a Bayesian framework where sparsity is enforced on reconstruction coefficients via probabilistic priors. The optimization resulting from spike and slab prior maximization is known to be a hard non-convex problem, and existing solutions involve simplifying assumptions and/or relaxations. We propose an approach called Iterative Convex Refinement (ICR) that aims to solve the aforementioned optimization problem directly allowing for greater generality in the sparse structure. Essentially, ICR solves a sequence of convex optimization problems such that sequence of solutions converges to a sub-optimal solution of the original hard optimization problem. We propose two versions of our algorithm: a.) an unconstrained version, and b.) with a non-negativity constraint on sparse coefficients, which may be required in some real-world problems. Experimental validation is performed on both synthetic data and for a real-world image recovery problem, which illustrates merits of ICR over state of the art alternatives. △ Less

Submitted 16 February, 2015; originally announced February 2015.

Comments: Submitted to IEEE Signal Processing Letters, Feb 2015

Non-standard Symplectic Structures via Symplectic Cohomology

Authors: Dustin Tran

Abstract: We examine how symplectic cohomology may be used as an invariant on symplectic structures, and investigate the non-uniqueness of these structures on Liouville domains, a field which has seen much development in the past decade. Notably, we prove the existence of infinitely many non-standard symplectic structures on finite type Liouville manifolds for dimensions $n\geq 6$. To do this, we build up n… ▽ More We examine how symplectic cohomology may be used as an invariant on symplectic structures, and investigate the non-uniqueness of these structures on Liouville domains, a field which has seen much development in the past decade. Notably, we prove the existence of infinitely many non-standard symplectic structures on finite type Liouville manifolds for dimensions $n\geq 6$. To do this, we build up notions of Liouville domains, Lefschetz fibrations, and symplectic cohomology. △ Less

Submitted 29 November, 2014; originally announced December 2014.

Comments: Originally written on May 11, 2012

Convex Techniques for Model Selection

Authors: Dustin Tran

Abstract: We develop a robust convex algorithm to select the regularization parameter in model selection. In practice this would be automated in order to save practitioners time from having to tune it manually. In particular, we implement and test the convex method for $K$-fold cross validation on ridge regression, although the same concept extends to more complex models. We then compare its performance wit… ▽ More We develop a robust convex algorithm to select the regularization parameter in model selection. In practice this would be automated in order to save practitioners time from having to tune it manually. In particular, we implement and test the convex method for $K$-fold cross validation on ridge regression, although the same concept extends to more complex models. We then compare its performance with standard methods. △ Less

Submitted 2 December, 2014; v1 submitted 27 November, 2014; originally announced November 2014.

Comments: Originally written on May 16, 2014

On the Theory of Stein Manifolds

Authors: Dustin Tran

Abstract: This paper examines the broad structure on Stein manifolds and how it generalizes the notion of a domain of holomorphy in $\mathbb C^n$. Along with this generalization, we see that Stein manifolds share key properties from domains of holomorphy, and we prove one of these major consequences. In particular, we investigate an equivalence, similar to domains of holomorphy and pseudoconvexity, on the c… ▽ More This paper examines the broad structure on Stein manifolds and how it generalizes the notion of a domain of holomorphy in $\mathbb C^n$. Along with this generalization, we see that Stein manifolds share key properties from domains of holomorphy, and we prove one of these major consequences. In particular, we investigate an equivalence, similar to domains of holomorphy and pseudoconvexity, on the class of manifolds. Then, we examine the canonical symplectic structure of Stein manifolds inherited from this equivalence, and how its symplectic topology develops. △ Less

Submitted 27 November, 2014; originally announced November 2014.

Comments: Originally written on May 14, 2012

Lifting maps from the symmetrized polydisk in small dimensions

Authors: Nikolai Nikolov, Pascal J. Thomas, Duc-Anh Tran

Abstract: The spectral unit ball $Ω_n$ is the set of all $n\times n$ matrices with spectral radius less than $1$. Let $π(M) \in \mathbb C^n$ stand for the coefficients of its characteristic polynomial of $M$ (up to signs), i.e. the elementary symmetric functions of its eigenvalues. The symmetrized polydisk is $\mathbb G_n:=π(Ω_n)$. When investigating Nevanlinna-Pick problems for maps from the disk to the sp… ▽ More The spectral unit ball $Ω_n$ is the set of all $n\times n$ matrices with spectral radius less than $1$. Let $π(M) \in \mathbb C^n$ stand for the coefficients of its characteristic polynomial of $M$ (up to signs), i.e. the elementary symmetric functions of its eigenvalues. The symmetrized polydisk is $\mathbb G_n:=π(Ω_n)$. When investigating Nevanlinna-Pick problems for maps from the disk to the spectral ball, it is often useful to project the map to the symmetrized polydisk (for instance to obtain continuity results for the Lempert function): if $ψ\in \mathcal O(\mathbb D, Ω_n)$, then $π\circ ψ\in \mathcal O(\mathbb D, \mathbb G_n)$. Given a map $\varphi \in \mathcal O(\mathbb D, \mathbb G_n)$, we are looking for necessary and sufficient conditions for this map to "lift through given matrices", i.e. find $ψ$ as above so that $π\circ ψ= \varphi$ and $ψ(α_j) = M_j$, $1\le j \le N$. A natural necessary condition is $\varphi(α_j)=π(M_j)$, $1\le j \le N$. When the matrices $M_j$ are derogatory (i.e. do not admit a cyclic vector) new necessary conditions appear, involving derivatives of $\varphi$ at the points $α_j$. Those conditions are necessary and sufficient for a local lift. We give a scheme which shows that the necessary conditions are also sufficient for a global lift in small dimensions (up to $5$), and a counter-example to show that the scheme fails in dimension $6$ (and above). △ Less

Submitted 9 September, 2015; v1 submitted 30 October, 2014; originally announced October 2014.

Comments: 22 pages; many small mistakes and typos fixed, thanks to the referee. To appear in Complex Analysis and Operator Theory

MSC Class: 30E05; 32F45

Journal ref: Complex Anal. Oper. Theory 10 (2016), 921-941

The uniqueness of hierarchically extended backward solutions of the Wright-Fisher model

Authors: Julian Hofrichter, Tat Dat Tran, Jürgen Jost

Abstract: The diffusion approximation of the Wright-Fisher model of population genetics leads to partial differentiable equations, the so-called Kolmogorov equations, with an operator that degenerates at the boundary. Standard tools do not apply, and in fact, solutions lack regularity properties. In this paper, we develop a regularising blow-up scheme for a certain class of solutions of the backward Kolmogo… ▽ More The diffusion approximation of the Wright-Fisher model of population genetics leads to partial differentiable equations, the so-called Kolmogorov equations, with an operator that degenerates at the boundary. Standard tools do not apply, and in fact, solutions lack regularity properties. In this paper, we develop a regularising blow-up scheme for a certain class of solutions of the backward Kolmogorov equation, the iteratively extended global solutions presented in \cite{THJ5}, and establish their uniqueness. As the model describes the random genetic drift of several alleles at the same locus from a backward perspective, the singularities result from the loss of an allele. While in an analytical approach, this causes substantial difficulties, from a biological or geometric perspective, this is a natural process that can be analyzed in detail. The presented scheme regularises the solution via a tailored successive transformation of the domain. △ Less

Submitted 19 July, 2014; v1 submitted 11 July, 2014; originally announced July 2014.

Comments: arXiv admin note: text overlap with arXiv:1406.5146

Journal ref: Communications in Partial Differential Equations, Volume 41, 2016 - Issue 3

A hierarchical extension scheme for solutions of the Wright-Fisher model

Authors: Julian Hofrichter, Tat Dat Tran, Jürgen Jost

Abstract: We develop a global and hierarchical scheme for the forward Kolmogorov (Fokker-Planck) equation of the diffusion approximation of the Wright-Fisher model of population genetics. That model describes the random genetic drift of several alleles at the same locus in a population. The key of our scheme is to connect the solutions before and after the loss of an allele. Whereas in an approach via stoch… ▽ More We develop a global and hierarchical scheme for the forward Kolmogorov (Fokker-Planck) equation of the diffusion approximation of the Wright-Fisher model of population genetics. That model describes the random genetic drift of several alleles at the same locus in a population. The key of our scheme is to connect the solutions before and after the loss of an allele. Whereas in an approach via stochastic processes or partial differential equations, such a loss of an allele leads to a boundary singularity, from a biological or geometric perspective, this is a natural process that can be analyzed in detail. Our method depends on evolution equations for the moments of the process and a careful analysis of the boundary flux. △ Less

Submitted 18 September, 2015; v1 submitted 19 June, 2014; originally announced June 2014.