Showing 1–50 of 78 results for author: Phan, T

Stochastic Learning of Computational Resource Usage as Graph Structured Multimarginal Schrödinger Bridge

Authors: Georgiy A. Bondar, Robert Gifford, Linh Thi Xuan Phan, Abhishek Halder

Abstract: We propose to learn the time-varying stochastic computational resource usage of software as a graph structured Schrödinger bridge problem. In general, learning the computational resource usage from data is challenging because resources such as the number of CPU instructions and the number of last level cache requests are both time-varying and statistically correlated. Our proposed method enables l… ▽ More We propose to learn the time-varying stochastic computational resource usage of software as a graph structured Schrödinger bridge problem. In general, learning the computational resource usage from data is challenging because resources such as the number of CPU instructions and the number of last level cache requests are both time-varying and statistically correlated. Our proposed method enables learning the joint time-varying stochasticity in computational resource usage from the measured profile snapshots in a nonparametric manner. The method can be used to predict the most-likely time-varying distribution of computational resource availability at a desired time. We provide detailed algorithms for stochastic learning in both single and multi-core cases, discuss the convergence guarantees, computational complexities, and demonstrate their practical use in two case studies: a single-core nonlinear model predictive controller, and a synthetic multi-core software. △ Less

Submitted 20 May, 2024; originally announced May 2024.

On linear elliptic equations with drift terms in critical weak spaces

Authors: Hyunseok Kim, Tuoc Phan, Tai-Peng Tsai

Abstract: We study the Dirichlet problem for a second order linear elliptic equation in a bounded smooth domain $Ω$ in $\mathbb{R}^n$, $n \ge 3$, with the drift $\mathbf{b} $ belonging to the critical weak space $L^{n,\infty}(Ω)$. We decompose the drift $\mathbf{b} = \mathbf{b}_1 + \mathbf{b}_2$ in which $\text{div} \mathbf{b}_1 \geq 0$ and $\mathbf{b}_2$ is small only in a small scale quasi-norm of… ▽ More We study the Dirichlet problem for a second order linear elliptic equation in a bounded smooth domain $Ω$ in $\mathbb{R}^n$, $n \ge 3$, with the drift $\mathbf{b} $ belonging to the critical weak space $L^{n,\infty}(Ω)$. We decompose the drift $\mathbf{b} = \mathbf{b}_1 + \mathbf{b}_2$ in which $\text{div} \mathbf{b}_1 \geq 0$ and $\mathbf{b}_2$ is small only in a small scale quasi-norm of $L^{n,\infty}(Ω)$. Under this new smallness condition, we prove existence, uniqueness, and regularity estimates of weak solutions to the problem and its dual. Hölder regularity and derivative estimates of weak solutions to the dual problem are also established. As a result, we prove uniqueness of very weak solutions slightly below the threshold. When $\mathbf{b}_2 =0$, our results recover those by Kim and Tsai in [SIAM J. Math. Anal. 52 (2020)]. Due to the new small scale quasi-norm, our results are new even when $\mathbf{b}_1=0$. △ Less

Submitted 18 December, 2023; originally announced December 2023.

Comments: 47 pages. Questions and comments are welcome

MSC Class: 35J15; 35J25

Path Structured Multimarginal Schrödinger Bridge for Probabilistic Learning of Hardware Resource Usage by Control Software

Authors: Georgiy A. Bondar, Robert Gifford, Linh Thi Xuan Phan, Abhishek Halder

Abstract: The solution of the path structured multimarginal Schrödinger bridge problem (MSBP) is the most-likely measure-valued trajectory consistent with a sequence of observed probability measures or distributional snapshots. We leverage recent algorithmic advances in solving such structured MSBPs for learning stochastic hardware resource usage by control software. The solution enables predicting the time… ▽ More The solution of the path structured multimarginal Schrödinger bridge problem (MSBP) is the most-likely measure-valued trajectory consistent with a sequence of observed probability measures or distributional snapshots. We leverage recent algorithmic advances in solving such structured MSBPs for learning stochastic hardware resource usage by control software. The solution enables predicting the time-varying distribution of hardware resource availability at a desired time with guaranteed linear convergence. We demonstrate the efficacy of our probabilistic learning approach in a model predictive control software execution case study. The method exhibits rapid convergence to an accurate prediction of hardware resource utilization of the controller. The method can be broadly applied to any software to predict cyber-physical context-dependent performance at arbitrary time. △ Less

Submitted 3 October, 2023; v1 submitted 1 October, 2023; originally announced October 2023.

Comments: 8 pages, 6 figures. Submitted to American Control Conference (ACC) 2024

Nondivergence form degenerate linear parabolic equations on the upper half space

Authors: Hongjie Dong, Tuoc Phan, Hung Vinh Tran

Abstract: We study a class of nondivergence form second-order degenerate linear parabolic equations in $(-\infty, T) \times {\mathbb R}^d_+$ with the homogeneous Dirichlet boundary condition on $(-\infty, T) \times \partial {\mathbb R}^d_+$, where ${\mathbb R}^d_+ = \{x =(x_1,x_2,\ldots, x_d) \in {\mathbb R}^d\,:\, x_d>0\}$ and $T\in {(-\infty, \infty]}$ is given. The coefficient matrices of the equations a… ▽ More We study a class of nondivergence form second-order degenerate linear parabolic equations in $(-\infty, T) \times {\mathbb R}^d_+$ with the homogeneous Dirichlet boundary condition on $(-\infty, T) \times \partial {\mathbb R}^d_+$, where ${\mathbb R}^d_+ = \{x =(x_1,x_2,\ldots, x_d) \in {\mathbb R}^d\,:\, x_d>0\}$ and $T\in {(-\infty, \infty]}$ is given. The coefficient matrices of the equations are the product of $μ(x_d)$ and bounded positive definite matrices, where $μ(x_d)$ behaves like $x_d^α$ for some given $α\in (0,2)$, which are degenerate on the boundary $\{x_d=0\}$ of the domain. The divergence form equations in this setting were studied in [14]. Under a partially weighted VMO assumption on the coefficients, we obtain the wellposedness and regularity of solutions in weighted Sobolev spaces. Our research program is motivated by the regularity theory of solutions to degenerate viscous Hamilton-Jacobi equations. △ Less

Submitted 20 August, 2023; v1 submitted 20 June, 2023; originally announced June 2023.

Comments: 40 pages, minor revision. Added a weighted parabolic embedding result and a local boundary estimate

On stationary Navier-Stokes equations in the upper-half plane

Authors: Adrian D. Calderon, Van Le, Tuoc Phan

Abstract: We study the incompressible stationary Navier-Stokes equations in the upper-half plane with homogeneous Dirichlet boundary condition and non-zero external forcing terms. Existence of weak solutions is proved under a suitable condition on the external forces. Weak-strong uniqueness criteria based on various growth conditions at the infinity of weak solutions are also given. This is done by employin… ▽ More We study the incompressible stationary Navier-Stokes equations in the upper-half plane with homogeneous Dirichlet boundary condition and non-zero external forcing terms. Existence of weak solutions is proved under a suitable condition on the external forces. Weak-strong uniqueness criteria based on various growth conditions at the infinity of weak solutions are also given. This is done by employing an energy estimate and a Hardy's inequality. Several estimates of stream functions are carried out and two density lemmas with suitable weights for the homogeneous Sobolev space on 2 dimensional space are proved. △ Less

Submitted 31 May, 2023; originally announced June 2023.

Comments: 25 pages. No figures

MSC Class: 35Q30; 35Q35; 76D03; 76D05

Sobolev estimates for singular-degenerate quasilinear equations beyond the $A_2$ class

Authors: Hongjie Dong, Tuoc Phan, Yannick Sire

Abstract: We study a conormal boundary value problem for a class of quasilinear elliptic equations in bounded domain $Ω$ whose coefficients can be degenerate or singular of the type $\text{dist}(x, \partial Ω)^α$, where $\partial Ω$ is the boundary of $Ω$ and $α\in (-1, \infty)$ is a given number. We establish weighted Sobolev type estimates for weak solutions under a smallness assumption on the weighted me… ▽ More We study a conormal boundary value problem for a class of quasilinear elliptic equations in bounded domain $Ω$ whose coefficients can be degenerate or singular of the type $\text{dist}(x, \partial Ω)^α$, where $\partial Ω$ is the boundary of $Ω$ and $α\in (-1, \infty)$ is a given number. We establish weighted Sobolev type estimates for weak solutions under a smallness assumption on the weighted mean oscillations of the coefficients in small balls. Our approach relies on a perturbative method and several new Lipschitz estimates for weak solutions to a class of singular-degenerate quasilinear equations. △ Less

Submitted 12 May, 2023; originally announced May 2023.

Comments: 25 pages, submitted

MSC Class: 35J70; 35J75; 35J62; 35D30; 35B45

Ground state solution of a Kirchhoff type equation with singular potentials

Authors: Thanh Viet Phan

Abstract: We study the existence and blow-up behavior of minimizers for $E(b)=\inf\Big\{\mathcal{E}_b(u) \,|\, u\in H^1(R^2), \|u\|_{L^2}=1\Big\},$ here $\mathcal{E}_b(u)$ is the Kirchhoff energy functional defined by $\mathcal{E}_b(u)= \int_{R^2} |\nabla u|^2 dx+ b(\int_{R^2} |\nabla u|^2d x)^2+\int_{R^2} V(x) |u(x)|^2 dx - \frac{a}{2} \int_{R^2} |u|^4 dx,$ where $a>0$ and $b>0$ are constants. When… ▽ More We study the existence and blow-up behavior of minimizers for $E(b)=\inf\Big\{\mathcal{E}_b(u) \,|\, u\in H^1(R^2), \|u\|_{L^2}=1\Big\},$ here $\mathcal{E}_b(u)$ is the Kirchhoff energy functional defined by $\mathcal{E}_b(u)= \int_{R^2} |\nabla u|^2 dx+ b(\int_{R^2} |\nabla u|^2d x)^2+\int_{R^2} V(x) |u(x)|^2 dx - \frac{a}{2} \int_{R^2} |u|^4 dx,$ where $a>0$ and $b>0$ are constants. When $V(x)= -|x|^{-p}$ with $0<p<2$, we prove that the problem has (at least) a minimizer that is non-negative and radially symmetric decreasing. For $a\ge a^*$ (where $a^*$ is the optimal constant in the Gagliardo-Nirenberg inequality), we get the behavior of $E(b)$ when $b\to 0^+$. Moreover, for the case $a=a^*$, we analyze the details of the behavior of the minimizers $u_b$ when $b\to 0^+$. △ Less

Submitted 15 December, 2022; originally announced December 2022.

Comments: 16 pages

MSC Class: 35Q40; 46N50

The emergence of a virus variant: dynamics of a competition model with cross-immunity time-delay validated by wastewater surveillance data for COVID-19

Authors: Bruce Pell, Samantha Brozak, Tin Phan, Fuqing Wu, Yang Kuang

Abstract: We consider the dynamics of a virus spreading through a population that produces a mutant strain with the ability to infect individuals that were infected with the established strain. Temporary cross-immunity is included using a time delay, but is found to be a harmless delay. We provide some sufficient conditions that guarantee local and global asymptotic stability of the disease-free equilibrium… ▽ More We consider the dynamics of a virus spreading through a population that produces a mutant strain with the ability to infect individuals that were infected with the established strain. Temporary cross-immunity is included using a time delay, but is found to be a harmless delay. We provide some sufficient conditions that guarantee local and global asymptotic stability of the disease-free equilibrium and the two boundary equilibria when the two strains outcompete one another. It is shown that, due to the immune evasion of the emerging strain, the reproduction number of the emerging strain must be significantly lower than that of the established strain for the local stability of the established-strain-only boundary equilibrium. To analyze the unique coexistence equilibrium we apply a quasi steady-state argument to reduce the full model to a two-dimensional one that exhibits a global asymptotically stable established-strain-only equilibrium or global asymptotically stable coexistence equilibrium. Our results indicate that the basic reproduction numbers of both strains govern the overall dynamics, but in nontrivial ways due to the inclusion of cross-immunity. The model is applied to study the emergence of the SARS-CoV-2 Delta variant in the presence of the Alpha variant using wastewater surveillance data from the Deer Island Treatment Plant in Massachusetts, USA. △ Less

Submitted 15 February, 2023; v1 submitted 15 September, 2022; originally announced September 2022.

Eine Bemerkung zu einigen $2$-dimensionalen Komplexen, die im $\mathbb{R}^4$ fast-eingebettet werden können

Authors: T. Tam Nguyen Phan

Abstract: We observe that many of the 2-complexes constructed by Freedman-Krushkal-Teichner in their paper on the incompleteness of the van Kampen embedding obstruction can actually be PL immersed in $\mathbb{R}^4$ in such a way that the images of the interiors of distinct cells are disjoint. In other words, they PL almost-embed in $\mathbb{R}^4$ with singularities occurring only as self intersections of so… ▽ More We observe that many of the 2-complexes constructed by Freedman-Krushkal-Teichner in their paper on the incompleteness of the van Kampen embedding obstruction can actually be PL immersed in $\mathbb{R}^4$ in such a way that the images of the interiors of distinct cells are disjoint. In other words, they PL almost-embed in $\mathbb{R}^4$ with singularities occurring only as self intersections of some 2-cells. This note is written in (not necessarily modern) German. △ Less

Submitted 26 June, 2022; originally announced June 2022.

Comments: 3 pages, in German

On trace Theorems for weighted mixed norm Sobolev spaces and applications

Authors: Tuoc Phan

Abstract: We prove trace theorems for weighted mixed norm Sobolev spaces in the upper-half space where the weight is a power function of the vertical variable. The results show the differentiability order of the trace functions depends only on the power in the weight function and the integrability power for the integration with respect to the vertical variable but not on the integrability powers for the int… ▽ More We prove trace theorems for weighted mixed norm Sobolev spaces in the upper-half space where the weight is a power function of the vertical variable. The results show the differentiability order of the trace functions depends only on the power in the weight function and the integrability power for the integration with respect to the vertical variable but not on the integrability powers for the integration with respect to the horizontal ones. They are new even in the un-weighted case and they recover classical results in the case of un-mixed norm spaces. The work is motivated by the study of regularity theory for solutions of elliptic and parabolic equations with anisotropic features and with non-homogeneous boundary conditions. The results provide an essential ingredient to the study of fractional elliptic and parabolic equations in divergence form with measurable coefficients. △ Less

Submitted 10 May, 2022; originally announced May 2022.

Comments: Comments or suggestion are welcome

MSC Class: 46E35; 35J25; 35J70; 35J75

StepDIRECT -- A Derivative-Free Optimization Method for Stepwise Functions

Authors: Dzung T. Phan, Hongsheng Liu, Lam M. Nguyen

Abstract: In this paper, we propose the StepDIRECT algorithm for derivative-free optimization (DFO), in which the black-box objective function has a stepwise landscape. Our framework is based on the well-known DIRECT algorithm. By incorporating the local variability to explore the flatness, we provide a new criterion to select the potentially optimal hyper-rectangles. In addition, we introduce a stochastic… ▽ More In this paper, we propose the StepDIRECT algorithm for derivative-free optimization (DFO), in which the black-box objective function has a stepwise landscape. Our framework is based on the well-known DIRECT algorithm. By incorporating the local variability to explore the flatness, we provide a new criterion to select the potentially optimal hyper-rectangles. In addition, we introduce a stochastic local search algorithm performing on potentially optimal hyper-rectangles to improve the solution quality and convergence speed. Global convergence of the StepDIRECT algorithm is provided. Numerical experiments on optimization for random forest models and hyper-parameter tuning are presented to support the efficacy of our algorithm. The proposed StepDIRECT algorithm shows competitive performance results compared with other state-of-the-art baseline DFO methods including the original DIRECT algorithm. △ Less

Submitted 1 February, 2022; originally announced February 2022.

Quasi-Einstein metrics on sphere bundles

Authors: Solomon Huang, Tommy Murphy, Thanh Nhan Phan

Abstract: In this note we adapt the work of Hall to find quasi-Einstein metrics on sphere bundles over products of Fano Kaehler-Einstein manifolds, as well as bundles where only one end is blown down. In this note we adapt the work of Hall to find quasi-Einstein metrics on sphere bundles over products of Fano Kaehler-Einstein manifolds, as well as bundles where only one end is blown down. △ Less

Submitted 12 January, 2022; originally announced January 2022.

Comments: 8 pages, to appear in Involve

MSC Class: 53C25

Journal ref: Involve 15 (2022) 507-514

Degenerate linear parabolic equations in divergence form on the upper half space

Authors: Hongjie Dong, Tuoc Phan, Hung Vinh Tran

Abstract: We study a class of second-order degenerate linear parabolic equations in divergence form in $(-\infty, T) \times \mathbb R^d_+$ with homogeneous Dirichlet boundary condition on $(-\infty, T) \times \partial \mathbb R^d_+$, where $\mathbb R^d_+ = \{x \in \mathbb R^d\,:\, x_d>0\}$ and $T\in {(-\infty, \infty]}$ is given. The coefficient matrices of the equations are the product of $μ(x_d)$ and boun… ▽ More We study a class of second-order degenerate linear parabolic equations in divergence form in $(-\infty, T) \times \mathbb R^d_+$ with homogeneous Dirichlet boundary condition on $(-\infty, T) \times \partial \mathbb R^d_+$, where $\mathbb R^d_+ = \{x \in \mathbb R^d\,:\, x_d>0\}$ and $T\in {(-\infty, \infty]}$ is given. The coefficient matrices of the equations are the product of $μ(x_d)$ and bounded uniformly elliptic matrices, where $μ(x_d)$ behaves like $x_d^α$ for some given $α\in (0,2)$, which are degenerate on the boundary $\{x_d=0\}$ of the domain. Under a partially VMO assumption on the coefficients, we obtain the wellposedness and regularity of solutions in weighted Sobolev spaces. Our results can be readily extended to systems. △ Less

Submitted 16 July, 2021; originally announced July 2021.

Comments: This paper supersedes arXiv:2106.07637 [math.AP]; 30 pages

On a class of divergence form linear parabolic equations with degenerate coefficients

Authors: Tuoc Phan, Hung Vinh Tran

Abstract: We study a class of linear parabolic equations in divergence form with degenerate coefficients on the upper half space. Specifically, the equations are considered in $(-\infty, T) \times \mathbb{R}^d_+$, where $\mathbb{R}^d_+ = \{x \in \mathbb{R}^d\,:\, x_d>0\}$ and $T\in {(-\infty, \infty]}$ is given, and the diffusion matrices are the product of $x_d$ and bounded uniformly elliptic matrices, whi… ▽ More We study a class of linear parabolic equations in divergence form with degenerate coefficients on the upper half space. Specifically, the equations are considered in $(-\infty, T) \times \mathbb{R}^d_+$, where $\mathbb{R}^d_+ = \{x \in \mathbb{R}^d\,:\, x_d>0\}$ and $T\in {(-\infty, \infty]}$ is given, and the diffusion matrices are the product of $x_d$ and bounded uniformly elliptic matrices, which are degenerate at $\{x_d=0\}$. As such, our class of equations resembles well the corresponding class of degenerate viscous Hamilton-Jacobi equations. We obtain wellposedness results and regularity type estimates in some appropriate weighted Sobolev spaces for the solutions. △ Less

Submitted 14 June, 2021; originally announced June 2021.

Comments: 27 pages

Fungible obstructions to embedding 2-complexes

Authors: Grigori Avramidi, T. Tam Nguyen Phan

Abstract: We give examples of finite, simplicial $2$-complexes that do not PL embed in $\mathbb{R}^4$ and exhibit, for each such complex, a family of PL immersions into $\mathbb{R}^4$ that hide the obstruction to embedding in "higher and higher order Milnor invariants". In addition, we show that the embedding obstructions defined by Krushkal in [8] vanish for our examples. We also answer a question in a pap… ▽ More We give examples of finite, simplicial $2$-complexes that do not PL embed in $\mathbb{R}^4$ and exhibit, for each such complex, a family of PL immersions into $\mathbb{R}^4$ that hide the obstruction to embedding in "higher and higher order Milnor invariants". In addition, we show that the embedding obstructions defined by Krushkal in [8] vanish for our examples. We also answer a question in a paper of Avramidi-Okun-Schreve. △ Less

Submitted 2 August, 2021; v1 submitted 23 May, 2021; originally announced May 2021.

Comments: New in this version: we show that the embedding obstructions defined by Krushkal in [8] vanish for our examples. 21 pages, 12 figures

Weighted mixed-norm $L_p$ estimates for equations in non-divergence form with singular coefficients: the Dirichlet problem

Authors: Hongjie Dong, Tuoc Phan

Abstract: We study a class of non-divergence form elliptic and parabolic equations with singular first-order coefficients in an upper half space with the homogeneous Dirichlet boundary condition. In the simplest setting, the operators in the equations under consideration appear in the study of fractional heat and fractional Laplace equations. Intrinsic weighted Sobolev spaces are found in which the existenc… ▽ More We study a class of non-divergence form elliptic and parabolic equations with singular first-order coefficients in an upper half space with the homogeneous Dirichlet boundary condition. In the simplest setting, the operators in the equations under consideration appear in the study of fractional heat and fractional Laplace equations. Intrinsic weighted Sobolev spaces are found in which the existence and uniqueness of strong solutions are proved under certain smallness conditions on the weighted mean oscillations of the coefficients in small parabolic cylinders. Our results are new even when the coefficients are constants and they cover the case where the weights may not be in the $A_p$-Muckenhoupt class. △ Less

Submitted 10 April, 2022; v1 submitted 14 March, 2021; originally announced March 2021.

Comments: Revised version using a different approach. Results are improved. Comments are welcome

MSC Class: 35K67; 35J75; 35D35; 35B45

On the Termination of Some Biclique Operators on Multipartite Graphs

Authors: Christophe Crespelle, Matthieu Latapy, Thi Ha Duong Phan

Abstract: We define a new graph operator, called the weak-factor graph, which comes from the context of complex network modelling. The weak-factor operator is close to the well-known clique-graph operator but it rather operates in terms of bicliques in a multipartite graph. We address the problem of the termination of the series of graphs obtained by iteratively applying the weak-factor operator starting fr… ▽ More We define a new graph operator, called the weak-factor graph, which comes from the context of complex network modelling. The weak-factor operator is close to the well-known clique-graph operator but it rather operates in terms of bicliques in a multipartite graph. We address the problem of the termination of the series of graphs obtained by iteratively applying the weak-factor operator starting from a given input graph. As for the clique-graph operator, it turns out that some graphs give rise to series that do not terminate. Therefore, we design a slight variation of the weak-factor operator, called clean-factor, and prove that its associated series terminates for all input graphs. In addition, we show that the multipartite graph on which the series terminates has a very nice combinatorial structure: we exhibit a bijection between its vertices and the chains of the inclusion order on the intersections of the maximal cliques of the input graph. △ Less

Submitted 7 March, 2021; originally announced March 2021.

Journal ref: Discrete Applied Mathematics 195, 2015

Termination of Multipartite Graph Series Arising from Complex Network Modelling

Authors: Matthieu Latapy, Thi Ha Duong Phan, Christophe Crespelle, Thanh Qui Nguyen

Abstract: An intense activity is nowadays devoted to the definition of models capturing the properties of complex networks. Among the most promising approaches, it has been proposed to model these graphs via their clique incidence bipartite graphs. However, this approach has, until now, severe limitations resulting from its incapacity to reproduce a key property of this object: the overlap** nature of cli… ▽ More An intense activity is nowadays devoted to the definition of models capturing the properties of complex networks. Among the most promising approaches, it has been proposed to model these graphs via their clique incidence bipartite graphs. However, this approach has, until now, severe limitations resulting from its incapacity to reproduce a key property of this object: the overlap** nature of cliques in complex networks. In order to get rid of these limitations we propose to encode the structure of clique overlaps in a network thanks to a process consisting in iteratively factorising the maximal bicliques between the upper level and the other levels of a multipartite graph. We show that the most natural definition of this factorising process leads to infinite series for some instances. Our main result is to design a restriction of this process that terminates for any arbitrary graph. Moreover, we show that the resulting multipartite graph has remarkable combinatorial properties and is closely related to another fundamental combinatorial object. Finally, we show that, in practice, this multipartite graph is computationally tractable and has a size that makes it suitable for complex network modelling. △ Less

Submitted 7 March, 2021; originally announced March 2021.

Comments: Published in LNCS, proceedings of the 4th International Conference on Combinatorial Optimization and Applications (COCOA), 2010

A Scalable MIP-based Method for Learning Optimal Multivariate Decision Trees

Authors: Haoran Zhu, Pavankumar Murali, Dzung T. Phan, Lam M. Nguyen, Jayant R. Kalagnanam

Abstract: Several recent publications report advances in training optimal decision trees (ODT) using mixed-integer programs (MIP), due to algorithmic advances in integer programming and a growing interest in addressing the inherent suboptimality of heuristic approaches such as CART. In this paper, we propose a novel MIP formulation, based on a 1-norm support vector machine model, to train a multivariate ODT… ▽ More Several recent publications report advances in training optimal decision trees (ODT) using mixed-integer programs (MIP), due to algorithmic advances in integer programming and a growing interest in addressing the inherent suboptimality of heuristic approaches such as CART. In this paper, we propose a novel MIP formulation, based on a 1-norm support vector machine model, to train a multivariate ODT for classification problems. We provide cutting plane techniques that tighten the linear relaxation of the MIP formulation, in order to improve run times to reach optimality. Using 36 data-sets from the University of California Irvine Machine Learning Repository, we demonstrate that our formulation outperforms its counterparts in the literature by an average of about 10% in terms of mean out-of-sample testing accuracy across the data-sets. We provide a scalable framework to train multivariate ODT on large data-sets by introducing a novel linear programming (LP) based data selection method to choose a subset of the data for training. Our method is able to routinely handle large data-sets with more than 7,000 sample points and outperform heuristics methods and other MIP based techniques. We present results on data-sets containing up to 245,000 samples. Existing MIP-based methods do not scale well on training data-sets beyond 5,500 samples. △ Less

Submitted 6 November, 2020; originally announced November 2020.

Parabolic and elliptic equations with singular or degenerate coefficients: the Dirichlet problem

Authors: Hongjie Dong, Tuoc Phan

Abstract: We consider the Dirichlet problem for a class of elliptic and parabolic equations in the upper-half space $\mathbb{R}^d_+$, where the coefficients are the product of $x_d^α, α\in (-\infty, 1),$ and a bounded uniformly elliptic matrix of coefficients. Thus, the coefficients are singular or degenerate near the boundary $\{x_d =0\}$ and they may not locally integrable. The novelty of the work is that… ▽ More We consider the Dirichlet problem for a class of elliptic and parabolic equations in the upper-half space $\mathbb{R}^d_+$, where the coefficients are the product of $x_d^α, α\in (-\infty, 1),$ and a bounded uniformly elliptic matrix of coefficients. Thus, the coefficients are singular or degenerate near the boundary $\{x_d =0\}$ and they may not locally integrable. The novelty of the work is that we find proper weights under which the existence, uniqueness, and regularity of solutions in Sobolev spaces are established. These results appear to be the first of their kind and are new even if the coefficients are constant. They are also readily extended to systems of equations. △ Less

Submitted 16 September, 2020; originally announced September 2020.

Comments: 36 pages, submitted for publication, comments are welcome

On parabolic and elliptic equations with singular or degenerate coefficients

Authors: Hongjie Dong, Tuoc Phan

Abstract: We study both divergence and non-divergence form parabolic and elliptic equations in the half space $\{x_d>0\}$ whose coefficients are the product of $x_d^α$ and uniformly nondegenerate bounded measurable matrix-valued functions, where $α\in (-1, \infty)$. As such, the coefficients are singular or degenerate near the boundary of the half space. For equations with the conormal or Neumann boundary c… ▽ More We study both divergence and non-divergence form parabolic and elliptic equations in the half space $\{x_d>0\}$ whose coefficients are the product of $x_d^α$ and uniformly nondegenerate bounded measurable matrix-valued functions, where $α\in (-1, \infty)$. As such, the coefficients are singular or degenerate near the boundary of the half space. For equations with the conormal or Neumann boundary condition, we prove the existence, uniqueness, and regularity of solutions in weighted Sobolev spaces and mixed-norm weighted Sobolev spaces when the coefficients are only measurable in the $x_d$ direction and have small mean oscillation in the other directions in small cylinders. Our results are new even in the special case when the coefficients are constants, and they are reduced to the classical results when $α=0$ △ Less

Submitted 8 July, 2020; originally announced July 2020.

Comments: Comments are welcome

A Hybrid Stochastic Policy Gradient Algorithm for Reinforcement Learning

Authors: Nhan H. Pham, Lam M. Nguyen, Dzung T. Phan, Phuong Ha Nguyen, Marten van Dijk, Quoc Tran-Dinh

Abstract: We propose a novel hybrid stochastic policy gradient estimator by combining an unbiased policy gradient estimator, the REINFORCE estimator, with another biased one, an adapted SARAH estimator for policy optimization. The hybrid policy gradient estimator is shown to be biased, but has variance reduced property. Using this estimator, we develop a new Proximal Hybrid Stochastic Policy Gradient Algori… ▽ More We propose a novel hybrid stochastic policy gradient estimator by combining an unbiased policy gradient estimator, the REINFORCE estimator, with another biased one, an adapted SARAH estimator for policy optimization. The hybrid policy gradient estimator is shown to be biased, but has variance reduced property. Using this estimator, we develop a new Proximal Hybrid Stochastic Policy Gradient Algorithm (ProxHSPGA) to solve a composite policy optimization problem that allows us to handle constraints or regularizers on the policy parameters. We first propose a single-looped algorithm then introduce a more practical restarting variant. We prove that both algorithms can achieve the best-known trajectory complexity $\mathcal{O}\left(\varepsilon^{-3}\right)$ to attain a first-order stationary point for the composite problem which is better than existing REINFORCE/GPOMDP $\mathcal{O}\left(\varepsilon^{-4}\right)$ and SVRPG $\mathcal{O}\left(\varepsilon^{-10/3}\right)$ in the non-composite setting. We evaluate the performance of our algorithm on several well-known examples in reinforcement learning. Numerical results show that our algorithm outperforms two existing methods on these examples. Moreover, the composite settings indeed have some advantages compared to the non-composite ones on certain problems. △ Less

Submitted 21 September, 2020; v1 submitted 1 March, 2020; originally announced March 2020.

Comments: Accepted for publication at the 23rd International Conference on Artificial Intelligence and Statistics (AISTATS 2020)

Journal ref: Proceedings of the International Conference on Artificial Intelligence and Statistics, PMLR 108:374-385, 2020

A Unified Convergence Analysis for Shuffling-Type Gradient Methods

Authors: Lam M. Nguyen, Quoc Tran-Dinh, Dzung T. Phan, Phuong Ha Nguyen, Marten van Dijk

Abstract: In this paper, we propose a unified convergence analysis for a class of generic shuffling-type gradient methods for solving finite-sum optimization problems. Our analysis works with any sampling without replacement strategy and covers many known variants such as randomized reshuffling, deterministic or randomized single permutation, and cyclic and incremental gradient schemes. We focus on two diff… ▽ More In this paper, we propose a unified convergence analysis for a class of generic shuffling-type gradient methods for solving finite-sum optimization problems. Our analysis works with any sampling without replacement strategy and covers many known variants such as randomized reshuffling, deterministic or randomized single permutation, and cyclic and incremental gradient schemes. We focus on two different settings: strongly convex and nonconvex problems, but also discuss the non-strongly convex case. Our main contribution consists of new non-asymptotic and asymptotic convergence rates for a wide class of shuffling-type gradient methods in both nonconvex and convex settings. We also study uniformly randomized shuffling variants with different learning rates and model assumptions. While our rate in the nonconvex case is new and significantly improved over existing works under standard assumptions, the rate on the strongly convex one matches the existing best-known rates prior to this paper up to a constant factor without imposing a bounded gradient condition. Finally, we empirically illustrate our theoretical results via two numerical examples: nonconvex logistic regression and neural network training examples. As byproducts, our results suggest some appropriate choices for diminishing learning rates in certain shuffling variants. △ Less

Submitted 19 September, 2021; v1 submitted 19 February, 2020; originally announced February 2020.

Comments: Journal of Machine Learning Research, 2021

Approximation rigidity and $h$-principle for Bing spines

Authors: Michael Freedman, T. Tam Nguyen Phan

Abstract: We show that all PL manifolds of dimension $\geq 3$ have spines similar to Bing's house with two rooms. Beyond this we explore approximation rigidity and an $h$-principle. We show that all PL manifolds of dimension $\geq 3$ have spines similar to Bing's house with two rooms. Beyond this we explore approximation rigidity and an $h$-principle. △ Less

Submitted 9 November, 2020; v1 submitted 7 January, 2020; originally announced January 2020.

Comments: 13 pages, 8 figures

Non-separating immersions of spheres and Bing houses

Authors: Michael Freedman, T. Tam Nguyen Phan

Abstract: We construct Bing houses in all dimensions $n \geq 3$, obtaining non-separating PL immersions of $\mathbb{S}^n \rightarrow\mathbb{R}^{n+1}$. We construct Bing houses in all dimensions $n \geq 3$, obtaining non-separating PL immersions of $\mathbb{S}^n \rightarrow\mathbb{R}^{n+1}$. △ Less

Submitted 19 January, 2020; v1 submitted 20 November, 2019; originally announced November 2019.

Comments: 16 pages, 17 figures. Appendix added

Boundary Lebesgue mixed-norm estimates for non-stationary Stokes systems with VMO coefficients

Authors: Hongjie Dong, Doyoon Kim, Tuoc Phan

Abstract: We consider Stokes systems with measurable coefficients and Lions-type boundary conditions. We show that, in contrast to the Dirichlet boundary conditions, local boundary mixed-norm $L_{s,q}$-estimates hold for the spatial second-order derivatives of solutions, assuming the smallness of the mean oscillations of the coefficients with respect to the spatial variables in small cylinders. In the un-mi… ▽ More We consider Stokes systems with measurable coefficients and Lions-type boundary conditions. We show that, in contrast to the Dirichlet boundary conditions, local boundary mixed-norm $L_{s,q}$-estimates hold for the spatial second-order derivatives of solutions, assuming the smallness of the mean oscillations of the coefficients with respect to the spatial variables in small cylinders. In the un-mixed norm case with $s=q=2$, the result is still new and provides local boundary Caccioppoli-type estimates. The main challenges in the work arise from the lack of regularity of the pressure and time derivatives of the solutions and from interaction of the boundary with the nonlocal structure of the system. To overcome these difficulties, our approach relies heavily on several newly developed regularity estimates for both divergence and non-divergence form parabolic equations with coefficients that are only measurable in the time variable and in one of the spatial variables. △ Less

Submitted 19 January, 2022; v1 submitted 1 October, 2019; originally announced October 2019.

MSC Class: 76D03; 76D07; 35K51; 35B45

A remark on $\varepsilon$-maps in dimension 1

Authors: T. Tam Nguyen Phan

Abstract: Let $f\colon \mathbb{S}^1\rightarrow G$ be a surjective map from the standard unit circle to a graph $G$ such that the pre-image of each point has diameter less than $\varepsilon$. If $\varepsilon$ is small enough, does $f$ split as a free factor in $π_1(G)$? Let $f\colon \mathbb{S}^1\rightarrow G$ be a surjective map from the standard unit circle to a graph $G$ such that the pre-image of each point has diameter less than $\varepsilon$. If $\varepsilon$ is small enough, does $f$ split as a free factor in $π_1(G)$? △ Less

Submitted 28 July, 2019; originally announced July 2019.

Comments: 4 pages, 2 figures

A Hybrid Stochastic Optimization Framework for Stochastic Composite Nonconvex Optimization

Authors: Quoc Tran-Dinh, Nhan H. Pham, Dzung T. Phan, Lam M. Nguyen

Abstract: We introduce a new approach to develop stochastic optimization algorithms for a class of stochastic composite and possibly nonconvex optimization problems. The main idea is to combine two stochastic estimators to create a new hybrid one. We first introduce our hybrid estimator and then investigate its fundamental properties to form a foundational theory for algorithmic development. Next, we apply… ▽ More We introduce a new approach to develop stochastic optimization algorithms for a class of stochastic composite and possibly nonconvex optimization problems. The main idea is to combine two stochastic estimators to create a new hybrid one. We first introduce our hybrid estimator and then investigate its fundamental properties to form a foundational theory for algorithmic development. Next, we apply our theory to develop several variants of stochastic gradient methods to solve both expectation and finite-sum composite optimization problems. Our first algorithm can be viewed as a variant of proximal stochastic gradient methods with a single-loop, but can achieve $\mathcal{O}(σ^3\varepsilon^{-1} + σ\varepsilon^{-3})$-oracle complexity bound, matching the best-known ones from state-of-the-art double-loop algorithms in the literature, where $σ> 0$ is the variance and $\varepsilon$ is a desired accuracy. Then, we consider two different variants of our method: adaptive step-size and restarting schemes that have similar theoretical guarantees as in our first algorithm. We also study two mini-batch variants of the proposed methods. In all cases, we achieve the best-known complexity bounds under standard assumptions. We test our methods on several numerical examples with real datasets and compare them with state-of-the-arts. Our numerical experiments show that the new methods are comparable and, in many cases, outperform their competitors. △ Less

Submitted 2 May, 2020; v1 submitted 8 July, 2019; originally announced July 2019.

Comments: 49 pages, 2 tables, 9 figures

Report number: UNC-STOR-2019.07.V1-03

Hybrid Stochastic Gradient Descent Algorithms for Stochastic Nonconvex Optimization

Authors: Quoc Tran-Dinh, Nhan H. Pham, Dzung T. Phan, Lam M. Nguyen

Abstract: We introduce a hybrid stochastic estimator to design stochastic gradient algorithms for solving stochastic optimization problems. Such a hybrid estimator is a convex combination of two existing biased and unbiased estimators and leads to some useful property on its variance. We limit our consideration to a hybrid SARAH-SGD for nonconvex expectation problems. However, our idea can be extended to ha… ▽ More We introduce a hybrid stochastic estimator to design stochastic gradient algorithms for solving stochastic optimization problems. Such a hybrid estimator is a convex combination of two existing biased and unbiased estimators and leads to some useful property on its variance. We limit our consideration to a hybrid SARAH-SGD for nonconvex expectation problems. However, our idea can be extended to handle a broader class of estimators in both convex and nonconvex settings. We propose a new single-loop stochastic gradient descent algorithm that can achieve $O(\max\{σ^3\varepsilon^{-1},σ\varepsilon^{-3}\})$-complexity bound to obtain an $\varepsilon$-stationary point under smoothness and $σ^2$-bounded variance assumptions. This complexity is better than $O(σ^2\varepsilon^{-4})$ often obtained in state-of-the-art SGDs when $σ< O(\varepsilon^{-3})$. We also consider different extensions of our method, including constant and adaptive step-size with single-loop, double-loop, and mini-batch variants. We compare our algorithms with existing methods on several datasets using two nonconvex models. △ Less

Submitted 14 May, 2019; originally announced May 2019.

Comments: 41 pages and 18 figures

Report number: UNC-STOR-May-2019-03

Well-posedness for the Navier-Stokes equations in critical mixed-norm Lebesgue spaces

Authors: Tuoc Phan

Abstract: We study the Cauchy problem in $n$-dimensional space for the system of Navier-Stokes equations in critical mixed-norm Lebesgue spaces. Local well-posedness and global well-posedness of solutions are established in the class of critical mixed-norm Lebesgue spaces. Being in the mixed-norm Lebesgue spaces, both of the initial data and the solutions could be singular at certain points or decaying to z… ▽ More We study the Cauchy problem in $n$-dimensional space for the system of Navier-Stokes equations in critical mixed-norm Lebesgue spaces. Local well-posedness and global well-posedness of solutions are established in the class of critical mixed-norm Lebesgue spaces. Being in the mixed-norm Lebesgue spaces, both of the initial data and the solutions could be singular at certain points or decaying to zero at infinity with different rates in different spatial variable directions. Some of these singular rates could be very strong and some of the decaying rates could be significantly slow. Besides other interests, the results of the paper particularly show an interesting phenomena on the persistence of the anisotropic behavior of the initial data under the evolution. To achieve the goals, fundamental analysis theory such as Young's inequality, time decaying of solutions for heat equations, the boundedness of the Helmholtz-Leray projection, and the boundedness of the Riesz tranfroms are developed in mixed-norm Lebesgue spaces. These fundamental analysis results are independently topics of great interests and they are potentially useful in other problems. △ Less

Submitted 14 April, 2019; v1 submitted 19 March, 2019; originally announced March 2019.

Comments: 19 pages, submitted, the statement of Theorem 2.9 is corrected. All comments are welcome and appreciated

ProxSARAH: An Efficient Algorithmic Framework for Stochastic Composite Nonconvex Optimization

Authors: Nhan H. Pham, Lam M. Nguyen, Dzung T. Phan, Quoc Tran-Dinh

Abstract: We propose a new stochastic first-order algorithmic framework to solve stochastic composite nonconvex optimization problems that covers both finite-sum and expectation settings. Our algorithms rely on the SARAH estimator introduced in (Nguyen et al, 2017) and consist of two steps: a proximal gradient and an averaging step making them different from existing nonconvex proximal-type algorithms. The… ▽ More We propose a new stochastic first-order algorithmic framework to solve stochastic composite nonconvex optimization problems that covers both finite-sum and expectation settings. Our algorithms rely on the SARAH estimator introduced in (Nguyen et al, 2017) and consist of two steps: a proximal gradient and an averaging step making them different from existing nonconvex proximal-type algorithms. The algorithms only require an average smoothness assumption of the nonconvex objective term and additional bounded variance assumption if applied to expectation problems. They work with both constant and adaptive step-sizes, while allowing single sample and mini-batches. In all these cases, we prove that our algorithms can achieve the best-known complexity bounds. One key step of our methods is new constant and adaptive step-sizes that help to achieve desired complexity bounds while improving practical performance. Our constant step-size is much larger than existing methods including proximal SVRG schemes in the single sample case. We also specify the algorithm to the non-composite case that covers existing state-of-the-arts in terms of complexity bounds. Our update also allows one to trade-off between step-sizes and mini-batch sizes to improve performance. We test the proposed algorithms on two composite nonconvex problems and neural networks using several well-known datasets. △ Less

Submitted 28 March, 2019; v1 submitted 14 February, 2019; originally announced February 2019.

Comments: 45 pages, 8 figures, and 2 table

Report number: STOR-UNC-Feb14.2019

Finite-Sum Smooth Optimization with SARAH

Authors: Lam M. Nguyen, Marten van Dijk, Dzung T. Phan, Phuong Ha Nguyen, Tsui-Wei Weng, Jayant R. Kalagnanam

Abstract: The total complexity (measured as the total number of gradient computations) of a stochastic first-order optimization algorithm that finds a first-order stationary point of a finite-sum smooth nonconvex objective function $F(w)=\frac{1}{n} \sum_{i=1}^n f_i(w)$ has been proven to be at least $Ω(\sqrt{n}/ε)$ for $n \leq \mathcal{O}(ε^{-2})$ where $ε$ denotes the attained accuracy… ▽ More The total complexity (measured as the total number of gradient computations) of a stochastic first-order optimization algorithm that finds a first-order stationary point of a finite-sum smooth nonconvex objective function $F(w)=\frac{1}{n} \sum_{i=1}^n f_i(w)$ has been proven to be at least $Ω(\sqrt{n}/ε)$ for $n \leq \mathcal{O}(ε^{-2})$ where $ε$ denotes the attained accuracy $\mathbb{E}[ \|\nabla F(\tilde{w})\|^2] \leq ε$ for the outputted approximation $\tilde{w}$ (Fang et al., 2018). In this paper, we provide a convergence analysis for a slightly modified version of the SARAH algorithm (Nguyen et al., 2017a;b) and achieve total complexity that matches the lower-bound worst case complexity in (Fang et al., 2018) up to a constant factor when $n \leq \mathcal{O}(ε^{-2})$ for nonconvex problems. For convex optimization, we propose SARAH++ with sublinear convergence for general convex and linear convergence for strongly convex problems; and we provide a practical version for which numerical experiments on various datasets show an improved performance. △ Less

Submitted 22 April, 2019; v1 submitted 22 January, 2019; originally announced January 2019.

DTN: A Learning Rate Scheme with Convergence Rate of $\mathcal{O}(1/t)$ for SGD

Authors: Lam M. Nguyen, Phuong Ha Nguyen, Dzung T. Phan, Jayant R. Kalagnanam, Marten van Dijk

Abstract: This paper has some inconsistent results, i.e., we made some failed claims because we did some mistakes for using the test criterion for a series. Precisely, our claims on the convergence rate of $\mathcal{O}(1/t)$ of SGD presented in Theorem 1, Corollary 1, Theorem 2 and Corollary 2 are wrongly derived because they are based on Lemma 5. In Lemma 5, we do not correctly use the test criterion for a… ▽ More This paper has some inconsistent results, i.e., we made some failed claims because we did some mistakes for using the test criterion for a series. Precisely, our claims on the convergence rate of $\mathcal{O}(1/t)$ of SGD presented in Theorem 1, Corollary 1, Theorem 2 and Corollary 2 are wrongly derived because they are based on Lemma 5. In Lemma 5, we do not correctly use the test criterion for a series. Hence, the result of Lemma 5 is not valid. We would like to thank the community for pointing out this mistake! △ Less

Submitted 27 February, 2019; v1 submitted 22 January, 2019; originally announced January 2019.

Comments: This paper has inconsistent results, i.e., we made some failed claims because we did some mistakes for using the test criterion for a series

Liouville type theorems for 3D stationary Navier-Stokes equations in weighted mixed-norm Lebesgue spaces

Authors: Tuoc Phan

Abstract: This work studies the system of $3D$ stationary Navier-Stokes equations. Several Liouville type theorems are established for solutions in mixed-norm Lebesgue spaces and weighted mixed-norm Lebesgue spaces. In particular, we show that, under some sufficient conditions in mixed-norm Lebesgue spaces, solutions of the stationary Navier-Stokes equations are identically zero. This result covers the impo… ▽ More This work studies the system of $3D$ stationary Navier-Stokes equations. Several Liouville type theorems are established for solutions in mixed-norm Lebesgue spaces and weighted mixed-norm Lebesgue spaces. In particular, we show that, under some sufficient conditions in mixed-norm Lebesgue spaces, solutions of the stationary Navier-Stokes equations are identically zero. This result covers the important case that solutions may decay to zero with different rates in different spatial directions, and some these rates could be significantly slow. In the un-mixed norm case, the result recovers available results. With some additional geometric assumptions on the supports of solutions, this work also provides several other important Liouville type theorems for solutions in weighted mixed-norm Lebesgue spaces. To prove the results, we establish some new results on mixed-norm and weighted mixed-norm estimates for Navier-Stokes equations. All of these results are new and could be useful in other studies. △ Less

Submitted 25 December, 2018; originally announced December 2018.

Comments: 12 pages, comments are welcome

Weighted mixed-norm $L_p$-estimates for elliptic and parabolic equations in non-divergence form with singular degenerate coefficients

Authors: Hongjie Dong, Tuoc Phan

Abstract: In this paper, we study both elliptic and parabolic equations in non-divergence form with singular degenerate coefficients. Weighted and mixed-norm $L_p$-estimates and solvability are established under some suitable partially weighted BMO regularity conditions on the coefficients. When the coefficients are constants, the operators are reduced to extensional operators which arise in the study of fr… ▽ More In this paper, we study both elliptic and parabolic equations in non-divergence form with singular degenerate coefficients. Weighted and mixed-norm $L_p$-estimates and solvability are established under some suitable partially weighted BMO regularity conditions on the coefficients. When the coefficients are constants, the operators are reduced to extensional operators which arise in the study of fractional heat equations and fractional Laplace equations. Our results are new even in this setting and in the unmixed case. For the proof, we establish both interior and boundary Lipschitz estimates for solutions and for higher order derivatives of solutions to homogeneous equations. We then employ the perturbation method by using the Fefferman-Stein sharp function theorem, the Hardy-Littlewood maximum function theorem, as well as a weighted Hardy's inequality. △ Less

Submitted 20 November, 2018; v1 submitted 15 November, 2018; originally announced November 2018.

Comments: 27 pages; minor typos are fixed; Comments and questions are welcomed

Harvesting of interacting stochastic populations

Authors: Alexandru Hening, Ky Quan Tran, Tien Trong Phan, George Yin

Abstract: We analyze the optimal harvesting problem for an ecosystem of species that experience environmental stochasticity. Our work generalizes the current literature significantly by taking into account non-linear interactions between species, state-dependent prices, and species injections. The key generalization is making it possible to not only harvest, but also `seed' individuals into the ecosystem. T… ▽ More We analyze the optimal harvesting problem for an ecosystem of species that experience environmental stochasticity. Our work generalizes the current literature significantly by taking into account non-linear interactions between species, state-dependent prices, and species injections. The key generalization is making it possible to not only harvest, but also `seed' individuals into the ecosystem. This is motivated by how fisheries and certain endangered species are controlled. The harvesting problem becomes finding the optimal harvesting-seeding strategy that maximizes the expected total income from the harvest minus the lost income from the species injections. Our analysis shows that new phenomena emerge due to the possibility of species injections. It is well-known that multidimensional harvesting problems are very hard to tackle. We are able to make progress, by characterizing the value function as a viscosity solution of the associated Hamilton-Jacobi-Bellman (HJB) equations. Moreover, we provide a verification theorem, which tells us that if a function has certain properties, then it will be the value function. This allows us to show heuristically, as was shown in Lungu and $Ø$ksendal (Bernoulli '01), that it is almost surely never optimal to harvest or seed from more than one population at a time. We approximate the continuous-time systems by Markov chains and show that the optimal harvesting-seeding strategies of the Markov chain approximations converge to the correct optimal harvesting strategy. This is used to provide numerical approximations to the optimal harvesting-seeding strategies and is a first step towards a full understanding of the intricacies of how one should harvest and seed interacting species. In particular, we look at three examples: one species modeled by a Verhulst-Pearl diffusion, two competing species and a two-species predator-prey system. △ Less

Submitted 12 October, 2018; originally announced October 2018.

Comments: 35 pages, 10 figures

MSC Class: 92D25; 60J70; 60J60

Journal ref: Journal of Mathematical Biology, Vol. 79, Issue 2, 533-570, 2019

Characterization of Convex Objective Functions and Optimal Expected Convergence Rates for SGD

Authors: Marten van Dijk, Lam M. Nguyen, Phuong Ha Nguyen, Dzung T. Phan

Abstract: We study Stochastic Gradient Descent (SGD) with diminishing step sizes for convex objective functions. We introduce a definitional framework and theory that defines and characterizes a core property, called curvature, of convex objective functions. In terms of curvature we can derive a new inequality that can be used to compute an optimal sequence of diminishing step sizes by solving a differentia… ▽ More We study Stochastic Gradient Descent (SGD) with diminishing step sizes for convex objective functions. We introduce a definitional framework and theory that defines and characterizes a core property, called curvature, of convex objective functions. In terms of curvature we can derive a new inequality that can be used to compute an optimal sequence of diminishing step sizes by solving a differential equation. Our exact solutions confirm known results in literature and allows us to fully characterize a new regularizer with its corresponding expected convergence rates. △ Less

Submitted 13 May, 2019; v1 submitted 9 October, 2018; originally announced October 2018.

Journal ref: Proceedings of the 36th International Conference on Machine Learning, PMLR 97, 2019

Mixed-norm $L_p$-estimates for non-stationary Stokes systems with singular VMO coefficients and applications

Authors: H. Dong, T. Phan

Abstract: We prove the mixed-norm Sobolev estimates for solutions to both divergence and non-divergence form time-dependent Stokes systems with unbounded measurable coefficients having small mean oscillations with respect to the spatial variable in small cylinders. As a special case, our results imply Caccioppoli's type estimates for the Stokes systems with variable coefficients. A new $ε$-regularity criter… ▽ More We prove the mixed-norm Sobolev estimates for solutions to both divergence and non-divergence form time-dependent Stokes systems with unbounded measurable coefficients having small mean oscillations with respect to the spatial variable in small cylinders. As a special case, our results imply Caccioppoli's type estimates for the Stokes systems with variable coefficients. A new $ε$-regularity criterion for Leray-Hopf weak solutions of Navier-Stokes equations is also obtained as a consequence of our regularity results, which in turn implies some borderline cases of the well-known Serrin's regularity criterion. △ Less

Submitted 14 May, 2018; v1 submitted 10 May, 2018; originally announced May 2018.

Comments: 20 pages, submitted, comments are appreciated

MSC Class: Primary: 76D03; 76D05; 76D07; Secondary: 35K67; 35K40

On higher integrability estimates for elliptic equations with singular coefficients

Authors: Juraj Földes, Tuoc Phan

Abstract: In this note we establish existence and uniqueness of weak solutions of linear elliptic equation $\text{div}[\mathbf{A}(x) \nabla u] = \text{div}{\mathbf{F}(x)}$, where the matrix $\mathbf{A}$ is just measurable and its skew-symmetric part can be unbounded. Global reverse Hölder's regularity estimates for gradients of weak solutions are also obtained. Most importantly, we show, by providing an exa… ▽ More In this note we establish existence and uniqueness of weak solutions of linear elliptic equation $\text{div}[\mathbf{A}(x) \nabla u] = \text{div}{\mathbf{F}(x)}$, where the matrix $\mathbf{A}$ is just measurable and its skew-symmetric part can be unbounded. Global reverse Hölder's regularity estimates for gradients of weak solutions are also obtained. Most importantly, we show, by providing an example, that boundedness and ellipticity of $\mathbf{A}$ is not sufficient for higher integrability estimates even when the symmetric part of $\mathbf{A}$ is the identity matrix. In addition, the example also shows the necessity of the dependence of $α$ in the Hölder $C^α$-regularity theory on the \textup{BMO}-semi norm of the skew-symmetric part of $\mathbf{A}$. The paper is an extension of classical results obtained by N. G. Meyers (1963) in which the skew-symmetric part of $\mathbf{A}$ is assumed to be zero. △ Less

Submitted 14 April, 2018; v1 submitted 9 April, 2018; originally announced April 2018.

Comments: Submitted

Regularity theory for parabolic equations with singular degenerate coefficients

Authors: Hongjie Dong, Tuoc Phan

Abstract: In this paper, we study parabolic equations in divergence form with coefficients that are singular degenerate as some Muckenhoupt weight functions in one spatial variable. Under certain conditions, weighted reverse Hölder's inequalities are established. Lipschitz estimates for weak solutions are proved for homogeneous equations with singular degenerate coefficients depending only on one spatial va… ▽ More In this paper, we study parabolic equations in divergence form with coefficients that are singular degenerate as some Muckenhoupt weight functions in one spatial variable. Under certain conditions, weighted reverse Hölder's inequalities are established. Lipschitz estimates for weak solutions are proved for homogeneous equations with singular degenerate coefficients depending only on one spatial variable. These estimates are then used to establish interior, boundary, and global weighted estimates of Calderón-Zygmund type for weak solutions, assuming that the coefficients are partially VMO (vanishing mean oscillations) with respect to the considered weights. The solvability in weighted Sobolev spaces is also achieved. Our results are new even for elliptic equations, and non-trivially extend known results for uniformly elliptic and parabolic equations. The results are also useful in the study of fractional elliptic and parabolic equations with measurable coefficients. △ Less

Submitted 15 November, 2018; v1 submitted 26 February, 2018; originally announced February 2018.

Comments: submitted, 37 pages. the main results are slightly improved

When Does Stochastic Gradient Algorithm Work Well?

Authors: Lam M. Nguyen, Nam H. Nguyen, Dzung T. Phan, Jayant R. Kalagnanam, Katya Scheinberg

Abstract: In this paper, we consider a general stochastic optimization problem which is often at the core of supervised learning, such as deep learning and linear classification. We consider a standard stochastic gradient descent (SGD) method with a fixed, large step size and propose a novel assumption on the objective function, under which this method has the improved convergence rates (to a neighborhood o… ▽ More In this paper, we consider a general stochastic optimization problem which is often at the core of supervised learning, such as deep learning and linear classification. We consider a standard stochastic gradient descent (SGD) method with a fixed, large step size and propose a novel assumption on the objective function, under which this method has the improved convergence rates (to a neighborhood of the optimal solutions). We then empirically demonstrate that these assumptions hold for logistic regression and standard deep neural networks on classical data sets. Thus our analysis helps to explain when efficient behavior can be expected from the SGD method in training classification models and deep neural networks. △ Less

Submitted 25 December, 2018; v1 submitted 18 January, 2018; originally announced January 2018.

Examples of noncompact nonpositively curved manifolds

Authors: Grigori Avramidi, T. Tam Nguyen Phan

Abstract: We give a simple construction of new, complete, finite volume manifolds $M$ of bounded, nonpositive curvature. These manifolds have ends that look like a mixture of locally symmetric ends of different ranks and their fundamental groups are not duality groups. We give a simple construction of new, complete, finite volume manifolds $M$ of bounded, nonpositive curvature. These manifolds have ends that look like a mixture of locally symmetric ends of different ranks and their fundamental groups are not duality groups. △ Less

Submitted 9 November, 2017; originally announced November 2017.

Comments: 13 pages, 2 figures

Large time behavior of unbounded solutions of first-order Hamilton-Jacobi equations in the whole space

Authors: Guy Barles, Olivier Ley, Thi-Tuyen Nguyen, Thanh Phan

Abstract: We study the large time behavior of solutions of first-order convex Hamilton-Jacobi Equations of Eikonal type set in the whole space. We assume that the solutions may have arbitrary growth. A complete study of the structure of solutions of the ergodic problem is provided : contrarily to the periodic setting, the ergodic constant is not anymore unique, leading to different large time behavior for… ▽ More We study the large time behavior of solutions of first-order convex Hamilton-Jacobi Equations of Eikonal type set in the whole space. We assume that the solutions may have arbitrary growth. A complete study of the structure of solutions of the ergodic problem is provided : contrarily to the periodic setting, the ergodic constant is not anymore unique, leading to different large time behavior for the solutions. We establish the ergodic behavior of the solutions of the Cauchy problem (i) when starting with a bounded from below initial condition and (ii) for some particular unbounded from below initial condition, two cases for which we have different ergodic constants which play a role. When the solution is not bounded from below, an example showing that the convergence may fail in general is provided. △ Less

Submitted 22 May, 2018; v1 submitted 25 September, 2017; originally announced September 2017.

Blow-up profile of Bose-Einstein condensate with singular potentials

Authors: Thanh Viet Phan

Abstract: The paper is concerned with the Bose-Einstein condensate described by the attractive Gross-Pitaevskii equation in R 2 , where the external potential is unbounded from below. We show that when the interaction strength increases to a critical value, the Gross-Pitaevskii minimizer collapses to one singular point and we analyze the details of the collapse exactly up to the leading order. The paper is concerned with the Bose-Einstein condensate described by the attractive Gross-Pitaevskii equation in R 2 , where the external potential is unbounded from below. We show that when the interaction strength increases to a critical value, the Gross-Pitaevskii minimizer collapses to one singular point and we analyze the details of the collapse exactly up to the leading order. △ Less

Submitted 25 July, 2017; originally announced July 2017.

Comments: 14 pages, no figure. To appear Journal of Mathematical Physics

Regularity gradient estimates for weak solutions of singular quasi-linear parabolic equations

Authors: Tuoc Phan

Abstract: This paper studies the Sobolev regularity estimates of weak solutions of a class of singular quasi-linear elliptic problems of the form $u_t - \mbox{div}[\mathbb{A}(x,t,u,\nabla u)]= \mbox{div}[{\mathbf F}]$ with homogeneous Dirichlet boundary conditions over bounded spatial domains. Our main focus is on the case that the vector coefficients $\mathbb{A}$ are discontinuous and singular in $(x,t)$-v… ▽ More This paper studies the Sobolev regularity estimates of weak solutions of a class of singular quasi-linear elliptic problems of the form $u_t - \mbox{div}[\mathbb{A}(x,t,u,\nabla u)]= \mbox{div}[{\mathbf F}]$ with homogeneous Dirichlet boundary conditions over bounded spatial domains. Our main focus is on the case that the vector coefficients $\mathbb{A}$ are discontinuous and singular in $(x,t)$-variables, and dependent on the solution $u$. Global and interior weighted $W^{1,p}(Ω, ω)$-regularity estimates are established for weak solutions of these equations, where $ω$ is a weight function in some Muckenhoupt class of weights. The results obtained are even new for linear equations, and for $ω=1$, because of the singularity of the coefficients in $(x,t)$-variables △ Less

Submitted 26 March, 2017; originally announced March 2017.

Comments: arXiv admin note: text overlap with arXiv:1703.02706. text overlap with arXiv:1702.08622

On $W^{1,p}$-regularity estimate for a class of generalized Stokes systems and its applications to the Navier-Stokes equations

Authors: Tuoc Phan

Abstract: This paper establishes global weighted Calderón-Zygmund type regularity estimates for weak solutions of a class of generalized Stokes systems in divergence form. The focus of the paper is on the case that the coefficients in the divergence-form Stokes operator consist of symmetric and skew-symmetric parts, which are both discontinuous. Moreover, the skew-symmetric part is not required to be bounde… ▽ More This paper establishes global weighted Calderón-Zygmund type regularity estimates for weak solutions of a class of generalized Stokes systems in divergence form. The focus of the paper is on the case that the coefficients in the divergence-form Stokes operator consist of symmetric and skew-symmetric parts, which are both discontinuous. Moreover, the skew-symmetric part is not required to be bounded and therefore it could be singular. Sufficient conditions on the coefficients are provided to ensure the global weighted $W^{1,p}$-regularity estimates for weak solutions of the systems. As a direct application, we show that our $W^{1,p}$-regularity results give some criteria in critical spaces for the global regularity of weak Leray-Hopf solutions of the Navier-Stokes system of equation △ Less

Submitted 16 May, 2017; v1 submitted 8 March, 2017; originally announced March 2017.

Comments: There are some gaps in the draft

Weighted Calderón-Zygmund estimates for weak solutions of quasi-linear degenerate elliptic equations

Authors: Tuoc Phan

Abstract: This paper studies the Sobolev regularity estimates for weak solutions of a class of degenerate, and singular quasi-linear elliptic problems of the form $\text{div}[\mathbf{A}(x,u, \nabla u)]= \text{div}[\mathbf{F}]$ with non-homogeneous Dirichlet boundary conditions over bounded non-smooth domains. The coefficients $\mathbf{A}$ could be be singular, and degenerate or both in $x$ in the sense that… ▽ More This paper studies the Sobolev regularity estimates for weak solutions of a class of degenerate, and singular quasi-linear elliptic problems of the form $\text{div}[\mathbf{A}(x,u, \nabla u)]= \text{div}[\mathbf{F}]$ with non-homogeneous Dirichlet boundary conditions over bounded non-smooth domains. The coefficients $\mathbf{A}$ could be be singular, and degenerate or both in $x$ in the sense that they behave like some weight function $μ$, which is in the $A_2$ class of Muckenhoupt weights. Global and interior weighted $W^{1,p}(Ω, ω)$-regularity estimates are established for weak solutions of these equations with some other weight function $ω$. The results obtained are even new for the case $μ=1$ because of the dependence on the solution $u$ of $\mathbf{A}$. In case of linear equations, our $W^{1,p}$-regularity estimates can be viewed as the Sobolev's counterpart of the Hölder's regularity estimates established by B. Fabes, C. E. Kenig, and R. P. Serapioni. △ Less

Submitted 27 February, 2017; originally announced February 2017.

A note on local $W^{1,p}$-regularity estimates for weak solutions of parabolic equations with singular divergence-free drifts

Authors: Tuoc Phan

Abstract: We investigate weighted Sobolev regularity of weak solutions of non-homogeneous parabolic equations with singular divergence-free drifts. Assuming that the drifts satisfy some mild regularity conditions, we establish local weighted $L^p$-estimates for the gradients of weak solutions. Our results improve the classical one to the borderline case by replacing the $L^\infty$-assumption on solutions by… ▽ More We investigate weighted Sobolev regularity of weak solutions of non-homogeneous parabolic equations with singular divergence-free drifts. Assuming that the drifts satisfy some mild regularity conditions, we establish local weighted $L^p$-estimates for the gradients of weak solutions. Our results improve the classical one to the borderline case by replacing the $L^\infty$-assumption on solutions by solutions in the John-Nirenberg \textup{BMO} space. The results are also generalized to parabolic equations in divergence form with small oscillation elliptic symmetric coefficients and therefore improve many known results. △ Less

Submitted 2 January, 2017; originally announced January 2017.

Weighted $W^{1,p}$- estimates for weak solutions of degenerate elliptic equations with coefficients degenerate in one variable

Authors: Tadele Mengesha, Tuoc Phan

Abstract: This paper studies the Sobolev regularity of weak solution of degenerate elliptic equations in divergence form $\text{div}[\mathbf{A}(X) \nabla u] = \text{div}[\mathbf{F}(X)]$, where $X = (x,y) \in \mathbb{R}^{n} \times \mathbb{R}$ . The coefficient matrix $\mathbf{A}(X)$ is a symmetric, measurable $(n+1) \times (n+1)$ matrix, and it could be degenerate or singular in the one dimensional $y$-varia… ▽ More This paper studies the Sobolev regularity of weak solution of degenerate elliptic equations in divergence form $\text{div}[\mathbf{A}(X) \nabla u] = \text{div}[\mathbf{F}(X)]$, where $X = (x,y) \in \mathbb{R}^{n} \times \mathbb{R}$ . The coefficient matrix $\mathbf{A}(X)$ is a symmetric, measurable $(n+1) \times (n+1)$ matrix, and it could be degenerate or singular in the one dimensional $y$-variable as a weight function in the Muckenhoupt class $A_2$ of weights. Our results give weighted Sobolev regularity estimates of Calderón-Zygmund type for weak solutions of this class of singular, degenerate equations. As an application of these estimates, we establish global Sobolev regularity estimates for solutions of the spectral fractional elliptic equation with measurable coefficients. This result can be considered as the Sobolev counterpart of the recently established Schauder regularity theory of fractional elliptic equations. △ Less

Submitted 21 December, 2016; originally announced December 2016.

Comments: Submitted

Weighted-$W^{1,p}$ estimates for weak solutions of degenerate and singular elliptic equations

Authors: Dat Cao, Tadele Mengesha, Tuoc Phan

Abstract: Global weighted $L^{p}$-estimates are obtained for the gradient of solutions to a class of linear singular, degenerate elliptic Dirichlet boundary value problems over a bounded non-smooth domain. The coefficient matrix is symmetric, nonnegative definite, and both its smallest and largest eigenvalues are proportion to a weight in a Muckenhoupt class. Under a smallness condition on the mean oscillat… ▽ More Global weighted $L^{p}$-estimates are obtained for the gradient of solutions to a class of linear singular, degenerate elliptic Dirichlet boundary value problems over a bounded non-smooth domain. The coefficient matrix is symmetric, nonnegative definite, and both its smallest and largest eigenvalues are proportion to a weight in a Muckenhoupt class. Under a smallness condition on the mean oscillation of the coefficients with the weight and a Reifenberg flatness condition on the boundary of the domain, we establish a weighted gradient estimate for weak solutions of the equation. A class of degenerate coefficients satisfying the smallness condition is characterized. A counter example to demonstrate the necessity of the smallness condition on the coefficients is given. Our $W^{1,p}$-regularity estimates can be viewed as the Sobolev's counterpart of the Hölder's regularity estimates established by B. Fabes, C. E. Kenig, and R. P. Serapioni in 1982. △ Less

Submitted 16 December, 2016; originally announced December 2016.

Comments: Submitted, lectures on the paper were given by the authors at several meetings, seminars