Showing 1–50 of 63 results for author: Hu, R

Finite-Agent Stochastic Differential Games on Large Graphs: I. The Linear-Quadratic Case

Authors: Ruimeng Hu, Jihao Long, Haosheng Zhou

Abstract: In this paper, we study finite-agent linear-quadratic games on graphs. Specifically, we propose a comprehensive framework that extends the existing literature by incorporating heterogeneous and interpretable player interactions. Compared to previous works, our model offers a more realistic depiction of strategic decision-making processes. For general graphs, we establish the convergence of fictiti… ▽ More In this paper, we study finite-agent linear-quadratic games on graphs. Specifically, we propose a comprehensive framework that extends the existing literature by incorporating heterogeneous and interpretable player interactions. Compared to previous works, our model offers a more realistic depiction of strategic decision-making processes. For general graphs, we establish the convergence of fictitious play, a widely-used iterative solution method for determining the Nash equilibrium of our proposed game model. Notably, under appropriate conditions, this convergence holds true irrespective of the number of players involved. For vertex-transitive graphs, we develop a semi-explicit characterization of the Nash equilibrium. Through rigorous analysis, we demonstrate the well-posedness of this characterization under certain conditions. We present numerical experiments that validate our theoretical results and provide insights into the intricate relationship between various game dynamics and the underlying graph structure. △ Less

Submitted 13 June, 2024; originally announced June 2024.

Strong asymptotic convergence of a slowly damped inertial primal-dual dynamical system controlled by a Tikhonov regularization term

Authors: Ting-Ting Zhu, Rong Hu, Ya-** Fang

Abstract: We propose a slowly damped inertial primal-dual dynamical system controlled by a Tikhonov regularization term, where the inertial term is introduced only for the primal variable, for the linearly constrained convex optimization problem in a Hilbert space. Under mild conditions on the underlying parameters, by a Lyapunov analysis approach, we prove the strong asymptotic convergence of the trajector… ▽ More We propose a slowly damped inertial primal-dual dynamical system controlled by a Tikhonov regularization term, where the inertial term is introduced only for the primal variable, for the linearly constrained convex optimization problem in a Hilbert space. Under mild conditions on the underlying parameters, by a Lyapunov analysis approach, we prove the strong asymptotic convergence of the trajectory of the proposed dynamic to the minimal norm element of the primal-dual solution set of the problem, along with convergence rate results for the primal-dual gap, the objective residual and the feasibility violation. We perform some numerical experiments to illustrate the theoretical findings. △ Less

Submitted 20 June, 2024; v1 submitted 13 June, 2024; originally announced June 2024.

Solving maximally comonotone inclusion problems via an implicit Newton-like inertial dynamical system and its discretization

Authors: Z. Z. Tan, R. Hu, Y. P. Fang

Abstract: This paper deals with an implicit Newton-like inertial dynamical system governed by a maximally comonotone inclusion problem in a Hilbert space. Under suitable conditions, we establish not only pointwise estimates and integral estimates for the velocity and the value of the associated Yosida regularization operator along the trajectory of the system, but also the weak convergence of the trajectory… ▽ More This paper deals with an implicit Newton-like inertial dynamical system governed by a maximally comonotone inclusion problem in a Hilbert space. Under suitable conditions, we establish not only pointwise estimates and integral estimates for the velocity and the value of the associated Yosida regularization operator along the trajectory of the system, but also the weak convergence of the trajectory to a zero of the maximally comonotone operator. Moreover, a new inertial algorithm is developed via a time discretization of the proposed system. Our analysis reveals that the resulting discrete algorithm exhibits fast convergence properties matching the ones of the continuous time counterpart. Finally, the theoretical results are illustrated by numerical experiments. △ Less

Submitted 10 May, 2024; originally announced May 2024.

On the Three-dimensional Nernst-Planck-Boussinesq System

Authors: Elie Abdo, Ruimeng Hu, Quyuan Lin

Abstract: In this paper, we analyze a three-dimensional Nernst-Planck-Boussinesq (NPB) system that describes ionic electrodiffusion in an incompressible viscous fluid. This new model incorporates variational temperature and is forced by buoyancy force stemming from temperature and salinity fluctuations, enhancing its generality and realism. The electromigration term in the NPB system displays a complex nonl… ▽ More In this paper, we analyze a three-dimensional Nernst-Planck-Boussinesq (NPB) system that describes ionic electrodiffusion in an incompressible viscous fluid. This new model incorporates variational temperature and is forced by buoyancy force stemming from temperature and salinity fluctuations, enhancing its generality and realism. The electromigration term in the NPB system displays a complex nonlinear structure influenced by the reciprocal of the temperature that distinguishes its mathematical aspects from other electrodiffusion models studied in the literature. We address the global existence of weak solutions to the NPB system on the three-dimensional torus for large initial data. In addition, we study the long-time dynamics of these weak solutions and the associated relative entropies and establish their exponential decay in time to steady states. △ Less

Submitted 3 May, 2024; originally announced May 2024.

Comments: 28 pages

Fast convergence rates and trajectory convergence of a Tikhonov regularized inertial primal\mbox{-}dual dynamical system with time scaling and vanishing dam**

Authors: Ting-Ting Zhu, Rong Hu, Ya-** Fang

Abstract: A Tikhonov regularized inertial primal\mbox{-}dual dynamical system with time scaling and vanishing dam** is proposed for solving a linearly constrained convex optimization problem in Hilbert spaces. The system under consideration consists of two coupled second order differential equations and its convergence properties depend upon the decaying speed of the product of the time scaling parameter… ▽ More A Tikhonov regularized inertial primal\mbox{-}dual dynamical system with time scaling and vanishing dam** is proposed for solving a linearly constrained convex optimization problem in Hilbert spaces. The system under consideration consists of two coupled second order differential equations and its convergence properties depend upon the decaying speed of the product of the time scaling parameter and the Tikhonov regularization parameter (named the rescaled regularization parameter) to zero. When the rescaled regularization parameter converges rapidly to zero, the system enjoys fast convergence rates of the primal-dual gap, the feasibility violation, the objective residual, and the gradient norm of the objective function along the trajectory, and the weak convergence of the trajectory to a primal-dual solution of the linearly constrained convex optimization problem. When the rescaled regularization parameter converges slowly to zero, the generated primal trajectory converges strongly to the minimal norm solution of the problem under suitable conditions. Finally, numerical experiments are performed to illustrate the theoretical findings. △ Less

Submitted 23 April, 2024; originally announced April 2024.

Multi-Agent Relative Investment Games in a Jump Diffusion Market with Deep Reinforcement Learning Algorithm

Authors: Liwei Lu, Ruimeng Hu, Xu Yang, Yi Zhu

Abstract: This paper focuses on multi-agent stochastic differential games for jump-diffusion systems. On one hand, we study the multi-agent game for optimal investment in a jump-diffusion market. We derive constant Nash equilibria and provide sufficient conditions for their existence and uniqueness for exponential, power, and logarithmic utilities, respectively. On the other hand, we introduce a computation… ▽ More This paper focuses on multi-agent stochastic differential games for jump-diffusion systems. On one hand, we study the multi-agent game for optimal investment in a jump-diffusion market. We derive constant Nash equilibria and provide sufficient conditions for their existence and uniqueness for exponential, power, and logarithmic utilities, respectively. On the other hand, we introduce a computational framework based on the actor-critic method in deep reinforcement learning to solve the stochastic control problem with jumps. We extend this algorithm to address the multi-agent game with jumps and utilize parallel computing to enhance computational efficiency. We present numerical examples of the Merton problem with jumps, linear quadratic regulators, and the optimal investment game under various settings to demonstrate the accuracy, efficiency, and robustness of the proposed method. In particular, neural network solutions numerically converge to the derived constant Nash equilibrium for the multi-agent game. △ Less

Submitted 18 April, 2024; originally announced April 2024.

An Online Algorithm for Solving Feedback Optimal Control Problems with Partial Observations

Authors: Siming Liang, Ruoyu Hu, Feng Bao, Richard Archibald, Guannan Zhang

Abstract: This paper presents a novel methodology to tackle feedback optimal control problems in scenarios where the exact state of the controlled process is unknown. It integrates data assimilation techniques and optimal control solvers to manage partial observation of the state process, a common occurrence in practical scenarios. Traditional stochastic optimal control methods assume full state observation… ▽ More This paper presents a novel methodology to tackle feedback optimal control problems in scenarios where the exact state of the controlled process is unknown. It integrates data assimilation techniques and optimal control solvers to manage partial observation of the state process, a common occurrence in practical scenarios. Traditional stochastic optimal control methods assume full state observation, which is often not feasible in real-world applications. Our approach underscores the significance of utilizing observational data to inform control policy design. Specifically, we introduce a kernel learning backward stochastic differential equation (SDE) filter to enhance data assimilation efficiency and propose a sample-wise stochastic optimization method within the stochastic maximum principle framework. Numerical experiments validate the efficacy and accuracy of our algorithm, showcasing its high efficiency in solving feedback optimal control problems with partial observation. △ Less

Submitted 21 March, 2024; originally announced April 2024.

Comments: arXiv admin note: substantial text overlap with arXiv:2201.10600

Weighted Composition Operator on Fock Space

Authors: Rui Hu

Abstract: In this thesis, we establish a necessary and sufficient condition for a weighted composition operator to commute with a self-adjoint weighted composition operator on the Fock space, then obtain a sufficient condition for these commuting weighted composition operators to be normal. In this thesis, we establish a necessary and sufficient condition for a weighted composition operator to commute with a self-adjoint weighted composition operator on the Fock space, then obtain a sufficient condition for these commuting weighted composition operators to be normal. △ Less

Submitted 25 March, 2024; originally announced March 2024.

Geometric theory of perturbation dynamics around non-equilibrium fluid flows

Authors: Darryl D. Holm, Ruiao Hu, Oliver D. Street

Abstract: The present work investigates the evolution of linear perturbations of time-dependent ideal fluid flows with advected quantities, expressed in terms of the second order variations of the action corresponding to a Lagrangian defined on a semidirect product space. This approach is related to Jacobi fields along geodesics and several examples are given explicitly to elucidate our approach. Numerical… ▽ More The present work investigates the evolution of linear perturbations of time-dependent ideal fluid flows with advected quantities, expressed in terms of the second order variations of the action corresponding to a Lagrangian defined on a semidirect product space. This approach is related to Jacobi fields along geodesics and several examples are given explicitly to elucidate our approach. Numerical simulations of the perturbation dynamics are also presented. △ Less

Submitted 29 March, 2024; v1 submitted 15 February, 2024; originally announced February 2024.

Comments: 21 pages, 3 figures, 2nd version

Accuracy Analysis of Physics-Informed Neural Networks for Approximating the Critical SQG Equation

Authors: Elie Abdo, Ruimeng Hu, Quyuan Lin

Abstract: We systematically analyze the accuracy of Physics-Informed Neural Networks (PINNs) in approximating solutions to the critical Surface Quasi-Geostrophic (SQG) equation on two-dimensional periodic boxes. The critical SQG equation involves advection and diffusion described by nonlocal periodic operators, posing challenges for neural network-based methods that do not commonly exhibit periodic boundary… ▽ More We systematically analyze the accuracy of Physics-Informed Neural Networks (PINNs) in approximating solutions to the critical Surface Quasi-Geostrophic (SQG) equation on two-dimensional periodic boxes. The critical SQG equation involves advection and diffusion described by nonlocal periodic operators, posing challenges for neural network-based methods that do not commonly exhibit periodic boundary conditions. In this paper, we present a novel approximation of these operators using their nonperiodic analogs based on singular integral representation formulas and use it to perform error estimates. This idea can be generalized to a larger class of nonlocal partial differential equations whose solutions satisfy prescribed boundary conditions, thereby initiating a new PINNs theory for equations with nonlocalities. △ Less

Submitted 19 January, 2024; originally announced January 2024.

Comments: 21 pages

Radon-type transforms for holomorphic and Hermitian monogenic functions

Authors: Ren Hu, Pan Lian

Abstract: The standard Radon transform of holomorphic functions is not always well defined, as the integration of such functions over planes may not converge. In this paper, we introduce new Radon-type transforms of co-(real)dimension $2$ for harmonic and holomorphic functions on the unit ball. These transforms are abstractly defined as orthogonal projections onto spaces of complex harmonic and holomorphic… ▽ More The standard Radon transform of holomorphic functions is not always well defined, as the integration of such functions over planes may not converge. In this paper, we introduce new Radon-type transforms of co-(real)dimension $2$ for harmonic and holomorphic functions on the unit ball. These transforms are abstractly defined as orthogonal projections onto spaces of complex harmonic and holomorphic plane waves, respectively. The inversion formulas are derived based on the dual transform, while the latter is defined as an integration on a complex Stiefel manifold. Our transforms are extended to the Fock space and give rise to a new transform defined on the entire $L^{2}(\mathbb{R}^{n})$ through the Segal-Bargmann transform. Furthermore, we develop these transforms for Hermitian monogenic functions on the unit ball, thereby refining the Szegö-Radon transform for monogenic functions introduced by Colombo, Sabadini and Sommen. △ Less

Submitted 1 January, 2024; originally announced January 2024.

Comments: All comments welcome!

MSC Class: 30G35

On the Long-time Dynamics and Ergodicity of the Stochastic Nernst-Planck-Navier-Stokes System

Authors: Elie Abdo, Ruimeng Hu, Quyuan Lin

Abstract: We consider an electrodiffusion model that describes the intricate interplay of multiple ionic species with a two-dimensional, incompressible, viscous fluid subjected to stochastic additive noise. This system involves nonlocal nonlinear drift-diffusion Nernst-Planck equations for ionic species and stochastic Navier-Stokes equations for fluid motion under the influence of electric and time-independ… ▽ More We consider an electrodiffusion model that describes the intricate interplay of multiple ionic species with a two-dimensional, incompressible, viscous fluid subjected to stochastic additive noise. This system involves nonlocal nonlinear drift-diffusion Nernst-Planck equations for ionic species and stochastic Navier-Stokes equations for fluid motion under the influence of electric and time-independent forces. Under the selective boundary conditions imposed on the concentrations, we establish the existence and uniqueness of global pathwise solutions to this system on smooth bounded domains. Our study also investigates long-time ionic concentration dynamics and explores Feller properties of the associated Markovian semigroup. In the context of equal diffusive species and under appropriate conditions, we demonstrate the existence of invariant ergodic measures supported on $H^2$. We then enhance the ergodicity results on periodic tori and obtain smooth invariant measures under a constraint on the initial spatial averages of the concentrations. The uniqueness of the invariant measures on periodic boxes and smooth bounded domains is further established when the noise forces sufficient modes, and the diffusivities of the species are large. Finally, in the case of two ionic species with equal diffusivities and valences of $1$ and $-1$, we study the rate of convergence of the Markov transition kernels to the invariant measure and obtain unconditional, unique exponential ergodicity for the model. △ Less

Submitted 31 October, 2023; originally announced October 2023.

Comments: 48 pages

Deep Reinforcement Learning for Infinite Horizon Mean Field Problems in Continuous Spaces

Authors: Andrea Angiuli, Jean-Pierre Fouque, Ruimeng Hu, Alan Raydan

Abstract: We present the development and analysis of a reinforcement learning (RL) algorithm designed to solve continuous-space mean field game (MFG) and mean field control (MFC) problems in a unified manner. The proposed approach pairs the actor-critic (AC) paradigm with a representation of the mean field distribution via a parameterized score function, which can be efficiently updated in an online fashion… ▽ More We present the development and analysis of a reinforcement learning (RL) algorithm designed to solve continuous-space mean field game (MFG) and mean field control (MFC) problems in a unified manner. The proposed approach pairs the actor-critic (AC) paradigm with a representation of the mean field distribution via a parameterized score function, which can be efficiently updated in an online fashion, and uses Langevin dynamics to obtain samples from the resulting distribution. The AC agent and the score function are updated iteratively to converge, either to the MFG equilibrium or the MFC optimum for a given mean field problem, depending on the choice of learning rates. A straightforward modification of the algorithm allows us to solve mixed mean field control games (MFCGs). The performance of our algorithm is evaluated using linear-quadratic benchmarks in the asymptotic infinite horizon framework. △ Less

Submitted 2 May, 2024; v1 submitted 19 September, 2023; originally announced September 2023.

Comments: Revisions made in accordance with reviewer's wishes. The revision primarily includes a detailed statement of our contribution, a justification of our multiscale approach, further explanations of our RL problem setup, numerical experiments, and relevant references in response to reviewers' comments. 29 pages; 9 figures

Anisotropic Viscosities Estimation for the Stochastic Primitive Equations

Authors: Igor Cialenco, Ruimeng Hu, Quyuan Lin

Abstract: The viscosity parameters plays a fundamental role in applications involving stochastic primitive equations (SPE), such as accurate weather predictions, climate modeling, and ocean current simulations. In this paper, we develop several novel estimators for the anisotropic viscosities in the SPE, using finite number of Fourier modes of a single sample path observed within a finite time interval. The… ▽ More The viscosity parameters plays a fundamental role in applications involving stochastic primitive equations (SPE), such as accurate weather predictions, climate modeling, and ocean current simulations. In this paper, we develop several novel estimators for the anisotropic viscosities in the SPE, using finite number of Fourier modes of a single sample path observed within a finite time interval. The focus is on analyzing the consistency and asymptotic normality of these estimators. We consider a torus domain and treat strong, pathwise solutions in the presence of additive white noise (in time). Notably, the analysis for estimating horizontal and vertical viscosities differs due to the unique structure of the SPE, as well as the fact that both parameters of interest are next to the highest order derivative. To the best of our knowledge, this is the first work addressing the estimation of anisotropic viscosities, with potential applicability of the methodology to other modeling. △ Less

Submitted 13 September, 2023; originally announced September 2023.

Branched Covering and Profinite Completion

Authors: Runjie Hu

Abstract: Artin-Mazur established the étale homotopy theory of schemes and proved the generalized Riemann existence theorem, i.e., all étale morphisms of a complex finite type scheme induce its profinite completion. We generalize it to piecewise linear pseudomanifolds and prove that all branched coverings of a pseudomanifold induce its profinite completion. Artin-Mazur established the étale homotopy theory of schemes and proved the generalized Riemann existence theorem, i.e., all étale morphisms of a complex finite type scheme induce its profinite completion. We generalize it to piecewise linear pseudomanifolds and prove that all branched coverings of a pseudomanifold induce its profinite completion. △ Less

Submitted 11 September, 2023; originally announced September 2023.

Galois Symmetry of Topological Manifolds

Authors: Runjie Hu

Abstract: In 1970 Nice ICM report, Sullivan defined simply connected $p$-adic formal manifolds and an abelianized Galois action on them, for $p$ odd. He also had a suggestion for $p=2$. The Galois action $Gal(\overline{\mathbb{Q}}/\mathbb{Q})$ on a variety over $\overline{\mathbb{Q}}$ does not change its étale homotopy type by Artin-Mazur. There is also a claim in Sullivan's 1970s MIT notes that the Galois… ▽ More In 1970 Nice ICM report, Sullivan defined simply connected $p$-adic formal manifolds and an abelianized Galois action on them, for $p$ odd. He also had a suggestion for $p=2$. The Galois action $Gal(\overline{\mathbb{Q}}/\mathbb{Q})$ on a variety over $\overline{\mathbb{Q}}$ does not change its étale homotopy type by Artin-Mazur. There is also a claim in Sullivan's 1970s MIT notes that the Galois action on the elements reprensented by varieties of the `structure set' on an étale homotopy type passes through the abelianized Galois action. We define simply connected $p$-adic formal manifolds and the abelianized Galois action on them, for both $p$ odd and $p=2$. Then we formulate the $p$-adic structure set on a $p$-adic formal manifold and define an abelianized Galois action on these structure sets. We prove that the Galois action on smooth projective varieties over $\overline{\mathbb{Q}}$ is equivalent to the abelianized Galois action on the $p$-adic structure sets. △ Less

Submitted 11 September, 2023; originally announced September 2023.

Characteristic Classes of $L$-theory

Authors: Runjie Hu

Abstract: We construct $2$-local characteristic classes and odd-local $KO$-theory characteristic classes of presheaves of Ranicki-Weiss's symmetric, quadratic or normal chains. As a result, we determine the homotopy type of the $L$-theory spaces, which was also proven by Taylor-Williams. We also establish (1) the equivalence between the classes of the surgery space at prime $2$ constructed by Sullivan, Rour… ▽ More We construct $2$-local characteristic classes and odd-local $KO$-theory characteristic classes of presheaves of Ranicki-Weiss's symmetric, quadratic or normal chains. As a result, we determine the homotopy type of the $L$-theory spaces, which was also proven by Taylor-Williams. We also establish (1) the equivalence between the classes of the surgery space at prime $2$ constructed by Sullivan, Rourke-Sullivan, Morgan-Sullivan, Madsen-Milgram, and the chain-level description by Ranicki; (2) the equivalence between the theory of $TOP$ bundles or spherical fibrations at odd primes by Sullivan and at prime $2$ by Brumfiel-Morgan, Morgan-Sullivan, and the theory of $L$-orientations by Levitt-Ranicki . △ Less

Submitted 10 September, 2023; originally announced September 2023.

Stochastic Delay Differential Games: Financial Modeling and Machine Learning Algorithms

Authors: Robert Balkin, Hector D. Ceniceros, Ruimeng Hu

Abstract: In this paper, we propose a numerical methodology for finding the closed-loop Nash equilibrium of stochastic delay differential games through deep learning. These games are prevalent in finance and economics where multi-agent interaction and delayed effects are often desired features in a model, but are introduced at the expense of increased dimensionality of the problem. This increased dimensiona… ▽ More In this paper, we propose a numerical methodology for finding the closed-loop Nash equilibrium of stochastic delay differential games through deep learning. These games are prevalent in finance and economics where multi-agent interaction and delayed effects are often desired features in a model, but are introduced at the expense of increased dimensionality of the problem. This increased dimensionality is especially significant as that arising from the number of players is coupled with the potential infinite dimensionality caused by the delay. Our approach involves parameterizing the controls of each player using distinct recurrent neural networks. These recurrent neural network-based controls are then trained using a modified version of Brown's fictitious play, incorporating deep learning techniques. To evaluate the effectiveness of our methodology, we test it on finance-related problems with known solutions. Furthermore, we also develop new problems and derive their analytical Nash equilibrium solutions, which serve as additional benchmarks for assessing the performance of our proposed deep learning approach. △ Less

Submitted 12 July, 2023; originally announced July 2023.

Comments: 29 pages, 8 figures

Tikhonov regularized second-order plus first-order primal-dual dynamical systems with asymptotically vanishing dam** for linear equality constrained convex optimization problems

Authors: Ting Ting Zhu, Rong Hu, Ya ** Fang

Abstract: In this paper, in the setting of Hilbert spaces, we consider a Tikhonov regularized second-order plus first-order primal-dual dynamical system with asymptotically vanishing dam** for a linear equality constrained convex optimization problem. The convergence properties of the proposed dynamical system depend heavily upon the choice of the Tikhonov regularization parameter. When the Tikhonov regul… ▽ More In this paper, in the setting of Hilbert spaces, we consider a Tikhonov regularized second-order plus first-order primal-dual dynamical system with asymptotically vanishing dam** for a linear equality constrained convex optimization problem. The convergence properties of the proposed dynamical system depend heavily upon the choice of the Tikhonov regularization parameter. When the Tikhonov regularization parameter decreases rapidly to zero, we establish the fast convergence rates of the primal-dual gap, the objective function error, the feasibility measure, and the gradient norm of the objective function along the trajectory generated by the system. When the Tikhonov regularization parameter tends slowly to zero, we prove that the primal trajectory of the Tikhonov regularized dynamical system converges strongly to the minimal norm solution of the linear equality constrained convex optimization problem. Numerical experiments are performed to illustrate the efficiency of our approach. △ Less

Submitted 21 April, 2024; v1 submitted 7 July, 2023; originally announced July 2023.

A second order dynamical system method for solving a maximal comonotone inclusion problem

Authors: Zengzhen Tan, Rong Hu, Ya** Fang

Abstract: In this paper a second order dynamical system model is proposed for computing a zero of a maximal comonotone operator in Hilbert spaces. Under mild conditions, we prove existence and uniqueness of a strong global solution of the proposed dynamical system. A proper tuning of the parameters can allow us to establish fast convergence properties of the trajectories generated by the dynamical system. T… ▽ More In this paper a second order dynamical system model is proposed for computing a zero of a maximal comonotone operator in Hilbert spaces. Under mild conditions, we prove existence and uniqueness of a strong global solution of the proposed dynamical system. A proper tuning of the parameters can allow us to establish fast convergence properties of the trajectories generated by the dynamical system. The weak convergence of the trajectory to a zero of the maximal comonotone operator is also proved. Furthermore, a discrete version of the dynamical system is considered and convergence properties matching to that of the dynamical system are established under a same framework. Finally, the validity of the proposed dynamical system and its discrete version is demonstrated by two numerical examples. △ Less

Submitted 7 July, 2023; originally announced July 2023.

Directed Chain Generative Adversarial Networks

Authors: Ming Min, Ruimeng Hu, Tomoyuki Ichiba

Abstract: Real-world data can be multimodal distributed, e.g., data describing the opinion divergence in a community, the interspike interval distribution of neurons, and the oscillators natural frequencies. Generating multimodal distributed real-world data has become a challenge to existing generative adversarial networks (GANs). For example, neural stochastic differential equations (Neural SDEs), treated… ▽ More Real-world data can be multimodal distributed, e.g., data describing the opinion divergence in a community, the interspike interval distribution of neurons, and the oscillators natural frequencies. Generating multimodal distributed real-world data has become a challenge to existing generative adversarial networks (GANs). For example, neural stochastic differential equations (Neural SDEs), treated as infinite-dimensional GANs, have demonstrated successful performance mainly in generating unimodal time series data. In this paper, we propose a novel time series generator, named directed chain GANs (DC-GANs), which inserts a time series dataset (called a neighborhood process of the directed chain or input) into the drift and diffusion coefficients of the directed chain SDEs with distributional constraints. DC-GANs can generate new time series of the same distribution as the neighborhood process, and the neighborhood process will provide the key step in learning and generating multimodal distributed time series. The proposed DC-GANs are examined on four datasets, including two stochastic models from social sciences and computational neuroscience, and two real-world datasets on stock prices and energy consumption. To our best knowledge, DC-GANs are the first work that can generate multimodal time series data and consistently outperforms state-of-the-art benchmarks with respect to measures of distribution, data similarity, and predictive ability. △ Less

Submitted 4 May, 2023; v1 submitted 25 April, 2023; originally announced April 2023.

Comments: Publish at ICML 2023

Recent Developments in Machine Learning Methods for Stochastic Control and Games

Authors: Ruimeng Hu, Mathieu Laurière

Abstract: Stochastic optimal control and games have a wide range of applications, from finance and economics to social sciences, robotics, and energy management. Many real-world applications involve complex models that have driven the development of sophisticated numerical methods. Recently, computational methods based on machine learning have been developed for solving stochastic control problems and games… ▽ More Stochastic optimal control and games have a wide range of applications, from finance and economics to social sciences, robotics, and energy management. Many real-world applications involve complex models that have driven the development of sophisticated numerical methods. Recently, computational methods based on machine learning have been developed for solving stochastic control problems and games. In this review, we focus on deep learning methods that have unlocked the possibility of solving such problems, even in high dimensions or when the structure is very complex, beyond what traditional numerical methods can achieve. We consider mostly the continuous time and continuous space setting. Many of the new approaches build on recent neural-network-based methods for solving high-dimensional partial differential equations or backward stochastic differential equations, or on model-free reinforcement learning for Markov decision processes that have led to breakthrough results. This paper provides an introduction to these methods and summarizes the state-of-the-art works at the crossroad of machine learning and stochastic control and games. △ Less

Submitted 11 March, 2024; v1 submitted 17 March, 2023; originally announced March 2023.

Pathwise Solutions for Stochastic Hydrostatic Euler Equations and Hydrostatic Navier-Stokes Equations Under the Local Rayleigh Condition

Authors: Ruimeng Hu, Quyuan Lin

Abstract: Stochastic factors are not negligible in applications of hydrostatic Euler equations (EE) and hydrostatic Navier-Stokes equations (NSE). Compared with the deterministic cases for which the ill-posedness of these models in the Sobolev spaces can be overcome by imposing the local Rayleigh condition on the initial data, the studies on the well-posedness of stochastic models are still limited. In this… ▽ More Stochastic factors are not negligible in applications of hydrostatic Euler equations (EE) and hydrostatic Navier-Stokes equations (NSE). Compared with the deterministic cases for which the ill-posedness of these models in the Sobolev spaces can be overcome by imposing the local Rayleigh condition on the initial data, the studies on the well-posedness of stochastic models are still limited. In this paper, we consider the initial data to be a random variable in a certain Sobolev space and satisfy the local Rayleigh condition. We establish the local in time existence and uniqueness of maximal pathwise solutions to the stochastic hydrostatic EE and hydrostatic NSE with multiplicative noise. Compared with previous results on these models (e.g., the existence of martingale solutions in the analytic spaces), our work gives the first result about the existence and uniqueness of solutions to these models in Sobolev spaces, and presents the first result showing the existence of pathwise solutions. △ Less

Submitted 18 January, 2023; originally announced January 2023.

Comments: 54 pages, 1 figure

Lagrangian reduction and wave mean flow interaction

Authors: Darryl D. Holm, Ruiao Hu, Oliver D. Street

Abstract: How does one derive models of dynamical feedback effects in multiscale, multiphysics systems such as wave mean flow interaction (WMFI)? We shall address this question for hybrid dynamical systems, whose motion can be expressed as the composition of two or more Lie-group actions. Hybrid systems abound in fluid dynamics. Examples include: the dynamics of complex fluids such as liquid crystals; wind-… ▽ More How does one derive models of dynamical feedback effects in multiscale, multiphysics systems such as wave mean flow interaction (WMFI)? We shall address this question for hybrid dynamical systems, whose motion can be expressed as the composition of two or more Lie-group actions. Hybrid systems abound in fluid dynamics. Examples include: the dynamics of complex fluids such as liquid crystals; wind-driven waves propagating with the currents moving on the sea surface; turbulence modelling in fluids and plasmas; and classical-quantum hydrodynamic models in molecular chemistry. From among these examples, the motivating question in this paper is: How do wind-driven waves produce ocean surface currents? The paper first summarises the geometric mechanics approach for deriving hybrid models of multiscale, multiphysics motions in ideal fluid dynamics. It then illustrates this approach for WMFI in the examples of 3D WKB waves and 2D wave amplitudes governed by the nonlinear Schrödinger (NLS) equation propagating in the frame of motion of an ideal incompressible inhomogeneous Euler fluid flow. The results for these examples tell us that the fluid flow in WMFI does not create waves. However, feedback in the opposite direction is possible, since 3D WKB and 2D NLS wave dynamics can indeed create circulatory fluid flow. △ Less

Submitted 27 April, 2023; v1 submitted 12 December, 2022; originally announced January 2023.

Comments: 2nd version, 32 pages, 3 figures, comments welcome by email

Convergence of the Backward Deep BSDE Method with Applications to Optimal Stop** Problems

Authors: Chengfan Gao, Si** Gao, Ruimeng Hu, Zimu Zhu

Abstract: The optimal stop** problem is one of the core problems in financial markets, with broad applications such as pricing American and Bermudan options. The deep BSDE method [Han, Jentzen and E, PNAS, 115(34):8505-8510, 2018] has shown great power in solving high-dimensional forward-backward stochastic differential equations (FBSDEs), and inspired many applications. However, the method solves backwar… ▽ More The optimal stop** problem is one of the core problems in financial markets, with broad applications such as pricing American and Bermudan options. The deep BSDE method [Han, Jentzen and E, PNAS, 115(34):8505-8510, 2018] has shown great power in solving high-dimensional forward-backward stochastic differential equations (FBSDEs), and inspired many applications. However, the method solves backward stochastic differential equations (BSDEs) in a forward manner, which can not be used for optimal stop** problems that in general require running BSDE backwardly. To overcome this difficulty, a recent paper [Wang, Chen, Sudjianto, Liu and Shen, ar** problem. In this paper, we provide the rigorous theory for the backward deep BSDE method. Specifically, 1. We derive the a posteriori error estimation, i.e., the error of the numerical solution can be bounded by the training loss function; and; 2. We give an upper bound of the loss function, which can be sufficiently small subject to universal approximations. We give two numerical examples, which present consistent performance with the proved theory. △ Less

Submitted 23 August, 2023; v1 submitted 8 October, 2022; originally announced October 2022.

MSC Class: 60G40; 60H35; 65C30

Journal ref: SIAM Journal on Financial Mathematics (2023)

Higher-Order error estimates for physics-informed neural networks approximating the primitive equations

Authors: Ruimeng Hu, Quyuan Lin, Alan Raydan, Sui Tang

Abstract: Large-scale dynamics of the oceans and the atmosphere are governed by primitive equations (PEs). Due to the nonlinearity and nonlocality, the numerical study of the PEs is generally challenging. Neural networks have been shown to be a promising machine learning tool to tackle this challenge. In this work, we employ physics-informed neural networks (PINNs) to approximate the solutions to the PEs an… ▽ More Large-scale dynamics of the oceans and the atmosphere are governed by primitive equations (PEs). Due to the nonlinearity and nonlocality, the numerical study of the PEs is generally challenging. Neural networks have been shown to be a promising machine learning tool to tackle this challenge. In this work, we employ physics-informed neural networks (PINNs) to approximate the solutions to the PEs and study the error estimates. We first establish the higher-order regularity for the global solutions to the PEs with either full viscosity and diffusivity, or with only the horizontal ones. Such a result for the case with only the horizontal ones is new and required in the analysis under the PINNs framework. Then we prove the existence of two-layer tanh PINNs of which the corresponding training error can be arbitrarily small by taking the width of PINNs to be sufficiently wide, and the error between the true solution and its approximation can be arbitrarily small provided that the training error is small enough and the sample set is large enough. In particular, all the estimates are a priori, and our analysis includes higher-order (in spatial Sobolev norm) error estimates. Numerical results on prototype systems are presented to further illustrate the advantage of using the $H^s$ norm during the training. △ Less

Submitted 17 March, 2023; v1 submitted 24 September, 2022; originally announced September 2022.

Comments: 30 pages

Global well-posedness of the 1d compressible Navier-Stokes system with rough data

Authors: Ke Chen, Ly Kim Ha, Ruilin Hu, Quoc-Hung Nguyen

Abstract: In this paper, we study the global well-posedness problem for the 1d compressible Navier-Stokers system (cNSE) in gas dynamics with rough initial data. Frist, Liu- Yu (2022) established the global well-posedness theory for the 1d isentropic cNSE with initial velocity data in BV space. Then, it was extended to the 1d cNSE for the polytropic ideal gas with initial velocity and temperature data in BV… ▽ More In this paper, we study the global well-posedness problem for the 1d compressible Navier-Stokers system (cNSE) in gas dynamics with rough initial data. Frist, Liu- Yu (2022) established the global well-posedness theory for the 1d isentropic cNSE with initial velocity data in BV space. Then, it was extended to the 1d cNSE for the polytropic ideal gas with initial velocity and temperature data in BV space by Wang-Yu-Zhang (2022). We improve the global well-posedness result of Liu-Yu with initial velocity data in $W^{2γ,1}$ space; and of Wang-Yu-Zhang with initial velocity data in $ L^2\cap W^{2γ,1}$ space and initial data of temperature in $\dot W^{-\frac{2}{3},\frac{6}{5}}\cap \dot W^{2γ-1,1}$ for any $γ>0$ \textit{arbitrary small}. Our essential ideas are based on establishing various "end-point" smoothing estimates for the 1d parabolic equation. △ Less

Submitted 8 September, 2022; originally announced September 2022.

Pandemic Control, Game Theory and Machine Learning

Authors: Yao Xuan, Robert Balkin, Jiequn Han, Ruimeng Hu, Hector D. Ceniceros

Abstract: Game theory has been an effective tool in the control of disease spread and in suggesting optimal policies at both individual and area levels. In this AMS Notices article, we focus on the decision-making development for the intervention of COVID-19, aiming to provide mathematical models and efficient machine learning methods, and justifications for related policies that have been implemented in th… ▽ More Game theory has been an effective tool in the control of disease spread and in suggesting optimal policies at both individual and area levels. In this AMS Notices article, we focus on the decision-making development for the intervention of COVID-19, aiming to provide mathematical models and efficient machine learning methods, and justifications for related policies that have been implemented in the past and explain how the authorities' decisions affect their neighboring regions from a game theory viewpoint. △ Less

Submitted 18 August, 2022; originally announced August 2022.

Local well-posedness of the $1d$ compressible Navier-Stokes system with rough data

Authors: Ke Chen, Ruilin Hu, Quoc-Hung Nguyen

Abstract: This paper presents a new approach to the local well-posedness of the $1d$ compressible Navier-Stokes systems with rough initial data. Our approach is based on establishing some smoothing and Lipschitz-type estimates for the $1d$ parabolic equation with piecewise continuous coefficients. This paper presents a new approach to the local well-posedness of the $1d$ compressible Navier-Stokes systems with rough initial data. Our approach is based on establishing some smoothing and Lipschitz-type estimates for the $1d$ parabolic equation with piecewise continuous coefficients. △ Less

Submitted 28 June, 2022; originally announced June 2022.

Comments: 37 pages

Learning High-Dimensional McKean-Vlasov Forward-Backward Stochastic Differential Equations with General Distribution Dependence

Authors: Jiequn Han, Ruimeng Hu, Jihao Long

Abstract: One of the core problems in mean-field control and mean-field games is to solve the corresponding McKean-Vlasov forward-backward stochastic differential equations (MV-FBSDEs). Most existing methods are tailored to special cases in which the mean-field interaction only depends on expectation or other moments and thus inadequate to solve problems when the mean-field interaction has full distribution… ▽ More One of the core problems in mean-field control and mean-field games is to solve the corresponding McKean-Vlasov forward-backward stochastic differential equations (MV-FBSDEs). Most existing methods are tailored to special cases in which the mean-field interaction only depends on expectation or other moments and thus inadequate to solve problems when the mean-field interaction has full distribution dependence. In this paper, we propose a novel deep learning method for computing MV-FBSDEs with a general form of mean-field interactions. Specifically, built on fictitious play, we recast the problem into repeatedly solving standard FBSDEs with explicit coefficient functions. These coefficient functions are used to approximate the MV-FBSDEs' model coefficients with full distribution dependence, and are updated by solving another supervising learning problem using training data simulated from the last iteration's FBSDE solutions. We use deep neural networks to solve standard BSDEs and approximate coefficient functions in order to solve high-dimensional MV-FBSDEs. Under proper assumptions on the learned functions, we prove that the convergence of the proposed method is free of the curse of dimensionality (CoD) by using a class of integral probability metrics previously developed in [Han, Hu and Long, arXiv:2104.12036]. The proved theorem shows the advantage of the method in high dimensions. We present the numerical performance in high-dimensional MV-FBSDE problems, including a mean-field game example of the well-known Cucker-Smale model whose cost depends on the full distribution of the forward process. △ Less

Submitted 18 September, 2023; v1 submitted 25 April, 2022; originally announced April 2022.

MSC Class: 65C30; 68T07; 49N80; 68Q25

SA-HMTS: A Secure and Adaptive Hierarchical Multi-timescale Framework for Resilient Load Restoration Using A Community Microgrid

Authors: Ashwin Shirsat, Valliappan Muthukaruppan, Rongxing Hu, Victor Paduani, Bei Xu, Lidong Song, Yiyan Li, Ning Lu, Mesut Baran, David Lubkeman, Wenyuan Tang

Abstract: Distribution system integrated community microgrids (CMGs) can partake in restoring loads during extended duration outages. At such times, the CMG is challenged with limited resource availability, absence of robust grid support, and heightened demand-supply uncertainty. This paper proposes a secure and adaptive three-stage hierarchical multi-timescale framework for scheduling and real-time (RT) di… ▽ More Distribution system integrated community microgrids (CMGs) can partake in restoring loads during extended duration outages. At such times, the CMG is challenged with limited resource availability, absence of robust grid support, and heightened demand-supply uncertainty. This paper proposes a secure and adaptive three-stage hierarchical multi-timescale framework for scheduling and real-time (RT) dispatch of CMGs with hybrid PV systems to address these challenges. The framework enables the CMG to dynamically expand its boundary to support the neighboring grid sections and is adaptive to the changing forecast error impacts. The first stage solves a stochastic extended duration scheduling (EDS) problem to obtain referral plans for optimal resource rationing. The intermediate near-real-time (NRT) scheduling stage updates the EDS schedule closer to the dispatch time using newly obtained forecasts, followed by the RT dispatch stage. To make the dispatch decisions more secure and robust against forecast errors, a novel concept called delayed recourse is proposed. The methodology is evaluated via numerical simulations on a modified IEEE 123-bus system and validated using OpenDSS/hardware-in-loop simulations. The results show superior performance in maximizing load supply and continuous secure CMG operation under numerous operating scenarios. △ Less

Submitted 10 February, 2022; originally announced February 2022.

Giga-scale Kernel Matrix Vector Multiplication on GPU

Authors: Robert Hu, Siu Lun Chau, Dino Sejdinovic, Joan Alexis Glaunès

Abstract: Kernel matrix-vector multiplication (KMVM) is a foundational operation in machine learning and scientific computing. However, as KMVM tends to scale quadratically in both memory and time, applications are often limited by these computational constraints. In this paper, we propose a novel approximation procedure coined \textit{Faster-Fast and Free Memory Method} ($\fthreem$) to address these scalin… ▽ More Kernel matrix-vector multiplication (KMVM) is a foundational operation in machine learning and scientific computing. However, as KMVM tends to scale quadratically in both memory and time, applications are often limited by these computational constraints. In this paper, we propose a novel approximation procedure coined \textit{Faster-Fast and Free Memory Method} ($\fthreem$) to address these scaling issues of KMVM for tall~($10^8\sim 10^9$) and skinny~($D\leq7$) data. Extensive experiments demonstrate that $\fthreem$ has empirical \emph{linear time and memory} complexity with a relative error of order $10^{-3}$ and can compute a full KMVM for a billion points \emph{in under a minute} on a high-end GPU, leading to a significant speed-up in comparison to existing CPU methods. We demonstrate the utility of our procedure by applying it as a drop-in for the state-of-the-art GPU-based linear solver FALKON, \emph{improving speed 1.5-5.5 times} at the cost of $<1\%$ drop in accuracy. We further demonstrate competitive results on \emph{Gaussian Process regression} coupled with significant speedups on a variety of real-world datasets. △ Less

Submitted 12 October, 2022; v1 submitted 2 February, 2022; originally announced February 2022.

Translation of Mathieu's On the five-fold transitive function of 24 quantities

Authors: Yiming Bing, Bright Hu, Ronni Hu, Rhianna Kho, Max Lau, Rhianna Li, Stefan Lu, Finn Mcdonald, Michael Sun, Gavin Trann, Nicholas Wolfe, Joshua Yao, Leon Zhou, Nathan Zhou

Abstract: We translated the paper 'On the five-fold transitive function of 24 quantities' by Émile Mathieu into English. This was done to aid our project on expressing $M_{23}$ as additive functions on the finite field of $2_{11}$ elements. We translated the paper 'On the five-fold transitive function of 24 quantities' by Émile Mathieu into English. This was done to aid our project on expressing $M_{23}$ as additive functions on the finite field of $2_{11}$ elements. △ Less

Submitted 21 January, 2022; originally announced January 2022.

Comments: We translated the paper 'On the five-fold transitive function of 24 quantities' by Émile Mathieu into English. This was done to aid our project on expressing $M_{23}$ as additive functions on the finite field of $2_{11}$ elements

Local Martingale Solutions and Pathwise Uniqueness for the Three-dimensional Stochastic Inviscid Primitive Equations

Authors: Ruimeng Hu, Quyuan Lin

Abstract: We study the stochastic effect on the three-dimensional inviscid primitive equations (PEs, also called the hydrostatic Euler equations). Specifically, we consider a larger class of noises than multiplicative noises, and work in the analytic function space due to the ill-posedness in Sobolev spaces of PEs without horizontal viscosity. Under proper conditions, we prove the local existence of marting… ▽ More We study the stochastic effect on the three-dimensional inviscid primitive equations (PEs, also called the hydrostatic Euler equations). Specifically, we consider a larger class of noises than multiplicative noises, and work in the analytic function space due to the ill-posedness in Sobolev spaces of PEs without horizontal viscosity. Under proper conditions, we prove the local existence of martingale solutions and pathwise uniqueness. By adding vertical viscosity, i.e., considering the hydrostatic Navier-Stokes equations, we can relax the restriction on initial conditions to be only analytic in the horizontal variables with Sobolev regularity in the vertical variable, and allow the transport noise in the vertical direction. We establish the local existence of martingale solutions and pathwise uniqueness, and show that the solutions become analytic in the vertical variable instantaneously as $t>0$ and the vertical analytic radius increases as long as the solutions exist. △ Less

Submitted 15 January, 2022; originally announced January 2022.

Comments: 34 pages

Fractional Besov Trace/Extension Type Inequalities via the Caffarelli-Silvestre extension

Authors: Pengtao Li, Rui Hu, Zhichun Zhai

Abstract: Let $u(\cdot,\cdot)$ be the Caffarelli-Silvestre extension of $f.$ The first goal of this article is to establish the fractional trace type inequalities involving the Caffarelli-Silvestre extension $u(\cdot,\cdot)$ of $f.$ In doing so, firstly, we establish the fractional Sobolev/ logarithmic Sobolev/ Hardy trace inequalities in terms of $\nabla_{(x,t)}u(x,t).$ Then, we prove the fractional anisot… ▽ More Let $u(\cdot,\cdot)$ be the Caffarelli-Silvestre extension of $f.$ The first goal of this article is to establish the fractional trace type inequalities involving the Caffarelli-Silvestre extension $u(\cdot,\cdot)$ of $f.$ In doing so, firstly, we establish the fractional Sobolev/ logarithmic Sobolev/ Hardy trace inequalities in terms of $\nabla_{(x,t)}u(x,t).$ Then, we prove the fractional anisotropic Sobolev/ logarithmic Sobolev/ Hardy trace inequalities in terms of $ {\partial_{t} u(x,t)}$ or $(-Δ)^{-γ/2}u(x,t)$ only. Moreover, based on an estimate of the Fourier transform of the Caffarelli-Silvestre extension kernel and the sharp affine weighted $L^p$ Sobolev inequality, we prove that the $\dot{H}^{-β/2}(\mathbb{R}^n)$ norm of $f(x)$ can be controlled by the product of the weighted $L^p-$affine energy and the weighted $L^p-$norm of ${\partial_{t} u(x,t)}.$ The second goal of this article is to characterize non-negative measures $μ$ on $\mathbb{R}^{n+1}_+$ such that the embeddings $$\|u(\cdot,\cdot)\|_{L^{q_0,p_0}_μ(\mathbb{R}^{n+1})}\lesssim \|f\|_{\dotΛ^{p,q}_β(\mathbb{R}^n)}$$ hold for some $p_0$ and $q_0$ depending on $p$ and $q$ which are classified in three different cases: (1). $p=q\in (n/(n+β),1];$ (2) $(p,q)\in (1,n/β)\times (1,\infty);$ (3). $(p,q)\in (1,n/β)\times\{\infty\}.$ For case (1), the embeddings can be characterized in terms of an analytic condition of the variational capacity minimizing function, the iso-capacitary inequality of open balls, and other weak type inequalities. For cases (2) and (3), the embeddings are characterized by the iso-capacitary inequality for fractonal Besov capacity of open sets. △ Less

Submitted 14 February, 2022; v1 submitted 3 January, 2022; originally announced January 2022.

Comments: The case of $p\geq 1$ is added

Strengthened Fractional Sobolev Type Inequalities in Besov Spaces

Authors: Pengtao Li, Rui Hu, Zhichun Zhai

Abstract: The purpose of this article is twofold. The first is to strengthen fractional Sobolev type inequalities in Besov spaces via the classical Lorentz space. In doing so, we show that the Sobolev inequality in Besov spaces is equivalent to the fractional Hardy inequality and the iso-capacitary type inequality. Secondly, we will strengthen fractional Sobolev type inequalities in Besov spaces via capacit… ▽ More The purpose of this article is twofold. The first is to strengthen fractional Sobolev type inequalities in Besov spaces via the classical Lorentz space. In doing so, we show that the Sobolev inequality in Besov spaces is equivalent to the fractional Hardy inequality and the iso-capacitary type inequality. Secondly, we will strengthen fractional Sobolev type inequalities in Besov spaces via capacitary Lorentz spaces associated with Besov capacities. For this purpose, we first study the embedding of the associated capacitary Lorentz space to the classical Lorentz space. Then, the embedding of the Besov space to the capacitary Lorentz space is established. Meanwhile, we show that these embeddings are closely related to the iso-capacitary type inequalities in terms of a new-introduced fractional $(β, p, q)$-perimeter. Moreover, characterizations of more general Sobolev type inequalities in Besov spaces have also been established. △ Less

Submitted 20 February, 2022; v1 submitted 3 January, 2022; originally announced January 2022.

Comments: 14 pages. Submitted. New results added

The Mathieu group $M_{23}$ as additive functions on the finite field of size ${2^{11}}$

Authors: Yiming Bing, Bright Hu, Ronni Hu, Rhianna Li, Stefan Lu, Finn McDonald, Michael Sun, Nicholas Wolfe, Joshua Yao, Leon Zhou, Nathan Zhou

Abstract: We explicitly extend the standard permutation action of the Mathieu group $M_{23}$ on a 23 element set $C=C_{23}$ contained in a finite field of $2^{11}$ elements $\mathbb{F}_{2^{11}}$ to additive functions on this finite field. That is we represent $M_{23}$ as functions $\varphi:\mathbb{F}_{2^{11}}\to \mathbb{F}_{2^{11}}$ such that $\varphi(x+y)=\varphi(x)+\varphi(y)$ and $\varphi|_{C}$ is the st… ▽ More We explicitly extend the standard permutation action of the Mathieu group $M_{23}$ on a 23 element set $C=C_{23}$ contained in a finite field of $2^{11}$ elements $\mathbb{F}_{2^{11}}$ to additive functions on this finite field. That is we represent $M_{23}$ as functions $\varphi:\mathbb{F}_{2^{11}}\to \mathbb{F}_{2^{11}}$ such that $\varphi(x+y)=\varphi(x)+\varphi(y)$ and $\varphi|_{C}$ is the standard permutation action. We give explicit $11\times 11$ matrices for the pair of standard generators of order $23$ and order $5$, as well as many tables to help facilitate future calculations. △ Less

Submitted 31 December, 2021; originally announced January 2022.

Comments: 15 pages

MSC Class: 20C34

Binary trees using the bookshelf and baseball constructions

Authors: Ruiyang Hu, Liang **long, Bradley Kaplan, Zhaonan Li, Serra Pelin, Michael Richard, Yicheng Tao, Max Weinstein, Kiyoshi Igusa

Abstract: This is a largely expository paper in which we discuss various sets having a Catalan number of objects and some well-known bijections between these sets presented in a new and hopefully interesting way. We call these concepts "bookshelf" and "baseball" constructions. No knowledge of these topics is assumed. These are the final student papers for a course at Brandeis University. This is a largely expository paper in which we discuss various sets having a Catalan number of objects and some well-known bijections between these sets presented in a new and hopefully interesting way. We call these concepts "bookshelf" and "baseball" constructions. No knowledge of these topics is assumed. These are the final student papers for a course at Brandeis University. △ Less

Submitted 14 December, 2021; originally announced December 2021.

Comments: 49 pages (several blank), 12 figures

MSC Class: 05C05: 16G20

Perturbed primal-dual dynamics with dam** and time scaling coefficients for affine constrained convex optimization problems

Authors: Xin He, Rong Hu, Ya-** Fang

Abstract: In Hilbert space, we propose a family of primal-dual dynamical system for affine constrained convex optimization problem. Several dam** coefficients, time scaling coefficients, and perturbation terms are thus considered. By constructing the energy functions, we investigate the convergence rates with different choices of the dam** coefficients and time scaling coefficients. Our results extend t… ▽ More In Hilbert space, we propose a family of primal-dual dynamical system for affine constrained convex optimization problem. Several dam** coefficients, time scaling coefficients, and perturbation terms are thus considered. By constructing the energy functions, we investigate the convergence rates with different choices of the dam** coefficients and time scaling coefficients. Our results extend the inertial dynamical approaches for unconstrained convex optimization problems to affine constrained convex optimization problems. △ Less

Submitted 25 June, 2021; originally announced June 2021.

Sub- and Super-solution Approach to Accuracy Analysis of Portfolio Optimization Asymptotics in Multiscale Stochastic Factor Market

Authors: Jean-Pierre Fouque, Ruimeng Hu, Ronnie Sircar

Abstract: The problem of portfolio optimization when stochastic factors drive returns and volatilities has been studied in previous works by the authors. In particular, they proposed asymptotic approximations for value functions and optimal strategies in the regime where these factors are running on both slow and fast timescales. However, the rigorous justification of the accuracy of these approximations ha… ▽ More The problem of portfolio optimization when stochastic factors drive returns and volatilities has been studied in previous works by the authors. In particular, they proposed asymptotic approximations for value functions and optimal strategies in the regime where these factors are running on both slow and fast timescales. However, the rigorous justification of the accuracy of these approximations has been limited to power utilities and a single factor. In this paper, we provide an accurate analysis for cases with general utility functions and two timescale factors by constructing sub- and super-solutions to the fully nonlinear problem so that their difference is at the desired level of accuracy. This approach will be valuable in various related stochastic control problems. △ Less

Submitted 13 October, 2021; v1 submitted 21 June, 2021; originally announced June 2021.

MSC Class: 91G10; 93E20; 60H30; 35C20

Signatured Deep Fictitious Play for Mean Field Games with Common Noise

Authors: Ming Min, Ruimeng Hu

Abstract: Existing deep learning methods for solving mean-field games (MFGs) with common noise fix the sampling common noise paths and then solve the corresponding MFGs. This leads to a nested-loop structure with millions of simulations of common noise paths in order to produce accurate solutions, which results in prohibitive computational cost and limits the applications to a large extent. In this paper, b… ▽ More Existing deep learning methods for solving mean-field games (MFGs) with common noise fix the sampling common noise paths and then solve the corresponding MFGs. This leads to a nested-loop structure with millions of simulations of common noise paths in order to produce accurate solutions, which results in prohibitive computational cost and limits the applications to a large extent. In this paper, based on the rough path theory, we propose a novel single-loop algorithm, named signatured deep fictitious play, by which we can work with the unfixed common noise setup to avoid the nested-loop structure and reduce the computational complexity significantly. The proposed algorithm can accurately capture the effect of common uncertainty changes on mean-field equilibria without further training of neural networks, as previously needed in the existing machine learning algorithms. The efficiency is supported by three applications, including linear-quadratic MFGs, mean-field portfolio game, and mean-field game of optimal consumption and investment. Overall, we provide a new point of view from the rough path theory to solve MFGs with common noise with significantly improved efficiency and an extensive range of applications. In addition, we report the first deep learning work to deal with extended MFGs (a mean-field interaction via both the states and controls) with common noise. △ Less

Submitted 6 June, 2021; originally announced June 2021.

Comments: Published at ICML 2021

$N$-player and Mean-field Games in Itô-diffusion Markets with Competitive or Homophilous Interaction

Authors: Ruimeng Hu, Thaleia Zariphopoulou

Abstract: In Itô-diffusion environments, we introduce and analyze $N$-player and common-noise mean-field games in the context of optimal portfolio choice in a common market. The players invest in a finite horizon and also interact, driven either by competition or homophily. We study an incomplete market model in which the players have constant individual risk tolerance coefficients (CARA utilities). We also… ▽ More In Itô-diffusion environments, we introduce and analyze $N$-player and common-noise mean-field games in the context of optimal portfolio choice in a common market. The players invest in a finite horizon and also interact, driven either by competition or homophily. We study an incomplete market model in which the players have constant individual risk tolerance coefficients (CARA utilities). We also consider the general case of random individual risk tolerances and analyze the related games in a complete market setting. This randomness makes the problem substantially more complex as it leads to ($N$ or a continuum of) auxiliary ''individual'' Itô-diffusion markets. For all cases, we derive explicit or closed-form solutions for the equilibrium stochastic processes, the optimal state processes, and the values of the games. △ Less

Submitted 14 June, 2021; v1 submitted 1 June, 2021; originally announced June 2021.

Efficient Solution Strategy for Chance-Constrained Optimal Power Flow based on FAST and Data-driven Convexification

Authors: Ren Hu, Qifeng Li

Abstract: The uncertainty of multiple power loads and renewable energy generations (PLREG) in power systems increases the complexity of power flow analysis for decision-makers. The chance-constrained method can be applied to model the optimization problems of power flow under uncertainty. This paper develops a novel solution approach for chance-constrained AC optimal power flow (CCACOPF) problem based on th… ▽ More The uncertainty of multiple power loads and renewable energy generations (PLREG) in power systems increases the complexity of power flow analysis for decision-makers. The chance-constrained method can be applied to model the optimization problems of power flow under uncertainty. This paper develops a novel solution approach for chance-constrained AC optimal power flow (CCACOPF) problem based on the data-driven convexification of power flow and a fast algorithm for scenario technique (FAST). This method is computationally effective for mainly two reasons. First, the original nonconvex AC power flow (ACPF) constraints are approximated by a set of learning-based quadratic convex ones. Second, FAST is an advanced scenario-based solution method (SSM) that doesn't rely on the pre-assumed probability distribution, using far less scenarios than the conventional SSM. Eventually, the CCACOPF is converted into a computationally tractable convex optimization problem. The simulation results on IEEE test cases indicate that 1) the proposed solution method can outperform the conventional SSM in computational efficiency, 2) the data-driven convexification of power flow is effective in approximating original complex AC power flow. △ Less

Submitted 11 November, 2021; v1 submitted 11 May, 2021; originally announced May 2021.

MSC Class: 49-02 ACM Class: I.2.6

A Class of Dimension-free Metrics for the Convergence of Empirical Measures

Authors: Jiequn Han, Ruimeng Hu, Jihao Long

Abstract: This paper concerns the convergence of empirical measures in high dimensions. We propose a new class of probability metrics and show that under such metrics, the convergence is free of the curse of dimensionality (CoD). Such a feature is critical for high-dimensional analysis and stands in contrast to classical metrics ({\it e.g.}, the Wasserstein metric). The proposed metrics fall into the catego… ▽ More This paper concerns the convergence of empirical measures in high dimensions. We propose a new class of probability metrics and show that under such metrics, the convergence is free of the curse of dimensionality (CoD). Such a feature is critical for high-dimensional analysis and stands in contrast to classical metrics ({\it e.g.}, the Wasserstein metric). The proposed metrics fall into the category of integral probability metrics, for which we specify criteria of test function spaces to guarantee the property of being free of CoD. Examples of the selected test function spaces include the reproducing kernel Hilbert spaces, Barron space, and flow-induced function spaces. Three applications of the proposed metrics are presented: 1. The convergence of empirical measure in the case of random variables; 2. The convergence of $n$-particle system to the solution to McKean-Vlasov stochastic differential equation; 3. The construction of an $\varepsilon$-Nash equilibrium for a homogeneous $n$-player game by its mean-field limit. As a byproduct, we prove that, given a distribution close to the target distribution measured by our metric and a certain representation of the target distribution, we can generate a distribution close to the target one in terms of the Wasserstein metric and relative entropy. Overall, we show that the proposed class of metrics is a powerful tool to analyze the convergence of empirical measures in high dimensions without CoD. △ Less

Submitted 16 September, 2023; v1 submitted 24 April, 2021; originally announced April 2021.

MSC Class: 60B10; 60E15; 60K35; 91A16; 60H10

Inertial primal-dual methods for linear equality constrained convex optimization problems

Authors: Xin He, Rong Hu, Ya-** Fang

Abstract: In this paper, we propose an inertial accelerated primal-dual method for the linear equality constrained convex optimization problem. When the objective function has a ``nonsmooth + smooth'' composite structure, we further propose an inexact inertial primal-dual method by linearizing the smooth individual function and solving the subproblem inexactly. Assuming merely convexity, we prove that the p… ▽ More In this paper, we propose an inertial accelerated primal-dual method for the linear equality constrained convex optimization problem. When the objective function has a ``nonsmooth + smooth'' composite structure, we further propose an inexact inertial primal-dual method by linearizing the smooth individual function and solving the subproblem inexactly. Assuming merely convexity, we prove that the proposed methods enjoy $\mathcal{O}(1/k^2)$ convergence rate on the objective residual and the feasibility violation in the primal model. Numerical results are reported to demonstrate the validity of the proposed methods. △ Less

Submitted 29 June, 2021; v1 submitted 23 March, 2021; originally announced March 2021.

"Second-Order Primal'' + "First-Order Dual'' Dynamical Systems with Time Scaling for Linear Equality Constrained Convex Optimization Problems

Authors: Xin He, Rong Hu, Ya-** Fang

Abstract: Second-order dynamical systems are important tools for solving optimization problems, and most of existing works in this field have focused on unconstrained optimization problems. In this paper, we propose an inertial primal-dual dynamical system with constant viscous dam** and time scaling for the linear equality constrained convex optimization problem, which consists of a second-order ODE for… ▽ More Second-order dynamical systems are important tools for solving optimization problems, and most of existing works in this field have focused on unconstrained optimization problems. In this paper, we propose an inertial primal-dual dynamical system with constant viscous dam** and time scaling for the linear equality constrained convex optimization problem, which consists of a second-order ODE for the primal variable and a first-order ODE for the dual variable. When the scaling satisfies certain conditions, we prove its convergence property without assuming strong convexity. Even the convergence rate can become exponential when the scaling grows exponentially. We also show that the obtained convergence property of the dynamical system is preserved under a small perturbation. △ Less

Submitted 20 May, 2022; v1 submitted 23 March, 2021; originally announced March 2021.

Fast primal-dual algorithm via dynamical system for a linearly constrained convex optimization problem

Authors: Xin He, Rong Hu, Ya-** Fang

Abstract: By time discretization of a second-order primal-dual dynamical system with dam** $α/t$ where an inertial construction in the sense of Nesterov is needed only for the primal variable, we propose a fast primal-dual algorithm for a linear equality constrained convex optimization problem. Under a suitable scaling condition, we show that the proposed algorithm enjoys a fast convergence rate for the o… ▽ More By time discretization of a second-order primal-dual dynamical system with dam** $α/t$ where an inertial construction in the sense of Nesterov is needed only for the primal variable, we propose a fast primal-dual algorithm for a linear equality constrained convex optimization problem. Under a suitable scaling condition, we show that the proposed algorithm enjoys a fast convergence rate for the objective residual and the feasibility violation, and the decay rate can reach $\mathcal{O}(1/k^{α-1})$ at the most. We also study convergence properties of the corresponding primal-dual dynamical system to better understand the acceleration scheme. Finally, we report numerical experiments to demonstrate the effectiveness of the proposed algorithm. △ Less

Submitted 3 June, 2022; v1 submitted 18 March, 2021; originally announced March 2021.

Solvability of a Regular Polynomial Vector Optimization Problem without Convexity

Authors: Danyang Liu, Rong Hu, Ya** Fang

Abstract: In this paper we consider the solvability of a non-convex regular polynomial vector optimization problem on a nonempty closed set. We introduce regularity conditions for the polynomial vector optimization problem and study properties and characterizations of the regularity conditions. Under the regularity conditions, we study nonemptiness and boundedness of the solution sets of the problem. As a c… ▽ More In this paper we consider the solvability of a non-convex regular polynomial vector optimization problem on a nonempty closed set. We introduce regularity conditions for the polynomial vector optimization problem and study properties and characterizations of the regularity conditions. Under the regularity conditions, we study nonemptiness and boundedness of the solution sets of the problem. As a consequence, we establish two Frank-Wolfe type theorems for the non-convex polynomial vector optimization problem. Finally, we investigate the solution stability of the non-convex regular polynomial vector optimization problem. △ Less

Submitted 11 January, 2021; originally announced January 2021.

Recurrent Neural Networks for Stochastic Control Problems with Delay

Authors: Jiequn Han, Ruimeng Hu

Abstract: Stochastic control problems with delay are challenging due to the path-dependent feature of the system and thus its intrinsic high dimensions. In this paper, we propose and systematically study deep neural networks-based algorithms to solve stochastic control problems with delay features. Specifically, we employ neural networks for sequence modeling (\emph{e.g.}, recurrent neural networks such as… ▽ More Stochastic control problems with delay are challenging due to the path-dependent feature of the system and thus its intrinsic high dimensions. In this paper, we propose and systematically study deep neural networks-based algorithms to solve stochastic control problems with delay features. Specifically, we employ neural networks for sequence modeling (\emph{e.g.}, recurrent neural networks such as long short-term memory) to parameterize the policy and optimize the objective function. The proposed algorithms are tested on three benchmark examples: a linear-quadratic problem, optimal consumption with fixed finite delay, and portfolio optimization with complete memory. Particularly, we notice that the architecture of recurrent neural networks naturally captures the path-dependent feature with much flexibility and yields better performance with more efficient and stable training of the network compared to feedforward networks. The superiority is even evident in the case of portfolio optimization with complete memory, which features infinite delay. △ Less

Submitted 16 June, 2021; v1 submitted 5 January, 2021; originally announced January 2021.

Optimal Policies for a Pandemic: A Stochastic Game Approach and a Deep Learning Algorithm

Authors: Yao Xuan, Robert Balkin, Jiequn Han, Ruimeng Hu, Hector D. Ceniceros

Abstract: Game theory has been an effective tool in the control of disease spread and in suggesting optimal policies at both individual and area levels. In this paper, we propose a multi-region SEIR model based on stochastic differential game theory, aiming to formulate optimal regional policies for infectious diseases. Specifically, we enhance the standard epidemic SEIR model by taking into account the soc… ▽ More Game theory has been an effective tool in the control of disease spread and in suggesting optimal policies at both individual and area levels. In this paper, we propose a multi-region SEIR model based on stochastic differential game theory, aiming to formulate optimal regional policies for infectious diseases. Specifically, we enhance the standard epidemic SEIR model by taking into account the social and health policies issued by multiple region planners. This enhancement makes the model more realistic and powerful. However, it also introduces a formidable computational challenge due to the high dimensionality of the solution space brought by the presence of multiple regions. This significant numerical difficulty of the model structure motivates us to generalize the deep fictitious algorithm introduced in [Han and Hu, MSML2020, pp.221--245, PMLR, 2020] and develop an improved algorithm to overcome the curse of dimensionality. We apply the proposed model and algorithm to study the COVID-19 pandemic in three states: New York, New Jersey, and Pennsylvania. The model parameters are estimated from real data posted by the Centers for Disease Control and Prevention (CDC). We are able to show the effects of the lockdown/travel ban policy on the spread of COVID-19 for each state and how their policies affect each other. △ Less

Submitted 8 March, 2021; v1 submitted 12 December, 2020; originally announced December 2020.