-
On Krull-Schmidt decompositions of unit groups of number fields
Authors:
Asuka Kumon,
Donghyeok Lim
Abstract:
We prove that the Krull-Schmidt decomposition of the Galois module of the $p$-adic completion of algebraic units is controlled by the primes that are ramified in the Galois extension and the $S$-ideal class group. We also compute explicit upper bounds for the number of possible Galois module structures of algebraic units when the Galois group is cyclic of order $p^{2}$ or $p^{3}$.
We prove that the Krull-Schmidt decomposition of the Galois module of the $p$-adic completion of algebraic units is controlled by the primes that are ramified in the Galois extension and the $S$-ideal class group. We also compute explicit upper bounds for the number of possible Galois module structures of algebraic units when the Galois group is cyclic of order $p^{2}$ or $p^{3}$.
△ Less
Submitted 14 March, 2024;
originally announced March 2024.
-
On global regularity of some bi-rotational Euler flows in $\mathbb{R}^{4}$
Authors:
Kyudong Choi,
In-Jee Jeong,
Deokwoo Lim
Abstract:
In this paper, we consider incompressible Euler flows in $ \mathbb{R}^{4} $ under bi-rotational symmetry, namely solutions that are invariant under rotations in $\mathbb{R}^{4}$ fixing either the first two or last two axes. With the additional swirl-free assumption, our first main result gives local wellposedness of Yudovich-type solutions, extending the work of Danchin [Uspekhi Mat. Nauk 62(2007)…
▽ More
In this paper, we consider incompressible Euler flows in $ \mathbb{R}^{4} $ under bi-rotational symmetry, namely solutions that are invariant under rotations in $\mathbb{R}^{4}$ fixing either the first two or last two axes. With the additional swirl-free assumption, our first main result gives local wellposedness of Yudovich-type solutions, extending the work of Danchin [Uspekhi Mat. Nauk 62(2007), no.3, 73-94] for axisymmetric flows in $\mathbb{R}^{3}$. The second main result establishes global wellposedness under additional decay conditions near the axes and at infinity. This in particular gives global regularity of $C^{\infty}$ smooth and decaying Euler flows in $\mathbb{R}^{4}$ subject to bi-rotational symmetry without swirl.
△ Less
Submitted 28 February, 2024;
originally announced February 2024.
-
The finitude of tamely ramified pro-$p$ extensions of number fields with cyclic $p$-class groups
Authors:
Yoon** Lee,
Donghyeok Lim
Abstract:
Let $p$ be an odd prime and $F$ be a number field whose $p$-class group is cyclic. Let $F_{\{\mathfrak{q}\}}$ be the maximal pro-$p$ extension of $F$ which is unramified outside a single non-$p$-adic prime ideal $\mathfrak{q}$ of $F$. In this work, we study the finitude of the Galois group $G_{\{\mathfrak{q}\}}(F)$ of $F_{\{\mathfrak{q}\}}$ over $F$. We prove that $G_{\{\mathfrak{q}\}}(F)$ is fini…
▽ More
Let $p$ be an odd prime and $F$ be a number field whose $p$-class group is cyclic. Let $F_{\{\mathfrak{q}\}}$ be the maximal pro-$p$ extension of $F$ which is unramified outside a single non-$p$-adic prime ideal $\mathfrak{q}$ of $F$. In this work, we study the finitude of the Galois group $G_{\{\mathfrak{q}\}}(F)$ of $F_{\{\mathfrak{q}\}}$ over $F$. We prove that $G_{\{\mathfrak{q}\}}(F)$ is finite for the majority of $\mathfrak{q}$'s such that the generator rank of $G_{\{\mathfrak{q}\}}(F)$ is two, provided that for $p = 3$, $F$ is not a complex quartic field containing the primitive third roots of unity.
△ Less
Submitted 13 February, 2024;
originally announced February 2024.
-
On the existence of Minkowski units
Authors:
David Burns,
Donghyeok Lim,
Christian Maire
Abstract:
We investigate the Galois structure of algebraic units in cyclic extensions of number fields and thereby obtain strong new results on the existence of independent Minkowski $S$-units.
We investigate the Galois structure of algebraic units in cyclic extensions of number fields and thereby obtain strong new results on the existence of independent Minkowski $S$-units.
△ Less
Submitted 30 December, 2023;
originally announced January 2024.
-
Quantum Algorithms for the Pathwise Lasso
Authors:
Joao F. Doriguello,
Debbie Lim,
Chi Seng Pun,
Patrick Rebentrost,
Tushar Vaidya
Abstract:
We present a novel quantum high-dimensional linear regression algorithm with an $\ell_1$-penalty based on the classical LARS (Least Angle Regression) pathwise algorithm. Similarly to available classical algorithms for Lasso, our quantum algorithm provides the full regularisation path as the penalty term varies, but quadratically faster per iteration under specific conditions. A quadratic speedup o…
▽ More
We present a novel quantum high-dimensional linear regression algorithm with an $\ell_1$-penalty based on the classical LARS (Least Angle Regression) pathwise algorithm. Similarly to available classical algorithms for Lasso, our quantum algorithm provides the full regularisation path as the penalty term varies, but quadratically faster per iteration under specific conditions. A quadratic speedup on the number of features $d$ is possible by using the quantum minimum-finding routine from Dürr and Hoyer (ar** the quadratic improvement on $d$. Finally, we propose a dequantised algorithm that also retains the polylogarithmic dependence on $n$, albeit with the linear scaling on $d$ from the standard LARS algorithm.
△ Less
Submitted 17 June, 2024; v1 submitted 21 December, 2023;
originally announced December 2023.
-
On diffusion-based generative models and their error bounds: The log-concave case with full convergence estimates
Authors:
Stefano Bruno,
Ying Zhang,
Dong-Young Lim,
Ömer Deniz Akyildiz,
Sotirios Sabanis
Abstract:
We provide full theoretical guarantees for the convergence behaviour of diffusion-based generative models under the assumption of strongly log-concave data distributions while our approximating class of functions used for score estimation is made of Lipschitz continuous functions. We demonstrate via a motivating example, sampling from a Gaussian distribution with unknown mean, the powerfulness of…
▽ More
We provide full theoretical guarantees for the convergence behaviour of diffusion-based generative models under the assumption of strongly log-concave data distributions while our approximating class of functions used for score estimation is made of Lipschitz continuous functions. We demonstrate via a motivating example, sampling from a Gaussian distribution with unknown mean, the powerfulness of our approach. In this case, explicit estimates are provided for the associated optimization problem, i.e. score approximation, while these are combined with the corresponding sampling estimates. As a result, we obtain the best known upper bound estimates in terms of key quantities of interest, such as the dimension and rates of convergence, for the Wasserstein-2 distance between the data distribution (Gaussian with unknown mean) and our sampling algorithm.
Beyond the motivating example and in order to allow for the use of a diverse range of stochastic optimizers, we present our results using an $L^2$-accurate score estimation assumption, which crucially is formed under an expectation with respect to the stochastic optimizer and our novel auxiliary process that uses only known information. This approach yields the best known convergence rate for our sampling algorithm.
△ Less
Submitted 22 April, 2024; v1 submitted 22 November, 2023;
originally announced November 2023.
-
On the Galois structure of units in totally real $p$-rational number fields
Authors:
Zakariae Bouazzaoui,
Donghyeok Lim
Abstract:
The theory of factor-equivalence of integral lattices gives a far reaching relationship between the Galois module structure of units of the ring of integers of a number field and its arithmetic. For a number field $K$ that is Galois over $\mathbb{Q}$ or an imaginary quadratic field, we prove a necessary and sufficient condition on the quotients of class numbers of subfields of $K$, for the quotien…
▽ More
The theory of factor-equivalence of integral lattices gives a far reaching relationship between the Galois module structure of units of the ring of integers of a number field and its arithmetic. For a number field $K$ that is Galois over $\mathbb{Q}$ or an imaginary quadratic field, we prove a necessary and sufficient condition on the quotients of class numbers of subfields of $K$, for the quotient $E_{K}$ of the group of units of the ring of integers of $K$ by the subgroup of roots of unity to be factor equivalent to the standard cyclic Galois module. By using strong arithmetic properties of totally real $p$-rational number fields, we prove that the non-abelian $p$-rational $p$-extensions of $\mathbb{Q}$ do not have Minkowski units, which extends a result of Burns to non-abelian number fields. We also study the relative Galois module structure of $E_{L}$ for varying Galois extensions $L/F$ of totally real $p$-rational number fields whose Galois groups are isomorphic to a fixed finite group $G$. In that case, we prove that there is a finite set $Ω$ of $\mathbb{Z}_p[G]$-lattices such that for every $L$, $\mathbb{Z}_{p} \otimes_{\mathbb{Z}} E_{L}$ is factor equivalent to $\mathbb{Z}_{p}[G]^{n} \oplus X$ as $\mathbb{Z}_p[G]$-lattices for some $X \in Ω$ and an integer $n \geq 0$.
△ Less
Submitted 22 November, 2023;
originally announced November 2023.
-
Closed-form formulas, determinantal expressions, recursive relations, power series, and special values of several functions used in Clark--Ismail's two conjectures
Authors:
Yan-Fang Li,
Dongkyu Lim,
Feng Qi
Abstract:
In the paper, by virtue of the famous formula of Faà di Bruno, with the aid of several identities of partial Bell polynomials, by means of a formula for derivatives of the ratio of two differentiable functions, and with availability of other techniques, the authors establish closed-form formulas in terms of the Bernoulli numbers and the second kind Stirling numbers, present determinantal expressio…
▽ More
In the paper, by virtue of the famous formula of Faà di Bruno, with the aid of several identities of partial Bell polynomials, by means of a formula for derivatives of the ratio of two differentiable functions, and with availability of other techniques, the authors establish closed-form formulas in terms of the Bernoulli numbers and the second kind Stirling numbers, present determinantal expressions, derive recursive relations, obtain power series, and compute special values of the function $\frac{v^j}{1-\operatorname{e}^{-v}}$, its derivatives, and related ones used in Clark--Ismail's two conjectures. By these results, the authors also discover a formula for the determinant of a Hessenberg matrix and derive logarithmic convexity of a sequence related to the function and its derivatives.
△ Less
Submitted 19 October, 2023;
originally announced October 2023.
-
Coherently complete algebraic stacks in positive characteristic
Authors:
Jarod Alper,
Jack Hall,
David Benjamin Lim
Abstract:
With the long-term goal of proving local structure theorems of algebraic stacks in positive characteristic near points with reductive (but possibly non-linearly reductive) stabilizer, we conjecture that quotient stacks of the form $[\mathrm{Spec}\, A/G]$, with $G$ reductive and $A^G$ complete local, are coherently complete along the unique closed point. We establish this conjecture in two interest…
▽ More
With the long-term goal of proving local structure theorems of algebraic stacks in positive characteristic near points with reductive (but possibly non-linearly reductive) stabilizer, we conjecture that quotient stacks of the form $[\mathrm{Spec}\, A/G]$, with $G$ reductive and $A^G$ complete local, are coherently complete along the unique closed point. We establish this conjecture in two interesting cases: (1) $A^G$ is artinian and (2) $G$ acts trivially on $\mathrm{Spec}\, A$. We also establish coherent completeness results for graded unipotent group actions. In order to establish these results, we prove a number of foundational statements concerning cohomological and completeness properties of algebraic stacks -- including on how these properties ascend and descend along morphisms.
△ Less
Submitted 4 September, 2023;
originally announced September 2023.
-
On the analyticity of the maximal extension of a number field with prescribed ramification and splitting
Authors:
Donghyeok Lim,
Christian Maire
Abstract:
We determine all the $p$-adic analytic groups that are realizable as Galois groups of the maximal pro-$p$ extensions of number fields with prescribed ramification and splitting under an assumption which allows us to move away from the Tame Fontaine-Mazur conjecture.
We determine all the $p$-adic analytic groups that are realizable as Galois groups of the maximal pro-$p$ extensions of number fields with prescribed ramification and splitting under an assumption which allows us to move away from the Tame Fontaine-Mazur conjecture.
△ Less
Submitted 7 August, 2023;
originally announced August 2023.
-
Degrees of Second and Higher-Order Polynomials
Authors:
Donghyun Lim,
Martin Ziegler
Abstract:
Second-order polynomials generalize classical first-order ones in allowing for additional variables that range over functions rather than values. We are motivated by their applications in higher-order computational complexity theory, extending for example classical classes like P or PSPACE to operators in Analysis [doi:10.1137/S0097539794263452, doi:10.1145/2189778.2189780]. The degree subclassifi…
▽ More
Second-order polynomials generalize classical first-order ones in allowing for additional variables that range over functions rather than values. We are motivated by their applications in higher-order computational complexity theory, extending for example classical classes like P or PSPACE to operators in Analysis [doi:10.1137/S0097539794263452, doi:10.1145/2189778.2189780]. The degree subclassifies ordinary polynomial growth into linear, quadratic, cubic etc. In order to similarly classify second-order polynomials, define their degree to be an 'arctic' first-order polynomial (namely a term/expression over variable $D$ and operations $+$ and $\cdot$ and $\max$). This degree turns out to transform as nicely under (now two kinds of) polynomial composition as the ordinary one. We also establish a normal form and semantic uniqueness for second-order polynomials. Then we define the degree of a third-order polynomial to be an arctic second-order polynomial, and establish its transformation under three kinds of composition.
△ Less
Submitted 21 May, 2023; v1 submitted 5 May, 2023;
originally announced May 2023.
-
Global regularity of some axisymmetric, single-signed vorticity in any dimension
Authors:
Deokwoo Lim
Abstract:
We consider incompressible Euler equations in any dimension $ d\geq3 $ imposing axisymmetric symmetry without swirl. While the global regularity of smooth flows in this setting has been well-known in $ d=3 $, the same question in higher dimensions $ d\geq4 $ remains unsolved. Recently, global regularity for the case $ d=4 $ with some extra decay assumption on vorticity is obtained by proving globa…
▽ More
We consider incompressible Euler equations in any dimension $ d\geq3 $ imposing axisymmetric symmetry without swirl. While the global regularity of smooth flows in this setting has been well-known in $ d=3 $, the same question in higher dimensions $ d\geq4 $ remains unsolved. Recently, global regularity for the case $ d=4 $ with some extra decay assumption on vorticity is obtained by proving global estimate of the radial velocity. Now we prove that the vorticity with single-sign and a similar decay assumption is globally regular for any $ d\geq4 $. This is due to pointwise decay estimate of radial velocity in sufficiently large radial distance, which depends on time. The result is of confinement type for support growth, which is going back to Marchioro [Comm. Math. Phys., 164 (1994) 507-524] and Iftimie--Sideris--Gamblin [Comm. Partial Differential Equations, 24 (1999) 1709-1730] for $ \mathbb{R}^{2} $. In particular, we follow the approach of Maffei--Marchioro [Rend. Sem. Mat. Univ. Padova, 105 (2001) 125-137] for $ d=3 $ so that we generalize the confinement into any dimension.
△ Less
Submitted 23 January, 2024; v1 submitted 24 April, 2023;
originally announced April 2023.
-
Quantum algorithm for robust optimization via stochastic-gradient online learning
Authors:
Debbie Lim,
João F. Doriguello,
Patrick Rebentrost
Abstract:
Optimization theory has been widely studied in academia and finds a large variety of applications in industry. The different optimization models in their discrete and/or continuous settings has catered to a rich source of research problems. Robust convex optimization is a branch of optimization theory in which the variables or parameters involved have a certain level of uncertainty. In this work,…
▽ More
Optimization theory has been widely studied in academia and finds a large variety of applications in industry. The different optimization models in their discrete and/or continuous settings has catered to a rich source of research problems. Robust convex optimization is a branch of optimization theory in which the variables or parameters involved have a certain level of uncertainty. In this work, we consider the online robust optimization meta-algorithm by Ben-Tal et al. and show that for a large range of stochastic subgradients, this algorithm has the same guarantee as the original non-stochastic version. We develop a quantum version of this algorithm and show that an at most quadratic improvement in terms of the dimension can be achieved. The speedup is due to the use of quantum state preparation, quantum norm estimation, and quantum multi-sampling. We apply our quantum meta-algorithm to examples such as robust linear programs and robust semidefinite programs and give applications of these robust optimization problems in finance and engineering.
△ Less
Submitted 5 April, 2023;
originally announced April 2023.
-
A combinatorial proof of the general identity of He-Nie-Yu
Authors:
Dong Gyu Lim
Abstract:
We give a uniform and combinatorial proof of the general identity appearing in the work of He-Nie-Yu on the affine Deligne-Lusztig varieties with finite Coxeter part.
We give a uniform and combinatorial proof of the general identity appearing in the work of He-Nie-Yu on the affine Deligne-Lusztig varieties with finite Coxeter part.
△ Less
Submitted 8 March, 2023; v1 submitted 26 February, 2023;
originally announced February 2023.
-
Nonemptiness of single affine Deligne-Lusztig varieties
Authors:
Dong Gyu Lim
Abstract:
Affine Deligne-Lusztig varieties with various level structures show up in the study of Shimura varieties and moduli spaces of shtukas. Among is the Iwahori level structure which is the most refined one. We study the nonemptiness problem of single affine Deligne-Lusztig varieties at Iwahori level in the basic case. Under a genericity condition (the ``shrunken Weyl chambers'' condition), an explicit…
▽ More
Affine Deligne-Lusztig varieties with various level structures show up in the study of Shimura varieties and moduli spaces of shtukas. Among is the Iwahori level structure which is the most refined one. We study the nonemptiness problem of single affine Deligne-Lusztig varieties at Iwahori level in the basic case. Under a genericity condition (the ``shrunken Weyl chambers'' condition), an explicit criterion is known. However, no explicit criterion has been available without the condition even conjecturally. We conjecture a new criterion in full generality, and prove it except for finitely many cases. As an application, the nonemptiness problem for special cases and a new conjectural dimension formula are discussed.
△ Less
Submitted 7 March, 2023; v1 submitted 9 February, 2023;
originally announced February 2023.
-
Global regularity for some axisymmetric Euler flows in $\mathbb{R}^{d}$
Authors:
Kyudong Choi,
In-Jee Jeong,
Deokwoo Lim
Abstract:
We consider axisymmetric Euler flows without swirl in $\mathbb{R}^{d}$ with $d\geq 4$, for which the global regularity of smooth solutions is an open problem. When $d = 4$, we obtain global regularity under the assumption that the initial vorticity satisfies some decay at infinity and is vanishing at the axis. Assuming further that the initial vorticity is of one sign guarantees global regularity…
▽ More
We consider axisymmetric Euler flows without swirl in $\mathbb{R}^{d}$ with $d\geq 4$, for which the global regularity of smooth solutions is an open problem. When $d = 4$, we obtain global regularity under the assumption that the initial vorticity satisfies some decay at infinity and is vanishing at the axis. Assuming further that the initial vorticity is of one sign guarantees global regularity for $d\leq 7$.
△ Less
Submitted 21 December, 2022;
originally announced December 2022.
-
Langevin dynamics based algorithm e-TH$\varepsilon$O POULA for stochastic optimization problems with discontinuous stochastic gradient
Authors:
Dong-Young Lim,
Ariel Neufeld,
Sotirios Sabanis,
Ying Zhang
Abstract:
We introduce a new Langevin dynamics based algorithm, called e-TH$\varepsilon$O POULA, to solve optimization problems with discontinuous stochastic gradients which naturally appear in real-world applications such as quantile estimation, vector quantization, CVaR minimization, and regularized optimization problems involving ReLU neural networks. We demonstrate both theoretically and numerically the…
▽ More
We introduce a new Langevin dynamics based algorithm, called e-TH$\varepsilon$O POULA, to solve optimization problems with discontinuous stochastic gradients which naturally appear in real-world applications such as quantile estimation, vector quantization, CVaR minimization, and regularized optimization problems involving ReLU neural networks. We demonstrate both theoretically and numerically the applicability of the e-TH$\varepsilon$O POULA algorithm. More precisely, under the conditions that the stochastic gradient is locally Lipschitz in average and satisfies a certain convexity at infinity condition, we establish non-asymptotic error bounds for e-TH$\varepsilon$O POULA in Wasserstein distances and provide a non-asymptotic estimate for the expected excess risk, which can be controlled to be arbitrarily small. Three key applications in finance and insurance are provided, namely, multi-period portfolio optimization, transfer learning in multi-period portfolio optimization, and insurance claim prediction, which involve neural networks with (Leaky)-ReLU activation functions. Numerical experiments conducted using real-world datasets illustrate the superior empirical performance of e-TH$\varepsilon$O POULA compared to SGLD, TUSLA, ADAM, and AMSGrad in terms of model accuracy.
△ Less
Submitted 30 June, 2024; v1 submitted 24 October, 2022;
originally announced October 2022.
-
Simple deterministic O(n log n) algorithm finding a solution of Erdős-Ginzburg-Ziv theorem
Authors:
Seokhwan Choi,
Hanpil Kang,
Dongjae Lim
Abstract:
Erdős-Ginzburg-Ziv theorem is a famous theorem in additive number theory, which states any sequence of $2n-1$ integers contains a subsequence of $n$ elements, with their sum being a multiple of $n$. In this article, we provide an algorithm finding a solution of Erdős-Ginzburg-Ziv theorem in $\mathcal{O}(n \log n)$ time. This is the first known deterministic $\mathcal{O}(n \log n)$ time algorithm f…
▽ More
Erdős-Ginzburg-Ziv theorem is a famous theorem in additive number theory, which states any sequence of $2n-1$ integers contains a subsequence of $n$ elements, with their sum being a multiple of $n$. In this article, we provide an algorithm finding a solution of Erdős-Ginzburg-Ziv theorem in $\mathcal{O}(n \log n)$ time. This is the first known deterministic $\mathcal{O}(n \log n)$ time algorithm finding a solution of Erdős-Ginzburg-Ziv theorem.
△ Less
Submitted 17 August, 2022; v1 submitted 16 August, 2022;
originally announced August 2022.
-
The connected components of affine Deligne--Lusztig varieties
Authors:
Ian Gleason,
Dong Gyu Lim,
Yujie Xu
Abstract:
We compute the connected components of arbitrary parahoric level affine Deligne--Lusztig varieties and local Shimura varieties, thus resolving the conjecture raised in \cite{He} in full generality (even for non-quasisplit groups). We achieve this by relating them to the connected components of infinite level moduli spaces of $p$-adic shtukas, where we use v-sheaf-theoretic techniques such as the s…
▽ More
We compute the connected components of arbitrary parahoric level affine Deligne--Lusztig varieties and local Shimura varieties, thus resolving the conjecture raised in \cite{He} in full generality (even for non-quasisplit groups). We achieve this by relating them to the connected components of infinite level moduli spaces of $p$-adic shtukas, where we use v-sheaf-theoretic techniques such as the specialization map of \textit{kimberlites}. Along the way, we give a $p$-adic Hodge-theoretic characterization of HN-irreducibility.
As applications, we obtain many results on the geometry of integral models of Shimura varieties at arbitrary parahoric levels. In particular, we deduce new CM lifting results on integral models of Shimura varieties for quasi-split groups at arbitrary connected parahoric levels.
△ Less
Submitted 8 January, 2023; v1 submitted 15 August, 2022;
originally announced August 2022.
-
Stability of monotone, non-negative, and compactly supported vorticities in the half cylinder and infinite perimeter growth for patches
Authors:
Kyudong Choi,
In-Jee Jeong,
Deokwoo Lim
Abstract:
We consider the incompressible Euler equations in the half cylinder $ \mathbb{R}_{>0}\times\mathbb{T}$. In this domain, any vorticity which is independent of $x_2$ defines a stationary solution. We prove that such a stationary solution is nonlinearly stable in a weighted $L^{1}$ norm involving the horizontal impulse, if the vorticity is non-negative and non-increasing in $x_1$. This includes stabi…
▽ More
We consider the incompressible Euler equations in the half cylinder $ \mathbb{R}_{>0}\times\mathbb{T}$. In this domain, any vorticity which is independent of $x_2$ defines a stationary solution. We prove that such a stationary solution is nonlinearly stable in a weighted $L^{1}$ norm involving the horizontal impulse, if the vorticity is non-negative and non-increasing in $x_1$. This includes stability of cylindrical patches $\{x_{1}<α\},\; α>0$. The stability result is based on the fact that such a profile is the unique minimizer of the horizontal impulse among all functions with the same distribution function. Based on stability, we prove existence of vortex patches in the half cylinder that exhibit infinite perimeter growth in infinite time.
△ Less
Submitted 14 September, 2022; v1 submitted 10 May, 2022;
originally announced May 2022.
-
Radon-Nikodym theorem with respect to $(ρ,q)$-measure on $\Bbb Z_p$
Authors:
Dongkyu Lim
Abstract:
Araci et al. introduced a $p$-adic $(ρ,q)$-analogue of the Haar distribution. By means of the distribution, they constructed the $p$-adic $(ρ,q)$-Volkenborn integral. In this paper, by virtue of the Mahler expansion of continuous functions, the author gives the Radon-Nikodym theorem with respect to the $p$-adic $(ρ,q)$-distribution on $\Bbb Z_p$.
Araci et al. introduced a $p$-adic $(ρ,q)$-analogue of the Haar distribution. By means of the distribution, they constructed the $p$-adic $(ρ,q)$-Volkenborn integral. In this paper, by virtue of the Mahler expansion of continuous functions, the author gives the Radon-Nikodym theorem with respect to the $p$-adic $(ρ,q)$-distribution on $\Bbb Z_p$.
△ Less
Submitted 24 January, 2022;
originally announced January 2022.
-
Non-asymptotic estimates for TUSLA algorithm for non-convex learning with applications to neural networks with ReLU activation function
Authors:
Dong-Young Lim,
Ariel Neufeld,
Sotirios Sabanis,
Ying Zhang
Abstract:
We consider non-convex stochastic optimization problems where the objective functions have super-linearly growing and discontinuous stochastic gradients. In such a setting, we provide a non-asymptotic analysis for the tamed unadjusted stochastic Langevin algorithm (TUSLA) introduced in Lovas et al. (2020). In particular, we establish non-asymptotic error bounds for the TUSLA algorithm in Wasserste…
▽ More
We consider non-convex stochastic optimization problems where the objective functions have super-linearly growing and discontinuous stochastic gradients. In such a setting, we provide a non-asymptotic analysis for the tamed unadjusted stochastic Langevin algorithm (TUSLA) introduced in Lovas et al. (2020). In particular, we establish non-asymptotic error bounds for the TUSLA algorithm in Wasserstein-1 and Wasserstein-2 distances. The latter result enables us to further derive non-asymptotic estimates for the expected excess risk. To illustrate the applicability of the main results, we consider an example from transfer learning with ReLU neural networks, which represents a key paradigm in machine learning. Numerical experiments are presented for the aforementioned example which support our theoretical findings. Hence, in this setting, we demonstrate both theoretically and numerically that the TUSLA algorithm can solve the optimization problem involving neural networks with ReLU activation function. Besides, we provide simulation results for synthetic examples where popular algorithms, e.g. ADAM, AMSGrad, RMSProp, and (vanilla) stochastic gradient descent (SGD) algorithm, may fail to find the minimizer of the objective functions due to the super-linear growth and the discontinuity of the corresponding stochastic gradient, while the TUSLA algorithm converges rapidly to the optimal solution. Moreover, we provide an empirical comparison of the performance of TUSLA with popular stochastic optimizers on real-world datasets, as well as investigate the effect of the key hyperparameters of TUSLA on its performance.
△ Less
Submitted 2 May, 2023; v1 submitted 19 July, 2021;
originally announced July 2021.
-
Equivariant Manifold Flows
Authors:
Isay Katsman,
Aaron Lou,
Derek Lim,
Qingxuan Jiang,
Ser-Nam Lim,
Christopher De Sa
Abstract:
Tractably modelling distributions over manifolds has long been an important goal in the natural sciences. Recent work has focused on develo** general machine learning models to learn such distributions. However, for many applications these distributions must respect manifold symmetries -- a trait which most previous models disregard. In this paper, we lay the theoretical foundations for learning…
▽ More
Tractably modelling distributions over manifolds has long been an important goal in the natural sciences. Recent work has focused on develo** general machine learning models to learn such distributions. However, for many applications these distributions must respect manifold symmetries -- a trait which most previous models disregard. In this paper, we lay the theoretical foundations for learning symmetry-invariant distributions on arbitrary manifolds via equivariant manifold flows. We demonstrate the utility of our approach by using it to learn gauge invariant densities over $SU(n)$ in the context of quantum field theory.
△ Less
Submitted 27 January, 2022; v1 submitted 18 July, 2021;
originally announced July 2021.
-
Polygonal Unadjusted Langevin Algorithms: Creating stable and efficient adaptive algorithms for neural networks
Authors:
Dong-Young Lim,
Sotirios Sabanis
Abstract:
We present a new class of Langevin based algorithms, which overcomes many of the known shortcomings of popular adaptive optimizers that are currently used for the fine tuning of deep learning models. Its underpinning theory relies on recent advances of Euler's polygonal approximations for stochastic differential equations (SDEs) with monotone coefficients. As a result, it inherits the stability pr…
▽ More
We present a new class of Langevin based algorithms, which overcomes many of the known shortcomings of popular adaptive optimizers that are currently used for the fine tuning of deep learning models. Its underpinning theory relies on recent advances of Euler's polygonal approximations for stochastic differential equations (SDEs) with monotone coefficients. As a result, it inherits the stability properties of tamed algorithms, while it addresses other known issues, e.g. vanishing gradients in neural networks. In particular, we provide a nonasymptotic analysis and full theoretical guarantees for the convergence properties of an algorithm of this novel class, which we named TH$\varepsilon$O POULA (or, simply, TheoPouLa). Finally, several experiments are presented with different types of deep learning models, which show the superior performance of TheoPouLa over many popular adaptive optimization algorithms.
△ Less
Submitted 2 March, 2024; v1 submitted 28 May, 2021;
originally announced May 2021.
-
Stability of radially symmetric, monotone vorticities of 2D Euler equations
Authors:
Kyudong Choi,
Deokwoo Lim
Abstract:
We consider the incompressible Euler equations in $R^2$ when the initial vorticity is bounded, radially symmetric and non-increasing in the radial direction. Such a radial distribution is stationary, and we show that the monotonicity produces stability in some weighted norm related to the angular impulse. For instance, it covers the cases of circular vortex patches and Gaussian distributions. Our…
▽ More
We consider the incompressible Euler equations in $R^2$ when the initial vorticity is bounded, radially symmetric and non-increasing in the radial direction. Such a radial distribution is stationary, and we show that the monotonicity produces stability in some weighted norm related to the angular impulse. For instance, it covers the cases of circular vortex patches and Gaussian distributions. Our stability does not depend on $L^\infty$-bound or support size of perturbations. The proof is based on the fact that such a radial monotone distribution minimizes the impulse of functions having the same level set measure.
△ Less
Submitted 22 March, 2021;
originally announced March 2021.
-
Maclaurin's series expansions for positive integer powers of inverse (hyperbolic) sine and related functions, specific values of partial Bell polynomials, and two applications
Authors:
Bai-Ni Guo,
Dongkyu Lim,
Feng Qi
Abstract:
In the paper, the authors establish Maclaurin's series expansions and series identities for positive integer powers of the inverse sine function, for positive integer powers of the inverse hyperbolic sine function, for the composite of incomplete gamma functions with the inverse hyperbolic sine function, for positive integer powers of the inverse tangent function, and for positive integer powers o…
▽ More
In the paper, the authors establish Maclaurin's series expansions and series identities for positive integer powers of the inverse sine function, for positive integer powers of the inverse hyperbolic sine function, for the composite of incomplete gamma functions with the inverse hyperbolic sine function, for positive integer powers of the inverse tangent function, and for positive integer powers of the inverse hyperbolic tangent function, in terms of the first kind Stirling numbers and binomial coefficients, apply the newly established Maclaurin's series expansion for positive integer powers of the inverse sine function to derive a closed-form formula for specific values of partial Bell polynomials and to derive a series representation of the generalized logsine function, and deduce several combinatorial identities involving the first kind Stirling numbers. Some of these results simplify and unify some known ones. All of these newly established Maclaurin's series expansions of positive integer powers of the inverse (hyperbolic) sine and tangent functions can be used to derive infinite series representations of the circular constant Pi and of positive integer powers of Pi.
△ Less
Submitted 11 November, 2021; v1 submitted 26 January, 2021;
originally announced January 2021.
-
Several combinatorial identities derived from series expansions of powers of arcsine
Authors:
Feng Qi,
Chao-** Chen,
Dongkyu Lim
Abstract:
In the paper, with the aid of the series expansions of the square or cubic of the arcsine function, the authors establish several possibly new combinatorial identities containing the ratio of two central binomial coefficients which are related to the Catalan numbers in combinatorial number theory.
In the paper, with the aid of the series expansions of the square or cubic of the arcsine function, the authors establish several possibly new combinatorial identities containing the ratio of two central binomial coefficients which are related to the Catalan numbers in combinatorial number theory.
△ Less
Submitted 10 January, 2021; v1 submitted 3 January, 2021;
originally announced January 2021.
-
Neural Manifold Ordinary Differential Equations
Authors:
Aaron Lou,
Derek Lim,
Isay Katsman,
Leo Huang,
Qingxuan Jiang,
Ser-Nam Lim,
Christopher De Sa
Abstract:
To better conform to data geometry, recent deep generative modelling techniques adapt Euclidean constructions to non-Euclidean spaces. In this paper, we study normalizing flows on manifolds. Previous work has developed flow models for specific cases; however, these advancements hand craft layers on a manifold-by-manifold basis, restricting generality and inducing cumbersome design constraints. We…
▽ More
To better conform to data geometry, recent deep generative modelling techniques adapt Euclidean constructions to non-Euclidean spaces. In this paper, we study normalizing flows on manifolds. Previous work has developed flow models for specific cases; however, these advancements hand craft layers on a manifold-by-manifold basis, restricting generality and inducing cumbersome design constraints. We overcome these issues by introducing Neural Manifold Ordinary Differential Equations, a manifold generalization of Neural ODEs, which enables the construction of Manifold Continuous Normalizing Flows (MCNFs). MCNFs require only local geometry (therefore generalizing to arbitrary manifolds) and compute probabilities with continuous change of variables (allowing for a simple and expressive flow construction). We find that leveraging continuous manifold dynamics produces a marked improvement for both density estimation and downstream tasks.
△ Less
Submitted 17 June, 2020;
originally announced June 2020.
-
Quantitative Coding and Complexity Theory of Continuous Data
Authors:
Donghyun Lim,
Martin Ziegler
Abstract:
Specifying a computational problem requires fixing encodings for input and output: encoding graphs as adjacency matrices, characters as integers, integers as bit strings, and vice versa. For such discrete data, the actual encoding is usually straightforward and/or complexity-theoretically inessential (up to polynomial time, say); but concerning continuous data, already real numbers naturally sugge…
▽ More
Specifying a computational problem requires fixing encodings for input and output: encoding graphs as adjacency matrices, characters as integers, integers as bit strings, and vice versa. For such discrete data, the actual encoding is usually straightforward and/or complexity-theoretically inessential (up to polynomial time, say); but concerning continuous data, already real numbers naturally suggest various encodings (so-called REPRESENTATIONS) with very different properties, ranging from the computably 'unreasonable' binary expansion via qualitatively to polynomially and even linearly complexity-theoretically 'reasonable' signed-digit expansion. But how to distinguish between un/suitable encodings of other spaces common in Calculus and Numerics, such as Sobolev?
With respect to qualitative computability, Kreitz and Weihrauch (1985) had identified ADMISSIBILITY as crucial criterion for a representation over the Cantor space of infinite binary sequences to be 'reasonable'; cmp. [doi:10.1007/11780342_48]. Refining computability over topological to complexity over metric spaces, we develop the theory of POLYNOMIAL/LINEAR ADMISSIBILITY as two quantitative refinements of qualitative admissibility.
We also rephrase quantitative admissibility as quantitative continuity of both the representation and of its set-valued inverse, the latter adopting from [doi:10.4115/jla.2013.5.7] a new notion of 'sequential' continuity for multifunctions. By establishing a quantitative continuous selection theorem for multifunctions between compact ultrametric spaces, we can extend our above quantitative MAIN THEOREM from functions to multifunctions aka search problems. Higher-type complexity is captured by generalizing Cantor's (and Baire's) ground space for encodings to other (compact) ULRAmetric spaces.
△ Less
Submitted 24 August, 2021; v1 submitted 10 February, 2020;
originally announced February 2020.
-
Spectra of Convex Hulls of Matrix Groups
Authors:
Eric Jankowski,
Charles R. Johnson,
Derek Lim
Abstract:
The still-unsolved problem of determining the set of eigenvalues realized by $n$-by-$n$ doubly stochastic matrices, those matrices with row sums and column sums equal to $1$, has attracted much attention in the last century. This problem is somewhat algebraic in nature, due to a result of Birkhoff demonstrating that the set of doubly stochastic matrices is the convex hull of the permutation matric…
▽ More
The still-unsolved problem of determining the set of eigenvalues realized by $n$-by-$n$ doubly stochastic matrices, those matrices with row sums and column sums equal to $1$, has attracted much attention in the last century. This problem is somewhat algebraic in nature, due to a result of Birkhoff demonstrating that the set of doubly stochastic matrices is the convex hull of the permutation matrices. Here we are interested in a general matrix group $G \subseteq GL_n(\mathbb{C})$ and the hull spectrum $\text{HS}(G)$ of eigenvalues realized by convex combinations of elements of $G$. We show that hull spectra of matrix groups share many nice properties. Moreover, we give bounds on the hull spectra of matrix groups, determine $\text{HS}(G)$ exactly for important classes of matrix groups, and study the hull spectra of representations of abstract groups.
△ Less
Submitted 27 December, 2019; v1 submitted 23 September, 2019;
originally announced September 2019.
-
The Doubly Stochastic Single Eigenvalue Problem: A Computational Approach
Authors:
Amit Harlev,
Charles R. Johnson,
Derek Lim
Abstract:
The problem of determining $DS_n$, the complex numbers that occur as an eigenvalue of an $n$-by-$n$ doubly stochastic matrix, has been a target of study for some time. The Perfect-Mirsky region, $PM_n$, is contained in $DS_n$, and is known to be exactly $DS_n$ for $n \leq 4$, but strictly contained within $DS_n$ for $n = 5$. Here, we present a Boundary Conjecture that asserts that the boundary of…
▽ More
The problem of determining $DS_n$, the complex numbers that occur as an eigenvalue of an $n$-by-$n$ doubly stochastic matrix, has been a target of study for some time. The Perfect-Mirsky region, $PM_n$, is contained in $DS_n$, and is known to be exactly $DS_n$ for $n \leq 4$, but strictly contained within $DS_n$ for $n = 5$. Here, we present a Boundary Conjecture that asserts that the boundary of $DS_n$ is achieved by eigenvalues of convex combinations of pairs of (or single) permutation matrices. We present a method to efficiently compute a portion of $DS_n$, and obtain computational results that support the Boundary Conjecture. We also give evidence that $DS_n$ is equal to $PM_n$ for certain $n > 5$.
△ Less
Submitted 3 April, 2020; v1 submitted 9 August, 2019;
originally announced August 2019.
-
Grothendieck's Existence Theorem for Relatively Perfect Complexes on Algebraic Stacks
Authors:
David Benjamin Lim
Abstract:
We prove Grothendieck's existence theorem for relatively perfect complexes on an algebraic stack that is proper and flat over an $I$-adically complete Noetherian ring $A$. This generalizes an earlier result of Lieblich in the setting of algebraic spaces.
We prove Grothendieck's existence theorem for relatively perfect complexes on an algebraic stack that is proper and flat over an $I$-adically complete Noetherian ring $A$. This generalizes an earlier result of Lieblich in the setting of algebraic spaces.
△ Less
Submitted 16 May, 2021; v1 submitted 11 July, 2019;
originally announced July 2019.
-
Randomized Computation of Continuous Data: Is Brownian Motion Computable?
Authors:
Willem Fouché,
Hyunwoo Lee,
Donghyun Lim,
Sewon Park,
Matthias Schröder,
Martin Ziegler
Abstract:
We consider randomized computation of continuous data in the sense of Computable Analysis. Our first contribution formally confirms that it is no loss of generality to take as sample space the Cantor space of infinite FAIR coin flips. This extends [Schröder&Simpson'05] and [Hoyrup&Rojas'09] considering sequences of suitably and adaptively BIASED coins.
Our second contribution is concerned with 1…
▽ More
We consider randomized computation of continuous data in the sense of Computable Analysis. Our first contribution formally confirms that it is no loss of generality to take as sample space the Cantor space of infinite FAIR coin flips. This extends [Schröder&Simpson'05] and [Hoyrup&Rojas'09] considering sequences of suitably and adaptively BIASED coins.
Our second contribution is concerned with 1D Brownian Motion (aka Wiener Process), a probability distribution on the space of continuous functions f:[0,1]->R with f(0)=0 whose computability has been conjectured [Davie&Fouché'13; arXiv:1409.4667,S6]. We establish that this (higher-type) random variable is computable iff some/every computable family of moduli of continuity (as ordinary random variables) has a computable probability distribution with respect to the Wiener Measure.
△ Less
Submitted 16 June, 2019;
originally announced June 2019.
