-
$h$-function, Hilbert-Kunz density function and Frobenius-Poincaré function
Authors:
Cheng Meng,
Alapan Mukhopadhyay
Abstract:
Given ideals $I,J$ of a noetherian local ring $(R, \mathfrak m)$ such that $I+J$ is $\mathfrak m$-primary and a finitely generated $R$-module $M$, we associate an invariant of $(M,R,I,J)$ called the $h$-function. Our results on $h$-functions allow extensions of the theories of Frobenius-Poincaré functions and Hilbert-Kunz density functions from the known graded case to the local case, answering a…
▽ More
Given ideals $I,J$ of a noetherian local ring $(R, \mathfrak m)$ such that $I+J$ is $\mathfrak m$-primary and a finitely generated $R$-module $M$, we associate an invariant of $(M,R,I,J)$ called the $h$-function. Our results on $h$-functions allow extensions of the theories of Frobenius-Poincaré functions and Hilbert-Kunz density functions from the known graded case to the local case, answering a question of V.Trivedi. When $J$ is $\mathfrak m$-primary, we describe the support of the corresponding density function in terms of other invariants of $(R, I,J)$. We show that the support captures the $F$-threshold: $c^J(I)$, under mild assumptions, extending results of V. Trivedi and Watanabe. The $h$-function encodes Hilbert-Samuel, Hilbert-Kunz multiplicity and $F$-threshold of the ideal pair involved. Using this feature of $h$-functions, we provide an equivalent formulation of a conjecture of Huneke, Mustaţă, Takagi, Watanabe; recover a result of Smirnov and Betancourt; prove that a result of Hanes comparing multiplicities, is equivalent to an a priori weaker containment condition on ideals. We also point out that a conjecture of Smirnov-Betancourt as stated is false and suggest a correction which we relate to the conjecture of Huneke et al.
We develop the theory of $h$-functions in a more general setting which yields a density function for $F$-signature. A key to many results on $h$-functions is a `convexity technique' that we introduce, which in particular proves differentiability of Hilbert-Kunz density functions almost everywhere on $(0,\infty)$, thus contributing to another question of Trivedi.
△ Less
Submitted 25 April, 2024; v1 submitted 16 October, 2023;
originally announced October 2023.
-
Sampling-Based Methods for Multi-Block Optimization Problems over Transport Polytopes
Authors:
Yukuan Hu,
Mengyu Li,
Xin Liu,
Cheng Meng
Abstract:
This paper focuses on multi-block optimization problems over transport polytopes, which underlie various applications including strongly correlated quantum physics and machine learning. Conventional block coordinate descent-type methods for the general multi-block problems store and operate on the matrix variables directly, resulting in formidable expenditure for large-scale settings. On the other…
▽ More
This paper focuses on multi-block optimization problems over transport polytopes, which underlie various applications including strongly correlated quantum physics and machine learning. Conventional block coordinate descent-type methods for the general multi-block problems store and operate on the matrix variables directly, resulting in formidable expenditure for large-scale settings. On the other hand, optimal transport problems, as a special case, have attracted extensive attention and numerical techniques that waive the use of the full matrices have recently emerged. However, it remains nontrivial to apply these techniques to the multi-block, possibly nonconvex problems with theoretical guarantees. In this work, we leverage the benefits of both sides and develop novel sampling-based block coordinate descent-type methods, which are equipped with either entropy regularization or Kullback-Leibler divergence. Each iteration of these methods solves subproblems restricted on the sampled degrees of freedom. Consequently, they involve only sparse matrices, which amounts to considerable complexity reductions. We explicitly characterize the sampling-induced errors and establish convergence and asymptotic properties for the methods equipped with the entropy regularization. Numerical experiments on typical strongly correlated electron systems corroborate their superior scalability over the methods utilizing full matrices. The advantage also enables the first visualization of approximate optimal transport maps between electron positions in three-dimensional contexts.
△ Less
Submitted 21 March, 2024; v1 submitted 29 June, 2023;
originally announced June 2023.
-
Importance Sparsification for Sinkhorn Algorithm
Authors:
Mengyu Li,
Jun Yu,
Tao Li,
Cheng Meng
Abstract:
Sinkhorn algorithm has been used pervasively to approximate the solution to optimal transport (OT) and unbalanced optimal transport (UOT) problems. However, its practical application is limited due to the high computational complexity. To alleviate the computational burden, we propose a novel importance sparsification method, called Spar-Sink, to efficiently approximate entropy-regularized OT and…
▽ More
Sinkhorn algorithm has been used pervasively to approximate the solution to optimal transport (OT) and unbalanced optimal transport (UOT) problems. However, its practical application is limited due to the high computational complexity. To alleviate the computational burden, we propose a novel importance sparsification method, called Spar-Sink, to efficiently approximate entropy-regularized OT and UOT solutions. Specifically, our method employs natural upper bounds for unknown optimal transport plans to establish effective sampling probabilities, and constructs a sparse kernel matrix to accelerate Sinkhorn iterations, reducing the computational cost of each iteration from $O(n^2)$ to $\widetilde{O}(n)$ for a sample of size $n$. Theoretically, we show the proposed estimators for the regularized OT and UOT problems are consistent under mild regularity conditions. Experiments on various synthetic data demonstrate Spar-Sink outperforms mainstream competitors in terms of both estimation error and speed. A real-world echocardiogram data analysis shows Spar-Sink can effectively estimate and visualize cardiac cycles, from which one can identify heart failure and arrhythmia. To evaluate the numerical accuracy of cardiac cycle prediction, we consider the task of predicting the end-systole time point using the end-diastole one. Results show Spar-Sink performs as well as the classical Sinkhorn algorithm, requiring significantly less computational time.
△ Less
Submitted 11 June, 2023;
originally announced June 2023.
-
An optimal transport approach for selecting a representative subsample with application in efficient kernel density estimation
Authors:
**gyi Zhang,
Cheng Meng,
Jun Yu,
Mengrui Zhang,
Wenxuan Zhong,
** Ma
Abstract:
Subsampling methods aim to select a subsample as a surrogate for the observed sample. Such methods have been used pervasively in large-scale data analytics, active learning, and privacy-preserving analysis in recent decades. Instead of model-based methods, in this paper, we study model-free subsampling methods, which aim to identify a subsample that is not confined by model assumptions. Existing m…
▽ More
Subsampling methods aim to select a subsample as a surrogate for the observed sample. Such methods have been used pervasively in large-scale data analytics, active learning, and privacy-preserving analysis in recent decades. Instead of model-based methods, in this paper, we study model-free subsampling methods, which aim to identify a subsample that is not confined by model assumptions. Existing model-free subsampling methods are usually built upon clustering techniques or kernel tricks. Most of these methods suffer from either a large computational burden or a theoretical weakness. In particular, the theoretical weakness is that the empirical distribution of the selected subsample may not necessarily converge to the population distribution. Such computational and theoretical limitations hinder the broad applicability of model-free subsampling methods in practice. We propose a novel model-free subsampling method by utilizing optimal transport techniques. Moreover, we develop an efficient subsampling algorithm that is adaptive to the unknown probability density function. Theoretically, we show the selected subsample can be used for efficient density estimation by deriving the convergence rate for the proposed subsample kernel density estimator. We also provide the optimal bandwidth for the proposed estimator. Numerical studies on synthetic and real-world datasets demonstrate the performance of the proposed method is superior.
△ Less
Submitted 31 May, 2022;
originally announced June 2022.
-
Strongly Lech-independent ideals and Lech's conjecture
Authors:
Cheng Meng
Abstract:
We introduce the notion of strongly Lech-independent ideals as a generalization of Lech-independent ideals defined by Lech and Hanes, and use this notion to derive inequalities on multiplicities of ideals. In particular we prove that if $(R,\mathfrak{m}) \to (S,\mathfrak{n})$ is a flat local extension of local rings with $\dim R = \dim S$, the completion of $S$ is the completion of a standard grad…
▽ More
We introduce the notion of strongly Lech-independent ideals as a generalization of Lech-independent ideals defined by Lech and Hanes, and use this notion to derive inequalities on multiplicities of ideals. In particular we prove that if $(R,\mathfrak{m}) \to (S,\mathfrak{n})$ is a flat local extension of local rings with $\dim R = \dim S$, the completion of $S$ is the completion of a standard graded ring over a field $k$ with respect to the homogeneous maximal ideal, and the completion of $\mathfrak{m}S$ is the completion of a homogeneous ideal, then $e(R) \leq e(S)$.
△ Less
Submitted 5 April, 2024; v1 submitted 18 December, 2021;
originally announced December 2021.
-
Local cohomology tables of sequentially almost Cohen-Macaulay modules
Authors:
Cheng Meng
Abstract:
Let $R$ be a polynomial ring over a field. We introduce the concept of sequentially almost Cohen-Macaulay modules and describe the extremal rays of the cone of local cohomology tables of finitely generated graded $R$-modules which are sequentially almost Cohen-Macaulay, and describe some cases when the local cohomology table of a module of dimension 3 has a nontrivial decomposition.
Let $R$ be a polynomial ring over a field. We introduce the concept of sequentially almost Cohen-Macaulay modules and describe the extremal rays of the cone of local cohomology tables of finitely generated graded $R$-modules which are sequentially almost Cohen-Macaulay, and describe some cases when the local cohomology table of a module of dimension 3 has a nontrivial decomposition.
△ Less
Submitted 3 May, 2023; v1 submitted 15 November, 2021;
originally announced November 2021.
-
Large-scale optimal transport map estimation using projection pursuit
Authors:
Cheng Meng,
Yuan Ke,
**gyi Zhang,
Mengrui Zhang,
Wenxuan Zhong,
** Ma
Abstract:
This paper studies the estimation of large-scale optimal transport maps (OTM), which is a well-known challenging problem owing to the curse of dimensionality. Existing literature approximates the large-scale OTM by a series of one-dimensional OTM problems through iterative random projection. Such methods, however, suffer from slow or none convergence in practice due to the nature of randomly selec…
▽ More
This paper studies the estimation of large-scale optimal transport maps (OTM), which is a well-known challenging problem owing to the curse of dimensionality. Existing literature approximates the large-scale OTM by a series of one-dimensional OTM problems through iterative random projection. Such methods, however, suffer from slow or none convergence in practice due to the nature of randomly selected projection directions. Instead, we propose an estimation method of large-scale OTM by combining the idea of projection pursuit regression and sufficient dimension reduction. The proposed method, named projection pursuit Monge map (PPMM), adaptively selects the most ``informative'' projection direction in each iteration. We theoretically show the proposed dimension reduction method can consistently estimate the most ``informative'' projection direction in each iteration. Furthermore, the PPMM algorithm weakly convergences to the target large-scale OTM in a reasonable number of steps. Empirically, PPMM is computationally easy and converges fast. We assess its finite sample performance through the applications of Wasserstein distance estimation and generative models.
△ Less
Submitted 8 June, 2021;
originally announced June 2021.
-
Extended Nestohedra and their Face Numbers
Authors:
Quang Dao,
Christina Meng,
Julian Wellman,
Zixuan Xu,
Calvin Yost-Wolff,
Teresa Yu
Abstract:
Nestohedra are a family of convex polytopes that includes permutohedra, associahedra, and graph associahedra. In this paper, we study an extension of such polytopes, called extended nestohedra. We show that these objects are indeed the boundaries of simple polytopes, answering a question of Lam and Pylyavskyy. We also study the duals of (extended) nestohedra, giving a complete characterization of…
▽ More
Nestohedra are a family of convex polytopes that includes permutohedra, associahedra, and graph associahedra. In this paper, we study an extension of such polytopes, called extended nestohedra. We show that these objects are indeed the boundaries of simple polytopes, answering a question of Lam and Pylyavskyy. We also study the duals of (extended) nestohedra, giving a complete characterization of isomorphisms (as simplicial complexes) between the duals of extended nestohedra and a partial characterization of isomorphisms between the duals of nestohedra and extended nestohedra. In addition, we give formulas for their $f$-, $h$-, and $γ$-vectors. This includes showing that the $f$-vectors of the extended nestohedron corresponding to a forest $F$ and the nestohedron corresponding to the line graph of $F$ are the same, as well as showing that all flag extended nestohedra have nonnegative $γ$-vectors, thus proving Gal's conjecture for a large class of flag simple polytopes. We also relate the $f$- and $h$-vectors of the nestohedra and extended nestohedra, as well as give explicit formulas for the $h$- and $γ$-vectors in terms of descent statistics for a certain class of flag extended nestohedra. Finally, we define a partial ordering on partial permutations that is a join semilattice quotient of the weak Bruhar order on the symmetric group, and such that any linear extension of the partial order provides a shelling of the dual of the stellohedron.
△ Less
Submitted 13 December, 2019; v1 submitted 30 November, 2019;
originally announced December 2019.
-
Krylov Methods for Low-Rank Regularization
Authors:
Silvia Gazzola,
Chang Meng,
James Nagy
Abstract:
This paper introduces new solvers for the computation of low-rank approximate solutions to large-scale linear problems, with a particular focus on the regularization of linear inverse problems. Although Krylov methods incorporating explicit projections onto low-rank subspaces are already used for well-posed systems that arise from discretizing stochastic or time-dependent PDEs, we are mainly conce…
▽ More
This paper introduces new solvers for the computation of low-rank approximate solutions to large-scale linear problems, with a particular focus on the regularization of linear inverse problems. Although Krylov methods incorporating explicit projections onto low-rank subspaces are already used for well-posed systems that arise from discretizing stochastic or time-dependent PDEs, we are mainly concerned with algorithms that solve the so-called nuclear norm regularized problem, where a suitable nuclear norm penalization on the solution is imposed alongside a fit-to-data term expressed in the 2-norm: this has the effect of implicitly enforcing low-rank solutions. By adopting an iteratively reweighted norm approach, the nuclear norm regularized problem is reformulated as a sequence of quadratic problems, which can then be efficiently solved using Krylov methods, giving rise to an inner-outer iteration scheme. Our approach differs from the other solvers available in the literature in that: (a) Kronecker product properties are exploited to define the reweighted 2-norm penalization terms; (b) efficient preconditioned Krylov methods replace gradient (projection) methods; (c) the regularization parameter can be efficiently and adaptively set along the iterations. Furthermore, we reformulate within the framework of flexible Krylov methods both the new inner-outer methods for nuclear norm regularization and some of the existing Krylov methods incorporating low-rank projections. This results in an even more computationally efficient (but heuristic) strategy, that does not rely on an inner-outer iteration scheme. Numerical experiments show that our new solvers are competitive with other state-of-the-art solvers for low-rank problems, and deliver reconstructions of increased quality with respect to other classical Krylov methods.
△ Less
Submitted 3 November, 2019; v1 submitted 23 October, 2019;
originally announced October 2019.
-
Hardy type inequalities on closed manifolds via Ricci curvature
Authors:
Canjun Meng,
Han Wang,
Wei Zhao
Abstract:
The paper is devoted to Hardy type inequalities on closed manifolds. By means of various weighted Ricci curvatures, we establish several sharp Hardy type inequalities on closed weighted Riemannian manifolds. Our results complement in several aspects those obtained recently in the noncompact Riemannian setting.
The paper is devoted to Hardy type inequalities on closed manifolds. By means of various weighted Ricci curvatures, we establish several sharp Hardy type inequalities on closed weighted Riemannian manifolds. Our results complement in several aspects those obtained recently in the noncompact Riemannian setting.
△ Less
Submitted 6 October, 2019;
originally announced October 2019.
-
G-graded irreducibility and the index of reducibility
Authors:
Cheng Meng
Abstract:
Let $R$ be a commutative Noetherian ring graded by a torsionfree abelian group $G$. We introduce the notion of $G$-graded irreducibility and prove that $G$-graded irreducibility is equivalent to irreducibility in the usual sense. This is a generalization of Chen and Kim's result in the $\mathbb{Z}$-graded case. We also discuss the concept of the index of reducibility and give an inequality for the…
▽ More
Let $R$ be a commutative Noetherian ring graded by a torsionfree abelian group $G$. We introduce the notion of $G$-graded irreducibility and prove that $G$-graded irreducibility is equivalent to irreducibility in the usual sense. This is a generalization of Chen and Kim's result in the $\mathbb{Z}$-graded case. We also discuss the concept of the index of reducibility and give an inequality for the indices of reducibility between any radical non-graded ideal and its largest graded subideal.
△ Less
Submitted 16 December, 2018;
originally announced December 2018.
-
Singular Value Decomposition Approximation via Kronecker Summations for Imaging Applications
Authors:
Clarissa Garvey,
Chang Meng,
James G. Nagy
Abstract:
In this paper we propose an approach to approximate a truncated singular value decomposition of a large structured matrix. By first decomposing the matrix into a sum of Kronecker products, our approach can be used to approximate a large number of singular values and vectors more efficiently than other well known schemes, such as randomized matrix algorithms or iterative algorithms based on Golub-K…
▽ More
In this paper we propose an approach to approximate a truncated singular value decomposition of a large structured matrix. By first decomposing the matrix into a sum of Kronecker products, our approach can be used to approximate a large number of singular values and vectors more efficiently than other well known schemes, such as randomized matrix algorithms or iterative algorithms based on Golub-Kahan bidiagonalization. We provide theoretical results and numerical experiments to demonstrate the accuracy of our approximation and show how the approximation can be used to solve large scale ill-posed inverse problems, either as an approximate filtering method, or as a preconditioner to accelerate iterative algorithms.
△ Less
Submitted 2 April, 2018; v1 submitted 30 March, 2018;
originally announced March 2018.