-
On the invertibility of matrices with a double saddle-point structure
Authors:
Fatemeh P. A. Beik,
Chen Greif,
Manfred Trummer
Abstract:
We establish necessary and sufficient conditions for invertibility of symmetric three-by-three block matrices having a double saddle-point structure \fb{that guarantee the unique solvability of double saddle-point systems}. We consider various scenarios, including the case where all diagonal blocks are allowed to be rank deficient. Under certain conditions related to the nullity of the blocks and…
▽ More
We establish necessary and sufficient conditions for invertibility of symmetric three-by-three block matrices having a double saddle-point structure \fb{that guarantee the unique solvability of double saddle-point systems}. We consider various scenarios, including the case where all diagonal blocks are allowed to be rank deficient. Under certain conditions related to the nullity of the blocks and intersections of their kernels, an explicit formula for the inverse is derived.
△ Less
Submitted 2 July, 2024; v1 submitted 26 April, 2024;
originally announced April 2024.
-
The Kolmogorov N-width for linear transport: Exact representation and the influence of the data
Authors:
Florian Arbes,
Constantin Greif,
Karsten Urban
Abstract:
The Kolmogorov $N$-width describes the best possible error one can achieve by elements of an $N$-dimensional linear space. Its decay has extensively been studied in Approximation Theory and for the solution of Partial Differential Equations (PDEs). Particular interest has occurred within Model Order Reduction (MOR) of parameterized PDEs e.g.\ by the Reduced Basis Method (RBM).
While it is known…
▽ More
The Kolmogorov $N$-width describes the best possible error one can achieve by elements of an $N$-dimensional linear space. Its decay has extensively been studied in Approximation Theory and for the solution of Partial Differential Equations (PDEs). Particular interest has occurred within Model Order Reduction (MOR) of parameterized PDEs e.g.\ by the Reduced Basis Method (RBM).
While it is known that the $N$-width decays exponentially fast (and thus admits efficient MOR) for certain problems, there are examples of the linear transport and the wave equation, where the decay rate deteriorates to $N^{-1/2}$. On the other hand, it is widely accepted that a smooth parameter dependence admits a fast decay of the $N$-width. However, a detailed analysis of the influence of properties of the data (such as regularity or slope) on the rate of the $N$-width seems to lack.
In this paper, we use techniques from Fourier Analysis to derive exact representations of the $N$-width in terms of initial and boundary conditions of the linear transport equation modeled by some function $g$ for half-wave symmetric data. For arbitrary functions $g$, we derive bounds and prove that these bounds are sharp. In particular, we prove that the $N$-width decays as ${c_r N^{-r}}$ for functions {with Sobolev regularity} $g\in H^{r{-\varepsilon}}$ for all $\varepsilon>0$ even if $g\not\in H^{r}$. Our theoretical investigations are complemented by numerical experiments which confirm the sharpness of our bounds and give additional quantitative insight.
△ Less
Submitted 31 January, 2024; v1 submitted 28 April, 2023;
originally announced May 2023.
-
Block Preconditioners for the Marker-and-Cell Discretization of the Stokes-Darcy Equations
Authors:
Chen Greif,
Yunhui He
Abstract:
We consider the problem of iteratively solving large and sparse double saddle-point systems arising from the stationary Stokes-Darcy equations in two dimensions, discretized by the Marker-and-Cell (MAC) finite difference method. We analyze the eigenvalue distribution of a few ideal block preconditioners. We then derive practical preconditioners that are based on approximations of Schur complements…
▽ More
We consider the problem of iteratively solving large and sparse double saddle-point systems arising from the stationary Stokes-Darcy equations in two dimensions, discretized by the Marker-and-Cell (MAC) finite difference method. We analyze the eigenvalue distribution of a few ideal block preconditioners. We then derive practical preconditioners that are based on approximations of Schur complements that arise in a block decomposition of the double saddle-point matrix. We show that including the interface conditions in the preconditioners is key in the pursuit of scalability. Numerical results show good convergence behavior of our preconditioned GMRES solver and demonstrate robustness of the proposed preconditioner with respect to the physical parameters of the problem.
△ Less
Submitted 24 February, 2023; v1 submitted 25 August, 2022;
originally announced August 2022.
-
Augmentation-Based Preconditioners for Saddle-Point Systems with Singular Leading Blocks
Authors:
Susanne Bradley,
Chen Greif
Abstract:
We consider the iterative solution of symmetric saddle-point matrices with a singular leading block. We develop a new ideal positive definite block diagonal preconditioner that yields a preconditioned operator with four distinct eigenvalues. We offer a few techniques for making the preconditioner practical, and illustrate the effectiveness of our approach with numerical experiments.
We consider the iterative solution of symmetric saddle-point matrices with a singular leading block. We develop a new ideal positive definite block diagonal preconditioner that yields a preconditioned operator with four distinct eigenvalues. We offer a few techniques for making the preconditioner practical, and illustrate the effectiveness of our approach with numerical experiments.
△ Less
Submitted 27 June, 2022;
originally announced June 2022.
-
Eigenvalue Bounds for Saddle-Point Systems with Singular Leading Blocks
Authors:
Susanne Bradley,
Chen Greif
Abstract:
We derive bounds on the eigenvalues of saddle-point matrices with singular leading blocks. The technique of proof is based on augmentation. Our bounds depend on the principal angles between the ranges or kernels of the matrix blocks. Numerical experiments validate our analytical findings.
We derive bounds on the eigenvalues of saddle-point matrices with singular leading blocks. The technique of proof is based on augmentation. Our bounds depend on the principal angles between the ranges or kernels of the matrix blocks. Numerical experiments validate our analytical findings.
△ Less
Submitted 30 May, 2022;
originally announced May 2022.
-
A note on using the mass matrix as a preconditioner for the Poisson equation
Authors:
Chen Greif,
Yunhui He
Abstract:
We show that the mass matrix derived from finite elements can be effectively used as a preconditioner for iteratively solving the linear system arising from finite-difference discretization of the Poisson equation, using the conjugate gradient method. We derive analytically the condition number of the preconditioned operator. Theoretical analysis shows that the ratio of the condition number of the…
▽ More
We show that the mass matrix derived from finite elements can be effectively used as a preconditioner for iteratively solving the linear system arising from finite-difference discretization of the Poisson equation, using the conjugate gradient method. We derive analytically the condition number of the preconditioned operator. Theoretical analysis shows that the ratio of the condition number of the Laplacian to the preconditioned operator is $8/3$ in one dimension, $9/2$ in two dimensions, and $2^9/3^4 \approx 6.3$ in three dimensions. From this it follows that the expected iteration count for achieving a fixed reduction of the norm of the residual is smaller than a half of the number of the iterations of unpreconditioned CG in 2D and 3D. The scheme is easy to implement, and numerical experiments show its efficiency.
△ Less
Submitted 4 November, 2021;
originally announced November 2021.
-
A closed-form multigrid smoothing factor for an additive Vanka-type smoother applied to the Poisson equation
Authors:
Chen Greif,
Yunhui He
Abstract:
We consider an additive Vanka-type smoother for the Poisson equation discretized by the standard finite difference centered scheme. Using local Fourier analysis, we derive analytical formulas for the optimal smoothing factors for two types of smoothers, called vertex-wise and element-wise Vanka smoothers, and present the corresponding stencils. Interestingly, in one dimension the element-wise Vank…
▽ More
We consider an additive Vanka-type smoother for the Poisson equation discretized by the standard finite difference centered scheme. Using local Fourier analysis, we derive analytical formulas for the optimal smoothing factors for two types of smoothers, called vertex-wise and element-wise Vanka smoothers, and present the corresponding stencils. Interestingly, in one dimension the element-wise Vanka smoother is equivalent to the scaled mass operator obtained from the linear finite element method, and in two dimensions the element-wise Vanka smoother is equivalent to the scaled mass operator discretized by bilinear finite element method plus a scaled identity operator. Based on these discoveries, the mass matrix obtained from finite element method can be used as an approximation to the inverse of the Laplacian, and the resulting mass-based relaxation scheme features small smoothing factors in one, two, and three dimensions. Advantages of the mass operator are that the operator is sparse and well conditioned, and the computational cost of the relaxation scheme is only one matrix-vector product; there is no need to compute the inverse of a matrix. These findings may help better understand the efficiency of additive Vanka smoothers and develop fast solvers for numerical solutions of partial differential equations.
△ Less
Submitted 4 November, 2021;
originally announced November 2021.
-
Eigenvalue Bounds for Double Saddle-Point Systems
Authors:
Susanne Bradley,
Chen Greif
Abstract:
We derive bounds on the eigenvalues of a generic form of double saddle-point matrices. The bounds are expressed in terms of extremal eigenvalues and singular values of the associated block matrices. Inertia and algebraic multiplicity of eigenvalues are considered as well. The analysis includes bounds for preconditioned matrices based on block diagonal preconditioners using Schur complements, and i…
▽ More
We derive bounds on the eigenvalues of a generic form of double saddle-point matrices. The bounds are expressed in terms of extremal eigenvalues and singular values of the associated block matrices. Inertia and algebraic multiplicity of eigenvalues are considered as well. The analysis includes bounds for preconditioned matrices based on block diagonal preconditioners using Schur complements, and it is shown that in this case the eigenvalues are clustered within a few intervals bounded away from zero. Analysis for approximations of Schur complements is included. Some numerical experiments validate our analytical findings.
△ Less
Submitted 14 February, 2022; v1 submitted 25 October, 2021;
originally announced October 2021.
-
HSS(0): an Improved Hermitian/Skew-Hermitian Splitting Iteration
Authors:
Chen Greif,
Yunhui He
Abstract:
We propose an improved version of the Hermitian/skew-Hermitian splitting (HSS) iterative method, which we call HSS(0), to solve non-Hermitian linear systems with a positive definite Hermitian part. The improvement is based on solving the Hermitian half iteration without a shift, and applying a shift only for the skew-Hermitian solve. An optimal parameter is derived analytically, and a correspondin…
▽ More
We propose an improved version of the Hermitian/skew-Hermitian splitting (HSS) iterative method, which we call HSS(0), to solve non-Hermitian linear systems with a positive definite Hermitian part. The improvement is based on solving the Hermitian half iteration without a shift, and applying a shift only for the skew-Hermitian solve. An optimal parameter is derived analytically, and a corresponding upper bound on the convergence speed is obtained. Using a combination of analytical proofs and numerical validations, we show that HSS(0) yields a dramatically faster convergence speed than standard HSS. Furthermore, HSS(0) is much less sensitive to the choice of the parameter. Numerical experiments on a convection-diffusion model problem in two and three dimensions illustrate the high efficiency of HSS(0).
△ Less
Submitted 29 September, 2021; v1 submitted 27 September, 2021;
originally announced September 2021.
-
Linear/Ridge expansions: Enhancing linear approximations by ridge functions
Authors:
Constantin Greif,
Philipp Junk,
Karsten Urban
Abstract:
We consider approximations formed by the sum of a linear combination of given functions enhanced by ridge functions -- a Linear/Ridge expansion. For an explicitly or implicitly given function, we reformulate finding a best Linear/Ridge expansion in terms of an optimization problem. We introduce a particle grid algorithm for its solution. Several numerical results underline the flexibility, robustn…
▽ More
We consider approximations formed by the sum of a linear combination of given functions enhanced by ridge functions -- a Linear/Ridge expansion. For an explicitly or implicitly given function, we reformulate finding a best Linear/Ridge expansion in terms of an optimization problem. We introduce a particle grid algorithm for its solution. Several numerical results underline the flexibility, robustness and efficiency of the algorithm.
One particular source of motivation is model reduction of parameterized transport or wave equations. We show that the particle grid algorithm is able to produce a Linear/Ridge expansion as an efficient nonlinear model reduction.
△ Less
Submitted 9 July, 2021;
originally announced July 2021.
-
An Efficient Modal-based Approach Towards Guzheng Sound Synthesis
Authors:
Enda Zhang,
Gopal Gupta,
Charles Greif,
Andrew Paplinski
Abstract:
Encouraged by recent interest in traditional Chinese instruments this work proposes a computational sound synthesis model for a traditional Chinese instrument, the guzheng. Digital waveguide model and modal synthesis are the most popular physical modelling methods. However, the excitation signal is usually over-simplified and the design of some digital filters is inadequate for real-time synthesis…
▽ More
Encouraged by recent interest in traditional Chinese instruments this work proposes a computational sound synthesis model for a traditional Chinese instrument, the guzheng. Digital waveguide model and modal synthesis are the most popular physical modelling methods. However, the excitation signal is usually over-simplified and the design of some digital filters is inadequate for real-time synthesis. We propose an accurate and efficient approach to synthesise the string signal of the guzheng. Our proposed model enables accurate parametric control of the pluck because the parameters are based on physical model of the instrument. The sound of the guzheng is then computed as the convolution of the synthesised string signal and the impulse response of the resonant body. As proof of concept, the 21st string of the guzheng is synthesised using the proposed model. The sound computed using our model shows improved accuracy with an acceptable computational complexity.
△ Less
Submitted 11 October, 2019;
originally announced October 2019.
-
Decay of the Kolmogorov $N$-width for wave problems
Authors:
Constantin Greif,
Karsten Urban
Abstract:
The Kolmogorov $N$-width $d_N(\mathcal{M})$ describes the rate of the worst-case error (w.r.t.\ a subset $\mathcal{M}\subset H$ of a normed space $H$) arising from a projection onto the best-possible linear subspace of $H$ of dimension $N\in\mathbb{N}$. Thus, $d_N(\mathcal{M})$ sets a limit to any projection-based approximation such as determined by the reduced basis method. While it is known that…
▽ More
The Kolmogorov $N$-width $d_N(\mathcal{M})$ describes the rate of the worst-case error (w.r.t.\ a subset $\mathcal{M}\subset H$ of a normed space $H$) arising from a projection onto the best-possible linear subspace of $H$ of dimension $N\in\mathbb{N}$. Thus, $d_N(\mathcal{M})$ sets a limit to any projection-based approximation such as determined by the reduced basis method. While it is known that $d_N(\mathcal{M})$ decays exponentially fast for many linear coercive parametrized partial differential equations, i.e., $d_N(\mathcal{M})=\mathcal{O}(e^{-βN})$, we show in this note, that only $d_N(\mathcal{M}) =\mathcal{O}(N^{-1/2})$ for initial-boundary-value problems of the hyperbolic wave equation with discontinuous initial conditions. This is aligned with the known slow decay of $d_N(\mathcal{M})$ for the linear transport problem.
△ Less
Submitted 10 April, 2019; v1 submitted 20 March, 2019;
originally announced March 2019.
-
SYM-ILDL: Incomplete $LDL^{T}$ Factorization of Symmetric Indefinite and Skew-Symmetric Matrices
Authors:
Chen Greif,
Shiwen He,
Paul Liu
Abstract:
SYM-ILDL is a numerical software package that computes incomplete $LDL^{T}$ (or `ILDL') factorizations of symmetric indefinite and real skew-symmetric matrices. The core of the algorithm is a Crout variant of incomplete LU (ILU), originally introduced and implemented for symmetric matrices by [Li and Saad, Crout versions of ILU factorization with pivoting for sparse symmetric matrices, Transaction…
▽ More
SYM-ILDL is a numerical software package that computes incomplete $LDL^{T}$ (or `ILDL') factorizations of symmetric indefinite and real skew-symmetric matrices. The core of the algorithm is a Crout variant of incomplete LU (ILU), originally introduced and implemented for symmetric matrices by [Li and Saad, Crout versions of ILU factorization with pivoting for sparse symmetric matrices, Transactions on Numerical Analysis 20, pp. 75--85, 2005]. Our code is economical in terms of storage and it deals with real skew-symmetric matrices as well, in addition to symmetric ones. The package is written in C++ and it is templated, open source, and includes a MATLAB interface. The code includes built-in RCM and AMD reordering, two equilibration strategies, threshold Bunch-Kaufman pivoting and rook pivoting, as well as a wrapper to MC64, a popular matching based equilibration and reordering algorithm. We also include two built-in iterative solvers: SQMR preconditioned with ILDL, or MINRES preconditioned with a symmetric positive definite preconditioner based on the ILDL factorization.
△ Less
Submitted 1 November, 2016; v1 submitted 28 May, 2015;
originally announced May 2015.
-
Fast matrix computations for pair-wise and column-wise commute times and Katz scores
Authors:
Francesco Bonchi,
Pooya Esfandiar,
David F. Gleich,
Chen Greif,
Laks V. S. Lakshmanan
Abstract:
We first explore methods for approximating the commute time and Katz score between a pair of nodes. These methods are based on the approach of matrices, moments, and quadrature developed in the numerical linear algebra community. They rely on the Lanczos process and provide upper and lower bounds on an estimate of the pair-wise scores. We also explore methods to approximate the commute times and K…
▽ More
We first explore methods for approximating the commute time and Katz score between a pair of nodes. These methods are based on the approach of matrices, moments, and quadrature developed in the numerical linear algebra community. They rely on the Lanczos process and provide upper and lower bounds on an estimate of the pair-wise scores. We also explore methods to approximate the commute times and Katz scores from a node to all other nodes in the graph. Here, our approach for the commute times is based on a variation of the conjugate gradient algorithm, and it provides an estimate of all the diagonals of the inverse of a matrix. Our technique for the Katz scores is based on exploiting an empirical localization property of the Katz matrix. We adopt algorithms used for personalized PageRank computing to these Katz scores and theoretically show that this approach is convergent. We evaluate these methods on 17 real world graphs ranging in size from 1000 to 1,000,000 nodes. Our results show that our pair-wise commute time method and column-wise Katz algorithm both have attractive theoretical properties and empirical performance.
△ Less
Submitted 19 April, 2011;
originally announced April 2011.
-
The power and Arnoldi methods in an algebra of circulants
Authors:
David F. Gleich,
Chen Greif,
James M. Varah
Abstract:
Circulant matrices play a central role in a recently proposed formulation of three-way data computations. In this setting, a three-way table corresponds to a matrix where each "scalar" is a vector of parameters defining a circulant. This interpretation provides many generalizations of results from matrix or vector-space algebra. We derive the power and Arnoldi methods in this algebra. In the cours…
▽ More
Circulant matrices play a central role in a recently proposed formulation of three-way data computations. In this setting, a three-way table corresponds to a matrix where each "scalar" is a vector of parameters defining a circulant. This interpretation provides many generalizations of results from matrix or vector-space algebra. We derive the power and Arnoldi methods in this algebra. In the course of our derivation, we define inner products, norms, and other notions. These extensions are straightforward in an algebraic sense, but the implications are dramatically different from the standard matrix case. For example, a matrix of circulants has a polynomial number of eigenvalues in its dimension; although, these can all be represented by a carefully chosen canonical set of eigenvalues and vectors. These results and algorithms are closely related to standard decoupling techniques on block-circulant matrices using the fast Fourier transform.
△ Less
Submitted 11 January, 2011;
originally announced January 2011.
