-
ResQPASS: an algorithm for bounded variable linear least squares with asymptotic Krylov convergence
Authors:
Bas Symoens,
Wim Vanroose
Abstract:
We present the Residual Quadratic Programming Active-Set Subspace (ResQPASS) method that solves large-scale linear least-squares problems with bound constraints on the variables. The problem is solved by creating a series of small problems of increasing size by projecting on the basis of residuals. Each projected problem is solved by the active-set method for convex quadratic programming, warm-sta…
▽ More
We present the Residual Quadratic Programming Active-Set Subspace (ResQPASS) method that solves large-scale linear least-squares problems with bound constraints on the variables. The problem is solved by creating a series of small problems of increasing size by projecting on the basis of residuals. Each projected problem is solved by the active-set method for convex quadratic programming, warm-started with a working set and solution of the previous problem. The method coincides with conjugate gradients (CG) or, equivalently, LSQR applied to the normal equations when none of the constraints is active. When only a few constraints are active the method converges, after a few initial iterations, like the CG and LSQR. An analysis links the convergence to an asymptotic Krylov subspace. We also present an efficient implementation where QR factorizations of the projected are updated over the inner iterations and Cholesky over the outer iterations.
△ Less
Submitted 6 March, 2024; v1 submitted 27 February, 2023;
originally announced February 2023.
-
Solving for the low-rank tensor components of a scattering wave function
Authors:
Jacob Snoeijer,
Wim Vanroose
Abstract:
Atomic and molecular breakup reactions, such as multiple-ionisation, are described by a driven Schrödinger equation. This equation is equivalent to a high-dimensional Helmholtz equation and it has solutions that are outgoing waves, emerging from the target. We show that these waves can be described by a low-rank approximation. For 2D problems this it a matrix product of two low-rank matrices, for…
▽ More
Atomic and molecular breakup reactions, such as multiple-ionisation, are described by a driven Schrödinger equation. This equation is equivalent to a high-dimensional Helmholtz equation and it has solutions that are outgoing waves, emerging from the target. We show that these waves can be described by a low-rank approximation. For 2D problems this it a matrix product of two low-rank matrices, for 3D problems it is a low-rank tensor decomposition. We propose an iterative method that solves, in an alternating way, for these low-rank components of the scattered wave. We illustrate the method with examples in 2D and 3D.
△ Less
Submitted 21 March, 2022;
originally announced March 2022.
-
Sequential Projected Newton method for regularization of nonlinear least squares problems
Authors:
Jeffrey Cornelis,
Wim Vanroose
Abstract:
We develop a computationally efficient algorithm for the automatic regularization of nonlinear inverse problems based on the discrepancy principle. We formulate the problem as an equality constrained optimization problem, where the constraint is given by a least squares data fidelity term and expresses the discrepancy principle. The objective function is a convex regularization function that incor…
▽ More
We develop a computationally efficient algorithm for the automatic regularization of nonlinear inverse problems based on the discrepancy principle. We formulate the problem as an equality constrained optimization problem, where the constraint is given by a least squares data fidelity term and expresses the discrepancy principle. The objective function is a convex regularization function that incorporates some prior knowledge, such as the total variation regularization function. Using the Jacobian matrix of the nonlinear forward model, we consider a sequence of quadratically constrained optimization problems that can all be solved using the Projected Newton method. We show that the solution of such a quadratically constrained sub-problem results in a descent direction for an exact merit function. This merit function can then be used to describe a formal line-search method. We also formulate a slightly more heuristic approach that simplifies the algorithm and allows for an inexact solution of the sequence of sub-problems. We illustrate the behavior of the algorithm using a number of numerical experiments, with Talbot-Lau X-ray phase contrast imaging as the main application. The numerical experiments confirm that the quadratically constrained sub-problems need not be solved with high accuracy in early iterations to make sufficient progress towards the solution. In addition, we show that the proposed method is able to produce reconstructions of similar quality compared to other state-of-the-art approaches with a significant reduction in computational time.
△ Less
Submitted 2 September, 2021; v1 submitted 11 May, 2021;
originally announced May 2021.
-
Convergence analysis of a regularized inexact interior-point method for linear programming problems
Authors:
Jeffrey Cornelis,
Wim Vanroose
Abstract:
Interior-point methods for linear programming problems require the repeated solution of a linear system of equations. Solving these linear systems is non-trivial due to the severe ill-conditioning of the matrices towards convergence. This issue can be alleviated by incorporating suitable regularization terms in the linear programming problem. Regularization also allows us to efficiently handle ran…
▽ More
Interior-point methods for linear programming problems require the repeated solution of a linear system of equations. Solving these linear systems is non-trivial due to the severe ill-conditioning of the matrices towards convergence. This issue can be alleviated by incorporating suitable regularization terms in the linear programming problem. Regularization also allows us to efficiently handle rank deficient constraint matrices. We provide a convergence analysis of a regularized inexact interior-point method. The term `inexact' refers to the fact that we do not need to compute the true solution of the linear system of equations, only an approximation thereof. The formulation of the algorithm is sufficiently general such that specialized linear algebra routines developed in other work on inexact interior-point methods can also be incorporated in our regularized framework. In this work, we exploit the inexactness by using a mixed-precision solver for the linear system of equations. More specifically, we perform a Cholesky factorization in IEEE single precision and use it as a preconditioner for the Conjugate Gradient method. Numerical experiments illustrate the benefits of this approach applied to linear programming problems with a dense constraint matrix.
△ Less
Submitted 4 May, 2021;
originally announced May 2021.
-
Krylov-Simplex method that minimizes the residual in $\ell_1$-norm or $\ell_\infty$-norm
Authors:
Wim Vanroose,
Jeffrey Cornelis
Abstract:
The paper presents two variants of a Krylov-Simplex iterative method that combines Krylov and simplex iterations to minimize the residual $r = b-Ax$. The first method minimizes $\|r\|_\infty$, i.e. maximum of the absolute residuals. The second minimizes $\|r\|_1$, and finds the solution with the least absolute residuals. Both methods search for an optimal solution $x_k$ in a Krylov subspace which…
▽ More
The paper presents two variants of a Krylov-Simplex iterative method that combines Krylov and simplex iterations to minimize the residual $r = b-Ax$. The first method minimizes $\|r\|_\infty$, i.e. maximum of the absolute residuals. The second minimizes $\|r\|_1$, and finds the solution with the least absolute residuals. Both methods search for an optimal solution $x_k$ in a Krylov subspace which results in a small linear programming problem. A specialized simplex algorithm solves this projected problem and finds the optimal linear combination of Krylov basis vectors to approximate the solution. The resulting simplex algorithm requires the solution of a series of small dense linear systems that only differ by rank-one updates. The $QR$ factorization of these matrices is updated each iteration. We demonstrate the effectiveness of the methods with numerical experiments.
△ Less
Submitted 27 January, 2021;
originally announced January 2021.
-
Projected Newton method for noise constrained $\ell_p$ regularization
Authors:
Jeffrey Cornelis,
Wim Vanroose
Abstract:
Choosing an appropriate regularization term is necessary to obtain a meaningful solution to an ill-posed linear inverse problem contaminated with measurement errors or noise. The $\ell_p$ norm covers a wide range of choices for the regularization term since its behavior critically depends on the choice of $p$ and since it can easily be combined with a suitable regularization matrix. We develop an…
▽ More
Choosing an appropriate regularization term is necessary to obtain a meaningful solution to an ill-posed linear inverse problem contaminated with measurement errors or noise. The $\ell_p$ norm covers a wide range of choices for the regularization term since its behavior critically depends on the choice of $p$ and since it can easily be combined with a suitable regularization matrix. We develop an efficient algorithm that simultaneously determines the regularization parameter and corresponding $\ell_p$ regularized solution such that the discrepancy principle is satisfied. We project the problem on a low-dimensional Generalized Krylov subspace and compute the Newton direction for this much smaller problem. We illustrate some interesting properties of the algorithm and compare its performance with other state-of-the-art approaches using a number of numerical experiments, with a special focus of the sparsity inducing $\ell_1$ norm and edge-preserving total variation regularization.
△ Less
Submitted 31 July, 2020; v1 submitted 6 May, 2020;
originally announced May 2020.
-
Projected Newton Method for noise constrained Tikhonov regularization
Authors:
Jeffrey Cornelis,
Nick Schenkels,
Wim Vanroose
Abstract:
Tikhonov regularization is a popular approach to obtain a meaningful solution for ill-conditioned linear least squares problems. A relatively simple way of choosing a good regularization parameter is given by Morozov's discrepancy principle. However, most approaches require the solution of the Tikhonov problem for many different values of the regularization parameter, which is computationally dema…
▽ More
Tikhonov regularization is a popular approach to obtain a meaningful solution for ill-conditioned linear least squares problems. A relatively simple way of choosing a good regularization parameter is given by Morozov's discrepancy principle. However, most approaches require the solution of the Tikhonov problem for many different values of the regularization parameter, which is computationally demanding for large scale problems. We propose a new and efficient algorithm which simultaneously solves the Tikhonov problem and finds the corresponding regularization parameter such that the discrepancy principle is satisfied. We achieve this by formulating the problem as a nonlinear system of equations and solving this system using a line search method. We obtain a good search direction by projecting the problem onto a low dimensional Krylov subspace and computing the Newton direction for the projected problem. This projected Newton direction, which is significantly less computationally expensive to calculate than the true Newton direction, is then combined with a backtracking line search to obtain a globally convergent algorithm, which we refer to as the Projected Newton method. We prove convergence of the algorithm and illustrate the improved performance over current state-of-the-art solvers with some numerical experiments.
△ Less
Submitted 30 April, 2020; v1 submitted 18 October, 2019;
originally announced October 2019.
-
Algorithm for the reconstruction of dynamic objects in CT-scanning using optical flow
Authors:
Koen Ruymbeek,
Wim Vanroose
Abstract:
Computed Tomography is a powerful imaging technique that allows non-destructive visualization of the interior of physical objects in different scientific areas. In traditional reconstruction techniques the object of interest is mostly considered to be static, which gives artefacts if the object is moving during the data acquisition. In this paper we present a method that, given only scan results o…
▽ More
Computed Tomography is a powerful imaging technique that allows non-destructive visualization of the interior of physical objects in different scientific areas. In traditional reconstruction techniques the object of interest is mostly considered to be static, which gives artefacts if the object is moving during the data acquisition. In this paper we present a method that, given only scan results of multiple successive scans, can estimate the motion and correct the CT-images for this motion assuming that the motion field is smooth over the complete domain using optical flow. The proposed method is validated on simulated scan data. The main contribution is that we show we can use the optical flow technique from imaging to correct CT-scan images for motion.
△ Less
Submitted 17 April, 2019;
originally announced May 2019.
-
Automatic exploration techniques for the numerical bifurcation study of the Ginzburg-Landau equation
Authors:
Michiel Wouters,
Wim Vanroose
Abstract:
This paper considers the extreme type-II Ginzburg-Landau equations, a nonlinear PDE model that describes the states of a wide range of superconductors. For two-dimensional grids, a robust method is developed that performs a numerical continuation of the equations, automatically exploring the whole solution landscape. The strength of the applied magnetic field is used as the bifurcation parameter.…
▽ More
This paper considers the extreme type-II Ginzburg-Landau equations, a nonlinear PDE model that describes the states of a wide range of superconductors. For two-dimensional grids, a robust method is developed that performs a numerical continuation of the equations, automatically exploring the whole solution landscape. The strength of the applied magnetic field is used as the bifurcation parameter. Our branch switching algorithm is based on Lyapunov-Schmidt reduction, but we will show that for an important class of grids an alternative method based on the equivariant branching lemma can be applied as well. The complete algorithm has been implemented in Python and tested for multiple examples. For each example a complete solution landscape was constructed, showing the robustness of the algorithm.
△ Less
Submitted 6 March, 2019;
originally announced March 2019.
-
Numerically Stable Recurrence Relations for the Communication Hiding Pipelined Conjugate Gradient Method
Authors:
Siegfried Cools,
Jeffrey Cornelis,
Wim Vanroose
Abstract:
Pipelined Krylov subspace methods (also referred to as communication-hiding methods) have been proposed in the literature as a scalable alternative to classic Krylov subspace algorithms for iteratively computing the solution to a large linear system in parallel. For symmetric and positive definite system matrices the pipelined Conjugate Gradient method outperforms its classic Conjugate Gradient co…
▽ More
Pipelined Krylov subspace methods (also referred to as communication-hiding methods) have been proposed in the literature as a scalable alternative to classic Krylov subspace algorithms for iteratively computing the solution to a large linear system in parallel. For symmetric and positive definite system matrices the pipelined Conjugate Gradient method outperforms its classic Conjugate Gradient counterpart on large scale distributed memory hardware by overlap** global communication with essential computations like the matrix-vector product, thus hiding global communication. A well-known drawback of the pipelining technique is the (possibly significant) loss of numerical stability. In this work a numerically stable variant of the pipelined Conjugate Gradient algorithm is presented that avoids the propagation of local rounding errors in the finite precision recurrence relations that construct the Krylov subspace basis. The multi-term recurrence relation for the basis vector is replaced by two-term recurrences, improving stability without increasing the overall computational cost of the algorithm. The proposed modification ensures that the pipelined Conjugate Gradient method is able to attain a highly accurate solution independently of the pipeline length. Numerical experiments demonstrate a combination of excellent parallel performance and improved maximal attainable accuracy for the new pipelined Conjugate Gradient algorithm. This work thus resolves one of the major practical restrictions for the useability of pipelined Krylov subspace methods.
△ Less
Submitted 15 May, 2019; v1 submitted 8 February, 2019;
originally announced February 2019.
-
Projected Newton method for a system of Tikhonov-Morozov equations
Authors:
Nick Schenkels,
Wim Vanroose
Abstract:
In this paper we derive a Newton type method to solve the non-linear system formed by combining the Tikhonov normal equations and Morozov's discrepancy principle. We prove that by placing a bound on the step size of the Newton iterations the method will always converge to the solution. By projecting the problem onto a low dimensional Krylov subspace and using the method to solve the projected non-…
▽ More
In this paper we derive a Newton type method to solve the non-linear system formed by combining the Tikhonov normal equations and Morozov's discrepancy principle. We prove that by placing a bound on the step size of the Newton iterations the method will always converge to the solution. By projecting the problem onto a low dimensional Krylov subspace and using the method to solve the projected non-linear system we show that we can reduce the computational cost of the method.
△ Less
Submitted 5 September, 2018;
originally announced September 2018.
-
Regula falsi based automatic regularization method for PDE constrained optimization
Authors:
Nick Schenkels,
Wim Vanroose
Abstract:
Many inverse problems can be described by a PDE model with unknown parameters that need to be calibrated based on measurements related to its solution. This can be seen as a constrained minimization problem where one wishes to minimize the mismatch between the observed data and the model predictions, including an extra regularization term, and use the PDE as a constraint. Often, a suitable regular…
▽ More
Many inverse problems can be described by a PDE model with unknown parameters that need to be calibrated based on measurements related to its solution. This can be seen as a constrained minimization problem where one wishes to minimize the mismatch between the observed data and the model predictions, including an extra regularization term, and use the PDE as a constraint. Often, a suitable regularization parameter is determined by solving the problem for a whole range of parameters -- e.g. using the L-curve -- which is computationally very expensive. In this paper we derive two methods that simultaneously solve the inverse problem and determine a suitable value for the regularization parameter. The first one is a direct generalization of the Generalized Arnoldi Tikhonov method for linear inverse problems. The second method is a novel method based on similar ideas, but with a number of advantages for nonlinear problems.
△ Less
Submitted 5 September, 2018; v1 submitted 12 April, 2018;
originally announced April 2018.
-
Numerically Stable Variants of the Communication-hiding Pipelined Conjugate Gradients Algorithm for the Parallel Solution of Large Scale Symmetric Linear Systems
Authors:
Siegfried Cools,
Wim Vanroose
Abstract:
By reducing the number of global synchronization bottlenecks per iteration and hiding communication behind useful computational work, pipelined Krylov subspace methods achieve significantly improved parallel scalability on present-day HPC hardware. However, this typically comes at the cost of a reduced maximal attainable accuracy. This paper presents and compares several stabilized versions of the…
▽ More
By reducing the number of global synchronization bottlenecks per iteration and hiding communication behind useful computational work, pipelined Krylov subspace methods achieve significantly improved parallel scalability on present-day HPC hardware. However, this typically comes at the cost of a reduced maximal attainable accuracy. This paper presents and compares several stabilized versions of the communication-hiding pipelined Conjugate Gradients method. The main novel contribution of this work is the reformulation of the multi-term recurrence pipelined CG algorithm by introducing shifts in the recursions for specific auxiliary variables. These shifts reduce the amplification of local rounding errors on the residual. The stability analysis presented in this work provides a rigorous method for selection of the optimal shift value in practice. It is shown that, given a proper choice for the shift parameter, the resulting shifted pipelined CG algorithm restores the attainable accuracy and displays nearly identical robustness to local rounding error propagation compared to classical CG. Numerical results on a variety of SPD benchmark problems compare different stabilization techniques for the pipelined CG algorithm, showing that the shifted pipelined CG algorithm is able to attain a high accuracy while displaying excellent parallel performance.
△ Less
Submitted 6 September, 2018; v1 submitted 19 June, 2017;
originally announced June 2017.
-
Analyzing the effect of local rounding error propagation on the maximal attainable accuracy of the pipelined Conjugate Gradient method
Authors:
Siegfried Cools,
Emrullah Fatih Yetkin,
Emmanuel Agullo,
Luc Giraud,
Wim Vanroose
Abstract:
Pipelined Krylov subspace methods typically offer improved strong scaling on parallel HPC hardware compared to standard Krylov subspace methods for large and sparse linear systems. In pipelined methods the traditional synchronization bottleneck is mitigated by overlap** time-consuming global communications with useful computations. However, to achieve this communication hiding strategy, pipeline…
▽ More
Pipelined Krylov subspace methods typically offer improved strong scaling on parallel HPC hardware compared to standard Krylov subspace methods for large and sparse linear systems. In pipelined methods the traditional synchronization bottleneck is mitigated by overlap** time-consuming global communications with useful computations. However, to achieve this communication hiding strategy, pipelined methods introduce additional recurrence relations for a number of auxiliary variables that are required to update the approximate solution. This paper aims at studying the influence of local rounding errors that are introduced by the additional recurrences in the pipelined Conjugate Gradient method. Specifically, we analyze the impact of local round-off effects on the attainable accuracy of the pipelined CG algorithm and compare to the traditional CG method. Furthermore, we estimate the gap between the true residual and the recursively computed residual used in the algorithm. Based on this estimate we suggest an automated residual replacement strategy to reduce the loss of attainable accuracy on the final iterative solution. The resulting pipelined CG method with residual replacement improves the maximal attainable accuracy of pipelined CG, while maintaining the efficient parallel performance of the pipelined method. This conclusion is substantiated by numerical results for a variety of benchmark problems.
△ Less
Submitted 29 November, 2017; v1 submitted 26 January, 2016;
originally announced January 2016.
-
A Generalized Bidiagonal-Tikhonov Method Applied To Differential Phase Contrast Tomography
Authors:
Nick Schenkels,
Jan Sijbers,
Wim van Aarle,
Wim Vanroose
Abstract:
Phase contrast tomography is an alternative to classic absorption contrast tomography that leads to higher contrast reconstructions in many applications. We review how phase contrast data can be acquired by using a combination of phase and absorption gratings. Using algebraic reconstruction techniques the object can be reconstructed from the measured data. In order to solve the resulting linear sy…
▽ More
Phase contrast tomography is an alternative to classic absorption contrast tomography that leads to higher contrast reconstructions in many applications. We review how phase contrast data can be acquired by using a combination of phase and absorption gratings. Using algebraic reconstruction techniques the object can be reconstructed from the measured data. In order to solve the resulting linear system we propose the Generalized Bidiagonal Tikhonov (GBiT) method, an adaptation of the generalized Arnoldi-Tikhonov method that uses the bidiagonal decomposition of the matrix instead of the Arnoldi decomposition. We also study the effect of the finite difference operator in the model by examining the reconstructions with either a forward difference or a central difference approximation. We validate our conclusions with simulated and experimental data.
△ Less
Submitted 12 October, 2015;
originally announced October 2015.
-
On the optimality of shifted Laplacian in the class of expansion preconditioners for the Helmholtz equation
Authors:
Siegfried Cools,
Wim Vanroose
Abstract:
This paper introduces and explores the class of expansion preconditioners EX(m) that forms a direct generalization to the classic complex shifted Laplace (CSL) preconditioner for Helmholtz problems. The construction of the EX(m) preconditioner is based upon a truncated Taylor series expansion of the original Helmholtz operator inverse. The expansion preconditioner is shown to significantly improve…
▽ More
This paper introduces and explores the class of expansion preconditioners EX(m) that forms a direct generalization to the classic complex shifted Laplace (CSL) preconditioner for Helmholtz problems. The construction of the EX(m) preconditioner is based upon a truncated Taylor series expansion of the original Helmholtz operator inverse. The expansion preconditioner is shown to significantly improve Krylov solver convergence rates for the Helmholtz problem for growing values of the number of series terms m. However, the addition of multiple terms in the expansion also increases the computational cost of applying the preconditioner. A thorough cost-benefit analysis of the addition of extra terms in the EX(m) preconditioner proves that the CSL or EX(1) preconditioner is the practically most efficient member of the expansion preconditioner class. Additionally, possible extensions to the expansion preconditioner class that further increase preconditioner efficiency are suggested.
△ Less
Submitted 23 December, 2016; v1 submitted 19 January, 2015;
originally announced January 2015.
-
Localised auxin peaks in concentration-based transport models of the shoot apical meristem
Authors:
Delphine Draelants,
Daniele Avitabile,
Wim Vanroose
Abstract:
We study the formation of auxin peaks in a generic class of concentration-based auxin transport models, posed on static plant tissues. Using standard asymptotic analysis we prove that, on bounded domains, auxin peaks are not formed via a Turing instability in the active transport parameter, but via simple corrections to the homogeneous steady state. When the active transport is small, the geometry…
▽ More
We study the formation of auxin peaks in a generic class of concentration-based auxin transport models, posed on static plant tissues. Using standard asymptotic analysis we prove that, on bounded domains, auxin peaks are not formed via a Turing instability in the active transport parameter, but via simple corrections to the homogeneous steady state. When the active transport is small, the geometry of the tissue encodes the peaks' amplitude and location: peaks arise where cells have fewer neighbours, that is, at the boundary of the domain. We test our theory and perform numerical bifurcation analysis on two models which are known to generate auxin patterns for biologically plausible parameter values. In the same parameter regimes, we find that realistic tissues are capable of generating a multitude of stationary patterns, with a variable number of auxin peaks, that can be selected by different initial conditions or by quasi-static changes in the active transport parameter. The competition between active transport and production rate determines whether peaks remain localised or cover the entire domain. We relate the occurrence of localised patterns to a snaking bifurcation structure, which is known to arise in a wide variety of nonlinear media but has not yet been reported in plant models.
△ Less
Submitted 5 January, 2015; v1 submitted 16 March, 2014;
originally announced March 2014.
-
A multi-level preconditioned Krylov method for the efficient solution of algebraic tomographic reconstruction problems
Authors:
Siegfried Cools,
Pieter Ghysels,
Wim van Aarle,
J. Sijbers,
Wim Vanroose
Abstract:
Classical iterative methods for tomographic reconstruction include the class of Algebraic Reconstruction Techniques (ART). Convergence of these stationary linear iterative methods is however notably slow. In this paper we propose the use of Krylov solvers for tomographic linear inversion problems. These advanced iterative methods feature fast convergence at the expense of a higher computational co…
▽ More
Classical iterative methods for tomographic reconstruction include the class of Algebraic Reconstruction Techniques (ART). Convergence of these stationary linear iterative methods is however notably slow. In this paper we propose the use of Krylov solvers for tomographic linear inversion problems. These advanced iterative methods feature fast convergence at the expense of a higher computational cost per iteration, causing them to be generally uncompetitive without the inclusion of a suitable preconditioner. Combining elements from standard multigrid (MG) solvers and the theory of wavelets, a novel wavelet-based multi-level (WMG) preconditioner is introduced, which is shown to significantly speed-up Krylov convergence. The performance of the WMG-preconditioned Krylov method is analyzed through a spectral analysis, and the approach is compared to existing methods like the classical Simultaneous Iterative Reconstruction Technique (SIRT) and unpreconditioned Krylov methods on a 2D tomographic benchmark problem. Numerical experiments are promising, showing the method to be competitive with the classical Algebraic Reconstruction Techniques in terms of convergence speed and overall performance (CPU time) as well as precision of the reconstruction.
△ Less
Submitted 21 January, 2015; v1 submitted 3 October, 2013;
originally announced October 2013.
-
A new level-dependent coarsegrid correction scheme for indefinite Helmholtz problems
Authors:
Siegfried Cools,
Bram Reps,
Wim Vanroose
Abstract:
In this paper we construct and analyse a level-dependent coarsegrid correction scheme for indefinite Helmholtz problems. This adapted multigrid method is capable of solving the Helmholtz equation on the finest grid using a series of multigrid cycles with a grid-dependent complex shift, leading to a stable correction scheme on all levels. It is rigourously shown that the adaptation of the complex s…
▽ More
In this paper we construct and analyse a level-dependent coarsegrid correction scheme for indefinite Helmholtz problems. This adapted multigrid method is capable of solving the Helmholtz equation on the finest grid using a series of multigrid cycles with a grid-dependent complex shift, leading to a stable correction scheme on all levels. It is rigourously shown that the adaptation of the complex shift throughout the multigrid cycle maintains the functionality of the two-grid correction scheme, as no smooth modes are amplified in or added to the error. In addition, a sufficiently smoothing relaxation scheme should be applied to ensure dam** of the oscillatory error components. Numerical experiments on various benchmark problems show the method to be competitive with or even outperform the current state-of-the-art multigrid-preconditioned Krylov methods, like e.g. CSL-preconditioned GMRES or BiCGStab.
△ Less
Submitted 6 September, 2013; v1 submitted 20 November, 2012;
originally announced November 2012.
-
An efficient multigrid calculation of the far field map for Helmholtz and Schrödinger equations
Authors:
Siegfried Cools,
Bram Reps,
Wim Vanroose
Abstract:
In this paper we present a new highly efficient calculation method for the far field amplitude pattern that arises from scattering problems governed by the d-dimensional Helmholtz equation and, by extension, Schrödinger's equation. The new technique is based upon a reformulation of the classical real-valued Green's function integral for the far field amplitude to an equivalent integral over a comp…
▽ More
In this paper we present a new highly efficient calculation method for the far field amplitude pattern that arises from scattering problems governed by the d-dimensional Helmholtz equation and, by extension, Schrödinger's equation. The new technique is based upon a reformulation of the classical real-valued Green's function integral for the far field amplitude to an equivalent integral over a complex domain. It is shown that the scattered wave, which is essential for the calculation of the far field integral, can be computed very efficiently along this complex contour (or manifold, in multiple dimensions). Using the iterative multigrid method as a solver for the discretized damped scattered wave system, the proposed approach results in a fast and scalable calculation method for the far field map. The complex contour method is successfully validated on Helmholtz and Schrödinger model problems in two and three spatial dimensions, and multigrid convergence results are provided to substantiate the wavenumber scalability and overall performance of the method.
△ Less
Submitted 19 March, 2014; v1 submitted 19 November, 2012;
originally announced November 2012.
-
An optimal linear solver for the Jacobian system of the extreme type-II Ginzburg--Landau problem
Authors:
Nico Schlömer,
Wim Vanroose
Abstract:
This paper considers the extreme type-II Ginzburg--Landau equations, a nonlinear PDE model for describing the states of a wide range of superconductors. Based on properties of the Jacobian operator and an AMG strategy, a preconditioned Newton--Krylov method is constructed. After a finite-volume-type discretization, numerical experiments are done for representative two- and three-dimensional domain…
▽ More
This paper considers the extreme type-II Ginzburg--Landau equations, a nonlinear PDE model for describing the states of a wide range of superconductors. Based on properties of the Jacobian operator and an AMG strategy, a preconditioned Newton--Krylov method is constructed. After a finite-volume-type discretization, numerical experiments are done for representative two- and three-dimensional domains. Strong numerical evidence is provided that the number of Krylov iterations is independent of the dimension $n$ of the solution space, yielding an overall solver complexity of O(n).
△ Less
Submitted 22 August, 2012; v1 submitted 23 April, 2012;
originally announced April 2012.
-
Numerical bifurcation analysis of pattern formation in a cell based auxin transport model
Authors:
Delphine Draelants,
Jan Broeckhove,
Gerrit T. S. Beemster,
Wim Vanroose
Abstract:
Transport models of growth hormones can be used to reproduce the hormone accumulations that occur in plant organs. Mostly, these accumulation patterns are calculated using time step methods, even though only the resulting steady state patterns of the model are of interest. We examine the steady state solutions of the hormone transport model of Smith et al (2006) for a one-dimensional row of plant…
▽ More
Transport models of growth hormones can be used to reproduce the hormone accumulations that occur in plant organs. Mostly, these accumulation patterns are calculated using time step methods, even though only the resulting steady state patterns of the model are of interest. We examine the steady state solutions of the hormone transport model of Smith et al (2006) for a one-dimensional row of plant cells. We search for the steady state solutions as a function of three of the model parameters by using numerical continuation methods and bifurcation analysis. These methods are more adequate for solving steady state problems than time step methods. We discuss a trivial solution where the concentrations of hormones are equal in all cells and examine its stability region. We identify two generic bifurcation scenarios through which the trivial solution loses its stability. The trivial solution becomes either a steady state pattern with regular spaced peaks or a pattern where the concentration is periodic in time.
△ Less
Submitted 17 May, 2012; v1 submitted 23 February, 2012;
originally announced February 2012.
-
Local Fourier Analysis of the Complex Shifted Laplacian preconditioner for Helmholtz problems
Authors:
Siegfried Cools,
Wim Vanroose
Abstract:
In this paper we solve the Helmholtz equation with multigrid preconditioned Krylov subspace methods. The class of Shifted Laplacian preconditioners are known to significantly speed-up Krylov convergence. However, these preconditioners have a parameter beta, a measure of the complex shift. Due to contradictory requirements for the multigrid and Krylov convergence, the choice of this shift parameter…
▽ More
In this paper we solve the Helmholtz equation with multigrid preconditioned Krylov subspace methods. The class of Shifted Laplacian preconditioners are known to significantly speed-up Krylov convergence. However, these preconditioners have a parameter beta, a measure of the complex shift. Due to contradictory requirements for the multigrid and Krylov convergence, the choice of this shift parameter can be a bottleneck in applying the method. In this paper, we propose a wavenumber-dependent minimal complex shift parameter which is predicted by a rigorous k-grid Local Fourier Analysis (LFA) of the multigrid scheme. We claim that, given any (regionally constant) wavenumber, this minimal complex shift parameter provides the reader with a parameter choice that leads to efficient Krylov convergence. Numerical experiments in one and two spatial dimensions validate the theoretical results. It appears that the proposed complex shift is both the minimal requirement for a multigrid V-cycle to converge, as well as being near-optimal in terms of Krylov iteration count.
△ Less
Submitted 5 September, 2013; v1 submitted 22 December, 2011;
originally announced December 2011.
-
Improved convergence of scattering calculations in the oscillator representation
Authors:
Yuriy Bidasyuk,
Wim Vanroose
Abstract:
The Schrödinger equation for two and tree-body problems is solved for scattering states in a hybrid representation where solutions are expanded in the eigenstates of the harmonic oscillator in the interaction region and on a finite difference grid in the near-- and far--field. The two representations are coupled through a high--order asymptotic formula that takes into account the function values a…
▽ More
The Schrödinger equation for two and tree-body problems is solved for scattering states in a hybrid representation where solutions are expanded in the eigenstates of the harmonic oscillator in the interaction region and on a finite difference grid in the near-- and far--field. The two representations are coupled through a high--order asymptotic formula that takes into account the function values and the third derivative in the classical turning points. For various examples the convergence is analyzed for various physics problems that use an expansion in a large number of oscillator states. The results show significant improvement over the JM-ECS method [Bidasyuk et al, Phys. Rev. C 82, 064603 (2010)].
△ Less
Submitted 19 June, 2012; v1 submitted 16 November, 2011;
originally announced November 2011.
-
Analyzing the wave number dependency of the convergence rate of a multigrid preconditioned Krylov method for the Helmholtz equation with an absorbing layer
Authors:
Bram Reps,
Wim Vanroose
Abstract:
This paper analyzes the Krylov convergence rate of a Helmholtz problem preconditioned with Multigrid. The multigrid method is applied to the Helmholtz problem formulated on a complex contour and uses GMRES as a smoother substitute at each level. A one-dimensional model is analyzed both in a continuous and discrete way. It is shown that the Krylov convergence rate of the continuous problem is indep…
▽ More
This paper analyzes the Krylov convergence rate of a Helmholtz problem preconditioned with Multigrid. The multigrid method is applied to the Helmholtz problem formulated on a complex contour and uses GMRES as a smoother substitute at each level. A one-dimensional model is analyzed both in a continuous and discrete way. It is shown that the Krylov convergence rate of the continuous problem is independent of the wave number. The discrete problem, however, can deviate significantly from this bound due to a pitchfork in the spectrum. It is further shown in numerical experiments that the convergence rate of the Krylov method approaches the continuous bound as the grid distance $h$ gets small.
△ Less
Submitted 29 October, 2011; v1 submitted 16 May, 2011;
originally announced May 2011.
-
Numerical bifurcation study of superconducting patterns on a square
Authors:
Nico Schlömer,
Daniele Avitabile,
Wim Vanroose
Abstract:
This paper considers the extreme type-II Ginzburg-Landau equations that model vortex patterns in superconductors. The nonlinear PDEs are solved using Newton's method, and properties of the Jacobian operator are highlighted. Specifically, it is illustrated how the operator can be regularized using an appropriate phase condition. For a two-dimensional square sample, the numerical results are based o…
▽ More
This paper considers the extreme type-II Ginzburg-Landau equations that model vortex patterns in superconductors. The nonlinear PDEs are solved using Newton's method, and properties of the Jacobian operator are highlighted. Specifically, it is illustrated how the operator can be regularized using an appropriate phase condition. For a two-dimensional square sample, the numerical results are based on a finite-difference discretization with link variables that preserves the gauge invariance. For two exemplary sample sizes, a thorough bifurcation analysis is performed using the strength of the applied magnetic field as a bifurcation parameter and focusing on the symmetries of this system. The analysis gives new insight in the transitions between stable and unstable states, as well as the connections between stable solution branches.
△ Less
Submitted 8 December, 2011; v1 submitted 6 February, 2011;
originally announced February 2011.
-
Numerical Continuation of Bound and Resonant States of the Two Channel Schrödinger Equation
Authors:
Przemysław Kłosiewicz,
Wim Vanroose,
Jan Broeckhove
Abstract:
Resonant solutions of the quantum Schrödinger equation occur at complex energies where the S-matrix becomes singular. Knowledge of such resonances is important in the study of the underlying physical system. Often the Schrödinger equation is dependent on some parameter and one is interested in following the path of the resonances in the complex energy plane as the parameter changes. This is partic…
▽ More
Resonant solutions of the quantum Schrödinger equation occur at complex energies where the S-matrix becomes singular. Knowledge of such resonances is important in the study of the underlying physical system. Often the Schrödinger equation is dependent on some parameter and one is interested in following the path of the resonances in the complex energy plane as the parameter changes. This is particularly true in coupled channel systems where the resonant behavior is highly dependent on the strength of the channel coupling, the energy separation of the channels and other factors. In previous work it was shown that numerical continuation, a technique familiar in the study of dynamical systems, can be brought to bear on the problem of following the resonance path in one dimensional problems and multi-channel problems without energy separation between the channels. A regularization can be defined that eliminates coalescing poles and zeros that appear in the S-matrix at the origin due to symmetries. Following the zeros of this regularized function then traces the resonance path. In this work we show that this approach can be extended to channels with energy separation, albeit limited to two channels. The issue here is that the energy separation introduces branch cuts in the complex energy domain that need to be eliminated with a so-called uniformization. We demonstrate that the resulting approach is suitable for investigating resonances in two-channel systems and provide an extensive example.
△ Less
Submitted 5 March, 2011; v1 submitted 4 January, 2011;
originally announced January 2011.
-
GMRES-based multigrid for the complex scaled preconditoner for the indefinite Helmholtz equation
Authors:
Bram Reps,
Wim Vanroose,
Hisham bin Zubair
Abstract:
Multigrid preconditioners and solvers for the indefinite Helmholtz equation suffer from non-stability of the stationary smoothers due to the indefinite spectrum of the operator. In this paper we explore GMRES as a replacement for the stationary smoothers of the standard multigrid method. This results in a robust and efficient solver for a complex shifted or stretched Helmholtz problem that can be…
▽ More
Multigrid preconditioners and solvers for the indefinite Helmholtz equation suffer from non-stability of the stationary smoothers due to the indefinite spectrum of the operator. In this paper we explore GMRES as a replacement for the stationary smoothers of the standard multigrid method. This results in a robust and efficient solver for a complex shifted or stretched Helmholtz problem that can be used as a preconditioner. Very few GMRES iterations are required on each level to build a good multigrid method. The convergence behavior is compared to a theoretically derived stable polynomial smoother. We test this method on some benchmark problems and report on the observed convergence behavior.
△ Less
Submitted 8 May, 2013; v1 submitted 24 December, 2010;
originally announced December 2010.
-
A preconditioned iterative solver for the scattering solutions of the Schrödinger equation
Authors:
Hisham bin Zubair,
Bram Reps,
Wim Vanroose
Abstract:
The Schrödinger equation defines the dynamics of quantum particles which has been an area of unabated interest in physics. We demonstrate how simple transformations of the Schrödinger equation leads to a coupled linear system, whereby each diagonal block is a high frequency Helmholtz problem. Based on this model, we derive indefinite Helmholtz model problems with strongly varying wavenumbers. We e…
▽ More
The Schrödinger equation defines the dynamics of quantum particles which has been an area of unabated interest in physics. We demonstrate how simple transformations of the Schrödinger equation leads to a coupled linear system, whereby each diagonal block is a high frequency Helmholtz problem. Based on this model, we derive indefinite Helmholtz model problems with strongly varying wavenumbers. We employ the iterative approach for their solution. In particular, we develop a preconditioner that has its spectrum restricted to a quadrant (of the complex plane) thereby making it easily invertible by multigrid methods with standard components. This multigrid preconditioner is used in conjuction with suitable Krylov-subspace methods for solving the indefinite Helmholtz model problems. The aim of this study is to report the feasbility of this preconditioner for the model problems. We compare this idea with the other prevalent preconditioning ideas, and discuss its merits. Results of numerical experiments are presented, which complement the proposed ideas, and show that this preconditioner may be used in an automatic setting.
△ Less
Submitted 12 July, 2011; v1 submitted 20 December, 2010;
originally announced December 2010.
-
Numerical Continuation of resonances and bound states in coupled channel Schrödinger equations
Authors:
Przemysław Kłosiewicz,
Jan Broeckhove,
Wim Vanroose
Abstract:
In this contribution, we introduce numerical continuation methods and bifurcation theory, techniques which find their roots in the study of dynamical systems, to the problem of tracing the parameter dependence of bound and resonant states of the quantum mechanical Schrödinger equation. We extend previous work on the subject to systems of coupled equations. Bound and resonant states of the Schrödin…
▽ More
In this contribution, we introduce numerical continuation methods and bifurcation theory, techniques which find their roots in the study of dynamical systems, to the problem of tracing the parameter dependence of bound and resonant states of the quantum mechanical Schrödinger equation. We extend previous work on the subject to systems of coupled equations. Bound and resonant states of the Schrödinger equation can be determined through the poles of the S-matrix, a quantity that can be derived from the asymptotic form of the wave function. We introduce a regularization procedure that essentially transforms the S-matrix into its inverse and improves its smoothness properties, thus making it amenable to numerical continuation. This allows us to automate the process of tracking bound and resonant states when parameters in the Schrödinger equation are varied. We have applied this approach to a number of model problems with satisfying results.
△ Less
Submitted 21 December, 2010; v1 submitted 1 December, 2010;
originally announced December 2010.
-
Applying numerical continuation to the parameter dependence of solutions of the Schrödinger equation
Authors:
Jan Broeckhove,
Przemysław Kłosiewicz,
Wim Vanroose
Abstract:
In molecular reactions at the microscopic level the appearance of resonances has an important influence on the reactivity. It is important to predict when a bound state transitions into a resonance and how these transitions depend on various system parameters such as internuclear distances. The dynamics of such systems are described by the time-independent Schrödinger equation and the resonances a…
▽ More
In molecular reactions at the microscopic level the appearance of resonances has an important influence on the reactivity. It is important to predict when a bound state transitions into a resonance and how these transitions depend on various system parameters such as internuclear distances. The dynamics of such systems are described by the time-independent Schrödinger equation and the resonances are modeled by poles of the S-matrix. Using numerical continuation methods and bifurcation theory, techniques which find their roots in the study of dynamical systems, we are able to develop efficient and robust methods to study the transitions of bound states into resonances. By applying Keller's Pseudo-Arclength continuation, we can minimize the numerical complexity of our algorithm. As continuation methods generally assume smooth and well-behaving functions and the S-matrix is neither, special care has been taken to ensure accurate results. We have successfully applied our approach in a number of model problems involving the radial Schrödinger equation.
△ Less
Submitted 30 November, 2010;
originally announced November 2010.
-
On the indefinite Helmholtz equation: complex stretched absorbing boundary layers, iterative analysis, and preconditioning
Authors:
Bram Reps,
Wim Vanroose,
Hisham bin Zubair
Abstract:
This paper studies and analyzes a preconditioned Krylov solver for Helmholtz problems that are formulated with absorbing boundary layers based on complex coordinate stretching. The preconditioner problem is a Helmholtz problem where not only the coordinates in the absorbing layer have an imaginary part, but also the coordinates in the interior region. This results into a preconditioner problem tha…
▽ More
This paper studies and analyzes a preconditioned Krylov solver for Helmholtz problems that are formulated with absorbing boundary layers based on complex coordinate stretching. The preconditioner problem is a Helmholtz problem where not only the coordinates in the absorbing layer have an imaginary part, but also the coordinates in the interior region. This results into a preconditioner problem that is invertible with a multigrid cycle. We give a numerical analysis based on the eigenvalues and evaluate the performance with several numerical experiments. The method is an alternative to the complex shifted Laplacian and it gives a comparable performance for the studied model problems.
△ Less
Submitted 14 June, 2010; v1 submitted 1 December, 2009;
originally announced December 2009.
