-
Academic competitions
Authors:
Hugo Jair Escalante,
Aleksandra Kruchinina
Abstract:
Academic challenges comprise effective means for (i) advancing the state of the art, (ii) putting in the spotlight of a scientific community specific topics and problems, as well as (iii) closing the gap for under represented communities in terms of accessing and participating in the sha** of research fields. Competitions can be traced back for centuries and their achievements have had great inf…
▽ More
Academic challenges comprise effective means for (i) advancing the state of the art, (ii) putting in the spotlight of a scientific community specific topics and problems, as well as (iii) closing the gap for under represented communities in terms of accessing and participating in the sha** of research fields. Competitions can be traced back for centuries and their achievements have had great influence in our modern world. Recently, they (re)gained popularity, with the overwhelming amounts of data that is being generated in different domains, as well as the need of pushing the barriers of existing methods, and available tools to handle such data. This chapter provides a survey of academic challenges in the context of machine learning and related fields. We review the most influential competitions in the last few years and analyze challenges per area of knowledge. The aims of scientific challenges, their goals, major achievements and expectations for the next few years are reviewed.
△ Less
Submitted 30 November, 2023;
originally announced December 2023.
-
The Chunks and Tasks Matrix Library 2.0
Authors:
Emanuel H. Rubensson,
Elias Rudberg,
Anastasia Kruchinina,
Anton G. Artemov
Abstract:
We present a C++ header-only parallel sparse matrix library, based on sparse quadtree representation of matrices using the Chunks and Tasks programming model. The library implements a number of sparse matrix algorithms for distributed memory parallelization that are able to dynamically exploit data locality to avoid movement of data. This is demonstrated for the example of block-sparse matrix-matr…
▽ More
We present a C++ header-only parallel sparse matrix library, based on sparse quadtree representation of matrices using the Chunks and Tasks programming model. The library implements a number of sparse matrix algorithms for distributed memory parallelization that are able to dynamically exploit data locality to avoid movement of data. This is demonstrated for the example of block-sparse matrix-matrix multiplication applied to three sequences of matrices with different nonzero structure, using the CHT-MPI 2.0 runtime library implementation of the Chunks and Tasks model. The runtime library succeeds to dynamically load balance the calculation regardless of the sparsity structure.
△ Less
Submitted 23 November, 2020;
originally announced November 2020.
-
Efficient computation of the density matrix with error control on distributed computer systems
Authors:
Anastasia Kruchinina,
Elias Rudberg,
Emanuel H. Rubensson
Abstract:
The recursive polynomial expansion for construction of a density matrix approximation with rigorous error control [J. Chem. Phys. 128, 074106 (2008)] is implemented in the quantum chemistry program Ergo [SoftwareX 7, 107 (2018)] using the Chunks and Tasks matrix library [Parallel Comput. 57, 87 (2016)]. The expansion is based on second-order polynomials and accelerated by the scale-and-fold techni…
▽ More
The recursive polynomial expansion for construction of a density matrix approximation with rigorous error control [J. Chem. Phys. 128, 074106 (2008)] is implemented in the quantum chemistry program Ergo [SoftwareX 7, 107 (2018)] using the Chunks and Tasks matrix library [Parallel Comput. 57, 87 (2016)]. The expansion is based on second-order polynomials and accelerated by the scale-and-fold technique [J. Chem. Theory Comput. 7, 1233 (2011)]. We evaluate the performance of the implementation by computing the density matrix from the Fock matrix in the large-scale self-consistent field calculations. We demonstrate that the amount of communicated data per worker process tends to a constant with increasing system size and number of computer nodes such that the amount of work per worker process is fixed.
△ Less
Submitted 27 September, 2019;
originally announced September 2019.
-
Multiple eigenvectors around the homo-lumo gap as a cheap by-product in linear scaling electronic structure calculations
Authors:
Anastasia Kruchinina
Abstract:
In this work we present and evaluate an implementation of the purify-shift-and-project method [J. Chem. Phys. 128, 176101 (2008)] for linear scaling computation of multiple eigenvectors around the homo-lumo gap of the Fock/Kohn-Sham matrix. Recursive polynomial expansions allow for linear scaling density matrix construction if matrices are sufficiently sparse. However, a drawback is that, compared…
▽ More
In this work we present and evaluate an implementation of the purify-shift-and-project method [J. Chem. Phys. 128, 176101 (2008)] for linear scaling computation of multiple eigenvectors around the homo-lumo gap of the Fock/Kohn-Sham matrix. Recursive polynomial expansions allow for linear scaling density matrix construction if matrices are sufficiently sparse. However, a drawback is that, compared to the traditional diagonalization approach, eigenvectors of the Fock/Kohn-Sham matrix are not readily available. The sharp polynomial filter, constructed in intermediate iterations of the recursive polynomial expansion, increases the relative separation of eigenvalues near the homo-lumo gap. The computed density matrix approximation is used to project away the uninteresting part of the spectrum, so that the eigenvalues of interest become the extreme eigenvalues, enabling fast convergence of a Lanczos eigensolver. We implement the purify-shift-and-project algorithm in the quantum chemistry program Ergo [SoftwareX 7, 107 (2018)]. We illustrate the performance of the method by computing 30 eigenvectors around the homo-lumo gap for large scale systems.
△ Less
Submitted 25 September, 2019;
originally announced September 2019.
-
Localized inverse factorization
Authors:
Emanuel H. Rubensson,
Anton G. Artemov,
Anastasia Kruchinina,
Elias Rudberg
Abstract:
We propose a localized divide and conquer algorithm for inverse factorization $S^{-1} = ZZ^*$ of Hermitian positive definite matrices $S$ with localized structure, e.g. exponential decay with respect to some given distance function on the index set of $S$. The algorithm is a reformulation of recursive inverse factorization [J. Chem. Phys., 128 (2008), 104105] but makes use of localized operations…
▽ More
We propose a localized divide and conquer algorithm for inverse factorization $S^{-1} = ZZ^*$ of Hermitian positive definite matrices $S$ with localized structure, e.g. exponential decay with respect to some given distance function on the index set of $S$. The algorithm is a reformulation of recursive inverse factorization [J. Chem. Phys., 128 (2008), 104105] but makes use of localized operations only. At each level of recursion, the problem is cut into two subproblems and their solutions are combined using iterative refinement [Phys. Rev. B, 70 (2004), 193102] to give a solution to the original problem. The two subproblems can be solved in parallel without any communication and, using the localized formulation, the cost of combining their results is proportional to the cut size, defined by the binary partition of the index set. This means that for cut sizes increasing as $o(n)$ with system size $n$ the cost of combining the two subproblems is negligible compared to the overall cost for sufficiently large systems.
We also present an alternative derivation of iterative refinement based on a sign matrix formulation, analyze the stability, and propose a parameterless stop** criterion. We present bounds for the initial factorization error and the number of iterations in terms of the condition number of $S$ when the starting guess is given by the solution of the two subproblems in the binary recursion. These bounds are used in theoretical results for the decay properties of the involved matrices.
The localization properties of our algorithms are demonstrated for matrices corresponding to nearest neighbor overlap on one-, two-, and three-dimensional lattices as well as basis set overlap matrices generated using the Hartree-Fock and Kohn-Sham density functional theory electronic structure program Ergo [SoftwareX, 7 (2018), 107].
△ Less
Submitted 10 April, 2019; v1 submitted 12 December, 2018;
originally announced December 2018.
-
On-the-fly computation of frontal orbitals in density matrix expansions
Authors:
Anastasia Kruchinina,
Elias Rudberg,
Emanuel H. Rubensson
Abstract:
Linear scaling density matrix methods typically do not provide individual eigenvectors and eigenvalues of the Fock/Kohn-Sham matrix, so additional work has to be performed if they are needed. Spectral transformation techniques facilitate computation of frontal (homo and lumo) molecular orbitals. In the purify-shift-and-square method the convergence of iterative eigenvalue solvers is improved by co…
▽ More
Linear scaling density matrix methods typically do not provide individual eigenvectors and eigenvalues of the Fock/Kohn-Sham matrix, so additional work has to be performed if they are needed. Spectral transformation techniques facilitate computation of frontal (homo and lumo) molecular orbitals. In the purify-shift-and-square method the convergence of iterative eigenvalue solvers is improved by combining recursive density matrix expansion with the folded spectrum method [J. Chem. Phys. 128, 176101 (2008)]. However, the location of the shift in the folded spectrum method and the iteration of the recursive expansion selected for eigenpair computation may have a significant influence on the iterative eigenvalue solver performance and eigenvector accuracy. In this work, we make use of recent homo and lumo eigenvalue estimates [SIAM J. Sci. Comput. 36, B147 (2014)] for selecting shift and iteration such that homo and lumo orbitals can be computed in a small fraction of the total recursive expansion time and with sufficient accuracy. We illustrate our method by performing self-consistent field calculations for large scale systems.
△ Less
Submitted 14 September, 2017;
originally announced September 2017.
-
Parameterless stop** criteria for recursive density matrix expansions
Authors:
Anastasia Kruchinina,
Elias Rudberg,
Emanuel H. Rubensson
Abstract:
Parameterless stop** criteria for recursive polynomial expansions to construct the density matrix in electronic structure calculations are proposed. Based on convergence order estimation the new stop** criteria automatically and accurately detect when the calculation is dominated by numerical errors and continued iteration does not improve the result. Difficulties in selecting a stop** toler…
▽ More
Parameterless stop** criteria for recursive polynomial expansions to construct the density matrix in electronic structure calculations are proposed. Based on convergence order estimation the new stop** criteria automatically and accurately detect when the calculation is dominated by numerical errors and continued iteration does not improve the result. Difficulties in selecting a stop** tolerance and appropriately balancing it in relation to parameters controlling the numerical accuracy are avoided. Thus, our parameterless stop** criteria stands in contrast to the standard approach to stop as soon as some error measure goes below a user-defined parameter or tolerance. We demonstrate that the stop** criteria work well both in dense and sparse matrix calculations and in large-scale self-consistent field calculations with the quantum chemistry program Ergo (www.ergoscf.org).
△ Less
Submitted 30 June, 2016; v1 submitted 8 July, 2015;
originally announced July 2015.
