Showing 1–50 of 84 results for author: Booth, G

Rearrangement of single atoms in a 2000-site optical tweezers array at cryogenic temperatures

Authors: Grégoire Pichard, Desiree Lim, Etienne Bloch, Julien Vaneecloo, Lilian Bourachot, Gert-Jan Both, Guillaume Mériaux, Sylvain Dutartre, Richard Hostein, Julien Paris, Bruno Ximenez, Adrien Signoles, Antoine Browaeys, Thierry Lahaye, Davide Dreon

Abstract: We report on the trap** of single rubidium atoms in large arrays of optical tweezers comprising up to 2088 sites in a cryogenic environment at 6 K. Our approach relies on the use of microscope objectives that are in-vacuum but at room temperature, in combination with windowless thermal shields into which the objectives are protruding to ensure a cryogenic environment for the trapped atoms. To ac… ▽ More We report on the trap** of single rubidium atoms in large arrays of optical tweezers comprising up to 2088 sites in a cryogenic environment at 6 K. Our approach relies on the use of microscope objectives that are in-vacuum but at room temperature, in combination with windowless thermal shields into which the objectives are protruding to ensure a cryogenic environment for the trapped atoms. To achieve enough optical power for efficient trap**, we combine two lasers at slightly different wavelengths. We discuss the performance and limitations of our design. Finally, we demonstrate atom-by-atom rearrangement of an 828-atom target array using moving optical tweezers controlled by a field-programmable gate array. △ Less

Submitted 29 May, 2024; originally announced May 2024.

Comments: 6 pages, 4 figures

Quantum-Enhanced Neural Exchange-Correlation Functionals

Authors: Igor O. Sokolov, Gert-Jan Both, Art D. Bochevarov, Pavel A. Dub, Daniel S. Levine, Christopher T. Brown, Shaheen Acheche, Panagiotis Kl. Barkoutsos, Vincent E. Elfving

Abstract: Kohn-Sham Density Functional Theory (KS-DFT) provides the exact ground state energy and electron density of a molecule, contingent on the as-yet-unknown universal exchange-correlation (XC) functional. Recent research has demonstrated that neural networks can efficiently learn to represent approximations to that functional, offering accurate generalizations to molecules not present during the train… ▽ More Kohn-Sham Density Functional Theory (KS-DFT) provides the exact ground state energy and electron density of a molecule, contingent on the as-yet-unknown universal exchange-correlation (XC) functional. Recent research has demonstrated that neural networks can efficiently learn to represent approximations to that functional, offering accurate generalizations to molecules not present during the training process. With the latest advancements in quantum-enhanced machine learning (ML), evidence is growing that Quantum Neural Network (QNN) models may offer advantages in ML applications. In this work, we explore the use of QNNs for representing XC functionals, enhancing and comparing them to classical ML techniques. We present QNNs based on differentiable quantum circuits (DQCs) as quantum (hybrid) models for XC in KS-DFT, implemented across various architectures. We assess their performance on 1D and 3D systems. To that end, we expand existing differentiable KS-DFT frameworks and propose strategies for efficient training of such functionals, highlighting the importance of fractional orbital occupation for accurate results. Our best QNN-based XC functional yields energy profiles of the H$_2$ and planar H$_4$ molecules that deviate by no more than 1 mHa from the reference DMRG and FCI/6-31G results, respectively. Moreover, they reach chemical precision on a system, H$_2$H$_2$, not present in the training dataset, using only a few variational parameters. This work lays the foundation for the integration of quantum models in KS-DFT, thereby opening new avenues for expressing XC functionals in a differentiable way and facilitating computations of various properties. △ Less

Submitted 22 April, 2024; originally announced April 2024.

Fast and accurate nonadiabatic molecular dynamics enabled through variational interpolation of correlated electron wavefunctions

Authors: Kemal Atalar, Yannic Rath, Rachel Crespo-Otero, George H. Booth

Abstract: We build on the concept of eigenvector continuation to develop an efficient multi-state method for the rigorous and smooth interpolation of a small training set of many-body wavefunctions through chemical space at mean-field cost. The inferred states are represented as variationally optimal linear combinations of the training states transferred between the many-body basis of different nuclear geom… ▽ More We build on the concept of eigenvector continuation to develop an efficient multi-state method for the rigorous and smooth interpolation of a small training set of many-body wavefunctions through chemical space at mean-field cost. The inferred states are represented as variationally optimal linear combinations of the training states transferred between the many-body basis of different nuclear geometries. We show that analytic multi-state forces and nonadiabatic couplings from the model enable application to nonadiabatic molecular dynamics, develo** an active learning scheme to ensure a compact and systematically improvable training set. This culminates in application to the nonadiabatic molecular dynamics of a photoexcited 28-atom hydrogen chain, with surprising complexity in the resulting nuclear motion. With just 22 DMRG calculations of training states from the low-energy correlated electronic structure at different geometries, we infer the multi-state energies, forces and nonadiabatic coupling vectors at 12,000 geometries with provable convergence to high accuracy along an ensemble of molecular trajectories, which would not be feasible with a brute force approach. This opens up a route to bridge the timescales between accurate single-point correlated electronic structure methods and timescales of relevance for photo-induced molecular dynamics. △ Less

Submitted 30 April, 2024; v1 submitted 18 March, 2024; originally announced March 2024.

Interpolating many-body wave functions for accelerated molecular dynamics on near-exact electronic surfaces

Authors: Yannic Rath, George H. Booth

Abstract: While there have been many developments in computational probes of both strongly-correlated molecular systems and machine-learning accelerated molecular dynamics, there remains a significant gap in capabilities between them, where it is necessary to describe the accurate electronic structure over timescales in which atoms move. We describe a practical approach to bridge these fields by interpolati… ▽ More While there have been many developments in computational probes of both strongly-correlated molecular systems and machine-learning accelerated molecular dynamics, there remains a significant gap in capabilities between them, where it is necessary to describe the accurate electronic structure over timescales in which atoms move. We describe a practical approach to bridge these fields by interpolating the correlated many-electron state through chemical space, whilst avoiding the exponential complexity of these underlying states. With a small number of accurate correlated wave function calculations as a training set, we demonstrate provable convergence to near-exact potential energy surfaces for subsequent dynamics with propagation of a valid many-body wave function and inference of its variational energy at all points, whilst retaining a mean-field computational scaling. This represents a profoundly different paradigm to the direct interpolation of properties through chemical space in established machine-learning approaches. It benefits from access to all electronic properties of interest from the same model without relying on local descriptors, and demonstrates improved performance compared to the direct training on energies themselves. We combine this with modern systematically-improvable electronic structure methods to resolve the molecular dynamics for a number of correlated electron problems, including the proton dynamics of a Zundel cation trajectory, where we highlight the qualitative improvement from traditional machine learning or ab initio dynamics on mean-field surfaces. △ Less

Submitted 16 February, 2024; originally announced February 2024.

Qadence: a differentiable interface for digital-analog programs

Authors: Dominik Seitz, Niklas Heim, João P. Moutinho, Roland Guichard, Vytautas Abramavicius, Aleksander Wennersteen, Gert-Jan Both, Anton Quelle, Caroline de Groot, Gergana V. Velikova, Vincent E. Elfving, Mario Dagrada

Abstract: Digital-analog quantum computing (DAQC) is an alternative paradigm for universal quantum computation combining digital single-qubit gates with global analog operations acting on a register of interacting qubits. Currently, no available open-source software is tailored to express, differentiate, and execute programs within the DAQC paradigm. In this work, we address this shortfall by presenting Qad… ▽ More Digital-analog quantum computing (DAQC) is an alternative paradigm for universal quantum computation combining digital single-qubit gates with global analog operations acting on a register of interacting qubits. Currently, no available open-source software is tailored to express, differentiate, and execute programs within the DAQC paradigm. In this work, we address this shortfall by presenting Qadence, a high-level programming interface for building complex digital-analog quantum programs developed at Pasqal. Thanks to its flexible interface, native differentiability, and focus on real-device execution, Qadence aims at advancing research on variational quantum algorithms built for native DAQC platforms such as Rydberg atom arrays. △ Less

Submitted 18 January, 2024; originally announced January 2024.

Comparative study on compact quantum circuits of hybrid quantum-classical algorithms for quantum impurity models

Authors: Rihito Sakurai, Oliver J. Backhouse, George H. Booth, Wataru Mizukami, Hiroshi Shinaoka

Abstract: Predicting the properties of strongly correlated materials is a significant challenge in condensed matter theory. The widely used dynamical mean-field theory faces difficulty in solving quantum impurity models numerically. Hybrid quantum--classical algorithms such as variational quantum eigensolver emerge as a potential solution for quantum impurity models. A common challenge in these algorithms i… ▽ More Predicting the properties of strongly correlated materials is a significant challenge in condensed matter theory. The widely used dynamical mean-field theory faces difficulty in solving quantum impurity models numerically. Hybrid quantum--classical algorithms such as variational quantum eigensolver emerge as a potential solution for quantum impurity models. A common challenge in these algorithms is the rapid growth of the number of variational parameters with the number of spin-orbitals in the impurity. In our approach to this problem, we develop compact ansatzes using a combination of two different strategies. First, we employ compact physics-inspired ansatz, $k$-unitary cluster Jastrow ansatz, developed in the field of quantum chemistry. Second, we eliminate largely redundant variational parameters of physics-inspired ansatzes associated with bath sites based on physical intuition. This is based on the fact that a quantum impurity model with a star-like geometry has no direct hop** between bath sites. We benchmark the accuracy of these ansatzes for both ground-state energy and dynamic quantities by solving typical quantum impurity models with/without shot noise. The results suggest that we can maintain the accuracy of ground-state energy while we drop the number of variational parameters associated with bath sites. Furthermore, we demonstrate that a moment expansion, when combined with the proposed ansatzes, can calculate the imaginary-time Green's functions under the influence of shot noise. This study demonstrates the potential for addressing complex impurity models in large-scale quantum simulations with fewer variational parameters without sacrificing accuracy. △ Less

Submitted 7 December, 2023; originally announced December 2023.

Rigorous screened interactions for realistic correlated electron systems

Authors: Charles J. C. Scott, George H. Booth

Abstract: We derive a widely-applicable first principles approach for determining two-body, static effective interactions for low-energy Hamiltonians with quantitative accuracy. The algebraic construction rigorously conserves all instantaneous two-point correlation functions in a chosen model space at the level of the random phase approximation, improving upon the traditional uncontrolled static approximati… ▽ More We derive a widely-applicable first principles approach for determining two-body, static effective interactions for low-energy Hamiltonians with quantitative accuracy. The algebraic construction rigorously conserves all instantaneous two-point correlation functions in a chosen model space at the level of the random phase approximation, improving upon the traditional uncontrolled static approximations. Applied to screened interactions within a quantum embedding framework, we demonstrate these faithfully describe the relaxation of local subspaces via downfolding high-energy physics in molecular systems, as well as enabling a systematically improvable description of the long-range plasmonic contributions in extended graphene. △ Less

Submitted 5 December, 2023; v1 submitted 25 July, 2023; originally announced July 2023.

Journal ref: Scott and Booth, Phys. Rev. Lett., 132, 076401 (2024)

A language-inspired machine learning approach for solving strongly correlated problems with dynamical mean-field theory

Authors: Zelong Zhao, Hovan Lee, George Booth, Weifeng Ge, Cedric Weber

Abstract: We present SCALINN -- Strongly Correlated Approach with Language Inspired Neural Network -- as a method for solving the Anderson impurity model and reducing the computational cost of dynamical mean-field theory calculations. Inspired by the success of generative Transformer networks in natural language processing, SCALINN utilizes an in-house modified Transformer network in order to learn correlat… ▽ More We present SCALINN -- Strongly Correlated Approach with Language Inspired Neural Network -- as a method for solving the Anderson impurity model and reducing the computational cost of dynamical mean-field theory calculations. Inspired by the success of generative Transformer networks in natural language processing, SCALINN utilizes an in-house modified Transformer network in order to learn correlated Matsubara Green's functions, which act as solutions to the impurity model. This is achieved by providing the network with low-cost Matsubara Green's functions, thereby overcoming the computational cost of high accuracy solutions. Across different temperatures and interaction strengths, the performance of SCALINN is demonstrated in both physical observables (spectral function, Matsubara Green's functions, quasi-particle weight), and the mean squared error cost values of the neural network, showcasing the network's ability to accelerate Green's function based calculations of correlated materials. △ Less

Submitted 18 July, 2023; v1 submitted 12 June, 2023; originally announced June 2023.

Comments: 8 pages, 4 figures

Impact of conditional modelling for a universal autoregressive quantum state

Authors: Massimo Bortone, Yannic Rath, George H. Booth

Abstract: We present a generalized framework to adapt universal quantum state approximators, enabling them to satisfy rigorous normalization and autoregressive properties. We also introduce filters as analogues to convolutional layers in neural networks to incorporate translationally symmetrized correlations in arbitrary quantum states. By applying this framework to the Gaussian process state, we enforce au… ▽ More We present a generalized framework to adapt universal quantum state approximators, enabling them to satisfy rigorous normalization and autoregressive properties. We also introduce filters as analogues to convolutional layers in neural networks to incorporate translationally symmetrized correlations in arbitrary quantum states. By applying this framework to the Gaussian process state, we enforce autoregressive and/or filter properties, analyzing the impact of the resulting inductive biases on variational flexibility, symmetries, and conserved quantities. In doing so we bring together different autoregressive states under a unified framework for machine learning-inspired ansätze. Our results provide insights into how the autoregressive construction influences the ability of a variational model to describe correlations in spin and fermionic lattice models, as well as ab initio electronic structure problems where the choice of representation affects accuracy. We conclude that, while enabling efficient and direct sampling, thus avoiding autocorrelation and loss of ergodicity issues in Metropolis sampling, the autoregressive construction materially constrains the expressivity of the model in many systems. △ Less

Submitted 2 February, 2024; v1 submitted 9 June, 2023; originally announced June 2023.

Comments: 16 pages, 5 figures, Accepted to Quantum (2024)

Journal ref: Quantum 8, 1245 (2024)

A framework for efficient ab initio electronic structure with Gaussian Process States

Authors: Yannic Rath, George H. Booth

Abstract: We present a general framework for the efficient simulation of realistic fermionic systems with modern machine learning inspired representations of quantum many-body states, towards a universal tool for ab initio electronic structure. These machine learning inspired ansatzes have recently come to the fore in both a (first quantized) continuum and discrete Fock space representations, where however… ▽ More We present a general framework for the efficient simulation of realistic fermionic systems with modern machine learning inspired representations of quantum many-body states, towards a universal tool for ab initio electronic structure. These machine learning inspired ansatzes have recently come to the fore in both a (first quantized) continuum and discrete Fock space representations, where however the inherent scaling of the latter approach for realistic interactions has so far limited practical applications. With application to the 'Gaussian Process State', a recently introduced ansatz inspired by systematically improvable kernel models in machine learning, we discuss different choices to define the representation of the computational Fock space. We show how local representations are particularly suited for stochastic sampling of expectation values, while also indicating a route to overcome the discrepancy in the scaling compared to continuum formulated models. We are able to show competitive accuracy for systems with up to 64 electrons, including a simplified (yet fully ab initio) model of the Mott transition in three-dimensional hydrogen, indicating a significant improvement over similar approaches, even for moderate numbers of configurational samples. △ Less

Submitted 15 May, 2023; v1 submitted 2 February, 2023; originally announced February 2023.

Comments: 15 pages, 5 figures

Journal ref: Physical Review B, 107(20), 205119 (2023)

A 'moment-conserving' reformulation of GW theory

Authors: Charles J. C. Scott, Oliver J. Backhouse, George H. Booth

Abstract: We show how to construct an effective Hamiltonian whose dimension scales linearly with system size, and whose eigenvalues systematically approximate the excitation energies of GW theory. This is achieved by rigorously expanding the self-energy in order to exactly conserve a desired number of frequency-independent moments of the self-energy dynamics. Recasting $GW$ in this way admits a low-scaling… ▽ More We show how to construct an effective Hamiltonian whose dimension scales linearly with system size, and whose eigenvalues systematically approximate the excitation energies of GW theory. This is achieved by rigorously expanding the self-energy in order to exactly conserve a desired number of frequency-independent moments of the self-energy dynamics. Recasting $GW$ in this way admits a low-scaling O[$N^4$] approach to build and solve this Hamiltonian, with a proposal to reduce this further to O[$N^3$]. This relies on exposing a novel recursive framework for the density response moments of the random phase approximation (RPA), where the efficient calculation of its starting point mirrors the low-scaling approaches to compute RPA correlation energies. The frequency integration of $GW$ which distinguishes so many different GW variants can be performed without approximation directly in this moment representation. Furthermore, the solution to the Dyson equation can be performed exactly, avoiding analytic continuation, diagonal approximations or iterative solutions to the quasiparticle equation, with the full-frequency spectrum obtained from the complete solution of this effective static Hamiltonian. We show how this approach converges rapidly with respect to the order of the conserved self-energy moments, and is applied across the GW100 benchmark dataset to obtain accurate $GW$ spectra in comparison to traditional implementations. We also show the ability to systematically converge all-electron full-frequency spectra and high-energy features beyond frontier excitations, as well as avoiding discontinuities in the spectrum which afflict many other GW approaches. △ Less

Submitted 17 July, 2023; v1 submitted 22 January, 2023; originally announced January 2023.

Comments: Journal of Chemical Physics, 2023. Error in JCP version fixed (erroneous factor of pi in Eq. 71 and appendix A)

Journal ref: Journal of Chemical Physics, 158, 12 (2023)

Anion-polarisation-directed short-range-order in antiperovskite Li$_2$FeSO

Authors: Samuel W. Coles, Viktoria Falkowski, Harry S. Geddes, Gabriel E. Pérez, Samuel G. Booth, Alexander G. Squires, Conn O'Rourke, Kit McColl, Andrew L. Goodwin, Serena A. Cussen, Simon J. Clarke, M. Saiful Islam, Benjamin J. Morgan

Abstract: Short-range ordering in cation-disordered cathodes can have a significant effect on their electrochemical properties. Here, we characterise the cation short-range order in the antiperovskite cathode material Li$_2$FeSO, using density functional theory, Monte Carlo simulations, and synchrotron X-ray pair-distribution-function data. We predict partial short-range cation-ordering, characterised by fa… ▽ More Short-range ordering in cation-disordered cathodes can have a significant effect on their electrochemical properties. Here, we characterise the cation short-range order in the antiperovskite cathode material Li$_2$FeSO, using density functional theory, Monte Carlo simulations, and synchrotron X-ray pair-distribution-function data. We predict partial short-range cation-ordering, characterised by favourable OLi$_4$Fe$_2$ oxygen coordination with a preference for polar cis-OLi$_4$Fe$_2$ over non-polar trans-OLi$_4$Fe$_2$ configurations. This preference for polar cation configurations produces long-range disorder, in agreement with experimental data. The predicted short-range-order preference contrasts with that for a simple point-charge model, which instead predicts preferential trans-OLi$_4$Fe$_2$ oxygen coordination and corresponding long-range crystallographic order. The absence of long-range order in Li$_2$FeSO can therefore be attributed to the relative stability of cis-OLi$_4$Fe$_2$ and other non-OLi$_4$Fe$_2$ oxygen-coordination motifs. We show that this effect is associated with the polarisation of oxide and sulfide anions in polar coordination environments, which stabilises these polar short-range cation orderings. We propose similar anion-polarisation-directed short-range-ordering may be present in other heterocationic materials that contain cations with different formal charges. Our analysis also illustrates the limitations of using simple point-charge models to predict the structure of cation-disordered materials, where other factors, such as anion polarisation, may play a critical role in directing both short- and long-range structural correlations. △ Less

Submitted 27 April, 2023; v1 submitted 27 December, 2022; originally announced December 2022.

On the effective reconstruction of expectation values from ab initio quantum embedding

Authors: Max Nusspickel, Basil Ibrahim, George H. Booth

Abstract: Quantum embedding is an appealing route to fragment a large interacting quantum system into several smaller auxiliary `cluster' problems to exploit the locality of the correlated physics. In this work we critically review approaches to recombine these fragmented solutions in order to compute non-local expectation values, including the total energy. Starting from the democratic partitioning of expe… ▽ More Quantum embedding is an appealing route to fragment a large interacting quantum system into several smaller auxiliary `cluster' problems to exploit the locality of the correlated physics. In this work we critically review approaches to recombine these fragmented solutions in order to compute non-local expectation values, including the total energy. Starting from the democratic partitioning of expectation values used in density matrix embedding theory, we motivate and develop a number of alternative approaches, numerically demonstrating their efficiency and improved accuracy as a function of increasing cluster size for both energetics and non-local two-body observables in molecular and solid state systems. These approaches consider the $N$-representability of the resulting expectation values via an implicit global wave~function across the clusters, as well as the importance of including contributions to expectation values spanning multiple fragments simultaneously, thereby alleviating the fundamental locality approximation of the embedding. We clearly demonstrate the value of these introduced functionals for reliable extraction of observables and robust and systematic convergence as the cluster size increases, allowing for significantly smaller clusters to be used for a desired accuracy compared to traditional approaches in ab initio wave~function quantum embedding. △ Less

Submitted 22 January, 2023; v1 submitted 26 October, 2022; originally announced October 2022.

Comments: 20 pages

Journal ref: J. Chem. Theory Comput. 2023, 19, 10, 2769-2791

Full configuration interaction quantum Monte Carlo for coupled electron--boson systems and infinite spaces

Authors: Robert J. Anderson, Charles C. J. Scott, George H. Booth

Abstract: We extend the scope of full configuration interaction quantum Monte Carlo (FCIQMC) to be applied to coupled fermion-boson hamiltonians, alleviating the a priori truncation in boson occupation which is necessary for many other wave function based approaches to be tractable. Detailing the required algorithmic changes for efficient excitation generation, we apply FCIQMC in two contrasting settings. T… ▽ More We extend the scope of full configuration interaction quantum Monte Carlo (FCIQMC) to be applied to coupled fermion-boson hamiltonians, alleviating the a priori truncation in boson occupation which is necessary for many other wave function based approaches to be tractable. Detailing the required algorithmic changes for efficient excitation generation, we apply FCIQMC in two contrasting settings. The first is a sign-problem-free Hubbard--Holstein model of local electron-phonon interactions, where we show that with care to control for population bias via importance sampling and/or reweighting, the method can achieve unbiased energies extrapolated to the thermodynamic limit, without suffering additional computational overheads from relaxing boson occupation constraints. Secondly, we apply the method as a `solver' within a quantum embedding scheme which maps electronic systems to local electron-boson auxiliary models, with the bosons representing coupling to long-range plasmonic-like fluctuations. We are able to sample these general electron-boson hamiltonians with ease despite a formal sign problem, including a faithful reconstruction of converged reduced density matrices of the system. △ Less

Submitted 10 October, 2022; v1 submitted 15 August, 2022; originally announced August 2022.

Constructing `full-frequency' spectra via moment constraints for coupled cluster Green's functions

Authors: Oliver J. Backhouse, George H. Booth

Abstract: We propose an approach to build `full-frequency' quasiparticle spectra from conservation of a set of static expectation values. These expectation values define the moments of the spectral distribution, resulting in an efficient and systematically improvable expansion. By computing these initial moment constraints at the coupled-cluster level, we demonstrate convergence in both correlated state-spe… ▽ More We propose an approach to build `full-frequency' quasiparticle spectra from conservation of a set of static expectation values. These expectation values define the moments of the spectral distribution, resulting in an efficient and systematically improvable expansion. By computing these initial moment constraints at the coupled-cluster level, we demonstrate convergence in both correlated state-specific and full spectral quantities, while requiring a fraction of the effort of traditional Green's function approaches. Tested across the GW100 benchmark set for charged excitation spectra, we can converge frontier excitations to within the inherent accuracy of the CCSD approximation, whilst obtaining a simultaneous representation of the entire excitation spectrum at all energy scales. △ Less

Submitted 27 September, 2022; v1 submitted 27 June, 2022; originally announced June 2022.

Comments: 12 pages, 4 figures

Journal ref: J. Chem. Theory Comput., 2022

The quantum Gaussian process state: A kernel-inspired state with quantum support data

Authors: Yannic Rath, George H. Booth

Abstract: We introduce the quantum Gaussian process state, motivated via a statistical inference for the wave function supported by a data set of unentangled product states. We show that this condenses down to a compact and expressive parametric form, with a variational flexibility shown to be competitive or surpassing established alternatives. The connections of the state to its roots as a Bayesian inferen… ▽ More We introduce the quantum Gaussian process state, motivated via a statistical inference for the wave function supported by a data set of unentangled product states. We show that this condenses down to a compact and expressive parametric form, with a variational flexibility shown to be competitive or surpassing established alternatives. The connections of the state to its roots as a Bayesian inference machine as well as matrix product states, also allow for efficient deterministic training of global states from small training data with enhanced generalization, including on application to frustrated spin physics. △ Less

Submitted 13 April, 2022; v1 submitted 19 November, 2021; originally announced November 2021.

Journal ref: Phys. Rev. Research 4, 023126 (2022)

The Variational Quantum Eigensolver: a review of methods and best practices

Authors: Jules Tilly, Hongxiang Chen, Shuxiang Cao, Dario Picozzi, Kanav Setia, Ying Li, Edward Grant, Leonard Wossnig, Ivan Rungger, George H. Booth, Jonathan Tennyson

Abstract: The variational quantum eigensolver (or VQE) uses the variational principle to compute the ground state energy of a Hamiltonian, a problem that is central to quantum chemistry and condensed matter physics. Conventional computing methods are constrained in their accuracy due to the computational limits. The VQE may be used to model complex wavefunctions in polynomial time, making it one of the most… ▽ More The variational quantum eigensolver (or VQE) uses the variational principle to compute the ground state energy of a Hamiltonian, a problem that is central to quantum chemistry and condensed matter physics. Conventional computing methods are constrained in their accuracy due to the computational limits. The VQE may be used to model complex wavefunctions in polynomial time, making it one of the most promising near-term applications for quantum computing. Finding a path to navigate the relevant literature has rapidly become an overwhelming task, with many methods promising to improve different parts of the algorithm. Despite strong theoretical underpinnings suggesting excellent scaling of individual VQE components, studies have pointed out that their various pre-factors could be too large to reach a quantum computing advantage over conventional methods. This review aims to provide an overview of the progress that has been made on the different parts of the algorithm. All the different components of the algorithm are reviewed in detail including representation of Hamiltonians and wavefunctions on a quantum computer, the optimization process, the post-processing mitigation of errors, and best practices are suggested. We identify four main areas of future research:(1) optimal measurement schemes for reduction of circuit repetitions; (2) large scale parallelization across many quantum computers;(3) ways to overcome the potential appearance of vanishing gradients in the optimization process, and how the number of iterations required for the optimization scales with system size; (4) the extent to which VQE suffers for quantum noise, and whether this noise can be mitigated. The answers to these open research questions will determine the routes for the VQE to achieve quantum advantage as the quantum computing hardware scales up and as the noise levels are reduced. △ Less

Submitted 25 August, 2022; v1 submitted 9 November, 2021; originally announced November 2021.

Comments: 156 pages, 19 figures

Mixed Models and Shrinkage Estimation for Balanced and Unbalanced Designs

Authors: Yihan Bao, James G. Booth

Abstract: The known connection between shrinkage estimation, empirical Bayes, and mixed effects models is explored and applied to balanced and unbalanced designs in which the responses are correlated. As an illustration, a mixed model is proposed for predicting the outcome of English Premier League games that takes into account both home and away team effects. Results based on empirical best linear unbiased… ▽ More The known connection between shrinkage estimation, empirical Bayes, and mixed effects models is explored and applied to balanced and unbalanced designs in which the responses are correlated. As an illustration, a mixed model is proposed for predicting the outcome of English Premier League games that takes into account both home and away team effects. Results based on empirical best linear unbiased predictors obtained from fitting mixed linear models are compared with fully Bayesian predictors that utilize prior information from the previous season. △ Less

Submitted 4 November, 2021; originally announced November 2021.

Comments: 15 pages, 6 figures

Discovering PDEs from Multiple Experiments

Authors: Georges Tod, Gert-Jan Both, Remy Kusters

Abstract: Automated model discovery of partial differential equations (PDEs) usually considers a single experiment or dataset to infer the underlying governing equations. In practice, experiments have inherent natural variability in parameters, initial and boundary conditions that cannot be simply averaged out. We introduce a randomised adaptive group Lasso sparsity estimator to promote grouped sparsity and… ▽ More Automated model discovery of partial differential equations (PDEs) usually considers a single experiment or dataset to infer the underlying governing equations. In practice, experiments have inherent natural variability in parameters, initial and boundary conditions that cannot be simply averaged out. We introduce a randomised adaptive group Lasso sparsity estimator to promote grouped sparsity and implement it in a deep learning based PDE discovery framework. It allows to create a learning bias that implies the a priori assumption that all experiments can be explained by the same underlying PDE terms with potentially different coefficients. Our experimental results show more generalizable PDEs can be found from multiple highly noisy datasets, by this grouped sparsity promotion rather than simply performing independent model discoveries. △ Less

Submitted 23 November, 2021; v1 submitted 24 September, 2021; originally announced September 2021.

Comments: Fourth Workshop on Machine Learning and the Physical Sciences (NeurIPS 2021)

Systematic improvability in quantum embedding for real materials

Authors: Max Nusspickel, George H. Booth

Abstract: Quantum embedding methods have become a powerful tool to overcome deficiencies of traditional quantum modelling in materials science. However, while these are systematically improvable in principle, in practice it is rarely possible to achieve rigorous convergence and often necessary to employ empirical parameters. Here, we formulate a quantum embedding theory, building on the methods of density-m… ▽ More Quantum embedding methods have become a powerful tool to overcome deficiencies of traditional quantum modelling in materials science. However, while these are systematically improvable in principle, in practice it is rarely possible to achieve rigorous convergence and often necessary to employ empirical parameters. Here, we formulate a quantum embedding theory, building on the methods of density-matrix embedding theory combined with local correlation approaches from quantum chemistry, to ensure the ability to systematically converge properties of real materials with accurate correlated wave~function methods, controlled by a single, rapidly convergent parameter. By expanding supercell size, basis set, and the resolution of the fluctuation space of an embedded fragment, we show that the systematic improvability of the approach yields accurate structural and electronic properties of realistic solids without empirical parameters, even across changes in geometry. Results are presented in insulating, semi-metallic, and more strongly correlated regimes, finding state of the art agreement to experimental data. △ Less

Submitted 14 January, 2022; v1 submitted 10 July, 2021; originally announced July 2021.

Journal ref: Phys. Rev. X, 12, 011046 (2022)

Extending Density Matrix Embedding: A Static Two-Particle Theory

Authors: Charles J. C. Scott, George H. Booth

Abstract: We introduce Extended Density Matrix Embedding Theory (EDMET), a static quantum embedding theory explicitly self-consistent with respect to local two-body physics. This overcomes the biggest practical and conceptual limitation of more traditional one-body embedding methods, namely the lack of screening and treatment of longer-range interactions. This algebraic zero-temperature embedding augments a… ▽ More We introduce Extended Density Matrix Embedding Theory (EDMET), a static quantum embedding theory explicitly self-consistent with respect to local two-body physics. This overcomes the biggest practical and conceptual limitation of more traditional one-body embedding methods, namely the lack of screening and treatment of longer-range interactions. This algebraic zero-temperature embedding augments a local interacting cluster model with a minimal number of bosons from a description of the full system correlations via the random phase approximation, and admits an analytic approach to build a self-consistent Coulomb-exchange-correlation kernel. For extended Hubbard models with non-local interactions, this leads to the accurate description of phase transitions, static quantities and dynamics. We also move towards ab initio systems via the Parriser--Parr--Pople model of conjugated coronene derivatives, finding good agreement with experimental optical gaps. △ Less

Submitted 25 November, 2021; v1 submitted 9 July, 2021; originally announced July 2021.

Sparsistent Model Discovery

Authors: Georges Tod, Gert-Jan Both, Remy Kusters

Abstract: Discovering the partial differential equations underlying spatio-temporal datasets from very limited and highly noisy observations is of paramount interest in many scientific fields. However, it remains an open question to know when model discovery algorithms based on sparse regression can actually recover the underlying physical processes. In this work, we show the design matrices used to infer t… ▽ More Discovering the partial differential equations underlying spatio-temporal datasets from very limited and highly noisy observations is of paramount interest in many scientific fields. However, it remains an open question to know when model discovery algorithms based on sparse regression can actually recover the underlying physical processes. In this work, we show the design matrices used to infer the equations by sparse regression can violate the irrepresentability condition (IRC) of the Lasso, even when derived from analytical PDE solutions (i.e. without additional noise). Sparse regression techniques which can recover the true underlying model under violated IRC conditions are therefore required, leading to the introduction of the randomised adaptive Lasso. We show once the latter is integrated within the deep learning model discovery framework DeepMod, a wide variety of nonlinear and chaotic canonical PDEs can be recovered: (1) up to $\mathcal{O}(2)$ higher noise-to-sample ratios than state-of-the-art algorithms, (2) with a single set of hyperparameters, which paves the road towards truly automated model discovery. △ Less

Submitted 5 October, 2021; v1 submitted 22 June, 2021; originally announced June 2021.

Fully differentiable model discovery

Authors: Gert-Jan Both, Remy Kusters

Abstract: Model discovery aims at autonomously discovering differential equations underlying a dataset. Approaches based on Physics Informed Neural Networks (PINNs) have shown great promise, but a fully-differentiable model which explicitly learns the equation has remained elusive. In this paper we propose such an approach by integrating neural network-based surrogates with Sparse Bayesian Learning (SBL). T… ▽ More Model discovery aims at autonomously discovering differential equations underlying a dataset. Approaches based on Physics Informed Neural Networks (PINNs) have shown great promise, but a fully-differentiable model which explicitly learns the equation has remained elusive. In this paper we propose such an approach by integrating neural network-based surrogates with Sparse Bayesian Learning (SBL). This combination yields a robust model discovery algorithm, which we showcase on various datasets. We then identify a connection with multitask learning, and build on it to construct a Physics Informed Normalizing Flow (PINF). We present a proof-of-concept using a PINF to directly learn a density model from single particle data. Our work expands PINNs to various types of neural network architectures, and connects neural network-based surrogates to the rich field of Bayesian parameter inference. △ Less

Submitted 5 October, 2021; v1 submitted 9 June, 2021; originally announced June 2021.

Scalable and predictive spectra of correlated molecules with moment truncated iterated perturbation theory

Authors: Oliver J. Backhouse, Alejandro Santana-Bonilla, George H. Booth

Abstract: A reliable and efficient computation of the entire single-particle spectrum of correlated molecules is an outstanding challenge in the field of quantum chemistry, with standard density functional theory approaches often giving an inadequate description of excitation energies and gaps. In this work, we expand upon a recently-introduced approach which relies on a fully self-consistent many-body pert… ▽ More A reliable and efficient computation of the entire single-particle spectrum of correlated molecules is an outstanding challenge in the field of quantum chemistry, with standard density functional theory approaches often giving an inadequate description of excitation energies and gaps. In this work, we expand upon a recently-introduced approach which relies on a fully self-consistent many-body perturbation theory, coupled to a non-perturbative truncation of the effective dynamics at each step. We show that this yields a low-scaling and accurate method across a diverse benchmark test set, capable of treating moderate levels of strong correlation effects, and detail an efficient implementation for applications up to $\sim1000$ orbitals on parallel resources. We then use this method to characterise the spectral properties of the artemisinin anti-malarial drug molecule, resolving discrepancies in previous works concerning the active sites of the lowest energy fundamental excitations of the system. △ Less

Submitted 22 July, 2021; v1 submitted 7 June, 2021; originally announced June 2021.

Comments: 8 pages, 4 figures

Journal ref: J. Phys. Chem. Lett., 12, 7650 (2021)

A variational quantum eigensolver for dynamic correlation functions

Authors: Hongxiang Chen, Max Nusspickel, Jules Tilly, George H. Booth

Abstract: Recent practical approaches for the use of current generation noisy quantum devices in the simulation of quantum many-body problems have been dominated by the use of a variational quantum eigensolver (VQE). These coupled quantum-classical algorithms leverage the ability to perform many repeated measurements to avoid the currently prohibitive gate depths often required for exact quantum algorithms,… ▽ More Recent practical approaches for the use of current generation noisy quantum devices in the simulation of quantum many-body problems have been dominated by the use of a variational quantum eigensolver (VQE). These coupled quantum-classical algorithms leverage the ability to perform many repeated measurements to avoid the currently prohibitive gate depths often required for exact quantum algorithms, with the restriction of a parameterized circuit to describe the states of interest. In this work, we show how the calculation of zero-temperature dynamic correlation functions defining the linear response characteristics of quantum systems can also be recast into a modified VQE algorithm, which can be incorporated into the current variational quantum infrastructure. This allows for these important physical expectation values describing the dynamics of the system to be directly converged on the frequency axis, and they approach exactness over all frequencies as the flexibility of the parameterization increases. The frequency resolution hence does not explicitly scale with gate depth, which is approximately twice as deep as a ground state VQE. We apply the method to compute the single-particle Green's function of ab initio dihydrogen and lithium hydride molecules, and demonstrate the use of a practical active space embedding approach to extend to larger systems. While currently limited by the fidelity of two-qubit gates, whose number is increased compared to the ground state algorithm on current devices, we believe the approach shows potential for the extraction of frequency dynamics of correlated systems on near-term quantum processors. △ Less

Submitted 10 May, 2021; v1 submitted 4 May, 2021; originally announced May 2021.

Comments: 13 pages, 4 figures. Added new citations

Journal ref: Phys. Rev. A 104, 032405 (2021)

Model discovery in the sparse sampling regime

Authors: Gert-Jan Both, Georges Tod, Remy Kusters

Abstract: To improve the physical understanding and the predictions of complex dynamic systems, such as ocean dynamics and weather predictions, it is of paramount interest to identify interpretable models from coarsely and off-grid sampled observations. In this work, we investigate how deep learning can improve model discovery of partial differential equations when the spacing between sensors is large and t… ▽ More To improve the physical understanding and the predictions of complex dynamic systems, such as ocean dynamics and weather predictions, it is of paramount interest to identify interpretable models from coarsely and off-grid sampled observations. In this work, we investigate how deep learning can improve model discovery of partial differential equations when the spacing between sensors is large and the samples are not placed on a grid. We show how leveraging physics informed neural network interpolation and automatic differentiation, allow to better fit the data and its spatiotemporal derivatives, compared to more classic spline interpolation and numerical differentiation techniques. As a result, deep learning-based model discovery allows to recover the underlying equations, even when sensors are placed further apart than the data's characteristic length scale and in the presence of high noise levels. We illustrate our claims on both synthetic and experimental data sets where combinations of physical processes such as (non)-linear advection, reaction, and diffusion are correctly identified. △ Less

Submitted 2 May, 2021; originally announced May 2021.

Reduced Density Matrix Sampling: Self-consistent Embedding and Multiscale Electronic Structure on Current Generation Quantum Computers

Authors: Jules Tilly, P. V. Sriluckshmy, Akashkumar Patel, Enrico Fontana, Ivan Rungger, Edward Grant, Robert Anderson, Jonathan Tennyson, George H. Booth

Abstract: We investigate fully self-consistent multiscale quantum-classical algorithms on current generation superconducting quantum computers, in a unified approach to tackle the correlated electronic structure of large systems in both quantum chemistry and condensed matter physics. In both of these contexts, a strongly correlated quantum region of the extended system is isolated and self-consistently coup… ▽ More We investigate fully self-consistent multiscale quantum-classical algorithms on current generation superconducting quantum computers, in a unified approach to tackle the correlated electronic structure of large systems in both quantum chemistry and condensed matter physics. In both of these contexts, a strongly correlated quantum region of the extended system is isolated and self-consistently coupled to its environment via the sampling of reduced density matrices. We analyze the viability of current generation quantum devices to provide the required fidelity of these objects for a robust and efficient optimization of this subspace. We show that with a simple error mitigation strategy and optimization of compact tensor product bases to minimize the number of terms to sample, these self-consistent algorithms are indeed highly robust, even in the presence of significant noises on quantum hardware. Furthermore, we demonstrate the use of these density matrices for the sampling of non-energetic properties, including dipole moments and Fermi liquid parameters in condensed phase systems, achieving a reliable accuracy with sparse sampling. It appears that uncertainties derived from the iterative optimization of these subspaces is smaller than variances in the energy for a single subspace optimization with current quantum hardware. This boosts the prospect for routine self-consistency to improve the choice of correlated subspaces in hybrid quantum-classical approaches to electronic structure for large systems in this multiscale fashion. △ Less

Submitted 12 April, 2021; originally announced April 2021.

Journal ref: Phys. Rev. Research 3, 033230 (2021)

High Harmonic Generation in Two-Dimensional Mott Insulators

Authors: Christopher Orthodoxou, Amelle Zaïr, George H. Booth

Abstract: With a combination of numerical methods, including quantum Monte Carlo, exact diagonalization, and a simplified dynamical mean-field model, we consider the attosecond charge dynamics of electrons induced by strong-field laser pulses in two-dimensional Mott insulators. The necessity to go beyond single-particle approaches in these strongly correlated systems has made the simulation of two-dimension… ▽ More With a combination of numerical methods, including quantum Monte Carlo, exact diagonalization, and a simplified dynamical mean-field model, we consider the attosecond charge dynamics of electrons induced by strong-field laser pulses in two-dimensional Mott insulators. The necessity to go beyond single-particle approaches in these strongly correlated systems has made the simulation of two-dimensional extended materials challenging, and we contrast their resulting high-harmonic emission with more widely studied one-dimensional analogues. As well as considering the photo-induced breakdown of the Mott insulating state and magnetic order, we also resolve the time and ultra-high frequency domains of emission, which are used to characterize both the photo-transition, and the sub-cycle structure of the electron dynamics. This extends simulation capabilities and understanding of the photo-melting of these Mott insulators in two-dimensions, at the frontier of attosecond non-equilibrium science of correlated materials. △ Less

Submitted 26 July, 2021; v1 submitted 25 March, 2021; originally announced March 2021.

Comments: 7 pages, 5 figures

Journal ref: npj Quantum Materials, 6, 76 (2021)

Fully Algebraic and Self-consistent Effective Dynamics in a Static Quantum Embedding

Authors: P. V. Sriluckshmy, Max Nusspickel, Edoardo Fertitta, George H. Booth

Abstract: Quantum embedding approaches involve the self-consistent optimization of a local fragment of a strongly correlated system, entangled with the wider environment. The `energy-weighted' density matrix embedding theory (EwDMET) was established recently as a way to systematically control the resolution of the fragment-environment coupling, and allow for true quantum fluctuations over this boundary to b… ▽ More Quantum embedding approaches involve the self-consistent optimization of a local fragment of a strongly correlated system, entangled with the wider environment. The `energy-weighted' density matrix embedding theory (EwDMET) was established recently as a way to systematically control the resolution of the fragment-environment coupling, and allow for true quantum fluctuations over this boundary to be self-consistently optimized within a fully static framework. In this work, we reformulate the algorithm to ensure that EwDMET can be considered equivalent to an optimal and rigorous truncation of the self-consistent dynamics of dynamical mean-field theory (DMFT). A practical limitation of these quantum embedding approaches is often a numerical fitting of a self-consistent object defining the quantum effects. However, we show here that in this formulation, all numerical fitting steps can be entirely circumvented, via an effective Dyson equation in the space of truncated dynamics. This provides a robust and analytic self-consistency for the method, and an ability to systematically and rigorously converge to DMFT from a static, wave function perspective. We demonstrate that this improved approach can solve the correlated dynamics and phase transitions of the Bethe lattice Hubbard model in infinite dimensions, as well as one- and two-dimensional Hubbard models where we clearly show the benefits of this rapidly convergent basis for correlation-driven fluctuations. This systematically truncated description of the effective dynamics of the problem also allows access to quantities such as Fermi liquid parameters and renormalized dynamics, and demonstrates a numerically efficient, systematic convergence to the zero-temperature dynamical mean-field theory limit. △ Less

Submitted 3 February, 2021; v1 submitted 10 December, 2020; originally announced December 2020.

Comments: 15 pages, 10 figures

Journal ref: Phys. Rev. B 103, 085131 (2021)

Sparsely constrained neural networks for model discovery of PDEs

Authors: Gert-Jan Both, Gijs Vermarien, Remy Kusters

Abstract: Sparse regression on a library of candidate features has developed as the prime method to discover the partial differential equation underlying a spatio-temporal data-set. These features consist of higher order derivatives, limiting model discovery to densely sampled data-sets with low noise. Neural network-based approaches circumvent this limit by constructing a surrogate model of the data, but h… ▽ More Sparse regression on a library of candidate features has developed as the prime method to discover the partial differential equation underlying a spatio-temporal data-set. These features consist of higher order derivatives, limiting model discovery to densely sampled data-sets with low noise. Neural network-based approaches circumvent this limit by constructing a surrogate model of the data, but have to date ignored advances in sparse regression algorithms. In this paper we present a modular framework that dynamically determines the sparsity pattern of a deep-learning based surrogate using any sparse regression technique. Using our new approach, we introduce a new constraint on the neural network and show how a different network architecture and sparsity estimator improve model discovery accuracy and convergence on several benchmark examples. Our framework is available at \url{https://github.com/PhIMaL/DeePyMoD} △ Less

Submitted 4 May, 2021; v1 submitted 9 November, 2020; originally announced November 2020.

Four-component Full Configuration Interaction Quantum Monte Carlo for Relativistic Correlated Electron Problems

Authors: Robert J. Anderson, George H. Booth

Abstract: An adaptation of the full configuration interaction quantum Monte Carlo (FCIQMC) method is presented, for correlated electron problems containing heavy elements and the presence of significant relativistic effects. The modified algorithm allows for the sampling of the four-component spinors of the Dirac--Coulomb(--Breit) Hamiltonian within the relativistic no-pair approximation. The loss of spin s… ▽ More An adaptation of the full configuration interaction quantum Monte Carlo (FCIQMC) method is presented, for correlated electron problems containing heavy elements and the presence of significant relativistic effects. The modified algorithm allows for the sampling of the four-component spinors of the Dirac--Coulomb(--Breit) Hamiltonian within the relativistic no-pair approximation. The loss of spin symmetry and the general requirement for complex-valued Hamiltonian matrix elements are the most immediate considerations in expanding the scope of FCIQMC into the relativistic domain, and the alternatives for their efficient implementation are motivated and demonstrated. For the canonical correlated four-component chemical benchmark application of Thallium Hydride, we show that the necessary modifications do not particularly adversely affect the convergence of the systematic (initiator) error to the exact correlation energy for FCIQMC calculations, which is primarily dictated by the sparsity of the wave function, allowing the computational effort to somewhat bypass the formal increases in Hilbert space dimension for these problems. We apply the method to the larger problem of the spectroscopic constants of Tin Oxide, correlating 28 electrons in 122 Kramers-paired spinors, finding good agreement with experimental and prior theoretical relativistic studies. △ Less

Submitted 23 October, 2020; v1 submitted 19 October, 2020; originally announced October 2020.

Comments: 6 pages, 4 figures

Automatic Post-selection by Ancillae Thermalisation

Authors: Lewis Wright, Fergus Barratt, James Dborin, George H. Booth, Andrew G. Green

Abstract: Tasks such as classification of data and determining the groundstate of a Hamiltonian cannot be carried out through purely unitary quantum evolution. Instead, the inherent non-unitarity of the measurement process must be harnessed. Post-selection and its extensions provide a way to do this. However they make inefficient use of time resources -- a typical computation might require $O(2^m)$ measurem… ▽ More Tasks such as classification of data and determining the groundstate of a Hamiltonian cannot be carried out through purely unitary quantum evolution. Instead, the inherent non-unitarity of the measurement process must be harnessed. Post-selection and its extensions provide a way to do this. However they make inefficient use of time resources -- a typical computation might require $O(2^m)$ measurements over $m$ qubits to reach a desired accuracy. We propose a method inspired by the eigenstate thermalisation hypothesis, that harnesses the induced non-linearity of measurement on a subsystem. Post-selection on $m$ ancillae qubits is replaced with tracing out $O(\logε/ \log(1-p))$ (where p is the probability of a successful measurement) to attain the same accuracy as the post-selection circuit. We demonstrate this scheme on the quantum perceptron and phase estimation algorithm. This method is particularly advantageous on current quantum computers involving superconducting circuits. △ Less

Submitted 21 April, 2023; v1 submitted 8 October, 2020; originally announced October 2020.

Journal ref: Phys. Rev. Research 3, 033151 (2021)

Equation of state of atomic solid hydrogen by stochastic many-body wave function methods

Authors: Sam Azadi, George H. Booth, Thomas D. Kühne

Abstract: We report a numerical study of the equation of state of crystalline body-centered-cubic (BCC) hydrogen, tackled with a variety of complementary many-body wave function methods. These include continuum stochastic techniques of fixed-node diffusion and variational quantum Monte Carlo, and the Hilbert space stochastic method of full configuration-interaction quantum Monte Carlo. In addition, periodic… ▽ More We report a numerical study of the equation of state of crystalline body-centered-cubic (BCC) hydrogen, tackled with a variety of complementary many-body wave function methods. These include continuum stochastic techniques of fixed-node diffusion and variational quantum Monte Carlo, and the Hilbert space stochastic method of full configuration-interaction quantum Monte Carlo. In addition, periodic coupled-cluster methods were also employed. Each of these methods is underpinned with different strengths and approximations, but their combination in order to perform reliable extrapolation to complete basis set and supercell size limits gives confidence in the final results. The methods were found to be in good agreement for equilibrium cell volumes for the system in the BCC phase, with a lattice parameter of 3.307 Bohr. △ Less

Submitted 15 October, 2020; v1 submitted 27 August, 2020; originally announced September 2020.

Journal ref: J. Chem. Phys. Vol. 153, Issue 20 (2020)

A Bayesian Inference Framework for Compression and Prediction of Quantum States

Authors: Yannic Rath, Aldo Glielmo, George H. Booth

Abstract: The recently introduced Gaussian Process State (GPS) provides a highly flexible, compact and physically insightful representation of quantum many-body states based on ideas from the zoo of machine learning approaches. In this work, we give a comprehensive description how such a state can be learned from given samples of a potentially unknown target state and show how regression approaches based on… ▽ More The recently introduced Gaussian Process State (GPS) provides a highly flexible, compact and physically insightful representation of quantum many-body states based on ideas from the zoo of machine learning approaches. In this work, we give a comprehensive description how such a state can be learned from given samples of a potentially unknown target state and show how regression approaches based on Bayesian inference can be used to compress a target state into a highly compact and accurate GPS representation. By application of a type II maximum likelihood method based on Relevance Vector Machines (RVM), we are able to extract many-body configurations from the underlying Hilbert space which are particularly relevant for the description of the target state, as support points to define the GPS. Together with an introduced optimization scheme for the hyperparameters of the model characterizing the weighting of modelled correlation features, this makes it possible to easily extract physical characteristics of the state such as the relative importance of particular correlation properties. We apply the Bayesian learning scheme to the problem of modelling ground states of small Fermi-Hubbard chains and show that the found solutions represent a systematically improvable trade-off between sparsity and accuracy of the model. Moreover, we show how the learned hyperparameters and the extracted relevant configurations, characterizing the correlation of the wavefunction, depend on the interaction strength of the Hubbard model as well as the target accuracy of the representation. △ Less

Submitted 18 September, 2020; v1 submitted 8 August, 2020; originally announced August 2020.

Comments: 12 pages, 7 figures

Journal ref: J. Chem. Phys. 153, 124108 (2020)

Improved Stochastic Multireference Perturbation Theory for Correlated Systems with Large Active Spaces

Authors: James J. Halson, Robert J. Anderson, George H. Booth

Abstract: We identify the dominant computational cost within the recently introduced stochastic and internally contracted FCIQMC-NEVPT2 method for large active space sizes. This arises from the contribution to the four-body intermediates arising from low-excitation level sampled determinant pairs. We develop an effective way to mitigate this cost via an additional stochastic step within the sampling of the… ▽ More We identify the dominant computational cost within the recently introduced stochastic and internally contracted FCIQMC-NEVPT2 method for large active space sizes. This arises from the contribution to the four-body intermediates arising from low-excitation level sampled determinant pairs. We develop an effective way to mitigate this cost via an additional stochastic step within the sampling of the required NEVPT2 intermediates. We find this systematically improvable additional sampling can reduce simulation time by 80\% without introducing appreciable error. This saving is expected to increase for larger active spaces. We combine this enhanced sampling scheme with full stochastic orbital optimization for the first time, and apply it to find FCIQMC-NEVPT2 energies for spin states of an iron porphyrin system within (24,24) active spaces with relatively meagre computational resources. This active space size can now be considered as routine for NEVPT2 calculations of strongly correlated molecular systems within this improved stochastic methodology. △ Less

Submitted 23 July, 2020; originally announced July 2020.

Comments: 11 pages, 7 figures

Journal ref: Mol. Phys. e1802072, (2020)

Efficient excitations and spectra within a perturbative renormalization approach

Authors: Oliver J. Backhouse, George H. Booth

Abstract: We present a self-consistent approach for computing the correlated quasiparticle spectrum of charged excitations in iterative $\mathcal{O}[N^5]$ computational time. This is based on the auxiliary second-order Green's function approach [O. Backhouse \textit{et al.}, JCTC (2020)], in which a self-consistent effective Hamiltonian is constructed by systematically renormalizing the dynamical effects of… ▽ More We present a self-consistent approach for computing the correlated quasiparticle spectrum of charged excitations in iterative $\mathcal{O}[N^5]$ computational time. This is based on the auxiliary second-order Green's function approach [O. Backhouse \textit{et al.}, JCTC (2020)], in which a self-consistent effective Hamiltonian is constructed by systematically renormalizing the dynamical effects of the self-energy at second-order perturbation theory. From extensive benchmarking across the W4-11 molecular test set, we show that the iterative renormalization and truncation of the effective dynamical resolution arising from the $2h1p$ and $1h2p$ spaces can substantially improve the quality of the resulting ionization potential and electron affinity predictions compared to benchmark values. The resulting method is shown to be superior in accuracy to similarly scaling quantum chemical methods for charged excitations in EOM-CC2 and ADC(2), across this test set, while the self-consistency also removes the dependence on the underlying mean-field reference. The approach also allows for single-shot computation of the entire quasiparticle spectrum, which is applied to the benzoquinone molecule and demonstrates the reduction in the single-particle gap due to the correlated physics, and gives direct access to the localization of the Dyson orbitals. △ Less

Submitted 18 August, 2020; v1 submitted 6 July, 2020; originally announced July 2020.

Comments: 9 pages, 4 figures

Journal ref: Journal of Chemical Theory and Computation (2020)

NECI: N-Electron Configuration Interaction with emphasis on state-of-the-art stochastic methods

Authors: Kai Guther, Robert J. Anderson, Nick S. Blunt, Nikolay A. Bogdanov, Deidre Cleland, Nike Dattani, Werner Dobrautz, Khaldoon Ghanem, Peter Jeszenski, Niklas Liebermann, Giovanni Li Manni, Alexander Y. Lozovoi, Hongjun Luo, Dongxia Ma, Florian Merz, Catherine Overy, Markus Rampp, Pradipta K. Samanta, Lauretta R. Schwarz, James J. Shepherd, Simon D. Smart, Eugenio Vitale, Oskar Weser, George H. Booth, Ali Alavi

Abstract: We present NECI, a state-of-the-art implementation of the Full Configuration Interaction Quantum Monte Carlo algorithm, a method based on a stochastic application of the Hamiltonian matrix on a sparse sampling of the wave function. The program utilizes a very powerful parallelization and scales efficiently to more than 24000 CPU cores. In this paper, we describe the core functionalities of NECI an… ▽ More We present NECI, a state-of-the-art implementation of the Full Configuration Interaction Quantum Monte Carlo algorithm, a method based on a stochastic application of the Hamiltonian matrix on a sparse sampling of the wave function. The program utilizes a very powerful parallelization and scales efficiently to more than 24000 CPU cores. In this paper, we describe the core functionalities of NECI and recent developments. This includes the capabilities to calculate ground and excited state energies, properties via the one- and two-body reduced density matrices, as well as spectral and Green's functions for ab initio and model systems. A number of enhancements of the bare FCIQMC algorithm are available within NECI, allowing to use a partially deterministic formulation of the algorithm, working in a spin-adapted basis or supporting transcorrelated Hamiltonians. NECI supports the FCIDUMP file format for integrals, supplying a convenient interface to numerous quantum chemistry programs and it is licensed under GPL-3.0. △ Less

Submitted 26 June, 2020; originally announced June 2020.

Comments: 68 pages, 8 figures. To be published in the Journal of Chemical Physics, full supplementary files are to be published together with the article

Efficient Compression Of The Environment Of An Open Quantum System

Authors: Max Nusspickel, George H. Booth

Abstract: In order to simulate open quantum systems, many approaches (such as Hamiltonian-based solvers in dynamical mean-field theory) aim for a reproduction of a desired environment spectral density in terms of a discrete set of bath states, mimicking the open system as a larger closed problem. Existing strategies to find a compressed representation of the environment for this purpose can be numerically d… ▽ More In order to simulate open quantum systems, many approaches (such as Hamiltonian-based solvers in dynamical mean-field theory) aim for a reproduction of a desired environment spectral density in terms of a discrete set of bath states, mimicking the open system as a larger closed problem. Existing strategies to find a compressed representation of the environment for this purpose can be numerically demanding, or lack the compactness and systematic improvability required for an accurate description of the system propagator. We propose a method in which bath orbitals are constructed explicitly by an algebraic construction based on the Schmidt-decomposition of response wave functions, efficiently and systematically compressing the description of the full environment. These resulting bath orbitals are designed to directly reproduce the system Green's function, not hybridization, which allows for consideration of the relevant system energy scales to optimally model. This results in an accurate and efficient truncation of the environment, with applications in a wide range of numerical simulations of open quantum systems. △ Less

Submitted 14 July, 2020; v1 submitted 12 March, 2020; originally announced March 2020.

Comments: 11 pages, 5 figures

Journal ref: Phys. Rev. B 102, 165107 (2020)

Recent developments in the PySCF program package

Authors: Qiming Sun, Xing Zhang, Samragni Banerjee, Peng Bao, Marc Barbry, Nick S. Blunt, Nikolay A. Bogdanov, George H. Booth, Jia Chen, Zhi-Hao Cui, Janus Juul Eriksen, Yang Gao, Sheng Guo, Jan Hermann, Matthew R. Hermes, Kevin Koh, Peter Koval, Susi Lehtola, Zhendong Li, Junzi Liu, Narbe Mardirossian, James D. McClain, Mario Motta, Bastien Mussard, Hung Q. Pham , et al. (24 additional authors not shown)

Abstract: PYSCF is a Python-based general-purpose electronic structure platform that both supports first-principles simulations of molecules and solids, as well as accelerates the development of new methodology and complex computational workflows. The present paper explains the design and philosophy behind PYSCF that enables it to meet these twin objectives. With several case studies, we show how users can… ▽ More PYSCF is a Python-based general-purpose electronic structure platform that both supports first-principles simulations of molecules and solids, as well as accelerates the development of new methodology and complex computational workflows. The present paper explains the design and philosophy behind PYSCF that enables it to meet these twin objectives. With several case studies, we show how users can easily implement their own methods using PYSCF as a development environment. We then summarize the capabilities of PYSCF for molecular and solid-state simulations. Finally, we describe the growing ecosystem of projects that use PYSCF across the domains of quantum chemistry, materials science, machine learning and quantum information science. △ Less

Submitted 10 July, 2020; v1 submitted 27 February, 2020; originally announced February 2020.

Journal ref: J. Chem. Phys. 153, 024109 (2020)

Gaussian Process States: A data-driven representation of quantum many-body physics

Authors: Aldo Glielmo, Yannic Rath, Gabor Csanyi, Alessandro De Vita, George H. Booth

Abstract: We present a novel, non-parametric form for compactly representing entangled many-body quantum states, which we call a `Gaussian Process State'. In contrast to other approaches, we define this state explicitly in terms of a configurational data set, with the probability amplitudes statistically inferred from this data according to Bayesian statistics. In this way the non-local physical correlated… ▽ More We present a novel, non-parametric form for compactly representing entangled many-body quantum states, which we call a `Gaussian Process State'. In contrast to other approaches, we define this state explicitly in terms of a configurational data set, with the probability amplitudes statistically inferred from this data according to Bayesian statistics. In this way the non-local physical correlated features of the state can be analytically resummed, allowing for exponential complexity to underpin the ansatz, but efficiently represented in a small data set. The state is found to be highly compact, systematically improvable and efficient to sample, representing a large number of known variational states within its span. It is also proven to be a `universal approximator' for quantum states, able to capture any entangled many-body state with increasing data set size. We develop two numerical approaches which can learn this form directly: a fragmentation approach, and direct variational optimization, and apply these schemes to the Fermionic Hubbard model. We find competitive or superior descriptions of correlated quantum problems compared to existing state-of-the-art variational ansatzes, as well as other numerical methods. △ Less

Submitted 17 September, 2020; v1 submitted 27 February, 2020; originally announced February 2020.

Journal ref: Phys. Rev. X 10, 041026 (2020)

Temporal Normalizing Flows

Authors: Gert-Jan Both, Remy Kusters

Abstract: Analyzing and interpreting time-dependent stochastic data requires accurate and robust density estimation. In this paper we extend the concept of normalizing flows to so-called temporal Normalizing Flows (tNFs) to estimate time dependent distributions, leveraging the full spatio-temporal information present in the dataset. Our approach is unsupervised, does not require an a-priori characteristic s… ▽ More Analyzing and interpreting time-dependent stochastic data requires accurate and robust density estimation. In this paper we extend the concept of normalizing flows to so-called temporal Normalizing Flows (tNFs) to estimate time dependent distributions, leveraging the full spatio-temporal information present in the dataset. Our approach is unsupervised, does not require an a-priori characteristic scale and can accurately estimate multi-scale distributions of vastly different length scales. We illustrate tNFs on sparse datasets of Brownian and chemotactic walkers, showing that the inclusion of temporal information enhances density estimation. Finally, we speculate how tNFs can be applied to fit and discover the continuous PDE underlying a stochastic process. △ Less

Submitted 19 December, 2019; originally announced December 2019.

Controlling Arbitrary Observables in Correlated Many-body Systems

Authors: Gerard McCaul, Christopher Orthodoxou, Kurt Jacobs, George H. Booth, Denys I. Bondar

Abstract: Here we present an expanded analysis of a model for the manipulation and control of observables in a strongly correlated, many-body system, which was first presented in [McCaul et al., eprint: arXiv:1911.05006]. A field-free, non-linear equation of motion for controlling the expectation value of an essentially arbitrary observable is derived, together with rigorous constraints that determine the l… ▽ More Here we present an expanded analysis of a model for the manipulation and control of observables in a strongly correlated, many-body system, which was first presented in [McCaul et al., eprint: arXiv:1911.05006]. A field-free, non-linear equation of motion for controlling the expectation value of an essentially arbitrary observable is derived, together with rigorous constraints that determine the limits of controllability. We show that these constraints arise from the physically reasonable assumptions that the system will undergo unitary time evolution, and has enough degrees of freedom for the electrons to be mobile. Furthermore, we give examples of multiple solutions to generating target observable trajectories when the constraints are violated. Ehrenfest theorems are used to further refine the model, and provide a check on the validity of numerical simulations. Finally, the experimental feasibility of implementing the control fields generated by this model is discussed. △ Less

Submitted 12 December, 2019; originally announced December 2019.

Comments: 10 pages, 10 figures

Journal ref: Phys. Rev. A 101, 053408 (2020)

A wave function perspective and efficient truncation of renormalised second-order perturbation theory

Authors: Oliver J. Backhouse, Max Nusspickel, George H. Booth

Abstract: We present an approach to renormalized second-order Green's function perturbation theory (GF2) which avoids all dependency on continuous variables, grids or explicit Green's functions, and is instead formulated entirely in terms of static quantities and wave functions. Correlation effects from MP2 diagrams are iteratively incorporated to modify the underlying spectrum of excitations by coupling th… ▽ More We present an approach to renormalized second-order Green's function perturbation theory (GF2) which avoids all dependency on continuous variables, grids or explicit Green's functions, and is instead formulated entirely in terms of static quantities and wave functions. Correlation effects from MP2 diagrams are iteratively incorporated to modify the underlying spectrum of excitations by coupling the physical system to fictitious auxiliary degrees of freedom, allowing for the single-particle orbitals to delocalize into this additional space. The overall approach is shown to be rigorously $\mathcal{O}[N^5]$, after an appropriate compression of this auxiliary space. This is achieved via a novel scheme which ensures that a desired number of moments of the underlying occupied and virtual spectra are conserved in the compression, allowing a rapid and systematically improvable convergence to the limit of the effective dynamical resolution. The approach is found to then allow for the qualitative description of stronger correlation effects, avoiding the divergences of MP2, as well as its orbital-optimized version. On application to the G1 test set, we find that modifications to only up to the third spectral moment of the underlying spectrum from which the double excitations are built is required for accurate energetics, even in strongly correlated regimes. This is beyond simple self-consistent changes to the density matrix of the system, but far from requiring a description of the full dynamics of the frequency-dependent self-energy. △ Less

Submitted 14 January, 2020; v1 submitted 26 November, 2019; originally announced November 2019.

Comments: 17 pages, 9 figures

Journal ref: J. Chem. Theory Comput. 16, 1090 (2020)

Efficient and Stochastic Multireference Perturbation Theory for Large Active Spaces within a Full Configuration Interaction Quantum Monte Carlo Framework

Authors: Robert J. Anderson, Toru Shiozaki, George H. Booth

Abstract: Full Configuration Interaction Quantum Monte Carlo (FCIQMC) has been effectively applied to very large configuration interaction (CI) problems, and was recently adapted for use as an active space solver and combined with orbital optimisation. In this work, we detail an approach within FCIQMC to allow for efficient sampling of fully internally-contracted multireference perturbation theories within… ▽ More Full Configuration Interaction Quantum Monte Carlo (FCIQMC) has been effectively applied to very large configuration interaction (CI) problems, and was recently adapted for use as an active space solver and combined with orbital optimisation. In this work, we detail an approach within FCIQMC to allow for efficient sampling of fully internally-contracted multireference perturbation theories within the same stochastic framework. Schemes are described to allow for the close control over the resolution of stochastic sampling of the effective higher-body intermediates within the active space. It is found that while CASPT2 seems less amenable to a stochastic reformulation, NEVPT2 is far more stable, requiring a similar number of walkers to converge the NEVPT2 expectation values as to converge the underlying CI problem. We demonstrate the application of the stochastic approach to the computation of NEVPT2 within a (24,24) active space in a biologically relevant system, and show that small numbers of walkers are sufficient for a faithful sampling of the NEVPT2 energy to chemical accuracy, despite the active space already exceeding the limits of practicality for traditional approaches. This raises prospects of an efficient stochastic solver for multireference chemical problems requiring large active spaces, with an accurate treatment of external orbitals. △ Less

Submitted 25 November, 2019; originally announced November 2019.

Comments: 18 pages, 8 figures

Driven Imposters: Controlling Expectations in Many-Body Systems

Authors: Gerard McCaul, Christopher Orthodoxou, Kurt Jacobs, George H. Booth, Denys I. Bondar

Abstract: We present a framework to control and track the observables of a general solid state system driven by an incident laser field. The main result is a non-linear equation of motion for tracking an observable, together with a constraint on the size of expectations which may be reproduced via tracking. Among other applications, this model provides a potential route to the design of laser fields which c… ▽ More We present a framework to control and track the observables of a general solid state system driven by an incident laser field. The main result is a non-linear equation of motion for tracking an observable, together with a constraint on the size of expectations which may be reproduced via tracking. Among other applications, this model provides a potential route to the design of laser fields which cause photo-induced superconductivity in materials above their critical temperature. As a first test, the strategy is used to make the expectation value of the current conform to an arbitrary function under a range of model parameters. Additionally, using two reference spectra for materials in the conducting and insulating regimes respectively, the tracking algorithm is used to make each material mimic the optical spectrum of the other. △ Less

Submitted 16 March, 2020; v1 submitted 12 November, 2019; originally announced November 2019.

Comments: 5 pages, 3 figures, will be accompanied by an extended submission

Journal ref: Phys. Rev. Lett. 124, 183201 (2020)

Quantile Regression Modelling via Location and Scale Mixtures of Normal Distributions

Authors: Haim Y. Bar, James G. Booth, Martin T. Wells

Abstract: We show that the estimating equations for quantile regression can be solved using a simple EM algorithm in which the M-step is computed via weighted least squares, with weights computed at the E-step as the expectation of independent generalized inverse-Gaussian variables. We compute the variance-covariance matrix for the quantile regression coefficients using a kernel density estimator that resul… ▽ More We show that the estimating equations for quantile regression can be solved using a simple EM algorithm in which the M-step is computed via weighted least squares, with weights computed at the E-step as the expectation of independent generalized inverse-Gaussian variables. We compute the variance-covariance matrix for the quantile regression coefficients using a kernel density estimator that results in more stable standard errors than those produced by existing software. A natural modification of the EM algorithm that involves fitting a linear mixed model at the M-step extends the methodology to mixed effects quantile regression models. In this case, the fitting method can be justified as a generalized alternating minimization algorithm. Obtaining quantile regression estimates via the weighted least squares method enables model diagnostic techniques similar to the ones used in the linear regression setting. The computational approach is compared with existing software using simulated data, and the methodology is illustrated with several case studies. △ Less

Submitted 28 June, 2021; v1 submitted 24 October, 2019; originally announced October 2019.

Comments: a newer version of the paper which focuses on large-P variable selection is available in arXiv:2104.08595

Direct comparison of many-body methods for realistic electronic Hamiltonians

Authors: Kiel T. Williams, Yuan Yao, Jia Li, Li Chen, Hao Shi, Mario Motta, Chunyao Niu, Ushnish Ray, Sheng Guo, Robert J. Anderson, Junhao Li, Lan Nguyen Tran, Chia-Nan Yeh, Bastien Mussard, Sandeep Sharma, Fabien Bruneval, Mark van Schilfgaarde, George H. Booth, Garnet Kin-Lic Chan, Shiwei Zhang, Emanuel Gull, Dominika Zgid, Andrew Millis, Cyrus J. Umrigar, Lucas K. Wagner

Abstract: A large collaboration carefully benchmarks 20 first principles many-body electronic structure methods on a test set of 7 transition metal atoms, and their ions and monoxides. Good agreement is attained between the 3 systematically converged methods, resulting in experiment-free reference values. These reference values are used to assess the accuracy of modern emerging and scalable approaches to th… ▽ More A large collaboration carefully benchmarks 20 first principles many-body electronic structure methods on a test set of 7 transition metal atoms, and their ions and monoxides. Good agreement is attained between the 3 systematically converged methods, resulting in experiment-free reference values. These reference values are used to assess the accuracy of modern emerging and scalable approaches to the many-electron problem. The most accurate methods obtain energies indistinguishable from experimental results, with the agreement mainly limited by the experimental uncertainties. Comparison between methods enables a unique perspective on calculations of many-body systems of electrons. △ Less

Submitted 5 October, 2019; v1 submitted 30 September, 2019; originally announced October 2019.

Comments: Simons collaboration on the many-electron problem

Journal ref: Phys. Rev. X 10, 011041 (2020)

Frequency-dependent and algebraic bath states for a Dynamical Mean-Field Theory with compact support

Authors: Max Nusspickel, George H. Booth

Abstract: We demonstrate an algebraic construction of frequency-dependent bath orbitals which can be used in a robust and rigorously self-consistent DMFT-like embedding method, here called $ω-$DMFT, suitable for use with Hamiltonian-based impurity solvers. These bath orbitals are designed to exactly reproduce the hybridization of the impurity to its environment, while allowing for a systematic expansion of… ▽ More We demonstrate an algebraic construction of frequency-dependent bath orbitals which can be used in a robust and rigorously self-consistent DMFT-like embedding method, here called $ω-$DMFT, suitable for use with Hamiltonian-based impurity solvers. These bath orbitals are designed to exactly reproduce the hybridization of the impurity to its environment, while allowing for a systematic expansion of this bath space as impurity interactions couple frequency points. In this way, the difficult non-linear fit of bath parameters necessary for many Hamiltonian-formulation impurity solvers in DMFT is avoided, while the introduction of frequency dependence in this bath space is shown to allow for more compact bath sizes. This has significant potential use with a number of new, emerging Hamiltonian solvers which allow for the embedding of large impurity spaces within a DMFT framework. We present results of the $ω-$DMFT approach for the Hubbard model on the Bethe lattice, a 1D chain, and the 2D square lattice, which show excellent agreement with standard DMFT results, with fewer bath orbitals and more compact support for the hybridization representation in the key impurity model of the method. △ Less

Submitted 17 September, 2019; originally announced September 2019.

Comments: 13 pages, 10 figures

Journal ref: Phys. Rev. B 101, 045126 (2020)

Deep neural network or dermatologist?

Authors: Kyle Young, Gareth Booth, Becks Simpson, Reuben Dutton, Sally Shrapnel

Abstract: Deep learning techniques have proven high accuracy for identifying melanoma in digitised dermoscopic images. A strength is that these methods are not constrained by features that are pre-defined by human semantics. A down-side is that it is difficult to understand the rationale of the model predictions and to identify potential failure modes. This is a major barrier to adoption of deep learning in… ▽ More Deep learning techniques have proven high accuracy for identifying melanoma in digitised dermoscopic images. A strength is that these methods are not constrained by features that are pre-defined by human semantics. A down-side is that it is difficult to understand the rationale of the model predictions and to identify potential failure modes. This is a major barrier to adoption of deep learning in clinical practice. In this paper we ask if two existing local interpretability methods, Grad-CAM and Kernel SHAP, can shed light on convolutional neural networks trained in the context of melanoma detection. Our contributions are (i) we first explore the domain space via a reproducible, end-to-end learning framework that creates a suite of 30 models, all trained on a publicly available data set (HAM10000), (ii) we next explore the reliability of GradCAM and Kernel SHAP in this context via some basic sanity check experiments (iii) finally, we investigate a random selection of models from our suite using GradCAM and Kernel SHAP. We show that despite high accuracy, the models will occasionally assign importance to features that are not relevant to the diagnostic task. We also show that models of similar accuracy will produce different explanations as measured by these methods. This work represents first steps in bridging the gap between model accuracy and interpretability in the domain of skin cancer classification. △ Less

Submitted 19 August, 2019; originally announced August 2019.

DeepMoD: Deep learning for Model Discovery in noisy data

Authors: Gert-Jan Both, Subham Choudhury, Pierre Sens, Remy Kusters

Abstract: We introduce DeepMoD, a Deep learning based Model Discovery algorithm. DeepMoD discovers the partial differential equation underlying a spatio-temporal data set using sparse regression on a library of possible functions and their derivatives. A neural network approximates the data and constructs the function library, but it also performs the sparse regression. This construction makes it extremely… ▽ More We introduce DeepMoD, a Deep learning based Model Discovery algorithm. DeepMoD discovers the partial differential equation underlying a spatio-temporal data set using sparse regression on a library of possible functions and their derivatives. A neural network approximates the data and constructs the function library, but it also performs the sparse regression. This construction makes it extremely robust to noise, applicable to small data sets, and, contrary to other deep learning methods, does not require a training set. We benchmark our approach on several physical problems such as the Burgers', Korteweg-de Vries and Keller-Segel equations, and find that it requires as few as $\mathcal{O}(10^2)$ samples and works at noise levels up to $75\%$. Motivated by these results, we apply DeepMoD directly on noisy experimental time-series data from a gel electrophoresis experiment and find that it discovers the advection-diffusion equation describing this system. △ Less

Submitted 24 February, 2021; v1 submitted 20 April, 2019; originally announced April 2019.