-
Quixer: A Quantum Transformer Model
Authors:
Nikhil Khatri,
Gabriel Matos,
Luuk Coopmans,
Stephen Clark
Abstract:
Progress in the realisation of reliable large-scale quantum computers has motivated research into the design of quantum machine learning models. We present Quixer: a novel quantum transformer model which utilises the Linear Combination of Unitaries and Quantum Singular Value Transform primitives as building blocks. Quixer operates by preparing a superposition of tokens and applying a trainable non…
▽ More
Progress in the realisation of reliable large-scale quantum computers has motivated research into the design of quantum machine learning models. We present Quixer: a novel quantum transformer model which utilises the Linear Combination of Unitaries and Quantum Singular Value Transform primitives as building blocks. Quixer operates by preparing a superposition of tokens and applying a trainable non-linear transformation to this mix. We present the first results for a quantum transformer model applied to a practical language modelling task, obtaining results competitive with an equivalent classical baseline. In addition, we include resource estimates for evaluating the model on quantum hardware, and provide an open-source implementation for classical simulation. We conclude by highlighting the generality of Quixer, showing that its parameterised components can be substituted with fixed structures to yield new classes of quantum transformers.
△ Less
Submitted 6 June, 2024;
originally announced June 2024.
-
Quantum Semidefinite Programming with Thermal Pure Quantum States
Authors:
Oscar Watts,
Yuta Kikuchi,
Luuk Coopmans
Abstract:
Semidefinite programs (SDPs) are a particular class of convex optimization problems with applications in combinatorial optimization, operational research, and quantum information science. Seminal work by Brandão and Svore shows that a ``quantization'' of the matrix multiplicative-weight algorithm can provide approximate solutions to SDPs quadratically faster than the best classical algorithms by u…
▽ More
Semidefinite programs (SDPs) are a particular class of convex optimization problems with applications in combinatorial optimization, operational research, and quantum information science. Seminal work by Brandão and Svore shows that a ``quantization'' of the matrix multiplicative-weight algorithm can provide approximate solutions to SDPs quadratically faster than the best classical algorithms by using a quantum computer as a Gibbs-state sampler. We propose a modification of this quantum algorithm and show that a similar speedup can be obtained by replacing the Gibbs-state sampler with the preparation of thermal pure quantum (TPQ) states. While our methodology incurs an additional problem-dependent error, which decreases as the problem size grows, it avoids the preparation of purified Gibbs states, potentially saving a number of ancilla qubits. In addition, we identify a spectral condition which, when met, reduces the resources further, and shifts the computational bottleneck from Gibbs state preparation to ground-state energy estimation. With classical state-vector simulations, we verify the efficiency of the algorithm for particular cases of Hamiltonian learning problems. We are able to obtain approximate solutions for two-dimensional spinless Hubbard and one-dimensional Heisenberg XXZ models for sizes of up to $N=2^{10}$ variables. For the Hubbard model, we provide an estimate of the resource requirements of our algorithm, including the number of Toffoli gates and the number of qubits.
△ Less
Submitted 11 October, 2023;
originally announced October 2023.
-
On the Sample Complexity of Quantum Boltzmann Machine Learning
Authors:
Luuk Coopmans,
Marcello Benedetti
Abstract:
Quantum Boltzmann machines (QBMs) are machine-learning models for both classical and quantum data. We give an operational definition of QBM learning in terms of the difference in expectation values between the model and target, taking into account the polynomial size of the data set. By using the relative entropy as a loss function this problem can be solved without encountering barren plateaus. W…
▽ More
Quantum Boltzmann machines (QBMs) are machine-learning models for both classical and quantum data. We give an operational definition of QBM learning in terms of the difference in expectation values between the model and target, taking into account the polynomial size of the data set. By using the relative entropy as a loss function this problem can be solved without encountering barren plateaus. We prove that a solution can be obtained with stochastic gradient descent using at most a polynomial number of Gibbs states. We also prove that pre-training on a subset of the QBM parameters can only lower the sample complexity bounds. In particular, we give pre-training strategies based on mean-field, Gaussian Fermionic, and geometrically local Hamiltonians. We verify these models and our theoretical findings numerically on a quantum and a classical data set. Our results establish that QBMs are promising machine learning models.
△ Less
Submitted 23 May, 2024; v1 submitted 26 June, 2023;
originally announced June 2023.
-
Training Quantum Boltzmann Machines with the $β$-Variational Quantum Eigensolver
Authors:
Onno Huijgen,
Luuk Coopmans,
Peyman Najafi,
Marcello Benedetti,
Hilbert J. Kappen
Abstract:
The quantum Boltzmann machine (QBM) is a generative machine learning model for both classical data and quantum states. Training the QBM consists of minimizing the relative entropy from the model to the target state. This requires QBM expectation values which are computationally intractable for large models in general. It is therefore important to develop heuristic training methods that work well i…
▽ More
The quantum Boltzmann machine (QBM) is a generative machine learning model for both classical data and quantum states. Training the QBM consists of minimizing the relative entropy from the model to the target state. This requires QBM expectation values which are computationally intractable for large models in general. It is therefore important to develop heuristic training methods that work well in practice. In this work, we study a heuristic method characterized by a nested loop: the inner loop trains the $β$-variational quantum eigensolver ($β$-VQE) by Liu et al (2021 Mach. Learn.: Sci. Technol.2 025011) to approximate the QBM expectation values; the outer loop trains the QBM to minimize the relative entropy to the target. We show that low-rank representations obtained by $β$-VQE provide an efficient way to learn low-rank target states, such as classical data and low-temperature quantum tomography. We test the method on both classical and quantum target data with numerical simulations of up to 10 qubits. For the cases considered here, the obtained QBMs can model the target to high fidelity. We implement a trained model on a physical quantum device. The approach offers a valuable route towards variationally training QBMs on near-term quantum devices.
△ Less
Submitted 23 May, 2024; v1 submitted 17 April, 2023;
originally announced April 2023.
-
Realization of quantum signal processing on a noisy quantum computer
Authors:
Yuta Kikuchi,
Conor Mc Keever,
Luuk Coopmans,
Michael Lubasch,
Marcello Benedetti
Abstract:
Quantum signal processing (QSP) is a powerful toolbox for the design of quantum algorithms and can lead to asymptotically optimal computational costs. Its realization on noisy quantum computers without fault tolerance, however, is challenging because it requires a deep quantum circuit in general. We propose a strategy to run an entire QSP protocol on noisy quantum hardware by carefully reducing ov…
▽ More
Quantum signal processing (QSP) is a powerful toolbox for the design of quantum algorithms and can lead to asymptotically optimal computational costs. Its realization on noisy quantum computers without fault tolerance, however, is challenging because it requires a deep quantum circuit in general. We propose a strategy to run an entire QSP protocol on noisy quantum hardware by carefully reducing overhead costs at each step. To illustrate the approach, we consider the application of Hamiltonian simulation for which QSP implements a polynomial approximation of the time evolution operator. We test the protocol by running the algorithm on the Quantinuum H1-1 trapped-ion quantum computer powered by Honeywell. In particular, we compute the time dependence of bipartite entanglement entropies for Ising spin chains and find good agreements with exact numerical simulations. To make the best use of the device, we determine optimal experimental parameters by using a simplified error model for the hardware and numerically studying the trade-off between Hamiltonian simulation time, polynomial degree, and total accuracy. Our results are the first step in the experimental realization of QSP-based quantum algorithms.
△ Less
Submitted 27 September, 2023; v1 submitted 9 March, 2023;
originally announced March 2023.
-
Predicting Gibbs-State Expectation Values with Pure Thermal Shadows
Authors:
Luuk Coopmans,
Yuta Kikuchi,
Marcello Benedetti
Abstract:
The preparation and computation of many properties of quantum Gibbs states is essential for algorithms such as quantum semidefinite programming and quantum Boltzmann machines. We propose a quantum algorithm that can predict $M$ linear functions of an arbitrary Gibbs state with only $\mathcal{O}(\log{M})$ experimental measurements. Our main insight is that for sufficiently large systems we do not n…
▽ More
The preparation and computation of many properties of quantum Gibbs states is essential for algorithms such as quantum semidefinite programming and quantum Boltzmann machines. We propose a quantum algorithm that can predict $M$ linear functions of an arbitrary Gibbs state with only $\mathcal{O}(\log{M})$ experimental measurements. Our main insight is that for sufficiently large systems we do not need to prepare the $n$-qubit mixed Gibbs state explicitly but, instead, we can evolve a random $n$-qubit pure state in imaginary time. The result then follows by constructing classical shadows of these random pure states. We propose a quantum circuit that implements this algorithm by using quantum signal processing for the imaginary time evolution. We numerically verify the efficiency of the algorithm by simulating the circuit for a ten-spin-1/2 XXZ-Heisenberg model. In addition, we show that the algorithm can be successfully employed as a subroutine for training an eight-qubit fully connected quantum Boltzmann machine.
△ Less
Submitted 26 June, 2023; v1 submitted 10 June, 2022;
originally announced June 2022.
-
Data-Driven Time Propagation of Quantum Systems with Neural Networks
Authors:
James Nelson,
Luuk Coopmans,
Graham Kells,
Stefano Sanvito
Abstract:
We investigate the potential of supervised machine learning to propagate a quantum system in time. While Markovian dynamics can be learned easily, given a sufficient amount of data, non-Markovian systems are non-trivial and their description requires the memory knowledge of past states. Here we analyse the feature of such memory by taking a simple 1D Heisenberg model as many-body Hamiltonian, and…
▽ More
We investigate the potential of supervised machine learning to propagate a quantum system in time. While Markovian dynamics can be learned easily, given a sufficient amount of data, non-Markovian systems are non-trivial and their description requires the memory knowledge of past states. Here we analyse the feature of such memory by taking a simple 1D Heisenberg model as many-body Hamiltonian, and construct a non-Markovian description by representing the system over the single-particle reduced density matrix. The number of past states required for this representation to reproduce the time-dependent dynamics is found to grow exponentially with the number of spins and with the density of the system spectrum. Most importantly, we demonstrate that neural networks can work as time propagators at any time in the future and that they can be concatenated in time forming an autoregression. Such neural-network autoregression can be used to generate long-time and arbitrary dense time trajectories. Finally, we investigate the time resolution needed to represent the system memory. We find two regimes: for fine memory samplings the memory needed remains constant, while longer memories are required for coarse samplings, although the total number of time steps remains constant. The boundary between these two regimes is set by the period corresponding to the highest frequency in the system spectrum, demonstrating that neural network can overcome the limitation set by the Shannon-Nyquist sampling theorem.
△ Less
Submitted 27 January, 2022;
originally announced January 2022.
-
Optimal Control in Disordered Quantum Systems
Authors:
Luuk Coopmans,
Steve Campbell,
Gabriele De Chiara,
Anthony Kiely
Abstract:
We investigate several control strategies for the transport of an excitation along a spin chain. We demonstrate that fast, high fidelity transport can be achieved using protocols designed with differentiable programming. Building on this, we then show how this approach can be effectively adapted to control a disordered quantum system. We consider two settings: optimal control for a known unwanted…
▽ More
We investigate several control strategies for the transport of an excitation along a spin chain. We demonstrate that fast, high fidelity transport can be achieved using protocols designed with differentiable programming. Building on this, we then show how this approach can be effectively adapted to control a disordered quantum system. We consider two settings: optimal control for a known unwanted disorder pattern, i.e. a specific disorder realisation, and optimal control where only the statistical properties of disorder are known, i.e. optimizing for high average fidelities. In the former, disorder effects can be effectively mitigated for an appropriately chosen control protocol. However, in the latter setting the average fidelity can only be marginally improved, suggesting the presence of a fundamental lower bound.
△ Less
Submitted 29 November, 2022; v1 submitted 6 January, 2022;
originally announced January 2022.
-
Dynamical Phase Error in Interacting Topological Quantum Memories
Authors:
Luuk Coopmans,
Shane Dooley,
Ian Jubb,
Kevin Kavanagh,
Graham Kells
Abstract:
A local Hamiltonian with Topological Quantum Order (TQO) has a robust ground state degeneracy that makes it an excellent quantum memory candidate. This memory can be corrupted however if part of the state leaves the protected ground state manifold and returns later with a dynamically accrued phase error. Here we analyse how TQO suppresses this process and use this to quantify the degree to which s…
▽ More
A local Hamiltonian with Topological Quantum Order (TQO) has a robust ground state degeneracy that makes it an excellent quantum memory candidate. This memory can be corrupted however if part of the state leaves the protected ground state manifold and returns later with a dynamically accrued phase error. Here we analyse how TQO suppresses this process and use this to quantify the degree to which spectral densities in different topological sectors are correlated. We provide numerical verification of our results by modelling an interacting p-wave superconducting wire.
△ Less
Submitted 6 August, 2021; v1 submitted 31 December, 2020;
originally announced January 2021.
-
Protocol Discovery for the Quantum Control of Majoranas by Differentiable Programming and Natural Evolution Strategies
Authors:
Luuk Coopmans,
Di Luo,
Graham Kells,
Bryan K. Clark,
Juan Carrasquilla
Abstract:
Quantum control, which refers to the active manipulation of physical systems described by the laws of quantum mechanics, constitutes an essential ingredient for the development of quantum technology. Here we apply Differentiable Programming (DP) and Natural Evolution Strategies (NES) to the optimal transport of Majorana zero modes in superconducting nanowires, a key element to the success of Major…
▽ More
Quantum control, which refers to the active manipulation of physical systems described by the laws of quantum mechanics, constitutes an essential ingredient for the development of quantum technology. Here we apply Differentiable Programming (DP) and Natural Evolution Strategies (NES) to the optimal transport of Majorana zero modes in superconducting nanowires, a key element to the success of Majorana-based topological quantum computation. We formulate the motion control of Majorana zero modes as an optimization problem for which we propose a new categorization of four different regimes with respect to the critical velocity of the system and the total transport time. In addition to correctly recovering the anticipated smooth protocols in the adiabatic regime, our algorithms uncover efficient but strikingly counter-intuitive motion strategies in the non-adiabatic regime. The emergent picture reveals a simple but high fidelity strategy that makes use of pulse-like jumps at the beginning and the end of the protocol with a period of constant velocity in between the jumps, which we dub the jump-move-jump protocol. We provide a transparent semi-analytical picture, which uses the sudden approximation and a reformulation of the Majorana motion in a moving frame, to illuminate the key characteristics of the jump-move-jump control strategy. We verify that the jump-move-jump protocol remains robust against the presence of interactions or disorder, and corroborate its high efficacy on a realistic proximity coupled nanowire model. Our results demonstrate that machine learning for quantum control can be applied efficiently to quantum many-body dynamical systems with performance levels that make it relevant to the realization of large-scale quantum technology.
△ Less
Submitted 9 April, 2021; v1 submitted 20 August, 2020;
originally announced August 2020.
