-
On the relation between trainability and dequantization of variational quantum learning models
Authors:
Elies Gil-Fuster,
Casper Gyurik,
Adrián Pérez-Salinas,
Vedran Dunjko
Abstract:
The quest for successful variational quantum machine learning (QML) relies on the design of suitable parametrized quantum circuits (PQCs), as analogues to neural networks in classical machine learning. Successful QML models must fulfill the properties of trainability and non-dequantization, among others. Recent works have highlighted an intricate interplay between trainability and dequantization o…
▽ More
The quest for successful variational quantum machine learning (QML) relies on the design of suitable parametrized quantum circuits (PQCs), as analogues to neural networks in classical machine learning. Successful QML models must fulfill the properties of trainability and non-dequantization, among others. Recent works have highlighted an intricate interplay between trainability and dequantization of such models, which is still unresolved. In this work we contribute to this debate from the perspective of machine learning, proving a number of results identifying, among others when trainability and non-dequantization are not mutually exclusive. We begin by providing a number of new somewhat broader definitions of the relevant concepts, compared to what is found in other literature, which are operationally motivated, and consistent with prior art. With these precise definitions given and motivated, we then study the relation between trainability and dequantization of variational QML. Next, we also discuss the degrees of "variationalness" of QML models, where we distinguish between models like the hardware efficient ansatz and quantum kernel methods. Finally, we introduce recipes for building PQC-based QML models which are both trainable and nondequantizable, and corresponding to different degrees of variationalness. We do not address the practical utility for such models. Our work however does point toward a way forward for finding more general constructions, for which finding applications may become feasible.
△ Less
Submitted 11 June, 2024;
originally announced June 2024.
-
On Bounded Advice Classes
Authors:
Simon Marshall,
Casper Gyurik,
Vedran Dunjko
Abstract:
Advice classes in computational complexity have frequently been used to model real-world scenarios encountered in cryptography, quantum computing and machine learning, where some computational task may be broken down into a preprocessing and deployment phase, each associated with a different complexity. However, in these scenarios, the advice given by the preprocessing phase must still be generate…
▽ More
Advice classes in computational complexity have frequently been used to model real-world scenarios encountered in cryptography, quantum computing and machine learning, where some computational task may be broken down into a preprocessing and deployment phase, each associated with a different complexity. However, in these scenarios, the advice given by the preprocessing phase must still be generated by some (albeit more powerful) bounded machine, which is not the case in conventional advice classes. To better model these cases we develop `bounded advice classes', where a more powerful Turing machine generates advice for another, less powerful, Turing machine. We then focus on the question of when various classes generate useful advice, to answer this we connect bounded advice to unary languages. This connection allows us to state various conditional and unconditional results on the utility of advice generated by $\mathsf{EXP}$, $\mathsf{NP}$, $\mathsf{BQP}$, $\mathsf{PSPACE}$, and more. We study the relations between bounded advice classes, quantum bounded advice classes, and randomised bounded advice. We also examine how each of these concepts interact with recently introduced classes, like $\mathsf{BPP/samp}$. Our results also improve the state of the art in existing research on the complexity of advice functions.
△ Less
Submitted 28 May, 2024;
originally announced May 2024.
-
Exponential quantum advantages in learning quantum observables from classical data
Authors:
Riccardo Molteni,
Casper Gyurik,
Vedran Dunjko
Abstract:
Quantum computers are believed to bring computational advantages in simulating quantum many body systems. However, recent works have shown that classical machine learning algorithms are able to predict numerous properties of quantum systems with classical data. Despite various examples of learning tasks with provable quantum advantages being proposed, they all involve cryptographic functions and d…
▽ More
Quantum computers are believed to bring computational advantages in simulating quantum many body systems. However, recent works have shown that classical machine learning algorithms are able to predict numerous properties of quantum systems with classical data. Despite various examples of learning tasks with provable quantum advantages being proposed, they all involve cryptographic functions and do not represent any physical scenarios encountered in laboratory settings. In this paper we prove quantum advantages for the physically relevant task of learning quantum observables from classical (measured out) data. We consider two types of observables: first we prove a learning advantage for linear combinations of Pauli strings, then we extend the result for the broader case of unitarily parametrized observables. For each type of observable we delineate the boundaries that separate physically relevant tasks which classical computers can solve using data from quantum measurements, from those where a quantum computer is still necessary for data analysis. Our results shed light on the utility of quantum computers for machine learning problems in the domain of quantum many body physics, thereby suggesting new directions where quantum learning improvements may emerge.
△ Less
Submitted 3 May, 2024;
originally announced May 2024.
-
Parameterized quantum circuits as universal generative models for continuous multivariate distributions
Authors:
Alice Barthe,
Michele Grossi,
Sofia Vallecorsa,
Jordi Tura,
Vedran Dunjko
Abstract:
Parameterized quantum circuits have been extensively used as the basis for machine learning models in regression, classification, and generative tasks. For supervised learning, their expressivity has been thoroughly investigated and several universality properties have been proven. However, in the case of quantum generative modelling, much less is known, especially when the task is to model distri…
▽ More
Parameterized quantum circuits have been extensively used as the basis for machine learning models in regression, classification, and generative tasks. For supervised learning, their expressivity has been thoroughly investigated and several universality properties have been proven. However, in the case of quantum generative modelling, much less is known, especially when the task is to model distributions over continuous variables. In this work, we elucidate expectation value sampling-based models. Such models output the expectation values of a set of fixed observables from a quantum circuit into which classical random data has been uploaded. We prove the universality of such variational quantum algorithms for the generation of multivariate distributions. We explore various architectures which allow universality and prove tight bounds connecting the minimal required qubit number, and the minimal required number of measurements needed. Our results may help guide the design of future quantum circuits in generative modelling tasks.
△ Less
Submitted 29 May, 2024; v1 submitted 15 February, 2024;
originally announced February 2024.
-
Curriculum reinforcement learning for quantum architecture search under hardware errors
Authors:
Yash J. Patel,
Akash Kundu,
Mateusz Ostaszewski,
Xavier Bonet-Monroig,
Vedran Dunjko,
Onur Danaci
Abstract:
The key challenge in the noisy intermediate-scale quantum era is finding useful circuits compatible with current device limitations. Variational quantum algorithms (VQAs) offer a potential solution by fixing the circuit architecture and optimizing individual gate parameters in an external loop. However, parameter optimization can become intractable, and the overall performance of the algorithm dep…
▽ More
The key challenge in the noisy intermediate-scale quantum era is finding useful circuits compatible with current device limitations. Variational quantum algorithms (VQAs) offer a potential solution by fixing the circuit architecture and optimizing individual gate parameters in an external loop. However, parameter optimization can become intractable, and the overall performance of the algorithm depends heavily on the initially chosen circuit architecture. Several quantum architecture search (QAS) algorithms have been developed to design useful circuit architectures automatically. In the case of parameter optimization alone, noise effects have been observed to dramatically influence the performance of the optimizer and final outcomes, which is a key line of study. However, the effects of noise on the architecture search, which could be just as critical, are poorly understood. This work addresses this gap by introducing a curriculum-based reinforcement learning QAS (CRLQAS) algorithm designed to tackle challenges in realistic VQA deployment. The algorithm incorporates (i) a 3D architecture encoding and restrictions on environment dynamics to explore the search space of possible circuits efficiently, (ii) an episode halting scheme to steer the agent to find shorter circuits, and (iii) a novel variant of simultaneous perturbation stochastic approximation as an optimizer for faster convergence. To facilitate studies, we developed an optimized simulator for our algorithm, significantly improving computational efficiency in simulating noisy quantum circuits by employing the Pauli-transfer matrix formalism in the Pauli-Liouville basis. Numerical experiments focusing on quantum chemistry tasks demonstrate that CRLQAS outperforms existing QAS algorithms across several metrics in both noiseless and noisy environments.
△ Less
Submitted 5 February, 2024;
originally announced February 2024.
-
Quantum Optimization: Potential, Challenges, and the Path Forward
Authors:
Amira Abbas,
Andris Ambainis,
Brandon Augustino,
Andreas Bärtschi,
Harry Buhrman,
Carleton Coffrin,
Giorgio Cortiana,
Vedran Dunjko,
Daniel J. Egger,
Bruce G. Elmegreen,
Nicola Franco,
Filippo Fratini,
Bryce Fuller,
Julien Gacon,
Constantin Gonciulea,
Sander Gribling,
Swati Gupta,
Stuart Hadfield,
Raoul Heese,
Gerhard Kircher,
Thomas Kleinert,
Thorsten Koch,
Georgios Korpas,
Steve Lenk,
Jakub Marecek
, et al. (21 additional authors not shown)
Abstract:
Recent advances in quantum computers are demonstrating the ability to solve problems at a scale beyond brute force classical simulation. As such, a widespread interest in quantum algorithms has developed in many areas, with optimization being one of the most pronounced domains. Across computer science and physics, there are a number of algorithmic approaches, often with little linkage. This is fur…
▽ More
Recent advances in quantum computers are demonstrating the ability to solve problems at a scale beyond brute force classical simulation. As such, a widespread interest in quantum algorithms has developed in many areas, with optimization being one of the most pronounced domains. Across computer science and physics, there are a number of algorithmic approaches, often with little linkage. This is further complicated by the fragmented nature of the field of mathematical optimization, where major classes of optimization problems, such as combinatorial optimization, convex optimization, non-convex optimization, and stochastic extensions, have devoted communities. With these aspects in mind, this work draws on multiple approaches to study quantum optimization. Provably exact versus heuristic settings are first explained using computational complexity theory - highlighting where quantum advantage is possible in each context. Then, the core building blocks for quantum optimization algorithms are outlined to subsequently define prominent problem classes and identify key open questions that, if answered, will advance the field. The effects of scaling relevant problems on noisy quantum devices are also outlined in detail, alongside meaningful benchmarking problems. We underscore the importance of benchmarking by proposing clear metrics to conduct appropriate comparisons with classical optimization techniques. Lastly, we highlight two domains - finance and sustainability - as rich sources of optimization problems that could be used to benchmark, and eventually validate, the potential real-world impact of quantum optimization.
△ Less
Submitted 4 December, 2023;
originally announced December 2023.
-
Limitations of measure-first protocols in quantum machine learning
Authors:
Casper Gyurik,
Riccardo Molteni,
Vedran Dunjko
Abstract:
In recent works, much progress has been made with regards to so-called randomized measurement strategies, which include the famous methods of classical shadows and shadow tomography. In such strategies, unknown quantum states are first measured (or ``learned''), to obtain classical data that can be used to later infer (or ``predict'') some desired properties of the quantum states. Even if the used…
▽ More
In recent works, much progress has been made with regards to so-called randomized measurement strategies, which include the famous methods of classical shadows and shadow tomography. In such strategies, unknown quantum states are first measured (or ``learned''), to obtain classical data that can be used to later infer (or ``predict'') some desired properties of the quantum states. Even if the used measurement procedure is fixed, surprisingly, estimations of an exponential number of vastly different quantities can be obtained from a polynomial amount of measurement data. This raises the question of just how powerful ``measure-first'' strategies are, and in particular, if all quantum machine learning problems can be solved with a measure-first, analyze-later scheme. This paper explores the potential and limitations of these measure-first protocols in learning from quantum data. We study a natural supervised learning setting where quantum states constitute data points, and the labels stem from an unknown measurement. We examine two types of machine learning protocols: ``measure-first'' protocols, where all the quantum data is first measured using a fixed measurement strategy, and ``fully-quantum'' protocols where the measurements are adapted during the training process. Our main result is a proof of separation. We prove that there exist learning problems that can be efficiently learned by fully-quantum protocols but which require exponential resources for measure-first protocols. Moreover, we show that this separation persists even for quantum data that can be prepared by a polynomial-time quantum process, such as a polynomially-sized quantum circuit. Our proofs combine methods from one-way communication complexity and pseudorandom quantum states. Our result underscores the role of quantum data processing in machine learning and highlights scenarios where quantum advantages appear.
△ Less
Submitted 21 November, 2023;
originally announced November 2023.
-
Compilation of product-formula Hamiltonian simulation via reinforcement learning
Authors:
Lea M. Trenkwalder,
Eleanor Scerri,
Thomas E. O'Brien,
Vedran Dunjko
Abstract:
Hamiltonian simulation is believed to be one of the first tasks where quantum computers can yield a quantum advantage. One of the most popular methods of Hamiltonian simulation is Trotterization, which makes use of the approximation $e^{i\sum_jA_j}\sim \prod_je^{iA_j}$ and higher-order corrections thereto. However, this leaves open the question of the order of operations (i.e. the order of the pro…
▽ More
Hamiltonian simulation is believed to be one of the first tasks where quantum computers can yield a quantum advantage. One of the most popular methods of Hamiltonian simulation is Trotterization, which makes use of the approximation $e^{i\sum_jA_j}\sim \prod_je^{iA_j}$ and higher-order corrections thereto. However, this leaves open the question of the order of operations (i.e. the order of the product over $j$, which is known to affect the quality of approximation). In some cases this order is fixed by the desire to minimise the error of approximation; when it is not the case, we propose that the order can be chosen to optimize compilation to a native quantum architecture. This presents a new compilation problem -- order-agnostic quantum circuit compilation -- which we prove is NP-hard in the worst case. In lieu of an easily-computable exact solution, we turn to methods of heuristic optimization of compilation. We focus on reinforcement learning due to the sequential nature of the compilation task, comparing it to simulated annealing and Monte Carlo tree search. While two of the methods outperform a naive heuristic, reinforcement learning clearly outperforms all others, with a gain of around 12% with respect to the second-best method and of around 50% compared to the naive heuristic in terms of the gate count. We further test the ability of RL to generalize across instances of the compilation problem, and find that a single learner is able to solve entire problem families. This demonstrates the ability of machine learning techniques to provide assistance in an order-agnostic quantum compilation task.
△ Less
Submitted 7 November, 2023;
originally announced November 2023.
-
On the expressivity of embedding quantum kernels
Authors:
Elies Gil-Fuster,
Jens Eisert,
Vedran Dunjko
Abstract:
One of the most natural connections between quantum and classical machine learning has been established in the context of kernel methods. Kernel methods rely on kernels, which are inner products of feature vectors living in large feature spaces. Quantum kernels are typically evaluated by explicitly constructing quantum feature states and then taking their inner product, here called embedding quant…
▽ More
One of the most natural connections between quantum and classical machine learning has been established in the context of kernel methods. Kernel methods rely on kernels, which are inner products of feature vectors living in large feature spaces. Quantum kernels are typically evaluated by explicitly constructing quantum feature states and then taking their inner product, here called embedding quantum kernels. Since classical kernels are usually evaluated without using the feature vectors explicitly, we wonder how expressive embedding quantum kernels are. In this work, we raise the fundamental question: can all quantum kernels be expressed as the inner product of quantum feature states? Our first result is positive: Invoking computational universality, we find that for any kernel function there always exists a corresponding quantum feature map and an embedding quantum kernel. The more operational reading of the question is concerned with efficient constructions, however. In a second part, we formalize the question of universality of efficient embedding quantum kernels. For shift-invariant kernels, we use the technique of random Fourier features to show that they are universal within the broad class of all kernels which allow a variant of efficient Fourier sampling. We then extend this result to a new class of so-called composition kernels, which we show also contains projected quantum kernels introduced in recent works. After proving the universality of embedding quantum kernels for both shift-invariant and composition kernels, we identify the directions towards new, more exotic, and unexplored quantum kernel families, for which it still remains open whether they correspond to efficient embedding quantum kernels.
△ Less
Submitted 9 April, 2024; v1 submitted 25 September, 2023;
originally announced September 2023.
-
Parametrized Quantum Circuits and their approximation capacities in the context of quantum machine learning
Authors:
Alberto Manzano,
David Dechant,
Jordi Tura,
Vedran Dunjko
Abstract:
Parametrized quantum circuits (PQC) are quantum circuits which consist of both fixed and parametrized gates. In recent approaches to quantum machine learning (QML), PQCs are essentially ubiquitous and play the role analogous to classical neural networks. They are used to learn various types of data, with an underlying expectation that if the PQC is made sufficiently deep, and the data plentiful, t…
▽ More
Parametrized quantum circuits (PQC) are quantum circuits which consist of both fixed and parametrized gates. In recent approaches to quantum machine learning (QML), PQCs are essentially ubiquitous and play the role analogous to classical neural networks. They are used to learn various types of data, with an underlying expectation that if the PQC is made sufficiently deep, and the data plentiful, the generalization error will vanish, and the model will capture the essential features of the distribution. While there exist results proving the approximability of square-integrable functions by PQCs under the $L^2$ distance, the approximation for other function spaces and under other distances has been less explored. In this work we show that PQCs can approximate the space of continuous functions, $p$-integrable functions and the $H^k$ Sobolev spaces under specific distances. Moreover, we develop generalization bounds that connect different function spaces and distances. These results provide a theoretical basis for different applications of PQCs, for example for solving differential equations. Furthermore, they provide us with new insight on how to design PQCs and loss functions which better suit the specific needs of the users.
△ Less
Submitted 7 November, 2023; v1 submitted 27 July, 2023;
originally announced July 2023.
-
Quantum Computing for High-Energy Physics: State of the Art and Challenges. Summary of the QC4HEP Working Group
Authors:
Alberto Di Meglio,
Karl Jansen,
Ivano Tavernelli,
Constantia Alexandrou,
Srinivasan Arunachalam,
Christian W. Bauer,
Kerstin Borras,
Stefano Carrazza,
Arianna Crippa,
Vincent Croft,
Roland de Putter,
Andrea Delgado,
Vedran Dunjko,
Daniel J. Egger,
Elias Fernandez-Combarro,
Elina Fuchs,
Lena Funcke,
Daniel Gonzalez-Cuadra,
Michele Grossi,
Jad C. Halimeh,
Zoe Holmes,
Stefan Kuhn,
Denis Lacroix,
Randy Lewis,
Donatella Lucchesi
, et al. (21 additional authors not shown)
Abstract:
Quantum computers offer an intriguing path for a paradigmatic change of computing in the natural sciences and beyond, with the potential for achieving a so-called quantum advantage, namely a significant (in some cases exponential) speed-up of numerical simulations. The rapid development of hardware devices with various realizations of qubits enables the execution of small scale but representative…
▽ More
Quantum computers offer an intriguing path for a paradigmatic change of computing in the natural sciences and beyond, with the potential for achieving a so-called quantum advantage, namely a significant (in some cases exponential) speed-up of numerical simulations. The rapid development of hardware devices with various realizations of qubits enables the execution of small scale but representative applications on quantum computers. In particular, the high-energy physics community plays a pivotal role in accessing the power of quantum computing, since the field is a driving source for challenging computational problems. This concerns, on the theoretical side, the exploration of models which are very hard or even impossible to address with classical techniques and, on the experimental side, the enormous data challenge of newly emerging experiments, such as the upgrade of the Large Hadron Collider. In this roadmap paper, led by CERN, DESY and IBM, we provide the status of high-energy physics quantum computations and give examples for theoretical and experimental target benchmark applications, which can be addressed in the near future. Having the IBM 100 x 100 challenge in mind, where possible, we also provide resource estimates for the examples given using error mitigated quantum computing.
△ Less
Submitted 6 July, 2023;
originally announced July 2023.
-
Exponential separations between classical and quantum learners
Authors:
Casper Gyurik,
Vedran Dunjko
Abstract:
Despite significant effort, the quantum machine learning community has only demonstrated quantum learning advantages for artificial cryptography-inspired datasets when dealing with classical data. In this paper we address the challenge of finding learning problems where quantum learning algorithms can achieve a provable exponential speedup over classical learning algorithms. We reflect on computat…
▽ More
Despite significant effort, the quantum machine learning community has only demonstrated quantum learning advantages for artificial cryptography-inspired datasets when dealing with classical data. In this paper we address the challenge of finding learning problems where quantum learning algorithms can achieve a provable exponential speedup over classical learning algorithms. We reflect on computational learning theory concepts related to this question and discuss how subtle differences in definitions can result in significantly different requirements and tasks for the learner to meet and solve. We examine existing learning problems with provable quantum speedups and find that they largely rely on the classical hardness of evaluating the function that generates the data, rather than identifying it. To address this, we present two new learning separations where the classical difficulty primarily lies in identifying the function generating the data. Furthermore, we explore computational hardness assumptions that can be leveraged to prove quantum speedups in scenarios where data is quantum-generated, which implies likely quantum advantages in a plethora of more natural settings (e.g., in condensed matter and high energy physics). We also discuss the limitations of the classical shadow paradigm in the context of learning separations, and how physically-motivated settings such as characterizing phases of matter and Hamiltonian learning fit in the computational learning framework.
△ Less
Submitted 28 June, 2023;
originally announced June 2023.
-
Enhancing variational quantum state diagonalization using reinforcement learning techniques
Authors:
Akash Kundu,
Przemysław Bedełek,
Mateusz Ostaszewski,
Onur Danaci,
Yash J. Patel,
Vedran Dunjko,
Jarosław A. Miszczak
Abstract:
The variational quantum algorithms are crucial for the application of NISQ computers. Such algorithms require short quantum circuits, which are more amenable to implementation on near-term hardware, and many such methods have been developed. One of particular interest is the so-called variational quantum state diagonalization method, which constitutes an important algorithmic subroutine and can be…
▽ More
The variational quantum algorithms are crucial for the application of NISQ computers. Such algorithms require short quantum circuits, which are more amenable to implementation on near-term hardware, and many such methods have been developed. One of particular interest is the so-called variational quantum state diagonalization method, which constitutes an important algorithmic subroutine and can be used directly to work with data encoded in quantum states. In particular, it can be applied to discern the features of quantum states, such as entanglement properties of a system, or in quantum machine learning algorithms. In this work, we tackle the problem of designing a very shallow quantum circuit, required in the quantum state diagonalization task, by utilizing reinforcement learning (RL). We use a novel encoding method for the RL-state, a dense reward function, and an $ε$-greedy policy to achieve this. We demonstrate that the circuits proposed by the reinforcement learning methods are shallower than the standard variational quantum state diagonalization algorithm and thus can be used in situations where hardware capabilities limit the depth of quantum circuits. The methods we propose in the paper can be readily adapted to address a wide range of variational quantum algorithms.
△ Less
Submitted 11 January, 2024; v1 submitted 19 June, 2023;
originally announced June 2023.
-
Shadows of quantum machine learning
Authors:
Sofiene Jerbi,
Casper Gyurik,
Simon C. Marshall,
Riccardo Molteni,
Vedran Dunjko
Abstract:
Quantum machine learning is often highlighted as one of the most promising uses for a quantum computer to solve practical problems. However, a major obstacle to the widespread use of quantum machine learning models in practice is that these models, even once trained, still require access to a quantum computer in order to be evaluated on new data. To solve this issue, we suggest that following the…
▽ More
Quantum machine learning is often highlighted as one of the most promising uses for a quantum computer to solve practical problems. However, a major obstacle to the widespread use of quantum machine learning models in practice is that these models, even once trained, still require access to a quantum computer in order to be evaluated on new data. To solve this issue, we suggest that following the training phase of a quantum model, a quantum computer could be used to generate what we call a classical shadow of this model, i.e., a classically computable approximation of the learned function. While recent works already explore this idea and suggest approaches to construct such shadow models, they also raise the possibility that a completely classical model could be trained instead, thus circumventing the need for a quantum computer in the first place. In this work, we take a novel approach to define shadow models based on the frameworks of quantum linear models and classical shadow tomography. This approach allows us to show that there exist shadow models which can solve certain learning tasks that are intractable for fully classical models, based on widely-believed cryptography assumptions. We also discuss the (un)likeliness that all quantum models could be shadowfiable, based on common assumptions in complexity theory.
△ Less
Submitted 31 May, 2023;
originally announced June 2023.
-
Application of quantum-inspired generative models to small molecular datasets
Authors:
C. Moussa,
H. Wang,
M. Araya-Polo,
T. Bäck,
V. Dunjko
Abstract:
Quantum and quantum-inspired machine learning has emerged as a promising and challenging research field due to the increased popularity of quantum computing, especially with near-term devices. Theoretical contributions point toward generative modeling as a promising direction to realize the first examples of real-world quantum advantages from these technologies. A few empirical studies also demons…
▽ More
Quantum and quantum-inspired machine learning has emerged as a promising and challenging research field due to the increased popularity of quantum computing, especially with near-term devices. Theoretical contributions point toward generative modeling as a promising direction to realize the first examples of real-world quantum advantages from these technologies. A few empirical studies also demonstrate such potential, especially when considering quantum-inspired models based on tensor networks. In this work, we apply tensor-network-based generative models to the problem of molecular discovery. In our approach, we utilize two small molecular datasets: a subset of $4989$ molecules from the QM9 dataset and a small in-house dataset of $516$ validated antioxidants from TotalEnergies. We compare several tensor network models against a generative adversarial network using different sample-based metrics, which reflect their learning performances on each task, and multiobjective performances using $3$ relevant molecular metrics per task. We also combined the output of the models and demonstrate empirically that such a combination can be beneficial, advocating for the unification of classical and quantum(-inspired) generative learning.
△ Less
Submitted 21 April, 2023;
originally announced April 2023.
-
All this for one qubit? Bounds on local circuit cutting schemes
Authors:
Simon C. Marshall,
Jordi Tura,
Vedran Dunjko
Abstract:
Small numbers of qubits are one of the primary constraints on the near-term deployment of advantageous quantum computing. To mitigate this constraint, techniques have been developed to break up a large quantum computation into smaller computations. While this work is sometimes called circuit knitting or divide and quantum we generically refer to it as circuit cutting (CC). Much of the existing wor…
▽ More
Small numbers of qubits are one of the primary constraints on the near-term deployment of advantageous quantum computing. To mitigate this constraint, techniques have been developed to break up a large quantum computation into smaller computations. While this work is sometimes called circuit knitting or divide and quantum we generically refer to it as circuit cutting (CC). Much of the existing work has focused on the development of more efficient circuit cutting schemes, leaving open questions on the limits of what theoretically optimal schemes can achieve. We develop bounds by breaking up possible approaches into two distinct regimes: the first, where the input state and measurement are fixed and known, and the second, which requires a given cutting to work for a complete basis of input states and measurements. For the first case, it is easy to see that bounds addressing the efficiency of any approaches to circuit cutting amount to resolving BPP$\stackrel{?}{=}$BQP. We therefore restrict ourselves to a simpler question, asking what \textit{locally-acting} circuit cutting schemes can achieve, a technical restriction which still includes all existing circuit cutting schemes. In our first case we show that the existence of a locally-acting circuit cutting scheme which could efficiently partition even a single qubit from the rest of a circuit would imply BPP$=$BQP. In our second case, we obtain more general results, showing inefficiency unconditionally. We also show that any (local or otherwise) circuit cutting scheme cannot function by only applying unital channels.
△ Less
Submitted 23 March, 2023;
originally announced March 2023.
-
Bloch Sphere Binary Trees: A method for the visualization of sets of multi-qubit systems pure states
Authors:
Alice Barthe,
Michele Grossi,
Jordi Tura,
Vedran Dunjko
Abstract:
Understanding the evolution of a multi-qubit quantum system, or elucidating what portion of the Hilbert space is occupied by a quantum dataset becomes increasingly hard with the number of qubits. In this context, the visualisation of sets of multi-qubit pure quantum states on a single image can be helpful. However, the current approaches to visualization of this type only allow the representation…
▽ More
Understanding the evolution of a multi-qubit quantum system, or elucidating what portion of the Hilbert space is occupied by a quantum dataset becomes increasingly hard with the number of qubits. In this context, the visualisation of sets of multi-qubit pure quantum states on a single image can be helpful. However, the current approaches to visualization of this type only allow the representation of a set of single qubits (not allowing multi-qubit systems) or a just a single multi-qubit system (not suitable if we care about sets of states), sometimes with additional restrictions, on symmetry or entanglement for example. [1{3]. In this work we present a map** that can uniquely represent a set of arbitrary multi-qubit pure states on what we call a Binary Tree of Bloch Spheres. The backbone of this technique is the combination of the Schmidt decomposition and the Bloch sphere representation. We illustrate how this can be used in the context of understanding the time evolution of quantum states, e.g. providing immediate insights into the periodicity of the system and even entanglement properties. We also provide a recursive algorithm which translates from the computational basis state representation to the binary tree of Bloch spheres representation. The algorithm was implemented together with a visualization library in Python released as open source.
△ Less
Submitted 6 February, 2023;
originally announced February 2023.
-
Reduce&chop: Shallow circuits for deeper problems
Authors:
Adrián Pérez-Salinas,
Radoica Draškić,
Jordi Tura,
Vedran Dunjko
Abstract:
State-of-the-art quantum computers can only reliably execute circuits with limited qubit numbers and computational depth. This severely reduces the scope of algorithms that can be run. While numerous techniques have been invented to exploit few-qubit devices, corresponding schemes for depth-limited computations are less explored. This work investigates to what extent we can mimic the performance o…
▽ More
State-of-the-art quantum computers can only reliably execute circuits with limited qubit numbers and computational depth. This severely reduces the scope of algorithms that can be run. While numerous techniques have been invented to exploit few-qubit devices, corresponding schemes for depth-limited computations are less explored. This work investigates to what extent we can mimic the performance of a deeper quantum computation by repeatedly using a shallower device. We propose a method for this purpose, inspired by Feynman simulation, where a given circuit is chopped in two pieces. The first piece is executed and measured early on, and the second piece is run based on the previous outcome. This method is inefficient if applied in a straightforward manner due to the high number of possible outcomes. To mitigate this issue, we propose a shallow variational circuit, whose purpose is to maintain the complexity of the method within pre-defined tolerable limits, and provide a novel optimisation method to find such circuit. The composition of these components of the methods is called reduce\&chop. As we discuss, this approach works for certain cases of interest. We believe this work may stimulate new research towards exploiting the potential of shallow quantum computers.
△ Less
Submitted 22 December, 2023; v1 submitted 22 December, 2022;
originally announced December 2022.
-
Robustness of quantum reinforcement learning under hardware errors
Authors:
Andrea Skolik,
Stefano Mangini,
Thomas Bäck,
Chiara Macchiavello,
Vedran Dunjko
Abstract:
Variational quantum machine learning algorithms have become the focus of recent research on how to utilize near-term quantum devices for machine learning tasks. They are considered suitable for this as the circuits that are run can be tailored to the device, and a big part of the computation is delegated to the classical optimizer. It has also been hypothesized that they may be more robust to hard…
▽ More
Variational quantum machine learning algorithms have become the focus of recent research on how to utilize near-term quantum devices for machine learning tasks. They are considered suitable for this as the circuits that are run can be tailored to the device, and a big part of the computation is delegated to the classical optimizer. It has also been hypothesized that they may be more robust to hardware noise than conventional algorithms due to their hybrid nature. However, the effect of training quantum machine learning models under the influence of hardware-induced noise has not yet been extensively studied. In this work, we address this question for a specific type of learning, namely variational reinforcement learning, by studying its performance in the presence of various noise sources: shot noise, coherent and incoherent errors. We analytically and empirically investigate how the presence of noise during training and evaluation of variational quantum reinforcement learning algorithms affect the performance of the agents and robustness of the learned policies. Furthermore, we provide a method to reduce the number of measurements required to train Q-learning agents, using the inherent structure of the algorithm.
△ Less
Submitted 19 December, 2022;
originally announced December 2022.
-
Quantum policy gradient algorithms
Authors:
Sofiene Jerbi,
Arjan Cornelissen,
Māris Ozols,
Vedran Dunjko
Abstract:
Understanding the power and limitations of quantum access to data in machine learning tasks is primordial to assess the potential of quantum computing in artificial intelligence. Previous works have already shown that speed-ups in learning are possible when given quantum access to reinforcement learning environments. Yet, the applicability of quantum algorithms in this setting remains very limited…
▽ More
Understanding the power and limitations of quantum access to data in machine learning tasks is primordial to assess the potential of quantum computing in artificial intelligence. Previous works have already shown that speed-ups in learning are possible when given quantum access to reinforcement learning environments. Yet, the applicability of quantum algorithms in this setting remains very limited, notably in environments with large state and action spaces. In this work, we design quantum algorithms to train state-of-the-art reinforcement learning policies by exploiting quantum interactions with an environment. However, these algorithms only offer full quadratic speed-ups in sample complexity over their classical analogs when the trained policies satisfy some regularity conditions. Interestingly, we find that reinforcement learning policies derived from parametrized quantum circuits are well-behaved with respect to these conditions, which showcases the benefit of a fully-quantum reinforcement learning framework.
△ Less
Submitted 19 December, 2022;
originally announced December 2022.
-
Massive particle interferometry with lattice solitons
Authors:
Piero Naldesi,
Juan Polo,
Peter D. Drummond,
Vanja Dunjko,
Luigi Amico,
Anna Minguzzi,
Maxim Olshanii
Abstract:
We discuss an interferometric scheme employing interference of bright solitons formed as specific bound states of attracting bosons on a lattice. We revisit the proposal of Castin and Weiss [Phys. Rev. Lett. vol. 102, 010403 (2009)] for using the scattering of a quantum matter-wave soliton on a barrier in order to create a coherent superposition state of the soliton being entirely to the left of t…
▽ More
We discuss an interferometric scheme employing interference of bright solitons formed as specific bound states of attracting bosons on a lattice. We revisit the proposal of Castin and Weiss [Phys. Rev. Lett. vol. 102, 010403 (2009)] for using the scattering of a quantum matter-wave soliton on a barrier in order to create a coherent superposition state of the soliton being entirely to the left of the barrier and being entirely to the right of the barrier. In that proposal, it was assumed that the scattering is perfectly elastic, i.e.\ that the center-of-mass kinetic energy of the soliton is lower than the chemical potential of the soliton. Here we relax this assumption: By employing a combination of Bethe ansatz and DMRG based analysis of the dynamics of the appropriate many-body system, we find that the interferometric fringes persist even when the center-of-mass kinetic energy of the soliton is above the energy needed for its complete dissociation into constituent atoms.
△ Less
Submitted 18 October, 2022;
originally announced October 2022.
-
Analyzing Prospects for Quantum Advantage in Topological Data Analysis
Authors:
Dominic W. Berry,
Yuan Su,
Casper Gyurik,
Robbie King,
Joao Basso,
Alexander Del Toro Barba,
Abhishek Rajput,
Nathan Wiebe,
Vedran Dunjko,
Ryan Babbush
Abstract:
Lloyd et al. were first to demonstrate the promise of quantum algorithms for computing Betti numbers, a way to characterize topological features of data sets. Here, we propose, analyze, and optimize an improved quantum algorithm for topological data analysis (TDA) with reduced scaling, including a method for preparing Dicke states based on inequality testing, a more efficient amplitude estimation…
▽ More
Lloyd et al. were first to demonstrate the promise of quantum algorithms for computing Betti numbers, a way to characterize topological features of data sets. Here, we propose, analyze, and optimize an improved quantum algorithm for topological data analysis (TDA) with reduced scaling, including a method for preparing Dicke states based on inequality testing, a more efficient amplitude estimation algorithm using Kaiser windows, and an optimal implementation of eigenvalue projectors based on Chebyshev polynomials. We compile our approach to a fault-tolerant gate set and estimate constant factors in the Toffoli complexity. Our analysis reveals that super-quadratic quantum speedups are only possible for this problem when targeting a multiplicative error approximation and the Betti number grows asymptotically. Further, we propose a dequantization of the quantum TDA algorithm that shows that having exponentially large dimension and Betti number are necessary, but insufficient conditions, for super-polynomial advantage. We then introduce and analyze specific problem examples which have parameters in the regime where super-polynomial advantages may be achieved, and argue that quantum circuits with tens of billions of Toffoli gates can solve seemingly classically intractable instances.
△ Less
Submitted 27 September, 2023; v1 submitted 27 September, 2022;
originally announced September 2022.
-
On establishing learning separations between classical and quantum machine learning with classical data
Authors:
Casper Gyurik,
Vedran Dunjko
Abstract:
Despite years of effort, the quantum machine learning community has only been able to show quantum learning advantages for certain contrived cryptography-inspired datasets in the case of classical data. In this note, we discuss the challenges of finding learning problems that quantum learning algorithms can learn much faster than any classical learning algorithm, and we study how to identify such…
▽ More
Despite years of effort, the quantum machine learning community has only been able to show quantum learning advantages for certain contrived cryptography-inspired datasets in the case of classical data. In this note, we discuss the challenges of finding learning problems that quantum learning algorithms can learn much faster than any classical learning algorithm, and we study how to identify such learning problems. Specifically, we reflect on the main concepts in computational learning theory pertaining to this question, and we discuss how subtle changes in definitions can mean conceptually significantly different tasks, which can either lead to a separation or no separation at all. Moreover, we study existing learning problems with a provable quantum speedup to distill sets of more general and sufficient conditions (i.e., ``checklists'') for a learning problem to exhibit a separation between classical and quantum learners. These checklists are intended to streamline one's approach to proving quantum speedups for learning problems, or to elucidate bottlenecks. Finally, to illustrate its application, we analyze examples of potential separations (i.e., when the learning problem is build from computational separations, or when the data comes from a quantum experiment) through the lens of our approach.
△ Less
Submitted 4 July, 2023; v1 submitted 12 August, 2022;
originally announced August 2022.
-
Reinforcement Learning Assisted Recursive QAOA
Authors:
Yash J. Patel,
Sofiene Jerbi,
Thomas Bäck,
Vedran Dunjko
Abstract:
Variational quantum algorithms such as the Quantum Approximation Optimization Algorithm (QAOA) in recent years have gained popularity as they provide the hope of using NISQ devices to tackle hard combinatorial optimization problems. It is, however, known that at low depth, certain locality constraints of QAOA limit its performance. To go beyond these limitations, a non-local variant of QAOA, namel…
▽ More
Variational quantum algorithms such as the Quantum Approximation Optimization Algorithm (QAOA) in recent years have gained popularity as they provide the hope of using NISQ devices to tackle hard combinatorial optimization problems. It is, however, known that at low depth, certain locality constraints of QAOA limit its performance. To go beyond these limitations, a non-local variant of QAOA, namely recursive QAOA (RQAOA), was proposed to improve the quality of approximate solutions. The RQAOA has been studied comparatively less than QAOA, and it is less understood, for instance, for what family of instances it may fail to provide high quality solutions. However, as we are tackling $\mathsf{NP}$-hard problems (specifically, the Ising spin model), it is expected that RQAOA does fail, raising the question of designing even better quantum algorithms for combinatorial optimization. In this spirit, we identify and analyze cases where RQAOA fails and, based on this, propose a reinforcement learning enhanced RQAOA variant (RL-RQAOA) that improves upon RQAOA. We show that the performance of RL-RQAOA improves over RQAOA: RL-RQAOA is strictly better on these identified instances where RQAOA underperforms, and is similarly performing on instances where RQAOA is near-optimal. Our work exemplifies the potentially beneficial synergy between reinforcement learning and quantum (inspired) optimization in the design of new, even better heuristics for hard problems.
△ Less
Submitted 5 February, 2024; v1 submitted 13 July, 2022;
originally announced July 2022.
-
Hyperparameter Importance of Quantum Neural Networks Across Small Datasets
Authors:
Charles Moussa,
Jan N. van Rijn,
Thomas Bäck,
Vedran Dunjko
Abstract:
As restricted quantum computers are slowly becoming a reality, the search for meaningful first applications intensifies. In this domain, one of the more investigated approaches is the use of a special type of quantum circuit - a so-called quantum neural network -- to serve as a basis for a machine learning model. Roughly speaking, as the name suggests, a quantum neural network can play a similar r…
▽ More
As restricted quantum computers are slowly becoming a reality, the search for meaningful first applications intensifies. In this domain, one of the more investigated approaches is the use of a special type of quantum circuit - a so-called quantum neural network -- to serve as a basis for a machine learning model. Roughly speaking, as the name suggests, a quantum neural network can play a similar role to a neural network. However, specifically for applications in machine learning contexts, very little is known about suitable circuit architectures, or model hyperparameters one should use to achieve good learning performance. In this work, we apply the functional ANOVA framework to quantum neural networks to analyze which of the hyperparameters were most influential for their predictive performance. We analyze one of the most typically used quantum neural network architectures. We then apply this to $7$ open-source datasets from the OpenML-CC18 classification benchmark whose number of features is small enough to fit on quantum hardware with less than $20$ qubits. Three main levels of importance were detected from the ranking of hyperparameters obtained with functional ANOVA. Our experiment both confirmed expected patterns and revealed new insights. For instance, setting well the learning rate is deemed the most critical hyperparameter in terms of marginal contribution on all datasets, whereas the particular choice of entangling gates used is considered the least important except on one dataset. This work introduces new methodologies to study quantum machine learning models and provides new insights toward quantum model selection.
△ Less
Submitted 20 June, 2022;
originally announced June 2022.
-
Equivariant quantum circuits for learning on weighted graphs
Authors:
Andrea Skolik,
Michele Cattelan,
Sheir Yarkoni,
Thomas Bäck,
Vedran Dunjko
Abstract:
Variational quantum algorithms are the leading candidate for advantage on near-term quantum hardware. When training a parametrized quantum circuit in this setting to solve a specific problem, the choice of ansatz is one of the most important factors that determines the trainability and performance of the algorithm. In quantum machine learning (QML), however, the literature on ansatzes that are mot…
▽ More
Variational quantum algorithms are the leading candidate for advantage on near-term quantum hardware. When training a parametrized quantum circuit in this setting to solve a specific problem, the choice of ansatz is one of the most important factors that determines the trainability and performance of the algorithm. In quantum machine learning (QML), however, the literature on ansatzes that are motivated by the training data structure is scarce. In this work, we introduce an ansatz for learning tasks on weighted graphs that respects an important graph symmetry, namely equivariance under node permutations. We evaluate the performance of this ansatz on a complex learning task, namely neural combinatorial optimization, where a machine learning model is used to learn a heuristic for a combinatorial optimization problem. We analytically and numerically study the performance of our model, and our results strengthen the notion that symmetry-preserving ansatzes are a key to success in QML.
△ Less
Submitted 24 April, 2023; v1 submitted 12 May, 2022;
originally announced May 2022.
-
Modern applications of machine learning in quantum sciences
Authors:
Anna Dawid,
Julian Arnold,
Borja Requena,
Alexander Gresch,
Marcin Płodzień,
Kaelan Donatella,
Kim A. Nicoli,
Paolo Stornati,
Rouven Koch,
Miriam Büttner,
Robert Okuła,
Gorka Muñoz-Gil,
Rodrigo A. Vargas-Hernández,
Alba Cervera-Lierta,
Juan Carrasquilla,
Vedran Dunjko,
Marylou Gabrié,
Patrick Huembeli,
Evert van Nieuwenburg,
Filippo Vicentini,
Lei Wang,
Sebastian J. Wetzel,
Giuseppe Carleo,
Eliška Greplová,
Roman Krems
, et al. (4 additional authors not shown)
Abstract:
In this book, we provide a comprehensive introduction to the most recent advances in the application of machine learning methods in quantum sciences. We cover the use of deep learning and kernel methods in supervised, unsupervised, and reinforcement learning algorithms for phase classification, representation of many-body quantum states, quantum feedback control, and quantum circuits optimization.…
▽ More
In this book, we provide a comprehensive introduction to the most recent advances in the application of machine learning methods in quantum sciences. We cover the use of deep learning and kernel methods in supervised, unsupervised, and reinforcement learning algorithms for phase classification, representation of many-body quantum states, quantum feedback control, and quantum circuits optimization. Moreover, we introduce and discuss more specialized topics such as differentiable programming, generative models, statistical approach to machine learning, and quantum machine learning.
△ Less
Submitted 15 November, 2023; v1 submitted 8 April, 2022;
originally announced April 2022.
-
High Dimensional Quantum Machine Learning With Small Quantum Computers
Authors:
Simon C. Marshall,
Casper Gyurik,
Vedran Dunjko
Abstract:
Quantum computers hold great promise to enhance machine learning, but their current qubit counts restrict the realisation of this promise. In an attempt to placate this limitation techniques can be applied for evaluating a quantum circuit using a machine with fewer qubits than the circuit naively requires. These techniques work by evaluating many smaller circuits on the smaller machine, that are t…
▽ More
Quantum computers hold great promise to enhance machine learning, but their current qubit counts restrict the realisation of this promise. In an attempt to placate this limitation techniques can be applied for evaluating a quantum circuit using a machine with fewer qubits than the circuit naively requires. These techniques work by evaluating many smaller circuits on the smaller machine, that are then combined in a polynomial to replicate the output of the larger machine. This scheme requires more circuit evaluations than are practical for general circuits. However, we investigate the possibility that for certain applications many of these subcircuits are superfluous, and that a much smaller sum is sufficient to estimate the full circuit. We construct a machine learning model that may be capable of approximating the outputs of the larger circuit with much fewer circuit evaluations. We successfully apply our model to the task of digit recognition, using simulated quantum computers much smaller than the data dimension. The model is also applied to the task of approximating a random 10 qubit PQC with simulated access to a 5 qubit computer, even with only relatively modest number of circuits our model provides an accurate approximation of the 10 qubit PQCs output, superior to a neural network attempt. The developed method might be useful for implementing quantum models on larger data throughout the NISQ era.
△ Less
Submitted 12 July, 2023; v1 submitted 25 March, 2022;
originally announced March 2022.
-
Unsupervised strategies for identifying optimal parameters in Quantum Approximate Optimization Algorithm
Authors:
Charles Moussa,
Hao Wang,
Thomas Bäck,
Vedran Dunjko
Abstract:
As combinatorial optimization is one of the main quantum computing applications, many methods based on parameterized quantum circuits are being developed. In general, a set of parameters are being tweaked to optimize a cost function out of the quantum circuit output. One of these algorithms, the Quantum Approximate Optimization Algorithm stands out as a promising approach to tackling combinatorial…
▽ More
As combinatorial optimization is one of the main quantum computing applications, many methods based on parameterized quantum circuits are being developed. In general, a set of parameters are being tweaked to optimize a cost function out of the quantum circuit output. One of these algorithms, the Quantum Approximate Optimization Algorithm stands out as a promising approach to tackling combinatorial problems. However, finding the appropriate parameters is a difficult task. Although QAOA exhibits concentration properties, they can depend on instances characteristics that may not be easy to identify, but may nonetheless offer useful information to find good parameters. In this work, we study unsupervised Machine Learning approaches for setting these parameters without optimization. We perform clustering with the angle values but also instances encodings (using instance features or the output of a variational graph autoencoder), and compare different approaches. These angle-finding strategies can be used to reduce calls to quantum circuits when leveraging QAOA as a subroutine. We showcase them within Recursive-QAOA up to depth $3$ where the number of QAOA parameters used per iteration is limited to $3$, achieving a median approximation ratio of $0.94$ for MaxCut over $200$ Erdős-Rényi graphs. We obtain similar performances to the case where we extensively optimize the angles, hence saving numerous circuit calls.
△ Less
Submitted 6 May, 2022; v1 submitted 18 February, 2022;
originally announced February 2022.
-
Massive particle interferometry with lattice solitons: robustness against ionization
Authors:
Piero Naldesi,
Peter D. Drummond,
Vanja Dunjko,
Anna Minguzzi,
Maxim Olshanii
Abstract:
We revisit the proposal of Castin and Weiss [Phys. Rev. Lett. vol. 102, 010403 (2009)] for using the scattering of a quantum matter-wave soliton on a barrier in order to create a coherent superposition state of the soliton being entirely to the left of the barrier and being entirely to the right of the barrier. In that proposal, is was assumed that the scattering is perfectly elastic, i.e. that th…
▽ More
We revisit the proposal of Castin and Weiss [Phys. Rev. Lett. vol. 102, 010403 (2009)] for using the scattering of a quantum matter-wave soliton on a barrier in order to create a coherent superposition state of the soliton being entirely to the left of the barrier and being entirely to the right of the barrier. In that proposal, is was assumed that the scattering is perfectly elastic, i.e. that the center-of-mass kinetic energy of the soliton is lower than the chemical potential of the soliton. Here we relax this assumption. Also, we introduce an interferometric scheme, which uses interference of soltions, that can be used to detect the degree of coherence between the reflected and transmitted part of the soliton. Using exact diagonalization, we numerically simulate a complete interferometric cycle for a soliton consisting of six atoms. We find that the interferometric fringes persist even when the center-of-mass kinetic energy of the soliton is above the energy needed for complete dissociation of the soliton into constituent atoms.
△ Less
Submitted 25 January, 2022;
originally announced January 2022.
-
Path Integral Estimates of the Quantum Fluctuations of the Relative Soliton-Soliton Velocity in a Gross-Pitevskii Breather
Authors:
Sumita Datta,
Vanja Dunjko,
Maxim Olshanii
Abstract:
In this paper, the quantum fluctuations of the relative velocity of constituent solitons in a Gross-Pitaevskii breather are studied. The breather is confined in a weak harmonic trap. These fluctuations are monitored,indirectly, using a two-body correlation function measured at a quarter of the harmonic period after the breather creation. The results of an ab initio quantum Monte Carlo calculations…
▽ More
In this paper, the quantum fluctuations of the relative velocity of constituent solitons in a Gross-Pitaevskii breather are studied. The breather is confined in a weak harmonic trap. These fluctuations are monitored,indirectly, using a two-body correlation function measured at a quarter of the harmonic period after the breather creation. The results of an ab initio quantum Monte Carlo calculations, based on the Feynman-Kac path integration method, are compared with the analytical predictions using the recently suggested approach within the Bogoliubov approximation, and a good agreement is obtained.
△ Less
Submitted 12 January, 2022; v1 submitted 10 January, 2022;
originally announced January 2022.
-
Performance comparison of optimization methods on variational quantum algorithms
Authors:
Xavier Bonet-Monroig,
Hao Wang,
Diederick Vermetten,
Bruno Senjean,
Charles Moussa,
Thomas Bäck,
Vedran Dunjko,
Thomas E. O'Brien
Abstract:
Variational quantum algorithms (VQAs) offer a promising path toward using near-term quantum hardware for applications in academic and industrial research. These algorithms aim to find approximate solutions to quantum problems by optimizing a parametrized quantum circuit using a classical optimization algorithm. A successful VQA requires fast and reliable classical optimization algorithms. Understa…
▽ More
Variational quantum algorithms (VQAs) offer a promising path toward using near-term quantum hardware for applications in academic and industrial research. These algorithms aim to find approximate solutions to quantum problems by optimizing a parametrized quantum circuit using a classical optimization algorithm. A successful VQA requires fast and reliable classical optimization algorithms. Understanding and optimizing how off-the-shelf optimization methods perform in this context is important for the future of the field. In this work, we study the performance of four commonly used gradient-free optimization methods: SLSQP, COBYLA, CMA-ES, and SPSA, at finding ground-state energies of a range of small chemistry and material science problems. We test a telesco** sampling scheme (where the accuracy of the cost-function estimate provided to the optimizer is increased as the optimization converges) on all methods, demonstrating mixed results across our range of optimizers and problems chosen. We further hyperparameter tune two of the four optimizers (CMA-ES and SPSA) across a large range of models and demonstrate that with appropriate hyperparameter tuning, CMA-ES is competitive with and sometimes outperforms SPSA (which is not observed in the absence of hyperparameter tuning). Finally, we investigate the ability of an optimizer to beat the `sampling noise floor' given by the sampling noise on each cost-function estimate provided to the optimizer. Our results demonstrate the necessity for tailoring and hyperparameter-tuning known optimization techniques for inherently-noisy variational quantum algorithms and that the variational landscape that one finds in a VQA is highly problem- and system-dependent. This provides guidance for future implementations of these algorithms in the experiment.
△ Less
Submitted 8 March, 2023; v1 submitted 26 November, 2021;
originally announced November 2021.
-
Quantum machine learning beyond kernel methods
Authors:
Sofiene Jerbi,
Lukas J. Fiderer,
Hendrik Poulsen Nautrup,
Jonas M. Kübler,
Hans J. Briegel,
Vedran Dunjko
Abstract:
Machine learning algorithms based on parametrized quantum circuits are prime candidates for near-term applications on noisy quantum computers. In this direction, various types of quantum machine learning models have been introduced and studied extensively. Yet, our understanding of how these models compare, both mutually and to classical models, remains limited. In this work, we identify a constru…
▽ More
Machine learning algorithms based on parametrized quantum circuits are prime candidates for near-term applications on noisy quantum computers. In this direction, various types of quantum machine learning models have been introduced and studied extensively. Yet, our understanding of how these models compare, both mutually and to classical models, remains limited. In this work, we identify a constructive framework that captures all standard models based on parametrized quantum circuits: that of linear quantum models. In particular, we show using tools from quantum information theory how data re-uploading circuits, an apparent outlier of this framework, can be efficiently mapped into the simpler picture of linear models in quantum Hilbert spaces. Furthermore, we analyze the experimentally-relevant resource requirements of these models in terms of qubit number and amount of data needed to learn. Based on recent results from classical machine learning, we prove that linear quantum models must utilize exponentially more qubits than data re-uploading models in order to solve certain learning tasks, while kernel methods additionally require exponentially more data points. Our results provide a more comprehensive view of quantum machine learning models as well as insights on the compatibility of different models with NISQ constraints.
△ Less
Submitted 1 February, 2023; v1 submitted 25 October, 2021;
originally announced October 2021.
-
The origin of the period-$2T/7$ quasi-breathing in disk-shaped Gross-Pitaevskii breathers
Authors:
J. Torrents,
V. Dunjko,
M. Gonchenko,
G. E. Astrakharchik,
M. Olshanii
Abstract:
We address the origins of the quasi-periodic breathing observed in [Phys. Rev.\ X vol. 9, 021035 (2019)] in disk-shaped harmonically trapped two-dimensional Bose condensates, where the quasi-period $T_{\text{quasi-breathing}}\sim$~$2T/7$ and $T$ is the period of the harmonic trap. We show that, due to an unexplained coincidence, the first instance of the collapse of the hydrodynamic description, a…
▽ More
We address the origins of the quasi-periodic breathing observed in [Phys. Rev.\ X vol. 9, 021035 (2019)] in disk-shaped harmonically trapped two-dimensional Bose condensates, where the quasi-period $T_{\text{quasi-breathing}}\sim$~$2T/7$ and $T$ is the period of the harmonic trap. We show that, due to an unexplained coincidence, the first instance of the collapse of the hydrodynamic description, at $t^{*} = \arctan(\sqrt{2})/(2π) T \approx T/7$, emerges as a `skillful impostor' of the quasi-breathing half-period $T_{\text{quasi-breathing}}/2$. At the time $t^{*}$, the velocity field almost vanishes, supporting the requisite time-reversal invariance. We find that this phenomenon persists for scale-invariant gases in all spatial dimensions, being exact in one dimension and, likely, approximate in all others. In $d$ dimensions, the quasi-breathing half-period assumes the form $T_{\text{quasi-breathing}}/2 \equiv t^{*} = \arctan(\sqrt{d})/(2π) T$. Remaining unresolved is the origin of the period-$2T$ breathing, reported in the same experiment.
△ Less
Submitted 22 August, 2021;
originally announced August 2021.
-
LIMDD: A Decision Diagram for Simulation of Quantum Computing Including Stabilizer States
Authors:
Lieuwe Vinkhuijzen,
Tim Coopmans,
David Elkouss,
Vedran Dunjko,
Alfons Laarman
Abstract:
Efficient methods for the representation and simulation of quantum states and quantum operations are crucial for the optimization of quantum circuits. Decision diagrams (DDs), a well-studied data structure originally used to represent Boolean functions, have proven capable of capturing relevant aspects of quantum systems, but their limits are not well understood. In this work, we investigate and b…
▽ More
Efficient methods for the representation and simulation of quantum states and quantum operations are crucial for the optimization of quantum circuits. Decision diagrams (DDs), a well-studied data structure originally used to represent Boolean functions, have proven capable of capturing relevant aspects of quantum systems, but their limits are not well understood. In this work, we investigate and bridge the gap between existing DD-based structures and the stabilizer formalism, an important tool for simulating quantum circuits in the tractable regime. We first show that although DDs were suggested to succinctly represent important quantum states, they actually require exponential space for certain stabilizer states. To remedy this, we introduce a more powerful decision diagram variant, called Local Invertible Map-DD (LIMDD). We prove that the set of quantum states represented by poly-sized LIMDDs strictly contains the union of stabilizer states and other decision diagram variants. Finally, there exist circuits which LIMDDs can efficiently simulate, while their output states cannot be succinctly represented by two state-of-the-art simulation paradigms: the stabilizer decomposition techniques for Clifford + $T$ circuits and Matrix-Product States. By uniting two successful approaches, LIMDDs thus pave the way for fundamentally more powerful solutions for simulation and analysis of quantum computing.
△ Less
Submitted 6 September, 2023; v1 submitted 2 August, 2021;
originally announced August 2021.
-
Structural risk minimization for quantum linear classifiers
Authors:
Casper Gyurik,
Dyon van Vreumingen,
Vedran Dunjko
Abstract:
Quantum machine learning (QML) models based on parameterized quantum circuits are often highlighted as candidates for quantum computing's near-term ``killer application''. However, the understanding of the empirical and generalization performance of these models is still in its infancy. In this paper we study how to balance between training accuracy and generalization performance (also called stru…
▽ More
Quantum machine learning (QML) models based on parameterized quantum circuits are often highlighted as candidates for quantum computing's near-term ``killer application''. However, the understanding of the empirical and generalization performance of these models is still in its infancy. In this paper we study how to balance between training accuracy and generalization performance (also called structural risk minimization) for two prominent QML models introduced by Havlíček et al. (Nature, 2019), and Schuld and Killoran (PRL, 2019). Firstly, using relationships to well understood classical models, we prove that two model parameters -- i.e., the dimension of the sum of the images and the Frobenius norm of the observables used by the model -- closely control the models' complexity and therefore its generalization performance. Secondly, using ideas inspired by process tomography, we prove that these model parameters also closely control the models' ability to capture correlations in sets of training examples. In summary, our results give rise to new options for structural risk minimization for QML models.
△ Less
Submitted 10 January, 2023; v1 submitted 12 May, 2021;
originally announced May 2021.
-
Quantum Chirikov criterion: Two particles in a box as a toy model for a quantum gas
Authors:
Dmitry Yampolsky,
N. L. Harshman,
Vanja Dunjko,
Zaijong Hwang,
Maxim Olshanii
Abstract:
We consider a toy model for emergence of chaos in a quantum many-body short-range-interacting system: two one-dimensional hard-core particles in a box, with a small mass defect as a perturbation over an integrable system, the latter represented by two equal mass particles. To that system, we apply a quantum generalization of Chirikov's criterion for the onset of chaos, i.e. the criterion of overla…
▽ More
We consider a toy model for emergence of chaos in a quantum many-body short-range-interacting system: two one-dimensional hard-core particles in a box, with a small mass defect as a perturbation over an integrable system, the latter represented by two equal mass particles. To that system, we apply a quantum generalization of Chirikov's criterion for the onset of chaos, i.e. the criterion of overlap** resonances. There, classical nonlinear resonances translate almost verbatim to the quantum language. Quantum mechanics intervenes at a later stage: the resonances occupying less than one Hamiltonian eigenstate are excluded from the chaos criterion. Resonances appear as contiguous patches of low purity unperturbed eigenstates, separated by the groups of undestroyed states -- the quantum analogues of the classical KAM tori.
△ Less
Submitted 14 March, 2022; v1 submitted 25 April, 2021;
originally announced April 2021.
-
Reinforcement learning for optimization of variational quantum circuit architectures
Authors:
Mateusz Ostaszewski,
Lea M. Trenkwalder,
Wojciech Masarczyk,
Eleanor Scerri,
Vedran Dunjko
Abstract:
The study of Variational Quantum Eigensolvers (VQEs) has been in the spotlight in recent times as they may lead to real-world applications of near-term quantum devices. However, their performance depends on the structure of the used variational ansatz, which requires balancing the depth and expressivity of the corresponding circuit. In recent years, various methods for VQE structure optimization h…
▽ More
The study of Variational Quantum Eigensolvers (VQEs) has been in the spotlight in recent times as they may lead to real-world applications of near-term quantum devices. However, their performance depends on the structure of the used variational ansatz, which requires balancing the depth and expressivity of the corresponding circuit. In recent years, various methods for VQE structure optimization have been introduced but the capacities of machine learning to aid with this problem has not yet been fully investigated. In this work, we propose a reinforcement learning algorithm that autonomously explores the space of possible ans{ä}tze, identifying economic circuits which still yield accurate ground energy estimates. The algorithm is intrinsically motivated, and it incrementally improves the accuracy of the result while minimizing the circuit depth. We showcase the performance of our algorithm on the problem of estimating the ground-state energy of lithium hydride (LiH). In this well-known benchmark problem, we achieve chemical accuracy, as well as state-of-the-art results in terms of circuit depth.
△ Less
Submitted 30 March, 2021;
originally announced March 2021.
-
Quantum agents in the Gym: a variational quantum algorithm for deep Q-learning
Authors:
Andrea Skolik,
Sofiene Jerbi,
Vedran Dunjko
Abstract:
Quantum machine learning (QML) has been identified as one of the key fields that could reap advantages from near-term quantum devices, next to optimization and quantum chemistry. Research in this area has focused primarily on variational quantum algorithms (VQAs), and several proposals to enhance supervised, unsupervised and reinforcement learning (RL) algorithms with VQAs have been put forward. O…
▽ More
Quantum machine learning (QML) has been identified as one of the key fields that could reap advantages from near-term quantum devices, next to optimization and quantum chemistry. Research in this area has focused primarily on variational quantum algorithms (VQAs), and several proposals to enhance supervised, unsupervised and reinforcement learning (RL) algorithms with VQAs have been put forward. Out of the three, RL is the least studied and it is still an open question whether VQAs can be competitive with state-of-the-art classical algorithms based on neural networks (NNs) even on simple benchmark tasks. In this work, we introduce a training method for parametrized quantum circuits (PQCs) that can be used to solve RL tasks for discrete and continuous state spaces based on the deep Q-learning algorithm. We investigate which architectural choices for quantum Q-learning agents are most important for successfully solving certain types of environments by performing ablation studies for a number of different data encoding and readout strategies. We provide insight into why the performance of a VQA-based Q-learning algorithm crucially depends on the observables of the quantum model and show how to choose suitable observables based on the learning task at hand. To compare our model against the classical DQN algorithm, we perform an extensive hyperparameter search of PQCs and NNs with varying numbers of parameters. We confirm that similar to results in classical literature, the architectural choices and hyperparameters contribute more to the agents' success in a RL setting than the number of parameters used in the model. Finally, we show when recent separation results between classical and quantum agents for policy gradient RL can be extended to inferring optimal Q-values in restricted families of environments.
△ Less
Submitted 16 May, 2022; v1 submitted 28 March, 2021;
originally announced March 2021.
-
Encoding strongly-correlated many-boson wavefunctions on a photonic quantum computer: application to the attractive Bose-Hubbard model
Authors:
Saad Yalouz,
Bruno Senjean,
Filippo Miatto,
Vedran Dunjko
Abstract:
Variational quantum algorithms (VQA) are considered as some of the most promising methods to determine the properties of complex strongly correlated quantum many-body systems, especially from the perspective of devices available in the near term. In this context, the development of efficient quantum circuit ansatze to encode a many-body wavefunction is one of the keys for the success of a VQA. Gre…
▽ More
Variational quantum algorithms (VQA) are considered as some of the most promising methods to determine the properties of complex strongly correlated quantum many-body systems, especially from the perspective of devices available in the near term. In this context, the development of efficient quantum circuit ansatze to encode a many-body wavefunction is one of the keys for the success of a VQA. Great efforts have been invested to study the potential of current quantum devices to encode the eigenstates of fermionic systems, but little is known about the encoding of bosonic systems. In this work, we investigate the encoding of the ground state of the (simple but rich) attractive Bose-Hubbard model using a Continuous-Variable (CV) photonic-based quantum circuit. We introduce two different ansatz architectures and demonstrate that the proposed continuous variable quantum circuits can efficiently encode (with a fidelity higher than 99%) the strongly correlated many-boson wavefunction with just a few layers, in all many-body regimes and for different number of bosons and initial states. Beyond the study of the suitability of the ansatz to approximate the ground states of many-boson systems, we also perform initial evaluations of the use of the ansatz in a variational quantum eigensolver algorithm to find it through energy minimization. To this end we also introduce a scheme to measure the Hamiltonian energy in an experimental system, and study the effect of sampling noise.
△ Less
Submitted 1 November, 2021; v1 submitted 27 March, 2021;
originally announced March 2021.
-
Experimental quantum speed-up in reinforcement learning agents
Authors:
Valeria Saggio,
Beate E. Asenbeck,
Arne Hamann,
Teodor Strömberg,
Peter Schiansky,
Vedran Dunjko,
Nicolai Friis,
Nicholas C. Harris,
Michael Hochberg,
Dirk Englund,
Sabine Wölk,
Hans J. Briegel,
Philip Walther
Abstract:
Increasing demand for algorithms that can learn quickly and efficiently has led to a surge of development within the field of artificial intelligence (AI). An important paradigm within AI is reinforcement learning (RL), where agents interact with environments by exchanging signals via a communication channel. Agents can learn by updating their behaviour based on obtained feedback. The crucial ques…
▽ More
Increasing demand for algorithms that can learn quickly and efficiently has led to a surge of development within the field of artificial intelligence (AI). An important paradigm within AI is reinforcement learning (RL), where agents interact with environments by exchanging signals via a communication channel. Agents can learn by updating their behaviour based on obtained feedback. The crucial question for practical applications is how fast agents can learn to respond correctly. An essential figure of merit is therefore the learning time. While various works have made use of quantum mechanics to speed up the agent's decision-making process, a reduction in learning time has not been demonstrated yet. Here we present a RL experiment where the learning of an agent is boosted by utilizing a quantum communication channel with the environment. We further show that the combination with classical communication enables the evaluation of such an improvement, and additionally allows for optimal control of the learning progress. This novel scenario is therefore demonstrated by considering hybrid agents, that alternate between rounds of quantum and classical communication. We implement this learning protocol on a compact and fully tunable integrated nanophotonic processor. The device interfaces with telecom-wavelength photons and features a fast active feedback mechanism, allowing us to demonstrate the agent's systematic quantum advantage in a setup that could be readily integrated within future large-scale quantum communication networks.
△ Less
Submitted 10 March, 2021;
originally announced March 2021.
-
Parametrized quantum policies for reinforcement learning
Authors:
Sofiene Jerbi,
Casper Gyurik,
Simon C. Marshall,
Hans J. Briegel,
Vedran Dunjko
Abstract:
With the advent of real-world quantum computing, the idea that parametrized quantum computations can be used as hypothesis families in a quantum-classical machine learning system is gaining increasing traction. Such hybrid systems have already shown the potential to tackle real-world tasks in supervised and generative learning, and recent works have established their provable advantages in special…
▽ More
With the advent of real-world quantum computing, the idea that parametrized quantum computations can be used as hypothesis families in a quantum-classical machine learning system is gaining increasing traction. Such hybrid systems have already shown the potential to tackle real-world tasks in supervised and generative learning, and recent works have established their provable advantages in special artificial tasks. Yet, in the case of reinforcement learning, which is arguably most challenging and where learning boosts would be extremely valuable, no proposal has been successful in solving even standard benchmarking tasks, nor in showing a theoretical learning advantage over classical algorithms. In this work, we achieve both. We propose a hybrid quantum-classical reinforcement learning model using very few qubits, which we show can be effectively trained to solve several standard benchmarking environments. Moreover, we demonstrate, and formally prove, the ability of parametrized quantum circuits to solve certain learning tasks that are intractable for classical models, including current state-of-art deep neural networks, under the widely-believed classical hardness of the discrete logarithm problem.
△ Less
Submitted 9 December, 2021; v1 submitted 9 March, 2021;
originally announced March 2021.
-
Certificates of quantum many-body properties assisted by machine learning
Authors:
Borja Requena,
Gorka Muñoz-Gil,
Maciej Lewenstein,
Vedran Dunjko,
Jordi Tura
Abstract:
Computationally intractable tasks are often encountered in physics and optimization. Such tasks often comprise a cost function to be optimized over a so-called feasible set, which is specified by a set of constraints. This may yield, in general, to difficult and non-convex optimization tasks. A number of standard methods are used to tackle such problems: variational approaches focus on parameteriz…
▽ More
Computationally intractable tasks are often encountered in physics and optimization. Such tasks often comprise a cost function to be optimized over a so-called feasible set, which is specified by a set of constraints. This may yield, in general, to difficult and non-convex optimization tasks. A number of standard methods are used to tackle such problems: variational approaches focus on parameterizing a subclass of solutions within the feasible set; in contrast, relaxation techniques have been proposed to approximate it from outside, thus complementing the variational approach by providing ultimate bounds to the global optimal solution. In this work, we propose a novel approach combining the power of relaxation techniques with deep reinforcement learning in order to find the best possible bounds within a limited computational budget. We illustrate the viability of the method in the context of finding the ground state energy of many-body quantum systems, a paradigmatic problem in quantum physics. We benchmark our approach against other classical optimization algorithms such as breadth-first search or Monte-Carlo, and we characterize the effect of transfer learning. We find the latter may be indicative of phase transitions, with a completely autonomous approach. Finally, we provide tools to generalize the approach to other common applications in the field of quantum information processing.
△ Less
Submitted 5 March, 2021;
originally announced March 2021.
-
Triangular Gross-Pitaevskii breathers and Damski-Chandrasekhar shock waves
Authors:
M. Olshanii,
D. Deshommes,
J. Torrents,
M. Gonchenko,
V. Dunjko,
G. E. Astrakharchik
Abstract:
The recently proposed map [arXiv:2011.01415] between the hydrodynamic equations governing the two-dimensional triangular cold-bosonic breathers [Phys. Rev. X 9, 021035 (2019)] and the high-density zero-temperature triangular free-fermionic clouds, both trapped harmonically, perfectly explains the former phenomenon but leaves uninterpreted the nature of the initial ($t=0$) singularity. This singula…
▽ More
The recently proposed map [arXiv:2011.01415] between the hydrodynamic equations governing the two-dimensional triangular cold-bosonic breathers [Phys. Rev. X 9, 021035 (2019)] and the high-density zero-temperature triangular free-fermionic clouds, both trapped harmonically, perfectly explains the former phenomenon but leaves uninterpreted the nature of the initial ($t=0$) singularity. This singularity is a density discontinuity that leads, in the bosonic case, to an infinite force at the cloud edge. The map itself becomes invalid at times $t<0$. A similar singularity appears at $t = T/4$, where $T$ is the period of the harmonic trap, with the Fermi-Bose map becoming invalid at $t > T/4$. Here, we first map -- using the scale invariance of the problem -- the trapped motion to an untrapped one. Then we show that in the new representation, the solution [arXiv:2011.01415] becomes, along a ray in the direction normal to one of the three edges of the initial cloud, a freely propagating one-dimensional shock wave of a class proposed by Damski in [Phys.~Rev.~A 69, 043610 (2004)]. There, for a broad class of initial conditions, the one-dimensional hydrodynamic equations can be mapped to the inviscid Burgers' equation, which is equivalent to a nonlinear transport equation. More specifically, under the Damski map, the $t=0$ singularity of the original problem becomes, verbatim, the initial condition for the wave catastrophe solution found by Chandrasekhar in 1943 [Ballistic Research Laboratory Report No. 423 (1943)]. At $t=T/8$, our interpretation ceases to exist: at this instance, all three effectively one-dimensional shock waves emanating from each of the three sides of the initial triangle collide at the origin, and the 2D-1D correspondence between the solution of [arXiv:2011.01415] and the Damski-Chandrasekhar shock wave becomes invalid.
△ Less
Submitted 5 May, 2021; v1 submitted 24 February, 2021;
originally announced February 2021.
-
On solving classes of positive-definite quantum linear systems with quadratically improved runtime in the condition number
Authors:
Davide Orsucci,
Vedran Dunjko
Abstract:
Quantum algorithms for solving the Quantum Linear System (QLS) problem are among the most investigated quantum algorithms of recent times, with potential applications including the solution of computationally intractable differential equations and speed-ups in machine learning. A fundamental parameter governing the efficiency of QLS solvers is $κ$, the condition number of the coefficient matrix…
▽ More
Quantum algorithms for solving the Quantum Linear System (QLS) problem are among the most investigated quantum algorithms of recent times, with potential applications including the solution of computationally intractable differential equations and speed-ups in machine learning. A fundamental parameter governing the efficiency of QLS solvers is $κ$, the condition number of the coefficient matrix $A$, as it has been known since the inception of the QLS problem that for worst-case instances the runtime scales at least linearly in $κ$ [Harrow, Hassidim and Lloyd, PRL 103, 150502 (2009)]. However, for the case of positive-definite matrices classical algorithms can solve linear systems with a runtime scaling as $\sqrtκ$, a quadratic improvement compared to the the indefinite case. It is then natural to ask whether QLS solvers may hold an analogous improvement. In this work we answer the question in the negative, showing that solving a QLS entails a runtime linear in $κ$ also when $A$ is positive definite. We then identify broad classes of positive-definite QLS where this lower bound can be circumvented and present two new quantum algorithms featuring a quadratic speed-up in $κ$: the first is based on efficiently implementing a matrix-block-encoding of $A^{-1}$, the second constructs a decomposition of the form $A = L L^\dagger$ to precondition the system. These methods are widely applicable and both allow to efficiently solve BQP-complete problems.
△ Less
Submitted 1 November, 2021; v1 submitted 28 January, 2021;
originally announced January 2021.
-
Tabu-driven Quantum Neighborhood Samplers
Authors:
Charles Moussa,
Hao Wang,
Henri Calandra,
Thomas Bäck,
Vedran Dunjko
Abstract:
Combinatorial optimization is an important application targeted by quantum computing. However, near-term hardware constraints make quantum algorithms unlikely to be competitive when compared to high-performing classical heuristics on large practical problems. One option to achieve advantages with near-term devices is to use them in combination with classical heuristics. In particular, we propose u…
▽ More
Combinatorial optimization is an important application targeted by quantum computing. However, near-term hardware constraints make quantum algorithms unlikely to be competitive when compared to high-performing classical heuristics on large practical problems. One option to achieve advantages with near-term devices is to use them in combination with classical heuristics. In particular, we propose using quantum methods to sample from classically intractable distributions -- which is the most probable approach to attain a true provable quantum separation in the near-term -- which are used to solve optimization problems faster. We numerically study this enhancement by an adaptation of Tabu Search using the Quantum Approximate Optimization Algorithm (QAOA) as a neighborhood sampler. We show that QAOA provides a flexible tool for exploration-exploitation in such hybrid settings and can provide evidence that it can help in solving problems faster by saving many tabu iterations and achieving better solutions.
△ Less
Submitted 4 March, 2021; v1 submitted 18 November, 2020;
originally announced November 2020.
-
Quantum-accessible reinforcement learning beyond strictly epochal environments
Authors:
A. Hamann,
V. Dunjko,
S. Wölk
Abstract:
In recent years, quantum-enhanced machine learning has emerged as a particularly fruitful application of quantum algorithms, covering aspects of supervised, unsupervised and reinforcement learning. Reinforcement learning offers numerous options of how quantum theory can be applied, and is arguably the least explored, from a quantum perspective. Here, an agent explores an environment and tries to f…
▽ More
In recent years, quantum-enhanced machine learning has emerged as a particularly fruitful application of quantum algorithms, covering aspects of supervised, unsupervised and reinforcement learning. Reinforcement learning offers numerous options of how quantum theory can be applied, and is arguably the least explored, from a quantum perspective. Here, an agent explores an environment and tries to find a behavior optimizing some figure of merit. Some of the first approaches investigated settings where this exploration can be sped-up, by considering quantum analogs of classical environments, which can then be queried in superposition. If the environments have a strict periodic structure in time (i.e. are strictly episodic), such environments can be effectively converted to conventional oracles encountered in quantum information. However, in general environments, we obtain scenarios that generalize standard oracle tasks. In this work we consider one such generalization, where the environment is not strictly episodic, which is mapped to an oracle identification setting with a changing oracle. We analyze this case and show that standard amplitude-amplification techniques can, with minor modifications, still be applied to achieve quadratic speed-ups, and that this approach is optimal for certain settings. This results constitutes one of the first generalizations of quantum-accessible reinforcement learning.
△ Less
Submitted 4 August, 2020;
originally announced August 2020.
-
Hybrid divide-and-conquer approach for tree search algorithms
Authors:
Mathys Rennela,
Sebastiaan Brand,
Alfons Laarman,
Vedran Dunjko
Abstract:
One of the challenges of quantum computers in the near- and mid- term is the limited number of qubits we can use for computations. Finding methods that achieve useful quantum improvements under size limitations is thus a key question in the field. In this vein, it was recently shown that a hybrid classical-quantum method can help provide polynomial speed-ups to classical divide-and-conquer algorit…
▽ More
One of the challenges of quantum computers in the near- and mid- term is the limited number of qubits we can use for computations. Finding methods that achieve useful quantum improvements under size limitations is thus a key question in the field. In this vein, it was recently shown that a hybrid classical-quantum method can help provide polynomial speed-ups to classical divide-and-conquer algorithms, even when only given access to a quantum computer much smaller than the problem itself. In this work, we study the hybrid divide-and-conquer method in the context of tree search algorithms, and extend it by including quantum backtracking, which allows better results than previous Grover-based methods. Further, we provide general criteria for polynomial speed-ups in the tree search context, and provide a number of examples where polynomial speed ups, using arbitrarily smaller quantum computers, can be obtained. We provide conditions for speedups for the well known algorithm of DPLL, and we prove threshold-free speed-ups for the PPSZ algorithm (the core of the fastest exact Boolean satisfiability solver) for well-behaved classes of formulas. We also provide a simple example where speed-ups can be obtained in an algorithm-independent fashion, under certain well-studied complexity-theoretical assumptions. Finally, we briefly discuss the fundamental limitations of hybrid methods in providing speed-ups for larger problems.
△ Less
Submitted 20 March, 2023; v1 submitted 14 July, 2020;
originally announced July 2020.
-
Creation and Characterization of Matter-Wave Breathers
Authors:
De Luo,
Yi **,
Jason H. V. Nguyen,
Boris A. Malomed,
Oleksandr V. Marchukov,
Vladimir A. Yurovsky,
Vanja Dunjko,
Maxim Olshanii,
R. G. Hulet
Abstract:
We report the creation of quasi-1D excited matter-wave solitons, "breathers", by quenching the strength of the interactions in a Bose-Einstein condensate with attractive interactions. We characterize the resulting breathing dynamics and quantify the effects of the aspect ratio of the confining potential, the strength of the quench, and the proximity of the 1D-3D crossover for the 2-soliton breathe…
▽ More
We report the creation of quasi-1D excited matter-wave solitons, "breathers", by quenching the strength of the interactions in a Bose-Einstein condensate with attractive interactions. We characterize the resulting breathing dynamics and quantify the effects of the aspect ratio of the confining potential, the strength of the quench, and the proximity of the 1D-3D crossover for the 2-soliton breather. We furthermore demonstrate the complex dynamics of a 3-soliton breather created by a stronger interaction quench. Our experimental results, which compare well with numerical simulations, provide a pathway for utilizing matter-wave breathers to explore quantum effects in large many-body systems.
△ Less
Submitted 28 September, 2020; v1 submitted 7 July, 2020;
originally announced July 2020.
-
Towards quantum advantage via topological data analysis
Authors:
Casper Gyurik,
Chris Cade,
Vedran Dunjko
Abstract:
Even after decades of quantum computing development, examples of generally useful quantum algorithms with exponential speedups over classical counterparts are scarce. Recent progress in quantum algorithms for linear-algebra positioned quantum machine learning (QML) as a potential source of such useful exponential improvements. Yet, in an unexpected development, a recent series of "dequantization"…
▽ More
Even after decades of quantum computing development, examples of generally useful quantum algorithms with exponential speedups over classical counterparts are scarce. Recent progress in quantum algorithms for linear-algebra positioned quantum machine learning (QML) as a potential source of such useful exponential improvements. Yet, in an unexpected development, a recent series of "dequantization" results has equally rapidly removed the promise of exponential speedups for several QML algorithms. This raises the critical question whether exponential speedups of other linear-algebraic QML algorithms persist. In this paper, we study the quantum-algorithmic methods behind the algorithm for topological data analysis of Lloyd, Garnerone and Zanardi through this lens. We provide evidence that the problem solved by this algorithm is classically intractable by showing that its natural generalization is as hard as simulating the one clean qubit model -- which is widely believed to require superpolynomial time on a classical computer -- and is thus very likely immune to dequantizations. Based on this result, we provide a number of new quantum algorithms for problems such as rank estimation and complex network analysis, along with complexity-theoretic evidence for their classical intractability. Furthermore, we analyze the suitability of the proposed quantum algorithms for near-term implementations. Our results provide a number of useful applications for full-blown, and restricted quantum computers with a guaranteed exponential speedup over classical methods, recovering some of the potential for linear-algebraic QML to become one of quantum computing's killer applications.
△ Less
Submitted 21 October, 2022; v1 submitted 6 May, 2020;
originally announced May 2020.