-
TensorFlow Quantum: A Software Framework for Quantum Machine Learning
Authors:
Michael Broughton,
Guillaume Verdon,
Trevor McCourt,
Antonio J. Martinez,
Jae Hyeon Yoo,
Sergei V. Isakov,
Philip Massey,
Ramin Halavati,
Murphy Yuezhen Niu,
Alexander Zlokapa,
Evan Peters,
Owen Lockwood,
Andrea Skolik,
Sofiene Jerbi,
Vedran Dunjko,
Martin Leib,
Michael Streif,
David Von Dollen,
Hongxiang Chen,
Shuxiang Cao,
Roeland Wiersema,
Hsin-Yuan Huang,
Jarrod R. McClean,
Ryan Babbush,
Sergio Boixo
, et al. (4 additional authors not shown)
Abstract:
We introduce TensorFlow Quantum (TFQ), an open source library for the rapid prototy** of hybrid quantum-classical models for classical or quantum data. This framework offers high-level abstractions for the design and training of both discriminative and generative quantum models under TensorFlow and supports high-performance quantum circuit simulators. We provide an overview of the software archi…
▽ More
We introduce TensorFlow Quantum (TFQ), an open source library for the rapid prototy** of hybrid quantum-classical models for classical or quantum data. This framework offers high-level abstractions for the design and training of both discriminative and generative quantum models under TensorFlow and supports high-performance quantum circuit simulators. We provide an overview of the software architecture and building blocks through several examples and review the theory of hybrid quantum-classical neural networks. We illustrate TFQ functionalities via several basic applications including supervised learning for quantum classification, quantum control, simulating noisy quantum circuits, and quantum approximate optimization. Moreover, we demonstrate how one can apply TFQ to tackle advanced quantum learning tasks including meta-learning, layerwise learning, Hamiltonian learning, sampling thermal states, variational quantum eigensolvers, classification of quantum phase transitions, generative adversarial networks, and reinforcement learning. We hope this framework provides the necessary tools for the quantum computing and machine learning research communities to explore models of both natural and artificial quantum systems, and ultimately discover new quantum algorithms which could potentially yield a quantum advantage.
△ Less
Submitted 26 August, 2021; v1 submitted 5 March, 2020;
originally announced March 2020.
-
To quantum or not to quantum: towards algorithm selection in near-term quantum optimization
Authors:
Charles Moussa,
Henri Calandra,
Vedran Dunjko
Abstract:
The Quantum Approximate Optimization Algorithm (QAOA) constitutes one of the often mentioned candidates expected to yield a quantum boost in the era of near-term quantum computing. In practice, quantum optimization will have to compete with cheaper classical heuristic methods, which have the advantage of decades of empirical domain-specific enhancements. Consequently, to achieve optimal performanc…
▽ More
The Quantum Approximate Optimization Algorithm (QAOA) constitutes one of the often mentioned candidates expected to yield a quantum boost in the era of near-term quantum computing. In practice, quantum optimization will have to compete with cheaper classical heuristic methods, which have the advantage of decades of empirical domain-specific enhancements. Consequently, to achieve optimal performance we will face the issue of algorithm selection, well-studied in practical computing. Here we introduce this problem to the quantum optimization domain.
Specifically, we study the problem of detecting those problem instances of where QAOA is most likely to yield an advantage over a conventional algorithm. As our case study, we compare QAOA against the well-understood approximation algorithm of Goemans and Williamson (GW) on the Max-Cut problem. As exactly predicting the performance of algorithms can be intractable, we utilize machine learning to identify when to resort to the quantum algorithm. We achieve cross-validated accuracy well over 96\%, which would yield a substantial practical advantage. In the process, we highlight a number of features of instances rendering them better suited for QAOA. While we work with simulated idealised algorithms, the flexibility of ML methods we employed provides confidence that our methods will be equally applicable to broader classes of classical heuristics, and to QAOA running on real-world noisy devices.
△ Less
Submitted 14 October, 2020; v1 submitted 22 January, 2020;
originally announced January 2020.
-
Quantum fluctuations of the center-of-mass and relative parameters of NLS breathers
Authors:
Oleksandr V. Marchukov,
Boris A. Malomed,
Vanja Dunjko,
Joanna Ruhl,
Maxim Olshanii,
Randall G. Hulet,
Vladimir A. Yurovsky
Abstract:
We study quantum fluctuations of macroscopic parameters of an NLS breathers, i.e., the second-order soliton solution of the nonlinear Schrödinger equation. Uncertainty relations for the parameters are derived and compared to similar relations for fundamental solitons. We compare two models for the state of the quantum field of fluctuations surrounding the classical field of the Bose-Einstein conde…
▽ More
We study quantum fluctuations of macroscopic parameters of an NLS breathers, i.e., the second-order soliton solution of the nonlinear Schrödinger equation. Uncertainty relations for the parameters are derived and compared to similar relations for fundamental solitons. We compare two models for the state of the quantum field of fluctuations surrounding the classical field of the Bose-Einstein condensate: a conventionally used, computationally convenient "white noise", and a correlated noise which assumes that the breather has been created from a fundamental soliton, by means of the application of the factor-of-four quench of the nonlinearity strength. Theoretical methods used in the work are well suited for a large number of particles, $N$. We thus confirm the possibility of experimental observation of macroscopic quantum fluctuations, which is suggested by an extrapolation to large $N$ of recently reported low-$N$ Bethe-ansatz results [Phys. Rev. Lett. 119 220401 (2017)].
△ Less
Submitted 26 November, 2020; v1 submitted 4 November, 2019;
originally announced November 2019.
-
Quantum enhancements for deep reinforcement learning in large spaces
Authors:
Sofiene Jerbi,
Lea M. Trenkwalder,
Hendrik Poulsen Nautrup,
Hans J. Briegel,
Vedran Dunjko
Abstract:
In the past decade, the field of quantum machine learning has drawn significant attention due to the prospect of bringing genuine computational advantages to now widespread algorithmic methods. However, not all domains of machine learning have benefited equally from quantum enhancements. Notably, deep learning and reinforcement learning, despite their tremendous success in the classical domain, bo…
▽ More
In the past decade, the field of quantum machine learning has drawn significant attention due to the prospect of bringing genuine computational advantages to now widespread algorithmic methods. However, not all domains of machine learning have benefited equally from quantum enhancements. Notably, deep learning and reinforcement learning, despite their tremendous success in the classical domain, both individually and combined, remain relatively unaddressed by the quantum community. Arguably, one reason behind this is the systematic use in these domains of models and methods without prominent computational bottlenecks, leaving little room for quantum improvements. In this work, we study the state-of-the-art neural-network approaches for reinforcement learning with quantum enhancements in mind. We demonstrate the substantial learning advantage that models with a sampling bottleneck can provide over conventional neural network architectures in complex learning environments. These so-called energy-based models, like deep energy-based reinforcement learning, and deep projective simulation that we also introduce in this work, effectively allow to trade off learning performance for efficiency of computation. To alleviate the additional computational costs, we propose to leverage future and near-term quantum algorithms, resulting in overall more advantageous learning algorithms. This is achieved using cutting-edge and new quantum computing machinery to speed-up classical sampling methods and by employing generalized models to gain an additional quantum advantage.
△ Less
Submitted 22 September, 2020; v1 submitted 28 October, 2019;
originally announced October 2019.
-
On the convergence of projective-simulation-based reinforcement learning in Markov decision processes
Authors:
Walter L. Boyajian,
Jens Clausen,
Lea M. Trenkwalder,
Vedran Dunjko,
Hans J. Briegel
Abstract:
In recent years, the interest in leveraging quantum effects for enhancing machine learning tasks has significantly increased. Many algorithms speeding up supervised and unsupervised learning were established. The first framework in which ways to exploit quantum resources specifically for the broader context of reinforcement learning were found is projective simulation. Projective simulation presen…
▽ More
In recent years, the interest in leveraging quantum effects for enhancing machine learning tasks has significantly increased. Many algorithms speeding up supervised and unsupervised learning were established. The first framework in which ways to exploit quantum resources specifically for the broader context of reinforcement learning were found is projective simulation. Projective simulation presents an agent-based reinforcement learning approach designed in a manner which may support quantum walk-based speed-ups. Although classical variants of projective simulation have been benchmarked against common reinforcement learning algorithms, very few formal theoretical analyses have been provided for its performance in standard learning scenarios. In this paper, we provide a detailed formal discussion of the properties of this model. Specifically, we prove that one version of the projective simulation model, understood as a reinforcement learning approach, converges to optimal behavior in a large class of Markov decision processes. This proof shows that a physically-inspired approach to reinforcement learning can guarantee to converge.
△ Less
Submitted 12 November, 2020; v1 submitted 25 October, 2019;
originally announced October 2019.
-
A hybrid algorithm framework for small quantum computers with application to finding Hamiltonian cycles
Authors:
Yimin Ge,
Vedran Dunjko
Abstract:
Recent works have shown that quantum computers can polynomially speed up certain SAT-solving algorithms even when the number of available qubits is significantly smaller than the number of variables. Here we generalise this approach. We present a framework for hybrid quantum-classical algorithms which utilise quantum computers significantly smaller than the problem size. Given an arbitrarily small…
▽ More
Recent works have shown that quantum computers can polynomially speed up certain SAT-solving algorithms even when the number of available qubits is significantly smaller than the number of variables. Here we generalise this approach. We present a framework for hybrid quantum-classical algorithms which utilise quantum computers significantly smaller than the problem size. Given an arbitrarily small ratio of the quantum computer to the instance size, we achieve polynomial speedups for classical divide-and-conquer algorithms, provided that certain criteria on the time- and space-efficiency are met. We demonstrate how this approach can be used to enhance Eppstein's algorithm for the cubic Hamiltonian cycle problem, and achieve a polynomial speedup for any ratio of the number of qubits to the size of the graph.
△ Less
Submitted 2 July, 2019;
originally announced July 2019.
-
Splitting of nonlinear-Schrödinger breathers by linear and nonlinear localized potentials
Authors:
Oleksandr V. Marchukov,
Boris A. Malomed,
Vladimir A. Yurovsky,
Maxim Olshanii,
Vanja Dunjko,
Randall G. Hulet
Abstract:
We consider evolution of one-dimensional nonlinear-Schrödinger (NLS) two-soliton complexes (breathers) with narrow repulsive or attractive potentials (barrier or well, respectively). By means of systematic simulations, we demonstrate that the breather may either split into constituent fundamental solitons (fragments) moving in opposite directions, or bounce as a whole from the barrier. A critical…
▽ More
We consider evolution of one-dimensional nonlinear-Schrödinger (NLS) two-soliton complexes (breathers) with narrow repulsive or attractive potentials (barrier or well, respectively). By means of systematic simulations, we demonstrate that the breather may either split into constituent fundamental solitons (fragments) moving in opposite directions, or bounce as a whole from the barrier. A critical initial position of the breather, which separates these scenarios, is predicted by an analytical approximation. The narrow potential well tends to trap the fragment with the larger amplitude, while the other one escapes. The interaction of the breather with a nonlinear potential barrier is also considered. The ratio of amplitudes of the emerging free solitons may be different from the 3:1 value suggested by the exact NLS solution, especially in the case of the nonlinear potential barrier. Post-splitting velocities of esca** solitons may be predicted by an approximation based on the energy balance.
△ Less
Submitted 28 May, 2019; v1 submitted 24 April, 2019;
originally announced April 2019.
-
Four-dimensional reflection groups and electrostatics
Authors:
Maxim Olshanii,
Yuri Styrkas,
Dmitry Yampolsky,
Vanja Dunjko,
Steven G. Jackson
Abstract:
We present a new class of electrostatics problems that are exactly solvable by adding finitely many image charges. Given a charge at some location inside a cavity bounded by up to four conducting grounded segments of spheres: if the spheres have a symmetry derived via a stereographic projection from a 4D finite reflection group, then this is a solvable generalization of the familiar problem of a c…
▽ More
We present a new class of electrostatics problems that are exactly solvable by adding finitely many image charges. Given a charge at some location inside a cavity bounded by up to four conducting grounded segments of spheres: if the spheres have a symmetry derived via a stereographic projection from a 4D finite reflection group, then this is a solvable generalization of the familiar problem of a charge inside a spherical cavity. There are 19 three-parametric families of finite groups formed by inversions relative to at most four spheres, each member of each family giving a solvable problem. We solve a sample problem which derives from the reflection group $\mathbf{D}_{4}$ and requires 191 image charges.
△ Less
Submitted 11 June, 2020; v1 submitted 4 April, 2019;
originally announced April 2019.
-
Enhancing sensitivity to rotations with quantum solitonic currents
Authors:
Piero Naldesi,
Juan Polo Gomez,
Vanja Dunjko,
Hélène Perrin,
Maxim Olshanii,
Luigi Amico,
Anna Minguzzi
Abstract:
Quantum mechanics is characterized by quantum coherence and entanglement. After having discovered how these fundamental concepts govern physical reality, scientists have been devoting intense efforts to harness them to shape future science and technology. This is a highly nontrivial task because most often quantum coherence and entanglement are difficult to access. Here, we demonstrate the enhance…
▽ More
Quantum mechanics is characterized by quantum coherence and entanglement. After having discovered how these fundamental concepts govern physical reality, scientists have been devoting intense efforts to harness them to shape future science and technology. This is a highly nontrivial task because most often quantum coherence and entanglement are difficult to access. Here, we demonstrate the enhancement of the sensitivity of a quantum many-body system with specific coherence and entanglement properties. Our physical system is made of strongly correlated attracting neutral bosons flowing in a ring-shaped potential of mesoscopic size. Because of attractive interactions, quantum analogs of bright solitons are formed. As a genuine quantum-many-body feature, we demonstrate that angular momentum fractionalization occurs. As a consequence, the matter-wave current in our system can react to very small changes of rotation or other artificial gauge fields. We work out a protocol to entangle such quantum solitonic currents, allowing them to operate rotation sensors and gyroscopes to Heisenberg-limited sensitivity.
△ Less
Submitted 17 November, 2020; v1 submitted 27 January, 2019;
originally announced January 2019.
-
Optimizing Quantum Error Correction Codes with Reinforcement Learning
Authors:
Hendrik Poulsen Nautrup,
Nicolas Delfosse,
Vedran Dunjko,
Hans J. Briegel,
Nicolai Friis
Abstract:
Quantum error correction is widely thought to be the key to fault-tolerant quantum computation. However, determining the most suited encoding for unknown error channels or specific laboratory setups is highly challenging. Here, we present a reinforcement learning framework for optimizing and fault-tolerantly adapting quantum error correction codes. We consider a reinforcement learning agent tasked…
▽ More
Quantum error correction is widely thought to be the key to fault-tolerant quantum computation. However, determining the most suited encoding for unknown error channels or specific laboratory setups is highly challenging. Here, we present a reinforcement learning framework for optimizing and fault-tolerantly adapting quantum error correction codes. We consider a reinforcement learning agent tasked with modifying a family of surface code quantum memories until a desired logical error rate is reached. Using efficient simulations with about 70 data qubits with arbitrary connectivity, we demonstrate that such a reinforcement learning agent can determine near-optimal solutions, in terms of the number of data qubits, for various error models of interest. Moreover, we show that agents trained on one setting are able to successfully transfer their experience to different settings. This ability for transfer learning showcases the inherent strengths of reinforcement learning and the applicability of our approach for optimization from off-line simulations to on-line laboratory settings.
△ Less
Submitted 9 April, 2020; v1 submitted 20 December, 2018;
originally announced December 2018.
-
Advances in Quantum Reinforcement Learning
Authors:
Vedran Dunjko,
Jacob M. Taylor,
Hans J. Briegel
Abstract:
In recent times, there has been much interest in quantum enhancements of machine learning, specifically in the context of data mining and analysis. Reinforcement learning, an interactive form of learning, is, in turn, vital in artificial intelligence-type applications. Also in this case, quantum mechanics was shown to be useful, in certain instances. Here, we elucidate these results, and show that…
▽ More
In recent times, there has been much interest in quantum enhancements of machine learning, specifically in the context of data mining and analysis. Reinforcement learning, an interactive form of learning, is, in turn, vital in artificial intelligence-type applications. Also in this case, quantum mechanics was shown to be useful, in certain instances. Here, we elucidate these results, and show that quantum enhancements can be achieved in a new setting: the setting of learning models which learn how to improve themselves -- that is, those that meta-learn. While not all learning models meta-learn, all non-trivial models have the potential of being "lifted", enhanced, to meta-learning models. Our results show that also such models can be quantum-enhanced to make even better learners. In parallel, we address one of the bottlenecks of current quantum reinforcement learning approaches: the need for so-called oracularized variants of task environments. Here we elaborate on a method which realizes these variants, with minimal changes in the setting, and with no corruption of the operative specification of the environments. This result may be important in near-term experimental demonstrations of quantum reinforcement learning.
△ Less
Submitted 21 November, 2018;
originally announced November 2018.
-
Truly noiseless probabilistic amplification
Authors:
Vedran Dunjko,
Erika Andersson
Abstract:
Most of the schemes for "noiseless" amplification of coherent states, which have recently been attracting theoretical and experimental interest, share a common trait: the amplification is not truly noiseless, or perfect, for non-zero success probability. While this must hold true for all phase-independent amplification schemes, in this work we point out that truly noiseless amplification is indeed…
▽ More
Most of the schemes for "noiseless" amplification of coherent states, which have recently been attracting theoretical and experimental interest, share a common trait: the amplification is not truly noiseless, or perfect, for non-zero success probability. While this must hold true for all phase-independent amplification schemes, in this work we point out that truly noiseless amplification is indeed possible, provided that the states which we wish to amplify come from a finite set. Perfect amplification with unlimited average gain is then possible with finite success probability, for example using techniques for unambiguously distinguishing between quantum states. Such realizations require only linear optics, no single-photon sources, nor any photon counting. We also investigate the optimal success probability of perfect amplification of a symmetric set of coherent states. There are two regimes: low-amplitude amplification, where the target amplitude is below one, and general amplification. For the low-amplitude regime, analytic results for the optimal amplification success probabilities can be obtained. In this case a natural bound imposed by the ratio of success probabilities of optimal unambiguous discrimination of the source and amplified states can always be reached. We also show that for general amplification this bound cannot always be satisfied.
△ Less
Submitted 21 November, 2018;
originally announced November 2018.
-
Computational speedups using small quantum devices
Authors:
Vedran Dunjko,
Yimin Ge,
J. Ignacio Cirac
Abstract:
Suppose we have a small quantum computer with only M qubits. Can such a device genuinely speed up certain algorithms, even when the problem size is much larger than M? Here we answer this question to the affirmative. We present a hybrid quantum-classical algorithm to solve 3SAT problems involving n>>M variables that significantly speeds up its fully classical counterpart. This question may be rele…
▽ More
Suppose we have a small quantum computer with only M qubits. Can such a device genuinely speed up certain algorithms, even when the problem size is much larger than M? Here we answer this question to the affirmative. We present a hybrid quantum-classical algorithm to solve 3SAT problems involving n>>M variables that significantly speeds up its fully classical counterpart. This question may be relevant in view of the current quest to build small quantum computers.
△ Less
Submitted 25 July, 2018; v1 submitted 24 July, 2018;
originally announced July 2018.
-
Smooth input preparation for quantum and quantum-inspired machine learning
Authors:
Zhikuan Zhao,
Jack K. Fitzsimons,
Patrick Rebentrost,
Vedran Dunjko,
Joseph F. Fitzsimons
Abstract:
Machine learning has recently emerged as a fruitful area for finding potential quantum computational advantage. Many of the quantum enhanced machine learning algorithms critically hinge upon the ability to efficiently produce states proportional to high-dimensional data points stored in a quantum accessible memory. Even given query access to exponentially many entries stored in a database, the con…
▽ More
Machine learning has recently emerged as a fruitful area for finding potential quantum computational advantage. Many of the quantum enhanced machine learning algorithms critically hinge upon the ability to efficiently produce states proportional to high-dimensional data points stored in a quantum accessible memory. Even given query access to exponentially many entries stored in a database, the construction of which is considered a one-off overhead, it has been argued that the cost of preparing such amplitude-encoded states may offset any exponential quantum advantage. Here we prove using smoothed analysis, that if the data-analysis algorithm is robust against small entry-wise input perturbation, state preparation can always be achieved with constant queries. This criterion is typically satisfied in realistic machine learning applications, where input data is subjective to moderate noise. Our results are equally applicable to the recent seminal progress in quantum-inspired algorithms, where specially constructed databases suffice for polylogarithmic classical algorithm in low-rank cases. The consequence of our finding is that for the purpose of practical machine learning, polylogarithmic processing time is possible under a general and flexible input model with quantum algorithms or quantum-inspired classical algorithms in the low-rank cases.
△ Less
Submitted 2 August, 2019; v1 submitted 1 April, 2018;
originally announced April 2018.
-
Neural Network Operations and Susuki-Trotter evolution of Neural Network States
Authors:
Nahuel Freitas,
Giovanna Morigi,
Vedran Dunjko
Abstract:
It was recently proposed to leverage the representational power of artificial neural networks, in particular Restricted Boltzmann Machines, in order to model complex quantum states of many-body systems [Science, 355(6325), 2017]. States represented in this way, called Neural Network States (NNSs), were shown to display interesting properties like the ability to efficiently capture long-range quant…
▽ More
It was recently proposed to leverage the representational power of artificial neural networks, in particular Restricted Boltzmann Machines, in order to model complex quantum states of many-body systems [Science, 355(6325), 2017]. States represented in this way, called Neural Network States (NNSs), were shown to display interesting properties like the ability to efficiently capture long-range quantum correlations. However, identifying an optimal neural network representation of a given state might be challenging, and so far this problem has been addressed with stochastic optimization techniques. In this work we explore a different direction. We study how the action of elementary quantum operations modifies NNSs. We parametrize a family of many body quantum operations that can be directly applied to states represented by Unrestricted Boltzmann Machines, by just adding hidden nodes and updating the network parameters. We show that this parametrization contains a set of universal quantum gates, from which it follows that the state prepared by any quantum circuit can be expressed as a Neural Network State with a number of hidden nodes that grows linearly with the number of elementary operations in the circuit. This is a powerful representation theorem (which was recently obtained with different methods) but that is not directly useful, since there is no general and efficient way to extract information from this unrestricted description of quantum states. To circumvent this problem, we propose a step-wise procedure based on the projection of Unrestricted quantum states to Restricted quantum states. In turn, two approximate methods to perform this projection are discussed. In this way, we show that it is in principle possible to approximately optimize or evolve Neural Network States without relying on stochastic methods such as Variational Monte Carlo, which are computationally expensive.
△ Less
Submitted 6 March, 2018;
originally announced March 2018.
-
Simple proof of confidentiality for private quantum channels in noisy environments
Authors:
A. Pirker,
M. Zwerger,
V. Dunjko,
H. J. Briegel,
W. Dür
Abstract:
Complete security proofs for quantum communication protocols can be notoriously involved, which convolutes their verification, and obfuscates the key physical insights the security finally relies on. In such cases, for the majority of the community, the utility of such proofs may be restricted. Here we provide a simple proof of confidentiality for parallel quantum channels established via entangle…
▽ More
Complete security proofs for quantum communication protocols can be notoriously involved, which convolutes their verification, and obfuscates the key physical insights the security finally relies on. In such cases, for the majority of the community, the utility of such proofs may be restricted. Here we provide a simple proof of confidentiality for parallel quantum channels established via entanglement distillation based on hashing, in the presence of noise, and a malicious eavesdropper who is restricted only by the laws of quantum mechanics. The direct contribution lies in improving the linear confidentiality levels of recurrence-type entanglement distillation protocols to exponential levels for hashing protocols. The proof directly exploits the security relevant physical properties: measurement-based quantum computation with resource states and the separation of Bell-pairs from an eavesdropper. The proof also holds for situations where Eve has full control over the input states, and obtains all information about the operations and noise applied by the parties. The resulting state after hashing is private, i.e., disentangled from the eavesdropper. Moreover, the noise regimes for entanglement distillation and confidentiality do not coincide: Confidentiality can be guaranteed even in situation where entanglement distillation fails. We extend our results to multiparty situations which are of special interest for secure quantum networks.
△ Less
Submitted 25 March, 2019; v1 submitted 24 November, 2017;
originally announced November 2017.
-
Exponential improvements for quantum-accessible reinforcement learning
Authors:
Vedran Dunjko,
Yi-Kai Liu,
Xingyao Wu,
Jacob M. Taylor
Abstract:
Quantum computers can offer dramatic improvements over classical devices for data analysis tasks such as prediction and classification. However, less is known about the advantages that quantum computers may bring in the setting of reinforcement learning, where learning is achieved via interaction with a task environment. Here, we consider a special case of reinforcement learning, where the task en…
▽ More
Quantum computers can offer dramatic improvements over classical devices for data analysis tasks such as prediction and classification. However, less is known about the advantages that quantum computers may bring in the setting of reinforcement learning, where learning is achieved via interaction with a task environment. Here, we consider a special case of reinforcement learning, where the task environment allows quantum access. In addition, we impose certain "naturalness" conditions on the task environment, which rule out the kinds of oracle problems that are studied in quantum query complexity (and for which quantum speedups are well-known). Within this framework of quantum-accessible reinforcement learning environments, we demonstrate that quantum agents can achieve exponential improvements in learning efficiency, surpassing previous results that showed only quadratic improvements. A key step in the proof is to construct task environments that encode well-known oracle problems, such as Simon's problem and Recursive Fourier Sampling, while satisfying the above "naturalness" conditions for reinforcement learning. Our results suggest that quantum agents may perform well in certain game-playing scenarios, where the game has recursive structure, and the agent can learn by playing against itself.
△ Less
Submitted 8 August, 2018; v1 submitted 30 October, 2017;
originally announced October 2017.
-
Machine learning \& artificial intelligence in the quantum domain
Authors:
Vedran Dunjko,
Hans J. Briegel
Abstract:
Quantum information technologies, and intelligent learning systems, are both emergent technologies that will likely have a transforming impact on our society. The respective underlying fields of research -- quantum information (QI) versus machine learning (ML) and artificial intelligence (AI) -- have their own specific challenges, which have hitherto been investigated largely independently. Howeve…
▽ More
Quantum information technologies, and intelligent learning systems, are both emergent technologies that will likely have a transforming impact on our society. The respective underlying fields of research -- quantum information (QI) versus machine learning (ML) and artificial intelligence (AI) -- have their own specific challenges, which have hitherto been investigated largely independently. However, in a growing body of recent work, researchers have been probing the question to what extent these fields can learn and benefit from each other. QML explores the interaction between quantum computing and ML, investigating how results and techniques from one field can be used to solve the problems of the other. Recently, we have witnessed breakthroughs in both directions of influence. For instance, quantum computing is finding a vital application in providing speed-ups in ML, critical in our "big data" world. Conversely, ML already permeates cutting-edge technologies, and may become instrumental in advanced quantum technologies. Aside from quantum speed-up in data analysis, or classical ML optimization used in quantum experiments, quantum enhancements have also been demonstrated for interactive learning, highlighting the potential of quantum-enhanced learning agents. Finally, works exploring the use of AI for the very design of quantum experiments, and for performing parts of genuine research autonomously, have reported their first successes. Beyond the topics of mutual enhancement, researchers have also broached the fundamental issue of quantum generalizations of ML/AI concepts. This deals with questions of the very meaning of learning and intelligence in a world that is described by quantum mechanics. In this review, we describe the main ideas, recent developments, and progress in a broad spectrum of research investigating machine learning and artificial intelligence in the quantum domain.
△ Less
Submitted 8 September, 2017;
originally announced September 2017.
-
Speeding-up the decision making of a learning agent using an ion trap quantum processor
Authors:
Theeraphot Sriarunothai,
Sabine Wölk,
Gouri Shankar Giri,
Nicolai Friis,
Vedran Dunjko,
Hans J. Briegel,
Christof Wunderlich
Abstract:
We report a proof-of-principle experimental demonstration of the quantum speed-up for learning agents utilizing a small-scale quantum information processor based on radiofrequency-driven trapped ions. The decision-making process of a quantum learning agent within the projective simulation paradigm for machine learning is implemented in a system of two qubits. The latter are realized using hyperfin…
▽ More
We report a proof-of-principle experimental demonstration of the quantum speed-up for learning agents utilizing a small-scale quantum information processor based on radiofrequency-driven trapped ions. The decision-making process of a quantum learning agent within the projective simulation paradigm for machine learning is implemented in a system of two qubits. The latter are realized using hyperfine states of two frequency-addressed atomic ions exposed to a static magnetic field gradient. We show that the deliberation time of this quantum learning agent is quadratically improved with respect to comparable classical learning agents. The performance of this quantum-enhanced learning agent highlights the potential of scalable quantum processors taking advantage of machine learning.
△ Less
Submitted 19 December, 2018; v1 submitted 5 September, 2017;
originally announced September 2017.
-
Skill Learning by Autonomous Robotic Playing using Active Learning and Creativity
Authors:
Simon Hangl,
Vedran Dunjko,
Hans J. Briegel,
Justus Piater
Abstract:
We treat the problem of autonomous acquisition of manipulation skills where problem-solving strategies are initially available only for a narrow range of situations. We propose to extend the range of solvable situations by autonomous playing with the object. By applying previously-trained skills and behaviours, the robot learns how to prepare situations for which a successful strategy is already k…
▽ More
We treat the problem of autonomous acquisition of manipulation skills where problem-solving strategies are initially available only for a narrow range of situations. We propose to extend the range of solvable situations by autonomous playing with the object. By applying previously-trained skills and behaviours, the robot learns how to prepare situations for which a successful strategy is already known. The information gathered during autonomous play is additionally used to learn an environment model. This model is exploited for active learning and the creative generation of novel preparatory behaviours. We apply our approach on a wide range of different manipulation tasks, e.g. book gras**, gras** of objects of different sizes by selecting different gras** strategies, placement on shelves, and tower disassembly. We show that the creative behaviour generation mechanism enables the robot to solve previously-unsolvable tasks, e.g. tower disassembly. We use success statistics gained during real-world experiments to simulate the convergence behaviour of our system. Experiments show that active improves the learning speed by around 9 percent in the book gras** scenario.
△ Less
Submitted 26 June, 2017;
originally announced June 2017.
-
Metastability versus collapse following a quench in attractive Bose-Einstein condensates
Authors:
Jake Golde,
Joanna Ruhl,
Sumita Datta,
Boris A. Malomed,
Maxim Olshanii,
Vanja Dunjko
Abstract:
We consider a Bose-Einstein condensate (BEC) with attractive two-body interactions in a cigar-shaped trap, initially prepared in its ground state for a given negative scattering length, which is quenched to a larger absolute value of the scattering length. Using the mean-field approximation, we compute numerically, for an experimentally relevant range of aspect ratios and initial strengths of the…
▽ More
We consider a Bose-Einstein condensate (BEC) with attractive two-body interactions in a cigar-shaped trap, initially prepared in its ground state for a given negative scattering length, which is quenched to a larger absolute value of the scattering length. Using the mean-field approximation, we compute numerically, for an experimentally relevant range of aspect ratios and initial strengths of the coupling, two critical values of quench: one corresponds to the weakest attraction strength the quench to which causes the system to collapse before completing even a single return from the narrow configuration ("perihelion") in its breathing cycle. The other is a similar critical point for the occurrence of collapse before completing two returns. In the latter case, we also compute the limiting value, as we keep increasing the strength of the post-quench attraction towards its critical value, of the time interval between the first two perihelia. We also use a Gaussian variational model to estimate the critical quenched attraction strength below which the system is stable against the collapse for long times. These time intervals and critical attraction strengths---apart from being fundamental properties of nonlinear dynamics of self-attractive BECs---may provide clues to the design of upcoming experiments that are trying to create robust BEC breathers.
△ Less
Submitted 23 February, 2018; v1 submitted 21 June, 2017;
originally announced June 2017.
-
Active learning machine learns to create new quantum experiments
Authors:
Alexey A. Melnikov,
Hendrik Poulsen Nautrup,
Mario Krenn,
Vedran Dunjko,
Markus Tiersch,
Anton Zeilinger,
Hans J. Briegel
Abstract:
How useful can machine learning be in a quantum laboratory? Here we raise the question of the potential of intelligent machines in the context of scientific research. A major motivation for the present work is the unknown reachability of various entanglement classes in quantum experiments. We investigate this question by using the projective simulation model, a physics-oriented approach to artific…
▽ More
How useful can machine learning be in a quantum laboratory? Here we raise the question of the potential of intelligent machines in the context of scientific research. A major motivation for the present work is the unknown reachability of various entanglement classes in quantum experiments. We investigate this question by using the projective simulation model, a physics-oriented approach to artificial intelligence. In our approach, the projective simulation system is challenged to design complex photonic quantum experiments that produce high-dimensional entangled multiphoton states, which are of high interest in modern quantum experiments. The artificial intelligence system learns to create a variety of entangled states, and improves the efficiency of their realization. In the process, the system autonomously (re)discovers experimental techniques which are only now becoming standard in modern quantum optical experiments - a trait which was not explicitly demanded from the system but emerged through the process of learning. Such features highlight the possibility that machines could have a significantly more creative role in future research.
△ Less
Submitted 8 February, 2018; v1 submitted 2 June, 2017;
originally announced June 2017.
-
Long-range big quantum-data transmission
Authors:
M. Zwerger,
A. Pirker,
V. Dunjko,
H. J. Briegel,
W. Dür
Abstract:
We introduce an alternative type of quantum repeater for long-range quantum communication with improved scaling with the distance. We show that by employing hashing, a deterministic entanglement distillation protocol with one-way communication, one obtains a scalable scheme that allows one to reach arbitrary distances, with constant overhead in resources per repeater station, and ultrahigh rates.…
▽ More
We introduce an alternative type of quantum repeater for long-range quantum communication with improved scaling with the distance. We show that by employing hashing, a deterministic entanglement distillation protocol with one-way communication, one obtains a scalable scheme that allows one to reach arbitrary distances, with constant overhead in resources per repeater station, and ultrahigh rates. In practical terms, we show that also with moderate resources of a few hundred qubits at each repeater station, one can reach intercontinental distances. At the same time, a measurement-based implementation allows one to tolerate high loss, but also operational and memory errors of the order of several percent per qubit. This opens the way for long-distance communication of big quantum data.
△ Less
Submitted 22 January, 2018; v1 submitted 5 May, 2017;
originally announced May 2017.
-
A connection between non-local one-body and local three-body correlations of the Lieb-Liniger model
Authors:
Maxim Olshanii,
Vanja Dunjko,
Anna Minguzzi,
Guillaume Lang
Abstract:
We derive a connection between the fourth coefficient of the short-distance Taylor expansion of the one-body correlation function, and the local three-body correlation function of the Lieb-Liniger model of $δ$-interacting spinless bosons in one dimension. This connection, valid at arbitrary interaction strength, involves the fourth moment of the density of quasi-momenta. Generalizing recent conjec…
▽ More
We derive a connection between the fourth coefficient of the short-distance Taylor expansion of the one-body correlation function, and the local three-body correlation function of the Lieb-Liniger model of $δ$-interacting spinless bosons in one dimension. This connection, valid at arbitrary interaction strength, involves the fourth moment of the density of quasi-momenta. Generalizing recent conjectures, we propose approximate analytical expressions for the fourth coefficient covering the whole range of repulsive interactions, validated by comparison with accurate numerics. In particular, we find that the fourth coefficient changes sign at interaction strength $γ_c\simeq 3.816$, while the first three coefficients of the Taylor expansion of the one-body correlation function retain the same sign throughout the whole range of interaction strengths.
△ Less
Submitted 20 July, 2017; v1 submitted 5 May, 2017;
originally announced May 2017.
-
Flexible resources for quantum metrology
Authors:
Nicolai Friis,
Davide Orsucci,
Michalis Skotiniotis,
Pavel Sekatski,
Vedran Dunjko,
Hans J. Briegel,
Wolfgang Dür
Abstract:
Quantum metrology offers a quadratic advantage over classical approaches to parameter estimation problems by utilizing entanglement and nonclassicality. However, the hurdle of actually implementing the necessary quantum probe states and measurements, which vary drastically for different metrological scenarios, is usually not taken into account. We show that for a wide range of tasks in metrology,…
▽ More
Quantum metrology offers a quadratic advantage over classical approaches to parameter estimation problems by utilizing entanglement and nonclassicality. However, the hurdle of actually implementing the necessary quantum probe states and measurements, which vary drastically for different metrological scenarios, is usually not taken into account. We show that for a wide range of tasks in metrology, 2D cluster states (a particular family of states useful for measurement-based quantum computation) can serve as flexible resources that allow one to efficiently prepare any required state for sensing, and perform appropriate (entangled) measurements using only single qubit operations. Crucially, the overhead in the number of qubits is less than quadratic, thus preserving the quantum scaling advantage. This is ensured by using a compression to a logarithmically sized space that contains all relevant information for sensing. We specifically demonstrate how our method can be used to obtain optimal scaling for phase and frequency estimation in local estimation problems, as well as for the Bayesian equivalents with Gaussian priors of varying widths. Furthermore, we show that in the paradigmatic case of local phase estimation 1D cluster states are sufficient for optimal state preparation and measurement.
△ Less
Submitted 30 June, 2017; v1 submitted 31 October, 2016;
originally announced October 2016.
-
Quantum-enhanced machine learning
Authors:
Vedran Dunjko,
Jacob M. Taylor,
Hans J. Briegel
Abstract:
The emerging field of quantum machine learning has the potential to substantially aid in the problems and scope of artificial intelligence. This is only enhanced by recent successes in the field of classical machine learning. In this work we propose an approach for the systematic treatment of machine learning, from the perspective of quantum information. Our approach is general and covers all thre…
▽ More
The emerging field of quantum machine learning has the potential to substantially aid in the problems and scope of artificial intelligence. This is only enhanced by recent successes in the field of classical machine learning. In this work we propose an approach for the systematic treatment of machine learning, from the perspective of quantum information. Our approach is general and covers all three main branches of machine learning: supervised, unsupervised and reinforcement learning. While quantum improvements in supervised and unsupervised learning have been reported, reinforcement learning has received much less attention. Within our approach, we tackle the problem of quantum enhancements in reinforcement learning as well, and propose a systematic scheme for providing improvements. As an example, we show that quadratic improvements in learning efficiency, and exponential improvements in performance over limited time periods, can be obtained for a broad class of learning problems.
△ Less
Submitted 26 October, 2016;
originally announced October 2016.
-
Entanglement generation secure against general attacks
Authors:
Alexander Pirker,
Vedran Dunjko,
Wolfgang Dür,
Hans J. Briegel
Abstract:
We present a security proof for establishing private entanglement by means of recurrence-type entanglement distillation protocols over noisy quantum channels. We consider protocols where the local devices are imperfect, and show that nonetheless a confidential quantum channel can be established, and used to e.g. perform distributed quantum computation in a secure manner. While our results are not…
▽ More
We present a security proof for establishing private entanglement by means of recurrence-type entanglement distillation protocols over noisy quantum channels. We consider protocols where the local devices are imperfect, and show that nonetheless a confidential quantum channel can be established, and used to e.g. perform distributed quantum computation in a secure manner. While our results are not fully device independent (which we argue to be unachievable in settings with quantum outputs), our proof holds for arbitrary channel noise and noisy local operations, and even in the case where the eavesdropper learns the noise. Our approach relies on non-trivial properties of distillation protocols which are used in conjunction with de-Finetti and post-selection-type techniques to reduce a general quantum attack in a non-asymptotic scenario to an i.i.d. setting. As a side result, we also provide entanglement distillation protocols for non-i.i.d. input states.
△ Less
Submitted 17 November, 2017; v1 submitted 6 October, 2016;
originally announced October 2016.
-
Creating Entanglement Using Integrals of Motion
Authors:
Maxim Olshanii,
Thibault Scoquart,
Dmitry Yampolsky,
Vanja Dunjko,
Steven Glenn Jackson
Abstract:
A quantum Galilean cannon is a 1D sequence of $N$ hard-core particles with special mass ratios, and a hard wall; conservation laws due to the reflection group $A_{N}$ prevent both classical stochastization and quantum diffraction. It is realizable through specie-alternating mutually repulsive bosonic soliton trains. We show that an initial disentangled state can evolve into one where the heavy and…
▽ More
A quantum Galilean cannon is a 1D sequence of $N$ hard-core particles with special mass ratios, and a hard wall; conservation laws due to the reflection group $A_{N}$ prevent both classical stochastization and quantum diffraction. It is realizable through specie-alternating mutually repulsive bosonic soliton trains. We show that an initial disentangled state can evolve into one where the heavy and light particles are entangled, and propose a sensor, containing $N_{\text{total}}$ atoms, with a $\sqrt{N_{\text{total}}}$ times higher sensitivity than in a one-atom sensor with $N_{\text{total}}$ repetitions.
△ Less
Submitted 19 January, 2017; v1 submitted 4 October, 2016;
originally announced October 2016.
-
Blind quantum computing with two almost identical states
Authors:
Vedran Dunjko,
Elham Kashefi
Abstract:
The question of whether a fully classical client can delegate a quantum computation to an untrusted quantum server while fully maintaining privacy (blindness) is one of the big open questions in quantum cryptography. Both yes and no answers have important practical and theoretical consequences, and the question seems genuinely hard. The state-of-the-art approaches to securely delegating quantum co…
▽ More
The question of whether a fully classical client can delegate a quantum computation to an untrusted quantum server while fully maintaining privacy (blindness) is one of the big open questions in quantum cryptography. Both yes and no answers have important practical and theoretical consequences, and the question seems genuinely hard. The state-of-the-art approaches to securely delegating quantum computation, without exception, rely on granting the client modest quantum powers, or on additional, non-communicating, quantum servers. In this work, we consider the single server setting, and push the boundaries of the minimal devices of the client, which still allow for blind quantum computation. Our approach is based on the observation that, in many blind quantum computing protocols, the "quantum" part of the protocol, from the clients perspective, boils down to the establishing classical-quantum correlations (independent from the computation) between the client and the server, following which the steering of the computation itself requires only classical communication. Here, we abstract this initial preparation phase, specifically for the Universal Blind Quantum Computation protocol of Broadbent, Fitzsimons and Kashefi. We identify sufficient criteria on the powers of the client, which still allow for secure blind quantum computation. We work in a universally composable framework, and provide a series of protocols, where each step reduces the number of differing states the client needs to be able to prepare. As the limit of such reductions, we show that the capacity to prepare just two pure states, which have an arbitrarily high overlap (thus are arbitrarily close to identical), suffices for efficient and secure blind quantum computation.
△ Less
Submitted 6 April, 2016;
originally announced April 2016.
-
Meta-learning within Projective Simulation
Authors:
Adi Makmal,
Alexey A. Melnikov,
Vedran Dunjko,
Hans J. Briegel
Abstract:
Learning models of artificial intelligence can nowadays perform very well on a large variety of tasks. However, in practice different task environments are best handled by different learning models, rather than a single, universal, approach. Most non-trivial models thus require the adjustment of several to many learning parameters, which is often done on a case-by-case basis by an external party.…
▽ More
Learning models of artificial intelligence can nowadays perform very well on a large variety of tasks. However, in practice different task environments are best handled by different learning models, rather than a single, universal, approach. Most non-trivial models thus require the adjustment of several to many learning parameters, which is often done on a case-by-case basis by an external party. Meta-learning refers to the ability of an agent to autonomously and dynamically adjust its own learning parameters, or meta-parameters. In this work we show how projective simulation, a recently developed model of artificial intelligence, can naturally be extended to account for meta-learning in reinforcement learning settings. The projective simulation approach is based on a random walk process over a network of clips. The suggested meta-learning scheme builds upon the same design and employs clip networks to monitor the agent's performance and to adjust its meta-parameters "on the fly". We distinguish between "reflexive adaptation" and "adaptation through learning", and show the utility of both approaches. In addition, a trade-off between flexibility and learning-time is addressed. The extended model is examined on three different kinds of reinforcement learning tasks, in which the agent has different optimal values of the meta-parameters, and is shown to perform well, reaching near-optimal to optimal success rates in all of them, without ever needing to manually adjust any meta-parameter.
△ Less
Submitted 25 February, 2016;
originally announced February 2016.
-
Experimental demonstration of kilometer-range quantum digital signatures
Authors:
Ross James Donaldson,
Robert John Collins,
Klaudia Kleczkowska,
Ryan Amiri,
Petros Wallden,
Vedran Dunjko,
John Jeffers,
Erika Andersson,
Gerald Stuart Buller
Abstract:
We present an experimental realization of a quantum digital signature protocol which, together with a standard quantum key distribution link, increases transmission distance to kilometre ranges, three orders of magnitude larger than in previous realizations. The bit-rate is also significantly increased compared with previous quantum signature demonstrations. This work illustrates that quantum digi…
▽ More
We present an experimental realization of a quantum digital signature protocol which, together with a standard quantum key distribution link, increases transmission distance to kilometre ranges, three orders of magnitude larger than in previous realizations. The bit-rate is also significantly increased compared with previous quantum signature demonstrations. This work illustrates that quantum digital signatures can be realized with optical components similar to those used for quantum key distribution, and could be implemented in existing optical fiber networks.
△ Less
Submitted 25 September, 2015;
originally announced September 2015.
-
Three-dimensional Gross-Pitaevskii solitary waves in optical lattices: stabilization using the artificial quartic kinetic energy induced by lattice shaking
Authors:
M. Olshanii,
S. Choi,
V. Dunjko,
A. E. Feiguin,
H. Perrin,
J. Ruhl,
D. Aveline
Abstract:
In this Letter, we show that a three-dimensional Bose-Einstein solitary wave can become stable if the dispersion law is changed from quadratic to quartic. We suggest a way to realize the quartic dispersion, using shaken optical lattices. Estimates show that the resulting solitary waves can occupy as little as $\sim 1/20$-th of the Brillouin zone in each of the three directions and contain as many…
▽ More
In this Letter, we show that a three-dimensional Bose-Einstein solitary wave can become stable if the dispersion law is changed from quadratic to quartic. We suggest a way to realize the quartic dispersion, using shaken optical lattices. Estimates show that the resulting solitary waves can occupy as little as $\sim 1/20$-th of the Brillouin zone in each of the three directions and contain as many as $N = 10^{3}$ atoms, thus representing a \textit{fully mobile} macroscopic three-dimensional object.
△ Less
Submitted 7 September, 2015;
originally announced September 2015.
-
Framework for learning agents in quantum environments
Authors:
Vedran Dunjko,
Jacob M. Taylor,
Hans J. Briegel
Abstract:
In this paper we provide a broad framework for describing learning agents in general quantum environments. We analyze the types of classically specified environments which allow for quantum enhancements in learning, by contrasting environments to quantum oracles. We show that whether or not quantum improvements are at all possible depends on the internal structure of the quantum environment. If th…
▽ More
In this paper we provide a broad framework for describing learning agents in general quantum environments. We analyze the types of classically specified environments which allow for quantum enhancements in learning, by contrasting environments to quantum oracles. We show that whether or not quantum improvements are at all possible depends on the internal structure of the quantum environment. If the environments are constructed and the internal structure is appropriately chosen, or if the agent has limited capacities to influence the internal states of the environment, we show that improvements in learning times are possible in a broad range of scenarios. Such scenarios we call luck-favoring settings. The case of constructed environments is particularly relevant for the class of model-based learning agents, where our results imply a near-generic improvement.
△ Less
Submitted 30 July, 2015;
originally announced July 2015.
-
On optimising quantum communication in verifiable quantum computing
Authors:
Theodoros Kapourniotis,
Vedran Dunjko,
Elham Kashefi
Abstract:
In the absence of any efficient classical schemes for verifying a universal quantum computer, the importance of limiting the required quantum resources for this task has been highlighted recently. Currently, most of efficient quantum verification protocols are based on cryptographic techniques where an almost classical verifier executes her desired encrypted quantum computation remotely on an untr…
▽ More
In the absence of any efficient classical schemes for verifying a universal quantum computer, the importance of limiting the required quantum resources for this task has been highlighted recently. Currently, most of efficient quantum verification protocols are based on cryptographic techniques where an almost classical verifier executes her desired encrypted quantum computation remotely on an untrusted quantum prover. In this work we present a new protocol for quantum verification by incorporating existing techniques in a non-standard composition to reduce the required quantum communications between the verifier and the prover.
△ Less
Submitted 23 June, 2015;
originally announced June 2015.
-
Atom transistor from the point of view of quantum nonequilibrium dynamics
Authors:
Zhedong Zhang,
Vanja Dunjko,
Maxim Olshanii
Abstract:
We analyze the atom field-effect transistor scheme [J. A. Stickney, D. Z. Anderson and A. A. Zozulya, Phys. Rev. A 75, 013608 (2007)] using the standard tools of nonequlilibrium dynamics. In particular, we study the deviations from the Eigenstate Thermalization Hypothesis, quantum fluctuations, and the density of states, both ab initio and using their mean-field analogues. Having fully established…
▽ More
We analyze the atom field-effect transistor scheme [J. A. Stickney, D. Z. Anderson and A. A. Zozulya, Phys. Rev. A 75, 013608 (2007)] using the standard tools of nonequlilibrium dynamics. In particular, we study the deviations from the Eigenstate Thermalization Hypothesis, quantum fluctuations, and the density of states, both ab initio and using their mean-field analogues. Having fully established the quantum vs. mean-field correspondence for this system, we attempt, using a mean-field model, to interpret the off-on threshold in our transistor as the onset of ergodicity---a point where the system becomes able to visit the thermal values of the former integrals of motion in principle, albeit not being fully thermalized yet.
△ Less
Submitted 8 June, 2015;
originally announced June 2015.
-
Projective simulation with generalization
Authors:
Alexey A. Melnikov,
Adi Makmal,
Vedran Dunjko,
Hans J. Briegel
Abstract:
The ability to generalize is an important feature of any intelligent agent. Not only because it may allow the agent to cope with large amounts of data, but also because in some environments, an agent with no generalization capabilities cannot learn. In this work we outline several criteria for generalization, and present a dynamic and autonomous machinery that enables projective simulation agents…
▽ More
The ability to generalize is an important feature of any intelligent agent. Not only because it may allow the agent to cope with large amounts of data, but also because in some environments, an agent with no generalization capabilities cannot learn. In this work we outline several criteria for generalization, and present a dynamic and autonomous machinery that enables projective simulation agents to meaningfully generalize. Projective simulation, a novel, physical approach to artificial intelligence, was recently shown to perform well in standard reinforcement learning problems, with applications in advanced robotics as well as quantum experiments. Both the basic projective simulation model and the presented generalization machinery are based on very simple principles. This allows us to provide a full analytical analysis of the agent's performance and to illustrate the benefit the agent gains by generalizing. Specifically, we show that already in basic (but extreme) environments, learning without generalization may be impossible, and demonstrate how the presented generalization machinery enables the projective simulation agent to learn.
△ Less
Submitted 31 October, 2017; v1 submitted 9 April, 2015;
originally announced April 2015.
-
Faster quantum mixing for slowly evolving sequences of Markov chains
Authors:
Davide Orsucci,
Hans J. Briegel,
Vedran Dunjko
Abstract:
Markov chain methods are remarkably successful in computational physics, machine learning, and combinatorial optimization. The cost of such methods often reduces to the mixing time, i.e., the time required to reach the steady state of the Markov chain, which scales as $δ^{-1}$, the inverse of the spectral gap. It has long been conjectured that quantum computers offer nearly generic quadratic impro…
▽ More
Markov chain methods are remarkably successful in computational physics, machine learning, and combinatorial optimization. The cost of such methods often reduces to the mixing time, i.e., the time required to reach the steady state of the Markov chain, which scales as $δ^{-1}$, the inverse of the spectral gap. It has long been conjectured that quantum computers offer nearly generic quadratic improvements for mixing problems. However, except in special cases, quantum algorithms achieve a run-time of $\mathcal{O}(\sqrt{δ^{-1}} \sqrt{N})$, which introduces a costly dependence on the Markov chain size $N,$ not present in the classical case. Here, we re-address the problem of mixing of Markov chains when these form a slowly evolving sequence. This setting is akin to the simulated annealing setting and is commonly encountered in physics, material sciences and machine learning. We provide a quantum memory-efficient algorithm with a run-time of $\mathcal{O}(\sqrt{δ^{-1}} \sqrt[4]{N})$, neglecting logarithmic terms, which is an important improvement for large state spaces. Moreover, our algorithms output quantum encodings of distributions, which has advantages over classical outputs. Finally, we discuss the run-time bounds of mixing algorithms and show that, under certain assumptions, our algorithms are optimal.
△ Less
Submitted 29 October, 2018; v1 submitted 4 March, 2015;
originally announced March 2015.
-
Quantum mixing of Markov chains for special distributions
Authors:
Vedran Dunjko,
Hans J. Briegel
Abstract:
The preparation of the stationary distribution of irreducible, time-reversible Markov chains is a fundamental building block in many heuristic approaches to algorithmically hard problems. It has been conjectured that quantum analogs of classical mixing processes may offer a generic quadratic speed-up in realizing such stationary distributions. Such a speed-up would also imply a speed-up of a broad…
▽ More
The preparation of the stationary distribution of irreducible, time-reversible Markov chains is a fundamental building block in many heuristic approaches to algorithmically hard problems. It has been conjectured that quantum analogs of classical mixing processes may offer a generic quadratic speed-up in realizing such stationary distributions. Such a speed-up would also imply a speed-up of a broad family of heuristic algorithms.
However, a true quadratic speed up has thus far only been demonstrated for special classes of Markov chains. These results often presuppose a regular structure of the underlying graph of the Markov chain, and also a regularity in the transition probabilities.
In this work, we demonstrate a true quadratic speed-up for a class of Markov chains where the restriction is only on the form of the stationary distribution, rather than directly on the Markov chain structure itself. In particular, we show efficient mixing can be achieved when it is beforehand known that the distribution is monotonically decreasing relative to a known order on the state space. Following this, we show that our approach extends to a wider class of distributions, where only a fraction of the shape of the distribution is known to be monotonic. Our approach is built on the Szegedy-type quantization of transition operators.
△ Less
Submitted 19 February, 2015;
originally announced February 2015.
-
Enhanced delegated computing using coherence
Authors:
Stefanie Barz,
Vedran Dunjko,
Florian Schlederer,
Merritt Moore,
Elham Kashefi,
Ian A. Walmsley
Abstract:
A long-standing question is whether it is possible to delegate computational tasks securely. Recently, both a classical and a quantum solution to this problem were found. Here, we study the interplay of classical and quantum approaches and show how coherence can be used as a tool for secure delegated classical computation. We show that a client with limited computational capacity - restricted to a…
▽ More
A long-standing question is whether it is possible to delegate computational tasks securely. Recently, both a classical and a quantum solution to this problem were found. Here, we study the interplay of classical and quantum approaches and show how coherence can be used as a tool for secure delegated classical computation. We show that a client with limited computational capacity - restricted to an XOR gate - can perform universal classical computation by manipulating information carriers that may occupy superpositions of two states. Using single photonic qubits or coherent light, we experimentally implement secure delegated classical computations between an independent client and a server. The server has access to the light sources and measurement devices, whereas the client may use only a restricted set of passive optical devices to manipulate the light beams. Thus, our work highlights how minimal quantum and classical resources can be combined and exploited for classical computing.
△ Less
Submitted 27 January, 2015;
originally announced January 2015.
-
Resilience of constituent solitons in multisoliton scattering off barriers
Authors:
Vanja Dunjko,
Maxim Olshanii
Abstract:
We introduce "superheated integrability," which produces characteristic staircase transmission plots for barrier collisions of breathers of the nonlinear Schrödinger equation. The effect makes tangible the inverse scattering transform, which treats the velocities and norms of the constituent solitons as the real and imaginary parts of the eigenvalues of the Lax operator. If all the norms are much…
▽ More
We introduce "superheated integrability," which produces characteristic staircase transmission plots for barrier collisions of breathers of the nonlinear Schrödinger equation. The effect makes tangible the inverse scattering transform, which treats the velocities and norms of the constituent solitons as the real and imaginary parts of the eigenvalues of the Lax operator. If all the norms are much greater than the velocities, an integrability-breaking potential may nonperturbatively change the velocities while having no measurable effect on the norms. This could be used to improve atomic interferometers.
△ Less
Submitted 1 September, 2020; v1 submitted 30 December, 2014;
originally announced January 2015.
-
Monopole excitations of a harmonically trapped one-dimensional Bose gas from the ideal gas to the Tonks-Girardeau regime
Authors:
S. Choi,
V. Dunjko,
Z. D. Zhang,
M. Olshanii
Abstract:
Using a time-dependent modified nonlinear Schrödinger equation (m-NLSE) -- where the conventional chemical potential proportional to the density is replaced by the one inferred from Lieb-Liniger's exact solution -- we study frequencies of the collective monopole excitations of a one-dimensional (1D) Bose gas. We find that our method accurately reproduces the results of a recent experimental study…
▽ More
Using a time-dependent modified nonlinear Schrödinger equation (m-NLSE) -- where the conventional chemical potential proportional to the density is replaced by the one inferred from Lieb-Liniger's exact solution -- we study frequencies of the collective monopole excitations of a one-dimensional (1D) Bose gas. We find that our method accurately reproduces the results of a recent experimental study [E. Haller et al., Science Vol. 325, 1224 (2009)] in the full spectrum of interaction regimes from the ideal gas, through the mean-field regime, through the mean-field Thomas-Fermi regime, all the way to the Tonks-Giradeau gas. While the former two are accessible by the standard time-dependent NLSE and inaccessible by the time-dependent local density approximation (LDA), the situation reverses in the latter case. However, the m-NLSE treats all these regimes within a single numerical method.
△ Less
Submitted 29 August, 2015; v1 submitted 21 December, 2014;
originally announced December 2014.
-
Quantum-enhanced deliberation of learning agents using trapped ions
Authors:
Vedran Dunjko,
Nicolai Friis,
Hans J. Briegel
Abstract:
A scheme that successfully employs quantum mechanics in the design of autonomous learning agents has recently been reported in the context of the projective simulation (PS) model for artificial intelligence. In that approach, the key feature of a PS agent, a specific type of memory which is explored via random walks, was shown to be amenable to quantization. In particular, classical random walks w…
▽ More
A scheme that successfully employs quantum mechanics in the design of autonomous learning agents has recently been reported in the context of the projective simulation (PS) model for artificial intelligence. In that approach, the key feature of a PS agent, a specific type of memory which is explored via random walks, was shown to be amenable to quantization. In particular, classical random walks were substituted by Szegedy-type quantum walks, allowing for a speed-up. In this work we propose how such classical and quantum agents can be implemented in systems of trapped ions. We employ a generic construction by which the classical agents are `upgraded' to their quantum counterparts by nested coherent controlization, and we outline how this construction can be realized in ion traps. Our results provide a flexible modular architecture for the design of PS agents. Furthermore, we present numerical simulations of simple PS agents which analyze the robustness of our proposal under certain noise models.
△ Less
Submitted 31 January, 2015; v1 submitted 10 July, 2014;
originally announced July 2014.
-
Entanglement of $π$-LME states and the SAT problem
Authors:
Adi Makmal,
Markus Tiersch,
Vedran Dunjko,
Shengjun Wu
Abstract:
In this paper we investigate the entanglement properties of the class of $π$-locally maximally entanglable ($π$-LME) states, which are also known as the "real equally weighted states" or the "hypergraph states". The $π$-LME states comprise well-studied classes of quantum states (e.g. graph states) and exhibit a large degree of symmetry. Motivated by the structure of LME states, we show that the ca…
▽ More
In this paper we investigate the entanglement properties of the class of $π$-locally maximally entanglable ($π$-LME) states, which are also known as the "real equally weighted states" or the "hypergraph states". The $π$-LME states comprise well-studied classes of quantum states (e.g. graph states) and exhibit a large degree of symmetry. Motivated by the structure of LME states, we show that the capacity to (efficiently) determine if a $π$-LME state is entangled would imply an efficient solution to the boolean satisfiability (SAT) problem. More concretely, we show that this particular problem of entanglement detection, phrased as a decision problem, is $\mathsf{NP}$-complete. The restricted setting we consider yields a technically uninvolved proof, and illustrates that entanglement detection, even when quantum states under consideration are highly restricted, still remains difficult.
△ Less
Submitted 28 May, 2014;
originally announced May 2014.
-
Quantum-enhanced Secure Delegated Classical Computing
Authors:
Vedran Dunjko,
Theodoros Kapourniotis,
Elham Kashefi
Abstract:
We present a quantumly-enhanced protocol to achieve unconditionally secure delegated classical computation where the client and the server have both limited classical and quantum computing capacity. We prove the same task cannot be achieved using only classical protocols. This extends the work of Anders and Browne on the computational power of correlations to a security setting. Concretely, we pre…
▽ More
We present a quantumly-enhanced protocol to achieve unconditionally secure delegated classical computation where the client and the server have both limited classical and quantum computing capacity. We prove the same task cannot be achieved using only classical protocols. This extends the work of Anders and Browne on the computational power of correlations to a security setting. Concretely, we present how a client with access to a non-universal classical gate such as a parity gate could achieve unconditionally secure delegated universal classical computation by exploiting minimal quantum gadgets. In particular, unlike the universal blind quantum computing protocols, the restriction of the task to classical computing removes the need for a full universal quantum machine on the side of the server and makes these new protocols readily implementable with the currently available quantum technology in the lab.
△ Less
Submitted 18 May, 2014;
originally announced May 2014.
-
Quantum digital signatures with quantum key distribution components
Authors:
Petros Wallden,
Vedran Dunjko,
Adrian Kent,
Erika Andersson
Abstract:
Digital signatures guarantee the authenticity and transferability of messages, and are widely used in modern communication. The security of currently used classical digital signature schemes, however, relies on computational assumptions. In contrast, quantum digital signature (QDS) schemes offer information-theoretic security guaranteed by the laws of quantum mechanics. We present two QDS protocol…
▽ More
Digital signatures guarantee the authenticity and transferability of messages, and are widely used in modern communication. The security of currently used classical digital signature schemes, however, relies on computational assumptions. In contrast, quantum digital signature (QDS) schemes offer information-theoretic security guaranteed by the laws of quantum mechanics. We present two QDS protocols which have the same experimental requirements as quantum key distribution, which is already commercially available. We also present the first security proof for any QDS scheme against coherent forging attacks.
△ Less
Submitted 22 November, 2014; v1 submitted 21 March, 2014;
originally announced March 2014.
-
Implementing quantum control for unknown subroutines
Authors:
Nicolai Friis,
Vedran Dunjko,
Wolfgang Dür,
Hans J. Briegel
Abstract:
We present setups for the practical realization of adding control to unknown subroutines, supplementing the existing quantum optical scheme for black-box control with a counterpart for the quantum control of the ordering of sequences of operations. We also provide schemes to realize either task using trapped ions. These practical circumventions of recent no-go theorems are based on existing techno…
▽ More
We present setups for the practical realization of adding control to unknown subroutines, supplementing the existing quantum optical scheme for black-box control with a counterpart for the quantum control of the ordering of sequences of operations. We also provide schemes to realize either task using trapped ions. These practical circumventions of recent no-go theorems are based on existing technologies. We argue that the possibility to add control to unknown operations in practice is a common feature of many physical systems. Based on the proposed implementations we discuss the apparent contradictions between theory and practice.
△ Less
Submitted 13 March, 2014; v1 submitted 31 January, 2014;
originally announced January 2014.
-
Quantum speedup for active learning agents
Authors:
Giuseppe Davide Paparo,
Vedran Dunjko,
Adi Makmal,
Miguel Angel Martin-Delgado,
Hans J. Briegel
Abstract:
Can quantum mechanics help us in building intelligent robots and agents? One of the defining characteristics of intelligent behavior is the capacity to learn from experience. However, a major bottleneck for agents to learn in any real-life situation is the size and complexity of the corresponding task environment. Owing to, e.g., a large space of possible strategies, learning is typically slow. Ev…
▽ More
Can quantum mechanics help us in building intelligent robots and agents? One of the defining characteristics of intelligent behavior is the capacity to learn from experience. However, a major bottleneck for agents to learn in any real-life situation is the size and complexity of the corresponding task environment. Owing to, e.g., a large space of possible strategies, learning is typically slow. Even for a moderate task environment, it may simply take too long to rationally respond to a given situation. If the environment is impatient, allowing only a certain time for a response, an agent may then be unable to cope with the situation and to learn at all. Here we show that quantum physics can help and provide a significant speed-up for active learning as a genuine problem of artificial intelligence. We introduce a large class of quantum learning agents for which we show a quadratic boost in their active learning efficiency over their classical analogues. This result will be particularly relevant for applications involving complex task environments.
△ Less
Submitted 14 July, 2014; v1 submitted 20 January, 2014;
originally announced January 2014.
-
Minimum-cost quantum measurements for quantum information
Authors:
Petros Wallden,
Vedran Dunjko,
Erika Andersson
Abstract:
Knowing about optimal quantum measurements is important for many applications in quantum information and quantum communication. However, deriving optimal quantum measurements is often difficult. We present a collection of results for minimum-cost quantum measurements, and give examples of how they can be used. Among other results, we show that a minimum-cost measurement for a set of given pure sta…
▽ More
Knowing about optimal quantum measurements is important for many applications in quantum information and quantum communication. However, deriving optimal quantum measurements is often difficult. We present a collection of results for minimum-cost quantum measurements, and give examples of how they can be used. Among other results, we show that a minimum-cost measurement for a set of given pure states is formally equivalent to a minimum-error measurement for mixed states of those same pure states. For pure symmetric states it turns out that for a certain class of cost matrices, the minimum-cost measurement is the square-root measurement. That is, the optimal minimum-cost measurement is in this case the same as the minimum-error measurement. Finally, we consider sequences of individual ``local" systems, and examine when the global minimum-cost measurement is a sequence of optimal local measurements. We also consider an example where the global minimum-cost measurement is, perhaps counter-intuitively, not a sequence of local measurements, and discuss how this is related to related to the Pusey-Barrett-Rudolph argument for the nature of the wave function.
△ Less
Submitted 18 December, 2013;
originally announced December 2013.
-
Realization of Quantum Digital Signatures without the requirement of quantum memory
Authors:
Robert J. Collins,
Ross J. Donaldson,
Vedran Dunjko,
Petros Wallden,
Patrick J. Clarke,
Erika Andersson,
John Jeffers,
Gerald S. Buller
Abstract:
Digital signatures are widely used to provide security for electronic communications, for example in financial transactions and electronic mail. Currently used classical digital signature schemes, however, only offer security relying on unproven computational assumptions. In contrast, quantum digital signatures (QDS) offer information-theoretic security based on laws of quantum mechanics (e.g. Got…
▽ More
Digital signatures are widely used to provide security for electronic communications, for example in financial transactions and electronic mail. Currently used classical digital signature schemes, however, only offer security relying on unproven computational assumptions. In contrast, quantum digital signatures (QDS) offer information-theoretic security based on laws of quantum mechanics (e.g. Gottesman and Chuang 2001). Here, security against forging relies on the impossibility of perfectly distinguishing between non-orthogonal quantum states. A serious drawback of previous QDS schemes is however that they require long-term quantum memory, making them unfeasible in practice. We present the first realisation of a scheme (Dunjko et al 2013) that does not need quantum memory, and which also uses only standard linear optical components and photodetectors. To achieve this, the recipients measure the distributed quantum signature states using a new type of quantum measurement, quantum state elimination (e.g. Barnett 2009, Bandyopadhyay et al 2013). This significantly advances QDS as a quantum technology with potential for real applications.
△ Less
Submitted 14 May, 2014; v1 submitted 22 November, 2013;
originally announced November 2013.
-
Quantum Digital Signatures without quantum memory
Authors:
Verdan Dunjko,
Petros Wallden,
Erika Andersson
Abstract:
Quantum Digital Signatures (QDS) allow for the exchange of messages from one sender to multiple recipients, with the guarantee that messages cannot be forged or tampered with. Additionally, messages cannot be repudiated -- if one recipient accepts a message, she is guaranteed that others will accept the same message as well. While messaging with these types of security guarantees are routinely per…
▽ More
Quantum Digital Signatures (QDS) allow for the exchange of messages from one sender to multiple recipients, with the guarantee that messages cannot be forged or tampered with. Additionally, messages cannot be repudiated -- if one recipient accepts a message, she is guaranteed that others will accept the same message as well. While messaging with these types of security guarantees are routinely performed in the modern digital world, current technologies only offer security under computational assumptions. QDS, on the other hand, offer security guaranteed by quantum mechanics. All thus far proposed variants of QDS require long-term, high quality storage of quantum information, making them unfeasible in the foreseeable future. Here, we present the first QDS scheme where no quantum memory is required, and all quantum information processing can be performed using just linear optics. This makes QDS feasible with current technology.
△ Less
Submitted 5 September, 2013;
originally announced September 2013.