-
Curriculum reinforcement learning for quantum architecture search under hardware errors
Authors:
Yash J. Patel,
Akash Kundu,
Mateusz Ostaszewski,
Xavier Bonet-Monroig,
Vedran Dunjko,
Onur Danaci
Abstract:
The key challenge in the noisy intermediate-scale quantum era is finding useful circuits compatible with current device limitations. Variational quantum algorithms (VQAs) offer a potential solution by fixing the circuit architecture and optimizing individual gate parameters in an external loop. However, parameter optimization can become intractable, and the overall performance of the algorithm dep…
▽ More
The key challenge in the noisy intermediate-scale quantum era is finding useful circuits compatible with current device limitations. Variational quantum algorithms (VQAs) offer a potential solution by fixing the circuit architecture and optimizing individual gate parameters in an external loop. However, parameter optimization can become intractable, and the overall performance of the algorithm depends heavily on the initially chosen circuit architecture. Several quantum architecture search (QAS) algorithms have been developed to design useful circuit architectures automatically. In the case of parameter optimization alone, noise effects have been observed to dramatically influence the performance of the optimizer and final outcomes, which is a key line of study. However, the effects of noise on the architecture search, which could be just as critical, are poorly understood. This work addresses this gap by introducing a curriculum-based reinforcement learning QAS (CRLQAS) algorithm designed to tackle challenges in realistic VQA deployment. The algorithm incorporates (i) a 3D architecture encoding and restrictions on environment dynamics to explore the search space of possible circuits efficiently, (ii) an episode halting scheme to steer the agent to find shorter circuits, and (iii) a novel variant of simultaneous perturbation stochastic approximation as an optimizer for faster convergence. To facilitate studies, we developed an optimized simulator for our algorithm, significantly improving computational efficiency in simulating noisy quantum circuits by employing the Pauli-transfer matrix formalism in the Pauli-Liouville basis. Numerical experiments focusing on quantum chemistry tasks demonstrate that CRLQAS outperforms existing QAS algorithms across several metrics in both noiseless and noisy environments.
△ Less
Submitted 5 February, 2024;
originally announced February 2024.
-
Enhancing variational quantum state diagonalization using reinforcement learning techniques
Authors:
Akash Kundu,
Przemysław Bedełek,
Mateusz Ostaszewski,
Onur Danaci,
Yash J. Patel,
Vedran Dunjko,
Jarosław A. Miszczak
Abstract:
The variational quantum algorithms are crucial for the application of NISQ computers. Such algorithms require short quantum circuits, which are more amenable to implementation on near-term hardware, and many such methods have been developed. One of particular interest is the so-called variational quantum state diagonalization method, which constitutes an important algorithmic subroutine and can be…
▽ More
The variational quantum algorithms are crucial for the application of NISQ computers. Such algorithms require short quantum circuits, which are more amenable to implementation on near-term hardware, and many such methods have been developed. One of particular interest is the so-called variational quantum state diagonalization method, which constitutes an important algorithmic subroutine and can be used directly to work with data encoded in quantum states. In particular, it can be applied to discern the features of quantum states, such as entanglement properties of a system, or in quantum machine learning algorithms. In this work, we tackle the problem of designing a very shallow quantum circuit, required in the quantum state diagonalization task, by utilizing reinforcement learning (RL). We use a novel encoding method for the RL-state, a dense reward function, and an $ε$-greedy policy to achieve this. We demonstrate that the circuits proposed by the reinforcement learning methods are shallower than the standard variational quantum state diagonalization algorithm and thus can be used in situations where hardware capabilities limit the depth of quantum circuits. The methods we propose in the paper can be readily adapted to address a wide range of variational quantum algorithms.
△ Less
Submitted 11 January, 2024; v1 submitted 19 June, 2023;
originally announced June 2023.
-
ManQala: Game-Inspired Strategies for Quantum State Engineering
Authors:
Onur Danaci,
Wenlei Zhang,
Robert Coleman,
William Djakam,
Michaela Amoo,
Ryan T. Glasser,
Brian T. Kirby,
Moussa N'Gom,
Thomas A. Searles
Abstract:
The ability to prepare systems in specific target states through quantum engineering is essential for realizing the new technologies promised by a second quantum revolution. Here, we recast the fundamental problem of state preparation in high-dimensional Hilbert spaces as ManQala, a quantum game inspired by the West African sowing game mancala. Motivated by optimal gameplay in solitaire mancala, w…
▽ More
The ability to prepare systems in specific target states through quantum engineering is essential for realizing the new technologies promised by a second quantum revolution. Here, we recast the fundamental problem of state preparation in high-dimensional Hilbert spaces as ManQala, a quantum game inspired by the West African sowing game mancala. Motivated by optimal gameplay in solitaire mancala, where nested nearest-neighbor permutations and actions evolve the state of the game board to its target configuration, ManQala acts as a pre-processing approach for deterministically arranging particles in a quantum control problem. Once pre-processing with ManQala is complete, existing quantum control methods are applied, but now with a reduced search space. We find that ManQala-type strategies match, or outperform, competing approaches in terms of final state variance even in small-scale quantum state engineering problems where we expect the slightest advantage since the relative reduction in search space is the least. These results suggest that ManQala provides a rich platform for designing control protocols relevant to near-term intermediate-scale quantum technologies.
△ Less
Submitted 28 February, 2023;
originally announced February 2023.
-
Machine learning pipeline for quantum state estimation with incomplete measurements
Authors:
Onur Danaci,
Sanjaya Lohani,
Brian T. Kirby,
Ryan T. Glasser
Abstract:
Two-qubit systems typically employ 36 projective measurements for high-fidelity tomographic estimation. The overcomplete nature of the 36 measurements suggests possible robustness of the estimation procedure to missing measurements. In this paper, we explore the resilience of machine-learning-based quantum state estimation techniques to missing measurements by creating a pipeline of stacked machin…
▽ More
Two-qubit systems typically employ 36 projective measurements for high-fidelity tomographic estimation. The overcomplete nature of the 36 measurements suggests possible robustness of the estimation procedure to missing measurements. In this paper, we explore the resilience of machine-learning-based quantum state estimation techniques to missing measurements by creating a pipeline of stacked machine learning models for imputation, denoising, and state estimation. When applied to simulated noiseless and noisy projective measurement data for both pure and mixed states, we demonstrate quantum state estimation from partial measurement results that outperforms previously developed machine-learning-based methods in reconstruction fidelity and several conventional methods in terms of resource scaling. Notably, our developed model does not require training a separate model for each missing measurement, making it potentially applicable to quantum state estimation of large quantum systems where preprocessing is computationally infeasible due to the exponential scaling of quantum system dimension.
△ Less
Submitted 5 December, 2020;
originally announced December 2020.
-
Machine learning assisted quantum state estimation
Authors:
Sanjaya Lohani,
Brian T. Kirby,
Michael Brodsky,
Onur Danaci,
Ryan T. Glasser
Abstract:
We build a general quantum state tomography framework that makes use of machine learning techniques to reconstruct quantum states from a given set of coincidence measurements. For a wide range of pure and mixed input states we demonstrate via simulations that our method produces functionally equivalent reconstructed states to that of traditional methods with the added benefit that expensive comput…
▽ More
We build a general quantum state tomography framework that makes use of machine learning techniques to reconstruct quantum states from a given set of coincidence measurements. For a wide range of pure and mixed input states we demonstrate via simulations that our method produces functionally equivalent reconstructed states to that of traditional methods with the added benefit that expensive computations are front-loaded with our system. Further, by training our system with measurement results that include simulated noise sources we are able to demonstrate a significantly enhanced average fidelity when compared to typical reconstruction methods. These enhancements in average fidelity are also shown to persist when we consider state reconstruction from partial tomography data where several measurements are missing. We anticipate that the present results combining the fields of machine intelligence and quantum state estimation will greatly improve and speed up tomography-based quantum experiments.
△ Less
Submitted 6 March, 2020;
originally announced March 2020.
-
Multi-mode four-wave mixing with a spatially-structured pump
Authors:
Jon D. Swaim,
Erin M. Knutson,
Onur Danaci,
Ryan T. Glasser
Abstract:
We demonstrate a new four-wave mixing (4WM) geometry based on structured light. By utilizing near-field diffraction through a narrow slit, the pump beam is asymmetrically structured to modify the phase matching condition, generating multi-mode output in both the spatial and frequency domains. We show that the frequency parameter enables selection of various spatial-mode outputs, including a twin-b…
▽ More
We demonstrate a new four-wave mixing (4WM) geometry based on structured light. By utilizing near-field diffraction through a narrow slit, the pump beam is asymmetrically structured to modify the phase matching condition, generating multi-mode output in both the spatial and frequency domains. We show that the frequency parameter enables selection of various spatial-mode outputs, including a twin-beam geometry which preserves relative intensity squeezing shared between the two beams. The results suggest that the engineering of atomic states via structured light may provide a pathway to a diverse set of quantum resources based on multi-mode squeezed light.
△ Less
Submitted 9 February, 2018;
originally announced February 2018.
-
Atomic vapor as a source of tunable, non-Gaussian self-reconstructing optical modes
Authors:
Jon D. Swaim,
Kaitlyn N. David,
Erin M. Knutson,
Christian Rios,
Onur Danaci,
Ryan T. Glasser
Abstract:
In this manuscript, we demonstrate the ability of nonlinear light-atom interactions to produce tunably non-Gaussian, partially self-healing optical modes. Gaussian spatial-mode light tuned near to the atomic resonances in hot rubidium vapor is shown to result in non-Gaussian output mode structures that may be controlled by varying either the input beam power or the temperature of the atomic vapor.…
▽ More
In this manuscript, we demonstrate the ability of nonlinear light-atom interactions to produce tunably non-Gaussian, partially self-healing optical modes. Gaussian spatial-mode light tuned near to the atomic resonances in hot rubidium vapor is shown to result in non-Gaussian output mode structures that may be controlled by varying either the input beam power or the temperature of the atomic vapor. We show that the output modes exhibit a degree of self-reconstruction after encountering an obstruction in the beam path. The resultant modes are similar to truncated Bessel-Gauss modes that exhibit the ability to self-reconstruct earlier upon propagation than Gaussian modes. The ability to generate tunable, self-reconstructing beams has potential applications to a variety of imaging and communication scenarios.
△ Less
Submitted 6 January, 2017;
originally announced January 2017.
-
All-optical mode conversion via spatially-multimode four-wave mixing
Authors:
Onur Danaci,
Christian Rios,
Ryan T. Glasser
Abstract:
We experimentally demonstrate the conversion of a Gaussian beam to an approximate Bessel-Gauss mode by making use of a non-collinear four-wave mixing process in hot atomic vapor. The presence of a strong, spatially non-Gaussian pump both converts the probe beam into a non-Gaussian mode, and generates a conjugate beam that is in a similar non-Gaussian mode. The resulting probe and conjugate modes a…
▽ More
We experimentally demonstrate the conversion of a Gaussian beam to an approximate Bessel-Gauss mode by making use of a non-collinear four-wave mixing process in hot atomic vapor. The presence of a strong, spatially non-Gaussian pump both converts the probe beam into a non-Gaussian mode, and generates a conjugate beam that is in a similar non-Gaussian mode. The resulting probe and conjugate modes are compared to the output of a Gaussian beam incident on an annular aperture that is then spatially filtered according to the phase-matching conditions imposed by the four-wave mixing process. We find that the resulting experimental data agrees well with both numerical simulations, as well as analytical formulae describing the effects of annular apertures on Gaussian modes. These results show that spatially-multimode gain platforms may be used as a new method of mode conversion.
△ Less
Submitted 3 August, 2016;
originally announced August 2016.
