-
Hamiltonian-based Quantum Reinforcement Learning for Neural Combinatorial Optimization
Authors:
Georg Kruse,
Rodrigo Coehlo,
Andreas Rosskopf,
Robert Wille,
Jeanette Miriam Lorenz
Abstract:
Advancements in Quantum Computing (QC) and Neural Combinatorial Optimization (NCO) represent promising steps in tackling complex computational challenges. On the one hand, Variational Quantum Algorithms such as QAOA can be used to solve a wide range of combinatorial optimization problems. On the other hand, the same class of problems can be solved by NCO, a method that has shown promising results,…
▽ More
Advancements in Quantum Computing (QC) and Neural Combinatorial Optimization (NCO) represent promising steps in tackling complex computational challenges. On the one hand, Variational Quantum Algorithms such as QAOA can be used to solve a wide range of combinatorial optimization problems. On the other hand, the same class of problems can be solved by NCO, a method that has shown promising results, particularly since the introduction of Graph Neural Networks. Given recent advances in both research areas, we introduce Hamiltonian-based Quantum Reinforcement Learning (QRL), an approach at the intersection of QC and NCO. We model our ansatzes directly on the combinatorial optimization problem's Hamiltonian formulation, which allows us to apply our approach to a broad class of problems. Our ansatzes show favourable trainability properties when compared to the hardware efficient ansatzes, while also not being limited to graph-based problems, unlike previous works. In this work, we evaluate the performance of Hamiltonian-based QRL on a diverse set of combinatorial optimization problems to demonstrate the broad applicability of our approach and compare it to QAOA.
△ Less
Submitted 13 May, 2024;
originally announced May 2024.
-
Variational Quantum Circuit Design for Quantum Reinforcement Learning on Continuous Environments
Authors:
Georg Kruse,
Theodora-Augustina Dragan,
Robert Wille,
Jeanette Miriam Lorenz
Abstract:
Quantum Reinforcement Learning (QRL) emerged as a branch of reinforcement learning (RL) that uses quantum submodules in the architecture of the algorithm. One branch of QRL focuses on the replacement of neural networks (NN) by variational quantum circuits (VQC) as function approximators. Initial works have shown promising results on classical environments with discrete action spaces, but many of t…
▽ More
Quantum Reinforcement Learning (QRL) emerged as a branch of reinforcement learning (RL) that uses quantum submodules in the architecture of the algorithm. One branch of QRL focuses on the replacement of neural networks (NN) by variational quantum circuits (VQC) as function approximators. Initial works have shown promising results on classical environments with discrete action spaces, but many of the proposed architectural design choices of the VQC lack a detailed investigation. Hence, in this work we investigate the impact of VQC design choices such as angle embedding, encoding block architecture and postprocessesing on the training capabilities of QRL agents. We show that VQC design greatly influences training performance and heuristically derive enhancements for the analyzed components. Additionally, we show how to design a QRL agent in order to solve classical environments with continuous action spaces and benchmark our agents against classical feed-forward NNs.
△ Less
Submitted 21 December, 2023;
originally announced December 2023.
-
Restricted Global Optimization for QAOA
Authors:
Peter Gleißner,
Georg Kruse,
Andreas Roßkopf
Abstract:
The Quantum Approximate Optimization Algorithm (QAOA) has emerged as a promising variational quantum algorithm for addressing NP hard combinatorial optimization problems. However, a significant limitation lies in optimizing its classical parameters, which is in itself an NP hard problem. To circumvent this obstacle, initialization heuristics, enhanced problem encodings and beneficial problem scali…
▽ More
The Quantum Approximate Optimization Algorithm (QAOA) has emerged as a promising variational quantum algorithm for addressing NP hard combinatorial optimization problems. However, a significant limitation lies in optimizing its classical parameters, which is in itself an NP hard problem. To circumvent this obstacle, initialization heuristics, enhanced problem encodings and beneficial problem scalings have been proposed. While such strategies further improve QAOA's performance, their remaining problem is the sole utilization of local optimizers. We show that local optimization methods are inherently inadequate within the complex cost landscape of QAOA. Instead, global optimization techniques greatly improve QAOA's performance across diverse problem instances. While global optimization generally requires high numbers of function evaluations, we demonstrate how restricted global optimizers still show better performance without requiring an exceeding amount of function evaluations.
△ Less
Submitted 21 September, 2023;
originally announced September 2023.
-
Aspects of quantum phase transitions
Authors:
M. K. G. Kruse,
H. G. Millerr,
A. Plastino,
A. R. Plastino
Abstract:
A unified description of i) classical phase transitions and their remnants in finite systems and ii) quantum phase transitions is presented. The ensuing discussion relies on the interplay between, on the one hand, the thermodynamic concepts of temperature and specific heat and on the other, the quantal ones of coupling strengths in the Hamiltonian. Our considerations are illustrated in an exactl…
▽ More
A unified description of i) classical phase transitions and their remnants in finite systems and ii) quantum phase transitions is presented. The ensuing discussion relies on the interplay between, on the one hand, the thermodynamic concepts of temperature and specific heat and on the other, the quantal ones of coupling strengths in the Hamiltonian. Our considerations are illustrated in an exactly solvable model of Plastino and Moszkowski [Il Nuovo Cimento {\bf 47}, 470 (1978)].
△ Less
Submitted 10 October, 2008; v1 submitted 20 September, 2008;
originally announced September 2008.
