-
Application of machine learning to experimental design in quantum mechanics
Authors:
Federico Belliardo,
Fabio Zoratti,
Vittorio Giovannetti
Abstract:
The recent advances in machine learning hold great promise for the fields of quantum sensing and metrology. With the help of reinforcement learning, we can tame the complexity of quantum systems and solve the problem of optimal experimental design. Reinforcement learning is a powerful model-free technique that allows an agent, typically a neural network, to learn the best strategy to reach a certa…
▽ More
The recent advances in machine learning hold great promise for the fields of quantum sensing and metrology. With the help of reinforcement learning, we can tame the complexity of quantum systems and solve the problem of optimal experimental design. Reinforcement learning is a powerful model-free technique that allows an agent, typically a neural network, to learn the best strategy to reach a certain goal in a completely a priori unknown environment. However, in general, we know something about the quantum system with which the agent is interacting, at least that it follows the rules of quantum mechanics. In quantum metrology, we typically have a model for the system, and only some parameters of the evolution or the initial state are unknown. We present here a general machine learning technique that can optimize the precision of quantum sensors, exploiting the knowledge we have on the system through model-aware reinforcement learning. This framework has been implemented in the Python package qsensoropt, which is able to optimize a broad class of problems found in quantum metrology and quantum parameter estimation. The agent learns an optimal adaptive strategy that, based on previous outcomes, decides the next measurements to perform. We have explored some applications of this technique to NV centers and photonic circuits. So far, we have been able to certify better results than the current state-of-the-art controls for many cases. The machine learning technique developed here can be applied in all scenarios where the quantum system is well-characterized and relatively simple and small. In these cases, we can extract every last bit of information from a quantum sensor by appropriately controlling it with a trained neural network. The qsensoropt software is available on PyPI and can be installed with pip.
△ Less
Submitted 15 March, 2024;
originally announced March 2024.
-
Applications of model-aware reinforcement learning in Bayesian quantum metrology
Authors:
Federico Belliardo,
Fabio Zoratti,
Vittorio Giovannetti
Abstract:
An important practical problem in the field of quantum metrology and sensors is to find the optimal sequences of controls for the quantum probe that realize optimal adaptive estimation. In Belliardo et al., arXiv:2312.16985 (2023), we solved this problem in general, by introducing a procedure capable of optimizing a wide range of tasks in quantum metrology and estimation by combining model-aware r…
▽ More
An important practical problem in the field of quantum metrology and sensors is to find the optimal sequences of controls for the quantum probe that realize optimal adaptive estimation. In Belliardo et al., arXiv:2312.16985 (2023), we solved this problem in general, by introducing a procedure capable of optimizing a wide range of tasks in quantum metrology and estimation by combining model-aware reinforcement learning with Bayesian inference. We take a model-based approach to the optimisation where the physics describing the system is explicitly taken into account in the training through automatic differentiation. In this follow-up paper we present some applications of the framework. The first family of examples concerns the estimation of magnetic fields, hyperfine interactions, and decoherence times for electronic spins in diamond. For these examples, we perform multiple Ramsey measurements on the spin. The second family of applications concerns the estimation of phases and coherent states on photonic circuits, without squeezing elements, where the bosonic lines are measured by photon counters. This exposition showcases the broad applicability of the method, which has been implemented in the qsensoropt library released on PyPI, which can be installed with pip.
△ Less
Submitted 8 March, 2024;
originally announced March 2024.
-
Model-aware reinforcement learning for high-performance Bayesian experimental design in quantum metrology
Authors:
Federico Belliardo,
Fabio Zoratti,
Florian Marquardt,
Vittorio Giovannetti
Abstract:
Quantum sensors offer control flexibility during estimation by allowing manipulation by the experimenter across various parameters. For each sensing platform, pinpointing the optimal controls to enhance the sensor's precision remains a challenging task. While an analytical solution might be out of reach, machine learning offers a promising avenue for many systems of interest, especially given the…
▽ More
Quantum sensors offer control flexibility during estimation by allowing manipulation by the experimenter across various parameters. For each sensing platform, pinpointing the optimal controls to enhance the sensor's precision remains a challenging task. While an analytical solution might be out of reach, machine learning offers a promising avenue for many systems of interest, especially given the capabilities of contemporary hardware. We have introduced a versatile procedure capable of optimizing a wide range of problems in quantum metrology, estimation, and hypothesis testing by combining model-aware reinforcement learning (RL) with Bayesian estimation based on particle filtering. To achieve this, we had to address the challenge of incorporating the many non-differentiable steps of the estimation in the training process, such as measurements and the resampling of the particle filter. Model-aware RL is a gradient-based method, where the derivatives of the sensor's precision are obtained through automatic differentiation (AD) in the simulation of the experiment. Our approach is suitable for optimizing both non-adaptive and adaptive strategies, using neural networks or other agents. We provide an implementation of this technique in the form of a Python library called qsensoropt, alongside several pre-made applications for relevant physical platforms, namely NV centers, photonic circuits, and optical cavities. This library will be released soon on PyPI. Leveraging our method, we've achieved results for many examples that surpass the current state-of-the-art in experimental design. In addition to Bayesian estimation, leveraging model-aware RL, it is also possible to find optimal controls for the minimization of the Cramér-Rao bound, based on Fisher information.
△ Less
Submitted 1 February, 2024; v1 submitted 28 December, 2023;
originally announced December 2023.
-
Optimizing quantum-enhanced Bayesian multiparameter estimation of phase and noise in practical sensors
Authors:
Federico Belliardo,
Valeria Cimini,
Emanuele Polino,
Francesco Hoch,
Bruno Piccirillo,
Nicolò Spagnolo,
Vittorio Giovannetti,
Fabio Sciarrino
Abstract:
Achieving quantum-enhanced performances when measuring unknown quantities requires develo** suitable methodologies for practical scenarios, that include noise and the availability of a limited amount of resources. Here, we report on the optimization of sub-standard quantum limit Bayesian multiparameter estimation in a scenario where a subset of the parameters describes unavoidable noise processe…
▽ More
Achieving quantum-enhanced performances when measuring unknown quantities requires develo** suitable methodologies for practical scenarios, that include noise and the availability of a limited amount of resources. Here, we report on the optimization of sub-standard quantum limit Bayesian multiparameter estimation in a scenario where a subset of the parameters describes unavoidable noise processes in an experimental photonic sensor. We explore how the optimization of the estimation changes depending on which parameters are either of interest or are treated as nuisance ones. Our results show that optimizing the multiparameter approach in noisy apparata represents a significant tool to fully exploit the potential of practical sensors operating beyond the standard quantum limit for broad resources range.
△ Less
Submitted 21 June, 2024; v1 submitted 9 November, 2022;
originally announced November 2022.
-
Untwining multiple parameters at the exclusive zero-coincidence points with quantum control
Authors:
Yu Yang,
Federico Belliardo,
Vittorio Giovannetti,
Fuli Li
Abstract:
In this paper we address a special case of "sloppy" quantum estimation procedures which happens in the presence of intertwined parameters. A collection of parameters are said to be intertwined when their imprinting on the quantum probe that mediates the estimation procedure, is performed by a set of linearly dependent generators. Under this circumstance the individual values of the parameters can…
▽ More
In this paper we address a special case of "sloppy" quantum estimation procedures which happens in the presence of intertwined parameters. A collection of parameters are said to be intertwined when their imprinting on the quantum probe that mediates the estimation procedure, is performed by a set of linearly dependent generators. Under this circumstance the individual values of the parameters can not be recovered unless one tampers with the encoding process itself. An example is presented by studying the estimation of the relative time-delays that accumulate along two parallel optical transmission lines. In this case we show that the parameters can be effectively untwined by inserting a sequence of balanced beam splitters (and eventually adding an extra phase shift on one of the lines) that couples the two lines at regular intervals in a setup that remind us a generalized Hong-Ou-Mandel (GHOM) interferometer. For the case of two time delays we prove that, when the employed probe is the frequency-correlated biphoton state, the untwining occurs in correspondence of exclusive zero-coincidence (EZC) point. Furthermore we show the statistical independence of two time delays and the optimality of the quantum Fisher information at the EZC point. Finally we prove the compatibility of this scheme by checking the weak commutativity condition associated with the symmetric logarithmic derivative operators.
△ Less
Submitted 22 December, 2022; v1 submitted 13 June, 2022;
originally announced June 2022.
-
Non-asymptotic Heisenberg scaling: experimental metrology for a wide resources range
Authors:
Valeria Cimini,
Emanuele Polino,
Federico Belliardo,
Francesco Hoch,
Bruno Piccirillo,
Nicolò Spagnolo,
Vittorio Giovannetti,
Fabio Sciarrino
Abstract:
Adopting quantum resources for parameter estimation discloses the possibility to realize quantum sensors operating at a sensitivity beyond the standard quantum limit. Such approach promises to reach the fundamental Heisenberg scaling as a function of the employed resources $N$ in the estimation process. Although previous experiments demonstrated precision scaling approaching Heisenberg-limited per…
▽ More
Adopting quantum resources for parameter estimation discloses the possibility to realize quantum sensors operating at a sensitivity beyond the standard quantum limit. Such approach promises to reach the fundamental Heisenberg scaling as a function of the employed resources $N$ in the estimation process. Although previous experiments demonstrated precision scaling approaching Heisenberg-limited performances, reaching such regime for a wide range of $N$ remains hard to accomplish. Here, we show a method which suitably allocates the available resources reaching Heisenberg scaling without any prior information on the parameter. We demonstrate experimentally such an advantage in measuring a rotation angle. We quantitatively verify Heisenberg scaling for a considerable range of $N$ by using single-photon states with high-order orbital angular momentum, achieving an error reduction greater than $10$ dB below the standard quantum limit. Such results can be applied to different scenarios, opening the way to the optimization of resources in quantum sensing.
△ Less
Submitted 6 October, 2021;
originally announced October 2021.
-
Incompatibility in Quantum Parameter Estimation
Authors:
Federico Belliardo,
Vittorio Giovannetti
Abstract:
In this paper we introduce a measure of genuine quantum incompatibility in the estimation task of multiple parameters, that has a geometric character and is backed by a clear operational interpretation. This measure is then applied to some simple systems in order to track the effect of a local depolarizing noise on the incompatibility of the estimation task. A semidefinite program is described and…
▽ More
In this paper we introduce a measure of genuine quantum incompatibility in the estimation task of multiple parameters, that has a geometric character and is backed by a clear operational interpretation. This measure is then applied to some simple systems in order to track the effect of a local depolarizing noise on the incompatibility of the estimation task. A semidefinite program is described and used to numerically compute the figure of merit when the analytical tools are not sufficient, among these we include an upper bound computable from the symmetric logarithmic derivatives only. Finally we discuss how to obtain compatible models for a general unitary encoding on a finite dimensional probe.
△ Less
Submitted 17 May, 2021; v1 submitted 26 February, 2021;
originally announced February 2021.
-
Achieving Heisenberg scaling with maximally entangled states: an analytic upper bound for the attainable root mean square error
Authors:
Federico Belliardo,
Vittorio Giovannetti
Abstract:
In this paper we explore the possibility of performing Heisenberg limited quantum metrology of a phase, without any prior, by employing only maximally entangled states. Starting from the estimator introduced by Higgins et al. in New J. Phys. 11, 073023 (2009), the main result of this paper is to produce an analytical upper bound on the associated Mean Squared Error which is monotonically decreasin…
▽ More
In this paper we explore the possibility of performing Heisenberg limited quantum metrology of a phase, without any prior, by employing only maximally entangled states. Starting from the estimator introduced by Higgins et al. in New J. Phys. 11, 073023 (2009), the main result of this paper is to produce an analytical upper bound on the associated Mean Squared Error which is monotonically decreasing as a function of the square of the number of quantum probes used in the process. The analysed protocol is non-adaptive and requires in principle (for distinguishable probes) only separable measurements. We explore also metrology in presence of a limitation on the entanglement size and in presence of loss.
△ Less
Submitted 25 September, 2020; v1 submitted 6 July, 2020;
originally announced July 2020.
