-
Two Stage Least Squares with Time-Varying Instruments: An Application to an Evaluation of Treatment Intensification for Type-2 Diabetes
Authors:
Daniel Tompsett,
Stijn Vansteelandt,
Richard Grieve,
Irene Petersen,
Manuel Gomes
Abstract:
As longitudinal data becomes more available in many settings, policy makers are increasingly interested in the effect of time-varying treatments (e.g. sustained treatment strategies). In settings such as this, the preferred analysis techniques are the g-methods, however these require the untestable assumption of no unmeasured confounding. Instrumental variable analyses can minimise bias through un…
▽ More
As longitudinal data becomes more available in many settings, policy makers are increasingly interested in the effect of time-varying treatments (e.g. sustained treatment strategies). In settings such as this, the preferred analysis techniques are the g-methods, however these require the untestable assumption of no unmeasured confounding. Instrumental variable analyses can minimise bias through unmeasured confounding. Of these methods, the Two Stage Least Squares technique is one of the most well used in Econometrics, but it has not been fully extended, and evaluated, in full time-varying settings. This paper proposes a robust two stage least squares method for the econometric evaluation of time-varying treatment. Using a simulation study we found that, unlike standard two stage least squares, it performs relatively well across a wide range of circumstances, including model misspecification. It compares well with recent time-varying instrument approaches via g-estimation. We illustrate the methods in an evaluation of treatment intensification for Type-2 Diabetes Mellitus, exploring the exogeneity in prescribing preferences to operationalise a time-varying instrument.
△ Less
Submitted 10 July, 2024;
originally announced July 2024.
-
Discrete-time Integral Resonant Control of Negative Imaginary Systems: Application to a High-speed Nanopositioner
Authors:
Kanghong Shi,
Erfan Khodabakhshi,
Prosanto Biswas,
Ian R. Petersen,
S. O. Reza Moheimani
Abstract:
We propose a discrete-time integral resonant control (IRC) approach for negative imaginary (NI) systems, which overcomes several limitations of continuous-time IRC. We show that a discrete-time IRC has a step-advanced negative imaginary property. A zero-order hold-sampled NI system can be asymptotically stabilized using a discrete-time IRC with suitable parameters. A hardware experiment is conduct…
▽ More
We propose a discrete-time integral resonant control (IRC) approach for negative imaginary (NI) systems, which overcomes several limitations of continuous-time IRC. We show that a discrete-time IRC has a step-advanced negative imaginary property. A zero-order hold-sampled NI system can be asymptotically stabilized using a discrete-time IRC with suitable parameters. A hardware experiment is conducted where a high-speed flexure-guided nanopositioner is efficiently damped using the proposed discrete-time IRC with the discrete-time controller being implemented in FPGA hardware at the sampling rate of 1.25 MHz.
△ Less
Submitted 23 June, 2024;
originally announced June 2024.
-
Unified Control of Voltage, Frequency and Angle in Electrical Power Systems: A Passivity and Negative-Imaginary based Approach
Authors:
Yijun Chen,
Kanghong Shi,
Ian R. Petersen,
Elizabeth L. Ratnam
Abstract:
This paper proposes a unified methodology for voltage regulation, frequency synchronization, and rotor angle control in power transmission systems considering a one-axis generator model with time-varying voltages. First, we formulate an output consensus problem with a passivity and negative-imaginary (NI) based control framework. We establish output consensus results for both networked passive sys…
▽ More
This paper proposes a unified methodology for voltage regulation, frequency synchronization, and rotor angle control in power transmission systems considering a one-axis generator model with time-varying voltages. First, we formulate an output consensus problem with a passivity and negative-imaginary (NI) based control framework. We establish output consensus results for both networked passive systems and networked NI systems. Next, we apply the output consensus problem by controlling large-scale batteries co-located with synchronous generators -- using real-time voltage phasor measurements. By controlling the battery storage systems so as to dispatch real and reactive power, we enable simultaneous control of voltage, frequency, and power angle differences across a transmission network. Validation through numerical simulations on a four-area transmission network confirms the robustness of our unified control framework.
△ Less
Submitted 3 June, 2024;
originally announced June 2024.
-
On the Stability of Networked Nonlinear Negative Imaginary Systems with Applications to Electrical Power Systems
Authors:
Yijun Chen,
Kanghong Shi,
Ian R. Petersen,
Elizabeth L. Ratnam
Abstract:
In the transition to achieving net zero emissions, it has been suggested that a substantial expansion of electric power grids will be necessary to support emerging renewable energy zones. In this paper, we propose employing battery-based feedback control and nonlinear negative imaginary (NI) systems theory to reduce the need for such expansion. By formulating a novel LurĂ©-Postnikov-like Lyapunov f…
▽ More
In the transition to achieving net zero emissions, it has been suggested that a substantial expansion of electric power grids will be necessary to support emerging renewable energy zones. In this paper, we propose employing battery-based feedback control and nonlinear negative imaginary (NI) systems theory to reduce the need for such expansion. By formulating a novel Luré-Postnikov-like Lyapunov function, stability results are presented for the feedback interconnection of two single nonlinear NI systems, while output feedback consensus results are established for the feedback interconnection of two networked nonlinear NI systems based on a network topology. This theoretical framework underpins our design of battery-based control in power transmission systems. We demonstrate that the power grid can be gradually transitioned into the proposed NI systems, one transmission line at a time.
△ Less
Submitted 11 July, 2024; v1 submitted 3 June, 2024;
originally announced June 2024.
-
Arbitrary State Transition of Open Qubit System Based on Switching Control
Authors:
Guangpu Wu,
Shibei Xue,
Shan Ma,
Sen Kuang,
Daoyi Dong,
Ian R. Petersen
Abstract:
We present a switching control strategy based on Lyapunov control for arbitrary state transitions in open qubit systems. With coherent vector representation, we propose a switching control strategy, which can prevent the state of the qubit from entering invariant sets and singular value sets, effectively driving the system ultimately to a sufficiently small neighborhood of target states. In compar…
▽ More
We present a switching control strategy based on Lyapunov control for arbitrary state transitions in open qubit systems. With coherent vector representation, we propose a switching control strategy, which can prevent the state of the qubit from entering invariant sets and singular value sets, effectively driving the system ultimately to a sufficiently small neighborhood of target states. In comparison to existing works, this control strategy relaxes the strict constraints on system models imposed by special target states. Furthermore, we identify conditions under which the open qubit system achieves finite-time stability (FTS) and finite-time contractive stability (FTCS), respectively. This represents a critical improvement in quantum state transitions, especially considering the asymptotic stability of arbitrary target states is unattainable in open quantum systems. The effectiveness of our proposed method is convincingly demonstrated through its application in a qubit system affected by various types of decoherence, including amplitude, dephasing and polarization decoherence.
△ Less
Submitted 28 March, 2024;
originally announced March 2024.
-
Digital control of negative imaginary systems: a discrete-time hybrid integrator-gain system approach
Authors:
Kanghong Shi,
Ian R. Petersen
Abstract:
A hybrid integrator-gain system (HIGS) is a control element that switches between an integrator and a gain, which overcomes some inherent limitations of linear controllers. In this paper, we consider using discrete-time HIGS controllers for the digital control of negative imaginary (NI) systems. We show that the discrete-time HIGS themselves are step-advanced negative imaginary systems. For a mini…
▽ More
A hybrid integrator-gain system (HIGS) is a control element that switches between an integrator and a gain, which overcomes some inherent limitations of linear controllers. In this paper, we consider using discrete-time HIGS controllers for the digital control of negative imaginary (NI) systems. We show that the discrete-time HIGS themselves are step-advanced negative imaginary systems. For a minimal linear NI system, there always exists a HIGS controller that can asymptotically stablize it. An illustrative example is provided, where we use the proposed HIGS control method to stabilize a discrete-time mass-spring system.
△ Less
Submitted 24 March, 2024;
originally announced March 2024.
-
Hybrid integrator-gain system based integral resonant controllers for negative imaginary systems
Authors:
Kanghong Shi,
Ian R. Petersen
Abstract:
We introduce a hybrid control system called a hybrid integrator-gain system (HIGS) based integral resonant controller (IRC) to stabilize negative imaginary (NI) systems. A HIGS-based IRC has a similar structure to an IRC, with the integrator replaced by a HIGS. We show that a HIGS-based IRC is an NI system. Also, for a SISO NI system with a minimal realization, we show there exists a HIGS-based IR…
▽ More
We introduce a hybrid control system called a hybrid integrator-gain system (HIGS) based integral resonant controller (IRC) to stabilize negative imaginary (NI) systems. A HIGS-based IRC has a similar structure to an IRC, with the integrator replaced by a HIGS. We show that a HIGS-based IRC is an NI system. Also, for a SISO NI system with a minimal realization, we show there exists a HIGS-based IRC such that their closed-loop interconnection is asymptotically stable. Also, we propose a proportional-integral-double-integral resonant controller and a HIGS-based proportional-integral-double-integral resonant controller and show that both of them can be applied to asymptotically stabilize an NI system. An example is provided to illustrate the proposed results.
△ Less
Submitted 22 March, 2024;
originally announced March 2024.
-
A two-stage solution to quantum process tomography: error analysis and optimal design
Authors:
Shuixin Xiao,
Yuanlong Wang,
Jun Zhang,
Daoyi Dong,
Gary J. Mooney,
Ian R. Petersen,
Hidehiro Yonezawa
Abstract:
Quantum process tomography is a critical task for characterizing the dynamics of quantum systems and achieving precise quantum control. In this paper, we propose a two-stage solution for both trace-preserving and non-trace-preserving quantum process tomography. Utilizing a tensor structure, our algorithm exhibits a computational complexity of $O(MLd^2)$ where $d$ is the dimension of the quantum sy…
▽ More
Quantum process tomography is a critical task for characterizing the dynamics of quantum systems and achieving precise quantum control. In this paper, we propose a two-stage solution for both trace-preserving and non-trace-preserving quantum process tomography. Utilizing a tensor structure, our algorithm exhibits a computational complexity of $O(MLd^2)$ where $d$ is the dimension of the quantum system and $ M $, $ L $ represent the numbers of different input states and measurement operators, respectively. We establish an analytical error upper bound and then design the optimal input states and the optimal measurement operators, which are both based on minimizing the error upper bound and maximizing the robustness characterized by the condition number. Numerical examples and testing on IBM quantum devices are presented to demonstrate the performance and efficiency of our algorithm.
△ Less
Submitted 14 February, 2024;
originally announced February 2024.
-
Robust Quantum Control via a Model Predictive Control Strategy
Authors:
Yunyan Lee,
Ian R. Petersen,
Daoyi Dong
Abstract:
This article presents a robust control strategy using Time-Optimal Model Predictive Control (TOMPC) for a two-level quantum system subject to bounded uncertainties. In this method, the control field is optimized over a finite horizon using a nominal quantum system as the reference and then the optimal control for the first time interval is applied and a projective measurement is implemented on the…
▽ More
This article presents a robust control strategy using Time-Optimal Model Predictive Control (TOMPC) for a two-level quantum system subject to bounded uncertainties. In this method, the control field is optimized over a finite horizon using a nominal quantum system as the reference and then the optimal control for the first time interval is applied and a projective measurement is implemented on the uncertain system. The new control field for the next time interval will be iteratively optimized based on the measurement result. We present theoretical results to guarantee the stability of the TOMPC algorithm. We also characterize the robustness and the convergence rate of the TOMPC strategy for the control of two-level systems. Numerical simulations further demonstrate that, in the presence of uncertainties, our quantum TOMPC algorithm enhances robustness and steers the state to the desired state with high fidelity. This work contributes to the progress of Model Predictive Control in quantum control and explores its potential in practical applications of quantum technology.
△ Less
Submitted 11 February, 2024;
originally announced February 2024.
-
Competitive Equilibrium in Microgrids With Dynamic Loads
Authors:
Zeinab Salehi,
Yijun Chen,
Ian R. Petersen,
Elizabeth L. Ratnam,
Guodong Shi
Abstract:
In this paper, we consider microgrids that interconnect prosumers with distributed energy resources and dynamic loads. Prosumers are connected through the microgrid to trade energy and gain profit while respecting the network constraints. We establish a local energy market by defining a competitive equilibrium which balances energy and satisfies voltage constraints within the microgrid for all tim…
▽ More
In this paper, we consider microgrids that interconnect prosumers with distributed energy resources and dynamic loads. Prosumers are connected through the microgrid to trade energy and gain profit while respecting the network constraints. We establish a local energy market by defining a competitive equilibrium which balances energy and satisfies voltage constraints within the microgrid for all time. Using duality theory, we prove that under some convexity assumptions, a competitive equilibrium is equivalent to a social welfare maximization solution. Additionally, we show that a competitive equilibrium is equivalent to a Nash equilibrium of a standard game. In general, the energy price for each prosumer is different, leading to the concept of locational prices. We investigate a case under which all prosumers have the same locational prices. Additionally, we show that under some assumptions on the resource supply and network topology, locational prices decay to zero after a period of time, implying the available supply will be more than the demand required to stabilize the system. Finally, two numerical examples are provided to validate the results, one of which is a direct application of our results on electric vehicle charging control.
△ Less
Submitted 4 February, 2024;
originally announced February 2024.
-
The Quantum Kalman Decomposition: A Gramian Matrix Approach
Authors:
Guofeng Zhang,
**ghao Li,
Zhiyuan Dong,
Ian R. Petersen
Abstract:
The Kalman canonical form for quantum linear systems was derived in \cite{ZGPG18}. The purpose of this paper is to present an alternative derivation by means of a Gramian matrix approach. Controllability and observability Gramian matrices are defined for linear quantum systems, which are used to characterize various subspaces. Based on these characterizations, real orthogonal and block symplectic…
▽ More
The Kalman canonical form for quantum linear systems was derived in \cite{ZGPG18}. The purpose of this paper is to present an alternative derivation by means of a Gramian matrix approach. Controllability and observability Gramian matrices are defined for linear quantum systems, which are used to characterize various subspaces. Based on these characterizations, real orthogonal and block symplectic coordinate transformation matrices are constructed to transform a given quantum linear system to the Kalman canonical form. An example is used to illustrate the main results.
△ Less
Submitted 26 December, 2023;
originally announced December 2023.
-
Discrete-time Negative Imaginary Systems from ZOH Sampling
Authors:
Kanghong Shi,
Ian R. Petersen,
Igor G. Vladimirov
Abstract:
A new definition of discrete-time negative imaginary (NI) systems is provided. This definition characterizes the dissipative property of a zero-order hold sampled continuous-time NI system. Under some assumptions, asymptotic stability can be guaranteed for the closed-loop interconnection of an NI system and an output strictly negative imaginary system, with one of them having a one step advance. I…
▽ More
A new definition of discrete-time negative imaginary (NI) systems is provided. This definition characterizes the dissipative property of a zero-order hold sampled continuous-time NI system. Under some assumptions, asymptotic stability can be guaranteed for the closed-loop interconnection of an NI system and an output strictly negative imaginary system, with one of them having a one step advance. In the case of linear systems, we also provide necessary and sufficient frequency-domain and LMI conditions under which the definition is satisfied. Also provided is a simple DC gain condition for the stability results in the linear case.
△ Less
Submitted 11 June, 2024; v1 submitted 8 December, 2023;
originally announced December 2023.
-
A Nonlinear Negative Imaginary Systems Framework with Actuator Saturation for Control of Electrical Power Systems
Authors:
Yijun Chen,
Kanghong Shi,
Ian R. Petersen,
Elizabeth L. Ratnam
Abstract:
In the transition to net zero, it has been suggested that a massive expansion of the electric power grid will be required to support emerging renewable energy zones. In this paper, we propose the use of battery-based feedback control and nonlinear negative imaginary systems theory to reduce the need for such an expansion by enabling the more complete utilization of existing grid infrastructure. By…
▽ More
In the transition to net zero, it has been suggested that a massive expansion of the electric power grid will be required to support emerging renewable energy zones. In this paper, we propose the use of battery-based feedback control and nonlinear negative imaginary systems theory to reduce the need for such an expansion by enabling the more complete utilization of existing grid infrastructure. By constructing a novel Lur'e-Postnikov-like Lyapunov function, a stability result is developed for the feedback interconnection of a nonlinear negative imaginary system and a nonlinear negative imaginary controller. Additionally, a new class of nonlinear negative imaginary controllers is proposed to deal with actuator saturation. We show that in this control framework, the controller eventually leaves the saturation boundary, and the feedback system is locally stable in the sense of Lyapunov. This provides theoretical support for the application of battery-based control in electrical power systems. Validation through simulation results for single-machine-infinite-bus power systems supports our results. Our approach has the potential to enable a transmission line to operate at its maximum power capacity, as stability robustness is ensured by the use of a feedback controller.
△ Less
Submitted 12 November, 2023;
originally announced November 2023.
-
Decoherence time control by interconnection for finite-level quantum memory systems
Authors:
Igor G. Vladimirov,
Ian R. Petersen
Abstract:
This paper is concerned with open quantum systems whose dynamic variables have an algebraic structure, similar to that of the Pauli matrices for finite-level systems. The Hamiltonian and the operators of coupling of the system to the external bosonic fields depend linearly on the system variables. The fields are represented by quantum Wiener processes which drive the system dynamics according to a…
▽ More
This paper is concerned with open quantum systems whose dynamic variables have an algebraic structure, similar to that of the Pauli matrices for finite-level systems. The Hamiltonian and the operators of coupling of the system to the external bosonic fields depend linearly on the system variables. The fields are represented by quantum Wiener processes which drive the system dynamics according to a quasilinear Hudson-Parthasarathy quantum stochastic differential equation whose drift vector and dispersion matrix are affine and linear functions of the system variables. This setting includes the zero-Hamiltonian isolated system dynamics as a particular case, where the system variables are constant in time, which makes them potentially applicable as a quantum memory. In a more realistic case of nonvanishing system-field coupling, we define a memory decoherence time when a mean-square deviation of the system variables from their initial values becomes relatively significant as specified by a weighting matrix and a fidelity parameter. We consider the decoherence time maximization over the energy parameters of the system and obtain a condition under which the zero Hamiltonian provides a suboptimal solution. This optimization problem is also discussed for a direct energy coupling interconnection of such systems.
△ Less
Submitted 3 November, 2023;
originally announced November 2023.
-
Decoherence time in quantum harmonic oscillators as quantum memory systems
Authors:
Igor G. Vladimirov,
Ian R. Petersen
Abstract:
This paper is concerned with open quantum harmonic oscillators (OQHOs) described by linear quantum stochastic differential equations. This framework includes isolated oscillators with zero Hamiltonian, whose system variables remain unchanged (in the Heisenberg picture of quantum dynamics) over the course of time, making such systems potentially applicable as quantum memory devices. In a more reali…
▽ More
This paper is concerned with open quantum harmonic oscillators (OQHOs) described by linear quantum stochastic differential equations. This framework includes isolated oscillators with zero Hamiltonian, whose system variables remain unchanged (in the Heisenberg picture of quantum dynamics) over the course of time, making such systems potentially applicable as quantum memory devices. In a more realistic case of system-environment coupling, we define a memory decoherence horizon as a typical time for a mean-square deviation of the system variables from their initial values to become relatively significant as specified by a weighting matrix and a fidelity parameter. We consider the maximization of the decoherence time over the energy and coupling matrices of the OQHO as a memory system in its storage phase and obtain a condition under which the zero Hamiltonian delivers a suboptimal solution. This optimization problem is also discussed for an interconnection of OQHOs.
△ Less
Submitted 26 October, 2023;
originally announced October 2023.
-
Negative Imaginary Control Using Hybrid Integrator-Gain Systems: Application to MEMS Nanopositioner
Authors:
Kanghong Shi,
Nastaran Nikooienejad,
Ian R. Petersen,
S. O. Reza Moheimani
Abstract:
In this paper, we propose a new approach to address the control problem for negative imaginary (NI) systems by using hybrid integrator-gain systems (HIGS). We investigate the single HIGS of its original form and its two variations, including a multi-HIGS and the serial cascade of two HIGS. A single HIGS is shown to be a nonlinear negative imaginary system, and so is the multi-HIGS and the cascade…
▽ More
In this paper, we propose a new approach to address the control problem for negative imaginary (NI) systems by using hybrid integrator-gain systems (HIGS). We investigate the single HIGS of its original form and its two variations, including a multi-HIGS and the serial cascade of two HIGS. A single HIGS is shown to be a nonlinear negative imaginary system, and so is the multi-HIGS and the cascade of two HIGS. We show that these three types of HIGS can be used as controllers to asymptotically stabilize linear NI systems. The results of this paper are then illustrated in a real-world experiment where a 2-DOF microelectromechanical system nanopositioner is stabilized by a multi-HIGS.
△ Less
Submitted 24 October, 2023;
originally announced October 2023.
-
Transactive Multi-Agent Systems over Flow Networks
Authors:
Yijun Chen,
Zeinab Salehi,
Elizabeth L. Ratnam,
Ian R. Petersen,
Guodong Shi
Abstract:
This paper presented insights into the implementation of transactive multi-agent systems over flow networks where local resources are decentralized. Agents have local resource demand and supply, and are interconnected through a flow network to support the sharing of local resources while respecting restricted sharing/flow capacity. We first establish a competitive market with a pricing mechanism t…
▽ More
This paper presented insights into the implementation of transactive multi-agent systems over flow networks where local resources are decentralized. Agents have local resource demand and supply, and are interconnected through a flow network to support the sharing of local resources while respecting restricted sharing/flow capacity. We first establish a competitive market with a pricing mechanism that internalizes flow capacity constraints into agents' private decisions. We then demonstrate through duality theory that competitive equilibrium and social welfare equilibrium exist and agree under convexity assumptions, indicating the efficiency of the pricing mechanism. Additionally, a new social acceptance sharing problem is defined to investigate homogeneous pricing when the optimal sharing prices at all agents under competitive equilibrium are always equal for social acceptance. A conceptual computation method is proposed, prescribing a class of socially admissible utility functions to solve the social acceptance problem. A special case of linear-quadratic multi-agent systems over undirected star graphs is provided as a pedagogical example of how to explicitly prescribe socially admissible utility functions. Finally, extensive experiments are provided to validate the results.
△ Less
Submitted 27 August, 2023;
originally announced October 2023.
-
Design and Stability of Angle based Feedback Control in Power Systems: A Negative-Imaginary Approach
Authors:
Yijun Chen,
Ian R. Petersen,
Elizabeth L. Ratnam
Abstract:
This paper considers a power transmission network characterized by interconnected nonlinear swing dynamics on generator buses. At the steady state, frequencies across different buses synchronize to a common nominal value such as $50$Hz or $60$Hz, and power flows on transmission lines are within steady-state envelopes. We assume that fast measurements of generator rotor angles are available. Our ap…
▽ More
This paper considers a power transmission network characterized by interconnected nonlinear swing dynamics on generator buses. At the steady state, frequencies across different buses synchronize to a common nominal value such as $50$Hz or $60$Hz, and power flows on transmission lines are within steady-state envelopes. We assume that fast measurements of generator rotor angles are available. Our approach to frequency and angle control centers on equip** generator buses with large-scale batteries that are controllable on a fast timescale. We link angle based feedback linearization control with negative-imaginary systems theory. Angle based feedback controllers are designed using large-scale batteries as actuators and can be implemented in a distributed manner incorporating local information. Our analysis demonstrates the internal stability of the interconnection between the power transmission network and the angle based feedback controllers. This internal stability underscores the benefits of achieving frequency synchronization and preserving steady-state power flows within network envelopes through the use of feedback controllers. Our approach will enable transmission lines to be operated at maximum power capacity since stability robustness is ensured by the use of feedback controllers rather than conservative criteria such as the equal area criterion. By means of numerical simulations, we illustrate our results.
△ Less
Submitted 3 October, 2023;
originally announced October 2023.
-
Quantum autoencoders using mixed reference states
Authors:
Hailan Ma,
Gary J. Mooney,
Ian R. Petersen,
Lloyd C. L. Hollenberg,
Daoyi Dong
Abstract:
One of the fundamental tasks in information theory is the compression of information. To achieve this in the quantum domain, quantum autoencoders that aim to compress quantum states to low-dimensional ones have been proposed. When taking a pure state as the reference state, there exists an upper bound for the encoding fidelity. This bound limits the compression rate for high-rank states that have…
▽ More
One of the fundamental tasks in information theory is the compression of information. To achieve this in the quantum domain, quantum autoencoders that aim to compress quantum states to low-dimensional ones have been proposed. When taking a pure state as the reference state, there exists an upper bound for the encoding fidelity. This bound limits the compression rate for high-rank states that have high entropy. To overcome the entropy inconsistency between the initial states and the reconstructed states, we allow the reference state to be a mixed state. A new cost function that combines the encoding fidelity and the quantum mutual information is proposed for compressing general input states. In particular, we consider the reference states to be a mixture of maximally mixed states and pure states. To achieve efficient compression for different states, two strategies for setting the ratio of mixedness (in the mixture of maximally mixed states and pure states) are provided based on prior knowledge about quantum states or observations obtained from the training process. Numerical results on thermal states of the transverse-field Ising model, Werner states, and maximally mixed states blended with pure states illustrate the effectiveness of the proposed method. In addition, quantum autoencoders using mixed reference states are experimentally implemented on IBM Quantum devices to compress and reconstruct thermal states and Werner states.
△ Less
Submitted 27 September, 2023;
originally announced September 2023.
-
Quadratic-exponential coherent feedback control of linear quantum stochastic systems
Authors:
Igor G. Vladimirov,
Ian R. Petersen
Abstract:
This paper considers a risk-sensitive optimal control problem for a field-mediated interconnection of a quantum plant with a coherent (measurement-free) quantum controller. The plant and the controller are multimode open quantum harmonic oscillators governed by linear quantum stochastic differential equations, which are coupled to each other and driven by multichannel quantum Wiener processes mode…
▽ More
This paper considers a risk-sensitive optimal control problem for a field-mediated interconnection of a quantum plant with a coherent (measurement-free) quantum controller. The plant and the controller are multimode open quantum harmonic oscillators governed by linear quantum stochastic differential equations, which are coupled to each other and driven by multichannel quantum Wiener processes modelling the external bosonic fields. The control objective is to internally stabilize the closed-loop system and minimize the infinite-horizon asymptotic growth rate of a quadratic-exponential functional which penalizes the plant variables and the controller output. We obtain first-order necessary conditions of optimality for this problem by computing the partial Frechet derivatives of the cost functional with respect to the energy and coupling matrices of the controller in frequency domain and state space. An infinitesimal equivalence between the risk-sensitive and weighted coherent quantum LQG control problems is also established. In addition to variational methods, we employ spectral factorizations and infinite cascades of auxiliary classical systems. Their truncations are applicable to numerical optimization algorithms (such as the gradient descent) for coherent quantum risk-sensitive feedback synthesis.
△ Less
Submitted 7 August, 2023;
originally announced August 2023.
-
Two-step feedback preparation of entanglement for qubit systems with time delay
Authors:
Yanan Liu,
Daoyi Dong,
Sen Kuang,
Ian R. Petersen,
Hidehiro Yonezawa
Abstract:
Quantum entanglement plays a fundamental role in quantum computation and quantum communication. Feedback control has been widely used in stochastic quantum systems to generate given entangled states since it has good robustness, where the time required to compute filter states and conduct filter based control usually cannot be ignored in many practical applications. This paper designed two control…
▽ More
Quantum entanglement plays a fundamental role in quantum computation and quantum communication. Feedback control has been widely used in stochastic quantum systems to generate given entangled states since it has good robustness, where the time required to compute filter states and conduct filter based control usually cannot be ignored in many practical applications. This paper designed two control strategies based on the Lyapunov method to prepare a class of entangled states for qubit systems with a constant delay time. The first one is bang bang like control strategy, which has a simple form with switching between a constant value and zero, the stability of which is proved. Another control strategy is switching Lyapunov control, where a constant delay time is introduced in the filter-based feedback control law to compensate for the computation time. Numerical results on a two qubit system illustrate the effectiveness of these two proposed control strategies.
△ Less
Submitted 26 July, 2023;
originally announced July 2023.
-
Fault-tolerant $H^\infty$ control for optical parametric oscillators with pum** fluctuations
Authors:
Yanan Liu,
Daoyi Dong,
Ian R. Petersen,
Hidehiro Yonezaw
Abstract:
Optical Parametric Oscillators (OPOs) have wide applications in quantum optics for generating squeezed states and develo** advanced technologies. When the phase or/and the amplitude of the pum** field for an OPO have fluctuations due to fault signals, time-varying uncertainties will be introduced in the dynamic parameters of the system. In this paper, we investigate how to design a fault-toler…
▽ More
Optical Parametric Oscillators (OPOs) have wide applications in quantum optics for generating squeezed states and develo** advanced technologies. When the phase or/and the amplitude of the pum** field for an OPO have fluctuations due to fault signals, time-varying uncertainties will be introduced in the dynamic parameters of the system. In this paper, we investigate how to design a fault-tolerant $H^\infty$ controller for an OPO with a disturbance input and time-varying uncertainties, which can achieve the required $H^\infty$ performance of the quantum system. We apply robust $H^\infty$ control theory to a quantum system, and design a passive controller and an active controller based on the solutions to two Riccati equations. The passive controller has a simple structure and is easy to be implemented by using only passive optical components, while the active quantum controller may achieve improved performance. The control performance of the proposed two controllers and one controller that was designed without consideration of system uncertainties is compared by numerical simulations in a specific OPO, and the results show that the designed controllers work effectively for fluctuations in both the phase and amplitude of the pum** field.
△ Less
Submitted 26 July, 2023;
originally announced July 2023.
-
A Robust Control Approach to Asymptotic Optimality of the Heavy Ball Method for Optimization of Quadratic Functions
Authors:
V. Ugrinovskii,
I. R. Petersen,
I. Shames
Abstract:
Among first order optimization methods, Polyak's heavy ball method has long been known to guarantee the asymptotic rate of convergence matching Nesterov's lower bound for functions defined in an infinite-dimensional space. In this paper, we use results on the robust gain margin of linear uncertain feedback control systems to show that the heavy ball method is provably worst-case asymptotically opt…
▽ More
Among first order optimization methods, Polyak's heavy ball method has long been known to guarantee the asymptotic rate of convergence matching Nesterov's lower bound for functions defined in an infinite-dimensional space. In this paper, we use results on the robust gain margin of linear uncertain feedback control systems to show that the heavy ball method is provably worst-case asymptotically optimal when applied to quadratic functions in a finite dimensional space.
△ Less
Submitted 11 May, 2023;
originally announced May 2023.
-
Strictly negative imaginary state feedback control for relative degree two systems
Authors:
James Dannatt,
Ian R. Petersen
Abstract:
In this paper, we present a strictly negative imaginary state feedback control methodology for relative degree two negative imaginary systems such as flexible structures with collocated sensors and actuators. We show that by augmenting a nominal model with a destabilising PID controller, we can apply state feedback control to the system, resulting in a strictly negative imaginary nominal closed lo…
▽ More
In this paper, we present a strictly negative imaginary state feedback control methodology for relative degree two negative imaginary systems such as flexible structures with collocated sensors and actuators. We show that by augmenting a nominal model with a destabilising PID controller, we can apply state feedback control to the system, resulting in a strictly negative imaginary nominal closed loop system with a prescribed degree of stability. Moreover, the overall system is guaranteed to be internally stable in the face of unmodelled spillover dynamics.
△ Less
Submitted 4 April, 2023;
originally announced April 2023.
-
A Coherent LQG approach to Quantum Equalization
Authors:
Rebbecca TY Thien,
Shanon L. Vuglar,
Ian R. Petersen
Abstract:
We propose a method to design a suboptimal, coherent quantum LQG controller to solve a quantum equalization problem. Our method involves reformulating the problem as a control problem and then designing a classical LQG controller and implementing it as a quantum system. Illustrative examples are included which demonstrate the algorithm for both active and passive systems, i.e., systems where the d…
▽ More
We propose a method to design a suboptimal, coherent quantum LQG controller to solve a quantum equalization problem. Our method involves reformulating the problem as a control problem and then designing a classical LQG controller and implementing it as a quantum system. Illustrative examples are included which demonstrate the algorithm for both active and passive systems, i.e., systems where the dynamics are described in terms of both position and momentum operators and systems with dynamics in terms of annihilation operators only.
△ Less
Submitted 3 April, 2023;
originally announced April 2023.
-
Nonlinear Negative Imaginary Systems with Switching
Authors:
Kanghong Shi,
Ian R. Petersen,
Igor G. Vladimirov
Abstract:
In this paper, we extend nonlinear negative imaginary (NI) systems theory to switched systems. Switched nonlinear NI systems and switched nonlinear output strictly negative imaginary (OSNI) systems are defined. We show that the interconnection of two switched nonlinear NI systems is still switched nonlinear NI. The interconnection of a switched nonlinear NI system and a switched nonlinear OSNI sys…
▽ More
In this paper, we extend nonlinear negative imaginary (NI) systems theory to switched systems. Switched nonlinear NI systems and switched nonlinear output strictly negative imaginary (OSNI) systems are defined. We show that the interconnection of two switched nonlinear NI systems is still switched nonlinear NI. The interconnection of a switched nonlinear NI system and a switched nonlinear OSNI system is asymptotically stable under some assumptions. This stability result is then illustrated using a numerical example.
△ Less
Submitted 2 April, 2023;
originally announced April 2023.
-
On the achievable degree of stability in strictly negative imaginary state feedback control
Authors:
James Dannatt,
Ian Petersen
Abstract:
In this paper we study the problem of determining the largest degree of stability that can be achieved for SISO systems using negative imaginary state feedback control. A state feedback result is given for synthesising a controller for a plant such that a given closed-loop transfer function is strictly negative imaginary with a prescribed degree of stability. By varying a parameter, the placement…
▽ More
In this paper we study the problem of determining the largest degree of stability that can be achieved for SISO systems using negative imaginary state feedback control. A state feedback result is given for synthesising a controller for a plant such that a given closed-loop transfer function is strictly negative imaginary with a prescribed degree of stability. By varying a parameter, the placement of the closed-loop system poles can be adjusted to give a prescribed degree of stability. We show the achievable degree of stability is related to the zero locations of the transfer function from the control input to the disturbance output of the nominal plant being controlled. Moreover, we offer results that outline the largest degree of stability that can be achieved for systems with distinct eigenvalues.
△ Less
Submitted 13 March, 2023;
originally announced March 2023.
-
Coherent quantum LQG controllers with Luenberger dynamics
Authors:
Igor G. Vladimirov,
Ian R. Petersen
Abstract:
This paper is concerned with the coherent quantum linear-quadratic-Gaussian control problem of minimising an infinite-horizon mean square cost for a measurement-free field-mediated interconnection of a quantum plant with a stabilising quantum controller. The plant and the controller are multimode open quantum harmonic oscillators, governed by linear quantum stochastic differential equations and co…
▽ More
This paper is concerned with the coherent quantum linear-quadratic-Gaussian control problem of minimising an infinite-horizon mean square cost for a measurement-free field-mediated interconnection of a quantum plant with a stabilising quantum controller. The plant and the controller are multimode open quantum harmonic oscillators, governed by linear quantum stochastic differential equations and coupled to each other and the external multichannel bosonic fields in the vacuum state. We discuss an interplay between the quantum physical realizability conditions and the Luenberger structure associated with the classical separation principle. This leads to a quadratic constraint on the controller gain matrices, which is formulated in the framework of a swap** transformation for the conjugate positions and momenta in the canonical representation of the controller variables. For the class of coherent quantum controllers with the Luenberger dynamics, we obtain first-order necessary conditions of optimality in the form of algebraic equations, involving a matrix-valued Lagrange multiplier.
△ Less
Submitted 13 November, 2022;
originally announced November 2022.
-
Competitive Equilibrium for Dynamic Multi-Agent Systems: Social Sha** and Price Trajectories
Authors:
Zeinab Salehi,
Yijun Chen,
Elizabeth L. Ratnam,
Ian R. Petersen,
Guodong Shi
Abstract:
In this paper, we consider dynamic multi-agent systems (MAS) for decentralized resource allocation. The MAS operates at a competitive equilibrium to ensure supply and demand are balanced. First, we investigate the MAS over a finite horizon. The utility functions of agents are parameterized to incorporate individual preferences. We shape individual preferences through a set of utility functions to…
▽ More
In this paper, we consider dynamic multi-agent systems (MAS) for decentralized resource allocation. The MAS operates at a competitive equilibrium to ensure supply and demand are balanced. First, we investigate the MAS over a finite horizon. The utility functions of agents are parameterized to incorporate individual preferences. We shape individual preferences through a set of utility functions to guarantee the resource price at a competitive equilibrium remains socially acceptable, i.e., the price is upper-bounded by an affordability threshold. We show this problem is solvable at the conceptual level. Next, we consider quadratic MAS and formulate the associated social sha** problem as a multi-agent linear quadratic regulator (LQR) problem which enables us to propose explicit utility sets using quadratic programming and dynamic programming. Then, a numerical algorithm is presented for calculating a tight range of the preference function parameters which guarantees a socially accepted price. We investigate the properties of a competitive equilibrium over an infinite horizon. Considering general utility functions, we show that under feasibility assumptions, any competitive equilibrium maximizes the social welfare. Then, we prove that for sufficiently small initial conditions, the social welfare maximization solution constitutes a competitive equilibrium with zero price. We also prove for general feasible initial conditions, there exists a time instant after which the optimal price, corresponding to a competitive equilibrium, becomes zero. Finally, we specifically focus on quadratic MAS and propose explicit results.
△ Less
Submitted 20 October, 2022;
originally announced October 2022.
-
Measuring decoherence by commutation relations decay for quasilinear quantum stochastic systems
Authors:
Igor G. Vladimirov,
Ian R. Petersen
Abstract:
This paper considers a class of open quantum systems with an algebraic structure of dynamic variables, including the Pauli matrices for finite-level systems as a particular case. The Hamiltonian and the operators of coupling of the system to the external bosonic fields depend linearly on the system variables. The fields are represented by quantum Wiener processes which drive the system dynamics in…
▽ More
This paper considers a class of open quantum systems with an algebraic structure of dynamic variables, including the Pauli matrices for finite-level systems as a particular case. The Hamiltonian and the operators of coupling of the system to the external bosonic fields depend linearly on the system variables. The fields are represented by quantum Wiener processes which drive the system dynamics in the form of a quasilinear Hudson-Parthasarathy quantum stochastic differential equation whose drift vector and dispersion matrix are affine and linear functions of the system variables. This quasilinearity leads to a tractable evolution of the two-point commutator matrix of the system variables (and their multi-point mixed moments in the case of vacuum input fields) involving time-ordered operator exponentials. The resulting exponential decay in the two-point commutation relations is a manifestation of quantum decoherence, caused by the dissipative system-field interaction and making the system lose specific unitary dynamics features which it would have in isolation from the environment. We quantify the decoherence in terms of the rate of the commutation relations decay and apply system theoretic and matrix analytic techniques, such as algebraic Lyapunov inequalities and spectrum perturbation results, to the study of the asymptotic behaviour of the related Lyapunov exponents in the presence of a small scaling parameter in the system-field coupling. These findings are illustrated for finite-level quantum systems (and their interconnections through a direct energy coupling) with multichannel external fields and the Pauli matrices as internal variables.
△ Less
Submitted 13 October, 2022;
originally announced October 2022.
-
Social Sha** of Dynamic Multi-Agent Systems over a Finite Horizon
Authors:
Zeinab Salehi,
Yijun Chen,
Ian R. Petersen,
Elizabeth L. Ratnam,
Guodong Shi
Abstract:
This paper studies self-sustained dynamic multiagent systems (MAS) for decentralized resource allocation operating at a competitive equilibrium over a finite horizon. The utility of resource consumption, along with the income from resource exchange, forms each agent's payoff which is aimed to be maximized. Each utility function is parameterized by individual preferences which can be designed by ag…
▽ More
This paper studies self-sustained dynamic multiagent systems (MAS) for decentralized resource allocation operating at a competitive equilibrium over a finite horizon. The utility of resource consumption, along with the income from resource exchange, forms each agent's payoff which is aimed to be maximized. Each utility function is parameterized by individual preferences which can be designed by agents independently. By sha** these preferences and proposing a set of utility functions, we can guarantee that the optimal resource price at the competitive equilibrium always remains socially acceptable, i.e., it never violates a given threshold that indicates affordability. First, we show this problem is solvable at the conceptual level under some convexity assumptions. Then, as a benchmark case, we consider quadratic MAS and formulate the associated social sha** problem as a multi-agent LQR problem which enables us to propose explicit utility sets using quadratic programming and dynamic programming. Finally, a numerical algorithm is presented for calculating the range of the preference function parameters which guarantee a socially accepted price. Some illustrative examples are given to examine the effectiveness of the proposed methods.
△ Less
Submitted 10 September, 2022;
originally announced September 2022.
-
A negative imaginary approach to hybrid integrator-gain system control
Authors:
Kanghong Shi,
Nastaran Nikooienejad,
Ian R. Petersen,
S. O. Reza Moheimani
Abstract:
In this paper, we show that a hybrid integrator-gain system (HIGS) is a nonlinear negative imaginary (NNI) system. We prove that the positive feedback interconnection of a linear negative imaginary (NI) system and a HIGS is asymptotically stable. We apply the HIGS to a MEMS nanopositioner, as an example of a linear NI system, in a single-input single-output framework. We analyze the stability and…
▽ More
In this paper, we show that a hybrid integrator-gain system (HIGS) is a nonlinear negative imaginary (NNI) system. We prove that the positive feedback interconnection of a linear negative imaginary (NI) system and a HIGS is asymptotically stable. We apply the HIGS to a MEMS nanopositioner, as an example of a linear NI system, in a single-input single-output framework. We analyze the stability and the performance of the closed-loop interconnection in both time and frequency domains through simulations and demonstrate the applicability of HIGS as an NNI controller to a linear NI system.
△ Less
Submitted 23 March, 2023; v1 submitted 5 September, 2022;
originally announced September 2022.
-
A J-spectral Factorization Condition for the Physical Realizability of a Transfer Function Matrix with only Direct Feedthrough Quantum Noise
Authors:
Rebbecca TY Thien,
Shanon L. Vuglar,
Ian R. Petersen
Abstract:
This paper gives a J-spectral factorization condition for the implementation of a strictly proper transfer function matrix as a physically realizable quantum system using only direct feedthrough quantum noise. A necessary frequency response condition is also presented. Examples are included to illustrate the main results.
This paper gives a J-spectral factorization condition for the implementation of a strictly proper transfer function matrix as a physically realizable quantum system using only direct feedthrough quantum noise. A necessary frequency response condition is also presented. Examples are included to illustrate the main results.
△ Less
Submitted 4 September, 2022;
originally announced September 2022.
-
Decoherence quantification through commutation relations decay for open quantum harmonic oscillators
Authors:
Igor G. Vladimirov,
Ian R. Petersen
Abstract:
This paper is concerned with multimode open quantum harmonic oscillators (OQHOs), described by linear quantum stochastic differential equations with multichannel external bosonic fields. We consider the exponentially fast decay in the two-point commutator matrix of the system variables as a manifestation of quantum decoherence. Such dissipative effects are caused by the interaction of the system w…
▽ More
This paper is concerned with multimode open quantum harmonic oscillators (OQHOs), described by linear quantum stochastic differential equations with multichannel external bosonic fields. We consider the exponentially fast decay in the two-point commutator matrix of the system variables as a manifestation of quantum decoherence. Such dissipative effects are caused by the interaction of the system with its environment and lead to a loss of specific features of the unitary evolution which the system would have in the case of isolated dynamics. These features are exploited as nonclassical resources in quantum computation and quantum information processing technologies. A system-theoretic definition of decoherence time in terms of the commutator matrix decay is discussed, and an upper bound for it is provided using algebraic Lyapunov inequalities. Employing spectrum perturbation techniques, we investigate the asymptotic behaviour of a related Lyapunov exponent for the oscillator when the system-field coupling is specified by a small coupling strength parameter and a given coupling shape matrix. The invariant quantum state of the system, driven by vacuum fields, in the weak-coupling limit is also studied. We illustrate the results for one- and two-mode oscillators with multichannel external fields and outline their application to a decoherence control problem for a feedback interconnection of OQHOs.
△ Less
Submitted 4 August, 2022;
originally announced August 2022.
-
On the regularization and optimization in quantum detector tomography
Authors:
Shuixin Xiao,
Yuanlong Wang,
Jun Zhang,
Daoyi Dong,
Shota Yokoyama,
Ian R. Petersen,
Hidehiro Yonezawa
Abstract:
Quantum detector tomography (QDT) is a fundamental technique for calibrating quantum devices and performing quantum engineering tasks. In this paper, we utilize regularization to improve the QDT accuracy whenever the probe states are informationally complete or informationally incomplete. In the informationally complete scenario, without regularization, we optimize the resource (probe state) distr…
▽ More
Quantum detector tomography (QDT) is a fundamental technique for calibrating quantum devices and performing quantum engineering tasks. In this paper, we utilize regularization to improve the QDT accuracy whenever the probe states are informationally complete or informationally incomplete. In the informationally complete scenario, without regularization, we optimize the resource (probe state) distribution by converting it to a semidefinite programming problem. Then in both the informationally complete and informationally incomplete scenarios, we discuss different regularization forms and prove the mean squared error scales as $ O(\frac{1}{N}) $ or tends to a constant with $ N $ state copies under the static assumption. We also characterize the ideal best regularization for the identifiable parameters, accounting for both the informationally complete and informationally incomplete scenarios. Numerical examples demonstrate the effectiveness of different regularization forms and a quantum optical experiment test shows that a suitable regularization form can reach a reduced mean squared error.
△ Less
Submitted 10 April, 2023; v1 submitted 21 July, 2022;
originally announced July 2022.
-
Negative Imaginary State Feedback Equivalence for a Class of Nonlinear Systems
Authors:
Kanghong Shi,
Ian R. Petersen,
Igor G. Vladimirov
Abstract:
In this paper, we investigate the necessary and sufficient conditions under which a class of nonlinear systems are state feedback equivalent to nonlinear negative imaginary (NI) systems with positive definite storage functions. The nonlinear systems of interest have a normal form of relative degree less than or equal to two. The nonlinearity of the system is restricted with respect to a subset of…
▽ More
In this paper, we investigate the necessary and sufficient conditions under which a class of nonlinear systems are state feedback equivalent to nonlinear negative imaginary (NI) systems with positive definite storage functions. The nonlinear systems of interest have a normal form of relative degree less than or equal to two. The nonlinearity of the system is restricted with respect to a subset of the state variables, which are the state variables that have external dynamics. Under mild assumptions, such systems are state feedback equivalent to nonlinear NI systems and nonlinear output strictly negative imaginary (OSNI) systems if and only if they are weakly minimum phase. Such a state feedback control approach can also asymptotically stabilize the systems in question against nonlinear OSNI system uncertainties. A numerical example is provided to show the process of the state feedback equivalence control and stabilization of uncertain systems.
△ Less
Submitted 7 June, 2022;
originally announced June 2022.
-
Covariance-analytic performance criteria, Hardy-Schatten norms and Wick-like ordering of cascaded systems
Authors:
Igor G. Vladimirov,
Ian R. Petersen
Abstract:
This paper is concerned with linear stochastic systems whose output is a stationary Gaussian random process related by an integral operator to a standard Wiener process at the input. We consider a performance criterion which involves the trace of an analytic function of the spectral density of the output process. This class of "covariance-analytic" cost functionals includes the usual mean square a…
▽ More
This paper is concerned with linear stochastic systems whose output is a stationary Gaussian random process related by an integral operator to a standard Wiener process at the input. We consider a performance criterion which involves the trace of an analytic function of the spectral density of the output process. This class of "covariance-analytic" cost functionals includes the usual mean square and risk-sensitive criteria as particular cases. Due to the presence of the "cost-sha**" analytic function, the performance criterion is related to higher-order Hardy-Schatten norms of the system transfer function. These norms have links with the asymptotic properties of cumulants of finite-horizon quadratic functionals of the system output and satisfy variational inequalities pertaining to system robustness to statistically uncertain inputs. In the case of strictly proper finite-dimensional systems, governed in state space by linear stochastic differential equations, we develop a method for recursively computing the Hardy-Schatten norms through a recently proposed technique of rearranging cascaded linear systems, which resembles the Wick ordering of annihilation and creation operators in quantum mechanics. The resulting computational procedure involves a recurrence sequence of solutions to algebraic Lyapunov equations and represents the covariance-analytic cost as the squared $\mathcal{H}_2$-norm of an auxiliary cascaded system. These results are also compared with an alternative approach which uses higher-order derivatives of stabilising solutions of parameter-dependent algebraic Riccati equations.
△ Less
Submitted 26 April, 2022;
originally announced April 2022.
-
Robust Fuzzy Q-Learning-Based Strictly Negative Imaginary Tracking Controllers for the Uncertain Quadrotor Systems
Authors:
Vu Phi Tran,
M. A Mabrok,
Sreenatha G. Anavatti,
Matthew A. Garratt,
Ian R. Petersen
Abstract:
Quadrotors are one of the popular unmanned aerial vehicles (UAVs) due to their versatility and simple design. However, the tuning of gains for quadrotor flight controllers can be laborious, and accurately stable control of trajectories can be difficult to maintain under exogenous disturbances and uncertain system parameters. This paper introduces a novel robust and adaptive control synthesis metho…
▽ More
Quadrotors are one of the popular unmanned aerial vehicles (UAVs) due to their versatility and simple design. However, the tuning of gains for quadrotor flight controllers can be laborious, and accurately stable control of trajectories can be difficult to maintain under exogenous disturbances and uncertain system parameters. This paper introduces a novel robust and adaptive control synthesis methodology for a quadrotor robot's attitude and altitude stabilization. The developed method is based on the fuzzy reinforcement learning and Strictly Negative Imaginary (SNI) property. The first stage of our control approach is to transform a nonlinear quadrotor system into an equivalent Negative-Imaginary (NI) linear model by means of the feedback linearization (FL) technique. The second phase is to design a control scheme that adapts online the Strictly Negative Imaginary (SNI) controller gains via fuzzy Q-learning, inspired by biological learning. The proposed controller does not require any prior training. The performance of the designed controller is compared with that of a fixed-gain SNI controller, a fuzzy-SNI controller, and a conventional PID controller in a series of numerical simulations. Furthermore, the stability of the proposed controller and the adaptive laws are proofed using the NI theorem.
△ Less
Submitted 25 March, 2022;
originally announced March 2022.
-
Making Nonlinear Systems Negative Imaginary via State Feedback
Authors:
Kanghong Shi,
Ian R. Petersen,
Igor G. Vladimirov
Abstract:
This paper provides a state feedback stabilization approach for nonlinear systems of relative degree less than or equal to two by rendering them nonlinear negative imaginary (NI) systems. Conditions are provided under which a nonlinear system can be made a nonlinear NI system or a nonlinear output strictly negative imaginary (OSNI) system. Roughly speaking, an affine nonlinear system that has a no…
▽ More
This paper provides a state feedback stabilization approach for nonlinear systems of relative degree less than or equal to two by rendering them nonlinear negative imaginary (NI) systems. Conditions are provided under which a nonlinear system can be made a nonlinear NI system or a nonlinear output strictly negative imaginary (OSNI) system. Roughly speaking, an affine nonlinear system that has a normal form with relative degree less than or equal to two, after possible output transformation, can be rendered nonlinear NI and nonlinear OSNI. In addition, if the internal dynamics of the normal form are input-to-state stable, then there exists a state feedback input that stabilizes the system. This stabilization result is then extended to achieve stability for systems with a nonlinear NI uncertainty.
△ Less
Submitted 5 September, 2022; v1 submitted 25 March, 2022;
originally announced March 2022.
-
Whiplash Gradient Descent Dynamics
Authors:
Subhransu S. Bhattacharjee,
Ian R. Petersen
Abstract:
In this paper, we propose the Whiplash Inertial Gradient dynamics, a closed-loop optimization method that utilises gradient information, to find the minima of a cost function in finite-dimensional settings. We introduce the symplectic asymptotic convergence analysis for the Whiplash system for convex functions. We also introduce relaxation sequences to explain the non-classical nature of the algor…
▽ More
In this paper, we propose the Whiplash Inertial Gradient dynamics, a closed-loop optimization method that utilises gradient information, to find the minima of a cost function in finite-dimensional settings. We introduce the symplectic asymptotic convergence analysis for the Whiplash system for convex functions. We also introduce relaxation sequences to explain the non-classical nature of the algorithm and an exploring heuristic variant of the Whiplash algorithm to escape saddle points, deterministically. We study the algorithm's performance for various costs and provide a practical methodology for analyzing convergence rates using integral constraint bounds and a novel Lyapunov rate method. Our results demonstrate polynomial and exponential rates of convergence for quadratic cost functions.
△ Less
Submitted 19 June, 2023; v1 submitted 4 March, 2022;
originally announced March 2022.
-
Global convergence and asymptotic optimality of the heavy ball method for a class of non-convex optimization problems
Authors:
Valery Ugrinovskii,
Ian R. Petersen,
Iman Shames
Abstract:
In this letter we revisit the famous heavy ball method and study its global convergence for a class of non-convex problems with sector-bounded gradient. We characterize the parameters that render the method globally convergent and yield the best $R$-convergence factor. We show that for this family of functions, this convergence factor is superior to the factor obtained from the triple momentum met…
▽ More
In this letter we revisit the famous heavy ball method and study its global convergence for a class of non-convex problems with sector-bounded gradient. We characterize the parameters that render the method globally convergent and yield the best $R$-convergence factor. We show that for this family of functions, this convergence factor is superior to the factor obtained from the triple momentum method.
△ Less
Submitted 24 March, 2022; v1 submitted 6 February, 2022;
originally announced February 2022.
-
Infinite-horizon risk-sensitive performance criteria for translation invariant networks of linear quantum stochastic systems
Authors:
Igor G. Vladimirov,
Ian R. Petersen
Abstract:
This paper is concerned with networks of identical linear quantum stochastic systems which interact with each other and external bosonic fields in a translation invariant fashion. The systems are associated with sites of a multidimensional lattice and are governed by coupled linear quantum stochastic differential equations (QSDEs). The block Toeplitz coefficients of these QSDEs are specified by th…
▽ More
This paper is concerned with networks of identical linear quantum stochastic systems which interact with each other and external bosonic fields in a translation invariant fashion. The systems are associated with sites of a multidimensional lattice and are governed by coupled linear quantum stochastic differential equations (QSDEs). The block Toeplitz coefficients of these QSDEs are specified by the energy and coupling matrices which quantify the Hamiltonian and coupling operators for the component systems. We discuss the invariant Gaussian quantum state of the network when it satisfies a stability condition and is driven by statistically independent vacuum fields. A quadratic-exponential functional (QEF) is considered as a risk-sensitive performance criterion for a finite fragment of the network over a bounded time interval. This functional involves a quadratic function of dynamic variables of the component systems with a block Toeplitz weighting matrix. Assuming the invariant state, we study the spatio-temporal asymptotic rate of the QEF per unit time and per lattice site in the thermodynamic limit of unboundedly growing time horizons and fragments of the lattice. A spatio-temporal frequency-domain formula is obtained for the QEF rate in terms of two spectral functions associated with the real and imaginary parts of the invariant quantum covariance kernel of the network variables. A homotopy method and asymptotic expansions for evaluating the QEF rate are also discussed.
△ Less
Submitted 4 February, 2022;
originally announced February 2022.
-
State-space computation of quadratic-exponential functional rates for linear quantum stochastic systems
Authors:
Igor G. Vladimirov,
Ian R. Petersen
Abstract:
This paper is concerned with infinite-horizon growth rates of quadratic-exponential functionals (QEFs) for linear quantum stochastic systems driven by multichannel bosonic fields. Such risk-sensitive performance criteria impose an exponential penalty on the integral of a quadratic function of the system variables, and their minimization improves robustness properties of the system with respect to…
▽ More
This paper is concerned with infinite-horizon growth rates of quadratic-exponential functionals (QEFs) for linear quantum stochastic systems driven by multichannel bosonic fields. Such risk-sensitive performance criteria impose an exponential penalty on the integral of a quadratic function of the system variables, and their minimization improves robustness properties of the system with respect to quantum statistical uncertainties and makes its behaviour more conservative in terms of tail distributions. We use a frequency-domain representation of the QEF growth rate for the invariant Gaussian quantum state of the system with vacuum input fields in order to compute it in state space. The QEF rate is related to a similar functional for a classical stationary Gaussian random process generated by an infinite cascade of linear systems. A truncation of this sha** filter allows the QEF rate to be computed with any accuracy by solving a recurrent sequence of algebraic Lyapunov equations together with an algebraic Riccati equation. The state-space computation of the QEF rate and its comparison with the frequency-domain results are demonstrated by a numerical example for an open quantum harmonic oscillator.
△ Less
Submitted 25 January, 2022;
originally announced January 2022.
-
Quantum estimation, control and learning: opportunities and challenges
Authors:
Daoyi Dong,
Ian R Petersen
Abstract:
The development of estimation and control theories for quantum systems is a fundamental task for practical quantum technology. This vision article presents a brief introduction to challenging problems and potential opportunities in the emerging areas of quantum estimation, control and learning. The topics cover quantum state estimation, quantum parameter identification, quantum filtering, quantum…
▽ More
The development of estimation and control theories for quantum systems is a fundamental task for practical quantum technology. This vision article presents a brief introduction to challenging problems and potential opportunities in the emerging areas of quantum estimation, control and learning. The topics cover quantum state estimation, quantum parameter identification, quantum filtering, quantum open-loop control, quantum feedback control, machine learning for estimation and control of quantum systems, and quantum machine learning.
△ Less
Submitted 15 January, 2022;
originally announced January 2022.
-
Negative Imaginary Systems Theory for Nonlinear Systems: A Dissipativity Approach
Authors:
Ahmed G. Ghallab,
Ian R. Petersen
Abstract:
Negative imaginary (NI) systems theory is a well-established system theoretic framework for analysis and design of linear-time-invariant (LTI) control systems. In this paper, we aim to generalize negative imaginary systems theory to a class of nonlinear systems. Based on the time domain interpretation of the NI property for LTI systems, a formal definition in terms of a dissipativity with an appro…
▽ More
Negative imaginary (NI) systems theory is a well-established system theoretic framework for analysis and design of linear-time-invariant (LTI) control systems. In this paper, we aim to generalize negative imaginary systems theory to a class of nonlinear systems. Based on the time domain interpretation of the NI property for LTI systems, a formal definition in terms of a dissipativity with an appropriate work rate will be used to define the nonlinear negative imaginary (NNI) property for a general nonlinear system. Mechanical systems with force actuators and position sensors are nonlinear negative imaginary according to this new definition. Using Lyapunov stability theory, we seek to establish a nonlinear generalization of the NI robust stability result for positive feedback interconnections of NNI systems. An example of a nonlinear mass-spring-damper system with force as input and displacement of the mass as output will be presented to illustrate the applicability of the NNI stability result. Furthermore, the case of NI systems with free motion will be investigated in the nonlinear domain based on the dissipativity framework of NNI systems.
△ Less
Submitted 1 January, 2022;
originally announced January 2022.
-
On how neural networks enhance quantum state tomography with constrained measurements
Authors:
Hailan Ma,
Daoyi Dong,
Ian R. Petersen,
Chang-Jiang Huang,
Guo-Yong Xiang
Abstract:
Quantum state tomography aiming at reconstructing the density matrix of a quantum state plays an important role in various emerging quantum technologies. Inspired by the intuition that machine learning has favorable robustness and generalization, we propose a deep neural networks based quantum state tomography (DNN-QST) approach, which are applied to three measurement-constrained cases, including…
▽ More
Quantum state tomography aiming at reconstructing the density matrix of a quantum state plays an important role in various emerging quantum technologies. Inspired by the intuition that machine learning has favorable robustness and generalization, we propose a deep neural networks based quantum state tomography (DNN-QST) approach, which are applied to three measurement-constrained cases, including few measurement copies and incomplete measurements as well as noisy measurements. Numerical results demonstrate that DNN-QST exhibits a great potential to achieve high fidelity for quantum state tomography with limited measurement resources and can achieve improved estimation when tomographic measurements suffer from noise. In addition, the results for 2-qubit states from quantum optical devices demonstrate the generalization of DNN-QST and its robustness against possible error in the experimental devices.
△ Less
Submitted 2 August, 2023; v1 submitted 17 November, 2021;
originally announced November 2021.
-
Social Sha** for Transactive Energy Systems
Authors:
Zeinab Salehi,
Yijun Chen,
Ian R. Petersen,
Elizabeth L. Ratnam,
Guodong Shi
Abstract:
This paper considers the problem of sha** agent utility functions in a transactive energy system to ensure the optimal energy price at a competitive equilibrium is always socially acceptable, that is, below a prescribed threshold. Agents in a distributed energy system aim to maximize their individual payoffs, as a combination of the utility of energy consumption and the income/expenditure from e…
▽ More
This paper considers the problem of sha** agent utility functions in a transactive energy system to ensure the optimal energy price at a competitive equilibrium is always socially acceptable, that is, below a prescribed threshold. Agents in a distributed energy system aim to maximize their individual payoffs, as a combination of the utility of energy consumption and the income/expenditure from energy exchange. The utility function of each agent is parameterized by individual preference vectors, with the overall system operating at competitive equilibriums. We show the social sha** problem of the proposed transactive energy system is conceptually captured by a set decision problem. The set of agent preferences that guarantees a socially acceptable price is characterized by an implicit algebraic equation for strictly concave and continuously differentiable utility functions. We also present two analytical solutions where tight ranges for the coefficients of linear-quadratic utilities and piece-wise linear utilities are established under which optimal pricing is proven to be always socially acceptable.
△ Less
Submitted 27 September, 2021;
originally announced September 2021.
-
Towards Online Optimization for Power Grids
Authors:
Deming Yuan,
Abhishek Bhardwaj,
Ian Petersen,
Elizabeth L. Ratnam,
Guodong Shi
Abstract:
In this note, we discuss potential advantages in extending distributed optimization frameworks to enhance support for power grid operators managing an influx of online sequential decisions. First, we review the state-of-the-art distributed optimization frameworks for electric power systems, and explain how distributed algorithms deliver scalable solutions. Next, we introduce key concepts and parad…
▽ More
In this note, we discuss potential advantages in extending distributed optimization frameworks to enhance support for power grid operators managing an influx of online sequential decisions. First, we review the state-of-the-art distributed optimization frameworks for electric power systems, and explain how distributed algorithms deliver scalable solutions. Next, we introduce key concepts and paradigms for online optimization, and present a distributed online optimization framework highlighting important performance characteristics. Finally, we discuss the connection and difference between offline and online distributed optimization, showcasing the suitability of such optimization techniques for power grid applications.
△ Less
Submitted 26 September, 2021;
originally announced September 2021.
-
Necessary and Sufficient Conditions for State Feedback Equivalence to Negative Imaginary Systems
Authors:
Kanghong Shi,
Ian R. Petersen,
Igor G. Vladimirov
Abstract:
In this paper, we present necessary and sufficient conditions under which a linear time-invariant (LTI) system is state feedback equivalent to a negative imaginary (NI) system. More precisely, we show that a minimal LTI strictly proper system can be rendered NI using full state feedback if and only if it can be output transformed into a system, which has relative degree less than or equal to two a…
▽ More
In this paper, we present necessary and sufficient conditions under which a linear time-invariant (LTI) system is state feedback equivalent to a negative imaginary (NI) system. More precisely, we show that a minimal LTI strictly proper system can be rendered NI using full state feedback if and only if it can be output transformed into a system, which has relative degree less than or equal to two and is weakly minimum phase. We also considered the problems of state feedback equivalence to output strictly negative imaginary systems and strongly strict negative imaginary systems. Then we apply the NI state feedback equivalence result to robustly stabilize an uncertain system with strictly negative imaginary uncertainty. An example is provided to illustrate the proposed results, for the purpose of stabilizing an uncertain system.
△ Less
Submitted 23 September, 2021;
originally announced September 2021.
-
A closed loop gradient descent algorithm applied to Rosenbrock's function
Authors:
Subhransu Bhattacharjee,
Ian Petersen
Abstract:
We introduce a novel adaptive dam** technique for an inertial gradient system which finds application as a gradient descent algorithm for unconstrained optimisation. In an example using the non-convex Rosenbrock's function, we show an improvement on existing momentum-based gradient optimisation methods. Also using Lyapunov stability analysis, we demonstrate the performance of the continuous-time…
▽ More
We introduce a novel adaptive dam** technique for an inertial gradient system which finds application as a gradient descent algorithm for unconstrained optimisation. In an example using the non-convex Rosenbrock's function, we show an improvement on existing momentum-based gradient optimisation methods. Also using Lyapunov stability analysis, we demonstrate the performance of the continuous-time version of the algorithm. Using numerical simulations, we consider the performance of its discrete-time counterpart obtained by using the symplectic Euler method of discretisation.
△ Less
Submitted 19 November, 2021; v1 submitted 29 August, 2021;
originally announced August 2021.