-
Hydraulic Parameter Estimation for District Heating Based on Laboratory Experiments
Authors:
Felix Agner,
Christian Møller Jensen,
Anders Rantzer,
Carsten Skovmose Kallesøe,
Rafal Wisniewski
Abstract:
In this paper we consider calibration of hydraulic models for district heating systems based on operational data. We extend previous theoretical work on the topic to handle real-world complications, namely unknown valve characteristics and hysteresis. We generate two datasets in the Smart Water Infrastructure laboratory in Aalborg, Denmark, on which we evaluate the proposed procedure. In the first…
▽ More
In this paper we consider calibration of hydraulic models for district heating systems based on operational data. We extend previous theoretical work on the topic to handle real-world complications, namely unknown valve characteristics and hysteresis. We generate two datasets in the Smart Water Infrastructure laboratory in Aalborg, Denmark, on which we evaluate the proposed procedure. In the first data set the system is controlled in such a way to excite all operational modes in terms of combinations of valve set-points. Here the best performing model predicted volume flow rates within roughly 5 and 10 \% deviation from the mean volume flow rate for the consumer with the highest and lowest mean volume flow rates respectively. This performance was met in the majority of the operational region. In the second data set, the system was controlled in order to mimic real load curves. The model trained on this data set performed similarly well when evaluated on data in the operational range represented in the training data. However, the model performance deteriorated when evaluated on data which was not represented in the training data.
△ Less
Submitted 1 July, 2024;
originally announced July 2024.
-
Feedback-Based Quantum Algorithm for Constrained Optimization Problems
Authors:
Salahuddin Abdul Rahman,
Özkan Karabacak,
Rafal Wisniewski
Abstract:
The feedback-based algorithm for quantum optimization \\(FALQON) has recently been proposed to solve quadratic unconstrained binary optimization problems. This paper efficiently generalizes FALQON to tackle quadratic constrained binary optimization (QCBO) problems. For this purpose, we introduce a new operator that encodes the problem's solution as its ground state. Using Lyapunov control theory,…
▽ More
The feedback-based algorithm for quantum optimization \\(FALQON) has recently been proposed to solve quadratic unconstrained binary optimization problems. This paper efficiently generalizes FALQON to tackle quadratic constrained binary optimization (QCBO) problems. For this purpose, we introduce a new operator that encodes the problem's solution as its ground state. Using Lyapunov control theory, we design a quantum control system such that the state converges to the ground state of this operator. When applied to the QCBO problem, we show that our proposed algorithm saves computational resources by reducing the depth of the quantum circuit and can perform better than FALQON. The effectiveness of our proposed algorithm is further illustrated through numerical simulations.
△ Less
Submitted 12 June, 2024;
originally announced June 2024.
-
Large Deviations in Safety-Critical Hamiltonian Systems with Probabilistic Initial Conditions
Authors:
Aitor R. Gomez,
Manuela L. Bujorianu,
Rafal Wisniewski
Abstract:
We address the problem of determining the least improbable deviations leading to an unsafe rare event in a weakly perturbed mechanical system with probabilistic initial conditions. These deviations are obtained as the solution to a variational problem formulated using rigorous approximation techniques grounded in the principles of large deviations theory. These types of results have been extended…
▽ More
We address the problem of determining the least improbable deviations leading to an unsafe rare event in a weakly perturbed mechanical system with probabilistic initial conditions. These deviations are obtained as the solution to a variational problem formulated using rigorous approximation techniques grounded in the principles of large deviations theory. These types of results have been extended to accommodate stochastic uncertainty in the initial states, which is a common assumption in mechanical systems. Furthermore, we demonstrate the applicability of the method by solving the problem for a rare collision event between two space objects, i.e. a high-dimensional and non-linear problem, resulting in the most likely sample paths leading to the realization of the unsafe rare event. The solution is validated against the necessary conditions for optimality derived from the maximum principle. Access to these unsafe sample paths offers relevant information regarding the dangerous configurations of rare events and can be used to design control strategies to reduce the probability of realization.
△ Less
Submitted 22 May, 2024;
originally announced May 2024.
-
Weighted Feedback-Based Quantum Algorithm for Excited States Calculation
Authors:
Salahuddin Abdul Rahman,
Özkan Karabacak,
Rafal Wisniewski
Abstract:
Drawing inspiration from the Lyapunov control technique for quantum systems, feedback-based quantum algorithms have been proposed for calculating the ground states of Hamiltonians. In this work, we consider extending these algorithms to tackle calculating excited states. Inspired by the weighted subspace-search variational quantum eigensolver algorithm, we propose a novel weighted feedback-based q…
▽ More
Drawing inspiration from the Lyapunov control technique for quantum systems, feedback-based quantum algorithms have been proposed for calculating the ground states of Hamiltonians. In this work, we consider extending these algorithms to tackle calculating excited states. Inspired by the weighted subspace-search variational quantum eigensolver algorithm, we propose a novel weighted feedback-based quantum algorithm for excited state calculation. We show that depending on how we design the weights and the feedback law, we can prepare the $p$th excited state or lowest energy states up to the $p$th excited state. Through an application in quantum chemistry, we show the effectiveness of the proposed algorithm, evaluating its efficacy via numerical simulations.
△ Less
Submitted 30 April, 2024;
originally announced April 2024.
-
A Hybrid Quantum-Classical Physics-Informed Neural Network Architecture for Solving Quantum Optimal Control Problems
Authors:
Nahid Binandeh Dehaghani,
A. Pedro Aguiar,
Rafal Wisniewski
Abstract:
This paper proposes an integrated quantum-classical approach that merges quantum computational dynamics with classical computing methodologies tailored to address control problems based on Pontryagin's minimum principle within a Physics-Informed Neural Network (PINN) framework. By leveraging a dynamic quantum circuit that combines Gaussian and non-Gaussian gates, the study showcases an innovative…
▽ More
This paper proposes an integrated quantum-classical approach that merges quantum computational dynamics with classical computing methodologies tailored to address control problems based on Pontryagin's minimum principle within a Physics-Informed Neural Network (PINN) framework. By leveraging a dynamic quantum circuit that combines Gaussian and non-Gaussian gates, the study showcases an innovative approach to optimizing quantum state manipulations. The proposed hybrid model effectively applies machine learning techniques to solve optimal control problems. This is illustrated through the design and implementation of a hybrid PINN network to solve a quantum state transition problem in a two and three-level system, highlighting its potential across various quantum computing applications.
△ Less
Submitted 23 April, 2024;
originally announced April 2024.
-
LLAMP: Assessing Network Latency Tolerance of HPC Applications with Linear Programming
Authors:
Siyuan Shen,
Langwen Huang,
Marcin Chrapek,
Timo Schneider,
Jai Dayal,
Manisha Gajbe,
Robert Wisniewski,
Torsten Hoefler
Abstract:
The shift towards high-bandwidth networks driven by AI workloads in data centers and HPC clusters has unintentionally aggravated network latency, adversely affecting the performance of communication-intensive HPC applications. As large-scale MPI applications often exhibit significant differences in their network latency tolerance, it is crucial to accurately determine the extent of network latency…
▽ More
The shift towards high-bandwidth networks driven by AI workloads in data centers and HPC clusters has unintentionally aggravated network latency, adversely affecting the performance of communication-intensive HPC applications. As large-scale MPI applications often exhibit significant differences in their network latency tolerance, it is crucial to accurately determine the extent of network latency an application can withstand without significant performance degradation. Current approaches to assessing this metric often rely on specialized hardware or network simulators, which can be inflexible and time-consuming. In response, we introduce LLAMP, a novel toolchain that offers an efficient, analytical approach to evaluating HPC applications' network latency tolerance using the LogGPS model and linear programming. LLAMP equips software developers and network architects with essential insights for optimizing HPC infrastructures and strategically deploying applications to minimize latency impacts. Through our validation on a variety of MPI applications like MILC, LULESH, and LAMMPS, we demonstrate our tool's high accuracy, with relative prediction errors generally below 2%. Additionally, we include a case study of the ICON weather and climate model to illustrate LLAMP's broad applicability in evaluating collective algorithms and network topologies.
△ Less
Submitted 22 April, 2024;
originally announced April 2024.
-
Feedback-Based Quantum Algorithm for Excited States Calculation
Authors:
Salahuddin Abdul Rahman,
Özkan Karabacak,
Rafal Wisniewski
Abstract:
Recently, feedback-based quantum algorithms have been introduced to calculate the ground states of Hamiltonians, inspired by quantum Lyapunov control theory. This paper aims to generalize these algorithms to the problem of calculating an eigenstate of a given Hamiltonian, assuming that the lower energy eigenstates are known. To this aim, we propose a new design methodology that combines the layer-…
▽ More
Recently, feedback-based quantum algorithms have been introduced to calculate the ground states of Hamiltonians, inspired by quantum Lyapunov control theory. This paper aims to generalize these algorithms to the problem of calculating an eigenstate of a given Hamiltonian, assuming that the lower energy eigenstates are known. To this aim, we propose a new design methodology that combines the layer-wise construction of the quantum circuit in feedback-based quantum algorithms with a new feedback law based on a new Lyapunov function to assign the quantum circuit parameters. We present two approaches for evaluating the circuit parameters: one based on the expectation and overlap estimation of the terms in the feedback law and another based on the gradient of the Lyapunov function. We demonstrate the algorithm through an illustrative example and through an application in quantum chemistry. To assess its performance, we conduct numerical simulations and execution on IBM's superconducting quantum computer.
△ Less
Submitted 6 April, 2024;
originally announced April 2024.
-
Enhancing Quantum Entanglement in Bipartite Systems: Leveraging Optimal Control and Physics-Informed Neural Networks
Authors:
Nahid Binandeh Dehaghani,
A. Pedro Aguiar,
Rafal Wisniewski
Abstract:
Quantum entanglement stands at the forefront of quantum information science, heralding new paradigms in quantum communication, computation, and cryptography. This paper introduces a quantum optimal control approach by focusing on entanglement measures rather than targeting predefined maximally entangled states. Leveraging the indirect Pontryagin Minimum Principle, we formulate an optimal control p…
▽ More
Quantum entanglement stands at the forefront of quantum information science, heralding new paradigms in quantum communication, computation, and cryptography. This paper introduces a quantum optimal control approach by focusing on entanglement measures rather than targeting predefined maximally entangled states. Leveraging the indirect Pontryagin Minimum Principle, we formulate an optimal control problem centered on maximizing an enhanced lower bound of the entanglement measure within a shortest timeframe in the presence of input constraints. We derive optimality conditions based on Pontryagin's Minimum Principle tailored for a matrix-valued dynamic control system and tackle the resulting boundary value problem through a Physics-Informed Neural Network, which is adept at handling differential matrix equations. The proposed strategy not only refines the process of generating entangled states but also introduces a method with increased sensitivity in detecting entangled states, thereby overcoming the limitations of conventional concurrence estimation.
△ Less
Submitted 24 March, 2024;
originally announced March 2024.
-
Safe Reinforcement Learning for Constrained Markov Decision Processes with Stochastic Stop** Time
Authors:
Abhijit Mazumdar,
Rafal Wisniewski,
Manuela L. Bujorianu
Abstract:
In this paper, we present an online reinforcement learning algorithm for constrained Markov decision processes with a safety constraint. Despite the necessary attention of the scientific community, considering stochastic stop** time, the problem of learning optimal policy without violating safety constraints during the learning phase is yet to be addressed. To this end, we propose an algorithm b…
▽ More
In this paper, we present an online reinforcement learning algorithm for constrained Markov decision processes with a safety constraint. Despite the necessary attention of the scientific community, considering stochastic stop** time, the problem of learning optimal policy without violating safety constraints during the learning phase is yet to be addressed. To this end, we propose an algorithm based on linear programming that does not require a process model. We show that the learned policy is safe with high confidence. We also propose a method to compute a safe baseline policy, which is central in develo** algorithms that do not violate the safety constraints. Finally, we provide simulation results to show the efficacy of the proposed algorithm. Further, we demonstrate that efficient exploration can be achieved by defining a subset of the state-space called proxy set.
△ Less
Submitted 23 March, 2024;
originally announced March 2024.
-
State Estimation and Control for Stochastic Quantum Dynamics with Homodyne Measurement: Stabilizing Qubits under Uncertainty
Authors:
Nahid Binandeh Dehaghani,
A. Pedro Aguiar,
Rafal Wisniewski
Abstract:
This paper introduces a Lyapunov-based control approach with homodyne measurement. We study two filtering approaches: (i) the traditional quantum filtering and (ii) a modified version of the extended Kalman filtering. We examine both methods in order to directly estimate the evolution of the coherence vector elements, using sequential homodyne current measurements. The latter case explicitly addre…
▽ More
This paper introduces a Lyapunov-based control approach with homodyne measurement. We study two filtering approaches: (i) the traditional quantum filtering and (ii) a modified version of the extended Kalman filtering. We examine both methods in order to directly estimate the evolution of the coherence vector elements, using sequential homodyne current measurements. The latter case explicitly addresses the dynamics of a stochastic master equation with correlated noise, transformed into a state-space representation, ensuring by construction the quantum properties of the estimated state variable. In addition, we consider the case where the quantum-mechanical Hamiltonian is unknown, and the system experiences uncertainties. In this case, we show as expected that both filters lose performance, exhibiting large expected estimation errors. To address this problem, we propose a simple multiple model estimation scheme that can be directly applied to any of the studied filters. We then reconstruct the estimated density operator \( \hatρ \), describing the full state of the system, and subject it to a control scheme. The proposed switching-based Lyapunov control scheme, which is fed with \( \hatρ \), guarantees noise-to-state practically stable in probability of the desired stationary target set with respect to the estimation error variance. We demonstrate our approach's efficacy in stabilizing a qubit coupled to a leaky cavity under homodyne detection in the presence of uncertainty in resonance frequency.
△ Less
Submitted 7 July, 2024; v1 submitted 9 March, 2024;
originally announced March 2024.
-
Online Parameter Estimation for Continuously Monitored Quantum Systems
Authors:
Henrik Glavind Clausen,
Pierre Rouchon,
Rafal Wisniewski
Abstract:
In this work, we consider the problem of online (real-time, single-shot) estimation of static or slow-varying parameters along quantum trajectories in quantum dynamical systems. Based on the measurement signal of a continuously-monitored quantum system, we propose a recursive algorithm for computing the maximum likelihood estimate of unknown parameters using an approach based on stochastic gradien…
▽ More
In this work, we consider the problem of online (real-time, single-shot) estimation of static or slow-varying parameters along quantum trajectories in quantum dynamical systems. Based on the measurement signal of a continuously-monitored quantum system, we propose a recursive algorithm for computing the maximum likelihood estimate of unknown parameters using an approach based on stochastic gradient ascent on the log-likelihood function. We formulate the algorithm in both discrete-time and continuous-time and illustrate the performance of the algorithm through simulations of a simple two-level system undergoing homodyne measurement from which we are able to track multiple parameters simultaneously.
△ Less
Submitted 18 June, 2024; v1 submitted 7 March, 2024;
originally announced March 2024.
-
Lyapunov Densities For Markov Processes: An Application To Quantum Systems With Non-Demolition Measurements
Authors:
Özkan Karabacak,
Horia Cornean,
Rafael Wisniewski
Abstract:
Stochastic convergence of discrete time Markov processes has been analysed based on a dual Lyapunov approach. Using some existing results on ergodic theory of Markov processes, it has been shown that existence of a properly subinvariant function (counterpart of the Lyapunov density in deterministic systems) implies swee** of a Markov process out of the sets where this function is integrable. Suc…
▽ More
Stochastic convergence of discrete time Markov processes has been analysed based on a dual Lyapunov approach. Using some existing results on ergodic theory of Markov processes, it has been shown that existence of a properly subinvariant function (counterpart of the Lyapunov density in deterministic systems) implies swee** of a Markov process out of the sets where this function is integrable. Such a function can be used as a certificate of convergence in probability of a stochastic system. We apply this technique to Markov processes induced by a quantum system with non-demolition measurement and propose dual Lyapunov certificates to certify swee**.
△ Less
Submitted 19 February, 2024;
originally announced February 2024.
-
PAC-Bayes Generalisation Bounds for Dynamical Systems Including Stable RNNs
Authors:
Deividas Eringis,
John Leth,
Zheng-Hua Tan,
Rafal Wisniewski,
Mihaly Petreczky
Abstract:
In this paper, we derive a PAC-Bayes bound on the generalisation gap, in a supervised time-series setting for a special class of discrete-time non-linear dynamical systems. This class includes stable recurrent neural networks (RNN), and the motivation for this work was its application to RNNs. In order to achieve the results, we impose some stability constraints, on the allowed models. Here, stabi…
▽ More
In this paper, we derive a PAC-Bayes bound on the generalisation gap, in a supervised time-series setting for a special class of discrete-time non-linear dynamical systems. This class includes stable recurrent neural networks (RNN), and the motivation for this work was its application to RNNs. In order to achieve the results, we impose some stability constraints, on the allowed models. Here, stability is understood in the sense of dynamical systems. For RNNs, these stability conditions can be expressed in terms of conditions on the weights. We assume the processes involved are essentially bounded and the loss functions are Lipschitz. The proposed bound on the generalisation gap depends on the mixing coefficient of the data distribution, and the essential supremum of the data. Furthermore, the bound converges to zero as the dataset size increases. In this paper, we 1) formalize the learning problem, 2) derive a PAC-Bayesian error bound for such systems, 3) discuss various consequences of this error bound, and 4) show an illustrative example, with discussions on computing the proposed bound. Unlike other available bounds the derived bound holds for non i.i.d. data (time-series) and it does not grow with the number of steps of the RNN.
△ Less
Submitted 15 December, 2023;
originally announced December 2023.
-
Online Model-free Safety Verification for Markov Decision Processes Without Safety Violation
Authors:
Abhijit Mazumdar,
Rafal Wisniewski,
Manuela L. Bujorianu
Abstract:
In this paper, we consider the problem of safety assessment for Markov decision processes without explicit knowledge of the model. We aim to learn probabilistic safety specifications associated with a given policy without compromising the safety of the process. To accomplish our goal, we characterize a subset of the state-space called proxy set, which contains the states that are near in a probabi…
▽ More
In this paper, we consider the problem of safety assessment for Markov decision processes without explicit knowledge of the model. We aim to learn probabilistic safety specifications associated with a given policy without compromising the safety of the process. To accomplish our goal, we characterize a subset of the state-space called proxy set, which contains the states that are near in a probabilistic sense to the forbidden set consisting of all unsafe states. We compute the safety function using the single-step temporal difference method. To this end, we relate the safety function computation to that of the value function estimation using temporal difference learning. Since the given control policy could be unsafe, we use a safe baseline subpolicy to generate data for learning. We then use an off-policy temporal difference learning method with importance sampling to learn the safety function corresponding to the given policy. Finally, we demonstrate our results using a numerical example
△ Less
Submitted 8 December, 2023;
originally announced December 2023.
-
Robust Correlated Equilibrium: Definition and Computation
Authors:
Rahul Misra,
Rafał Wisniewski,
Carsten Skovmose Kallesøe,
Manuela L. Bujorianu
Abstract:
We study N-player finite games with costs perturbed due to time-varying disturbances in the underlying system and to that end we propose the concept of Robust Correlated Equilibrium that generalizes the definition of Correlated Equilibrium. Conditions under which the Robust Correlated Equilibrium exists are specified and a decentralized algorithm for learning strategies that are optimal in the sen…
▽ More
We study N-player finite games with costs perturbed due to time-varying disturbances in the underlying system and to that end we propose the concept of Robust Correlated Equilibrium that generalizes the definition of Correlated Equilibrium. Conditions under which the Robust Correlated Equilibrium exists are specified and a decentralized algorithm for learning strategies that are optimal in the sense of Robust Correlated Equilibrium is proposed. The primary contribution of the paper is the convergence analysis of the algorithm and to that end, we propose an extension of the celebrated Blackwell's Approachability theorem to games with costs that are not just time-average as in the original Blackwell's Approachability Theorem but also include time-average of previous algorithm iterates. The designed algorithm is applied to a practical water distribution network with pumps being the controllers and their costs being perturbed by uncertain consumption by consumers. Simulation results show that each controller achieves no regret and empirical distributions converge to the Robust Correlated Equilibrium.
△ Less
Submitted 29 November, 2023;
originally announced November 2023.
-
Exploring Strange Entanglement: Experimental and Theoretical Perspectives on Neutral Kaon Systems
Authors:
Nahid Binandeh Dehaghani,
A. Pedro Aguiar,
Rafal Wisniewski
Abstract:
This chapter provides an in-depth analysis of the properties and phenomena associated with neutral K-mesons. Kaons are quantum systems illustrating strange behaviours. We begin by examining the significance of strangeness and charge parity violation in understanding these particles. The concept of strangeness oscillations is then introduced, explaining oscillations between $K^0$ and $\bar{K}^0$ st…
▽ More
This chapter provides an in-depth analysis of the properties and phenomena associated with neutral K-mesons. Kaons are quantum systems illustrating strange behaviours. We begin by examining the significance of strangeness and charge parity violation in understanding these particles. The concept of strangeness oscillations is then introduced, explaining oscillations between $K^0$ and $\bar{K}^0$ states. The regeneration of $K_S$ is investigated, uncovering the underlying mechanisms involved. The discussion moves on to quasi-spin space, exploring its bases and their implications. The entangled states of kaon pairs $(K^0,\bar K^0)$ are considered, with a focus on maximally entangled neutral kaons and non-maximally entangled states. Decoherence effects on entangled kaons are examined, utilizing the density matrix description to capture the dynamics. A dedicated decoherence parameter is introduced to quantify the impact of decoherence. Furthermore, the chapter investigates the loss of entanglement through measures such as Von Neumann entanglement entropy, entanglement of formation, and concurrence. These measures provide insights into quantifying and characterizing entanglement in the context of neutral kaons. Through this comprehensive exploration of properties, phenomena, and entanglement dynamics, this chapter aims to pointing out recent works on neutral kaons, contributing to advancements in particle physics.
△ Less
Submitted 19 July, 2023;
originally announced July 2023.
-
Measurement-Based Control for Minimizing Energy Functions in Quantum Systems
Authors:
Henrik Glavind Clausen,
Salahuddin Abdul Rahman,
Özkan Karabacak,
Rafal Wisniewski
Abstract:
In variational quantum algorithms (VQAs), the most common objective is to find the minimum energy eigenstate of a given energy Hamiltonian. In this paper, we consider the general problem of finding a sufficient control Hamiltonian structure that, under a given feedback control law, ensures convergence to the minimum energy eigenstate of a given energy function. By including quantum non-demolition…
▽ More
In variational quantum algorithms (VQAs), the most common objective is to find the minimum energy eigenstate of a given energy Hamiltonian. In this paper, we consider the general problem of finding a sufficient control Hamiltonian structure that, under a given feedback control law, ensures convergence to the minimum energy eigenstate of a given energy function. By including quantum non-demolition (QND) measurements in the loop, convergence to a pure state can be ensured from an arbitrary mixed initial state. Based on existing results on strict control Lyapunov functions, we formulate a semidefinite optimization problem, whose solution defines a non-unique control Hamiltonian, which is sufficient to ensure almost sure convergence to the minimum energy eigenstate under the given feedback law and the action of QND measurements. A numerical example is provided to showcase the proposed methodology.
△ Less
Submitted 18 April, 2023;
originally announced April 2023.
-
Quantum Pontryagin Neural Networks in Gamkrelidze Form Subjected to the Purity of Quantum Channels
Authors:
Nahid Binandeh Dehaghani,
A. Pedro Aguiar,
Rafal Wisniewski
Abstract:
We investigate a time and energy minimization optimal control problem for open quantum systems, whose dynamics is governed through the Lindblad (or Gorini-Kossakowski-Sudarshan-Lindblad) master equation. The dissipation is Markovian time-independent, and the control is governed by the Hamiltonian of a quantum-mechanical system. We are specifically interested to study the purity in a dissipative sy…
▽ More
We investigate a time and energy minimization optimal control problem for open quantum systems, whose dynamics is governed through the Lindblad (or Gorini-Kossakowski-Sudarshan-Lindblad) master equation. The dissipation is Markovian time-independent, and the control is governed by the Hamiltonian of a quantum-mechanical system. We are specifically interested to study the purity in a dissipative system constrained by state and control inputs. The idea for solving this problem is by the combination of two following techniques. We deal with the state constraints through Gamkrelidze revisited method, while handling control constraints through the idea of saturation functions and system extensions. This is the first time that quantum purity conservation is formulated in such framework. We obtain the necessary conditions of optimality through the Pontryagin Minimum Principle. Finally, the resulted boundary value problem is solved by a Physics-Informed Neural Network (PINN) approach. The exploited Pontryagin PINN technique is also new in quantum control context. We show that these PINNs play an effective role in learning optimal control actions.
△ Less
Submitted 4 June, 2023; v1 submitted 17 March, 2023;
originally announced April 2023.
-
PAC-Bayesian bounds for learning LTI-ss systems with input from empirical loss
Authors:
Deividas Eringis,
John Leth,
Zheng-Hua Tan,
Rafael Wisniewski,
Mihaly Petreczky
Abstract:
In this paper we derive a Probably Approxilmately Correct(PAC)-Bayesian error bound for linear time-invariant (LTI) stochastic dynamical systems with inputs. Such bounds are widespread in machine learning, and they are useful for characterizing the predictive power of models learned from finitely many data points. In particular, with the bound derived in this paper relates future average predictio…
▽ More
In this paper we derive a Probably Approxilmately Correct(PAC)-Bayesian error bound for linear time-invariant (LTI) stochastic dynamical systems with inputs. Such bounds are widespread in machine learning, and they are useful for characterizing the predictive power of models learned from finitely many data points. In particular, with the bound derived in this paper relates future average prediction errors with the prediction error generated by the model on the data used for learning. In turn, this allows us to provide finite-sample error bounds for a wide class of learning/system identification algorithms. Furthermore, as LTI systems are a sub-class of recurrent neural networks (RNNs), these error bounds could be a first step towards PAC-Bayesian bounds for RNNs.
△ Less
Submitted 29 March, 2023;
originally announced March 2023.
-
On Bellman's principle of optimality and Reinforcement learning for safety-constrained Markov decision process
Authors:
Rahul Misra,
Rafał Wisniewski,
Carsten Skovmose Kallesøe
Abstract:
We study optimality for the safety-constrained Markov decision process which is the underlying framework for safe reinforcement learning. Specifically, we consider a constrained Markov decision process (with finite states and finite actions) where the goal of the decision maker is to reach a target set while avoiding an unsafe set(s) with certain probabilistic guarantees. Therefore the underlying…
▽ More
We study optimality for the safety-constrained Markov decision process which is the underlying framework for safe reinforcement learning. Specifically, we consider a constrained Markov decision process (with finite states and finite actions) where the goal of the decision maker is to reach a target set while avoiding an unsafe set(s) with certain probabilistic guarantees. Therefore the underlying Markov chain for any control policy will be multichain since by definition there exists a target set and an unsafe set. The decision maker also has to be optimal (with respect to a cost function) while navigating to the target set. This gives rise to a multi-objective optimization problem. We highlight the fact that Bellman's principle of optimality may not hold for constrained Markov decision problems with an underlying multichain structure (as shown by the counterexample due to Haviv. We resolve the counterexample by formulating the aforementioned multi-objective optimization problem as a zero-sum game and thereafter construct an asynchronous value iteration scheme for the Lagrangian (similar to Shapley's algorithm). Finally, we consider the reinforcement learning problem for the same and construct a modified $Q$-learning algorithm for learning the Lagrangian from data. We also provide a lower bound on the number of iterations required for learning the Lagrangian and corresponding error bounds.
△ Less
Submitted 12 July, 2023; v1 submitted 25 February, 2023;
originally announced February 2023.
-
PAC-Bayesian-Like Error Bound for a Class of Linear Time-Invariant Stochastic State-Space Models
Authors:
Deividas Eringis,
John Leth,
Zheng-Hua Tan,
Rafal Wisniewski,
Mihaly Petreczky
Abstract:
In this paper we derive a PAC-Bayesian-Like error bound for a class of stochastic dynamical systems with inputs, namely, for linear time-invariant stochastic state-space models (stochastic LTI systems for short). This class of systems is widely used in control engineering and econometrics, in particular, they represent a special case of recurrent neural networks. In this paper we 1) formalize the…
▽ More
In this paper we derive a PAC-Bayesian-Like error bound for a class of stochastic dynamical systems with inputs, namely, for linear time-invariant stochastic state-space models (stochastic LTI systems for short). This class of systems is widely used in control engineering and econometrics, in particular, they represent a special case of recurrent neural networks. In this paper we 1) formalize the learning problem for stochastic LTI systems with inputs, 2) derive a PAC-Bayesian-Like error bound for such systems, 3) discuss various consequences of this error bound.
△ Less
Submitted 30 December, 2022;
originally announced December 2022.
-
Causal Inference on Win Ratio for Observational Data with Dependent Subjects
Authors:
Di Zhang,
Stephen R. Wisniewski,
Jong-Hyeon Jeong
Abstract:
Composite endpoints are commonly used with an anticipation that clinically relevant endpoints as a whole would yield meaningful treatment benefits. The win ratio is a rank-based statistic to summarize composite endpoints, allowing prioritizing the important components of the composite endpoints. Recent development in statistical inference for the win ratio statistic has been focusing on independen…
▽ More
Composite endpoints are commonly used with an anticipation that clinically relevant endpoints as a whole would yield meaningful treatment benefits. The win ratio is a rank-based statistic to summarize composite endpoints, allowing prioritizing the important components of the composite endpoints. Recent development in statistical inference for the win ratio statistic has been focusing on independent subjects without any potential confounding. When analyzing composite endpoints using observational data, one of the important challenges is confounding at baseline. Additionally, hierarchical observational data structures are commonly seen in practice, especially in multi-center studies with patients nesting within hospitals. Such hierarchical structure can introduce potential dependency or cluster effects among observations in the analysis. To address these two issues when using the win ratio statistic, we propose a weighted stratified causal win ratio estimator with calibrated weights. The calibrated weights create balanced patient-level covariates and cluster effect distributions between comparison groups. We conducted extensive simulation studies and showed promising performance of the proposed estimator in terms of bias, variance estimation, type I error and power analysis, regardless of the allocation of treatment assignments at baseline and intra-cluster correlations within clusters. Lastly, the proposed estimator was applied to an observational study among children with traumatic brain injury.
△ Less
Submitted 13 December, 2022;
originally announced December 2022.
-
Privacy-Preserving Distributed Expectation Maximization for Gaussian Mixture Model using Subspace Perturbation
Authors:
Qiongxiu Li,
Jaron Skovsted Gundersen,
Katrine Tjell,
Rafal Wisniewski,
Mads Græsbøll Christensen
Abstract:
Privacy has become a major concern in machine learning. In fact, the federated learning is motivated by the privacy concern as it does not allow to transmit the private data but only intermediate updates. However, federated learning does not always guarantee privacy-preservation as the intermediate updates may also reveal sensitive information. In this paper, we give an explicit information-theore…
▽ More
Privacy has become a major concern in machine learning. In fact, the federated learning is motivated by the privacy concern as it does not allow to transmit the private data but only intermediate updates. However, federated learning does not always guarantee privacy-preservation as the intermediate updates may also reveal sensitive information. In this paper, we give an explicit information-theoretical analysis of a federated expectation maximization algorithm for Gaussian mixture model and prove that the intermediate updates can cause severe privacy leakage. To address the privacy issue, we propose a fully decentralized privacy-preserving solution, which is able to securely compute the updates in each maximization step. Additionally, we consider two different types of security attacks: the honest-but-curious and eavesdrop** adversary models. Numerical validation shows that the proposed approach has superior performance compared to the existing approach in terms of both the accuracy and privacy level.
△ Less
Submitted 16 September, 2022;
originally announced September 2022.
-
Investigation of Alternative Measures for Mutual Information
Authors:
Bulut Kuskonmaz,
Jaron Skovsted Gundersen,
Rafal Wisniewski
Abstract:
Mutual information $I(X;Y)$ is a useful definition in information theory to estimate how much information the random variable $Y$ holds about the random variable $X$. One way to define the mutual information is by comparing the joint distribution of $X$ and $Y$ with the product of the marginals through the KL-divergence. If the two distributions are close to each other there will be almost no leak…
▽ More
Mutual information $I(X;Y)$ is a useful definition in information theory to estimate how much information the random variable $Y$ holds about the random variable $X$. One way to define the mutual information is by comparing the joint distribution of $X$ and $Y$ with the product of the marginals through the KL-divergence. If the two distributions are close to each other there will be almost no leakage of $X$ from $Y$ since the two variables are close to being independent. In the discrete setting the mutual information has the nice interpretation of how many bits $Y$ reveals about $X$ and if $I(X;Y)=H(X)$ (the Shannon entropy of $X$) then $X$ is completely revealed. However, in the continuous case we do not have the same reasoning. For instance the mutual information can be infinite in the continuous case. This fact enables us to try different metrics or divergences to define the mutual information. In this paper, we are evaluating different metrics or divergences such as Kullback-Liebler (KL) divergence, Wasserstein distance, Jensen-Shannon divergence and total variation distance to form alternatives to the mutual information in the continuous case. We deploy different methods to estimate or bound these metrics and divergences and evaluate their performances.
△ Less
Submitted 13 April, 2022; v1 submitted 2 February, 2022;
originally announced February 2022.
-
Algebraic Test for Asymptotic Stability of Periodic Orbits for Polynomial Systems
Authors:
Rafał Wisniewski,
Tom Nørgaard Jensen
Abstract:
We will address the problem of determining the existence and asymptotic stability of a non-trivial periodic orbit in dynamical systems described by polynomial vector fields. To this end, we will lean upon the celebrated results of Borg, Olech and Hartman and newer results of Giesl, who all employ the concept of contraction for this purpose. Importantly, we formulate a numerically tractable algebra…
▽ More
We will address the problem of determining the existence and asymptotic stability of a non-trivial periodic orbit in dynamical systems described by polynomial vector fields. To this end, we will lean upon the celebrated results of Borg, Olech and Hartman and newer results of Giesl, who all employ the concept of contraction for this purpose. Importantly, we formulate a numerically tractable algebraic test. The developed algorithm is illustrated in a numerical example.
△ Less
Submitted 11 December, 2021;
originally announced December 2021.
-
Secure PAC Bayesian Regression via Real Shamir Secret Sharing
Authors:
Jaron Skovsted Gundersen,
Bulut Kuskonmaz,
Rafael Wisniewski
Abstract:
A common approach of system identification and machine learning is to generate a model by using training data to predict the test data instances as accurate as possible. Nonetheless, concerns about data privacy are increasingly raised, but not always addressed. We present a secure protocol for learning a linear model relying on recently described technique called real number secret sharing. We tak…
▽ More
A common approach of system identification and machine learning is to generate a model by using training data to predict the test data instances as accurate as possible. Nonetheless, concerns about data privacy are increasingly raised, but not always addressed. We present a secure protocol for learning a linear model relying on recently described technique called real number secret sharing. We take as our starting point the PAC Bayesian bounds and deduce a closed form for the model parameters which depends on the data and the prior from the PAC Bayesian bounds. To obtain the model parameters one needs to solve a linear system. However, we consider the situation where several parties hold different data instances and they are not willing to give up the privacy of the data. Hence, we suggest to use real number secret sharing and multiparty computation to share the data and solve the linear regression in a secure way without violating the privacy of data. We suggest two methods; a secure inverse method and a secure Gaussian elimination method, and compare these methods at the end. The benefit of using secret sharing directly on real numbers is reflected in the simplicity of the protocols and the number of rounds needed. However, this comes with the drawback that a share might leak a small amount of information, but in our analysis we argue that the leakage is small.
△ Less
Submitted 17 April, 2023; v1 submitted 23 September, 2021;
originally announced September 2021.
-
Safe Dynamic Programming
Authors:
Rafal Wisniewski,
Manuela L. Bujorianu
Abstract:
We incorporate safety specifications into dynamic programming. Explicitly, we address the minimization problem of a Markov decision process up to a stop** time with safety constraints. To incorporate safety into dynamic programming, we establish a formalism leaning upon the evolution equation. We show how to compute the safety function with the method of dynamic programming. In the last part of…
▽ More
We incorporate safety specifications into dynamic programming. Explicitly, we address the minimization problem of a Markov decision process up to a stop** time with safety constraints. To incorporate safety into dynamic programming, we establish a formalism leaning upon the evolution equation. We show how to compute the safety function with the method of dynamic programming. In the last part of the paper, we develop several algorithms for safe dynamic programming.
△ Less
Submitted 7 September, 2021;
originally announced September 2021.
-
Explicit construction of the minimum error variance estimator for stochastic LTI state-space systems
Authors:
Deividas Eringis,
John Leth,
Zheng-Hua Tan,
Rafal Wisniewski,
Mihaly Petreczky
Abstract:
In this short article, we showcase the derivation of the optimal (minimum error variance) estimator, when one part of the stochastic LTI system output is not measured but is able to be predicted from the measured system outputs. Similar derivations have been done before but not using state-space representation.
In this short article, we showcase the derivation of the optimal (minimum error variance) estimator, when one part of the stochastic LTI system output is not measured but is able to be predicted from the measured system outputs. Similar derivations have been done before but not using state-space representation.
△ Less
Submitted 1 January, 2023; v1 submitted 6 September, 2021;
originally announced September 2021.
-
Privacy in Distributed Computations based on Real Number Secret Sharing
Authors:
Katrine Tjell,
Rafael Wisniewski
Abstract:
Privacy preservation in distributed computations is an important subject as digitization and new technologies enable collection and storage of vast amounts of data, including private data belonging to individuals. To this end, there is a need for a privacy preserving computation framework that minimises the leak of private information during computations while being efficient enough for practical…
▽ More
Privacy preservation in distributed computations is an important subject as digitization and new technologies enable collection and storage of vast amounts of data, including private data belonging to individuals. To this end, there is a need for a privacy preserving computation framework that minimises the leak of private information during computations while being efficient enough for practical usage. This paper presents a step towards such a framework with the proposal of a real number secret sharing scheme that works directly on real numbers without the need for conversion to integers which is the case in related schemes. The scheme offers computations like addition, multiplication, and division to be performed directly on secret shared data (the cipher text version of the data). Simulations show that the scheme is much more efficient in terms of accuracy than its counterpart version based on integers and finite field arithmetic. The drawback with the proposed scheme is that it is not perfectly secure. However, we provide a privacy analysis of the scheme, where we show that the leaked information can be upper bounded and asymptotically goes to zero. To demonstrate the scheme, we use it to perform Kalman filtering directly on secret shared data.
△ Less
Submitted 2 July, 2021;
originally announced July 2021.
-
PAC-Bayesian theory for stochastic LTI systems
Authors:
Deividas Eringis,
John Leth,
Zheng-Hua Tan,
Rafal Wisniewski,
Alireza Fakhrizadeh Esfahani,
Mihaly Petreczky
Abstract:
In this paper we derive a PAC-Bayesian error bound for autonomous stochastic LTI state-space models. The motivation for deriving such error bounds is that they will allow deriving similar error bounds for more general dynamical systems, including recurrent neural networks. In turn, PACBayesian error bounds are known to be useful for analyzing machine learning algorithms and for deriving new ones.
In this paper we derive a PAC-Bayesian error bound for autonomous stochastic LTI state-space models. The motivation for deriving such error bounds is that they will allow deriving similar error bounds for more general dynamical systems, including recurrent neural networks. In turn, PACBayesian error bounds are known to be useful for analyzing machine learning algorithms and for deriving new ones.
△ Less
Submitted 25 March, 2021; v1 submitted 23 March, 2021;
originally announced March 2021.
-
Privacy Preservation in Epidemic Data Collection
Authors:
Katrine Tjell,
Jaron Skovsted Gundersen,
Rafael Wisniewski
Abstract:
This work is inspired by the outbreak of COVID-19, and some of the challenges we have observed with gathering data about the disease. To this end, we aim to help collect data about citizens and the disease without risking the privacy of individuals. Specifically, we focus on how to determine the density of the population across the country, how to trace contact between citizens, how to determine t…
▽ More
This work is inspired by the outbreak of COVID-19, and some of the challenges we have observed with gathering data about the disease. To this end, we aim to help collect data about citizens and the disease without risking the privacy of individuals. Specifically, we focus on how to determine the density of the population across the country, how to trace contact between citizens, how to determine the location of infections, and how to determine the timeline of the spread of the disease. Our proposed methods are privacy-preserving and rely on an app to be voluntarily installed on citizens' smartphones. Thus, any individual can choose not to participate. However, the accurateness of the methods relies on the participation of a large percentage of the population.
△ Less
Submitted 30 April, 2020;
originally announced April 2020.
-
Model reduction of linear hybrid systems
Authors:
Ion Victor Gosea,
Mihaly Petreczky,
John Leth,
Rafael Wisniewski,
Athanasios C. Antoulas
Abstract:
The paper proposes a model reduction algorithm for linear hybrid systems, i.e., hybrid systems with externally induced discrete events, with linear continuous subsystems, and linear reset maps. The model reduction algorithm is based on balanced truncation. Moreover, the paper also proves an analytical error bound for the difference between the input-output behaviors of the original and the reduced…
▽ More
The paper proposes a model reduction algorithm for linear hybrid systems, i.e., hybrid systems with externally induced discrete events, with linear continuous subsystems, and linear reset maps. The model reduction algorithm is based on balanced truncation. Moreover, the paper also proves an analytical error bound for the difference between the input-output behaviors of the original and the reduced order model. This error bound is formulated in terms of singular values of the Gramians used for model reduction.
△ Less
Submitted 17 March, 2020;
originally announced March 2020.
-
Optimization and Positivity Certificates of Rational Functions using Bernstein Form
Authors:
Tareq Hamadneh,
Hassan Al-Zoubi,
Hamza Alzaareer,
Rafael Wisniewski
Abstract:
Rational functions of total degree $l$ in n variables have a representation in the Bernstein form defined over $n$ dimensional simplex. The range of a rational function is bounded by the smallest and the largest rational Bernstein coefficients over a simplex. Convergence properties of the bounds to the range are reviewed. Algebraic identities certifying the positivity of a given rational function…
▽ More
Rational functions of total degree $l$ in n variables have a representation in the Bernstein form defined over $n$ dimensional simplex. The range of a rational function is bounded by the smallest and the largest rational Bernstein coefficients over a simplex. Convergence properties of the bounds to the range are reviewed. Algebraic identities certifying the positivity of a given rational function over a simplex are given. Subsequently, a bound established in this work does not depend on the given dimension.
△ Less
Submitted 16 June, 2019;
originally announced June 2019.
-
On Robust Stability of Switched Systems in the Context of Filippov Solutions
Authors:
Mohamadreza Ahmadi,
Hamed Mojallali,
Rafael Wisniewski
Abstract:
The stability problem of a class of nonlinear switched systems defined on compact sets with state-dependent switching is considered. Instead of the Caratheodory solutions, the general Filippov solutions are studied. This encapsulates solutions with infinite switching in finite time and sliding modes in the neighborhood of the switching surfaces. In this regard, a Lyapunov-like stability theorem, b…
▽ More
The stability problem of a class of nonlinear switched systems defined on compact sets with state-dependent switching is considered. Instead of the Caratheodory solutions, the general Filippov solutions are studied. This encapsulates solutions with infinite switching in finite time and sliding modes in the neighborhood of the switching surfaces. In this regard, a Lyapunov-like stability theorem, based on the theory of differential inclusions, is formulated. Additionally, the results are extended to switched systems with simplical uncertainty. It is also demonstrated that, for the special case of polynomial switched systems defined on semi-algebraic sets, stability analysis can be checked based on sum of squares programming techniques.
△ Less
Submitted 28 July, 2017;
originally announced July 2017.
-
On the Almost Everywhere Stability of Discrete-Time Dynamical Systems
Authors:
Ozkan Karabacak,
Rafael Wisniewski,
John-Josef Leth
Abstract:
For a dynamical system, it is known that the existence of a Lyapunov-type density function, called Lyapunov density or Rantzer's density function, implies convergence of Lebesgue almost all solutions to an equilibrium. Using the duality between Frobenius-Perron and Koopmann operators, we generalize this result from equilibrium to invariant sets, both for continuous- and discrete-time. Furthermore,…
▽ More
For a dynamical system, it is known that the existence of a Lyapunov-type density function, called Lyapunov density or Rantzer's density function, implies convergence of Lebesgue almost all solutions to an equilibrium. Using the duality between Frobenius-Perron and Koopmann operators, we generalize this result from equilibrium to invariant sets, both for continuous- and discrete-time. Furthermore, some redundant assumptions that exist in the literature of almost everywhere stability for discrete-time, such as the local stability of the attractor and the compactness of the state space, has been removed.
△ Less
Submitted 9 March, 2018; v1 submitted 23 September, 2016;
originally announced September 2016.
-
Moment matching for bilinear systems with nice selections
Authors:
Mihály Petreczky,
Rafael Wisniewski,
John Leth
Abstract:
The paper develops a method for model reduction of bilinear control systems. It leans upon the observation that the input-output map of a bilinear system has a particularly simple Fliess series expansion. Subsequently, a model reduction algorithm is formulated such that the coefficients of Fliess series expansion for the original and reduced systems match up to certain predefined sets - nice selec…
▽ More
The paper develops a method for model reduction of bilinear control systems. It leans upon the observation that the input-output map of a bilinear system has a particularly simple Fliess series expansion. Subsequently, a model reduction algorithm is formulated such that the coefficients of Fliess series expansion for the original and reduced systems match up to certain predefined sets - nice selections. Algorithms for computing matrix representations of unobservability and reachability spaces complying with a nice selection are provided. Subsequently, they are used for calculating a partial realization of a given input-output map.
△ Less
Submitted 14 May, 2016;
originally announced May 2016.
-
Moment Matching Based Model Reduction for LPV State-Space Models
Authors:
Mert Bastug,
Mihaly Petreczky,
Roland Toth,
Rafael Wisniewski,
John Leth,
Denis Efimov
Abstract:
We present a novel algorithm for reducing the state dimension, i.e. order, of linear parameter varying (LPV) discrete-time state-space (SS) models with affine dependence on the scheduling variable. The input-output behavior of the reduced order model approximates that of the original model. In fact, for input and scheduling sequences of a certain length, the input-output behaviors of the reduced a…
▽ More
We present a novel algorithm for reducing the state dimension, i.e. order, of linear parameter varying (LPV) discrete-time state-space (SS) models with affine dependence on the scheduling variable. The input-output behavior of the reduced order model approximates that of the original model. In fact, for input and scheduling sequences of a certain length, the input-output behaviors of the reduced and original model coincide. The proposed method can also be interpreted as a reachability and observability reduction (minimization) procedure for LPV-SS representations with affine dependence.
△ Less
Submitted 14 August, 2015;
originally announced August 2015.
-
Stochastic Analysis of Synchronization in a Supermarket Refrigeration System
Authors:
John Leth,
Rafael Wisniewski,
Jakob Rasmussen,
Henrik Schioler
Abstract:
Display cases in supermarket systems often exhibit synchronization, in which the expansion valves in the display cases turn on and off at exactly the same time. The study of the influence of switching noise on synchronization in supermarket refrigeration systems is the subject matter of this work. For this purpose, we model it as a hybrid system, for which synchronization corresponds to a periodic…
▽ More
Display cases in supermarket systems often exhibit synchronization, in which the expansion valves in the display cases turn on and off at exactly the same time. The study of the influence of switching noise on synchronization in supermarket refrigeration systems is the subject matter of this work. For this purpose, we model it as a hybrid system, for which synchronization corresponds to a periodic trajectory. Subsequently, we investigate the influence of switching noise. We develop a statistical method for computing an intensity function, which measures how often the refrigeration system stays synchronized. By analyzing the intensity, we conclude that the increase in measurement uncertainty yields the decrease at the prevalence of synchronization.
△ Less
Submitted 24 January, 2015;
originally announced January 2015.
-
Proceedings 4th Workshop on Hybrid Autonomous Systems
Authors:
Manuela Bujorianu,
Rafael Wisniewski
Abstract:
The interest in autonomous systems is increasing both in industry and academia. Such systems must operate with limited human intervention in a changing environment and must be able to compensate for significant system failures without external intervention. The most appropriate models of autonomous systems can be found in the class of hybrid systems that interact with their environment. This works…
▽ More
The interest in autonomous systems is increasing both in industry and academia. Such systems must operate with limited human intervention in a changing environment and must be able to compensate for significant system failures without external intervention. The most appropriate models of autonomous systems can be found in the class of hybrid systems that interact with their environment. This workshop brings together researchers interested in all aspects of autonomy and resilience of hybrid systems.
△ Less
Submitted 22 January, 2015;
originally announced January 2015.
-
Fatigue Estimation Methods Comparison for Wind Turbine Control
Authors:
J. J. Barradas Berglind,
Rafael Wisniewski
Abstract:
Fatigue is a critical factor in structures as wind turbines exposed to harsh operating conditions, both in the design stage and control during their operation. In the present paper the most recognized approaches to estimate the damage caused by fatigue are discussed and compared, with special focus on their applicability for wind turbine control. The aim of this paper is to serve as a guide among…
▽ More
Fatigue is a critical factor in structures as wind turbines exposed to harsh operating conditions, both in the design stage and control during their operation. In the present paper the most recognized approaches to estimate the damage caused by fatigue are discussed and compared, with special focus on their applicability for wind turbine control. The aim of this paper is to serve as a guide among the vast literature on fatigue and shed some light on the underlying relationships between these methods.
△ Less
Submitted 14 November, 2014;
originally announced November 2014.
-
Modeling Populations of Thermostatic Loads with Switching Rate Actuation
Authors:
Luminita Cristiana Totu,
Rafael Wisniewski,
John Leth
Abstract:
We model thermostatic devices using a stochastic hybrid description, and introduce an external actuation mechanism that creates random switch events in the discrete dynamics. We then conjecture the form of the Fokker-Planck equation and successfully verify it numerically using Monte Carlo simulations. The actuation mechanism and subsequent modeling result are relevant for power system operation.
We model thermostatic devices using a stochastic hybrid description, and introduce an external actuation mechanism that creates random switch events in the discrete dynamics. We then conjecture the form of the Fokker-Planck equation and successfully verify it numerically using Monte Carlo simulations. The actuation mechanism and subsequent modeling result are relevant for power system operation.
△ Less
Submitted 24 January, 2015; v1 submitted 11 November, 2014;
originally announced November 2014.
-
Model Reduction of Linear Switched Systems by Restricting Discrete Dynamics
Authors:
Mert Bastug,
Mihaly Petreczky,
Rafael Wisniewski,
John Leth
Abstract:
We present a procedure for reducing the number of continuous states of discrete-time linear switched systems, such that the reduced system has the same behavior as the original system for a subset of switching sequences. The proposed method is expected to be useful for abstraction based control synthesis methods for hybrid systems.
We present a procedure for reducing the number of continuous states of discrete-time linear switched systems, such that the reduced system has the same behavior as the original system for a subset of switching sequences. The proposed method is expected to be useful for abstraction based control synthesis methods for hybrid systems.
△ Less
Submitted 11 September, 2014; v1 submitted 4 September, 2014;
originally announced September 2014.
-
Model Reduction by Moment Matching for Linear Switched Systems
Authors:
Mert Bastug,
Mihaly Petreczky,
Rafael Wisniewski,
John Leth
Abstract:
Two moment-matching methods for model reduction of linear switched systems (LSSs) are presented. The methods are similar to the Krylov subspace methods used for moment matching for linear systems. The more general one of the two methods, is based on the so called "nice selection" of some vectors in the reachability or observability space of the LSS. The underlying theory is closely related to the…
▽ More
Two moment-matching methods for model reduction of linear switched systems (LSSs) are presented. The methods are similar to the Krylov subspace methods used for moment matching for linear systems. The more general one of the two methods, is based on the so called "nice selection" of some vectors in the reachability or observability space of the LSS. The underlying theory is closely related to the (partial) realization theory of LSSs. In this paper, the connection of the methods to the realization theory of LSSs is provided, and algorithms are developed for the purpose of model reduction. Conditions for applicability of the methods for model reduction are stated and finally the results are illustrated on numerical examples.
△ Less
Submitted 29 January, 2015; v1 submitted 7 March, 2014;
originally announced March 2014.
-
Completeness of Lyapunov Abstraction
Authors:
Rafael Wisniewski,
Christoffer Sloth
Abstract:
In this work, we continue our study on discrete abstractions of dynamical systems. To this end, we use a family of partitioning functions to generate an abstraction. The intersection of sub-level sets of the partitioning functions defines cells, which are regarded as discrete objects. The union of cells makes up the state space of the dynamical systems. Our construction gives rise to a combinatori…
▽ More
In this work, we continue our study on discrete abstractions of dynamical systems. To this end, we use a family of partitioning functions to generate an abstraction. The intersection of sub-level sets of the partitioning functions defines cells, which are regarded as discrete objects. The union of cells makes up the state space of the dynamical systems. Our construction gives rise to a combinatorial object - a timed automaton. We examine sound and complete abstractions. An abstraction is said to be sound when the flow of the time automata covers the flow lines of the dynamical systems. If the dynamics of the dynamical system and the time automaton are equivalent, the abstraction is complete.
The commonly accepted paradigm for partitioning functions is that they ought to be transversal to the studied vector field. We show that there is no complete partitioning with transversal functions, even for particular dynamical systems whose critical sets are isolated critical points. Therefore, we allow the directional derivative along the vector field to be non-positive in this work. This considerably complicates the abstraction technique. For understanding dynamical systems, it is vital to study stable and unstable manifolds and their intersections. These objects appear naturally in this work. Indeed, we show that for an abstraction to be complete, the set of critical points of an abstraction function shall contain either the stable or unstable manifold of the dynamical system.
△ Less
Submitted 24 August, 2013;
originally announced August 2013.
-
Combinatorial Abstractions of Dynamical Systems
Authors:
Rafael Wisniewski
Abstract:
Formal verification has been successfully developed in computer science for verifying combinatorial classes of models and specifications. In like manner, formal verification methods have been developed for dynamical systems. However, the verification of system properties, such as safety, is based on reachability calculations, which are the sources of insurmountable complexity. This talk addresses…
▽ More
Formal verification has been successfully developed in computer science for verifying combinatorial classes of models and specifications. In like manner, formal verification methods have been developed for dynamical systems. However, the verification of system properties, such as safety, is based on reachability calculations, which are the sources of insurmountable complexity. This talk addresses indirect verification methods, which are based on abstracting the dynamical systems by models of reduced complexity and preserving central properties of the original systems.
△ Less
Submitted 24 August, 2013;
originally announced August 2013.
-
Balanced truncation for linear switched systems
Authors:
Mihaly Petreczky,
Rafael Wisniewski,
John Leth
Abstract:
In this paper, we present a theoretical analysis of the model reduction algorithm for linear switched systems. This algorithm is a reminiscence of the balanced truncation method for linear parameter varying systems. Specifically in this paper, we provide a bound on the approximation error in L2 norm for continuous-time and l2 norm for discrete-time linear switched systems. We provide a system theo…
▽ More
In this paper, we present a theoretical analysis of the model reduction algorithm for linear switched systems. This algorithm is a reminiscence of the balanced truncation method for linear parameter varying systems. Specifically in this paper, we provide a bound on the approximation error in L2 norm for continuous-time and l2 norm for discrete-time linear switched systems. We provide a system theoretic interpretation of grammians and their singular values. Furthermore, we show that the performance of bal- anced truncation depends only on the input-output map and not on the choice of the state-space representation. For a class of stable discrete-time linear switched systems (so called strongly stable systems), we define nice controllability and nice observability grammians, which are genuinely related to reachability and controllability of switched systems. In addition, we show that quadratic stability and LMI estimates of the L2 and l2 gains depend only on the input-output map.
△ Less
Submitted 15 March, 2013; v1 submitted 1 February, 2013;
originally announced February 2013.
-
Depth concentrations of deuterium ions implanted into some pure metals and alloys
Authors:
A. Yu. Didyk,
R. Wiśniewski,
K. Kitowski,
V. Kulikauskas,
T. Wilczynska,
A. A. Shiryaev,
Ya. V. Zubavichus
Abstract:
Pure metals (Cu, Ti, Zr, V, Pd) and diluted Pd-alloys (Pd-Ag, Pd-Pt, Pd-Ru, Pd-Rh) were implanted by 25 keV deuterium ions at fluences in the range (1.2÷2.3)x1022 D+/m2. The post-treatment depth distributions of deuterium ions were measured 10 days and three months after the implantation using Elastic Recoil Detection Analysis (ERDA) and Rutherford Backscattering (RBS). Comparison of the obtained…
▽ More
Pure metals (Cu, Ti, Zr, V, Pd) and diluted Pd-alloys (Pd-Ag, Pd-Pt, Pd-Ru, Pd-Rh) were implanted by 25 keV deuterium ions at fluences in the range (1.2÷2.3)x1022 D+/m2. The post-treatment depth distributions of deuterium ions were measured 10 days and three months after the implantation using Elastic Recoil Detection Analysis (ERDA) and Rutherford Backscattering (RBS). Comparison of the obtained results allowed to make conclusions about relative stability of deuterium and hydrogen gases in pure metals and diluted Pd alloys. Very high diffusion rates of implanted deuterium ions from V and Pd pure metals and Pd alloys were observed. Small-angle X-ray scattering revealed formation of nanosized defects in implanted corundum and titanium.
△ Less
Submitted 4 February, 2011;
originally announced February 2011.
-
Timed Game Abstraction of Control Systems
Authors:
Christoffer Sloth,
Rafael Wisniewski
Abstract:
This paper proposes a method for abstracting control systems by timed game automata, and is aimed at obtaining automatic controller synthesis.
The proposed abstraction is based on partitioning the state space of a control system using positive and negative invariant sets, generated by Lyapunov functions. This partitioning ensures that the vector field of the control system is transversal to the…
▽ More
This paper proposes a method for abstracting control systems by timed game automata, and is aimed at obtaining automatic controller synthesis.
The proposed abstraction is based on partitioning the state space of a control system using positive and negative invariant sets, generated by Lyapunov functions. This partitioning ensures that the vector field of the control system is transversal to the facets of the cells, which induces some desirable properties of the abstraction. To allow a rich class of control systems to be abstracted, the update maps of the timed game automaton are extended.
Conditions on the partitioning of the state space and the control are set up to obtain sound abstractions. Finally, an example is provided to demonstrate the method applied to a control problem related to navigation.
△ Less
Submitted 22 December, 2010;
originally announced December 2010.
-
Proofs for an Abstraction of Continuous Dynamical Systems Utilizing Lyapunov Functions
Authors:
Christoffer Sloth,
Rafael Wisniewski
Abstract:
In this report proofs are presented for a method for abstracting continuous dynamical systems by timed automata. The method is based on partitioning the state space of dynamical systems with invariant sets, which form cells representing locations of the timed automata.
To enable verification of the dynamical system based on the abstraction, conditions for obtaining sound, complete, and refinable…
▽ More
In this report proofs are presented for a method for abstracting continuous dynamical systems by timed automata. The method is based on partitioning the state space of dynamical systems with invariant sets, which form cells representing locations of the timed automata.
To enable verification of the dynamical system based on the abstraction, conditions for obtaining sound, complete, and refinable abstractions are set up.
It is proposed to partition the state space utilizing sub-level sets of Lyapunov functions, since they are positive invariant sets. The existence of sound abstractions for Morse-Smale systems and complete and refinable abstractions for linear systems are proved.
△ Less
Submitted 19 August, 2010;
originally announced August 2010.
