-
The HR-Calculus: Enabling Information Processing with Quaternion Algebra
Authors:
Danilo P. Mandic,
Sayed Pouria Talebi,
Clive Cheong Took,
Yili Xia,
Dongpo Xu,
Min Xiang,
Pauline Bourigault
Abstract:
From their inception, quaternions and their division algebra have proven to be advantageous in modelling rotation/orientation in three-dimensional spaces and have seen use from the initial formulation of electromagnetic filed theory through to forming the basis of quantum filed theory. Despite their impressive versatility in modelling real-world phenomena, adaptive information processing technique…
▽ More
From their inception, quaternions and their division algebra have proven to be advantageous in modelling rotation/orientation in three-dimensional spaces and have seen use from the initial formulation of electromagnetic filed theory through to forming the basis of quantum filed theory. Despite their impressive versatility in modelling real-world phenomena, adaptive information processing techniques specifically designed for quaternion-valued signals have only recently come to the attention of the machine learning, signal processing, and control communities. The most important development in this direction is introduction of the HR-calculus, which provides the required mathematical foundation for deriving adaptive information processing techniques directly in the quaternion domain. In this article, the foundations of the HR-calculus are revised and the required tools for deriving adaptive learning techniques suitable for dealing with quaternion-valued signals, such as the gradient operator, chain and product derivative rules, and Taylor series expansion are presented. This serves to establish the most important applications of adaptive information processing in the quaternion domain for both single-node and multi-node formulations. The article is supported by Supplementary Material, which will be referred to as SM.
△ Less
Submitted 28 November, 2023;
originally announced November 2023.
-
On the dynamics of multi agent nonlinear filtering and learning
Authors:
Sayed Pouria Talebi,
Danilo Mandic
Abstract:
Multiagent systems aim to accomplish highly complex learning tasks through decentralised consensus seeking dynamics and their use has garnered a great deal of attention in the signal processing and computational intelligence societies. This article examines the behaviour of multiagent networked systems with nonlinear filtering/learning dynamics. To this end, a general formulation for the actions o…
▽ More
Multiagent systems aim to accomplish highly complex learning tasks through decentralised consensus seeking dynamics and their use has garnered a great deal of attention in the signal processing and computational intelligence societies. This article examines the behaviour of multiagent networked systems with nonlinear filtering/learning dynamics. To this end, a general formulation for the actions of an agent in multiagent networked systems is presented and conditions for achieving a cohesive learning behaviour is given. Importantly, application of the so derived framework in distributed and federated learning scenarios are presented.
△ Less
Submitted 19 September, 2023; v1 submitted 7 September, 2023;
originally announced September 2023.
-
On Stability and Convergence of Distributed Filters
Authors:
Sayed Pouria Talebi,
Stefan Werner,
Vijay Gupta,
Yih-Fang Huang
Abstract:
Recent years have bore witness to the proliferation of distributed filtering techniques, where a collection of agents communicating over an ad-hoc network aim to collaboratively estimate and track the state of a system. These techniques form the enabling technology of modern multi-agent systems and have gained great importance in the engineering community. Although most distributed filtering techn…
▽ More
Recent years have bore witness to the proliferation of distributed filtering techniques, where a collection of agents communicating over an ad-hoc network aim to collaboratively estimate and track the state of a system. These techniques form the enabling technology of modern multi-agent systems and have gained great importance in the engineering community. Although most distributed filtering techniques come with a set of stability and convergence criteria, the conditions imposed are found to be unnecessarily restrictive. The paradigm of stability and convergence in distributed filtering is revised in this manuscript. Accordingly, a general distributed filter is constructed and its estimation error dynamics is formulated. The conducted analysis demonstrates that conditions for achieving stable filtering operations are the same as those required in the centralized filtering setting. Finally, the concepts are demonstrated in a Kalman filtering framework and validated using simulation examples.
△ Less
Submitted 22 February, 2021;
originally announced February 2021.
-
A Distributed Quaternion Kalman Filter With Applications to Fly-by-Wire Systems
Authors:
Sayed Pouria Talebi
Abstract:
The introduction of automated flight control and management systems have made possible aircraft designs that sacrifice arodynamic stability in order to incorporate stealth technology intro their shape, operate more efficiently, and are highly maneuverable. Therefore, modern flight management systems are reliant on multiple redundant sensors to monitor and control the rotations of the aircraft. To…
▽ More
The introduction of automated flight control and management systems have made possible aircraft designs that sacrifice arodynamic stability in order to incorporate stealth technology intro their shape, operate more efficiently, and are highly maneuverable. Therefore, modern flight management systems are reliant on multiple redundant sensors to monitor and control the rotations of the aircraft. To this end, a novel distributed quaternion Kalman filtering algorithm is developed for tracking the rotation and orientation of an aircraft in the three-dimensional space. The algorithm is developed to distribute computation among the sensors in a manner that forces them to consent to a unique solution while being robust to sensor and link failure, a desirable characteristic for flight management systems. In addition, the underlying quaternion-valued state space model allows to avoid problems associated with gimbal lock. The performance of the developed algorithm is verified through simulations.
△ Less
Submitted 21 July, 2016; v1 submitted 15 May, 2016;
originally announced May 2016.
-
On Distributed Frequency Estimation in Three-Phase Power Distribution Networks
Authors:
Sayed Pouria Talebi
Abstract:
The earlier work of the author on Frequency estimation in three-phase power systems ( that is included as the reference number 1) is expanded to the distributed setting in order present a framework for the implementation of such a frequency estimator in real-world power distribution networks. For rigor, the mean and mean square performance of the distributed frequency estimator is analysed. The pe…
▽ More
The earlier work of the author on Frequency estimation in three-phase power systems ( that is included as the reference number 1) is expanded to the distributed setting in order present a framework for the implementation of such a frequency estimator in real-world power distribution networks. For rigor, the mean and mean square performance of the distributed frequency estimator is analysed. The performance of the developed algorithm is validated through simulations on both synthetic data and real-world data recordings, where it is shown to outperform standard linear and the recently introduced widely liner frequency estimators.
△ Less
Submitted 14 March, 2016;
originally announced March 2016.
-
A Quaternion Frequency and Phasor Estimator for Three-Phase Power Distribution Networks
Authors:
Sayed Pouria Talebi,
Professor Danilo P. Mandic
Abstract:
For the first time quaternions have been used for real-time frequency estimation, where the multi-dimensional nature of quaternions allows for the full characterization of three-phase power systems. This is achieved through the use of quaternions to provide a unified framework for incorporating voltage measurements from all the phases of a three-phase system and then employing the recently introdu…
▽ More
For the first time quaternions have been used for real-time frequency estimation, where the multi-dimensional nature of quaternions allows for the full characterization of three-phase power systems. This is achieved through the use of quaternions to provide a unified framework for incorporating voltage measurements from all the phases of a three-phase system and then employing the recently introduced HR-calculus to derive a state space estimator based on the quaternion extended Kalman filter (QEKF). The components of the state space vector are designed such that they can be deployed for adaptive estimation of the system phasors. Finally, the proposed algorithm is validated through simulations using both synthetic and real-world data, which indicate that the developed quaternion frequency estimator can outperform its complex-valued counterparts.
△ Less
Submitted 7 March, 2016;
originally announced March 2016.
-
Frequency estimation in three-phase power systems with harmonic contamination: A multistage quaternion Kalman filtering approach
Authors:
Sayed Pouria Talebi,
Danilo P. Mandic
Abstract:
Motivated by the need for accurate frequency information, a novel algorithm for estimating the fundamental frequency and its rate of change in three-phase power systems is developed. This is achieved through two stages of Kalman filtering. In the first stage a quaternion extended Kalman filter, which provides a unified framework for joint modeling of voltage measurements from all the phases, is us…
▽ More
Motivated by the need for accurate frequency information, a novel algorithm for estimating the fundamental frequency and its rate of change in three-phase power systems is developed. This is achieved through two stages of Kalman filtering. In the first stage a quaternion extended Kalman filter, which provides a unified framework for joint modeling of voltage measurements from all the phases, is used to estimate the instantaneous phase increment of the three-phase voltages. The phase increment estimates are then used as observations of the extended Kalman filter in the second stage that accounts for the dynamic behavior of the system frequency and simultaneously estimates the fundamental frequency and its rate of change. The framework is then extended to account for the presence of harmonics. Finally, the concept is validated through simulation on both synthetic and real-world data.
△ Less
Submitted 8 March, 2016;
originally announced March 2016.