-
A Novel Micro-Doppler Coherence Loss for Deep Learning Radar Applications
Authors:
Mikolaj Czerkawski,
Christos Ilioudis,
Carmine Clemente,
Craig Michie,
Ivan Andonovic,
Christos Tachtatzis
Abstract:
Deep learning techniques are subject to increasing adoption for a wide range of micro-Doppler applications, where predictions need to be made based on time-frequency signal representations. Most, if not all, of the reported applications focus on translating an existing deep learning framework to this new domain with no adjustment made to the objective function. This practice results in a missed op…
▽ More
Deep learning techniques are subject to increasing adoption for a wide range of micro-Doppler applications, where predictions need to be made based on time-frequency signal representations. Most, if not all, of the reported applications focus on translating an existing deep learning framework to this new domain with no adjustment made to the objective function. This practice results in a missed opportunity to encourage the model to prioritize features that are particularly relevant for micro-Doppler applications. Thus the paper introduces a micro-Doppler coherence loss, minimized when the normalized power of micro-Doppler oscillatory components between input and output is matched. The experiments conducted on real data show that the application of the introduced loss results in models more resilient to noise.
△ Less
Submitted 12 April, 2024;
originally announced April 2024.
-
Non-invasive Diver Respiration Rate Monitoring in Hyperbaric Lifeboat Environments using Short-Range Radar
Authors:
Mikolaj Czerkawski,
Fraser Stewart,
Christos Ilioudis,
Craig Michie,
Ivan Andonovic,
Robert Atkinson,
Maurice Coull,
Donald Sandilands,
Gareth Kerr,
Carmine Clemente,
Christos Tachtatzis
Abstract:
The monitoring of diver health during emergency events is crucial to ensuring the safety of personnel. A non-invasive system continuously providing a measure of the respiration rate of individual divers is exceedingly beneficial in this context. The paper reports on the application of short-range radar to record the respiration rate of divers within hyperbaric lifeboat environments. Results demons…
▽ More
The monitoring of diver health during emergency events is crucial to ensuring the safety of personnel. A non-invasive system continuously providing a measure of the respiration rate of individual divers is exceedingly beneficial in this context. The paper reports on the application of short-range radar to record the respiration rate of divers within hyperbaric lifeboat environments. Results demonstrate that the respiratory motion can be extracted from the radar return signal applying routine signal processing. Further, evidence is provided that the radar-based approach yields a more accurate measure of respiration rate than an audio signal from a headset microphone. The system promotes an improvement in evacuation protocols under critical operational scenarios.
△ Less
Submitted 15 April, 2024;
originally announced April 2024.
-
On Models and Approaches for Human Vital Signs Extraction from Short Range Radar Signals
Authors:
Mikolaj Czerkawski,
Christos Ilioudis,
Carmine Clemente,
Craig Michie,
Ivan Andonovic,
Christos Tachtatzis
Abstract:
The paper centres on an assessment of the modelling approaches for the processing of signals in CW and FMCW radar-based systems for the detection of vital signs. It is shown that the use of the widely adopted phase extraction method, which relies on the approximation of the target as a single point scatterer, has limitations in respect of the simultaneous estimation of both respiratory and heart r…
▽ More
The paper centres on an assessment of the modelling approaches for the processing of signals in CW and FMCW radar-based systems for the detection of vital signs. It is shown that the use of the widely adopted phase extraction method, which relies on the approximation of the target as a single point scatterer, has limitations in respect of the simultaneous estimation of both respiratory and heart rates. A method based on a velocity spectrum is proposed as an alternative with the ability to treat a wider range of application scenarios.
△ Less
Submitted 15 April, 2024;
originally announced April 2024.
-
Interference Motion Removal for Doppler Radar Vital Sign Detection Using Variational Encoder-Decoder Neural Network
Authors:
Mikolaj Czerkawski,
Christos Ilioudis,
Carmine Clemente,
Craig Michie,
Ivan Andonovic,
Christos Tachtatzis
Abstract:
The treatment of interfering motion contributions remains one of the key challenges in the domain of radar-based vital sign monitoring. Removal of the interference to extract the vital sign contributions is demanding due to overlap** Doppler bands, the complex structure of the interference motions and significant variations in the power levels of their contributions. A novel approach to the remo…
▽ More
The treatment of interfering motion contributions remains one of the key challenges in the domain of radar-based vital sign monitoring. Removal of the interference to extract the vital sign contributions is demanding due to overlap** Doppler bands, the complex structure of the interference motions and significant variations in the power levels of their contributions. A novel approach to the removal of interference through the use of a probabilistic deep learning model is presented. Results show that a convolutional encoder-decoder neural network with a variational objective is capable of learning a meaningful representation space of vital sign Doppler-time distribution facilitating their extraction from a mixture signal. The approach is tested on semi-experimental data containing real vital sign signatures and simulated returns from interfering body motions. The application of the proposed network enhances the extraction of the micro-Doppler frequency corresponding to the respiration rate is demonstrated.
△ Less
Submitted 12 April, 2024;
originally announced April 2024.
-
Modelling of Networked Measuring Systems -- From White-Box Models to Data Based Approaches
Authors:
Klaus-Dieter Sommer,
Peter Harris,
Sascha Eichstädt,
Roland Füssl,
Tanja Dorst,
Andreas Schütze,
Michael Heizmann,
Nadine Schiering,
Andreas Maier,
Yuhui Luo,
Christos Tachtatzis,
Ivan Andonovic,
Gordon Gourlay
Abstract:
Mathematical modelling is at the core of metrology as it transforms raw measured data into useful measurement results. A model captures the relationship between the measurand and all relevant quantities on which the measurand depends, and is used to design measuring systems, analyse measured data, make inferences and predictions, and is the basis for evaluating measurement uncertainties. Tradition…
▽ More
Mathematical modelling is at the core of metrology as it transforms raw measured data into useful measurement results. A model captures the relationship between the measurand and all relevant quantities on which the measurand depends, and is used to design measuring systems, analyse measured data, make inferences and predictions, and is the basis for evaluating measurement uncertainties. Traditional modelling approaches are typically analytical, for example, based on principles of physics. But with the increasing use of digital technologies, large sensor networks and powerful computing hardware, these traditional approaches are being replaced more and more by data-driven methods. This paradigm shift holds true in particular for the digital future of measurement in all spheres of our lives and the environment, where data provided by large and complex interconnected systems of sensors are to be analysed. Additionally, there is a requirement for existing guidelines and standards in metrology to take the paradigm shift into account. In this paper we lay the foundation for the development from traditional to data-driven modelling approaches. We identify key aspects from traditional modelling approaches and discuss their transformation to data-driven modelling.
△ Less
Submitted 21 December, 2023;
originally announced December 2023.
-
Neural Weight Step Video Compression
Authors:
Mikolaj Czerkawski,
Javier Cardona,
Robert Atkinson,
Craig Michie,
Ivan Andonovic,
Carmine Clemente,
Christos Tachtatzis
Abstract:
A variety of compression methods based on encoding images as weights of a neural network have been recently proposed. Yet, the potential of similar approaches for video compression remains unexplored. In this work, we suggest a set of experiments for testing the feasibility of compressing video using two architectural paradigms, coordinate-based MLP (CbMLP) and convolutional network. Furthermore,…
▽ More
A variety of compression methods based on encoding images as weights of a neural network have been recently proposed. Yet, the potential of similar approaches for video compression remains unexplored. In this work, we suggest a set of experiments for testing the feasibility of compressing video using two architectural paradigms, coordinate-based MLP (CbMLP) and convolutional network. Furthermore, we propose a novel technique of neural weight step**, where subsequent frames of a video are encoded as low-entropy parameter updates. To assess the feasibility of the considered approaches, we will test the video compression performance on several high-resolution video datasets and compare against existing conventional and neural compression techniques.
△ Less
Submitted 2 December, 2021;
originally announced December 2021.
-
Neural Knitworks: Patched Neural Implicit Representation Networks
Authors:
Mikolaj Czerkawski,
Javier Cardona,
Robert Atkinson,
Craig Michie,
Ivan Andonovic,
Carmine Clemente,
Christos Tachtatzis
Abstract:
Coordinate-based Multilayer Perceptron (MLP) networks, despite being capable of learning neural implicit representations, are not performant for internal image synthesis applications. Convolutional Neural Networks (CNNs) are typically used instead for a variety of internal generative tasks, at the cost of a larger model. We propose Neural Knitwork, an architecture for neural implicit representatio…
▽ More
Coordinate-based Multilayer Perceptron (MLP) networks, despite being capable of learning neural implicit representations, are not performant for internal image synthesis applications. Convolutional Neural Networks (CNNs) are typically used instead for a variety of internal generative tasks, at the cost of a larger model. We propose Neural Knitwork, an architecture for neural implicit representation learning of natural images that achieves image synthesis by optimizing the distribution of image patches in an adversarial manner and by enforcing consistency between the patch predictions. To the best of our knowledge, this is the first implementation of a coordinate-based MLP tailored for synthesis tasks such as image inpainting, super-resolution, and denoising. We demonstrate the utility of the proposed technique by training on these three tasks. The results show that modeling natural images using patches, rather than pixels, produces results of higher fidelity. The resulting model requires 80% fewer parameters than alternative CNN-based solutions while achieving comparable performance and training time.
△ Less
Submitted 15 April, 2024; v1 submitted 29 September, 2021;
originally announced September 2021.
-
A Review of Cyber-Ranges and Test-Beds: Current and Future Trends
Authors:
Elochukwu Ukwandu,
Mohamed Amine Ben Farah,
Hanan Hindy,
David Brosset,
Dimitris Kavallieros,
Robert Atkinson,
Christos Tachtatzis,
Miroslav Bures,
Ivan Andonovic,
Xavier Bellekens
Abstract:
Cyber situational awareness has been proven to be of value in forming a comprehensive understanding of threats and vulnerabilities within organisations, as the degree of exposure is governed by the prevailing levels of cyber-hygiene and established processes. A more accurate assessment of the security provision informs on the most vulnerable environments that necessitate more diligent management.…
▽ More
Cyber situational awareness has been proven to be of value in forming a comprehensive understanding of threats and vulnerabilities within organisations, as the degree of exposure is governed by the prevailing levels of cyber-hygiene and established processes. A more accurate assessment of the security provision informs on the most vulnerable environments that necessitate more diligent management. The rapid proliferation in the automation of cyber-attacks is reducing the gap between information and operational technologies and the need to review the current levels of robustness against new sophisticated cyber-attacks, trends, technologies and mitigation countermeasures has become pressing. A deeper characterisation is also the basis with which to predict future vulnerabilities in turn guiding the most appropriate deployment technologies. Thus, refreshing established practices and the scope of the training to support the decision making of users and operators. The foundation of the training provision is the use of Cyber-Ranges (CRs) and Test-Beds (TBs), platforms/tools that help inculcate a deeper understanding of the evolution of an attack and the methodology to deploy the most impactful countermeasures to arrest breaches. In this paper, an evaluation of documented CR and TB platforms is evaluated. CRs and TBs are segmented by type, technology, threat scenarios, applications and the scope of attainable training. To enrich the analysis of documented CR and TB research and cap the study, a taxonomy is developed to provide a broader comprehension of the future of CRs and TBs. The taxonomy elaborates on the CRs/TBs different dimensions, as well as, highlighting a diminishing differentiation between application areas.
△ Less
Submitted 14 October, 2020;
originally announced October 2020.
-
Leveraging Siamese Networks for One-Shot Intrusion Detection Model
Authors:
Hanan Hindy,
Christos Tachtatzis,
Robert Atkinson,
David Brosset,
Miroslav Bures,
Ivan Andonovic,
Craig Michie,
Xavier Bellekens
Abstract:
The use of supervised Machine Learning (ML) to enhance Intrusion Detection Systems has been the subject of significant research. Supervised ML is based upon learning by example, demanding significant volumes of representative instances for effective training and the need to re-train the model for every unseen cyber-attack class. However, retraining the models in-situ renders the network susceptibl…
▽ More
The use of supervised Machine Learning (ML) to enhance Intrusion Detection Systems has been the subject of significant research. Supervised ML is based upon learning by example, demanding significant volumes of representative instances for effective training and the need to re-train the model for every unseen cyber-attack class. However, retraining the models in-situ renders the network susceptible to attacks owing to the time-window required to acquire a sufficient volume of data. Although anomaly detection systems provide a coarse-grained defence against unseen attacks, these approaches are significantly less accurate and suffer from high false-positive rates. Here, a complementary approach referred to as 'One-Shot Learning', whereby a limited number of examples of a new attack-class is used to identify a new attack-class (out of many) is detailed. The model grants a new cyber-attack classification without retraining. A Siamese Network is trained to differentiate between classes based on pairs similarities, rather than features, allowing to identify new and previously unseen attacks. The performance of a pre-trained model to classify attack-classes based only on one example is evaluated using three datasets. Results confirm the adaptability of the model in classifying unseen attacks and the trade-off between performance and the need for distinctive class representation.
△ Less
Submitted 5 November, 2022; v1 submitted 27 June, 2020;
originally announced June 2020.
-
Fusion of laser diffraction and chord length distribution data for estimation of particle size distribution using multi-objective optimisation
Authors:
Okpeafoh S. Agimelen,
Carla Ferreira,
Bilal Ahmed,
Javier Cardona,
Yi-chieh Chen,
Alastair J. Florence,
Ivan Andonovic,
Jan Sefcik,
Anthony J. Mulholland
Abstract:
The in situ measurement of the particle size distribution (PSD) of a suspension of particles presents huge challenges. Various effects from the process could introduce noise to the data from which the PSD is estimated. This in turn could lead to the occurrence of artificial peaks in the estimated PSD. Limitations in the models used in the PSD estimation could also lead to the occurrence of these a…
▽ More
The in situ measurement of the particle size distribution (PSD) of a suspension of particles presents huge challenges. Various effects from the process could introduce noise to the data from which the PSD is estimated. This in turn could lead to the occurrence of artificial peaks in the estimated PSD. Limitations in the models used in the PSD estimation could also lead to the occurrence of these artificial peaks. This could pose a significant challenge to in situ monitoring of particulate processes, as there will be no independent estimate of the PSD to allow a discrimination of the artificial peaks to be carried out.
Here, we present an algorithm which is capable of discriminating between artificial and true peaks in PSD estimates based on fusion of multiple data streams. In this case, chord length distribution and laser diffraction data have been used. The data fusion is done by means of multi-objective optimisation using the weighted sum approach. The algorithm is applied to two different particle suspensions. The estimated PSDs from the algorithm are compared with offline estimates of PSD from the Malvern Mastersizer and Morphologi G3. The results show that the algorithm is capable of eliminating an artificial peak in a PSD estimate when this artificial peak is sufficiently displaced from the true peak. However, when the artificial peak is too close to the true peak, it is only suppressed but not completely eliminated.
△ Less
Submitted 16 April, 2018;
originally announced April 2018.
-
Monitoring crystal breakage in wet milling processes using inline imaging and chord length distribution measurements
Authors:
Okpeafoh S. Agimelen,
Vaclav Svoboda,
Bilal Ahmed,
Javier Cardona,
Jerzy Dziewierz,
Cameron J. Brown,
Thomas McGlone,
Alison Cleary,
Christos Tachtatzis,
Craig Michie,
Alastair J. Florence,
Ivan Andonovic,
Anthony J. Mulholland,
Jan Sefcik
Abstract:
The success of the various secondary operations involved in the production of particulate products depends on the production of particles with a desired size and shape from a previous primary operation such as crystallisation. This is because these properties of size and shape affect the behaviour of the particles in the secondary processes. The size and the shape of the particles are very sensiti…
▽ More
The success of the various secondary operations involved in the production of particulate products depends on the production of particles with a desired size and shape from a previous primary operation such as crystallisation. This is because these properties of size and shape affect the behaviour of the particles in the secondary processes. The size and the shape of the particles are very sensitive to the conditions of the crystallisation processes, and so control of these processes is essential. This control requires the development of software tools that can effectively and efficiently process the sensor data captured in situ. However, these tools have various strengths and limitations depending on the process conditions and the nature of the particles.
In this work, we employ wet milling of crystalline particles as a case study of a process which produces effects typical to crystallisation processes. We study some of the strengths and limitations of our previously introduced tools for estimating the particle size distribution (PSD) and the aspect ratio from chord length distribution (CLD) and imaging data. We find situations where the CLD tool works better than the imaging tool and vice versa. However, in general both tools complement each other, and can therefore be employed in a suitable multi-objective optimisation approach to estimate PSD and aspect ratio.
△ Less
Submitted 27 March, 2017;
originally announced March 2017.