-
Explaining black boxes with a SMILE: Statistical Model-agnostic Interpretability with Local Explanations
Authors:
Koorosh Aslansefat,
Mojgan Hashemian,
Martin Walker,
Mohammed Naveed Akram,
Ioannis Sorokos,
Yiannis Papadopoulos
Abstract:
Machine learning is currently undergoing an explosion in capability, popularity, and sophistication. However, one of the major barriers to widespread acceptance of machine learning (ML) is trustworthiness: most ML models operate as black boxes, their inner workings opaque and mysterious, and it can be difficult to trust their conclusions without understanding how those conclusions are reached. Exp…
▽ More
Machine learning is currently undergoing an explosion in capability, popularity, and sophistication. However, one of the major barriers to widespread acceptance of machine learning (ML) is trustworthiness: most ML models operate as black boxes, their inner workings opaque and mysterious, and it can be difficult to trust their conclusions without understanding how those conclusions are reached. Explainability is therefore a key aspect of improving trustworthiness: the ability to better understand, interpret, and anticipate the behaviour of ML models. To this end, we propose SMILE, a new method that builds on previous approaches by making use of statistical distance measures to improve explainability while remaining applicable to a wide range of input data domains.
△ Less
Submitted 13 November, 2023;
originally announced November 2023.
-
Online Dynamic Reliability Evaluation of Wind Turbines based on Drone-assisted Monitoring
Authors:
Sohag Kabir,
Koorosh Aslansefat,
Prosanta Gope,
Felician Campean,
Yiannis Papadopoulos
Abstract:
The offshore wind energy is increasingly becoming an attractive source of energy due to having lower environmental impact. Effective operation and maintenance that ensures the maximum availability of the energy generation process using offshore facilities and minimal production cost are two key factors to improve the competitiveness of this energy source over other traditional sources of energy. C…
▽ More
The offshore wind energy is increasingly becoming an attractive source of energy due to having lower environmental impact. Effective operation and maintenance that ensures the maximum availability of the energy generation process using offshore facilities and minimal production cost are two key factors to improve the competitiveness of this energy source over other traditional sources of energy. Condition monitoring systems are widely used for health management of offshore wind farms to have improved operation and maintenance. Reliability of the wind farms are increasingly being evaluated to aid in the maintenance process and thereby to improve the availability of the farms. However, much of the reliability analysis is performed offline based on statistical data. In this article, we propose a drone-assisted monitoring based method for online reliability evaluation of wind turbines. A blade system of a wind turbine is used as an illustrative example to demonstrate the proposed approach.
△ Less
Submitted 23 November, 2022;
originally announced November 2022.
-
A Deep Learning Framework for Wind Turbine Repair Action Prediction Using Alarm Sequences and Long Short Term Memory Algorithms
Authors:
Connor Walker,
Callum Rothon,
Koorosh Aslansefat,
Yiannis Papadopoulos,
Nina Dethlefs
Abstract:
With an increasing emphasis on driving down the costs of Operations and Maintenance (O&M) in the Offshore Wind (OSW) sector, comes the requirement to explore new methodology and applications of Deep Learning (DL) to the domain. Condition-based monitoring (CBM) has been at the forefront of recent research develo** alarm-based systems and data-driven decision making. This paper provides a brief in…
▽ More
With an increasing emphasis on driving down the costs of Operations and Maintenance (O&M) in the Offshore Wind (OSW) sector, comes the requirement to explore new methodology and applications of Deep Learning (DL) to the domain. Condition-based monitoring (CBM) has been at the forefront of recent research develo** alarm-based systems and data-driven decision making. This paper provides a brief insight into the research being conducted in this area, with a specific focus on alarm sequence modelling and the associated challenges faced in its implementation. The paper proposes a novel idea to predict a set of relevant repair actions from an input sequence of alarm sequences, comparing Long Short-term Memory (LSTM) and Bidirectional LSTM (biLSTM) models. Achieving training accuracy results of up to 80.23%, and test accuracy results of up to 76.01% with biLSTM gives a strong indication to the potential benefits of the proposed approach that can be furthered in future research. The paper introduces a framework that integrates the proposed approach into O$\&$M procedures and discusses the potential benefits which include the reduction of a confusing plethora of alarms, as well as unnecessary vessel transfers to the turbines for fault diagnosis and correction.
△ Less
Submitted 26 July, 2022; v1 submitted 19 July, 2022;
originally announced July 2022.
-
SafeDrones: Real-Time Reliability Evaluation of UAVs using Executable Digital Dependable Identities
Authors:
Koorosh Aslansefat,
Panagiota Nikolaou,
Martin Walker,
Mohammed Naveed Akram,
Ioannis Sorokos,
Jan Reich,
Panayiotis Kolios,
Maria K. Michael,
Theocharis Theocharides,
Georgios Ellinas,
Daniel Schneider,
Yiannis Papadopoulos
Abstract:
The use of Unmanned Arial Vehicles (UAVs) offers many advantages across a variety of applications. However, safety assurance is a key barrier to widespread usage, especially given the unpredictable operational and environmental factors experienced by UAVs, which are hard to capture solely at design-time. This paper proposes a new reliability modeling approach called SafeDrones to help address this…
▽ More
The use of Unmanned Arial Vehicles (UAVs) offers many advantages across a variety of applications. However, safety assurance is a key barrier to widespread usage, especially given the unpredictable operational and environmental factors experienced by UAVs, which are hard to capture solely at design-time. This paper proposes a new reliability modeling approach called SafeDrones to help address this issue by enabling runtime reliability and risk assessment of UAVs. It is a prototype instantiation of the Executable Digital Dependable Identity (EDDI) concept, which aims to create a model-based solution for real-time, data-driven dependability assurance for multi-robot systems. By providing real-time reliability estimates, SafeDrones allows UAVs to update their missions accordingly in an adaptive manner.
△ Less
Submitted 12 July, 2022;
originally announced July 2022.
-
DEIS: Dependability Engineering Innovation for Industrial CPS
Authors:
Erik Armengaud,
Georg Macher,
Alexander Massoner,
Sebastian Frager,
Rasmus Adler,
Daniel Schneider,
Simone Longo,
Massimiliano Melis,
Riccardo Groppo,
Federica Villa,
Padraig OLeary,
Kevin Bambury,
Finnegan Anita,
Marc Zeller,
Kai Hoefig,
Yiannis Papadopoulos,
Richard Hawkins,
Tim Kelly
Abstract:
The open and cooperative nature of Cyber-Physical Systems (CPS) poses new challenges in assuring dependability. The DEIS project (Dependability Engineering Innovation for automotive CPS. This project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 732242, see http://www.deis-project.eu) addresses these challenges by develo**…
▽ More
The open and cooperative nature of Cyber-Physical Systems (CPS) poses new challenges in assuring dependability. The DEIS project (Dependability Engineering Innovation for automotive CPS. This project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 732242, see http://www.deis-project.eu) addresses these challenges by develo** technologies that form a science of dependable system integration. In the core of these technologies lies the concept of a Digital Dependability Identity (DDI) of a component or system. DDIs are modular, composable, and executable in the field facilitating (a) efficient synthesis of component and system dependability information over the supply chain and (b) effective evaluation of this information in-the-field for safe and secure composition of highly distributed and autonomous CPS. The paper outlines the DDI concept and opportunities for application in four industrial use cases.
△ Less
Submitted 3 June, 2021;
originally announced June 2021.
-
WAP: Digital Dependability Identities
Authors:
Daniel Schneider,
Mario Trapp,
Yiannis Papadopoulos,
Eric Armengaud,
Marc Zeller,
Kai Hoefig
Abstract:
Cyber-Physical Systems (CPS) provide enormous potential for innovation but a precondition for this is that the issue of dependability has been addressed. This paper presents the concept of a Digital Dependability Identity (DDI) of a component or system as foundation for assuring the dependability of CPS. A DDI is an analyzable and potentially executable model of information about the dependability…
▽ More
Cyber-Physical Systems (CPS) provide enormous potential for innovation but a precondition for this is that the issue of dependability has been addressed. This paper presents the concept of a Digital Dependability Identity (DDI) of a component or system as foundation for assuring the dependability of CPS. A DDI is an analyzable and potentially executable model of information about the dependability of a component or system. We argue that DDIs must fulfill a number of properties including being universally useful across supply chains, enabling off-line certification of systems where possible, and providing capabilities for in-field certification of safety of CPS. In this paper, we focus on system safety as one integral part of dependability and as a practical demonstration of the concept, we present an initial implementation of DDIs in the form of Conditional Safety Certificates (also known as ConSerts). We explain ConSerts and their practical operationalization based on an illustrative example.
△ Less
Submitted 31 May, 2021;
originally announced May 2021.
-
SafeML: Safety Monitoring of Machine Learning Classifiers through Statistical Difference Measure
Authors:
Koorosh Aslansefat,
Ioannis Sorokos,
Declan Whiting,
Ramin Tavakoli Kolagari,
Yiannis Papadopoulos
Abstract:
Ensuring safety and explainability of machine learning (ML) is a topic of increasing relevance as data-driven applications venture into safety-critical application domains, traditionally committed to high safety standards that are not satisfied with an exclusive testing approach of otherwise inaccessible black-box systems. Especially the interaction between safety and security is a central challen…
▽ More
Ensuring safety and explainability of machine learning (ML) is a topic of increasing relevance as data-driven applications venture into safety-critical application domains, traditionally committed to high safety standards that are not satisfied with an exclusive testing approach of otherwise inaccessible black-box systems. Especially the interaction between safety and security is a central challenge, as security violations can lead to compromised safety. The contribution of this paper to addressing both safety and security within a single concept of protection applicable during the operation of ML systems is active monitoring of the behaviour and the operational context of the data-driven system based on distance measures of the Empirical Cumulative Distribution Function (ECDF). We investigate abstract datasets (XOR, Spiral, Circle) and current security-specific datasets for intrusion detection (CICIDS2017) of simulated network traffic, using distributional shift detection measures including the Kolmogorov-Smirnov, Kuiper, Anderson-Darling, Wasserstein and mixed Wasserstein-Anderson-Darling measures. Our preliminary findings indicate that the approach can provide a basis for detecting whether the application context of an ML component is valid in the safety-security. Our preliminary code and results are available at https://github.com/ISorokos/SafeML.
△ Less
Submitted 27 May, 2020;
originally announced May 2020.
-
Failure Mode Reasoning in Model Based Safety Analysis
Authors:
Hamid Jahanian,
David Parker,
Marc Zeller,
Annabelle McIver,
Yiannis Papadopoulos
Abstract:
Failure Mode Reasoning (FMR) is a novel approach for analyzing failure in a Safety Instrumented System (SIS). The method uses an automatic analysis of an SIS program to calculate potential failures in parts of the SIS. In this paper we use a case study from the power industry to demonstrate how FMR can be utilized in conjunction with other model-based safety analysis methods, such as HiP-HOPS and…
▽ More
Failure Mode Reasoning (FMR) is a novel approach for analyzing failure in a Safety Instrumented System (SIS). The method uses an automatic analysis of an SIS program to calculate potential failures in parts of the SIS. In this paper we use a case study from the power industry to demonstrate how FMR can be utilized in conjunction with other model-based safety analysis methods, such as HiP-HOPS and CFT, in order to achieve a comprehensive safety analysis of SIS. In this case study, FMR covers the analysis of SIS inputs while HiP-HOPS/CFT models the faults of logic solver and final elements. The SIS program is analyzed by FMR and the results are exported to HiP-HOPS/CFT via automated interfaces. The final outcome is the collective list of SIS failure modes along with their reliability measures. We present and review the results from both qualitative and quantitative perspectives.
△ Less
Submitted 19 July, 2020; v1 submitted 11 May, 2020;
originally announced May 2020.
-
PeSOA: Penguins Search Optimisation Algorithm for Global Optimisation Problems
Authors:
Youcef Gheraibia,
Abdelouahab Moussaoui,
Peng-Yeng Yin,
Yiannis Papadopoulos,
Smaine Maazouzi
Abstract:
This paper develops Penguin search Optimisation Algorithm (PeSOA), a new metaheuristic algorithm which is inspired by the foraging behaviours of penguins. A population of penguins located in the solution space of the given search and optimisation problem is divided into groups and tasked with finding optimal solutions. The penguins of a group perform simultaneous dives and work as a team to collab…
▽ More
This paper develops Penguin search Optimisation Algorithm (PeSOA), a new metaheuristic algorithm which is inspired by the foraging behaviours of penguins. A population of penguins located in the solution space of the given search and optimisation problem is divided into groups and tasked with finding optimal solutions. The penguins of a group perform simultaneous dives and work as a team to collaboratively feed on fish the energy content of which corresponds to the fitness of candidate solutions. Fish stocks have higher fitness and concentration near areas of solution optima and thus drive the search. Penguins can migrate to other places if their original habitat lacks food. We identify two forms of penguin communication both intra-group and inter-group which are useful in designing intensification and diversification strategies. An efficient intensification strategy allows fast convergence to a local optimum, whereas an effective diversification strategy avoids cyclic behaviour around local optima and explores more effectively the space of potential solutions. The proposed PeSOA algorithm has been validated on a well-known set of benchmark functions. Comparative performances with six other nature-inspired metaheuristics show that the PeSOA performs favourably in these tests. A run-time analysis shows that the performance obtained by the PeSOA is very stable at any time of the evolution horizon, making the PeSOA a viable approach for real world applications.
△ Less
Submitted 8 April, 2019; v1 submitted 26 September, 2018;
originally announced September 2018.
-
A First Option Calibration of the GARCH Diffusion Model by a PDE Method
Authors:
Yiannis A. Papadopoulos,
Alan L. Lewis
Abstract:
Time-series calibrations often suggest that the GARCH diffusion model could also be a suitable candidate for option (risk-neutral) calibration. But unlike the popular Heston model, it lacks a fast, semi-analytic solution for the pricing of vanilla options, perhaps the main reason why it is not used in this way. In this paper we show how an efficient finite difference-based PDE solver can effective…
▽ More
Time-series calibrations often suggest that the GARCH diffusion model could also be a suitable candidate for option (risk-neutral) calibration. But unlike the popular Heston model, it lacks a fast, semi-analytic solution for the pricing of vanilla options, perhaps the main reason why it is not used in this way. In this paper we show how an efficient finite difference-based PDE solver can effectively replace analytical solutions, enabling accurate option calibrations in less than a minute. The proposed pricing engine is shown to be robust under a wide range of model parameters and combines smoothly with black-box optimizers. We use this approach to produce a first PDE calibration of the GARCH diffusion model to SPX options and present some benchmark results for future reference.
△ Less
Submitted 18 January, 2018;
originally announced January 2018.