-
Ageing Analysis of Embedded SRAM on a Large-Scale Testbed Using Machine Learning
Authors:
Leandro Lanzieri,
Peter Kietzmann,
Goerschwin Fey,
Holger Schlarb,
Thomas C. Schmidt
Abstract:
Ageing detection and failure prediction are essential in many Internet of Things (IoT) deployments, which operate huge quantities of embedded devices unattended in the field for years. In this paper, we present a large-scale empirical analysis of natural SRAM wear-out using 154 boards from a general-purpose testbed. Starting from SRAM initialization bias, which each node can easily collect at star…
▽ More
Ageing detection and failure prediction are essential in many Internet of Things (IoT) deployments, which operate huge quantities of embedded devices unattended in the field for years. In this paper, we present a large-scale empirical analysis of natural SRAM wear-out using 154 boards from a general-purpose testbed. Starting from SRAM initialization bias, which each node can easily collect at startup, we apply various metrics for feature extraction and experiment with common machine learning methods to predict the age of operation for this node. Our findings indicate that even though ageing impacts are subtle, our indicators can well estimate usage times with an $R^2$ score of 0.77 and a mean error of 24% using regressors, and with an F1 score above 0.6 for classifiers applying a six-months resolution.
△ Less
Submitted 13 July, 2023;
originally announced July 2023.
-
A Review of Techniques for Ageing Detection and Monitoring on Embedded Systems
Authors:
Leandro Lanzieri,
Gianluca Martino,
Goerschwin Fey,
Holger Schlarb,
Thomas C. Schmidt,
Matthias Wählisch
Abstract:
Embedded digital devices, such as Field-Programmable Gate Arrays (FPGAs) and Systems on Chip (SoCs), are increasingly used in dependable or safety-critical systems. These commodity devices are subject to notable hardware ageing, which makes failures likely when used for an extended time. It is of vital importance to understand ageing processes and to detect hardware degradations early. In this sur…
▽ More
Embedded digital devices, such as Field-Programmable Gate Arrays (FPGAs) and Systems on Chip (SoCs), are increasingly used in dependable or safety-critical systems. These commodity devices are subject to notable hardware ageing, which makes failures likely when used for an extended time. It is of vital importance to understand ageing processes and to detect hardware degradations early. In this survey, we describe the fundamental ageing mechanisms and review the main techniques for detecting ageing in FPGAs, microcontrollers, SoCs, and power supplies. The main goal of this work is to facilitate future research efforts in this field by presenting all main approaches in an organized way.
△ Less
Submitted 17 January, 2023;
originally announced January 2023.
-
Decision Trees for Analyzing Influences on the Accuracy of Indoor Localization Systems
Authors:
Jakob Schyga,
Swantje Plambeck,
Johannes Hinckeldeyn,
Görschwin Fey,
Jochen Kreutzfeldt
Abstract:
Absolute position accuracy is the key performance criterion of an Indoor Localization System (ILS). Since ILS are heterogeneous and complex cyber-physical systems, the localization accuracy depends on various influences from the environment, system configuration, and the application processes. To determine the position accuracy of a system in a reproducible, comparable, and realistic manner, these…
▽ More
Absolute position accuracy is the key performance criterion of an Indoor Localization System (ILS). Since ILS are heterogeneous and complex cyber-physical systems, the localization accuracy depends on various influences from the environment, system configuration, and the application processes. To determine the position accuracy of a system in a reproducible, comparable, and realistic manner, these factors must be taken into account. We propose a strategy for analyzing the influences on the position accuracy of ILS using decision trees in combination with application-related or technology-related categorization. The proposed strategy is validated using empirical data from 120 experiments. The accuracy of an Ultra-Wideband and a LiDAR-based ILS was determined under different application-driven influencing factors, considering the application of autonomous mobile robots in warehouses. Finally, the opportunities and limitations of analyzing decision trees to compare system performance, find a suitable system, optimize the environment or system configuration, and understand the relevance of different influencing factors are presented.
△ Less
Submitted 8 July, 2022;
originally announced July 2022.
-
Automata Learning for Automated Test Generation of Real Time Localization Systems
Authors:
Swantje Plambeck,
Jakob Schyga,
Johannes Hinckeldeyn,
Jochen Kreutzfeldt,
Görschwin Fey
Abstract:
Cyber Physical Systems (CPSs) are often black box systems for which no exact model exists. Automata learning allows to build abstract models of CPSs and is used in several scenarios, i.e. simulation, monitoring, and test case generation. Real time localization systems (RTLSs) are an example of particularly complex and often safety critical CPSs. We present a procedure for automatic test case gener…
▽ More
Cyber Physical Systems (CPSs) are often black box systems for which no exact model exists. Automata learning allows to build abstract models of CPSs and is used in several scenarios, i.e. simulation, monitoring, and test case generation. Real time localization systems (RTLSs) are an example of particularly complex and often safety critical CPSs. We present a procedure for automatic test case generation with automata learning and apply this approach in a case study to a localization system.
△ Less
Submitted 21 May, 2021;
originally announced May 2021.
-
YAPS -- Your Open Examination System for Activating and emPowering Students
Authors:
Fin Hendrik Bahnsen,
Goerschwin Fey
Abstract:
There are numerous e-assessment systems devoted to specific domains under diverse license models. Cost, extensibility, and maintainability are relevant issues for an institution. Ease of use and inclusion into courses are educator's main concerns. For students the user experience and fast transparent feedback plus "better" tests are most important. Many exams still focus on testing memorized knowl…
▽ More
There are numerous e-assessment systems devoted to specific domains under diverse license models. Cost, extensibility, and maintainability are relevant issues for an institution. Ease of use and inclusion into courses are educator's main concerns. For students the user experience and fast transparent feedback plus "better" tests are most important. Many exams still focus on testing memorized knowledge, instead of improving and testing skills with competence-oriented learning support and examinations, respectively. We discuss design decisions and present the resulting architecture of YAPS - Your open Assessment system for emPowering Students. YAPS has been used for very diverse lectures in logistics, computer engineering, and algorithms for exams, but also for empowering students by fast feedback during the learning period. We report on results in a basic lecture on Computer Science for Mechanical Engineers.
△ Less
Submitted 27 April, 2021;
originally announced May 2021.
-
Synthesizing Adaptive Test Strategies from Temporal Logic Specifications
Authors:
Roderick Bloem,
Goerschwin Fey,
Fabian Greif,
Robert Koenighofer,
Ingo Pill,
Heinz Riener,
Franz Roeck
Abstract:
Constructing good test cases is difficult and time-consuming, especially if the system under test is still under development and its exact behavior is not yet fixed. We propose a new approach to compute test strategies for reactive systems from a given temporal logic specification using formal methods. The computed strategies are guaranteed to reveal certain simple faults in every realization of t…
▽ More
Constructing good test cases is difficult and time-consuming, especially if the system under test is still under development and its exact behavior is not yet fixed. We propose a new approach to compute test strategies for reactive systems from a given temporal logic specification using formal methods. The computed strategies are guaranteed to reveal certain simple faults in every realization of the specification and for every behavior of the uncontrollable part of the system's environment. The proposed approach supports different assumptions on occurrences of faults (ranging from a single transient fault to a persistent fault) and by default aims at unveiling the weakest one. Based on well-established hypotheses from fault-based testing, we argue that such tests are also sensitive for more complex bugs. Since the specification may not define the system behavior completely, we use reactive synthesis algorithms with partial information. The computed strategies are adaptive test strategies that react to behavior at runtime. We work out the underlying theory of adaptive test strategy synthesis and present experiments for a safety-critical component of a real-world satellite system. We demonstrate that our approach can be applied to industrial specifications and that the synthesized test strategies are capable of detecting bugs that are hard to detect with random testing.
△ Less
Submitted 5 September, 2018;
originally announced September 2018.
-
Path-Based Program Repair
Authors:
Heinz Riener,
Rüdiger Ehlers,
Görschwin Fey
Abstract:
We propose a path-based approach to program repair for imperative programs. Our repair framework takes as input a faulty program, a logic specification that is refuted, and a hint where the fault may be located. An iterative abstraction refinement loop is then used to repair the program: in each iteration, the faulty program part is re-synthesized considering a symbolic counterexample, where the c…
▽ More
We propose a path-based approach to program repair for imperative programs. Our repair framework takes as input a faulty program, a logic specification that is refuted, and a hint where the fault may be located. An iterative abstraction refinement loop is then used to repair the program: in each iteration, the faulty program part is re-synthesized considering a symbolic counterexample, where the control-flow is kept concrete but the data-flow is symbolic. The appeal of the idea is two-fold: 1) the approach lazily considers candidate repairs and 2) the repairs are directly derived from the logic specification. In contrast to prior work, our approach is complete for programs with finitely many control-flow paths, i.e., the program is repaired if and only if it can be repaired at the specified fault location. Initial results for small programs indicate that the approach is useful for debugging programs in practice.
△ Less
Submitted 16 March, 2015;
originally announced March 2015.