-
Time Series Representation Models
Authors:
Robert Leppich,
Vanessa Borst,
Veronika Lesch,
Samuel Kounev
Abstract:
Time series analysis remains a major challenge due to its sparse characteristics, high dimensionality, and inconsistent data quality. Recent advancements in transformer-based techniques have enhanced capabilities in forecasting and imputation; however, these methods are still resource-heavy, lack adaptability, and face difficulties in integrating both local and global attributes of time series. To…
▽ More
Time series analysis remains a major challenge due to its sparse characteristics, high dimensionality, and inconsistent data quality. Recent advancements in transformer-based techniques have enhanced capabilities in forecasting and imputation; however, these methods are still resource-heavy, lack adaptability, and face difficulties in integrating both local and global attributes of time series. To tackle these challenges, we propose a new architectural concept for time series analysis based on introspection. Central to this concept is the self-supervised pretraining of Time Series Representation Models (TSRMs), which once learned can be easily tailored and fine-tuned for specific tasks, such as forecasting and imputation, in an automated and resource-efficient manner. Our architecture is equipped with a flexible and hierarchical representation learning process, which is robust against missing data and outliers. It can capture and learn both local and global features of the structure, semantics, and crucial patterns of a given time series category, such as heart rate data. Our learned time series representation models can be efficiently adapted to a specific task, such as forecasting or imputation, without manual intervention. Furthermore, our architecture's design supports explainability by highlighting the significance of each input value for the task at hand. Our empirical study using four benchmark datasets shows that, compared to investigated state-of-the-art baseline methods, our architecture improves imputation and forecasting errors by up to 90.34% and 71.54%, respectively, while reducing the required trainable parameters by up to 92.43%. The source code is available at https://github.com/RobertLeppich/TSRM.
△ Less
Submitted 28 May, 2024;
originally announced May 2024.
-
A Case Study on Optimization of Warehouses
Authors:
Veronika Lesch,
Patrick B. M. Müller,
Moritz Krämer,
Samuel Kounev,
Christian Krupitzer
Abstract:
In warehouses, order picking is known to be the most labor-intensive and costly task in which the employees account for a large part of the warehouse performance. Hence, many approaches exist, that optimize the order picking process based on diverse economic criteria. However, most of these approaches focus on a single economic objective at once and disregard ergonomic criteria in their optimizati…
▽ More
In warehouses, order picking is known to be the most labor-intensive and costly task in which the employees account for a large part of the warehouse performance. Hence, many approaches exist, that optimize the order picking process based on diverse economic criteria. However, most of these approaches focus on a single economic objective at once and disregard ergonomic criteria in their optimization. Further, the influence of the placement of the items to be picked is underestimated and accordingly, too little attention is paid to the interdependence of these two problems. In this work, we aim at optimizing the storage assignment and the order picking problem within mezzanine warehouse with regards to their reciprocal influence. We propose a customized version of the Non-dominated Sorting Genetic Algorithm II (NSGA-II) for optimizing the storage assignment problem as well as an Ant Colony Optimization (ACO) algorithm for optimizing the order picking problem. Both algorithms incorporate multiple economic and ergonomic constraints simultaneously. Furthermore, the algorithms incorporate knowledge about the interdependence between both problems, aiming to improve the overall warehouse performance. Our evaluation results show that our proposed algorithms return better storage assignments and order pick routes compared to commonly used techniques for the following quality indicators for comparing Pareto fronts: Coverage, Generational Distance, Euclidian Distance, Pareto Front Size, and Inverted Generational Distance. Additionally, the evaluation regarding the interaction of both algorithms shows a better performance when combining both proposed algorithms.
△ Less
Submitted 23 November, 2021;
originally announced December 2021.
-
A Case Study on Optimization of Platooning Coordination
Authors:
Veronika Lesch,
Marius Hadry,
Samuel Kounev,
Christian Krupitzer
Abstract:
In today's world, circumstances, processes, and requirements for software systems are becoming increasingly complex. In order to operate properly in such dynamic environments, software systems must adapt to these changes, which has led to the research area of Self-Adaptive Systems (SAS). Platooning is one example of adaptive systems in Intelligent Transportation Systems, which is the ability of ve…
▽ More
In today's world, circumstances, processes, and requirements for software systems are becoming increasingly complex. In order to operate properly in such dynamic environments, software systems must adapt to these changes, which has led to the research area of Self-Adaptive Systems (SAS). Platooning is one example of adaptive systems in Intelligent Transportation Systems, which is the ability of vehicles to travel with close inter-vehicle distances. This technology leads to an increase in road throughput and safety, which directly addresses the increased infrastructure needs due to increased traffic on the roads. However, the No-Free-Lunch theorem states that the performance of one platooning coordination strategy is not necessarily transferable to other problems. Moreover, especially in the field of SAS, the selection of the most appropriate strategy depends on the current situation of the system. In this paper, we address the problem of self-aware optimization of adaptation planning strategies by designing a framework that includes situation detection, strategy selection, and parameter optimization of the selected strategies. We apply our approach on the case study platooning coordination and evaluate the performance of the proposed framework.
△ Less
Submitted 18 November, 2021;
originally announced November 2021.
-
A Case Study of Vehicle Route Optimization
Authors:
Veronika Lesch,
Maximilian König,
Samuel Kounev,
Anthony Stein,
Christian Krupitzer
Abstract:
In the last decades, the classical Vehicle Routing Problem (VRP), i.e., assigning a set of orders to vehicles and planning their routes has been intensively researched. As only the assignment of order to vehicles and their routes is already an NP-complete problem, the application of these algorithms in practice often fails to take into account the constraints and restrictions that apply in real-wo…
▽ More
In the last decades, the classical Vehicle Routing Problem (VRP), i.e., assigning a set of orders to vehicles and planning their routes has been intensively researched. As only the assignment of order to vehicles and their routes is already an NP-complete problem, the application of these algorithms in practice often fails to take into account the constraints and restrictions that apply in real-world applications, the so called rich VRP (rVRP) and are limited to single aspects. In this work, we incorporate the main relevant real-world constraints and requirements. We propose a two-stage strategy and a Timeline algorithm for time windows and pause times, and apply a Genetic Algorithm (GA) and Ant Colony Optimization (ACO) individually to the problem to find optimal solutions. Our evaluation of eight different problem instances against four state-of-the-art algorithms shows that our approach handles all given constraints in a reasonable time.
△ Less
Submitted 17 November, 2021;
originally announced November 2021.
-
A Survey on Predictive Maintenance for Industry 4.0
Authors:
Christian Krupitzer,
Tim Wagenhals,
Marwin Züfle,
Veronika Lesch,
Dominik Schäfer,
Amin Mozaffarin,
Janick Edinger,
Christian Becker,
Samuel Kounev
Abstract:
Production issues at Volkswagen in 2016 lead to dramatic losses in sales of up to 400 million Euros per week. This example shows the huge financial impact of a working production facility for companies. Especially in the data-driven domains of Industry 4.0 and Industrial IoT with intelligent, connected machines, a conventional, static maintenance schedule seems to be old-fashioned. In this paper,…
▽ More
Production issues at Volkswagen in 2016 lead to dramatic losses in sales of up to 400 million Euros per week. This example shows the huge financial impact of a working production facility for companies. Especially in the data-driven domains of Industry 4.0 and Industrial IoT with intelligent, connected machines, a conventional, static maintenance schedule seems to be old-fashioned. In this paper, we present a survey on the current state of the art in predictive maintenance for Industry 4.0. Based on a structured literate survey, we present a classification of predictive maintenance in the context of Industry 4.0 and discuss recent developments in this area.
△ Less
Submitted 5 February, 2020;
originally announced February 2020.
-
A Survey on Human Machine Interaction in Industry 4.0
Authors:
Christian Krupitzer,
Sebastian Müller,
Veronika Lesch,
Marwin Züfle,
Janick Edinger,
Alexander Lemken,
Dominik Schäfer,
Samuel Kounev,
Christian Becker
Abstract:
Industry 4.0 or Industrial IoT both describe new paradigms for seamless interaction between humans and machines. Both concepts rely on intelligent, inter-connected cyber-physical production systems that are able to control the process flow of industrial production. As those machines take many decisions autonomously and further interact with production and manufacturing planning systems, the integr…
▽ More
Industry 4.0 or Industrial IoT both describe new paradigms for seamless interaction between humans and machines. Both concepts rely on intelligent, inter-connected cyber-physical production systems that are able to control the process flow of industrial production. As those machines take many decisions autonomously and further interact with production and manufacturing planning systems, the integration of human users requires new paradigms. In this paper, we provide an analysis of the current state-of-the-art in human-machine interaction in the Industry 4.0 domain.We focus on new paradigms that integrate the application of augmented and virtual reality technology. Based on our analysis, we further provide a discussion of research challenges.
△ Less
Submitted 3 February, 2020;
originally announced February 2020.
-
A combined theoretical and experimental study of the influence of different anion ratios on lithium ion dynamics in ionic liquids
Authors:
Volker Lesch,
Sebastian Jeremias,
Arianna Moretti,
Stefano Passerini,
Andreas Heuer,
Oleg Borodin
Abstract:
In this paper we have investigated via experimental and simulations techniques the transport properties, in terms of total ionic conductivity and ion diffusion coefficients, of ionic liquids and lithium salt mixtures composed of two anions, bis(fluorosulfonyl)imide (FSI) and bis(trifluoromethanesulfonyl)imide (TFSI), and two cations, N-ethyl-N-methylimidazolium (emim) and lithium. The comparison o…
▽ More
In this paper we have investigated via experimental and simulations techniques the transport properties, in terms of total ionic conductivity and ion diffusion coefficients, of ionic liquids and lithium salt mixtures composed of two anions, bis(fluorosulfonyl)imide (FSI) and bis(trifluoromethanesulfonyl)imide (TFSI), and two cations, N-ethyl-N-methylimidazolium (emim) and lithium. The comparison of the experimental results with the simulations shows an exceptional agreement over a wide temperature range. Of particular interest is the high agreement achieved at lower temperature, which is a result of the extended simulation length of, at least, a factor of 5 compared with previous work. The results show as the addition of TFSI favor the formation of lithium dimers (Li+ - TFSI- - Li+). A closer analysis of such dimers shows that involved lithium ions move nearly as fast as single lithium ions although they have a different coordination and much slower TFSI exchange rates.
△ Less
Submitted 30 January, 2014;
originally announced January 2014.