-
Leveraging Time-Series Foundation Models in Smart Agriculture for Soil Moisture Forecasting
Authors:
Boje Deforce,
Bart Baesens,
Estefanía Serral Asensio
Abstract:
The recent surge in foundation models for natural language processing and computer vision has fueled innovation across various domains. Inspired by this progress, we explore the potential of foundation models for time-series forecasting in smart agriculture, a field often plagued by limited data availability. Specifically, this work presents a novel application of $\texttt{TimeGPT}$, a state-of-th…
▽ More
The recent surge in foundation models for natural language processing and computer vision has fueled innovation across various domains. Inspired by this progress, we explore the potential of foundation models for time-series forecasting in smart agriculture, a field often plagued by limited data availability. Specifically, this work presents a novel application of $\texttt{TimeGPT}$, a state-of-the-art (SOTA) time-series foundation model, to predict soil water potential ($ψ_\mathrm{soil}$), a key indicator of field water status that is typically used for irrigation advice. Traditionally, this task relies on a wide array of input variables. We explore $ψ_\mathrm{soil}$'s ability to forecast $ψ_\mathrm{soil}$ in: ($i$) a zero-shot setting, ($ii$) a fine-tuned setting relying solely on historic $ψ_\mathrm{soil}$ measurements, and ($iii$) a fine-tuned setting where we also add exogenous variables to the model. We compare $\texttt{TimeGPT}$'s performance to established SOTA baseline models for forecasting $ψ_\mathrm{soil}$. Our results demonstrate that $\texttt{TimeGPT}$ achieves competitive forecasting accuracy using only historical $ψ_\mathrm{soil}$ data, highlighting its remarkable potential for agricultural applications. This research paves the way for foundation time-series models for sustainable development in agriculture by enabling forecasting tasks that were traditionally reliant on extensive data collection and domain expertise.
△ Less
Submitted 29 May, 2024;
originally announced May 2024.
-
From Internet of Things Data to Business Processes: Challenges and a Framework
Authors:
Juergen Mangler,
Ronny Seiger,
Janik-Vasily Benzin,
Joscha Grüger,
Yusuf Kirikkayis,
Florian Gallik,
Lukas Malburg,
Matthias Ehrendorfer,
Yannis Bertrand,
Marco Franceschetti,
Barbara Weber,
Stefanie Rinderle-Ma,
Ralph Bergmann,
Estefanía Serral Asensio,
Manfred Reichert
Abstract:
The IoT and Business Process Management (BPM) communities co-exist in many shared application domains, such as manufacturing and healthcare. The IoT community has a strong focus on hardware, connectivity and data; the BPM community focuses mainly on finding, controlling, and enhancing the structured interactions among the IoT devices in processes. While the field of Process Mining deals with the e…
▽ More
The IoT and Business Process Management (BPM) communities co-exist in many shared application domains, such as manufacturing and healthcare. The IoT community has a strong focus on hardware, connectivity and data; the BPM community focuses mainly on finding, controlling, and enhancing the structured interactions among the IoT devices in processes. While the field of Process Mining deals with the extraction of process models and process analytics from process event logs, the data produced by IoT sensors often is at a lower granularity than these process-level events. The fundamental questions about extracting and abstracting process-related data from streams of IoT sensor values are: (1) Which sensor values can be clustered together as part of process events?, (2) Which sensor values signify the start and end of such events?, (3) Which sensor values are related but not essential? This work proposes a framework to semi-automatically perform a set of structured steps to convert low-level IoT sensor data into higher-level process events that are suitable for process mining. The framework is meant to provide a generic sequence of abstract steps to guide the event extraction, abstraction, and correlation, with variation points for plugging in specific analysis techniques and algorithms for each step. To assess the completeness of the framework, we present a set of challenges, how they can be tackled through the framework, and an example on how to instantiate the framework in a real-world demonstration from the field of smart manufacturing. Based on this framework, future research can be conducted in a structured manner through refining and improving individual steps.
△ Less
Submitted 22 May, 2024; v1 submitted 14 May, 2024;
originally announced May 2024.
-
End-To-End Self-tuning Self-supervised Time Series Anomaly Detection
Authors:
Boje Deforce,
Meng-Chieh Lee,
Bart Baesens,
Estefanía Serral Asensio,
Jaemin Yoo,
Leman Akoglu
Abstract:
Time series anomaly detection (TSAD) finds many applications such as monitoring environmental sensors, industry KPIs, patient biomarkers, etc. A two-fold challenge for TSAD is a versatile and unsupervised model that can detect various different types of time series anomalies (spikes, discontinuities, trend shifts, etc.) without any labeled data. Modern neural networks have outstanding ability in m…
▽ More
Time series anomaly detection (TSAD) finds many applications such as monitoring environmental sensors, industry KPIs, patient biomarkers, etc. A two-fold challenge for TSAD is a versatile and unsupervised model that can detect various different types of time series anomalies (spikes, discontinuities, trend shifts, etc.) without any labeled data. Modern neural networks have outstanding ability in modeling complex time series. Self-supervised models in particular tackle unsupervised TSAD by transforming the input via various augmentations to create pseudo anomalies for training. However, their performance is sensitive to the choice of augmentation, which is hard to choose in practice, while there exists no effort in the literature on data augmentation tuning for TSAD without labels. Our work aims to fill this gap. We introduce TSAP for TSA "on autoPilot", which can (self-)tune augmentation hyperparameters end-to-end. It stands on two key components: a differentiable augmentation architecture and an unsupervised validation loss to effectively assess the alignment between augmentation type and anomaly type. Case studies show TSAP's ability to effectively select the (discrete) augmentation type and associated (continuous) hyperparameters. In turn, it outperforms established baselines, including SOTA self-supervised models, on diverse TSAD tasks exhibiting different anomaly types.
△ Less
Submitted 3 April, 2024;
originally announced April 2024.
-
Self-Supervised Anomaly Detection of Rogue Soil Moisture Sensors
Authors:
Boje Deforce,
Bart Baesens,
Jan Diels,
Estefanía Serral Asensio
Abstract:
IoT data is a central element in the successful digital transformation of agriculture. However, IoT data comes with its own set of challenges. E.g., the risk of data contamination due to rogue sensors. A sensor is considered rogue when it provides incorrect measurements over time. To ensure correct analytical results, an essential preprocessing step when working with IoT data is the detection of s…
▽ More
IoT data is a central element in the successful digital transformation of agriculture. However, IoT data comes with its own set of challenges. E.g., the risk of data contamination due to rogue sensors. A sensor is considered rogue when it provides incorrect measurements over time. To ensure correct analytical results, an essential preprocessing step when working with IoT data is the detection of such rogue sensors. Existing methods assume that well-behaving sensors are known or that a large majority of the sensors is well-behaving. However, real-world data is often completely unlabeled and voluminous, calling for self-supervised methods that can detect rogue sensors without prior information. We present a self-supervised anomalous sensor detector based on a neural network with a contrastive loss, followed by DBSCAN. A core contribution of our paper is the use of Dynamic Time War** in the negative sampling for the triplet loss. This novelty makes the use of triplet networks feasible for anomalous sensor detection. Our method shows promising results on a challenging dataset of soil moisture sensors deployed in multiple pear orchards.
△ Less
Submitted 9 May, 2023;
originally announced May 2023.
-
SensorStream: An XES Extension for Enriching Event Logs with IoT-Sensor Data
Authors:
Joscha Grüger,
Lukas Malburg,
Juergen Mangler,
Yannis Bertrand,
Stefanie Rinderle-Ma,
Ralph Bergmann,
Estefanía Serral Asensio
Abstract:
Process management and process orchestration/execution are currently hot topics; prevalent trends such as automation and Industry 4.0 require solutions which allow domain-experts to easily model and execute processes in various domains, including manufacturing and health-care. These domains, in turn, rely on a tight integration between hardware and software, i.e. via the Internet of Things (IoT).…
▽ More
Process management and process orchestration/execution are currently hot topics; prevalent trends such as automation and Industry 4.0 require solutions which allow domain-experts to easily model and execute processes in various domains, including manufacturing and health-care. These domains, in turn, rely on a tight integration between hardware and software, i.e. via the Internet of Things (IoT). While process execution is about actuation, i.e. actively triggering actions and awaiting their completion, accompanying IoT sensors monitor humans and the environment. These sensors produce large amounts of procedural, discrete, and continuous data streams, that hold the key to understanding the quality of process subjects (e.g. produced parts), outcome (e.g. quantity and quality), and error causes. Processes constantly evolve in conjunction with their IoT environment. This requires joint storage of data generated by processes, with data generated by the IoT sensors is therefore needed. In this paper, we present an extension of the process log standard format XES, namely SensorStream. SensorStream enables to connect IoT data to process events, as well as a set of semantic annotations to describe the scenario and environment during data collection. This allows to preserve the full context required for data-analysis, so that logs can be analyzed even when scenarios or hardware artifacts are rapidly changing. Through additional semantic annotations, we envision the XES extension log format to be a solid based for the creation of a (semi-)automatic analysis pipeline, which can support domain experts by automatically providing data visualization, or even process insights.
△ Less
Submitted 22 June, 2022;
originally announced June 2022.
-
Modeling IoT-aware Business Processes - A State of the Art Report
Authors:
Nadja Brouns,
Samir Tata,
Heiko Ludwig,
E. Serral Asensio,
Paul Grefen
Abstract:
This research report presents an analysis of the state of the art of modeling Internet of Things (IoT)-aware business processes. IOT links the physical world to the digital world. Traditionally, we would find information about events and processes in the physical world in the digital world entered by humans and humans using this information to control the physical world. In the IoT paradigm, the p…
▽ More
This research report presents an analysis of the state of the art of modeling Internet of Things (IoT)-aware business processes. IOT links the physical world to the digital world. Traditionally, we would find information about events and processes in the physical world in the digital world entered by humans and humans using this information to control the physical world. In the IoT paradigm, the physical world is equipped with sensors and actuators to create a direct link with the digital world. Business processes are used to coordinate a complex environment including multiple actors for a common goal, typically in the context of administrative work. In the past few years, we have seen research efforts on the possibilities to model IoT- aware business processes, extending process coordination to real world entities directly. This set of research efforts is relatively small when compared to the overall research effort into the IoT and much of the work is still in the early research stage. To create a basis for a bridge between IoT and BPM, the goal of this report is to collect and analyze the state of the art of existing frameworks for modeling IoT-aware business processes.
△ Less
Submitted 1 November, 2018;
originally announced November 2018.
