-
SoftED: Metrics for Soft Evaluation of Time Series Event Detection
Authors:
Rebecca Salles,
Janio Lima,
Rafaelli Coutinho,
Esther Pacitti,
Florent Masseglia,
Reza Akbarinia,
Chao Chen,
Jonathan Garibaldi,
Fabio Porto,
Eduardo Ogasawara
Abstract:
Time series event detection methods are evaluated mainly by standard classification metrics that focus solely on detection accuracy. However, inaccuracy in detecting an event can often result from its preceding or delayed effects reflected in neighboring detections. These detections are valuable to trigger necessary actions or help mitigate unwelcome consequences. In this context, current metrics…
▽ More
Time series event detection methods are evaluated mainly by standard classification metrics that focus solely on detection accuracy. However, inaccuracy in detecting an event can often result from its preceding or delayed effects reflected in neighboring detections. These detections are valuable to trigger necessary actions or help mitigate unwelcome consequences. In this context, current metrics are insufficient and inadequate for the context of event detection. There is a demand for metrics that incorporate both the concept of time and temporal tolerance for neighboring detections. This paper introduces SoftED metrics, a new set of metrics designed for soft evaluating event detection methods. They enable the evaluation of both detection accuracy and the degree to which their detections represent events. They improved event detection evaluation by associating events and their representative detections, incorporating temporal tolerance in over 36\% of experiments compared to the usual classification metrics. SoftED metrics were validated by domain specialists that indicated their contribution to detection evaluation and method selection.
△ Less
Submitted 29 May, 2024; v1 submitted 1 April, 2023;
originally announced April 2023.
-
Feedback Clustering for Online Travel Agencies Searches: a Case Study
Authors:
Sara Scaramuccia,
Simon Nanty,
Florent Masseglia
Abstract:
Understanding choices performed by online customers is a growing need in the travel industry. In many practical situations, the only available information is the flight search query performed by the customer with no additional profile knowledge. In general, customer flight bookings are driven by prices, duration, number of connections, and so on. However, not all customers might assign the same im…
▽ More
Understanding choices performed by online customers is a growing need in the travel industry. In many practical situations, the only available information is the flight search query performed by the customer with no additional profile knowledge. In general, customer flight bookings are driven by prices, duration, number of connections, and so on. However, not all customers might assign the same importance to each of those criteria. Here comes the need of grou** together all flight searches performed by the same kind of customer, that is having the same booking criteria. The effectiveness of some set of recommendations, for a single cluster, can be measured in terms of the number of bookings historically performed. This effectiveness measure plays the role of a feedback, that is an external knowledge which can be recombined to iteratively obtain a final segmentation. In this paper, we describe our Online Travel Agencies (OTA) flight search use case and highlight its specific features. We address the flight search segmentation problem motivated above by proposing a novel algorithm called Split-or-Merge (S/M). This algorithm is a variation of the Split-Merge-Evolve (SME) method. The SME method has already been introduced in the community as an iterative process updating a clustering given by the K-means algorithm by splitting and merging clusters subject to feedback independent evaluations. No previous application of the SME method to the real-word data is reported in literature to the best of our knowledge. Here, we provide experimental evaluations over real-world data to the SME and the S/M methods. The impact on our domain-specific metrics obtained under the SME and the S/M methods suggests that feedback clustering techniques can be very promising in the handling of the domain of OTA flight searches.
△ Less
Submitted 28 June, 2020;
originally announced July 2020.
-
Apprentissage de la pensée informatique : de la formation des enseignant$\cdot$e$\cdot$s à la formation de tou$\cdot$te$\cdot$s les citoyen$\cdot$ne$\cdot$s
Authors:
Corinne Atlan,
Jean-Pierre Archambault,
Olivier Banus,
Frédéric Bardeau,
Amélie Blandeau,
Antonin Cois,
Martine Courbin,
Gérard Giraudon,
Saint-Clair Lefèvre,
Valérie Letard,
Bastien Masse,
Florent Masseglia,
Benjamin Ninassi,
Sophie de Quatrebarbes,
Margarida Romero,
Didier Roy,
Thierry Vieville
Abstract:
In recent years, in France, computer learning (under the term of code) has entered the school curriculum, in primary and high school. This learning is also aimed at develo** computer thinking to enable students, girls and boys, to start master all aspects of the digital world (science, technology, industry, culture). However, neither teachers, nor parents are trained to teach or educate on these…
▽ More
In recent years, in France, computer learning (under the term of code) has entered the school curriculum, in primary and high school. This learning is also aimed at develo** computer thinking to enable students, girls and boys, to start master all aspects of the digital world (science, technology, industry, culture). However, neither teachers, nor parents are trained to teach or educate on these topics. Furthermore, if the educational system progresses progressively towards these objectives, in everyday life and in professional context there is also a need for lifelong training in computer thinking. Large-scale projects on coding initiation are now quite successful in supporting the training of professionals in education on these topics. However, they require an infrastructure of people and important resources to maintain their level of efficiency. In order to further develop the objectives ofhel** people to demystify IT thinking, we aim to question here the way by which it is possible to conceive a concrete and operational initiative that addresses this issue. A huge challenge: Let's share a proposal here and discuss it.
△ Less
Submitted 3 June, 2019;
originally announced June 2019.
-
A Distributed Collaborative Filtering Algorithm Using Multiple Data Sources
Authors:
Mohamed Reda Bouadjenek,
Esther Pacitti,
Maximilien Servajean,
Florent Masseglia,
Amr El Abbadi
Abstract:
Collaborative Filtering (CF) is one of the most commonly used recommendation methods. CF consists in predicting whether, or how much, a user will like (or dislike) an item by leveraging the knowledge of the user's preferences as well as that of other users. In practice, users interact and express their opinion on only a small subset of items, which makes the corresponding user-item rating matrix v…
▽ More
Collaborative Filtering (CF) is one of the most commonly used recommendation methods. CF consists in predicting whether, or how much, a user will like (or dislike) an item by leveraging the knowledge of the user's preferences as well as that of other users. In practice, users interact and express their opinion on only a small subset of items, which makes the corresponding user-item rating matrix very sparse. Such data sparsity yields two main problems for recommender systems: (1) the lack of data to effectively model users' preferences, and (2) the lack of data to effectively model item characteristics. However, there are often many other data sources that are available to a recommender system provider, which can describe user interests and item characteristics (e.g., users' social network, tags associated to items, etc.). These valuable data sources may supply useful information to enhance a recommendation system in modeling users' preferences and item characteristics more accurately and thus, hopefully, to make recommenders more precise. For various reasons, these data sources may be managed by clusters of different data centers, thus requiring the development of distributed solutions. In this paper, we propose a new distributed collaborative filtering algorithm, which exploits and combines multiple and diverse data sources to improve recommendation quality. Our experimental evaluation using real datasets shows the effectiveness of our algorithm compared to state-of-the-art recommendation algorithms.
△ Less
Submitted 16 July, 2018;
originally announced July 2018.
