-
Unimodal and Multimodal Sensor Fusion for Wearable Activity Recognition
Authors:
Hymalai Bello
Abstract:
Combining different sensing modalities with multiple positions helps form a unified perception and understanding of complex situations such as human behavior. Hence, human activity recognition (HAR) benefits from combining redundant and complementary information (Unimodal/Multimodal). Even so, it is not an easy task. It requires a multidisciplinary approach, including expertise in sensor technolog…
▽ More
Combining different sensing modalities with multiple positions helps form a unified perception and understanding of complex situations such as human behavior. Hence, human activity recognition (HAR) benefits from combining redundant and complementary information (Unimodal/Multimodal). Even so, it is not an easy task. It requires a multidisciplinary approach, including expertise in sensor technologies, signal processing, data fusion algorithms, and domain-specific knowledge. This Ph.D. work employs sensing modalities such as inertial, pressure (audio and atmospheric pressure), and textile capacitive sensing for HAR. The scenarios explored are gesture and hand position tracking, facial and head pattern recognition, and body posture and gesture recognition. The selected wearable devices and sensing modalities are fully integrated with machine learning-based algorithms, some of which are implemented in the embedded device, on the edge, and tested in real-time.
△ Less
Submitted 24 April, 2024;
originally announced April 2024.
-
BeSound: Bluetooth-Based Position Estimation Enhancing with Cross-Modality Distillation
Authors:
Hymalai Bello,
Sungho Suh,
Bo Zhou,
Paul Lukowicz
Abstract:
Smart factories leverage advanced technologies to optimize manufacturing processes and enhance efficiency. Implementing worker tracking systems, primarily through camera-based methods, ensures accurate monitoring. However, concerns about worker privacy and technology protection make it necessary to explore alternative approaches. We propose a non-visual, scalable solution using Bluetooth Low Energ…
▽ More
Smart factories leverage advanced technologies to optimize manufacturing processes and enhance efficiency. Implementing worker tracking systems, primarily through camera-based methods, ensures accurate monitoring. However, concerns about worker privacy and technology protection make it necessary to explore alternative approaches. We propose a non-visual, scalable solution using Bluetooth Low Energy (BLE) and ultrasound coordinates. BLE position estimation offers a very low-power and cost-effective solution, as the technology is available on smartphones and is scalable due to the large number of smartphone users, facilitating worker localization and safety protocol transmission. Ultrasound signals provide faster response times and higher accuracy but require custom hardware, increasing costs. To combine the benefits of both modalities, we employ knowledge distillation (KD) from ultrasound signals to BLE RSSI data. Once the student model is trained, the model only takes as inputs the BLE-RSSI data for inference, retaining the advantages of ubiquity and low cost of BLE RSSI. We tested our approach using data from an experiment with twelve participants in a smart factory test bed environment. We obtained an increase of 11.79% in the F1-score compared to the baseline (target model without KD and trained with BLE-RSSI data only).
△ Less
Submitted 24 April, 2024;
originally announced April 2024.
-
iFace: Hand-Over-Face Gesture Recognition Leveraging Impedance Sensing
Authors:
Mengxi Liu,
Hymalai Bello,
Bo Zhou,
Paul Lukowicz,
Jakob Karolus
Abstract:
Hand-over-face gestures can provide important implicit interactions during conversations, such as frustration or excitement. However, in situations where interlocutors are not visible, such as phone calls or textual communication, the potential meaning contained in the hand-over-face gestures is lost. In this work, we present iFace, an unobtrusive, wearable impedance-sensing solution for recognizi…
▽ More
Hand-over-face gestures can provide important implicit interactions during conversations, such as frustration or excitement. However, in situations where interlocutors are not visible, such as phone calls or textual communication, the potential meaning contained in the hand-over-face gestures is lost. In this work, we present iFace, an unobtrusive, wearable impedance-sensing solution for recognizing different hand-over-face gestures. In contrast to most existing works, iFace does not require the placement of sensors on the user's face or hands. Instead, we proposed a novel sensing configuration, the shoulders, which remains invisible to both the user and outside observers. The system can monitor the shoulder-to-shoulder impedance variation caused by gestures through electrodes attached to each shoulder. We evaluated iFace in a user study with eight participants, collecting six kinds of hand-over-face gestures with different meanings. Using a convolutional neural network and a user-dependent classification, iFace reaches 82.58 \% macro F1 score. We discuss potential application scenarios of iFace as an implicit interaction interface.
△ Less
Submitted 27 March, 2024;
originally announced March 2024.
-
Remaining useful life prediction of Lithium-ion batteries using spatio-temporal multimodal attention networks
Authors:
Sungho Suh,
Dhruv Aditya Mittal,
Hymalai Bello,
Bo Zhou,
Mayank Shekhar Jha,
Paul Lukowicz
Abstract:
Lithium-ion batteries are widely used in various applications, including electric vehicles and renewable energy storage. The prediction of the remaining useful life (RUL) of batteries is crucial for ensuring reliable and efficient operation, as well as reducing maintenance costs. However, determining the life cycle of batteries in real-world scenarios is challenging, and existing methods have limi…
▽ More
Lithium-ion batteries are widely used in various applications, including electric vehicles and renewable energy storage. The prediction of the remaining useful life (RUL) of batteries is crucial for ensuring reliable and efficient operation, as well as reducing maintenance costs. However, determining the life cycle of batteries in real-world scenarios is challenging, and existing methods have limitations in predicting the number of cycles iteratively. In addition, existing works often oversimplify the datasets, neglecting important features of the batteries such as temperature, internal resistance, and material type. To address these limitations, this paper proposes a two-stage RUL prediction scheme for Lithium-ion batteries using a spatio-temporal multimodal attention network (ST-MAN). The proposed ST-MAN is to capture the complex spatio-temporal dependencies in the battery data, including the features that are often neglected in existing works. Despite operating without prior knowledge of end-of-life (EOL) events, our method consistently achieves lower error rates, boasting mean absolute error (MAE) and mean square error (MSE) of 0.0275 and 0.0014, respectively, compared to existing convolutional neural networks (CNN) and long short-term memory (LSTM)-based methods. The proposed method has the potential to improve the reliability and efficiency of battery operations and is applicable in various industries.
△ Less
Submitted 6 June, 2024; v1 submitted 29 October, 2023;
originally announced October 2023.
-
Two-stage Early Prediction Framework of Remaining Useful Life for Lithium-ion Batteries
Authors:
Dhruv Mittal,
Hymalai Bello,
Bo Zhou,
Mayank Shekhar Jha,
Sungho Suh,
Paul Lukowicz
Abstract:
Early prediction of remaining useful life (RUL) is crucial for effective battery management across various industries, ranging from household appliances to large-scale applications. Accurate RUL prediction improves the reliability and maintainability of battery technology. However, existing methods have limitations, including assumptions of data from the same sensors or distribution, foreknowledge…
▽ More
Early prediction of remaining useful life (RUL) is crucial for effective battery management across various industries, ranging from household appliances to large-scale applications. Accurate RUL prediction improves the reliability and maintainability of battery technology. However, existing methods have limitations, including assumptions of data from the same sensors or distribution, foreknowledge of the end of life (EOL), and neglect to determine the first prediction cycle (FPC) to identify the start of the unhealthy stage. This paper proposes a novel method for RUL prediction of Lithium-ion batteries. The proposed framework comprises two stages: determining the FPC using a neural network-based model to divide the degradation data into distinct health states and predicting the degradation pattern after the FPC to estimate the remaining useful life as a percentage. Experimental results demonstrate that the proposed method outperforms conventional approaches in terms of RUL prediction. Furthermore, the proposed method shows promise for real-world scenarios, providing improved accuracy and applicability for battery management.
△ Less
Submitted 7 August, 2023;
originally announced August 2023.
-
MeciFace: Mechanomyography and Inertial Fusion-based Glasses for Edge Real-Time Recognition of Facial and Eating Activities
Authors:
Hymalai Bello,
Sungho Suh,
Bo Zhou,
Paul Lukowicz
Abstract:
The increasing prevalence of stress-related eating behaviors and their impact on overall health highlights the importance of effective and ubiquitous monitoring systems. In this paper, we present MeciFace, an innovative wearable technology designed to monitor facial expressions and eating activities in real-time on-the-edge (RTE). MeciFace aims to provide a low-power, privacy-conscious, and highly…
▽ More
The increasing prevalence of stress-related eating behaviors and their impact on overall health highlights the importance of effective and ubiquitous monitoring systems. In this paper, we present MeciFace, an innovative wearable technology designed to monitor facial expressions and eating activities in real-time on-the-edge (RTE). MeciFace aims to provide a low-power, privacy-conscious, and highly accurate tool for promoting healthy eating behaviors and stress management. We employ lightweight convolutional neural networks as backbone models for facial expression and eating monitoring scenarios. The MeciFace system ensures efficient data processing with a tiny memory footprint, ranging from 11KB to 19 KB. During RTE evaluation, the system achieves an F1-score of < 86% for facial expression recognition and 94% for eating/drinking monitoring, for the RTE of unseen users (user-independent case).
△ Less
Submitted 3 April, 2024; v1 submitted 19 June, 2023;
originally announced June 2023.
-
CaptAinGlove: Capacitive and Inertial Fusion-Based Glove for Real-Time on Edge Hand Gesture Recognition for Drone Control
Authors:
Hymalai Bello,
Sungho Suh,
Daniel Geißler,
Lala Ray,
Bo Zhou,
Paul Lukowicz
Abstract:
We present CaptAinGlove, a textile-based, low-power (1.15Watts), privacy-conscious, real-time on-the-edge (RTE) glove-based solution with a tiny memory footprint (2MB), designed to recognize hand gestures used for drone control. We employ lightweight convolutional neural networks as the backbone models and a hierarchical multimodal fusion to reduce power consumption and improve accuracy. The syste…
▽ More
We present CaptAinGlove, a textile-based, low-power (1.15Watts), privacy-conscious, real-time on-the-edge (RTE) glove-based solution with a tiny memory footprint (2MB), designed to recognize hand gestures used for drone control. We employ lightweight convolutional neural networks as the backbone models and a hierarchical multimodal fusion to reduce power consumption and improve accuracy. The system yields an F1-score of 80% for the offline evaluation of nine classes; eight hand gesture commands and null activity. For the RTE, we obtained an F1-score of 67% (one user).
△ Less
Submitted 7 June, 2023;
originally announced June 2023.
-
InMyFace: Inertial and Mechanomyography-Based Sensor Fusion for Wearable Facial Activity Recognition
Authors:
Hymalai Bello,
Luis Alfredo Sanchez Marin,
Sungho Suh,
Bo Zhou,
Paul Lukowicz
Abstract:
Recognizing facial activity is a well-understood (but non-trivial) computer vision problem. However, reliable solutions require a camera with a good view of the face, which is often unavailable in wearable settings. Furthermore, in wearable applications, where systems accompany users throughout their daily activities, a permanently running camera can be problematic for privacy (and legal) reasons.…
▽ More
Recognizing facial activity is a well-understood (but non-trivial) computer vision problem. However, reliable solutions require a camera with a good view of the face, which is often unavailable in wearable settings. Furthermore, in wearable applications, where systems accompany users throughout their daily activities, a permanently running camera can be problematic for privacy (and legal) reasons. This work presents an alternative solution based on the fusion of wearable inertial sensors, planar pressure sensors, and acoustic mechanomyography (muscle sounds). The sensors were placed unobtrusively in a sports cap to monitor facial muscle activities related to facial expressions. We present our integrated wearable sensor system, describe data fusion and analysis methods, and evaluate the system in an experiment with thirteen subjects from different cultural backgrounds (eight countries) and both sexes (six women and seven men). In a one-model-per-user scheme and using a late fusion approach, the system yielded an average F1 score of 85.00% for the case where all sensing modalities are combined. With a cross-user validation and a one-model-for-all-user scheme, an F1 score of 79.00% was obtained for thirteen participants (six females and seven males). Moreover, in a hybrid fusion (cross-user) approach and six classes, an average F1 score of 82.00% was obtained for eight users. The results are competitive with state-of-the-art non-camera-based solutions for a cross-user study. In addition, our unique set of participants demonstrates the inclusiveness and generalizability of the approach.
△ Less
Submitted 8 February, 2023;
originally announced February 2023.
-
Granger causality test for heteroskedastic and structural-break time series using generalized least squares
Authors:
Hugo J. Bello
Abstract:
This paper proposes a novel method (GLS Granger test) to determine causal relationships between time series based on the estimation of the autocovariance matrix and generalized least squares. We show the effectiveness of proposed autocovariance matrix estimator (the sliding autocovariance matrix) and we compare the proposed method with the classical Granger F-test with via a synthetic dataset and…
▽ More
This paper proposes a novel method (GLS Granger test) to determine causal relationships between time series based on the estimation of the autocovariance matrix and generalized least squares. We show the effectiveness of proposed autocovariance matrix estimator (the sliding autocovariance matrix) and we compare the proposed method with the classical Granger F-test with via a synthetic dataset and a real dataset composed by cryptocurrencies. The simulations show that the proposed GLS Granger test captures causality more accurately than Granger F-tests in the cases of heteroskedastic or structural-break residuals. Finally, we use the proposed method to unravel unknown causal relationships between cryptocurrencies.
△ Less
Submitted 8 January, 2023;
originally announced January 2023.
-
Suicide Classificaction for News Media Using Convolutional Neural Network
Authors:
Hugo J. Bello,
Nora Palomar-Ciria,
Enrique Baca-García,
Celia Lozano
Abstract:
Currently, the process of evaluating suicides is highly subjective, which limits the efficacy and accuracy of prevention efforts. Artificial intelligence (AI) has emerged as a means of investigating large datasets to identify patterns within "big data" that can determine the factors on suicide outcomes. Here, we use AI tools to extract the topic from (press and social) media text. However, news me…
▽ More
Currently, the process of evaluating suicides is highly subjective, which limits the efficacy and accuracy of prevention efforts. Artificial intelligence (AI) has emerged as a means of investigating large datasets to identify patterns within "big data" that can determine the factors on suicide outcomes. Here, we use AI tools to extract the topic from (press and social) media text. However, news media articles lack of suicide tags. Using tweets with hashtags related to sucide, we train a neuronal model which identifies if a given text has a suicidade-related contagion. Our results suggest a high level of the impact of mediatic into suicide cases, and a intrinsic thematic relationship of suicide news. These results pave the way to build more interpretable suicide data, which may help to better track, understand its origin, and improve prevention strategies.
△ Less
Submitted 18 February, 2021;
originally announced March 2021.
-
Machine Learning to study the impact of gender-based violence in the news media
Authors:
Hugo J. Bello,
Nora Palomar,
Elisa Gallego,
Lourdes Jiménez Navascués,
Celia Lozano
Abstract:
While it remains a taboo topic, gender-based violence (GBV) undermines the health, dignity, security and autonomy of its victims. Many factors have been studied to generate or maintain this kind of violence, however, the influence of the media is still uncertain. Here, we use Machine Learning tools to extrapolate the effect of the news in GBV. By feeding neural networks with news, the topic inform…
▽ More
While it remains a taboo topic, gender-based violence (GBV) undermines the health, dignity, security and autonomy of its victims. Many factors have been studied to generate or maintain this kind of violence, however, the influence of the media is still uncertain. Here, we use Machine Learning tools to extrapolate the effect of the news in GBV. By feeding neural networks with news, the topic information associated with each article can be recovered. Our findings show a relationship between GBV news and public awareness, the effect of mediatic GBV cases, and the intrinsic thematic relationship of GBV news. Because the used neural model can be easily adjusted, this also allows us to extend our approach to other media sources or topics
△ Less
Submitted 27 November, 2020;
originally announced December 2020.
-
Review of recent results on heavy-ion physics and astroparticle physics in ALICE at the LHC
Authors:
Héctor Bello,
A. Fernandez Téllez,
Antonio Ortiz
Abstract:
In this work we present a summary of the most relevant results on heavy-ion and astroparticle physics in ALICE. The summary includes a brief overview of the current status on the characterization of the hot and dense QCD medium created in the heavy-ion collisions produced at the LHC, as well as the intriguing finding of collective-like phenomena in small collision systems.
In this work we present a summary of the most relevant results on heavy-ion and astroparticle physics in ALICE. The summary includes a brief overview of the current status on the characterization of the hot and dense QCD medium created in the heavy-ion collisions produced at the LHC, as well as the intriguing finding of collective-like phenomena in small collision systems.
△ Less
Submitted 2 September, 2016;
originally announced September 2016.
-
Revealing the source of the radial flow patterns in proton--proton collisions using hard probes
Authors:
Antonio Ortiz,
Gyula Bencédi,
Héctor Bello
Abstract:
In this work, we propose a tool to reveal the origin of the collective-like phenomena observed in proton--proton collisions. We exploit the fundamental difference between the underlying mechanisms, color reconnection (CR) and hydrodynamics, which produce radial flow patterns in \textsc{Pythia}~8 and \textsc{Epos}~3, respectively. Specifically, we proceed by examining the strength of the coupling b…
▽ More
In this work, we propose a tool to reveal the origin of the collective-like phenomena observed in proton--proton collisions. We exploit the fundamental difference between the underlying mechanisms, color reconnection (CR) and hydrodynamics, which produce radial flow patterns in \textsc{Pythia}~8 and \textsc{Epos}~3, respectively. Specifically, we proceed by examining the strength of the coupling between the soft and hard components which, by construction, is larger in \textsc{Pythia}~8 than in \textsc{Epos}~3.
We study the transverse momentum ($p_{\rm T}$) distributions of charged pions, kaons and (anti)protons in inelastic pp collisions at $\sqrt{s}=$ 7\,TeV produced at mid-rapidity. Specific selections are made on an event-by-event basis as a function of the charged particle multiplicity and the transverse momentum of the leading jet ($p_{\rm T}^{\rm jet}$) reconstructed using the \textsc{FastJet} algorithm at mid-pseudorapidity ($|η|<1$). From our studies, quantitative and qualitative differences between \textsc{Pythia}~8 and \textsc{Epos}~3 are found in the $p_{\rm T}$ spectra when (for a given multiplicity class) the leading jet $p_{\rm T}$ is increased. In addition, we show that for low-multiplicity events the presence of jets can produce radial flow-like behavior. Motivated by our findings, we propose to perform a similar analysis using experimental data from RHIC and LHC.
△ Less
Submitted 26 April, 2017; v1 submitted 16 August, 2016;
originally announced August 2016.
-
Jet effects in high-multiplicity pp events
Authors:
Antonio Ortiz,
Gyula Bencédi,
Héctor Bello,
Satyajit Jena
Abstract:
The study of the high-multiplicity pp events has become important because we need to understand the origin of the fluid-like features which have been found in such small systems. In this work we concentrate on the radial flow signatures. To this end, the role of jets in high-multiplicity pp collisions is investigated using PYTHIA 8.
The study of the high-multiplicity pp events has become important because we need to understand the origin of the fluid-like features which have been found in such small systems. In this work we concentrate on the radial flow signatures. To this end, the role of jets in high-multiplicity pp collisions is investigated using PYTHIA 8.
△ Less
Submitted 16 March, 2016;
originally announced March 2016.
-
The Ext group in the categories of topological abelian groups and topological vector spaces
Authors:
Hugo J. Bello
Abstract:
This paper is devoted to the study of the group ${\rm Ext} (G,H)$ of all extensions of topological abelian groups $0\to H\to X\to G\to 0$ and the group ${\rm Ext}_{TVS} (Z,Y)$ of all extensions of topological vector spaces $0\to Y\to X\to Z\to 0$. We focus on their behaviour under taking products, countable coproducts, dense subgroups and open subgroups. Finally, we apply the obtained properties t…
▽ More
This paper is devoted to the study of the group ${\rm Ext} (G,H)$ of all extensions of topological abelian groups $0\to H\to X\to G\to 0$ and the group ${\rm Ext}_{TVS} (Z,Y)$ of all extensions of topological vector spaces $0\to Y\to X\to Z\to 0$. We focus on their behaviour under taking products, countable coproducts, dense subgroups and open subgroups. Finally, we apply the obtained properties to formulate in a more general setting some known results in the category of locally compact abelian groups and to determine conditions in which being a topological vector space is a three space property.
△ Less
Submitted 7 March, 2016;
originally announced March 2016.
-
Extensions of topological Abelian groups and three-space problems
Authors:
Hugo J. Bello,
María Jesús Chasco,
Xabier Domínguez
Abstract:
A twisted sum in the category of topological abelian groups is a short exact sequence $0\to Y\to X \to Z\to 0$ where all maps are assumed to be continuous and open onto their images. The twisted sum splits if it is equivalent to $0\to Y\to Y \times Z \to Z\to 0$. \par We study the class $\ST$ of topological groups $G$ for which every twisted sum $0\to \T\to X \to G\to 0$ splits. We prove that this…
▽ More
A twisted sum in the category of topological abelian groups is a short exact sequence $0\to Y\to X \to Z\to 0$ where all maps are assumed to be continuous and open onto their images. The twisted sum splits if it is equivalent to $0\to Y\to Y \times Z \to Z\to 0$. \par We study the class $\ST$ of topological groups $G$ for which every twisted sum $0\to \T\to X \to G\to 0$ splits. We prove that this class contains locally precompact groups, sequential direct limits of locally compact groups and topological groups with $\mathcal{L}_\infty$ topologies. We also prove that it is closed by taking open and dense subgroups, quotients by dually embedded subgroups and coproducts. As a technique to find further examples of groups in $\ST$ we use the relation of this class with the existence of quasi-characters on $G$ and with three-space problems for topological groups. The subject is inspired on some concepts known in the framework of topological vector spaces such as the notion of $K$-space, which were interpreted for topological groups by Cabello.
△ Less
Submitted 20 May, 2013;
originally announced May 2013.
