-
A Supervised Embedding and Clustering Anomaly Detection method for classification of Mobile Network Faults
Authors:
R. Mosayebi,
H. Kia,
A. Kianpour Raki
Abstract:
The paper introduces Supervised Embedding and Clustering Anomaly Detection (SEMC-AD), a method designed to efficiently identify faulty alarm logs in a mobile network and alleviate the challenges of manual monitoring caused by the growing volume of alarm logs. SEMC-AD employs a supervised embedding approach based on deep neural networks, utilizing historical alarm logs and their labels to extract n…
▽ More
The paper introduces Supervised Embedding and Clustering Anomaly Detection (SEMC-AD), a method designed to efficiently identify faulty alarm logs in a mobile network and alleviate the challenges of manual monitoring caused by the growing volume of alarm logs. SEMC-AD employs a supervised embedding approach based on deep neural networks, utilizing historical alarm logs and their labels to extract numerical representations for each log, effectively addressing the issue of imbalanced classification due to a small proportion of anomalies in the dataset without employing one-hot encoding. The robustness of the embedding is evaluated by plotting the two most significant principle components of the embedded alarm logs, revealing that anomalies form distinct clusters with similar embeddings. Multivariate normal Gaussian clustering is then applied to these components, identifying clusters with a high ratio of anomalies to normal alarms (above 90%) and labeling them as the anomaly group. To classify new alarm logs, we check if their embedded vectors' two most significant principle components fall within the anomaly-labeled clusters. If so, the log is classified as an anomaly. Performance evaluation demonstrates that SEMC-AD outperforms conventional random forest and gradient boosting methods without embedding. SEMC-AD achieves 99% anomaly detection, whereas random forest and XGBoost only detect 86% and 81% of anomalies, respectively. While supervised classification methods may excel in labeled datasets, the results demonstrate that SEMC-AD is more efficient in classifying anomalies in datasets with numerous categorical features, significantly enhancing anomaly detection, reducing operator burden, and improving network maintenance.
△ Less
Submitted 10 October, 2023;
originally announced October 2023.
-
Clustering of Urban Traffic Patterns by K-Means and Dynamic Time War**: Case Study
Authors:
Sadegh Etemad,
Raziyeh Mosayebi,
Tadeh Alexani Khodavirdian,
Elahe Dastan,
Amir Salari Telmadarreh,
Mohammadreza Jafari,
Sepehr Rafiei
Abstract:
Clustering of urban traffic patterns is an essential task in many different areas of traffic management and planning. In this paper, two significant applications in the clustering of urban traffic patterns are described. The first application estimates the missing speed values using the speed of road segments with similar traffic patterns to colorify map tiles. The second one is the estimation of…
▽ More
Clustering of urban traffic patterns is an essential task in many different areas of traffic management and planning. In this paper, two significant applications in the clustering of urban traffic patterns are described. The first application estimates the missing speed values using the speed of road segments with similar traffic patterns to colorify map tiles. The second one is the estimation of essential road segments for generating addresses for a local point on the map, using the similarity patterns of different road segments. The speed time series extracts the traffic pattern in different road segments. In this paper, we proposed the time series clustering algorithm based on K-Means and Dynamic Time War**. The case study of our proposed algorithm is based on the Snapp application's driver speed time series data. The results of the two applications illustrate that the proposed method can extract similar urban traffic patterns.
△ Less
Submitted 18 September, 2023;
originally announced September 2023.
-
Early Cancer Detection in Blood Vessels Using Mobile Nanosensors
Authors:
Reza Mosayebi,
Arman Ahmadzadeh,
Wayan Wicke,
Vahid Jamali,
Robert Schober,
Masoumeh Nasiri-Kenari
Abstract:
In this paper, we propose using mobile nanosensors (MNSs) for early stage anomaly detection. For concreteness, we focus on the detection of cancer cells located in a particular region of a blood vessel. These cancer cells produce and emit special molecules, so-called biomarkers, which are symptomatic for the presence of anomaly, into the cardiovascular system. Detection of cancer biomarkers with c…
▽ More
In this paper, we propose using mobile nanosensors (MNSs) for early stage anomaly detection. For concreteness, we focus on the detection of cancer cells located in a particular region of a blood vessel. These cancer cells produce and emit special molecules, so-called biomarkers, which are symptomatic for the presence of anomaly, into the cardiovascular system. Detection of cancer biomarkers with conventional blood tests is difficult in the early stages of a cancer due to the very low concentration of the biomarkers in the samples taken. However, close to the cancer cells, the concentration of the cancer biomarkers is high. Hence, detection is possible if a sensor with the ability to detect these biomarkers is placed in the vicinity of the cancer cells. Therefore, in this paper, we study the use of MNSs that are injected at a suitable injection site and can move through the blood vessels of the cardiovascular system, which potentially contain cancer cells. These MNSs can be activated by the biomarkers close to the cancer cells, where the biomarker concentration is sufficiently high. Eventually, the MNSs are collected by a fusion center (FC) where their activation levels are read and exploited to declare the presence of anomaly. We analytically derive the biomarker concentration as well as the probability mass function of the MNSs' activation levels and validate the obtained results via particle-based simulations. Then, we derive the optimal decision rule for the FC regarding the presence of anomaly assuming that the entire network is known at the FC. Finally, for the FC, we propose a simple sum detector that does not require knowledge of the network topology. Our simulations reveal that while the optimal detector achieves a higher performance than the sum detector, both proposed detectors significantly outperform a benchmark scheme that used fixed nanosensors at the FC.
△ Less
Submitted 22 May, 2018;
originally announced May 2018.
-
Advanced Target Detection via Molecular Communication
Authors:
Reza Mosayebi,
Wayan Wicke,
Vahid Jamali,
Arman Ahmadzadeh,
Robert Schober,
Masoumeh Nasiri-Kenari
Abstract:
In this paper, we consider target detection in suspicious tissue via diffusive molecular communications (MCs). If a target is present, it continuously and with a constant rate secretes molecules of a specific type, so-called biomarkers, into the medium, which are symptomatic for the presence of the target. Detection of these biomarkers is challenging since due to the diffusion and degradation, the…
▽ More
In this paper, we consider target detection in suspicious tissue via diffusive molecular communications (MCs). If a target is present, it continuously and with a constant rate secretes molecules of a specific type, so-called biomarkers, into the medium, which are symptomatic for the presence of the target. Detection of these biomarkers is challenging since due to the diffusion and degradation, the biomarkers are only detectable in the vicinity of the target. In addition, the exact location of the target within the tissue is not known. In this paper, we propose to distribute several reactive nanosensors (NSs) across the tissue such that at least some of them are expected to come in contact with biomarkers, which cause them to become activated. Upon activation, an NS releases a certain number of molecules of a secondary type into the medium to alert a fusion center (FC), where the final decision regarding the presence of the target is made. In particular, we consider a composite hypothesis testing framework where it is assumed that the location of the target and the biomarker secretion rate are unknown, whereas the locations of the NSs are known. We derive the uniformly most powerful (UMP) test for the detection at the NSs. For the final decision at the FC, we show that the UMP test does not exist. Hence, we derive a genie-aided detector as an upper bound on performance. We then propose two sub-optimal detectors and evaluate their performance via simulations
△ Less
Submitted 3 May, 2018;
originally announced May 2018.
-
Cooperative Abnormality Detection via Diffusive Molecular Communications
Authors:
Reza Mosayebi,
Vahid Jamali,
Nafiseh Ghoroghchian,
Robert Schober,
Masoumeh Nasiri-Kenari,
Mahdieh Mehrabi
Abstract:
In this paper, we consider abnormality detection via diffusive molecular communications (MCs) for a network consisting of several sensors and a fusion center (FC). If a sensor detects an abnormality, it injects into the medium a number of molecules which is proportional to the sensed value. Two transmission schemes for releasing molecules into the medium are considered. In the first scheme, referr…
▽ More
In this paper, we consider abnormality detection via diffusive molecular communications (MCs) for a network consisting of several sensors and a fusion center (FC). If a sensor detects an abnormality, it injects into the medium a number of molecules which is proportional to the sensed value. Two transmission schemes for releasing molecules into the medium are considered. In the first scheme, referred to as DTM, each sensor releases a different type of molecule, whereas in the second scheme, referred to as STM, all sensors release the same type of molecule. The molecules released by the sensors propagate through the MC channel and some may reach the FC where the final decision regarding whether or not an abnormality has occurred is made. We derive the optimal decision rules for both DTM and STM. However, the optimal detectors entail high computational complexity as log-likelihood ratios (LLRs) have to be computed. To overcome this issue, we show that the optimal decision rule for STM can be transformed into an equivalent low-complexity decision rule. Since a similar transformation is not possible for DTM, we propose simple low-complexity sub-optimal detectors based on different approximations of the LLR. The proposed low-complexity detectors are more suitable for practical MC systems than the original complex optimal decision rule, particularly when the FC is a nano-machine with limited computational capabilities. Furthermore, we analyze the performance of the proposed detectors in terms of their false alarm and missed detection probabilities. Simulation results verify our analytical derivations and reveal interesting insights regarding the trade-off between complexity and performance of the proposed detectors and the considered DTM and STM schemes.
△ Less
Submitted 29 March, 2017;
originally announced March 2017.
-
Type Based Sign Modulation and its Application for ISI mitigation in Molecular Communication
Authors:
Reza Mosayebi,
Amin Gohari,
Mahtab Mirmohseni,
Masoumeh Nasiri Kenari
Abstract:
An important challenge in design of modulation schemes for molecular communication is positivity of the transmission signal (only a positive concentration of molecules can be released in the environment). This restriction makes handling of the InterSymbol Interference (ISI) a challenge for molecular communication. Previous works have proposed use of chemical reactions to remove molecules from the…
▽ More
An important challenge in design of modulation schemes for molecular communication is positivity of the transmission signal (only a positive concentration of molecules can be released in the environment). This restriction makes handling of the InterSymbol Interference (ISI) a challenge for molecular communication. Previous works have proposed use of chemical reactions to remove molecules from the environment, and to effectively simulate negative signals. However, the differential equation describing a diffusion-reaction process is non-linear. This precludes the possibility of using Fourier transform tools. In this paper, a solution for simulating negative signals based on the diffusion-reaction channel model is proposed. While the proposed solution does not exploit the full degrees of freedom available for signaling in a diffusion-reaction process, but its end-to-end system is a linear channel and amenable to Fourier transform analysis. Based on our solution, a modulation scheme and a precoder are introduced and shown to have a significant reduction in error probability compared to previous modulation schemes such as CSK and MCSK. The effect of various imperfections (such as quantization error) on the communication system performance are studied.
△ Less
Submitted 14 December, 2016; v1 submitted 6 March, 2016;
originally announced March 2016.
-
Receivers for Diffusion-Based Molecular Communication: Exploiting Memory and Sampling Rate
Authors:
Reza Mosayebi,
Hamidreza Arjmandi,
Amin Gohari,
Masoumeh Nasiri Kenari,
Urbashi Mitra
Abstract:
In this paper, a diffusion-based molecular communication channel between two nano-machines is considered. The effect of the amount of memory on performance is characterized, and a simple memory-limited decoder is proposed and its performance is shown to be close to that of the best possible imaginable decoder (without any restriction on the computational complexity or its functional form), using G…
▽ More
In this paper, a diffusion-based molecular communication channel between two nano-machines is considered. The effect of the amount of memory on performance is characterized, and a simple memory-limited decoder is proposed and its performance is shown to be close to that of the best possible imaginable decoder (without any restriction on the computational complexity or its functional form), using Genie-aided upper bounds. This effect is specialized for the case of Molecular Concentration Shift Keying; it is shown that a four-bits memory achieved nearly the same performance as infinite memory. Then a general class of threshold decoders is considered and shown not to be optimal for Poisson channel with memory, unless SNR is higher than a value specified in the paper. Another contribution is to show that receiver sampling at a rate higher than the transmission rate, i.e., a multi-read system, can significantly improve the performance. The associated decision rule for this system is shown to be a weighted sum of the samples during each symbol interval. The performance of the system is analyzed using the saddle point approximation. The best performance gains are achieved for an oversampling factor of three.
△ Less
Submitted 2 May, 2014; v1 submitted 1 May, 2014;
originally announced May 2014.