-
Predicting Feynman periods in $φ^4$-theory
Authors:
Paul-Hermann Balduf,
Kimia Shaban
Abstract:
We present efficient data-driven approaches to predict Feynman periods in $φ^4$-theory from properties of the underlying Feynman graphs. We find that the numbers of cuts and cycles determines the period to approximately 2% accuracy. Hepp bound and Martin invariant allow to predict the period with accuracy much better than 1%. In most cases, the period is a multi-linear function of the parameters i…
▽ More
We present efficient data-driven approaches to predict Feynman periods in $φ^4$-theory from properties of the underlying Feynman graphs. We find that the numbers of cuts and cycles determines the period to approximately 2% accuracy. Hepp bound and Martin invariant allow to predict the period with accuracy much better than 1%. In most cases, the period is a multi-linear function of the parameters in question. Besides classical correlation analysis, we also investigate the usefulness of machine-learning algorithms to predict the period. When sufficiently many properties of the graph are used, the period can be predicted with better than 0.05% relative accuracy.
We use one of the constructed prediction models for weighted Monte-Carlo sampling of Feynman graphs, and compute the primitive contribution to the beta function of $φ^4$-theory at $L\in \left \lbrace 13, 14, 15, 16 \right \rbrace $ loops. Our results confirm the previously known numerical estimates of the primitive beta function and improve their accuracy. Compared to uniform random sampling of graphs, our new algorithm reaches 35-fold higher accuracy in fixed runtime, or requires 1000-fold less runtime to reach a given accuracy.
The data set of all periods computed for this work, combined with a previous data set, is made publicly available. Besides the physical application, it could serve as a benchmark for graph-based machine learning algorithms.
△ Less
Submitted 24 March, 2024;
originally announced March 2024.
-
ASEM: Enhancing Empathy in Chatbot through Attention-based Sentiment and Emotion Modeling
Authors:
Omama Hamad,
Ali Hamdi,
Khaled Shaban
Abstract:
Effective feature representations play a critical role in enhancing the performance of text generation models that rely on deep neural networks. However, current approaches suffer from several drawbacks, such as the inability to capture the deep semantics of language and sensitivity to minor input variations, resulting in significant changes in the generated text. In this paper, we present a novel…
▽ More
Effective feature representations play a critical role in enhancing the performance of text generation models that rely on deep neural networks. However, current approaches suffer from several drawbacks, such as the inability to capture the deep semantics of language and sensitivity to minor input variations, resulting in significant changes in the generated text. In this paper, we present a novel solution to these challenges by employing a mixture of experts, multiple encoders, to offer distinct perspectives on the emotional state of the user's utterance while simultaneously enhancing performance. We propose an end-to-end model architecture called ASEM that performs emotion analysis on top of sentiment analysis for open-domain chatbots, enabling the generation of empathetic responses that are fluent and relevant. In contrast to traditional attention mechanisms, the proposed model employs a specialized attention strategy that uniquely zeroes in on sentiment and emotion nuances within the user's utterance. This ensures the generation of context-rich representations tailored to the underlying emotional tone and sentiment intricacies of the text. Our approach outperforms existing methods for generating empathetic embeddings, providing empathetic and diverse responses. The performance of our proposed model significantly exceeds that of existing models, enhancing emotion detection accuracy by 6.2% and lexical diversity by 1.4%.
△ Less
Submitted 25 February, 2024;
originally announced February 2024.
-
MARL: Multimodal Attentional Representation Learning for Disease Prediction
Authors:
Ali Hamdi,
Amr Aboeleneen,
Khaled Shaban
Abstract:
Existing learning models often utilise CT-scan images to predict lung diseases. These models are posed by high uncertainties that affect lung segmentation and visual feature learning. We introduce MARL, a novel Multimodal Attentional Representation Learning model architecture that learns useful features from multimodal data under uncertainty. We feed the proposed model with both the lung CT-scan i…
▽ More
Existing learning models often utilise CT-scan images to predict lung diseases. These models are posed by high uncertainties that affect lung segmentation and visual feature learning. We introduce MARL, a novel Multimodal Attentional Representation Learning model architecture that learns useful features from multimodal data under uncertainty. We feed the proposed model with both the lung CT-scan images and their perspective historical patients' biological records collected over times. Such rich data offers to analyse both spatial and temporal aspects of the disease. MARL employs Fuzzy-based image spatial segmentation to overcome uncertainties in CT-scan images. We then utilise a pre-trained Convolutional Neural Network (CNN) to learn visual representation vectors from images. We augment patients' data with statistical features from the segmented images. We develop a Long Short-Term Memory (LSTM) network to represent the augmented data and learn sequential patterns of disease progressions. Finally, we inject both CNN and LSTM feature vectors to an attention layer to help focus on the best learning features. We evaluated MARL on regression of lung disease progression and status classification. MARL outperforms state-of-the-art CNN architectures, such as EfficientNet and DenseNet, and baseline prediction models. It achieves a 91% R^2 score, which is higher than the other models by a range of 8% to 27%. Also, MARL achieves 97% and 92% accuracy for binary and multi-class classification, respectively. MARL improves the accuracy of state-of-the-art CNN models with a range of 19% to 57%. The results show that combining spatial and sequential temporal features produces better discriminative feature.
△ Less
Submitted 1 May, 2021;
originally announced May 2021.
-
Spatiotemporal Data Mining: A Survey on Challenges and Open Problems
Authors:
Ali Hamdi,
Khaled Shaban,
Abdelkarim Erradi,
Amr Mohamed,
Shakila Khan Rumi,
Flora Salim
Abstract:
Spatiotemporal data mining (STDM) discovers useful patterns from the dynamic interplay between space and time. Several available surveys capture STDM advances and report a wealth of important progress in this field. However, STDM challenges and problems are not thoroughly discussed and presented in articles of their own. We attempt to fill this gap by providing a comprehensive literature survey on…
▽ More
Spatiotemporal data mining (STDM) discovers useful patterns from the dynamic interplay between space and time. Several available surveys capture STDM advances and report a wealth of important progress in this field. However, STDM challenges and problems are not thoroughly discussed and presented in articles of their own. We attempt to fill this gap by providing a comprehensive literature survey on state-of-the-art advances in STDM. We describe the challenging issues and their causes and open gaps of multiple STDM directions and aspects. Specifically, we investigate the challenging issues in regards to spatiotemporal relationships, interdisciplinarity, discretisation, and data characteristics. Moreover, we discuss the limitations in the literature and open research problems related to spatiotemporal data representations, modelling and visualisation, and comprehensiveness of approaches. We explain issues related to STDM tasks of classification, clustering, hotspot detection, association and pattern mining, outlier detection, visualisation, visual analytics, and computer vision tasks. We also highlight STDM issues related to multiple applications including crime and public safety, traffic and transportation, earth and environment monitoring, epidemiology, social media, and Internet of Things.
△ Less
Submitted 31 March, 2021;
originally announced March 2021.
-
Investigate a dense transparent glass doped Nd3+ ion for high power laser applications
Authors:
A A El-Maaref,
Essam Abdel Wahab,
Kh Shaaban
Abstract:
Emission and absorption cross sections of the prepared materials will be measured at different spectral regions.
Emission and absorption cross sections of the prepared materials will be measured at different spectral regions.
△ Less
Submitted 11 August, 2020;
originally announced August 2020.
-
Model-Based Risk Assessment for Cyber Physical Systems Security
Authors:
Ashraf Tantawy,
Abdelkarim Erradi,
Sherif Abdelwahed,
Khaled Shaban
Abstract:
Traditional techniques for Cyber-Physical Systems (CPS) security design either treat the cyber and physical systems independently, or do not address the specific vulnerabilities of real time embedded controllers and networks used to monitor and control physical processes. In this work, we develop and test an integrated model-based approach for CPS security risk assessment utilizing a CPS testbed w…
▽ More
Traditional techniques for Cyber-Physical Systems (CPS) security design either treat the cyber and physical systems independently, or do not address the specific vulnerabilities of real time embedded controllers and networks used to monitor and control physical processes. In this work, we develop and test an integrated model-based approach for CPS security risk assessment utilizing a CPS testbed with real-world industrial controllers and communication protocols. The testbed monitors and controls an exothermic Continuous Stirred Tank Reactor (CSTR) simulated in real-time. CSTR is a fundamental process unit in many industries, including Oil \& Gas, Petrochemicals, Water treatment, and nuclear industry. In addition, the process is rich in terms of hazardous scenarios that could be triggered by cyber attacks due to the lack of possible mechanical protection. The paper presents an integrated approach to analyze and design the cyber security system for a given CPS where the physical threats are identified first to guide the risk assessment process. A mathematical model is derived for the physical system using a hybrid automaton to enumerate potential hazardous states of the system. The cyber system is then analyzed using network and data flow models to develop the attack scenarios that may lead to the identified hazards. Finally, the attack scenarios are performed on the testbed and observations are obtained on the possible ways to prevent and mitigate the attacks. The insights gained from the experiments result in several key findings, including the expressive power of hybrid automaton in security risk assessment, the hazard development time and its impact on cyber security design, and the tight coupling between the physical and the cyber systems for CPS that requires an integrated design approach to achieve cost-effective and secure designs.
△ Less
Submitted 27 May, 2020;
originally announced May 2020.
-
ArSentD-LEV: A Multi-Topic Corpus for Target-based Sentiment Analysis in Arabic Levantine Tweets
Authors:
Ramy Baly,
Alaa Khaddaj,
Hazem Hajj,
Wassim El-Hajj,
Khaled Bashir Shaban
Abstract:
Sentiment analysis is a highly subjective and challenging task. Its complexity further increases when applied to the Arabic language, mainly because of the large variety of dialects that are unstandardized and widely used in the Web, especially in social media. While many datasets have been released to train sentiment classifiers in Arabic, most of these datasets contain shallow annotation, only m…
▽ More
Sentiment analysis is a highly subjective and challenging task. Its complexity further increases when applied to the Arabic language, mainly because of the large variety of dialects that are unstandardized and widely used in the Web, especially in social media. While many datasets have been released to train sentiment classifiers in Arabic, most of these datasets contain shallow annotation, only marking the sentiment of the text unit, as a word, a sentence or a document. In this paper, we present the Arabic Sentiment Twitter Dataset for the Levantine dialect (ArSenTD-LEV). Based on findings from analyzing tweets from the Levant region, we created a dataset of 4,000 tweets with the following annotations: the overall sentiment of the tweet, the target to which the sentiment was expressed, how the sentiment was expressed, and the topic of the tweet. Results confirm the importance of these annotations at improving the performance of a baseline sentiment classifier. They also confirm the gap of training in a certain domain, and testing in another domain.
△ Less
Submitted 25 May, 2019;
originally announced June 2019.
-
Directed Graph-based Wireless EEG Sensor Channel Selection Approach for Cognitive Task Classification
Authors:
Abduljalil Mohamed,
Khaled Bashir Shaban,
Amr Mohamed
Abstract:
Wireless electroencephalogram (EEG) sensors have been successfully applied in many medical and computer brain interface classifications. A common characteristic of wireless EEG sensors is that they are low powered devices, and hence an efficient usage of sensor energy resources is critical for any practical application. One way of minimizing energy consumption by the EEG sensors is by reducing the…
▽ More
Wireless electroencephalogram (EEG) sensors have been successfully applied in many medical and computer brain interface classifications. A common characteristic of wireless EEG sensors is that they are low powered devices, and hence an efficient usage of sensor energy resources is critical for any practical application. One way of minimizing energy consumption by the EEG sensors is by reducing the number of EEG channels participating in the classification process. For the purpose of classifying EEG signals, we propose a directed acyclic graph (DAG)-based channel selection algorithm. To achieve this objective, the EEG sensor channels are first realized in a complete undirected graph, where each channel is represented by a node. An edge between any two nodes indicates the collaboration between these nodes in identifying the system state; and the significance of this collaboration is quantified by a weight assigned to the edge. The complete graph is then reduced into a directed acyclic graph that encodes the knowledge of the non-increasing order of the channel ranking for each cognitive task. The channel selection algorithm utilizes this directed graph to find a maximum path such that the total weight of this path satisfies a predefined threshold. It has been demonstrated experimentally that channel utilization has been reduced by 50% in the worst case scenario for a three-state system and an EEG sensor with 14 channels; and the best classification accuracy obtained is 81%.
△ Less
Submitted 10 September, 2016;
originally announced September 2016.