Showing 1–21 of 21 results for author: Dehshibi, M M

L-SFAN: Lightweight Spatially-focused Attention Network for Pain Behavior Detection

Authors: Jorge Ortigoso-Narro, Fernando Diaz-de-Maria, Mohammad Mahdi Dehshibi, Ana Tajadura-Jiménez

Abstract: Chronic Low Back Pain (CLBP) afflicts millions globally, significantly impacting individuals' well-being and imposing economic burdens on healthcare systems. While artificial intelligence (AI) and deep learning offer promising avenues for analyzing pain-related behaviors to improve rehabilitation strategies, current models, including convolutional neural networks (CNNs), recurrent neural networks,… ▽ More Chronic Low Back Pain (CLBP) afflicts millions globally, significantly impacting individuals' well-being and imposing economic burdens on healthcare systems. While artificial intelligence (AI) and deep learning offer promising avenues for analyzing pain-related behaviors to improve rehabilitation strategies, current models, including convolutional neural networks (CNNs), recurrent neural networks, and graph-based neural networks, have limitations. These approaches often focus singularly on the temporal dimension or require complex architectures to exploit spatial interrelationships within multivariate time series data. To address these limitations, we introduce \hbox{L-SFAN}, a lightweight CNN architecture incorporating 2D filters designed to meticulously capture the spatial-temporal interplay of data from motion capture and surface electromyography sensors. Our proposed model, enhanced with an oriented global pooling layer and multi-head self-attention mechanism, prioritizes critical features to better understand CLBP and achieves competitive classification accuracy. Experimental results on the EmoPain database demonstrate that our approach not only enhances performance metrics with significantly fewer parameters but also promotes model interpretability, offering valuable insights for clinicians in managing CLBP. This advancement underscores the potential of AI in transforming healthcare practices for chronic conditions like CLBP, providing a sophisticated framework for the nuanced analysis of complex biomedical data. △ Less

Submitted 7 June, 2024; originally announced June 2024.

SoniWeight Shoes: Investigating Effects and Personalization of a Wearable Sound Device for Altering Body Perception and Behavior

Authors: A. D'Adamo, M. Roel-Lesur, L. Turmo-Vidal, M. M. Dehshibi, D. De La Prida, J. R. Diaz-Duran, L. A. Azpicueta-Ruiz, A. Väljamäe, A. Tajadura-Jiménez

Abstract: Changes in body perception influence behavior and emotion and can be induced through multisensory feedback. Auditory feedback to one's actions can trigger such alterations; however, it is unclear which individual factors modulate these effects. We employ and evaluate SoniWeight Shoes, a wearable device based on literature for altering one's weight perception through manipulated footstep sounds. In… ▽ More Changes in body perception influence behavior and emotion and can be induced through multisensory feedback. Auditory feedback to one's actions can trigger such alterations; however, it is unclear which individual factors modulate these effects. We employ and evaluate SoniWeight Shoes, a wearable device based on literature for altering one's weight perception through manipulated footstep sounds. In a healthy population sample across a spectrum of individuals (n=84) with varying degrees of eating disorder symptomatology, physical activity levels, body concerns, and mental imagery capacities, we explore the effects of three sound conditions (low-frequency, high-frequency and control) on extensive body perception measures (demographic, behavioral, physiological, psychological, and subjective). Analyses revealed an impact of individual differences in each of these dimensions. Besides replicating previous findings, we reveal and highlight the role of individual differences in body perception, offering avenues for personalized sonification strategies. Datasets, technical refinements, and novel body map quantification tools are provided. △ Less

Submitted 11 March, 2024; originally announced March 2024.

Comments: Conditionally Accepted in CHI '24 Conference

Spatial-aware Transformer-GRU Framework for Enhanced Glaucoma Diagnosis from 3D OCT Imaging

Authors: Mona Ashtari-Majlan, Mohammad Mahdi Dehshibi, David Masip

Abstract: Glaucoma, a leading cause of irreversible blindness, necessitates early detection for accurate and timely intervention to prevent irreversible vision loss. In this study, we present a novel deep learning framework that leverages the diagnostic value of 3D Optical Coherence Tomography (OCT) imaging for automated glaucoma detection. In this framework, we integrate a pre-trained Vision Transformer on… ▽ More Glaucoma, a leading cause of irreversible blindness, necessitates early detection for accurate and timely intervention to prevent irreversible vision loss. In this study, we present a novel deep learning framework that leverages the diagnostic value of 3D Optical Coherence Tomography (OCT) imaging for automated glaucoma detection. In this framework, we integrate a pre-trained Vision Transformer on retinal data for rich slice-wise feature extraction and a bidirectional Gated Recurrent Unit for capturing inter-slice spatial dependencies. This dual-component approach enables comprehensive analysis of local nuances and global structural integrity, crucial for accurate glaucoma diagnosis. Experimental results on a large dataset demonstrate the superior performance of the proposed method over state-of-the-art ones, achieving an F1-score of 93.58%, Matthews Correlation Coefficient (MCC) of 73.54%, and AUC of 95.24%. The framework's ability to leverage the valuable information in 3D OCT data holds significant potential for enhancing clinical decision support systems and improving patient outcomes in glaucoma management. △ Less

Submitted 8 March, 2024; originally announced March 2024.

BEE-NET: A deep neural network to identify in-the-wild Bodily Expression of Emotions

Authors: Mohammad Mahdi Dehshibi, David Masip

Abstract: In this study, we investigate how environmental factors, specifically the scenes and objects involved, can affect the expression of emotions through body language. To this end, we introduce a novel multi-stream deep convolutional neural network named BEE-NET. We also propose a new late fusion strategy that incorporates meta-information on places and objects as prior knowledge in the learning proce… ▽ More In this study, we investigate how environmental factors, specifically the scenes and objects involved, can affect the expression of emotions through body language. To this end, we introduce a novel multi-stream deep convolutional neural network named BEE-NET. We also propose a new late fusion strategy that incorporates meta-information on places and objects as prior knowledge in the learning process. Our proposed probabilistic pooling model leverages this information to generate a joint probability distribution of both available and anticipated non-available contextual information in latent space. Importantly, our fusion strategy is differentiable, allowing for end-to-end training and capturing of hidden associations among data points without requiring further post-processing or regularisation. To evaluate our deep model, we use the Body Language Database (BoLD), which is currently the largest available database for the Automatic Identification of the in-the-wild Bodily Expression of Emotions (AIBEE). Our experimental results demonstrate that our proposed approach surpasses the current state-of-the-art in AIBEE by a margin of 2.07%, achieving an Emotional Recognition Score of 66.33%. △ Less

Submitted 21 February, 2024; originally announced February 2024.

Deep Learning and Computer Vision for Glaucoma Detection: A Review

Authors: Mona Ashtari-Majlan, Mohammad Mahdi Dehshibi, David Masip

Abstract: Glaucoma is the leading cause of irreversible blindness worldwide and poses significant diagnostic challenges due to its reliance on subjective evaluation. However, recent advances in computer vision and deep learning have demonstrated the potential for automated assessment. In this paper, we survey recent studies on AI-based glaucoma diagnosis using fundus, optical coherence tomography, and visua… ▽ More Glaucoma is the leading cause of irreversible blindness worldwide and poses significant diagnostic challenges due to its reliance on subjective evaluation. However, recent advances in computer vision and deep learning have demonstrated the potential for automated assessment. In this paper, we survey recent studies on AI-based glaucoma diagnosis using fundus, optical coherence tomography, and visual field images, with a particular emphasis on deep learning-based methods. We provide an updated taxonomy that organizes methods into architectural paradigms and includes links to available source code to enhance the reproducibility of the methods. Through rigorous benchmarking on widely-used public datasets, we reveal performance gaps in generalizability, uncertainty estimation, and multimodal integration. Additionally, our survey curates key datasets while highlighting limitations such as scale, labeling inconsistencies, and bias. We outline open research challenges and detail promising directions for future studies. This survey is expected to be useful for both AI researchers seeking to translate advances into practice and ophthalmologists aiming to improve clinical workflows and diagnosis using the latest AI outcomes. △ Less

Submitted 31 July, 2023; originally announced July 2023.

Pain level and pain-related behaviour classification using GRU-based sparsely-connected RNNs

Authors: Mohammad Mahdi Dehshibi, Temitayo Olugbade, Fernando Diaz-de-Maria, Nadia Bianchi-Berthouze, Ana Tajadura-Jiménez

Abstract: There is a growing body of studies on applying deep learning to biometrics analysis. Certain circumstances, however, could impair the objective measures and accuracy of the proposed biometric data analysis methods. For instance, people with chronic pain (CP) unconsciously adapt specific body movements to protect themselves from injury or additional pain. Because there is no dedicated benchmark dat… ▽ More There is a growing body of studies on applying deep learning to biometrics analysis. Certain circumstances, however, could impair the objective measures and accuracy of the proposed biometric data analysis methods. For instance, people with chronic pain (CP) unconsciously adapt specific body movements to protect themselves from injury or additional pain. Because there is no dedicated benchmark database to analyse this correlation, we considered one of the specific circumstances that potentially influence a person's biometrics during daily activities in this study and classified pain level and pain-related behaviour in the EmoPain database. To achieve this, we proposed a sparsely-connected recurrent neural networks (s-RNNs) ensemble with the gated recurrent unit (GRU) that incorporates multiple autoencoders using a shared training framework. This architecture is fed by multidimensional data collected from inertial measurement unit (IMU) and surface electromyography (sEMG) sensors. Furthermore, to compensate for variations in the temporal dimension that may not be perfectly represented in the latent space of s-RNNs, we fused hand-crafted features derived from information-theoretic approaches with represented features in the shared hidden state. We conducted several experiments which indicate that the proposed method outperforms the state-of-the-art approaches in classifying both pain level and pain-related behaviour. △ Less

Submitted 20 December, 2022; originally announced December 2022.

Journal ref: IEEE Journal of Selected Topics in Signal Processing, 17 (3), 2023, 677-688

Neuropunk Revolution. Hacking Cognitive Systems towards Cyborgs 3.0

Authors: Max Talanov, Jordi Vallverdu, Andrew Adamatzky, Alexander Toschev, Alina Suleimanova, Alexey Leukhin, Ann Posdeeva, Yulia Mikhailova, Alice Rodionova, Alexey Mikhaylov, Alexander Serb, Sergey Shchanikov, Svetlana Gerasimova, Mohammad Mahdi Dehshibi, Alexander Hramov, Victor Kazantsev, Tatyana Tsoy, Evgeni Magid, Igor Lavrov, Victor Erokhin, Kevin Warwick

Abstract: This work is dedicated to the review and perspective of the new direction that we call "Neuropunk revolution" resembling the cultural phenomenon of cyberpunk. This new phenomenon has its foundations in advances in neuromorphic technologies including memristive and bio-plausible simulations, BCI, and neurointerfaces as well as unconventional approaches to AI and computing in general. We present the… ▽ More This work is dedicated to the review and perspective of the new direction that we call "Neuropunk revolution" resembling the cultural phenomenon of cyberpunk. This new phenomenon has its foundations in advances in neuromorphic technologies including memristive and bio-plausible simulations, BCI, and neurointerfaces as well as unconventional approaches to AI and computing in general. We present the review of the current state-of-the-art and our vision of near future development of scientific approaches and future technologies. We call the "Neuropunk revolution" the set of trends that in our view provide the necessary background for the new generation of approaches technologies to integrate the cybernetic objects with biological tissues in close loop system as well as robotic systems inspired by the biological processes again integrated with biological objects. We see bio-plausible simulations implemented by digital computers or spiking networks memristive hardware as promising bridge or middleware between digital and (neuro)biological domains. △ Less

Submitted 13 May, 2022; originally announced May 2022.

A multi-stream convolutional neural network for classification of progressive MCI in Alzheimer's disease using structural MRI images

Authors: Mona Ashtari-Majlan, Abbas Seifi, Mohammad Mahdi Dehshibi

Abstract: Early diagnosis of Alzheimer's disease and its prodromal stage, also known as mild cognitive impairment (MCI), is critical since some patients with progressive MCI will develop the disease. We propose a multi-stream deep convolutional neural network fed with patch-based imaging data to classify stable MCI and progressive MCI. First, we compare MRI images of Alzheimer's disease with cognitively nor… ▽ More Early diagnosis of Alzheimer's disease and its prodromal stage, also known as mild cognitive impairment (MCI), is critical since some patients with progressive MCI will develop the disease. We propose a multi-stream deep convolutional neural network fed with patch-based imaging data to classify stable MCI and progressive MCI. First, we compare MRI images of Alzheimer's disease with cognitively normal subjects to identify distinct anatomical landmarks using a multivariate statistical test. These landmarks are then used to extract patches that are fed into the proposed multi-stream convolutional neural network to classify MRI images. Next, we train the architecture in a separate scenario using samples from Alzheimer's disease images, which are anatomically similar to the progressive MCI ones and cognitively normal images to compensate for the lack of progressive MCI training data. Finally, we transfer the trained model weights to the proposed architecture in order to fine-tune the model using progressive MCI and stable MCI data. Experimental results on the ADNI-1 dataset indicate that our method outperforms existing methods for MCI classification, with an F1-score of 85.96%. △ Less

Submitted 3 March, 2022; originally announced March 2022.

Journal ref: IEEE Journal of Biomedical and Health Informatics, 26 (8), 2022, pp. 3918 - 3926

ADVISE: ADaptive Feature Relevance and VISual Explanations for Convolutional Neural Networks

Authors: Mohammad Mahdi Dehshibi, Mona Ashtari-Majlan, Gereziher Adhane, David Masip

Abstract: To equip Convolutional Neural Networks (CNNs) with explainability, it is essential to interpret how opaque models take specific decisions, understand what causes the errors, improve the architecture design, and identify unethical biases in the classifiers. This paper introduces ADVISE, a new explainability method that quantifies and leverages the relevance of each unit of the feature map to provid… ▽ More To equip Convolutional Neural Networks (CNNs) with explainability, it is essential to interpret how opaque models take specific decisions, understand what causes the errors, improve the architecture design, and identify unethical biases in the classifiers. This paper introduces ADVISE, a new explainability method that quantifies and leverages the relevance of each unit of the feature map to provide better visual explanations. To this end, we propose using adaptive bandwidth kernel density estimation to assign a relevance score to each unit of the feature map with respect to the predicted class. We also propose an evaluation protocol to quantitatively assess the visual explainability of CNN models. We extensively evaluate our idea in the image classification task using AlexNet, VGG16, ResNet50, and Xception pretrained on ImageNet. We compare ADVISE with the state-of-the-art visual explainable methods and show that the proposed method outperforms competing approaches in quantifying feature-relevance and visual explainability while maintaining competitive time complexity. Our experiments further show that ADVISE fulfils the sensitivity and implementation independence axioms while passing the sanity checks. The implementation is accessible for reproducibility purposes on https://github.com/dehshibi/ADVISE. △ Less

Submitted 2 March, 2022; originally announced March 2022.

Journal ref: The Visual Computer, 2023, 1-13

Fungal electronics

Authors: Andrew Adamatzky, Phil Ayres, Alexander E. Beasley, Alessandro Chiolerio, Mohammad M. Dehshibi, Antoni Gandia, Elena Albergati, Richard Mayne, Anna Nikolaidou, Nic Roberts, Martin Tegelaar, Michail-Antisthenis Tsompanas, Neil Phillips, Han A. B. Wösten

Abstract: Fungal electronics is a family of living electronic devices made of mycelium bound composites or pure mycelium. Fungal electronic devices are capable of changing their impedance and generating spikes of electrical potential in response to external control parameters. Fungal electronics can be embedded into fungal materials and wearables or used as stand alone sensing and computing devices. Fungal electronics is a family of living electronic devices made of mycelium bound composites or pure mycelium. Fungal electronic devices are capable of changing their impedance and generating spikes of electrical potential in response to external control parameters. Fungal electronics can be embedded into fungal materials and wearables or used as stand alone sensing and computing devices. △ Less

Submitted 22 November, 2021; originally announced November 2021.

A deep convolutional neural network for classification of Aedes albopictus mosquitoes

Authors: Gereziher Adhane, Mohammad Mahdi Dehshibi, David Masip

Abstract: Monitoring the spread of disease-carrying mosquitoes is a first and necessary step to control severe diseases such as dengue, chikungunya, Zika or yellow fever. Previous citizen science projects have been able to obtain large image datasets with linked geo-tracking information. As the number of international collaborators grows, the manual annotation by expert entomologists of the large amount of… ▽ More Monitoring the spread of disease-carrying mosquitoes is a first and necessary step to control severe diseases such as dengue, chikungunya, Zika or yellow fever. Previous citizen science projects have been able to obtain large image datasets with linked geo-tracking information. As the number of international collaborators grows, the manual annotation by expert entomologists of the large amount of data gathered by these users becomes too time demanding and unscalable, posing a strong need for automated classification of mosquito species from images. We introduce the application of two Deep Convolutional Neural Networks in a comparative study to automate this classification task. We use the transfer learning principle to train two state-of-the-art architectures on the data provided by the Mosquito Alert project, obtaining testing accuracy of 94%. In addition, we applied explainable models based on the Grad-CAM algorithm to visualise the most discriminant regions of the classified images, which coincide with the white band stripes located at the legs, abdomen, and thorax of mosquitoes of the Aedes albopictus species. The model allows us to further analyse the classification errors. Visual Grad-CAM models show that they are linked to poor acquisition conditions and strong image occlusions. △ Less

Submitted 29 October, 2021; originally announced October 2021.

Journal ref: IEEE Access, vol. 9, pp. 72681-72690, 2021

On the use of uncertainty in classifying Aedes Albopictus mosquitoes

Authors: Gereziher Adhane, Mohammad Mahdi Dehshibi, David Masip

Abstract: The re-emergence of mosquito-borne diseases (MBDs), which kill hundreds of thousands of people each year, has been attributed to increased human population, migration, and environmental changes. Convolutional neural networks (CNNs) have been used by several studies to recognise mosquitoes in images provided by projects such as Mosquito Alert to assist entomologists in identifying, monitoring, and… ▽ More The re-emergence of mosquito-borne diseases (MBDs), which kill hundreds of thousands of people each year, has been attributed to increased human population, migration, and environmental changes. Convolutional neural networks (CNNs) have been used by several studies to recognise mosquitoes in images provided by projects such as Mosquito Alert to assist entomologists in identifying, monitoring, and managing MBD. Nonetheless, utilising CNNs to automatically label input samples could involve incorrect predictions, which may mislead future epidemiological studies. Furthermore, CNNs require large numbers of manually annotated data. In order to address the mentioned issues, this paper proposes using the Monte Carlo Dropout method to estimate the uncertainty scores in order to rank the classified samples to reduce the need for human supervision in recognising Aedes albopictus mosquitoes. The estimated uncertainty was also used in an active learning framework, where just a portion of the data from large training sets was manually labelled. The experimental results show that the proposed classification method with rejection outperforms the competing methods by improving overall performance and reducing entomologist annotation workload. We also provide explainable visualisations of the different regions that contribute to a set of samples' uncertainty assessment. △ Less

Submitted 29 October, 2021; originally announced October 2021.

Comments: This article has been accepted for publication in a future issue of IEEE Journal of Selected Topics in Signal Processing

On stimulating fungi $Pleurotus~ostreatus$ with Cortisol

Authors: Mohammad Mahdi Dehshibi, Alessandro Chiolerio, Anna Nikolaidou, Richard Mayne, Antoni Gandia, Mona Ashtari, Andrew Adamatzky

Abstract: Fungi cells are capable of sensing extracellular cues through reception, transduction and response systems which allow them to communicate with their host and adapt to their environment. They display effective regulatory protein expressions which enhance and regulate their response and adaptation to a variety of triggers such as stress, hormones, light, chemicals and host factors. In our recent st… ▽ More Fungi cells are capable of sensing extracellular cues through reception, transduction and response systems which allow them to communicate with their host and adapt to their environment. They display effective regulatory protein expressions which enhance and regulate their response and adaptation to a variety of triggers such as stress, hormones, light, chemicals and host factors. In our recent studies, we have shown that $Pleurotus$ oyster fungi generate electrical potential impulses in the form of spike events as a result of their exposure to environmental, mechanical and chemical triggers, demonstrating that it is possible to discern the nature of stimuli from the fungi electrical responses. Harnessing the power of fungi sensing and intelligent capabilities, we explored the communication protocols of fungi as reporters of human chemical secretions such as hormones, addressing the question if fungi can sense human signals. We exposed $Pleurotus$ oyster fungi to cortisol, directly applied to a surface of a hemp shavings substrate colonised by fungi, and recorded the electrical activity of fungi. The response of fungi to cortisol was also supplementary studied through the application of X-ray to identify changes in the fungi tissue, where receiving cortisol by the substrate can inhibit the flow of calcium and, in turn, reduce its physiological changes. This study could pave the way for future research on adaptive fungal wearables capable for detecting physiological states of humans and biosensors made of living fungi. △ Less

Submitted 1 June, 2021; originally announced June 2021.

Electrical activity of fungi: Spikes detection and complexity analysis

Authors: Mohammad Mahdi Dehshibi, Andrew Adamatzky

Abstract: Oyster fungi \emph{Pleurotus djamor} generate actin potential like spikes of electrical potential. The trains of spikes might manifest propagation of growing mycelium in a substrate, transportation of nutrients and metabolites and communication processes in the mycelium network. The spiking activity of the mycelium networks is highly variable compared to neural activity and therefore can not be an… ▽ More Oyster fungi \emph{Pleurotus djamor} generate actin potential like spikes of electrical potential. The trains of spikes might manifest propagation of growing mycelium in a substrate, transportation of nutrients and metabolites and communication processes in the mycelium network. The spiking activity of the mycelium networks is highly variable compared to neural activity and therefore can not be analysed by standard tools from neuroscience. We propose original techniques for detecting and classifying the spiking activity of fungi. Using these techniques, we analyse the information-theoretic complexity of the fungal electrical activity. The results can pave ways for future research on sensorial fusion and decision making of fungi. △ Less

Submitted 24 August, 2020; originally announced August 2020.

A supervised active learning method for identifying critical nodes in Wireless Sensor Network

Authors: Behnam Ojaghi, Mohammad Mahdi Dehshibi

Abstract: Energy Efficiency of a wireless sensor network (WSN) relies on its main characteristics, including hop-number, user's location, allocated power, and relay. Identifying nodes, which have more impact on these characteristics, is, however, subject to a substantial computational overhead and energy consumption. In this paper, we proposed an active learning approach to address the computational overhea… ▽ More Energy Efficiency of a wireless sensor network (WSN) relies on its main characteristics, including hop-number, user's location, allocated power, and relay. Identifying nodes, which have more impact on these characteristics, is, however, subject to a substantial computational overhead and energy consumption. In this paper, we proposed an active learning approach to address the computational overhead of identifying critical nodes in a WSN. The proposed approach can overcome biasing in identifying non-critical nodes and needs much less effort in fine-tuning to adapt to the dynamic nature of WSN. This method benefits from the cooperation of clustering and classification modules to iteratively decrease the required number of data in a typical supervised learning scenario and to increase the accuracy in the presence of uninformative examples, i.e., non-critical nodes. Experiments show that the proposed method has more flexibility, compared to the state-of-the-art, to be employed in large scale WSN environments, the fifth-generation mobile networks (5G), and massively distributed IoT (i.e., sensor networks), where it can prolong the network lifetime. △ Less

Submitted 29 April, 2023; v1 submitted 19 April, 2020; originally announced April 2020.

Raft Consensus Algorithm: an Effective Substitute for Paxos in High Throughput P2P-based Systems

Authors: Mohammad Fazlali, Sara Moazezi Eftekhar, Mohammad Mahdi Dehshibi, Hadi Tabatabaee Malazi, Masoud Nosrati

Abstract: One of the significant problem in peer-to-peer databases is collision problem. These databases do not rely on a central leader that is a reason to increase scalability and fault tolerance. Utilizing these systems in high throughput computing cause more flexibility in computing system and meanwhile solve the problems in most of the computing systems which are depend on a central nodes. There are li… ▽ More One of the significant problem in peer-to-peer databases is collision problem. These databases do not rely on a central leader that is a reason to increase scalability and fault tolerance. Utilizing these systems in high throughput computing cause more flexibility in computing system and meanwhile solve the problems in most of the computing systems which are depend on a central nodes. There are limited researches in this scope and they seem are not suitable for using in a large scale. In this paper, we used Cassandra which is a distributed database based on peer-to-peer network as a high throughput computing system. Cassandra uses Paxos to elect central leader by default that causes collision problem. Among existent consensus algorithms Raft separates the key elements of consensus, such as leader election, so enforces a stronger degree of coherency to reduce the number of states that must be considered, such as collision. △ Less

Submitted 4 November, 2019; originally announced November 2019.

VICSOM: VIsual Clues from SOcial Media for psychological assessment

Authors: Mohammad Mahdi Dehshibi, Gerard Pons, Bita Baiani, David Masip

Abstract: Sharing multimodal information (typically images, videos or text) in Social Network Sites (SNS) occupies a relevant part of our time. The particular way how users expose themselves in SNS can provide useful information to infer human behaviors. This paper proposes to use multimodal data gathered from Instagram accounts to predict the perceived prototypical needs described in Glasser's choice theor… ▽ More Sharing multimodal information (typically images, videos or text) in Social Network Sites (SNS) occupies a relevant part of our time. The particular way how users expose themselves in SNS can provide useful information to infer human behaviors. This paper proposes to use multimodal data gathered from Instagram accounts to predict the perceived prototypical needs described in Glasser's choice theory. The contribution is two-fold: (i) we provide a large multimodal database from Instagram public profiles (more than 30,000 images and text captions) annotated by expert Psychologists on each perceived behavior according to Glasser's theory, and (ii) we propose to automate the recognition of the (unconsciously) perceived needs by the users. Particularly, we propose a baseline using three different feature sets: visual descriptors based on pixel images (SURF and Visual Bag of Words), a high-level descriptor based on the automated scene description using Convolutional Neural Networks, and a text-based descriptor (Word2vec) obtained from processing the captions provided by the users. Finally, we propose a multimodal fusion of these descriptors obtaining promising results in the multi-label classification problem. △ Less

Submitted 15 May, 2019; originally announced May 2019.

On complexity of branching droplets in electrical field

Authors: Mohammad Mahdi Dehshibi, Jitka Cejkova, Dominik Svara, Andrew Adamatzky

Abstract: Decanol droplets in a thin layer of sodium decanoate with sodium chloride exhibit bifurcation branching growth due to interplay between osmotic pressure, diffusion and surface tension. We aimed to evaluate if morphology of the branching droplets changes when the droplets are subject to electrical potential difference. We analysed graph-theoretic structure of the droplets and applied several comple… ▽ More Decanol droplets in a thin layer of sodium decanoate with sodium chloride exhibit bifurcation branching growth due to interplay between osmotic pressure, diffusion and surface tension. We aimed to evaluate if morphology of the branching droplets changes when the droplets are subject to electrical potential difference. We analysed graph-theoretic structure of the droplets and applied several complexity measures. We found that, in overall, the current increases complexity of the branching droplets in terms of number of connected components and nodes in their graph presentations, morphological complexity and compressibility. △ Less

Submitted 15 January, 2019; originally announced January 2019.

A robust image-based cryptology scheme based on cellular non-linear network and local image descriptors

Authors: Mohammad Mahdi Dehshibi, Jamshid Shanbehzadeh, Mir Mohsen Pedram

Abstract: Cellular nonlinear network (CNN) provides an infrastructure for Cellular Automata to have not only an initial state but an input which has a local memory in each cell with much more complexity. This property has many applications which we have investigated it in proposing a robust cryptology scheme. This scheme consists of a cryptography and steganography sub-module in which a 3D CNN is designed t… ▽ More Cellular nonlinear network (CNN) provides an infrastructure for Cellular Automata to have not only an initial state but an input which has a local memory in each cell with much more complexity. This property has many applications which we have investigated it in proposing a robust cryptology scheme. This scheme consists of a cryptography and steganography sub-module in which a 3D CNN is designed to produce a chaotic map as the kernel of the system to preserve confidentiality and data integrity in cryptology. Our contributions are three-fold including (1) a feature descriptor is applied to the cover image to form the secret key while conventional methods use a predefined key, (2) a 3D CNN is used to make a chaotic map for making cipher from the visual message, and (3) the proposed CNN is also used to make a dynamic $k$-LSB steganography. Conducted experiments on 25 standard images prove the effectiveness of the proposed cryptology scheme in terms of security, visual, and complexity analysis. △ Less

Submitted 10 August, 2018; originally announced August 2018.

Comments: This is an Accepted Manuscript of an article published by Taylor & Francis Group in the International Journal of Parallel, Emergent & Distributed Systems, available online: http://www.tandfonline.com/10.1080/17445760.2018.1510929

On complexity of post-processing in analyzing GATE-driven X-ray spectrum

Authors: Neda Gholami, Mohammad Mahdi Dehshibi, Mahmood Fazlali, Antonio Rueda-Toicen, Hector Zenil, Andrew Adamatzky

Abstract: Computed Tomography (CT) imaging is one of the most influential diagnostic methods. In clinical reconstruction, an effective energy is used instead of total X-ray spectrum. This approximation causes an accuracy decline. To increase the contrast, single source or dual source dual energy CT can be used to reach optimal values of tissue differentiation. However, these infrastructures are still at the… ▽ More Computed Tomography (CT) imaging is one of the most influential diagnostic methods. In clinical reconstruction, an effective energy is used instead of total X-ray spectrum. This approximation causes an accuracy decline. To increase the contrast, single source or dual source dual energy CT can be used to reach optimal values of tissue differentiation. However, these infrastructures are still at the laboratory level, and their safeties for patients are still yet to mature. Therefore, computer modelling of DECT could be used. We propose a novel post-processing approach for converting a total X-ray spectrum into irregular intervals of quantized energy. We simulate a phantom in GATE/GEANT4 and irradiate it based on CT configuration. Inverse Radon transform is applied to the acquired sinogram to construct the Pixel-based Attenuation Matrix (PAM). To construct images represented by each interval, water attenuation coefficient of the interval is extracted from NIST and used in the Hounsfield unit (HU) scale in conjunction with PAM. The CT image is modified by using of an associated normalized photon flux and calculated HU corresponding to the interval. We demonstrate the proposed method efficiency via complexity analysis, using absolute and relative complexities, entropy measures, Kolmogorov complexity, morphological richness, and quantitative segmentation criteria associated with standard fuzzy C-means. The irregularity of the modified CT images decreases over the simulated ones. △ Less

Submitted 24 July, 2018; originally announced July 2018.

Exploring Tehran with excitable medium

Authors: Andrew Adamatzky, Mohammad Mahdi Dehshibi

Abstract: An excitable chemical medium --- Belousov-Zhabotinsky (BZ) reaction --- is proven to be a fruitful substrate for prototy** unconventional computing devices. These include image processors, logical circuits, and robot controllers. We study a BZ potential for characterising a geometry of street networks on a fragment of Tehran street map. The city was chosen because it is one of the most populated… ▽ More An excitable chemical medium --- Belousov-Zhabotinsky (BZ) reaction --- is proven to be a fruitful substrate for prototy** unconventional computing devices. These include image processors, logical circuits, and robot controllers. We study a BZ potential for characterising a geometry of street networks on a fragment of Tehran street map. The city was chosen because it is one of the most populated cities in the World with nearly uncontrollable urban growth. In numerical experiments with Oregonator model of BZ reaction, we demonstrate that excitability of the medium allows acts as a selector between omnidirectional waves and soliton-like localised excitations. We uncover a phase-transition like dynamics, controlled by the excitability, of coverage of the street network by excitation wave-fronts. In the cluster analysis, we show how the network geometry, when it meets propagation of BZ wave-front, relates to the traffic flow of Tehran △ Less

Submitted 24 July, 2018; originally announced July 2018.

Journal ref: From Parallel to Emergent Computing, 2019, 475-488