Showing 1–29 of 29 results for author: Hassanien, A

DeepGEMM: Accelerated Ultra Low-Precision Inference on CPU Architectures using Lookup Tables

Authors: Darshan C. Ganji, Saad Ashfaq, Ehsan Saboori, Sudhakar Sah, Saptarshi Mitra, MohammadHossein AskariHemmat, Alexander Hoffman, Ahmed Hassanien, Mathieu Léonardon

Abstract: A lot of recent progress has been made in ultra low-bit quantization, promising significant improvements in latency, memory footprint and energy consumption on edge devices. Quantization methods such as Learned Step Size Quantization can achieve model accuracy that is comparable to full-precision floating-point baselines even with sub-byte quantization. However, it is extremely challenging to depl… ▽ More A lot of recent progress has been made in ultra low-bit quantization, promising significant improvements in latency, memory footprint and energy consumption on edge devices. Quantization methods such as Learned Step Size Quantization can achieve model accuracy that is comparable to full-precision floating-point baselines even with sub-byte quantization. However, it is extremely challenging to deploy these ultra low-bit quantized models on mainstream CPU devices because commodity SIMD (Single Instruction, Multiple Data) hardware typically supports no less than 8-bit precision. To overcome this limitation, we propose DeepGEMM, a lookup table based approach for the execution of ultra low-precision convolutional neural networks on SIMD hardware. The proposed method precomputes all possible products of weights and activations, stores them in a lookup table, and efficiently accesses them at inference time to avoid costly multiply-accumulate operations. Our 2-bit implementation outperforms corresponding 8-bit integer kernels in the QNNPACK framework by up to 1.74x on x86 platforms. △ Less

Submitted 18 April, 2023; originally announced April 2023.

COVID-19 Blockchain Framework: Innovative Approach

Authors: Mohamed Torky, Aboul Ella Hassanien

Abstract: The world is currently witnessing dangerous shifts in the epidemic of emerging SARS-CoV-2, the causative agent of (COVID-19) coronavirus. The infection, and death numbers reported by World Health Organization (WHO) about this epidemic forecasts an increasing threats to the lives of people and the economics of countries. The greatest challenge that most governments are currently suffering from is t… ▽ More The world is currently witnessing dangerous shifts in the epidemic of emerging SARS-CoV-2, the causative agent of (COVID-19) coronavirus. The infection, and death numbers reported by World Health Organization (WHO) about this epidemic forecasts an increasing threats to the lives of people and the economics of countries. The greatest challenge that most governments are currently suffering from is the lack of a precise mechanism to detect unknown infected cases and predict the infection risk of COVID-19 virus. In response to mitigate this challenge, this study proposes a novel innovative approach for mitigating big challenges of (COVID-19) coronavirus propagation and contagion. This study propose a blockchain-based framework which investigate the possibility of utilizing peer-to peer, time stam**, and decentralized storage advantages of blockchain to build a new system for verifying and detecting the unknown infected cases of COVID-19 virus. Moreover, the proposed framework will enable the citizens to predict the infection risk of COVID-19 virus within conglomerates of people or within public places through a novel design of P2P-Mobile Application. The proposed approach is forecasted to produce an effective system able to support governments, health authorities, and citizens to take critical decision regarding the infection detection, infection prediction, and infection avoidance. The framework is currently being developed and implemented as a new system consists of four components, Infection Verifier Subsystem, Blockchain platform, P2P-Mobile Application, and Mass-Surveillance System. This four components work together for detecting the unknown infected cases and predicting and estimating the infection Risk of Corona Virus (COVID-19). △ Less

Submitted 5 April, 2020; originally announced April 2020.

Comments: 22 pages, 11 Figures

COVID-19 forecasting based on an improved interior search algorithm and multi-layer feed forward neural network

Authors: Rizk M. Rizk-Allah, Aboul Ella Hassanien

Abstract: COVID-19 is a novel coronavirus that was emerged in December 2019 within Wuhan, China. As the crisis of its serious increasing dynamic outbreak in all parts of the globe, the forecast maps and analysis of confirmed cases (CS) becomes a vital great changeling task. In this study, a new forecasting model is presented to analyze and forecast the CS of COVID-19 for the coming days based on the reporte… ▽ More COVID-19 is a novel coronavirus that was emerged in December 2019 within Wuhan, China. As the crisis of its serious increasing dynamic outbreak in all parts of the globe, the forecast maps and analysis of confirmed cases (CS) becomes a vital great changeling task. In this study, a new forecasting model is presented to analyze and forecast the CS of COVID-19 for the coming days based on the reported data since 22 Jan 2020. The proposed forecasting model, named ISACL-MFNN, integrates an improved interior search algorithm (ISA) based on chaotic learning (CL) strategy into a multi-layer feed-forward neural network (MFNN). The ISACL incorporates the CL strategy to enhance the performance of ISA and avoid the trap** in the local optima. By this methodology, it is intended to train the neural network by tuning its parameters to optimal values and thus achieving high-accuracy level regarding forecasted results. The ISACL-MFNN model is investigated on the official data of the COVID-19 reported by the World Health Organization (WHO) to analyze the confirmed cases for the upcoming days. The performance regarding the proposed forecasting model is validated and assessed by introducing some indices including the mean absolute error (MAE), root mean square error (RMSE) and mean absolute percentage error (MAPE) and the comparisons with other optimization algorithms are presented. The proposed model is investigated in the most affected countries (i.e., USA, Italy, and Spain). The experimental simulations illustrate that the proposed ISACL-MFNN provides promising performance rather than the other algorithms while forecasting task for the candidate countries. △ Less

Submitted 6 April, 2020; originally announced April 2020.

Comments: 24 pages, 3 Tables and 8 Figures

GSA-DenseNet121-COVID-19: a Hybrid Deep Learning Architecture for the Diagnosis of COVID-19 Disease based on Gravitational Search Optimization Algorithm

Authors: Dalia Ezzat, Aboul ell Hassanien, Hassan Aboul Ella

Abstract: In this paper, a novel approach called GSA-DenseNet121-COVID-19 based on a hybrid convolutional neural network (CNN) architecture is proposed using an optimization algorithm. The CNN architecture that was used is called DenseNet121 and the optimization algorithm that was used is called the gravitational search algorithm (GSA). The GSA is adapted to determine the best values for the hyperparameters… ▽ More In this paper, a novel approach called GSA-DenseNet121-COVID-19 based on a hybrid convolutional neural network (CNN) architecture is proposed using an optimization algorithm. The CNN architecture that was used is called DenseNet121 and the optimization algorithm that was used is called the gravitational search algorithm (GSA). The GSA is adapted to determine the best values for the hyperparameters of the DenseNet121 architecture, and to achieve a high level of accuracy in diagnosing COVID-19 disease through chest x-ray image analysis. The obtained results showed that the proposed approach was able to correctly classify 98% of the test set. To test the efficacy of the GSA in setting the optimum values for the hyperparameters of DenseNet121, it was compared to another optimization algorithm called social ski driver (SSD). The comparison results demonstrated the efficacy of the proposed GSA-DenseNet121-COVID-19 and its ability to better diagnose COVID-19 disease than the SSD-DenseNet121 as the second was able to diagnose only 94% of the test set. As well as, the proposed approach was compared to an approach based on a CNN architecture called Inception-v3 and the manual search method for determining the values of the hyperparameters. The results of the comparison showed that the GSA-DenseNet121 was able to beat the other approach, as the second was able to classify only 95% of the test set samples. △ Less

Submitted 9 April, 2020; originally announced April 2020.

Comments: 29 pages - 7 Figures - 5 Tables

Journal ref: Applied Soft Computing, Volume 98, January 2021, 106742

Harmony-Search and Otsu based System for Coronavirus Disease (COVID-19) Detection using Lung CT Scan Images

Authors: V. Ra**ikanth, Nilanjan Dey, Alex Noel Joseph Raj, Aboul Ella Hassanien, K. C. Santosh, N. Sri Madhava Raja

Abstract: Pneumonia is one of the foremost lung diseases and untreated pneumonia will lead to serious threats for all age groups. The proposed work aims to extract and evaluate the Coronavirus disease (COVID-19) caused pneumonia infection in lung using CT scans. We propose an image-assisted system to extract COVID-19 infected sections from lung CT scans (coronal view). It includes following steps: (i) Thres… ▽ More Pneumonia is one of the foremost lung diseases and untreated pneumonia will lead to serious threats for all age groups. The proposed work aims to extract and evaluate the Coronavirus disease (COVID-19) caused pneumonia infection in lung using CT scans. We propose an image-assisted system to extract COVID-19 infected sections from lung CT scans (coronal view). It includes following steps: (i) Threshold filter to extract the lung region by eliminating possible artifacts; (ii) Image enhancement using Harmony-Search-Optimization and Otsu thresholding; (iii) Image segmentation to extract infected region(s); and (iv) Region-of-interest (ROI) extraction (features) from binary image to compute level of severity. The features that are extracted from ROI are then employed to identify the pixel ratio between the lung and infection sections to identify infection level of severity. The primary objective of the tool is to assist the pulmonologist not only to detect but also to help plan treatment process. As a consequence, for mass screening processing, it will help prevent diagnostic burden. △ Less

Submitted 6 April, 2020; originally announced April 2020.

Comments: 13 pages

Detection of Coronavirus (COVID-19) Associated Pneumonia based on Generative Adversarial Networks and a Fine-Tuned Deep Transfer Learning Model using Chest X-ray Dataset

Authors: Nour Eldeen M. Khalifa, Mohamed Hamed N. Taha, Aboul Ella Hassanien, Sally Elghamrawy

Abstract: The COVID-19 coronavirus is one of the devastating viruses according to the world health organization. This novel virus leads to pneumonia, which is an infection that inflames the lungs' air sacs of a human. One of the methods to detect those inflames is by using x-rays for the chest. In this paper, a pneumonia chest x-ray detection based on generative adversarial networks (GAN) with a fine-tuned… ▽ More The COVID-19 coronavirus is one of the devastating viruses according to the world health organization. This novel virus leads to pneumonia, which is an infection that inflames the lungs' air sacs of a human. One of the methods to detect those inflames is by using x-rays for the chest. In this paper, a pneumonia chest x-ray detection based on generative adversarial networks (GAN) with a fine-tuned deep transfer learning for a limited dataset will be presented. The use of GAN positively affects the proposed model robustness and made it immune to the overfitting problem and helps in generating more images from the dataset. The dataset used in this research consists of 5863 X-ray images with two categories: Normal and Pneumonia. This research uses only 10% of the dataset for training data and generates 90% of images using GAN to prove the efficiency of the proposed model. Through the paper, AlexNet, GoogLeNet, Squeeznet, and Resnet18 are selected as deep transfer learning models to detect the pneumonia from chest x-rays. Those models are selected based on their small number of layers on their architectures, which will reflect in reducing the complexity of the models and the consumed memory and time. Using a combination of GAN and deep transfer models proved it is efficiency according to testing accuracy measurement. The research concludes that the Resnet18 is the most appropriate deep transfer model according to testing accuracy measurement and achieved 99% with the other performance metrics such as precision, recall, and F1 score while using GAN as an image augmenter. Finally, a comparison result was carried out at the end of the research with related work which used the same dataset except that this research used only 10% of original dataset. The presented work achieved a superior result than the related work in terms of testing accuracy. △ Less

Submitted 2 April, 2020; originally announced April 2020.

Comments: 15 pages, 3 Tables and 10 Figures

A Proposed Artificial intelligence Model for Real-Time Human Action Localization and Tracking

Authors: Ahmed Ali Hammam, Mona Soliman, Aboul Ella Hassanien

Abstract: In recent years, artificial intelligence (AI) based on deep learning (DL) has sparked tremendous global interest. DL is widely used today and has expanded into various interesting areas. It is becoming more popular in cross-subject research, such as studies of smart city systems, which combine computer science with engineering applications. Human action detection is one of these areas. Human actio… ▽ More In recent years, artificial intelligence (AI) based on deep learning (DL) has sparked tremendous global interest. DL is widely used today and has expanded into various interesting areas. It is becoming more popular in cross-subject research, such as studies of smart city systems, which combine computer science with engineering applications. Human action detection is one of these areas. Human action detection is an interesting challenge due to its stringent requirements in terms of computing speed and accuracy. High-accuracy real-time object tracking is also considered a significant challenge. This paper integrates the YOLO detection network, which is considered a state-of-the-art tool for real-time object detection, with motion vectors and the Coyote Optimization Algorithm (COA) to construct a real-time human action localization and tracking system. The proposed system starts with the extraction of motion information from a compressed video stream and the extraction of appearance information from RGB frames using an object detector. Then, a fusion step between the two streams is performed, and the results are fed into the proposed action tracking model. The COA is used in object tracking due to its accuracy and fast convergence. The basic foundation of the proposed model is the utilization of motion vectors, which already exist in a compressed video bit stream and provide sufficient information to improve the localization of the target action without requiring high consumption of computational resources compared with other popular methods of extracting motion information, such as optical flows. This advantage allows the proposed approach to be implemented in challenging environments where the computational resources are limited, such as Internet of Things (IoT) systems. △ Less

Submitted 9 November, 2019; originally announced November 2019.

Comments: SUBMITTED TO IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS

Monkey Optimization System with Active Membranes: A New Meta-heuristic Optimization System

Authors: Moustafa Zein, Aboul Ella Hassanien, Ammar Adl, Adam Slowik

Abstract: Optimization techniques, used to get the optimal solution in search spaces, have not solved the time-consuming problem. The objective of this study is to tackle the sequential processing problem in Monkey Algorithm and simulating the natural parallel behavior of monkeys. Therefore, a P system with active membranes is constructed by providing a codification for Monkey Algorithm within the context o… ▽ More Optimization techniques, used to get the optimal solution in search spaces, have not solved the time-consuming problem. The objective of this study is to tackle the sequential processing problem in Monkey Algorithm and simulating the natural parallel behavior of monkeys. Therefore, a P system with active membranes is constructed by providing a codification for Monkey Algorithm within the context of a cell-like P system, defining accordingly the elements of the model - membrane structure, objects, rules and the behavior of it. The proposed algorithm has modeled the natural behavior of climb process using separate membranes, rather than the original algorithm. Moreover, it introduced the membrane migration process to select the best solution and the time stamp was added as an additional stop** criterion to control the timing of the algorithm. The results indicate a substantial solution for the time consumption problem, significant representation of the natural behavior of monkeys, and considerable chance to reach the best solution in the context of meta-heuristics purpose. In addition, experiments use the commonly used benchmark functions to test the performance of the algorithm as well as the expected time of the proposed P Monkey optimization algorithm and the traditional Monkey Algorithm running on population size. The unit times are calculated based on the complexity of algorithms, where P Monkey takes a time unit to fire rule(s) over a population size n; as soon as, Monkey Algorithm takes a time unit to run a step every mathematical equation over a population size. △ Less

Submitted 30 September, 2019; originally announced October 2019.

Barqi Breed Sheep Weight Estimation based on Neural Network with Regression

Authors: Chintan Bhatt, Aboul-ella Hassanien, Nirav Alpesh Shah, Jaydeep Thik

Abstract: Computer vision is a very powerful method for understanding the contents from the images. We tried to utilize this powerful technology to make the difficult task of estimating sheep weights quick and accurate. It has enabled us to minimize the human involvement in measuring weight of the sheep. We are using a novel approach for segmentation and neural network based regression model for achieving b… ▽ More Computer vision is a very powerful method for understanding the contents from the images. We tried to utilize this powerful technology to make the difficult task of estimating sheep weights quick and accurate. It has enabled us to minimize the human involvement in measuring weight of the sheep. We are using a novel approach for segmentation and neural network based regression model for achieving better results for the task of estimating sheep weight. △ Less

Submitted 9 July, 2018; originally announced July 2018.

Parallel Whale Optimization Algorithm for Solving Constrained and Unconstrained Optimization Problems

Authors: Amr M. Sauber, Mohammed M. Nasef, Essam H. Houssein, Aboul Ella Hassanien

Abstract: Recently the engineering optimization problems require large computational demands and long solution time even on high multi-processors computational devices. In this paper, an OpenMP inspired parallel version of the whale optimization algorithm (PWOA) to obtain enhanced computational throughput and global search capability is presented. It automatically detects the number of available processors… ▽ More Recently the engineering optimization problems require large computational demands and long solution time even on high multi-processors computational devices. In this paper, an OpenMP inspired parallel version of the whale optimization algorithm (PWOA) to obtain enhanced computational throughput and global search capability is presented. It automatically detects the number of available processors and divides the workload among them to accomplish the effective utilization of the available resources. PWOA is applied on twenty unconstrained optimization functions on multiple dimensions and five constrained optimization engineering functions. The proposed parallelism PWOA algorithms performance is evaluated using parallel metrics such as speedup, efficiency. The comparison illustrates that the proposed PWOA algorithm has obtained the same results while exceeding the sequential version in performance. Furthermore, PWOA algorithm in the term of computational time and speed of parallel metric was achieved better results over the sequential processing compared to the standard WOA. △ Less

Submitted 21 June, 2018; originally announced July 2018.

Combining Support Vector Machine and Elephant Herding Optimization for Cardiac Arrhythmias

Authors: Aboul Ella Hassanien, Moataz Kilany, Essam H. Houssein

Abstract: Many people are currently suffering from heart diseases that can lead to untimely death. The most common heart abnormality is arrhythmia, which is simply irregular beating of the heart. A prediction system for the early intervention and prevention of heart diseases, including cardiovascular diseases (CDVs) and arrhythmia, is important. This paper introduces the classification of electrocardiogram… ▽ More Many people are currently suffering from heart diseases that can lead to untimely death. The most common heart abnormality is arrhythmia, which is simply irregular beating of the heart. A prediction system for the early intervention and prevention of heart diseases, including cardiovascular diseases (CDVs) and arrhythmia, is important. This paper introduces the classification of electrocardiogram (ECG) heartbeats into normal or abnormal. The approach is based on the combination of swarm optimization algorithms with a modified PannTompkins algorithm (MPTA) and support vector machines (SVMs). The MPTA was implemented to remove ECG noise, followed by the application of the extended features extraction algorithm (EFEA) for ECG feature extraction. Then, elephant herding optimization (EHO) was used to find a subset of ECG features from a larger feature pool that provided better classification performance than that achieved using the whole set. Finally, SVMs were used for classification. The results show that the EHOSVM approach achieved good classification results in terms of five statistical indices: accuracy, 93.31%; sensitivity, 45.49%; precision, 46.45%; F-measure, 45.48%; and specificity, 45.48%. Furthermore, the results demonstrate a clear improvement in accuracy compared to that of other methods when applied to the MITBIH arrhythmia database. △ Less

Submitted 20 June, 2018; originally announced June 2018.

Orbital Petri Nets: A Novel Petri Net Approach

Authors: Mohamed Yorky, Aboul Ella Hassanien

Abstract: Petri Nets is very interesting tool for studying and simulating different behaviors of information systems. It can be used in different applications based on the appropriate class of Petri Nets whereas it is classical, colored or timed Petri Nets. In this paper we introduce a new approach of Petri Nets called orbital Petri Nets (OPN) for studying the orbital rotating systems within a specific doma… ▽ More Petri Nets is very interesting tool for studying and simulating different behaviors of information systems. It can be used in different applications based on the appropriate class of Petri Nets whereas it is classical, colored or timed Petri Nets. In this paper we introduce a new approach of Petri Nets called orbital Petri Nets (OPN) for studying the orbital rotating systems within a specific domain. The study investigated and analyzed OPN with highlighting the problem of space debris collision problem as a case study. The mathematical investigation results of two OPN models proved that space debris collision problem can be prevented based on the new method of firing sequence in OPN. By this study, new smart algorithms can be implemented and simulated by orbital Petri Nets for mitigating the space debris collision problem as a next work. △ Less

Submitted 8 June, 2018; originally announced June 2018.

Comments: 10 figures

Deep Galaxy: Classification of Galaxies based on Deep Convolutional Neural Networks

Authors: Nour Eldeen M. Khalifa, Mohamed Hamed N. Taha, Aboul Ella Hassanien, I. M. Selim

Abstract: In this paper, a deep convolutional neural network architecture for galaxies classification is presented. The galaxy can be classified based on its features into main three categories Elliptical, Spiral, and Irregular. The proposed deep galaxies architecture consists of 8 layers, one main convolutional layer for features extraction with 96 filters, followed by two principles fully connected layers… ▽ More In this paper, a deep convolutional neural network architecture for galaxies classification is presented. The galaxy can be classified based on its features into main three categories Elliptical, Spiral, and Irregular. The proposed deep galaxies architecture consists of 8 layers, one main convolutional layer for features extraction with 96 filters, followed by two principles fully connected layers for classification. It is trained over 1356 images and achieved 97.272% in testing accuracy. A comparative result is made and the testing accuracy was compared with other related works. The proposed architecture outperformed other related works in terms of testing accuracy. △ Less

Submitted 2 September, 2017; originally announced September 2017.

Comments: 4 pages, 6 figures, 2 tables, Conference

Bitwise Retransmission Schemes for Resources Constrained Uplink Sensor Networks

Authors: Mohamed A. M. Hassanien, Pavel Loskot, Salman M. Al-Shehri, Tolga Numanoglu, Mehmet Mert

Abstract: Novel bitwise retransmission schemes are devised which retransmit only the bits received with small reliability. The retransmissions are used to accumulate the reliabilities of individual bits. Unlike the conventional automatic repeat request (ARQ) schemes, the proposed scheme does not require a checksum for the error detection. The bits to be retransmitted are reported as a combination number, or… ▽ More Novel bitwise retransmission schemes are devised which retransmit only the bits received with small reliability. The retransmissions are used to accumulate the reliabilities of individual bits. Unlike the conventional automatic repeat request (ARQ) schemes, the proposed scheme does not require a checksum for the error detection. The bits to be retransmitted are reported as a combination number, or two synchronized random number generators (RNGs) at the transmitter and receiver are used to greatly compress the feedback message. The bitwise retransmission decisions and/or combining can be performed after the demodulation or after the channel decoding at the receiver. The bit-error rate (BER) expressions are derived for the case of one and two retransmissions, and verified by computer simulations. Assuming three specific retransmission strategies, the scheme parameters are optimized to minimize the overall BER. For the same number of retransmissions and packet length, the proposed schemes always outperform the frequently used stop-and-wait ARQ. The impact of feedback errors is also considered. Finally, practical designs of the bitwise retransmissions for data fusion from sensor nodes in Zigbee, Wifi and Bluetooth networks are presented. △ Less

Submitted 30 July, 2017; originally announced July 2017.

Comments: 14 pages, 17 figures, 3 tables

Arabian Horse Identification Benchmark Dataset

Authors: Ayat Taha, Ashraf Darwish, Aboul Ella Hassanien

Abstract: The lack of a standard muzzle print database is a challenge for conducting researches in Arabian horse identification systems. Therefore, collecting a muzzle print images database is a crucial decision. The dataset presented in this paper is an option for the studies that need a dataset for testing and comparing the algorithms under development for Arabian horse identification. Our collected datas… ▽ More The lack of a standard muzzle print database is a challenge for conducting researches in Arabian horse identification systems. Therefore, collecting a muzzle print images database is a crucial decision. The dataset presented in this paper is an option for the studies that need a dataset for testing and comparing the algorithms under development for Arabian horse identification. Our collected dataset consists of 300 color images that were collected from 50 Arabian horse muzzle species. This dataset has been collected from 50 Arabian horses with 6 muzzle print images each. A special care has been given to the quality of the collected images. The collected images cover different quality levels and degradation factors such as image rotation and image partiality for simulating real time identification operations. This dataset can be used to test the identification of Arabian horse system including the extracted features and the selected classifier. △ Less

Submitted 15 June, 2017; originally announced June 2017.

Large-scale, Fast and Accurate Shot Boundary Detection through Spatio-temporal Convolutional Neural Networks

Authors: Ahmed Hassanien, Mohamed Elgharib, Ahmed Selim, Sung-Ho Bae, Mohamed Hefeeda, Wojciech Matusik

Abstract: Shot boundary detection (SBD) is an important pre-processing step for video manipulation. Here, each segment of frames is classified as either sharp, gradual or no transition. Current SBD techniques analyze hand-crafted features and attempt to optimize both detection accuracy and processing speed. However, the heavy computations of optical flow prevents this. To achieve this aim, we present an SBD… ▽ More Shot boundary detection (SBD) is an important pre-processing step for video manipulation. Here, each segment of frames is classified as either sharp, gradual or no transition. Current SBD techniques analyze hand-crafted features and attempt to optimize both detection accuracy and processing speed. However, the heavy computations of optical flow prevents this. To achieve this aim, we present an SBD technique based on spatio-temporal Convolutional Neural Networks (CNN). Since current datasets are not large enough to train an accurate SBD CNN, we present a new dataset containing more than 3.5 million frames of sharp and gradual transitions. The transitions are generated synthetically using image compositing models. Our dataset contain additional 70,000 frames of important hard-negative no transitions. We perform the largest evaluation to date for one SBD algorithm, on real and synthetic data, containing more than 4.85 million frames. In comparison to the state of the art, we outperform dissolve gradual detection, generate competitive performance for sharp detections and produce significant improvement in wipes. In addition, we are up to 11 times faster than the state of the art. △ Less

Submitted 27 July, 2017; v1 submitted 9 May, 2017; originally announced May 2017.

Transmit Array Interpolation for DOA Estimation via Tensor Decomposition in 2D MIMO Radar

Authors: Ming-Yang Cao, Sergiy A. Vorobyov, Aboulnasr Hassanien

Abstract: In this paper, we propose a two-dimensional (2D) joint transmit array interpolation and beamspace design for planar array mono-static multiple-input-multiple-output (MIMO) radar for direction-of-arrival (DOA) estimation via tensor modeling. Our underlying idea is to map the transmit array to a desired array and suppress the transmit power outside the spatial sector of interest. In doing so, the si… ▽ More In this paper, we propose a two-dimensional (2D) joint transmit array interpolation and beamspace design for planar array mono-static multiple-input-multiple-output (MIMO) radar for direction-of-arrival (DOA) estimation via tensor modeling. Our underlying idea is to map the transmit array to a desired array and suppress the transmit power outside the spatial sector of interest. In doing so, the signal-tonoise ratio is improved at the receive array. Then, we fold the received data along each dimension into a tensorial structure and apply tensor-based methods to obtain DOA estimates. In addition, we derive a close-form expression for DOA estimation bias caused by interpolation errors and argue for using a specially designed look-up table to compensate the bias. The corresponding Cramer-Rao Bound (CRB) is also derived. Simulation results are provided to show the performance of the proposed method and compare its performance to CRB. △ Less

Submitted 5 May, 2017; originally announced May 2017.

Comments: 37 pages, 13 figures, Submitted to the IEEE Trans. Signal Processing in December 2016

Journal ref: IEEE Transaction on Signal Processing, vol. 65, no. 19, pp. 5225-5239, Oct. 2017

Sequence to sequence learning for unconstrained scene text recognition

Authors: Ahmed Mamdouh A. Hassanien

Abstract: In this work we present a state-of-the-art approach for unconstrained natural scene text recognition. We propose a cascade approach that incorporates a convolutional neural network (CNN) architecture followed by a long short term memory model (LSTM). The CNN learns visual features for the characters and uses them with a softmax layer to detect sequence of characters. While the CNN gives very good… ▽ More In this work we present a state-of-the-art approach for unconstrained natural scene text recognition. We propose a cascade approach that incorporates a convolutional neural network (CNN) architecture followed by a long short term memory model (LSTM). The CNN learns visual features for the characters and uses them with a softmax layer to detect sequence of characters. While the CNN gives very good recognition results, it does not model relation between characters, hence gives rise to false positive and false negative cases (confusing characters due to visual similarities like "g" and "9", or confusing background patches with characters; either removing existing characters or adding non-existing ones) To alleviate these problems we leverage recent developments in LSTM architectures to encode contextual information. We show that the LSTM can dramatically reduce such errors and achieve state-of-the-art accuracy in the task of unconstrained natural scene text recognition. Moreover we manually remove all occurrences of the words that exist in the test set from our training set to test whether our approach will generalize to unseen data. We use the ICDAR 13 test set for evaluation and compare the results with the state of the art approaches [11, 18]. We finally present an application of the work in the domain of for traffic monitoring. △ Less

Submitted 20 July, 2016; originally announced July 2016.

Comments: It is my master thesis. The thesis was done at Sony Technology Center Stuttgart and presented to Nile University. The thesis supervisors are Mark Blaxall, Fabien Cardinaux, and Motaz Abdelwahab

Image Fusion Techniques in Remote Sensing

Authors: Reham Gharbia, Ahmad Taher Azar, Ali El Baz, Aboul Ella Hassanien

Abstract: Remote sensing image fusion is an effective way to use a large volume of data from multisensor images. Most earth satellites such as SPOT, Landsat 7, IKONOS and QuickBird provide both panchromatic (Pan) images at a higher spatial resolution and multispectral (MS) images at a lower spatial resolution and many remote sensing applications require both high spatial and high spectral resolutions, espec… ▽ More Remote sensing image fusion is an effective way to use a large volume of data from multisensor images. Most earth satellites such as SPOT, Landsat 7, IKONOS and QuickBird provide both panchromatic (Pan) images at a higher spatial resolution and multispectral (MS) images at a lower spatial resolution and many remote sensing applications require both high spatial and high spectral resolutions, especially for GIS based applications. An effective image fusion technique can produce such remotely sensed images. Image fusion is the combination of two or more different images to form a new image by using a certain algorithm to obtain more and better information about an object or a study area than. The image fusion is performed at three different processing levels which are pixel level, feature level and decision level according to the stage at which the fusion takes place. There are many image fusion methods that can be used to produce high resolution multispectral images from a high resolution pan image and low resolution multispectral images. This paper explores the major remote sensing data fusion techniques at pixel level and reviews the concept, principals, limitations and advantages for each technique. This paper focused on traditional techniques like intensity hue-saturation- (HIS), Brovey, principal component analysis (PCA) and Wavelet. △ Less

Submitted 10 March, 2014; originally announced March 2014.

Negative Selection Approach Application in Network Intrusion Detection Systems

Authors: Amira Sayed A. Aziz, Ahmad Taher Azar, Aboul Ella Hassanien, Sanaa El-Ola Hanafy

Abstract: Nature has always been an inspiration to researchers with its diversity and robustness of its systems, and Artificial Immune Systems are one of them. Many algorithms were inspired by ongoing discoveries of biological immune systems techniques and approaches. One of the basic and most common approach is the Negative Selection Approach, which is simple and easy to implement. It was applied in many f… ▽ More Nature has always been an inspiration to researchers with its diversity and robustness of its systems, and Artificial Immune Systems are one of them. Many algorithms were inspired by ongoing discoveries of biological immune systems techniques and approaches. One of the basic and most common approach is the Negative Selection Approach, which is simple and easy to implement. It was applied in many fields, but mostly in anomaly detection for the similarity of its basic idea. In this paper, a review is given on the application of negative selection approach in network security, specifically the intrusion detection system. As the work in this field is limited, we need to understand what the challenges of this approach are. Recommendations are given by the end of the paper for future work. △ Less

Submitted 10 March, 2014; originally announced March 2014.

Ant Colony based Feature Selection Heuristics for Retinal Vessel Segmentation

Authors: Ahmed. H. Asad, Ahmad Taher Azar, Nashwa El-Bendary, Aboul Ella Hassaanien

Abstract: Features selection is an essential step for successful data classification, since it reduces the data dimensionality by removing redundant features. Consequently, that minimizes the classification complexity and time in addition to maximizing its accuracy. In this article, a comparative study considering six features selection heuristics is conducted in order to select the best relevant features s… ▽ More Features selection is an essential step for successful data classification, since it reduces the data dimensionality by removing redundant features. Consequently, that minimizes the classification complexity and time in addition to maximizing its accuracy. In this article, a comparative study considering six features selection heuristics is conducted in order to select the best relevant features subset. The tested features vector consists of fourteen features that are computed for each pixel in the field of view of retinal images in the DRIVE database. The comparison is assessed in terms of sensitivity, specificity, and accuracy measurements of the recommended features subset resulted by each heuristic when applied with the ant colony system. Experimental results indicated that the features subset recommended by the relief heuristic outperformed the subsets recommended by the other experienced heuristics. △ Less

Submitted 7 March, 2014; originally announced March 2014.

Continuous Features Discretization for Anomaly Intrusion Detectors Generation

Authors: Amira Sayed A. Aziz, Ahmad Taher Azar, Aboul Ella Hassanien, Sanaa Al-Ola Hanafy

Abstract: Network security is a growing issue, with the evolution of computer systems and expansion of attacks. Biological systems have been inspiring scientists and designs for new adaptive solutions, such as genetic algorithms. In this paper, we present an approach that uses the genetic algorithm to generate anomaly net- work intrusion detectors. In this paper, an algorithm propose use a discretization me… ▽ More Network security is a growing issue, with the evolution of computer systems and expansion of attacks. Biological systems have been inspiring scientists and designs for new adaptive solutions, such as genetic algorithms. In this paper, we present an approach that uses the genetic algorithm to generate anomaly net- work intrusion detectors. In this paper, an algorithm propose use a discretization method for the continuous features selected for the intrusion detection, to create some homogeneity between values, which have different data types. Then,the intrusion detection system is tested against the NSL-KDD data set using different distance methods. A comparison is held amongst the results, and it is shown by the end that this proposed approach has good results, and recommendations is given for future experiments. △ Less

Submitted 7 March, 2014; originally announced March 2014.

Expert System Based On Neural-Fuzzy Rules for Thyroid Diseases Diagnosis

Authors: Ahmad Taher Azar, Aboul Ella Hassanien

Abstract: The thyroid, an endocrine gland that secretes hormones in the blood, circulates its products to all tissues of the body, where they control vital functions in every cell. Normal levels of thyroid hormone help the brain, heart, intestines, muscles and reproductive system function normally. Thyroid hormones control the metabolism of the body. Abnormalities of thyroid function are usually related to… ▽ More The thyroid, an endocrine gland that secretes hormones in the blood, circulates its products to all tissues of the body, where they control vital functions in every cell. Normal levels of thyroid hormone help the brain, heart, intestines, muscles and reproductive system function normally. Thyroid hormones control the metabolism of the body. Abnormalities of thyroid function are usually related to production of too little thyroid hormone (hypothyroidism) or production of too much thyroid hormone (hyperthyroidism). Therefore, the correct diagnosis of these diseases is very important topic. In this study, Linguistic Hedges Neural-Fuzzy Classifier with Selected Features (LHNFCSF) is presented for diagnosis of thyroid diseases. The performance evaluation of this system is estimated by using classification accuracy and k-fold cross-validation. The results indicated that the classification accuracy without feature selection was 98.6047% and 97.6744% during training and testing phases, respectively with RMSE of 0.02335. After applying feature selection algorithm, LHNFCSF achieved 100% for all cluster sizes during training phase. However, in the testing phase LHNFCSF achieved 88.3721% using one cluster for each class, 90.6977% using two clusters, 91.8605% using three clusters and 97.6744% using four clusters for each class and 12 fuzzy rules. The obtained classification accuracy was very promising with regard to the other classification applications in literature for this problem. △ Less

Submitted 3 March, 2014; originally announced March 2014.

Comments: Conference Paper

How Many Beamforming Vectors Generate the Same Beampattern?

Authors: Arash Khabbazibasmenj, Aboulnasr Hassanien, Sergiy A. Vorobyov

Abstract: In this letter, we address the fundamental question of how many beamforming vectors exist which generate the same beampattern? The question is relevant to many fields such as, for example, array processing, radar, wireless communications, data compression, dimensionality reduction, and biomedical engineering. The desired property of having the same beampattern for different columns of a beamspace… ▽ More In this letter, we address the fundamental question of how many beamforming vectors exist which generate the same beampattern? The question is relevant to many fields such as, for example, array processing, radar, wireless communications, data compression, dimensionality reduction, and biomedical engineering. The desired property of having the same beampattern for different columns of a beamspace transformation matrix (beamforming vectors) often plays a key importance in practical applications. The result is that at most 2^{M-1}-1 beamforming vectors with the same beampattern can be generated from any given beamforming vector. Here M is the dimension of the beamforming vector. At the constructive side, the answer to this question allows for computationally efficient techniques for the beamspace transformation design. Indeed, one can start with a single beamforming vector, which gives a desired beampattern, and generate a number of other beamforming vectors, which give absolutely the same beampattern, in a computationally efficient way. We call the initial beamforming vector as the mother beamforming vector. One possible procedure for generating all possible new beamforming vectors with the same beampattern from the mother beamforming vector is proposed. The application of the proposed analysis to the transmit beamspace design in multiple-input multiple-output radar is also given. △ Less

Submitted 7 February, 2014; originally announced February 2014.

Comments: 12 pages, 3 figures, 2 tables, Submitted to the IEEE Signal Processing Letters in February 2014

Journal ref: IEEE Signal Processing Letters, vol. 22, no. 10, pp. 1609-1613, Oct. 2015

Efficient Transmit Beamspace Design for Search-free Based DOA Estimation in MIMO Radar

Authors: Arash Khabbazibasmenj, Aboulnasr Hassanien, Sergiy A. Vorobyov, Matthew W. Morency

Abstract: In this paper, we address the problem of transmit beamspace design for multiple-input multiple-output (MIMO) radar with colocated antennas in application to direction-of-arrival (DOA) estimation. A new method for designing the transmit beamspace matrix that enables the use of search-free DOA estimation techniques at the receiver is introduced. The essence of the proposed method is to design the tr… ▽ More In this paper, we address the problem of transmit beamspace design for multiple-input multiple-output (MIMO) radar with colocated antennas in application to direction-of-arrival (DOA) estimation. A new method for designing the transmit beamspace matrix that enables the use of search-free DOA estimation techniques at the receiver is introduced. The essence of the proposed method is to design the transmit beamspace matrix based on minimizing the difference between a desired transmit beampattern and the actual one under the constraint of uniform power distribution across the transmit array elements. The desired transmit beampattern can be of arbitrary shape and is allowed to consist of one or more spatial sectors. The number of transmit waveforms is even but otherwise arbitrary. To allow for simple search-free DOA estimation algorithms at the receive array, the rotational invariance property is established at the transmit array by imposing a specific structure on the beamspace matrix. Semi-definite relaxation is used to transform the proposed formulation into a convex problem that can be solved efficiently. We also propose a spatial-division based design (SDD) by dividing the spatial domain into several subsectors and assigning a subset of the transmit beams to each subsector. The transmit beams associated with each subsector are designed separately. Simulation results demonstrate the improvement in the DOA estimation performance offered by using the proposed joint and SDD transmit beamspace design methods as compared to the traditional MIMO radar technique. △ Less

Submitted 21 May, 2013; originally announced May 2013.

Comments: 32 pages, 10 figures, submitted to the IEEE Trans. Signal Processing in May 2013

Journal ref: A. Khabbazibasmenj, A. Hassanien, S.A. Vorobyov, M.W. Morency, "Efficient transmit beamspace design for search-free based DOA estimation in MIMO radar," IEEE Trans. Signal Processing, vol. 62, no. 6, pp. 1490-1500, Mar. 2014

Moving Target Parameters Estimation in Non-Coherent MIMO Radar Systems

Authors: Aboulnasr Hassanien, Sergiy A. Vorobyov, Alex B. Gershman

Abstract: The problem of estimating the parameters of a moving target in multiple-input multiple-output (MIMO) radar is considered and a new approach for estimating the moving target parameters by making use of the phase information associated with each transmit-receive path is introduced. It is required for this technique that different receive antennas have the same time reference, but no synchronization… ▽ More The problem of estimating the parameters of a moving target in multiple-input multiple-output (MIMO) radar is considered and a new approach for estimating the moving target parameters by making use of the phase information associated with each transmit-receive path is introduced. It is required for this technique that different receive antennas have the same time reference, but no synchronization of initial phases of the receive antennas is needed and, therefore, the estimation process is non-coherent. We model the target motion within a certain processing interval as a polynomial of general order. The first three coefficients of such a polynomial correspond to the initial location, velocity, and acceleration of the target, respectively. A new maximum likelihood (ML) technique for estimating the target motion coefficients is developed. It is shown that the considered ML problem can be interpreted as the classic "overdetermined" nonlinear least-squares problem. The proposed ML estimator requires multi-dimensional search over the unknown polynomial coefficients. The Cramér-Rao Bound (CRB) for the proposed parameter estimation problem is derived. The performance of the proposed estimator is validated by simulation results and is shown to achieve the CRB. △ Less

Submitted 31 January, 2012; originally announced February 2012.

Comments: 17 pages, 4 figures, Submitted to the IEEE Trans. Signal Processing in Aug. 2011

Journal ref: A. Hassanien, S.A. Vorobyov, and A.B. Gershman, "Moving target parameters estimation in non-coherent MIMO radar systems," IEEE Trans. Signal Processing, vol. 60, no. 5, pp. 2354-2361, May 2012

Robust Adaptive Beamforming Based on Steering Vector Estimation via Semidefinite Programming Relaxation

Authors: Arash Khabbazibasmenj, Sergiy A. Vorobyov, Aboulnasr Hassanien

Abstract: We develop a new approach to robust adaptive beamforming in the presence of signal steering vector errors. Since the signal steering vector is known imprecisely, its presumed (prior) value is used to find a more accurate estimate of the actual steering vector, which then is used for obtaining the optimal beamforming weight vector. The objective for finding such an estimate of the actual signal ste… ▽ More We develop a new approach to robust adaptive beamforming in the presence of signal steering vector errors. Since the signal steering vector is known imprecisely, its presumed (prior) value is used to find a more accurate estimate of the actual steering vector, which then is used for obtaining the optimal beamforming weight vector. The objective for finding such an estimate of the actual signal steering vector is the maximization of the beamformer output power, while the constraints are the normalization condition and the requirement that the estimate of the steering vector does not converge to an interference steering vector. Our objective and constraints are free of any design parameters of non-unique choice. The resulting optimization problem is a non-convex quadratically constrained quadratic program, which is NP hard in general. However, for our problem we show that an efficient solution can be found using the semi-definite relaxation technique. Moreover, the strong duality holds for the proposed problem and can also be used for finding the optimal solution efficiently and at low complexity. In some special cases, the solution can be even found in closed-form. Our simulation results demonstrate the superiority of the proposed method over other previously developed robust adaptive beamforming methods for several frequently encountered types of signal steering vector errors. △ Less

Submitted 5 August, 2010; originally announced August 2010.

Comments: 30 pages, 7 figures, Submitted to the IEEE Trans. Signal Processing in July 2010

Journal ref: A. Khabbazibasmenj, S.A. Vorobyov, and A. Hassanien, "Robust adaptive beamforming based on steering vector estimation with as little as possible prior information," IEEE Trans. Signal Processing, vol. 60, no. 6, pp. 2974-2987, June 2012

Transmit Energy Focusing for DOA Estimation in MIMO Radar with Colocated Antennas

Authors: Aboulnasr Hassanien, Sergiy A. Vorobyov

Abstract: In this paper, we propose a transmit beamspace energy focusing technique for multiple-input multiple-output (MIMO) radar with application to direction finding for multiple targets. The general angular directions of the targets are assumed to be located within a certain spatial sector. We focus the energy of multiple (two or more) transmitted orthogonal waveforms within that spatial sector using tr… ▽ More In this paper, we propose a transmit beamspace energy focusing technique for multiple-input multiple-output (MIMO) radar with application to direction finding for multiple targets. The general angular directions of the targets are assumed to be located within a certain spatial sector. We focus the energy of multiple (two or more) transmitted orthogonal waveforms within that spatial sector using transmit beamformers which are designed to improve the signal-to-noise ratio (SNR) gain at each receive antenna. The subspace decomposition-based techniques such as MUSIC can then be used for direction finding for multiple targets. Moreover, the transmit beamformers can be designed so that matched-filtering the received data to the waveforms yields multiple (two or more) data sets with rotational invariance property that allows applying search-free direction finding techniques such as ESPRIT for two data sets or parallel factor analysis (PARAFAC) for more than two data sets. Unlike previously reported MIMO radar ESPRIT/PARAFAC-based direction finding techniques, our method achieves the rotational invariance property in a different manner combined also with the transmit energy focusing. As a result, it achieves better estimation performance at lower computational cost. Particularly, the proposed technique leads to lower Cramer-Rao bound than the existing techniques due to the transmit energy focusing capability. Simulation results also show the superiority of the proposed technique over the existing techniques. △ Less

Submitted 2 July, 2010; originally announced July 2010.

Comments: 29 pages, 9 figures, submitted to IEEE Trans. Signal Processing in June 2010

Report number: IEEE Trans. Signal Processing, vol. 59, no. 6, pp. 2669-2682, June 2011

Journal ref: A. Hassanien and S.A. Vorobyov, "Transmit energy focusing for DOA estimation in MIMO radar with colocated antennas," IEEE Trans. Signal Processing, vol. 59, no. 6, pp. 2669-2682, June 2011

Phased-MIMO Radar: A Tradeoff Between Phased-Array and MIMO Radars

Authors: Aboulnasr Hassanien, Sergiy A. Vorobyov

Abstract: We propose a new technique for multiple-input multiple-output (MIMO) radar with colocated antennas which we call phased-MIMO radar. The new technique enjoys the advantages of MIMO radar without sacrificing the main advantage of phased-array radar which is the coherent processing gain at the transmitting side. The essence of the proposed technique is to partition the transmitting array into a num… ▽ More We propose a new technique for multiple-input multiple-output (MIMO) radar with colocated antennas which we call phased-MIMO radar. The new technique enjoys the advantages of MIMO radar without sacrificing the main advantage of phased-array radar which is the coherent processing gain at the transmitting side. The essence of the proposed technique is to partition the transmitting array into a number of subarrays that are allowed to overlap. Then, each subarray is used to coherently transmit a waveform which is orthogonal to the waveforms transmitted by other subarrays. Coherent processing gain can be achieved by designing a weight vector for each subarray to form a beam towards a certain direction in space. Moreover, the subarrays are combined jointly to form a MIMO radar resulting in higher resolution capabilities. The substantial improvements offered by the proposed phased-MIMO radar technique as compared to previous techniques are demonstrated analytically and by simulations through analysis of the corresponding beampatterns and achievable output signal-to-noise-plus-interference ratios. Both analytical and simulation results validate the effectiveness of the proposed phased-MIMO radar. △ Less

Submitted 14 August, 2009; originally announced August 2009.

Comments: 33 pages, 14 figures, Submitted to the IEEE Transactions on Signal Processing in July 2009

Journal ref: A. Hassanien and S.A. Vorobyov, "Phased-MIMO radar: A tradeoff between phased-array and MIMO radars," IEEE Trans. Signal Processing, vol. 58, no. 6, pp. 3137-3151, June 2010