-
Edge-Efficient Deep Learning Models for Automatic Modulation Classification: A Performance Analysis
Authors:
Nayan Moni Baishya,
B. R. Manoj,
Prabin K. Bora
Abstract:
The recent advancement in deep learning (DL) for automatic modulation classification (AMC) of wireless signals has encouraged numerous possible applications on resource-constrained edge devices. However, develo** optimized DL models suitable for edge applications of wireless communications is yet to be studied in depth. In this work, we perform a thorough investigation of optimized convolutional…
▽ More
The recent advancement in deep learning (DL) for automatic modulation classification (AMC) of wireless signals has encouraged numerous possible applications on resource-constrained edge devices. However, develo** optimized DL models suitable for edge applications of wireless communications is yet to be studied in depth. In this work, we perform a thorough investigation of optimized convolutional neural networks (CNNs) developed for AMC using the three most commonly used model optimization techniques: a) pruning, b) quantization, and c) knowledge distillation. Furthermore, we have proposed optimized models with the combinations of these techniques to fuse the complementary optimization benefits. The performances of all the proposed methods are evaluated in terms of sparsity, storage compression for network parameters, and the effect on classification accuracy with a reduction in parameters. The experimental results show that the proposed individual and combined optimization techniques are highly effective for develo** models with significantly less complexity while maintaining or even improving classification performance compared to the benchmark CNNs.
△ Less
Submitted 11 April, 2024;
originally announced April 2024.
-
A Brief Review of Explainable Artificial Intelligence in Healthcare
Authors:
Zahra Sadeghi,
Roohallah Alizadehsani,
Mehmet Akif Cifci,
Samina Kausar,
Rizwan Rehman,
Priyakshi Mahanta,
Pranjal Kumar Bora,
Ammar Almasri,
Rami S. Alkhawaldeh,
Sadiq Hussain,
Bilal Alatas,
Afshin Shoeibi,
Hossein Moosaei,
Milan Hladik,
Saeid Nahavandi,
Panos M. Pardalos
Abstract:
XAI refers to the techniques and methods for building AI applications which assist end users to interpret output and predictions of AI models. Black box AI applications in high-stakes decision-making situations, such as medical domain have increased the demand for transparency and explainability since wrong predictions may have severe consequences. Model explainability and interpretability are vit…
▽ More
XAI refers to the techniques and methods for building AI applications which assist end users to interpret output and predictions of AI models. Black box AI applications in high-stakes decision-making situations, such as medical domain have increased the demand for transparency and explainability since wrong predictions may have severe consequences. Model explainability and interpretability are vital successful deployment of AI models in healthcare practices. AI applications' underlying reasoning needs to be transparent to clinicians in order to gain their trust. This paper presents a systematic review of XAI aspects and challenges in the healthcare domain. The primary goals of this study are to review various XAI methods, their challenges, and related machine learning models in healthcare. The methods are discussed under six categories: Features-oriented methods, global methods, concept models, surrogate models, local pixel-based methods, and human-centric methods. Most importantly, the paper explores XAI role in healthcare problems to clarify its necessity in safety-critical applications. The paper intends to establish a comprehensive understanding of XAI-related applications in the healthcare field by reviewing the related experimental results. To facilitate future research for filling research gaps, the importance of XAI models from different viewpoints and their limitations are investigated.
△ Less
Submitted 4 April, 2023;
originally announced April 2023.
-
Two-stream Encoder-Decoder Network for Localizing Image Forgeries
Authors:
Aniruddha Mazumdar,
Prabin Kumar Bora
Abstract:
This paper proposes a novel two-stream encoder-decoder network, which utilizes both the high-level and the low-level image features for precisely localizing forged regions in a manipulated image. This is motivated from the fact that the forgery creation process generally introduces both the high-level artefacts (e.g. unnatural contrast) and the low-level artefacts (e.g. noise inconsistency) to the…
▽ More
This paper proposes a novel two-stream encoder-decoder network, which utilizes both the high-level and the low-level image features for precisely localizing forged regions in a manipulated image. This is motivated from the fact that the forgery creation process generally introduces both the high-level artefacts (e.g. unnatural contrast) and the low-level artefacts (e.g. noise inconsistency) to the forged images. In the proposed two-stream network, one stream learns the low-level manipulation-related features in the encoder side by extracting noise residuals through a set of high-pass filters in the first layer of the encoder network. In the second stream, the encoder learns the high-level image manipulation features from the input image RGB values. The coarse feature maps of both the encoders are upsampled by their corresponding decoder network to produce dense feature maps. The dense feature maps of the two streams are concatenated and fed to a final convolutional layer with sigmoidal activation to produce pixel-wise prediction. We have carried out experimental analysis on multiple standard forensics datasets to evaluate the performance of the proposed method. The experimental results show the efficacy of the proposed method with respect to the state-of-the-art.
△ Less
Submitted 27 September, 2020;
originally announced September 2020.
-
Universal Image Manipulation Detection using Deep Siamese Convolutional Neural Network
Authors:
Aniruddha Mazumdar,
Jaya Singh,
Yosha Singh Tomar,
Prabin Kumar Bora
Abstract:
Detection of different types of image editing operations carried out on an image is an important problem in image forensics. It gives the information about the processing history of an image, and also can expose forgeries present in an image. There have been few methods proposed to detect different types of image editing operations in a single framework. However, all the operations have to be know…
▽ More
Detection of different types of image editing operations carried out on an image is an important problem in image forensics. It gives the information about the processing history of an image, and also can expose forgeries present in an image. There have been few methods proposed to detect different types of image editing operations in a single framework. However, all the operations have to be known a priori in the training phase. But, in real-forensics scenarios it may not be possible to know about the editing operations carried out on an image. To solve this problem, we propose a novel deep learning-based method which can differentiate between different types of image editing operations. The proposed method classifies image patches in a pair-wise fashion as either similarly or differently processed using a deep siamese neural network. Once the network learns feature that can discriminate between different image editing operations, it can differentiate between different image editing operations not present in the training stage. The experimental results show the efficacy of the proposed method in detecting/discriminating different image editing operations.
△ Less
Submitted 23 August, 2018; v1 submitted 20 August, 2018;
originally announced August 2018.
-
A Fast Data Driven Shrinkage of Singular Values for Arbitrary Rank Signal Matrix Denoising
Authors:
Santosh Kumar Yadav,
Rohit Sinha,
Prabin Kumar Bora
Abstract:
Recovering a low-rank signal matrix from its noisy observation, commonly known as matrix denoising, is a fundamental inverse problem in statistical signal processing. Matrix denoising methods are generally based on shrinkage or thresholding of singular values with a predetermined shrinkage parameter or threshold. However, most of the existing adaptive shrinkage methods use multiple parameters to o…
▽ More
Recovering a low-rank signal matrix from its noisy observation, commonly known as matrix denoising, is a fundamental inverse problem in statistical signal processing. Matrix denoising methods are generally based on shrinkage or thresholding of singular values with a predetermined shrinkage parameter or threshold. However, most of the existing adaptive shrinkage methods use multiple parameters to obtain a better flexibility in shrinkage. The optimal value of these parameters using either cross-validation or Stein's principle. In both the cases, the iterative estimation of various parameters render the existing shrinkage methods computationally latent for most of the real-time applications. This paper presents an efficient data dependent shrinkage function whose parameters are estimated using Stein's principle but in a non-iterative manner, thereby providing a comparatively faster shrinkage method. In addition, the proposed estimator is found to be consistent with the recently proposed asymptotically optimal estimators using the results from random matrix theory. The experimental studies on artificially generated low-rank matrices and on the magnetic resonant imagery data, show the efficacy of the proposed denoising method.
△ Less
Submitted 19 January, 2017; v1 submitted 4 January, 2017;
originally announced January 2017.
-
Electrocardiogram signal denoising using non-local wavelet transform domain filtering
Authors:
Santosh Kumar Yadav,
Rohit Sinha,
Prabin Kumar Bora
Abstract:
ECG signals are usually corrupted by baseline wander, power-line interference, muscle noise, etc. and numerous methods have been proposed to remove these noises. However, in case of wireless recording of the ECG signal it gets corrupted by the additive white Gaussian noise (AWGN). For the correct diagnosis, removal of AWGN from ECG signals becomes necessary as it affects the all the diagnostic fea…
▽ More
ECG signals are usually corrupted by baseline wander, power-line interference, muscle noise, etc. and numerous methods have been proposed to remove these noises. However, in case of wireless recording of the ECG signal it gets corrupted by the additive white Gaussian noise (AWGN). For the correct diagnosis, removal of AWGN from ECG signals becomes necessary as it affects the all the diagnostic features. The natural signals exhibit correlation among their samples and this property has been exploited in various signal restoration tasks. Motivated by that, in this work we propose a nonlocal wavelet transform domain ECG signal denoising method which exploits the correlations among both local and nonlocal samples of the signal. In the proposed method, the similar blocks of the samples are grouped in a matrix and then denoising is achieved by the shrinkage of its two-dimensional discrete wavelet transform coefficients. The experiments performed on a number of ECG signals show significant quantitative and qualitative improvement in denoising performance over the existing ECG signal denoising methods.
△ Less
Submitted 26 October, 2016;
originally announced November 2016.