-
Optimizing Universal Lesion Segmentation: State Space Model-Guided Hierarchical Networks with Feature Importance Adjustment
Authors:
Kazi Shahriar Sanjid,
Md. Tanzim Hossain,
Md. Shakib Shahariar Junayed,
M. Monir Uddin
Abstract:
Deep learning has revolutionized medical imaging by providing innovative solutions to complex healthcare challenges. Traditional models often struggle to dynamically adjust feature importance, resulting in suboptimal representation, particularly in tasks like semantic segmentation crucial for accurate structure delineation. Moreover, their static nature incurs high computational costs. To tackle t…
▽ More
Deep learning has revolutionized medical imaging by providing innovative solutions to complex healthcare challenges. Traditional models often struggle to dynamically adjust feature importance, resulting in suboptimal representation, particularly in tasks like semantic segmentation crucial for accurate structure delineation. Moreover, their static nature incurs high computational costs. To tackle these issues, we introduce Mamba-Ahnet, a novel integration of State Space Model (SSM) and Advanced Hierarchical Network (AHNet) within the MAMBA framework, specifically tailored for semantic segmentation in medical imaging.Mamba-Ahnet combines SSM's feature extraction and comprehension with AHNet's attention mechanisms and image reconstruction, aiming to enhance segmentation accuracy and robustness. By dissecting images into patches and refining feature comprehension through self-attention mechanisms, the approach significantly improves feature resolution. Integration of AHNet into the MAMBA framework further enhances segmentation performance by selectively amplifying informative regions and facilitating the learning of rich hierarchical representations. Evaluation on the Universal Lesion Segmentation dataset demonstrates superior performance compared to state-of-the-art techniques, with notable metrics such as a Dice similarity coefficient of approximately 98% and an Intersection over Union of about 83%. These results underscore the potential of our methodology to enhance diagnostic accuracy, treatment planning, and ultimately, patient outcomes in clinical practice. By addressing the limitations of traditional models and leveraging the power of deep learning, our approach represents a significant step forward in advancing medical imaging technology.
△ Less
Submitted 26 April, 2024;
originally announced April 2024.
-
Integrating Mamba Sequence Model and Hierarchical Upsampling Network for Accurate Semantic Segmentation of Multiple Sclerosis Legion
Authors:
Kazi Shahriar Sanjid,
Md. Tanzim Hossain,
Md. Shakib Shahariar Junayed,
Dr. Mohammad Monir Uddin
Abstract:
Integrating components from convolutional neural networks and state space models in medical image segmentation presents a compelling approach to enhance accuracy and efficiency. We introduce Mamba HUNet, a novel architecture tailored for robust and efficient segmentation tasks. Leveraging strengths from Mamba UNet and the lighter version of Hierarchical Upsampling Network (HUNet), Mamba HUNet comb…
▽ More
Integrating components from convolutional neural networks and state space models in medical image segmentation presents a compelling approach to enhance accuracy and efficiency. We introduce Mamba HUNet, a novel architecture tailored for robust and efficient segmentation tasks. Leveraging strengths from Mamba UNet and the lighter version of Hierarchical Upsampling Network (HUNet), Mamba HUNet combines convolutional neural networks local feature extraction power with state space models long range dependency modeling capabilities. We first converted HUNet into a lighter version, maintaining performance parity and then integrated this lighter HUNet into Mamba HUNet, further enhancing its efficiency. The architecture partitions input grayscale images into patches, transforming them into 1D sequences for processing efficiency akin to Vision Transformers and Mamba models. Through Visual State Space blocks and patch merging layers, hierarchical features are extracted while preserving spatial information. Experimental results on publicly available Magnetic Resonance Imaging scans, notably in Multiple Sclerosis lesion segmentation, demonstrate Mamba HUNet's effectiveness across diverse segmentation tasks. The model's robustness and flexibility underscore its potential in handling complex anatomical structures. These findings establish Mamba HUNet as a promising solution in advancing medical image segmentation, with implications for improving clinical decision making processes.
△ Less
Submitted 26 March, 2024;
originally announced March 2024.
-
Balanced Truncation of Linear Systems with Quadratic Outputs in Limited Time and Frequency Intervals
Authors:
Qiu-Yan Song,
Umair Zulfiqar,
Zhi-Hua Xiao,
Mohammad Monir Uddin,
Victor Sreeram
Abstract:
Model order reduction involves constructing a reduced-order approximation of a high-order model while retaining its essential characteristics. This reduced-order model serves as a substitute for the original one in various applications such as simulation, analysis, and design. Often, there's a need to maintain high accuracy within a specific time or frequency interval, while errors beyond this lim…
▽ More
Model order reduction involves constructing a reduced-order approximation of a high-order model while retaining its essential characteristics. This reduced-order model serves as a substitute for the original one in various applications such as simulation, analysis, and design. Often, there's a need to maintain high accuracy within a specific time or frequency interval, while errors beyond this limit can be tolerated. This paper addresses time-limited and frequency-limited model order reduction scenarios for linear systems with quadratic outputs, by generalizing the recently introduced structure-preserving balanced truncation algorithm. To that end, limited interval system Gramians are defined, and the corresponding generalized Lyapunov equations governing their computation are derived. Additionally, low-rank solutions for these equations are investigated. Next, balanced truncation algorithms are proposed for time-limited and frequency-limited scenarios, each utilizing its corresponding limited-interval system Gramians. The proposed algorithms ensure accurate results within specified time and frequency intervals while preserving the quadratic-output structure. Two benchmark numerical examples are presented to demonstrate the effectiveness of the algorithms, showcasing their ability to achieve superior accuracy within the desired time or frequency interval.
△ Less
Submitted 5 March, 2024; v1 submitted 17 February, 2024;
originally announced February 2024.
-
Towards an Adaptive Dynamic Mode Decomposition
Authors:
Mohammad N. Murshed,
M. Monir Uddin
Abstract:
Dynamic Mode Decomposition (DMD) is a data based modeling tool that identifies a matrix to map a quantity at some time instant to the same quantity in future. We design a new version which we call Adaptive Dynamic Mode Decomposition (ADMD) that utilizes time delay coordinates, projection methods and filters as per the nature of the data to create a model for the available problem. Filters are very…
▽ More
Dynamic Mode Decomposition (DMD) is a data based modeling tool that identifies a matrix to map a quantity at some time instant to the same quantity in future. We design a new version which we call Adaptive Dynamic Mode Decomposition (ADMD) that utilizes time delay coordinates, projection methods and filters as per the nature of the data to create a model for the available problem. Filters are very effective in reducing the rank of high-dimensional dataset. We have incorporated 'discrete Fourier transform' and 'augmented lagrangian multiplier' as filters in our method. The proposed ADMD is tested on several datasets of varying complexities and its performance appears to be promising.
△ Less
Submitted 11 December, 2020;
originally announced December 2020.
-
Interpolatory projection technique for Riccati-based feedback stabilization of index-1 descriptor systems
Authors:
Mahtab Uddin,
M. Monir Uddin,
M. A. H. Khan,
Md. Motlubar Rahman
Abstract:
The work aims to stabilize the unstable index-1 descriptor systems by Riccati-based feedback stabilization via a modified form of Iterative Rational Krylov Algorithm (IRKA), which is a bi-tangential interpolation-based technique. In the basic IRKA, for the stable systems the Reduced Order Models (ROMs) can be found conveniently, but it is unsuitable for the unstable ones. In the proposed technique…
▽ More
The work aims to stabilize the unstable index-1 descriptor systems by Riccati-based feedback stabilization via a modified form of Iterative Rational Krylov Algorithm (IRKA), which is a bi-tangential interpolation-based technique. In the basic IRKA, for the stable systems the Reduced Order Models (ROMs) can be found conveniently, but it is unsuitable for the unstable ones. In the proposed technique, the initial feedback is implemented within the construction of the projectors of the IRKA approach. The solution of the Riccati equation is estimated from the ROM achieved by IRKA and hence the low-rank feedback matrix is attained. Using the reverse projecting process, for the full model the optimal feedback matrix is retrieved from the low-rank feedback matrix. Finally, to validate the aptness and competency of the proposed technique it is applied to unstable index-1 descriptor systems. The comparison of the present work with two previous works is narrated. The simulation is done by numerical computation using MATLAB, and both the tabular method and graphical method are used as the supporting tools of comparative analysis.
△ Less
Submitted 30 March, 2021; v1 submitted 29 July, 2020;
originally announced July 2020.
-
Computationally efficient optimal control for unstable power system models
Authors:
Mahtab Uddin,
M. Monir Uddin,
Md. Abdul Hakim Khan
Abstract:
In this article, the focus is mainly on gaining the optimal control for the unstable power system models and stabilizing them through the Riccati-based feedback stabilization process with sparsity-preserving techniques. We are to find the solution of the Continuous-time Algebraic Riccati Equations (CAREs) governed from the unstable power system models derived from the Brazilian Inter-Connected Pow…
▽ More
In this article, the focus is mainly on gaining the optimal control for the unstable power system models and stabilizing them through the Riccati-based feedback stabilization process with sparsity-preserving techniques. We are to find the solution of the Continuous-time Algebraic Riccati Equations (CAREs) governed from the unstable power system models derived from the Brazilian Inter-Connected Power System (BIPS) models, which are large-scale sparse index-1 descriptor systems. We propose the projection-based Rational Krylov Subspace Method (RKSM) for the iterative computation of the solution of the CAREs. The novelties of RKSM are sparsity-preserving computations and the implementation of time-convenient adaptive shift parameters. We modify the Low-Rank Cholesky-Factor integrated Alternating Direction Implicit (LRCF-ADI) technique based nested iterative Kleinman-Newton (KN) method to a sparse form and adjust this to solve the desired CAREs. We compare the results achieved by the Kleinman-Newton method with that of using the RKSM. The applicability and adaptability of the proposed techniques are justified numerically with MATLAB simulations. Transient behaviors of the target models are investigated for comparative analysis through the tabular and graphical approaches.
△ Less
Submitted 1 September, 2021; v1 submitted 25 June, 2020;
originally announced June 2020.
-
Interpolatory Projection Techniques for $\mathcal{H}_2$ Optimal Structure-Preserving Model Order Reduction of Second-Order Systems
Authors:
Md. Motlubar Rahman,
M. Monir Uddin,
L. S. Andallah,
Mahtab Uddin
Abstract:
This paper focuses on exploring efficient ways to find $\mathcal{H}_2$ optimal Structure-Preserving Model Order Reduction (SPMOR) of the second-order systems via interpolatory projection-based method Iterative Rational Krylov Algorithm (IRKA). To get the reduced models of the second-order systems, the classical IRKA deals with the equivalent first-order converted forms and estimates the first-orde…
▽ More
This paper focuses on exploring efficient ways to find $\mathcal{H}_2$ optimal Structure-Preserving Model Order Reduction (SPMOR) of the second-order systems via interpolatory projection-based method Iterative Rational Krylov Algorithm (IRKA). To get the reduced models of the second-order systems, the classical IRKA deals with the equivalent first-order converted forms and estimates the first-order reduced models. The drawbacks of that of the technique are failure of structure preservation and abolishing the properties of the original models, which are the key factors for some of the physical applications. To surpass those issues, we introduce IRKA based techniques that enable us to approximate the second-order systems through the reduced models implicitly without forming the first-order forms. On the other hand, there are very challenging tasks to the Model Order Reduction (MOR) of the large-scale second-order systems with the optimal $\mathcal{H}_2$ error norm and attain the rapid rate of convergence. For the convenient computations, we discuss competent techniques to determine the optimal $\mathcal{H}_2$ error norms efficiently for the second-order systems. The applicability and efficiency of the proposed techniques are validated by applying them to some large-scale systems extracted form engineering applications. The computations are done numerically using MATLAB simulation and the achieved results are discussed in both tabular and graphical approaches.
△ Less
Submitted 8 October, 2023; v1 submitted 24 June, 2020;
originally announced June 2020.
-
Estimating Blood Pressure from Photoplethysmogram Signal and Demographic Features using Machine Learning Techniques
Authors:
Moajjem Hossain Chowdhury,
Md Nazmul Islam Shuzan,
Muhammad E. H. Chowdhury,
Zaid B Mahbub,
M. Monir Uddin,
Amith Khandakar,
Mamun Bin Ibne Reaz
Abstract:
Hypertension is a potentially unsafe health ailment, which can be indicated directly from the Blood pressure (BP). Hypertension always leads to other health complications. Continuous monitoring of BP is very important; however, cuff-based BP measurements are discrete and uncomfortable to the user. To address this need, a cuff-less, continuous and a non-invasive BP measurement system is proposed us…
▽ More
Hypertension is a potentially unsafe health ailment, which can be indicated directly from the Blood pressure (BP). Hypertension always leads to other health complications. Continuous monitoring of BP is very important; however, cuff-based BP measurements are discrete and uncomfortable to the user. To address this need, a cuff-less, continuous and a non-invasive BP measurement system is proposed using Photoplethysmogram (PPG) signal and demographic features using machine learning (ML) algorithms. PPG signals were acquired from 219 subjects, which undergo pre-processing and feature extraction steps. Time, frequency and time-frequency domain features were extracted from the PPG and their derivative signals. Feature selection techniques were used to reduce the computational complexity and to decrease the chance of over-fitting the ML algorithms. The features were then used to train and evaluate ML algorithms. The best regression models were selected for Systolic BP (SBP) and Diastolic BP (DBP) estimation individually. Gaussian Process Regression (GPR) along with ReliefF feature selection algorithm outperforms other algorithms in estimating SBP and DBP with a root-mean-square error (RMSE) of 6.74 and 3.59 respectively. This ML model can be implemented in hardware systems to continuously monitor BP and avoid any critical health conditions due to sudden changes.
△ Less
Submitted 7 May, 2020;
originally announced May 2020.
-
Projection assisted Dynamic Mode Decomposition of large scale data
Authors:
Mohammad N. Murshed,
M. Monir Uddin
Abstract:
We have deluge of data in time series format for numerous phenomena. The number of snapshots, resolution and many other factors come into play as we look to identify the dynamics in a given problem. The pre-processing and post-processing steps while working with the data may be related to the resources in terms of the hardware used to collect data and computations that we perform on the data to cr…
▽ More
We have deluge of data in time series format for numerous phenomena. The number of snapshots, resolution and many other factors come into play as we look to identify the dynamics in a given problem. The pre-processing and post-processing steps while working with the data may be related to the resources in terms of the hardware used to collect data and computations that we perform on the data to create a model for the problem. Dynamic Mode Decomposition (DMD) is a data based modeling tool that identifies a matrix to map a quantity at some time instant to the same quantity in future. It is possible to generate a model by projecting the high dimensional spatiotemporal data to a lower dimensional subspace in a probabilistic framework. Sampling and gaussian projection have been used in the past to increase efficiency in the computation. Here, we design an optimized version of DMD that utilizes time delay coordinates and a projection matrix. In our proposal, we discussed about two projection matrices -- one is inspired by the Krylov subspace and the other promotes and leverages sparsity to bring computational benefits in producing a model. Satisfactory results are obtained as they are tested on data related to Double gyre (present in ocean mixing) and on a 2D compressible signal. The motivation behind this scheme of DMD comes from the fact that data from many phenomena are 'big' and 'highly oscillatory.'
△ Less
Submitted 10 January, 2020;
originally announced January 2020.