-
UDCR: Unsupervised Aortic DSA/CTA Rigid Registration Using Deep Reinforcement Learning and Overlap Degree Calculation
Authors:
Wentao Liu,
Bowen Liang,
Wei** Xu,
Tong Tian,
Qingsheng Lu,
Xipeng Pan,
Haoyuan Li,
Siyu Tian,
Huihua Yang,
Ruisheng Su
Abstract:
The rigid registration of aortic Digital Subtraction Angiography (DSA) and Computed Tomography Angiography (CTA) can provide 3D anatomical details of the vasculature for the interventional surgical treatment of conditions such as aortic dissection and aortic aneurysms, holding significant value for clinical research. However, the current methods for 2D/3D image registration are dependent on manual…
▽ More
The rigid registration of aortic Digital Subtraction Angiography (DSA) and Computed Tomography Angiography (CTA) can provide 3D anatomical details of the vasculature for the interventional surgical treatment of conditions such as aortic dissection and aortic aneurysms, holding significant value for clinical research. However, the current methods for 2D/3D image registration are dependent on manual annotations or synthetic data, as well as the extraction of landmarks, which is not suitable for cross-modal registration of aortic DSA/CTA. In this paper, we propose an unsupervised method, UDCR, for aortic DSA/CTA rigid registration based on deep reinforcement learning. Leveraging the imaging principles and characteristics of DSA and CTA, we have constructed a cross-dimensional registration environment based on spatial transformations. Specifically, we propose an overlap degree calculation reward function that measures the intensity difference between the foreground and background, aimed at assessing the accuracy of registration between segmentation maps and DSA images. This method is highly flexible, allowing for the loading of pre-trained models to perform registration directly or to seek the optimal spatial transformation parameters through online learning. We manually annotated 61 pairs of aortic DSA/CTA for algorithm evaluation. The results indicate that the proposed UDCR achieved a Mean Absolute Error (MAE) of 2.85 mm in translation and 4.35° in rotation, showing significant potential for clinical applications.
△ Less
Submitted 8 March, 2024;
originally announced March 2024.
-
Two-Stage Hybrid Supervision Framework for Fast, Low-resource, and Accurate Organ and Pan-cancer Segmentation in Abdomen CT
Authors:
Wentao Liu,
Tong Tian,
Wei** Xu,
Lemeng Wang,
Haoyuan Li,
Huihua Yang
Abstract:
Abdominal organ and tumour segmentation has many important clinical applications, such as organ quantification, surgical planning, and disease diagnosis. However, manual assessment is inherently subjective with considerable inter- and intra-expert variability. In the paper, we propose a hybrid supervised framework, StMt, that integrates self-training and mean teacher for the segmentation of abdomi…
▽ More
Abdominal organ and tumour segmentation has many important clinical applications, such as organ quantification, surgical planning, and disease diagnosis. However, manual assessment is inherently subjective with considerable inter- and intra-expert variability. In the paper, we propose a hybrid supervised framework, StMt, that integrates self-training and mean teacher for the segmentation of abdominal organs and tumors using partially labeled and unlabeled data. We introduce a two-stage segmentation pipeline and whole-volume-based input strategy to maximize segmentation accuracy while meeting the requirements of inference time and GPU memory usage. Experiments on the validation set of FLARE2023 demonstrate that our method achieves excellent segmentation performance as well as fast and low-resource model inference. Our method achieved an average DSC score of 89.79\% and 45.55 \% for the organs and lesions on the validation set and the average running time and area under GPU memory-time cure are 11.25s and 9627.82MB, respectively.
△ Less
Submitted 15 November, 2023; v1 submitted 11 September, 2023;
originally announced September 2023.
-
A Robust ADMM-Based Optimization Algorithm For Underwater Acoustic Channel Estimation
Authors:
Tian Tian,
Agastya Raj,
Bruno Missi Xavier,
Ying Zhang,
Feiyun Wu,
Kunde Yang
Abstract:
Accurate estimation of the Underwater acoustic (UWA) is a key part of underwater communications, especially for coherent systems. The severe multipath effects and large delay spreads make the estimation problem large-scale. The non-stationary, non-Gaussian, and impulsive nature of ocean ambient noise poses further obstacles to the design of estimation algorithms. Under the framework of compressed…
▽ More
Accurate estimation of the Underwater acoustic (UWA) is a key part of underwater communications, especially for coherent systems. The severe multipath effects and large delay spreads make the estimation problem large-scale. The non-stationary, non-Gaussian, and impulsive nature of ocean ambient noise poses further obstacles to the design of estimation algorithms. Under the framework of compressed sensing (CS), this work addresses the issue of robust channel estimation when measurements are contaminated by impulsive noise. A first-order algorithm based on alternating direction method of multipliers (ADMM) is proposed. Numerical simulations of time-varying channel estimation are performed to show its improved performance in highly impulsive noise environments.
△ Less
Submitted 24 August, 2023; v1 submitted 23 August, 2023;
originally announced August 2023.
-
DIAS: A Dataset and Benchmark for Intracranial Artery Segmentation in DSA sequences
Authors:
Wentao Liu,
Tong Tian,
Lemeng Wang,
Wei** Xu,
Lei Li,
Haoyuan Li,
Wenyi Zhao,
Siyu Tian,
Xipeng Pan,
Huihua Yang,
Feng Gao,
Yiming Deng,
Xin Yang,
Ruisheng Su
Abstract:
The automated segmentation of Intracranial Arteries (IA) in Digital Subtraction Angiography (DSA) plays a crucial role in the quantification of vascular morphology, significantly contributing to computer-assisted stroke research and clinical practice. Current research primarily focuses on the segmentation of single-frame DSA using proprietary datasets. However, these methods face challenges due to…
▽ More
The automated segmentation of Intracranial Arteries (IA) in Digital Subtraction Angiography (DSA) plays a crucial role in the quantification of vascular morphology, significantly contributing to computer-assisted stroke research and clinical practice. Current research primarily focuses on the segmentation of single-frame DSA using proprietary datasets. However, these methods face challenges due to the inherent limitation of single-frame DSA, which only partially displays vascular contrast, thereby hindering accurate vascular structure representation. In this work, we introduce DIAS, a dataset specifically developed for IA segmentation in DSA sequences. We establish a comprehensive benchmark for evaluating DIAS, covering full, weak, and semi-supervised segmentation methods. Specifically, we propose the vessel sequence segmentation network, in which the sequence feature extraction module effectively captures spatiotemporal representations of intravascular contrast, achieving intracranial artery segmentation in 2D+Time DSA sequences. For weakly-supervised IA segmentation, we propose a novel scribble learning-based image segmentation framework, which, under the guidance of scribble labels, employs cross pseudo-supervision and consistency regularization to improve the performance of the segmentation network. Furthermore, we introduce the random patch-based self-training framework, aimed at alleviating the performance constraints encountered in IA segmentation due to the limited availability of annotated DSA data. Our extensive experiments on the DIAS dataset demonstrate the effectiveness of these methods as potential baselines for future research and clinical applications. The dataset and code are publicly available at https://doi.org/10.5281/zenodo.11396520 and https://github.com/lseventeen/DIAS.
△ Less
Submitted 13 June, 2024; v1 submitted 21 June, 2023;
originally announced June 2023.
-
PHTrans: Parallelly Aggregating Global and Local Representations for Medical Image Segmentation
Authors:
Wentao Liu,
Tong Tian,
Wei** Xu,
Huihua Yang,
Xipeng Pan,
Songlin Yan,
Lemeng Wang
Abstract:
The success of Transformer in computer vision has attracted increasing attention in the medical imaging community. Especially for medical image segmentation, many excellent hybrid architectures based on convolutional neural networks (CNNs) and Transformer have been presented and achieve impressive performance. However, most of these methods, which embed modular Transformer into CNNs, struggle to r…
▽ More
The success of Transformer in computer vision has attracted increasing attention in the medical imaging community. Especially for medical image segmentation, many excellent hybrid architectures based on convolutional neural networks (CNNs) and Transformer have been presented and achieve impressive performance. However, most of these methods, which embed modular Transformer into CNNs, struggle to reach their full potential. In this paper, we propose a novel hybrid architecture for medical image segmentation called PHTrans, which parallelly hybridizes Transformer and CNN in main building blocks to produce hierarchical representations from global and local features and adaptively aggregate them, aiming to fully exploit their strengths to obtain better segmentation performance. Specifically, PHTrans follows the U-shaped encoder-decoder design and introduces the parallel hybird module in deep stages, where convolution blocks and the modified 3D Swin Transformer learn local features and global dependencies separately, then a sequence-to-volume operation unifies the dimensions of the outputs to achieve feature aggregation. Extensive experimental results on both Multi-Atlas Labeling Beyond the Cranial Vault and Automated Cardiac Diagnosis Challeng datasets corroborate its effectiveness, consistently outperforming state-of-the-art methods. The code is available at: https://github.com/lseventeen/PHTrans.
△ Less
Submitted 23 July, 2022; v1 submitted 9 March, 2022;
originally announced March 2022.
-
Multi-resolution Progressive Computational Ghost Imaging
Authors:
Cheng Zhou,
Tian Tian,
Chao Gao,
Wenli Gong,
Lijun Song
Abstract:
Ghost imaging needs massive measurements to obtain an image with good visibility and the imaging speed is usually very low. In order to realize real-time high-resolution ghost imaging of a target which is located in a scenario with a large field of view (FOV), we propose a high-speed multi-resolution progressive computational ghost imaging approach. The target area is firstly locked by a low-resol…
▽ More
Ghost imaging needs massive measurements to obtain an image with good visibility and the imaging speed is usually very low. In order to realize real-time high-resolution ghost imaging of a target which is located in a scenario with a large field of view (FOV), we propose a high-speed multi-resolution progressive computational ghost imaging approach. The target area is firstly locked by a low-resolution image with a small number of measurements, then high-resolution imaging of the target can be obtained by only modulating the light fields corresponding to the target area. The experiments verify the feasibility of the approach. The influence of detection signal-to-noise ratio on the quality of multi-resolution progressive computational ghost imaging is also investigated experimentally. This approach may be applied to some practical application scenarios such as ground-to-air or air-to-air imaging with a large FOV.
△ Less
Submitted 2 November, 2018;
originally announced November 2018.
-
Estimation of Spatial-Temporal Gait Parameters based on the Fusion of Inertial and Film-Pressure Signals
Authors:
Cheng Wang,
Xiangdong Wang,
Zhou Long,
Tian Tian,
Mingming Gao,
** Yun,
Yueliang Qian,
**tao Li
Abstract:
Gait analysis (GA) has been widely used in physical activity monitoring and clinical contexts, and the estimation of the spatial-temporal gait parameters is of primary importance for GA. With the quick development of smart tiny sensors, GA methods based on wearable devices have become more popular recently. However, most existing wearable GA methods focus on data analysis from inertial sensors. In…
▽ More
Gait analysis (GA) has been widely used in physical activity monitoring and clinical contexts, and the estimation of the spatial-temporal gait parameters is of primary importance for GA. With the quick development of smart tiny sensors, GA methods based on wearable devices have become more popular recently. However, most existing wearable GA methods focus on data analysis from inertial sensors. In this paper, we firstly present a two-foot-worn in-shoe system (Gaitboter) based on low-cost, wearable and multimodal sensors' fusion for GA, comprising an inertial sensor and eight film-pressure sensors with each foot for gait raw data collection while walking. Secondly, a GA algorithm for estimating the spatial-temporal parameters of gait is proposed. The algorithm fully uses the fusion of two kinds of sensors' signals: inertial sensor and film-pressure sensor, in order to estimate the spatial-temporal gait parameters, such as stance phase, swing phase, double stance phase, cadence, step time, stride time, stride length, velocity. Finally, to verify the effectiveness of this system and algorithm of the paper, an experiment is performed with 27 stoke patients from local hospital that the spatial-temporal gait parameters obtained with the system and the algorithm are compared with a GA tool used in medical laboratories. And the experimental results show that it achieves very good consistency and correlation between the proposed system and the compared GA tool.
△ Less
Submitted 23 October, 2018;
originally announced October 2018.