-
RSTAR: Rotational Streak Artifact Reduction in 4D CBCT using Separable and Circular Convolutions
Authors:
Ziheng Deng,
Hua Chen,
Haibo Hu,
Zhiyong Xu,
Tianling Lyu,
Yan Xi,
Yang Chen,
Jun Zhao
Abstract:
Four-dimensional cone-beam computed tomography (4D CBCT) provides respiration-resolved images and can be used for image-guided radiation therapy. However, the ability to reveal respiratory motion comes at the cost of image artifacts. As raw projection data are sorted into multiple respiratory phases, there is a limited number of cone-beam projections available for image reconstruction. Consequentl…
▽ More
Four-dimensional cone-beam computed tomography (4D CBCT) provides respiration-resolved images and can be used for image-guided radiation therapy. However, the ability to reveal respiratory motion comes at the cost of image artifacts. As raw projection data are sorted into multiple respiratory phases, there is a limited number of cone-beam projections available for image reconstruction. Consequently, the 4D CBCT images are covered by severe streak artifacts. Although several deep learning-based methods have been proposed to address this issue, most algorithms employ ordinary network models, neglecting the intrinsic structural prior within 4D CBCT images. In this paper, we first explore the origin and appearance of streak artifacts in 4D CBCT images.Specifically, we find that streak artifacts exhibit a periodic rotational motion along with the patient's respiration. This unique motion pattern inspires us to distinguish the artifacts from the desired anatomical structures in the spatiotemporal domain. Thereafter, we propose a spatiotemporal neural network named RSTAR-Net with separable and circular convolutions for Rotational Streak Artifact Reduction. The specially designed model effectively encodes dynamic image features, facilitating the recovery of 4D CBCT images. Moreover, RSTAR-Net is also lightweight and computationally efficient. Extensive experiments substantiate the effectiveness of our proposed method, and RSTAR-Net shows superior performance to comparison methods.
△ Less
Submitted 24 March, 2024;
originally announced March 2024.
-
PDS-MAR: a fine-grained Projection-Domain Segmentation-based Metal Artifact Reduction method for intraoperative CBCT images with guidewires
Authors:
Tianling Lyu,
Zhan Wu,
Gege Ma,
Chen Jiang,
Xinyun Zhong,
Yan Xi,
Yang Chen,
Wentao Zhu
Abstract:
Since the invention of modern CT systems, metal artifacts have been a persistent problem. Due to increased scattering, amplified noise, and insufficient data collection, it is more difficult to suppress metal artifacts in cone-beam CT, limiting its use in human- and robot-assisted spine surgeries where metallic guidewires and screws are commonly used. In this paper, we demonstrate that conventiona…
▽ More
Since the invention of modern CT systems, metal artifacts have been a persistent problem. Due to increased scattering, amplified noise, and insufficient data collection, it is more difficult to suppress metal artifacts in cone-beam CT, limiting its use in human- and robot-assisted spine surgeries where metallic guidewires and screws are commonly used. In this paper, we demonstrate that conventional image-domain segmentation-based MAR methods are unable to eliminate metal artifacts for intraoperative CBCT images with guidewires. To solve this problem, we present a fine-grained projection-domain segmentation-based MAR method termed PDS-MAR, in which metal traces are augmented and segmented in the projection domain before being inpainted using triangular interpolation. In addition, a metal reconstruction phase is proposed to restore metal areas in the image domain. The digital phantom study and real CBCT data study demonstrate that the proposed algorithm achieves significantly better artifact suppression than other comparing methods and has the potential to advance the use of intraoperative CBCT imaging in clinical spine surgeries.
△ Less
Submitted 20 June, 2023;
originally announced June 2023.
-
Photoacoustic digital brain: numerical modelling and image reconstruction via deep learning
Authors:
Tengbo Lyu,
Jiadong Zhang,
Zijian Gao,
Changchun Yang,
Feng Gao,
Fei Gao
Abstract:
Photoacoustic tomography (PAT) is a newly developed medical imaging modality, which combines the advantages of pure optical imaging and ultrasound imaging, owning both high optical contrast and deep penetration depth. Very recently, PAT is studied in human brain imaging. Nevertheless, while ultrasound waves are passing through the human skull tissues, the strong acoustic attenuation and aberration…
▽ More
Photoacoustic tomography (PAT) is a newly developed medical imaging modality, which combines the advantages of pure optical imaging and ultrasound imaging, owning both high optical contrast and deep penetration depth. Very recently, PAT is studied in human brain imaging. Nevertheless, while ultrasound waves are passing through the human skull tissues, the strong acoustic attenuation and aberration will happen, which causes photoacoustic signals' distortion. In this work, we use 10 magnetic resonance angiography (MRA) human brain volumes, and manually segment them to obtain the 2D human brain numerical phantoms for PAT. The numerical phantoms contain six kinds of tissues which are scalp, skull, white matter, gray matter, blood vessel and cerebral cortex. For every numerical phantom, optical properties are assigned to every kind of tissues. Then, Monte-Carlo based optical simulation is deployed to obtain the photoacoustic initial pressure. Then, we made two k-wave simulation cases: one takes inhomogeneous medium and uneven sound velocity into consideration, and the other not. Then we use the sensor data of the former one as the input of U-net, and the sensor data of the latter one as the output of U-net to train the network. We randomly choose 7 human brain PA sinograms as the training dataset and 3 human brain PA sinograms as the testing set. The testing result shows that our method could correct the skull acoustic aberration and obtain the blood vessel distribution inside the human brain satisfactorily.
△ Less
Submitted 19 September, 2021;
originally announced September 2021.
-
Dual-energy Computed Tomography Imaging from Contrast-enhanced Single-energy Computed Tomography
Authors:
Wei Zhao,
Tianling Lyu,
Yang Chen,
Lei Xing
Abstract:
In a standard computed tomography (CT) image, pixels having the same Hounsfield Units (HU) can correspond to different materials and it is therefore challenging to differentiate and quantify materials. Dual-energy CT (DECT) is desirable to differentiate multiple materials, but DECT scanners are not widely available as single-energy CT (SECT) scanners. Here we purpose a deep learning approach to pe…
▽ More
In a standard computed tomography (CT) image, pixels having the same Hounsfield Units (HU) can correspond to different materials and it is therefore challenging to differentiate and quantify materials. Dual-energy CT (DECT) is desirable to differentiate multiple materials, but DECT scanners are not widely available as single-energy CT (SECT) scanners. Here we purpose a deep learning approach to perform DECT imaging by using standard SECT data. We designed a predenoising and difference learning mechanism to generate DECT images from SECT data. The performance of the deep learning-based DECT approach was studied using images from patients who received contrast-enhanced abdomen DECT scan with a popular DE application: virtual non-contrast (VNC) imaging and contrast quantification. Clinically relevant metrics were used for quantitative assessment. The absolute HU difference between the predicted and original high-energy CT images are 1.3 HU, 1.6 HU, 1.8 HU and 1.3 HU for the ROIs on aorta, liver, spine and stomach, respectively. The aorta iodine quantification difference between iodine maps obtained from the original and deep learning DECT images is smaller than 1.0\%, and the noise levels in the material images have been reduced by more than 7-folds for the latter. This study demonstrates that highly accurate DECT imaging with single low-energy data is achievable by using a deep learning approach. The proposed method allows us to obtain high-quality DECT images without paying the overhead of conventional hardware-based DECT solutions and thus leads to a new paradigm of spectral CT imaging.
△ Less
Submitted 25 October, 2020;
originally announced October 2020.
-
Dual-energy CT imaging from single-energy CT data with material decomposition convolutional neural network
Authors:
Tianling Lyu,
Zhan Wu,
Yikun Zhang,
Yang Chen,
Lei Xing,
Wei Zhao
Abstract:
Dual-energy computed tomography (DECT) is of great significance for clinical practice due to its huge potential to provide material-specific information. However, DECT scanners are usually more expensive than standard single-energy CT (SECT) scanners and thus are less accessible to undeveloped regions. In this paper, we show that the energy-domain correlation and anatomical consistency between sta…
▽ More
Dual-energy computed tomography (DECT) is of great significance for clinical practice due to its huge potential to provide material-specific information. However, DECT scanners are usually more expensive than standard single-energy CT (SECT) scanners and thus are less accessible to undeveloped regions. In this paper, we show that the energy-domain correlation and anatomical consistency between standard DECT images can be harnessed by a deep learning model to provide high-performance DECT imaging from fully-sampled low-energy data together with single-view high-energy data, which can be obtained by using a scout-view high-energy image. We demonstrate the feasibility of the approach with contrast-enhanced DECT scans from 5,753 slices of images of twenty-two patients and show its superior performance on DECT applications. The deep learning-based approach could be useful to further significantly reduce the radiation dose of current premium DECT scanners and has the potential to simplify the hardware of DECT imaging systems and to enable DECT imaging using standard SECT scanners.
△ Less
Submitted 29 May, 2020;
originally announced June 2020.
-
A deep learning approach for virtual monochromatic spectral CT imaging with a standard single energy CT scanner
Authors:
Wei Zhao,
Tianling Lyu,
Yang Chen,
Lei Xing
Abstract:
Purpose/Objectives: To develop and assess a strategy of using deep learning (DL) to generate virtual monochromatic CT (VMCT) images from a single-energy CT (SECT) scan. Materials/Methods: The proposed data-driven VMCT imaging consists of two steps: (i) using a supervised DL model trained with a large number of 100 kV and 140 kV dual-energy CT (DECT) image pairs to produce the corresponding high-en…
▽ More
Purpose/Objectives: To develop and assess a strategy of using deep learning (DL) to generate virtual monochromatic CT (VMCT) images from a single-energy CT (SECT) scan. Materials/Methods: The proposed data-driven VMCT imaging consists of two steps: (i) using a supervised DL model trained with a large number of 100 kV and 140 kV dual-energy CT (DECT) image pairs to produce the corresponding high-energy CT image from a low-energy image; and (ii) reconstructing VMCT images with energy ranging from 40 to 150 keV. To evaluate the performance of the method, we retrospectively studied 6,767 abdominal DECT images. The VMCT images reconstructed using both DL-derived DECT (DL-DECT) images and the images from DECT scanner were compared quantitatively. Paired-sample t-tests were used for statistical analysis to show the consistency and precision of calculated HU values. Results: Excellent agreement was found between the DL-DECT and the ground truth DECT images (p values ranged from 0.50 to 0.95). Noise reduction up to 68% (from 163 HU to 51 HU) was achieved for DL-based VMCT imaging as compared to that obtained by using the standard DECT. For the DL-based VMCT, the maximum iodine contrast-to-noise ratio (CNR) for each patient (ranging from 15.1 to 16.6) was achieved at 40 keV. In addition to the enormous benefit of VMCT acquisition with merely a SECT image, an improvement of CNR as high as 55% (from 10.7 to 16.6) was attained with the proposed approach. Conclusions: This study demonstrates that high-quality VMCT images can be obtained with only a SECT scan.
△ Less
Submitted 20 May, 2020;
originally announced May 2020.