-
Deep Rib Fracture Instance Segmentation and Classification from CT on the RibFrac Challenge
Authors:
Jiancheng Yang,
Rui Shi,
Liang **,
Xiaoyang Huang,
Kaiming Kuang,
Donglai Wei,
Shixuan Gu,
Jianying Liu,
Pengfei Liu,
Zhizhong Chai,
Yongjie Xiao,
Hao Chen,
Liming Xu,
Bang Du,
Xiangyi Yan,
Hao Tang,
Adam Alessio,
Gregory Holste,
Jiapeng Zhang,
Xiaoming Wang,
Jianye He,
Lixuan Che,
Hanspeter Pfister,
Ming Li,
Bingbing Ni
Abstract:
Rib fractures are a common and potentially severe injury that can be challenging and labor-intensive to detect in CT scans. While there have been efforts to address this field, the lack of large-scale annotated datasets and evaluation benchmarks has hindered the development and validation of deep learning algorithms. To address this issue, the RibFrac Challenge was introduced, providing a benchmar…
▽ More
Rib fractures are a common and potentially severe injury that can be challenging and labor-intensive to detect in CT scans. While there have been efforts to address this field, the lack of large-scale annotated datasets and evaluation benchmarks has hindered the development and validation of deep learning algorithms. To address this issue, the RibFrac Challenge was introduced, providing a benchmark dataset of over 5,000 rib fractures from 660 CT scans, with voxel-level instance mask annotations and diagnosis labels for four clinical categories (buckle, nondisplaced, displaced, or segmental). The challenge includes two tracks: a detection (instance segmentation) track evaluated by an FROC-style metric and a classification track evaluated by an F1-style metric. During the MICCAI 2020 challenge period, 243 results were evaluated, and seven teams were invited to participate in the challenge summary. The analysis revealed that several top rib fracture detection solutions achieved performance comparable or even better than human experts. Nevertheless, the current rib fracture classification solutions are hardly clinically applicable, which can be an interesting area in the future. As an active benchmark and research resource, the data and online evaluation of the RibFrac Challenge are available at the challenge website. As an independent contribution, we have also extended our previous internal baseline by incorporating recent advancements in large-scale pretrained networks and point-based rib segmentation techniques. The resulting FracNet+ demonstrates competitive performance in rib fracture detection, which lays a foundation for further research and development in AI-assisted rib fracture detection and diagnosis.
△ Less
Submitted 14 February, 2024;
originally announced February 2024.
-
Channel Measurement, Modeling, and Simulation for 6G: A Survey and Tutorial
Authors:
Jianhua Zhang,
Jiaxin Lin,
Pan Tang,
Yuxiang Zhang,
Huixin Xu,
Tianyang Gao,
Haiyang Miao,
Zeyong Chai,
Zhengfu Zhou,
Yi Li,
Huiwen Gong,
Yameng Liu,
Zhiqiang Yuan,
Lei Tian,
Shaoshi Yang,
Liang Xia,
Guangyi Liu,
** Zhang
Abstract:
The sixth generation (6G) mobile communications have attracted substantial attention in the global research community of information and communication technologies (ICT). 6G systems are expected to support not only extended 5G usage scenarios, but also new usage scenarios, such as integrated sensing and communication (ISAC), integrated artificial intelligence (AI) and communication, and communicat…
▽ More
The sixth generation (6G) mobile communications have attracted substantial attention in the global research community of information and communication technologies (ICT). 6G systems are expected to support not only extended 5G usage scenarios, but also new usage scenarios, such as integrated sensing and communication (ISAC), integrated artificial intelligence (AI) and communication, and communication and ubiquitous connectivity. To realize this goal, channel characteristics must be comprehensively studied and properly exploited, so as to promote the design, standardization, and optimization of 6G systems. In this paper, we first summarize the requirements and challenges in 6G channel research. Our focus is on channels for five promising technologies enabling 6G, including terahertz (THz), extreme MIMO (E-MIMO), ISAC, reconfigurable intelligent surface (RIS), and space-air-ground integrated network (SAGIN). Then, a survey of the progress of the 6G channel research regarding the above five promising technologies is presented in terms of the latest measurement campaigns, new characteristics, modeling methods, and research prospects. Moreover, a tutorial on the 6G channel simulations is presented. We introduce the BUPTCMG- 6G, a 6G link-level channel simulator, developed based on the ITU/3GPP 3D geometry-based stochastic model (GBSM) methodology. The simulator supports the channel simulation of the aforementioned 6G potential technologies. To facilitate the use of the simulator, the tutorial encompasses the design framework, user guidelines, and application examples. This paper offers in-depth, hands-on insights into the best practices of channel measurements, modeling, and simulations for the evaluation of 6G technologies, the development of 6G standards, and the implementation and optimization of 6G systems.
△ Less
Submitted 28 March, 2024; v1 submitted 26 May, 2023;
originally announced May 2023.
-
Conquering Data Variations in Resolution: A Slice-Aware Multi-Branch Decoder Network
Authors:
Shuxin Wang,
Shilei Cao,
Zhizhong Chai,
Dong Wei,
Kai Ma,
Liansheng Wang,
Yefeng Zheng
Abstract:
Fully convolutional neural networks have made promising progress in joint liver and liver tumor segmentation. Instead of following the debates over 2D versus 3D networks (for example, pursuing the balance between large-scale 2D pretraining and 3D context), in this paper, we novelly identify the wide variation in the ratio between intra- and inter-slice resolutions as a crucial obstacle to the perf…
▽ More
Fully convolutional neural networks have made promising progress in joint liver and liver tumor segmentation. Instead of following the debates over 2D versus 3D networks (for example, pursuing the balance between large-scale 2D pretraining and 3D context), in this paper, we novelly identify the wide variation in the ratio between intra- and inter-slice resolutions as a crucial obstacle to the performance. To tackle the mismatch between the intra- and inter-slice information, we propose a slice-aware 2.5D network that emphasizes extracting discriminative features utilizing not only in-plane semantics but also out-of-plane coherence for each separate slice. Specifically, we present a slice-wise multi-input multi-output architecture to instantiate such a design paradigm, which contains a Multi-Branch Decoder (MD) with a Slice-centric Attention Block (SAB) for learning slice-specific features and a Densely Connected Dice (DCD) loss to regularize the inter-slice predictions to be coherent and continuous. Based on the aforementioned innovations, we achieve state-of-the-art results on the MICCAI 2017 Liver Tumor Segmentation (LiTS) dataset. Besides, we also test our model on the ISBI 2019 Segmentation of THoracic Organs at Risk (SegTHOR) dataset, and the result proves the robustness and generalizability of the proposed method in other segmentation tasks.
△ Less
Submitted 7 March, 2022;
originally announced March 2022.
-
Deep Semi-supervised Metric Learning with Dual Alignment for Cervical Cancer Cell Detection
Authors:
Zhizhong Chai,
Luyang Luo,
Huang**g Lin,
Hao Chen,
Anjia Han,
Pheng-Ann Heng
Abstract:
Deep learning has achieved unprecedented success in various object detection tasks with huge amounts of labeled data. However, obtaining large-scale annotations for medical images is extremely challenging due to the high demand of labour and expertise. In this paper, we propose a novel deep semi-supervised metric learning method to effectively leverage both labeled and unlabeled data for cervical…
▽ More
Deep learning has achieved unprecedented success in various object detection tasks with huge amounts of labeled data. However, obtaining large-scale annotations for medical images is extremely challenging due to the high demand of labour and expertise. In this paper, we propose a novel deep semi-supervised metric learning method to effectively leverage both labeled and unlabeled data for cervical cancer cell detection. Specifically, our model learns a metric space and conducts dual alignment of semantic features on both the proposal level and the prototype levels. On the proposal level, we align the unlabeled data with class proxies derived from the labeled data. We further align the prototypes of the labeled and unlabeled data to alleviate the influence of possibly noisy pseudo labels generated at the proposal alignment stage. Moreover, we adopt a memory bank to store the labeled prototypes, which significantly enrich the metric learning information from larger batches. Extensive experiments show our proposed method outperforms other state-of-the-art semi-supervised approaches consistently, demonstrating the efficacy of our proposed deep semi-supervised metric learning with dual alignment.
△ Less
Submitted 18 March, 2022; v1 submitted 7 April, 2021;
originally announced April 2021.
-
BioNet: Infusing Biomarker Prior into Global-to-Local Network for Choroid Segmentation in Optical Coherence Tomography Images
Authors:
Huihong Zhang,
Jianlong Yang,
Kang Zhou,
Zhenjie Chai,
Jun Cheng,
Shenghua Gao,
Jiang Liu
Abstract:
Choroid is the vascular layer of the eye, which is directly related to the incidence and severity of many ocular diseases. Optical Coherence Tomography (OCT) is capable of imaging both the cross-sectional view of retina and choroid, but the segmentation of the choroid region is challenging because of the fuzzy choroid-sclera interface (CSI). In this paper, we propose a biomarker infused global-to-…
▽ More
Choroid is the vascular layer of the eye, which is directly related to the incidence and severity of many ocular diseases. Optical Coherence Tomography (OCT) is capable of imaging both the cross-sectional view of retina and choroid, but the segmentation of the choroid region is challenging because of the fuzzy choroid-sclera interface (CSI). In this paper, we propose a biomarker infused global-to-local network (BioNet) for choroid segmentation, which segments the choroid with higher credibility and robustness. Firstly, our method trains a biomarker prediction network to learn the features of the biomarker. Then a global multi-layers segmentation module is applied to segment the OCT image into 12 layers. Finally, the global multi-layered result and the original OCT image are fed into a local choroid segmentation module to segment the choroid region with the biomarker infused as regularizer. We conducted comparison experiments with the state-of-the-art methods on a dataset (named AROD). The experimental results demonstrate the superiority of our method with $90.77\%$ Dice-index and 6.23 pixels Average-unsigned-surface-detection-error, etc.
△ Less
Submitted 10 December, 2019;
originally announced December 2019.
-
Perceptual-assisted Adversarial Adaptation for Choroid Segmentation in optical coherence tomography
Authors:
Zhenjie Chai,
Kang Zhou,
Jianlong Yang,
Yuhui Ma,
Zhi Chen,
Shenghua Gao,
Jiang Liu
Abstract:
Accurate choroid segmentation in optical coherence tomography (OCT) image is vital because the choroid thickness is a major quantitative biomarker of many ocular diseases. Deep learning has shown its superiority in the segmentation of the choroid region but subjects to the performance degeneration caused by the domain discrepancies (e.g., noise level and distribution) among datasets obtained from…
▽ More
Accurate choroid segmentation in optical coherence tomography (OCT) image is vital because the choroid thickness is a major quantitative biomarker of many ocular diseases. Deep learning has shown its superiority in the segmentation of the choroid region but subjects to the performance degeneration caused by the domain discrepancies (e.g., noise level and distribution) among datasets obtained from the OCT devices of different manufacturers. In this paper, we present an unsupervised perceptual-assisted adversarial adaptation (PAAA) framework for efficiently segmenting the choroid area by narrowing the domain discrepancies between different domains. The adversarial adaptation module in the proposed framework encourages the prediction structure information of the target domain to be similar to that of the source domain. Besides, a perceptual loss is employed for matching their shape information (the curvatures of Bruch's membrane and choroid-sclera interface) which can result in a fine boundary prediction. The results of quantitative experiments show that the proposed PAAA segmentation framework outperforms other state-of-the-art methods.
△ Less
Submitted 22 October, 2019;
originally announced October 2019.
-
Knowledge infused cascade convolutional neural network for segmenting retinal vessels in volumetric optical coherence tomography
Authors:
Liyang Fang,
Jianlong Yang,
Lei Mou,
Huihong Zhang,
Zhenjie Chai,
Zhi Chen,
Jiang Liu
Abstract:
We present a cascade deep neural network to segment retinal vessels in volumetric optical coherence tomography (OCT). Two types of knowledge are infused into the network for confining the searching regions. (1) Histology. The retinal vessels locate between the inner limiting membrane and the inner nuclear layer of human retina. (2) Imaging. The red blood cells inside the vessels scatter the OCT pr…
▽ More
We present a cascade deep neural network to segment retinal vessels in volumetric optical coherence tomography (OCT). Two types of knowledge are infused into the network for confining the searching regions. (1) Histology. The retinal vessels locate between the inner limiting membrane and the inner nuclear layer of human retina. (2) Imaging. The red blood cells inside the vessels scatter the OCT probe light forward and form projection shadows on the retinal pigment epithelium (RPE) layer, which is avascular thus perfect for localizing the retinal vessel in transverse plane. Qualitative and quantitative comparison results show that the proposed method outperforms the state-of-the-art deep learning and graph-based methods. This work demonstrates, instead of modifying the architectures of the deep networks, incorporating proper prior knowledge in the design of the image processing framework could be an efficient approach for handling such specific tasks.
△ Less
Submitted 21 October, 2019;
originally announced October 2019.
-
High signal-to-noise ratio reconstruction of low bit-depth optical coherence tomography using deep learning
Authors:
Qiangjiang Hao,
Kang Zhou,
Jianlong Yang,
Liyang Fang,
Zhengjie Chai,
Yuhui Ma,
Yan Hu,
Shenghua Gao,
Jiang Liu
Abstract:
Reducing the bit-depth is an effective approach to lower the cost of optical coherence tomography (OCT) systems and increase the transmission efficiency in data acquisition and telemedicine. However, a low bit-depth will lead to the degeneration of the detection sensitivity thus reduce the signal-to-noise ratio (SNR) of OCT images. In this paper, we propose to use deep learning for the reconstruct…
▽ More
Reducing the bit-depth is an effective approach to lower the cost of optical coherence tomography (OCT) systems and increase the transmission efficiency in data acquisition and telemedicine. However, a low bit-depth will lead to the degeneration of the detection sensitivity thus reduce the signal-to-noise ratio (SNR) of OCT images. In this paper, we propose to use deep learning for the reconstruction of the high SNR OCT images from the low bit-depth acquisition. Its feasibility was preliminarily evaluated by applying the proposed method to the quantized $3\sim8$-bit data from native 12-bit interference fringes. We employed a pixel-to-pixel generative adversarial network architecture in the low to high bit-depth OCT image transition. Retinal OCT data of a healthy subject from a homemade spectral-domain OCT system was used in the study. Extensively qualitative and quantitative results show this deep-learning-based approach could significantly improve the SNR of the low bit-depth OCT images especially at the choroidal region. Superior similarity and SNR between the reconstructed images and the original 12-bit OCT images could be derived when the bit-depth $\geq 5$. This work demonstrates the proper integration of OCT and deep learning could benefit the development of healthcare in low-resource settings.
△ Less
Submitted 11 February, 2020; v1 submitted 12 October, 2019;
originally announced October 2019.