-
Automatic hip osteoarthritis grading with uncertainty estimation from computed tomography using digitally-reconstructed radiographs
Authors:
Masachika Masuda,
Mazen Soufi,
Yoshito Otake,
Keisuke Uemura,
Sotaro Kono,
Kazuma Takashima,
Hidetoshi Hamada,
Yi Gu,
Masaki Takao,
Seiji Okada,
Nobuhiko Sugano,
Yoshinobu Sato
Abstract:
Progression of hip osteoarthritis (hip OA) leads to pain and disability, likely leading to surgical treatment such as hip arthroplasty at the terminal stage. The severity of hip OA is often classified using the Crowe and Kellgren-Lawrence (KL) classifications. However, as the classification is subjective, we aimed to develop an automated approach to classify the disease severity based on the two g…
▽ More
Progression of hip osteoarthritis (hip OA) leads to pain and disability, likely leading to surgical treatment such as hip arthroplasty at the terminal stage. The severity of hip OA is often classified using the Crowe and Kellgren-Lawrence (KL) classifications. However, as the classification is subjective, we aimed to develop an automated approach to classify the disease severity based on the two grades using digitally-reconstructed radiographs (DRRs) from CT images. Automatic grading of the hip OA severity was performed using deep learning-based models. The models were trained to predict the disease grade using two grading schemes, i.e., predicting the Crowe and KL grades separately, and predicting a new ordinal label combining both grades and representing the disease progression of hip OA. The models were trained in classification and regression settings. In addition, the model uncertainty was estimated and validated as a predictor of classification accuracy. The models were trained and validated on a database of 197 hip OA patients, and externally validated on 52 patients. The model accuracy was evaluated using exact class accuracy (ECA), one-neighbor class accuracy (ONCA), and balanced accuracy.The deep learning models produced a comparable accuracy of approximately 0.65 (ECA) and 0.95 (ONCA) in the classification and regression settings. The model uncertainty was significantly larger in cases with large classification errors (P<6e-3). In this study, an automatic approach for grading hip OA severity from CT images was developed. The models have shown comparable performance with high ONCA, which facilitates automated grading in large-scale CT databases and indicates the potential for further disease progression analysis. Classification accuracy was correlated with the model uncertainty, which would allow for the prediction of classification errors.
△ Less
Submitted 30 December, 2023;
originally announced January 2024.
-
Hybrid Representation-Enhanced Sampling for Bayesian Active Learning in Musculoskeletal Segmentation of Lower Extremities
Authors:
Gan** Li,
Yoshito Otake,
Mazen Soufi,
Masashi Taniguchi,
Masahide Yagi,
Noriaki Ichihashi,
Keisuke Uemura,
Masaki Takao,
Nobuhiko Sugano,
Yoshinobu Sato
Abstract:
Purpose: Manual annotations for training deep learning (DL) models in auto-segmentation are time-intensive. This study introduces a hybrid representation-enhanced sampling strategy that integrates both density and diversity criteria within an uncertainty-based Bayesian active learning (BAL) framework to reduce annotation efforts by selecting the most informative training samples. Methods: The expe…
▽ More
Purpose: Manual annotations for training deep learning (DL) models in auto-segmentation are time-intensive. This study introduces a hybrid representation-enhanced sampling strategy that integrates both density and diversity criteria within an uncertainty-based Bayesian active learning (BAL) framework to reduce annotation efforts by selecting the most informative training samples. Methods: The experiments are performed on two lower extremity (LE) datasets of MRI and CT images, focusing on the segmentation of the femur, pelvis, sacrum, quadriceps femoris, hamstrings, adductors, sartorius, and iliopsoas, utilizing a U-net-based BAL framework. Our method selects uncertain samples with high density and diversity for manual revision, optimizing for maximal similarity to unlabeled instances and minimal similarity to existing training data. We assess the accuracy and efficiency using Dice and a proposed metric called reduced annotation cost (RAC), respectively. We further evaluate the impact of various acquisition rules on BAL performance and design an ablation study for effectiveness estimation. Results: In MRI and CT datasets, our method was superior or comparable to existing ones, achieving a 0.8\% Dice and 1.0\% RAC increase in CT (statistically significant), and a 0.8\% Dice and 1.1\% RAC increase in MRI (not statistically significant) in volume-wise acquisition. Our ablation study indicates that combining density and diversity criteria enhances the efficiency of BAL in musculoskeletal segmentation compared to using either criterion alone. Conclusion: Our sampling method is proven efficient in reducing annotation costs in image segmentation tasks. The combination of the proposed method and our BAL framework provides a semi-automatic way for efficient annotation of medical image datasets.
△ Less
Submitted 20 December, 2023; v1 submitted 26 July, 2023;
originally announced July 2023.
-
Bone mineral density estimation from a plain X-ray image by learning decomposition into projections of bone-segmented computed tomography
Authors:
Yi Gu,
Yoshito Otake,
Keisuke Uemura,
Mazen Soufi,
Masaki Takao,
Hugues Talbot,
Seiji Okada,
Nobuhiko Sugano,
Yoshinobu Sato
Abstract:
Osteoporosis is a prevalent bone disease that causes fractures in fragile bones, leading to a decline in daily living activities. Dual-energy X-ray absorptiometry (DXA) and quantitative computed tomography (QCT) are highly accurate for diagnosing osteoporosis; however, these modalities require special equipment and scan protocols. To frequently monitor bone health, low-cost, low-dose, and ubiquito…
▽ More
Osteoporosis is a prevalent bone disease that causes fractures in fragile bones, leading to a decline in daily living activities. Dual-energy X-ray absorptiometry (DXA) and quantitative computed tomography (QCT) are highly accurate for diagnosing osteoporosis; however, these modalities require special equipment and scan protocols. To frequently monitor bone health, low-cost, low-dose, and ubiquitously available diagnostic methods are highly anticipated. In this study, we aim to perform bone mineral density (BMD) estimation from a plain X-ray image for opportunistic screening, which is potentially useful for early diagnosis. Existing methods have used multi-stage approaches consisting of extraction of the region of interest and simple regression to estimate BMD, which require a large amount of training data. Therefore, we propose an efficient method that learns decomposition into projections of bone-segmented QCT for BMD estimation under limited datasets. The proposed method achieved high accuracy in BMD estimation, where Pearson correlation coefficients of 0.880 and 0.920 were observed for DXA-measured BMD and QCT-measured BMD estimation tasks, respectively, and the root mean square of the coefficient of variation values were 3.27 to 3.79% for four measurements with different poses. Furthermore, we conducted extensive validation experiments, including multi-pose, uncalibrated-CT, and compression experiments toward actual application in routine clinical practice.
△ Less
Submitted 21 July, 2023;
originally announced July 2023.
-
MSKdeX: Musculoskeletal (MSK) decomposition from an X-ray image for fine-grained estimation of lean muscle mass and muscle volume
Authors:
Yi Gu,
Yoshito Otake,
Keisuke Uemura,
Masaki Takao,
Mazen Soufi,
Yuta Hiasa,
Hugues Talbot,
Seiji Okata,
Nobuhiko Sugano,
Yoshinobu Sato
Abstract:
Musculoskeletal diseases such as sarcopenia and osteoporosis are major obstacles to health during aging. Although dual-energy X-ray absorptiometry (DXA) and computed tomography (CT) can be used to evaluate musculoskeletal conditions, frequent monitoring is difficult due to the cost and accessibility (as well as high radiation exposure in the case of CT). We propose a method (named MSKdeX) to estim…
▽ More
Musculoskeletal diseases such as sarcopenia and osteoporosis are major obstacles to health during aging. Although dual-energy X-ray absorptiometry (DXA) and computed tomography (CT) can be used to evaluate musculoskeletal conditions, frequent monitoring is difficult due to the cost and accessibility (as well as high radiation exposure in the case of CT). We propose a method (named MSKdeX) to estimate fine-grained muscle properties from a plain X-ray image, a low-cost, low-radiation, and highly accessible imaging modality, through musculoskeletal decomposition leveraging fine-grained segmentation in CT. We train a multi-channel quantitative image translation model to decompose an X-ray image into projections of CT of individual muscles to infer the lean muscle mass and muscle volume. We propose the object-wise intensity-sum loss, a simple yet surprisingly effective metric invariant to muscle deformation and projection direction, utilizing information in CT and X-ray images collected from the same patient. While our method is basically an unpaired image-to-image translation, we also exploit the nature of the bone's rigidity, which provides the paired data through 2D-3D rigid registration, adding strong pixel-wise supervision in unpaired training. Through the evaluation using a 539-patient dataset, we showed that the proposed method significantly outperformed conventional methods. The average Pearson correlation coefficient between the predicted and CT-derived ground truth metrics was increased from 0.460 to 0.863. We believe our method opened up a new musculoskeletal diagnosis method and has the potential to be extended to broader applications in multi-channel quantitative image translation tasks. Our source code will be released soon.
△ Less
Submitted 21 July, 2023; v1 submitted 31 May, 2023;
originally announced May 2023.
-
BMD-GAN: Bone mineral density estimation using x-ray image decomposition into projections of bone-segmented quantitative computed tomography using hierarchical learning
Authors:
Yi Gu,
Yoshito Otake,
Keisuke Uemura,
Mazen Soufi,
Masaki Takao,
Nobuhiko Sugano,
Yoshinobu Sato
Abstract:
We propose a method for estimating the bone mineral density (BMD) from a plain x-ray image. Dual-energy X-ray absorptiometry (DXA) and quantitative computed tomography (QCT) provide high accuracy in diagnosing osteoporosis; however, these modalities require special equipment and scan protocols. Measuring BMD from an x-ray image provides an opportunistic screening, which is potentially useful for e…
▽ More
We propose a method for estimating the bone mineral density (BMD) from a plain x-ray image. Dual-energy X-ray absorptiometry (DXA) and quantitative computed tomography (QCT) provide high accuracy in diagnosing osteoporosis; however, these modalities require special equipment and scan protocols. Measuring BMD from an x-ray image provides an opportunistic screening, which is potentially useful for early diagnosis. The previous methods that directly learn the relationship between x-ray images and BMD require a large training dataset to achieve high accuracy because of large intensity variations in the x-ray images. Therefore, we propose an approach using the QCT for training a generative adversarial network (GAN) and decomposing an x-ray image into a projection of bone-segmented QCT. The proposed hierarchical learning improved the robustness and accuracy of quantitatively decomposing a small-area target. The evaluation of 200 patients with osteoarthritis using the proposed method, which we named BMD-GAN, demonstrated a Pearson correlation coefficient of 0.888 between the predicted and ground truth DXA-measured BMD. Besides not requiring a large-scale training database, another advantage of our method is its extensibility to other anatomical areas, such as the vertebrae and rib bones.
△ Less
Submitted 7 July, 2022;
originally announced July 2022.
-
Automated segmentation of an intensity calibration phantom in clinical CT images using a convolutional neural network
Authors:
Keisuke Uemura,
Yoshito Otake,
Masaki Takao,
Mazen Soufi,
Akihiro Kawasaki,
Nobuhiko Sugano,
Yoshinobu Sato
Abstract:
Purpose: To apply a convolutional neural network (CNN) to develop a system that segments intensity calibration phantom regions in computed tomography (CT) images, and to test the system in a large cohort to evaluate its robustness. Methods: A total of 1040 cases (520 cases each from two institutions), in which an intensity calibration phantom (B-MAS200, Kyoto Kagaku, Kyoto, Japan) was used, were i…
▽ More
Purpose: To apply a convolutional neural network (CNN) to develop a system that segments intensity calibration phantom regions in computed tomography (CT) images, and to test the system in a large cohort to evaluate its robustness. Methods: A total of 1040 cases (520 cases each from two institutions), in which an intensity calibration phantom (B-MAS200, Kyoto Kagaku, Kyoto, Japan) was used, were included herein. A training dataset was created by manually segmenting the regions of the phantom for 40 cases (20 cases each). Segmentation accuracy of the CNN model was assessed with the Dice coefficient and the average symmetric surface distance (ASD) through the 4-fold cross validation. Further, absolute differences of radiodensity values (in Hounsfield units: HU) were compared between manually segmented regions and automatically segmented regions. The system was tested on the remaining 1000 cases. For each institution, linear regression was applied to calculate coefficients for the correlation between radiodensity and the densities of the phantom. Results: After training, the median Dice coefficient was 0.977, and the median ASD was 0.116 mm. When segmented regions were compared between manual segmentation and automated segmentation, the median absolute difference was 0.114 HU. For the test cases, the median correlation coefficient was 0.9998 for one institution and was 0.9999 for the other, with a minimum value of 0.9863. Conclusions: The CNN model successfully segmented the calibration phantom's regions in the CT images with excellent accuracy, and the automated method was found to be at least equivalent to the conventional manual method. Future study should integrate the system by automatically segmenting the region of interest in bones such that the bone mineral density can be fully automatically quantified from CT images.
△ Less
Submitted 21 December, 2020;
originally announced December 2020.
-
Singular hyperbolic attractors are statistical stable
Authors:
Mohammad Fanaee,
Mohammad Soufi
Abstract:
We prove that the unique SRB measure for a singular hyperbolic attractor depends continuously on the dynamics in the weak$^\ast$ topology.
We prove that the unique SRB measure for a singular hyperbolic attractor depends continuously on the dynamics in the weak$^\ast$ topology.
△ Less
Submitted 5 October, 2020;
originally announced October 2020.
-
Hyperbolic billiards on polytopes with contracting reflection laws
Authors:
Pedro Duarte,
José Pedro Gaivão,
Mohammad Soufi
Abstract:
We study billiards on polytopes in $\Rr^d$ with contracting reflection laws, i.e. non-standard reflection laws that contract the reflection angle towards the normal. We prove that billiards on generic polytopes are uniformly hyperbolic provided there exists a positive integer $k$ such that for any $k$ consecutive collisions, the corresponding normals of the faces of the polytope where the collisio…
▽ More
We study billiards on polytopes in $\Rr^d$ with contracting reflection laws, i.e. non-standard reflection laws that contract the reflection angle towards the normal. We prove that billiards on generic polytopes are uniformly hyperbolic provided there exists a positive integer $k$ such that for any $k$ consecutive collisions, the corresponding normals of the faces of the polytope where the collisions took place generate $\Rr^d$. As an application of our main result we prove that billiards on generic polytopes are uniformly hyperbolic if either the contracting reflection law is sufficiently close to the specular or the polytope is obtuse. Finally, we study in detail the billiard on a family of $3$-dimensional simplexes.
△ Less
Submitted 7 November, 2016; v1 submitted 2 February, 2016;
originally announced February 2016.
-
Saturation of Generalized Partially Hyperbolic Attractors
Authors:
A. Fakhari,
M. Soufi
Abstract:
We prove the saturation of a generalized partially hyperbolic attractor of a $C^2$ map. As a consequence, we show that any generalized partially hyperbolic horseshoe-like attractor of a $C^1$-generic diffeomorphism has zero volume. In contrast, by modification of Poincaré cross section of the geometric model, we build a $C^1$-diffeomorphism with a partially hyperbolic horseshoe-like attractor of p…
▽ More
We prove the saturation of a generalized partially hyperbolic attractor of a $C^2$ map. As a consequence, we show that any generalized partially hyperbolic horseshoe-like attractor of a $C^1$-generic diffeomorphism has zero volume. In contrast, by modification of Poincaré cross section of the geometric model, we build a $C^1$-diffeomorphism with a partially hyperbolic horseshoe-like attractor of positive volume.
△ Less
Submitted 27 November, 2018; v1 submitted 8 August, 2014;
originally announced August 2014.
-
Statistical stability of Geometric Lorenz attractors
Authors:
Jose F. Alves,
Mohammad Soufi
Abstract:
We consider the robust family of Geometric Lorenz attractors. These attractors are chaotic in the sense that they are transitive and have sensitive dependence on the initial conditions. Moreover, they support SRB measures whose ergodic basins cover a full Lebesgue measure subset of points in the topological basin of attraction. Here we prove that the SRB measures depend continuously on the dynamic…
▽ More
We consider the robust family of Geometric Lorenz attractors. These attractors are chaotic in the sense that they are transitive and have sensitive dependence on the initial conditions. Moreover, they support SRB measures whose ergodic basins cover a full Lebesgue measure subset of points in the topological basin of attraction. Here we prove that the SRB measures depend continuously on the dynamics in the weak$^*$ topology.
△ Less
Submitted 5 December, 2013; v1 submitted 28 September, 2012;
originally announced September 2012.
-
Statistical stability and limit laws for Rovella maps
Authors:
Jose F. Alves,
Mohammad Soufi
Abstract:
We consider the family of one-dimensional maps arising from the contracting Lorenz attractors studied by Rovella. Benedicks-Carleson techniques were used by Rovella to prove that there is a one-parameter family of maps whose derivatives along their critical orbits increase exponentially fast and the critical orbits have slow recurrent to the critical point. Metzger proved that these maps have a un…
▽ More
We consider the family of one-dimensional maps arising from the contracting Lorenz attractors studied by Rovella. Benedicks-Carleson techniques were used by Rovella to prove that there is a one-parameter family of maps whose derivatives along their critical orbits increase exponentially fast and the critical orbits have slow recurrent to the critical point. Metzger proved that these maps have a unique absolutely continuous ergodic invariant probability measure (SRB measure).
Here we use the technique developed by Freitas and show that the tail set (the set of points which at a given time have not achieved either the exponential growth of derivative or the slow recurrence) decays exponentially fast as time passes. As a consequence, we obtain the continuous variation of the densities of the SRB measures and associated metric entropies with the parameter. Our main result also implies some statistical properties for these maps.
△ Less
Submitted 25 May, 2012;
originally announced May 2012.
