-
Metric-guided Image Reconstruction Bounds via Conformal Prediction
Authors:
Matt Y Cheung,
Tucker J Netherton,
Laurence E Court,
Ashok Veeraraghavan,
Guha Balakrishnan
Abstract:
Recent advancements in machine learning have led to the development of novel medical imaging systems and algorithms that address ill-posed problems. Assessing their trustworthiness and understanding how to deploy them safely at test time remains an important and open problem. In this work, we propose using conformal prediction to compute valid and distribution-free bounds on downstream metrics giv…
▽ More
Recent advancements in machine learning have led to the development of novel medical imaging systems and algorithms that address ill-posed problems. Assessing their trustworthiness and understanding how to deploy them safely at test time remains an important and open problem. In this work, we propose using conformal prediction to compute valid and distribution-free bounds on downstream metrics given reconstructions generated by one algorithm, and retrieve upper/lower bounds and inlier/outlier reconstructions according to the adjusted bounds. Our work offers 1) test time image reconstruction evaluation without ground truth, 2) downstream performance guarantees, 3) meaningful upper/lower bound reconstructions, and 4) meaningful statistical inliers/outlier reconstructions. We demonstrate our method on post-mastectomy radiotherapy planning using 3D breast CT reconstructions, and show 1) that metric-guided bounds have valid coverage for downstream metrics while conventional pixel-wise bounds do not and 2) anatomical differences of upper/lower bounds between metric-guided and pixel-wise methods. Our work paves way for more meaningful and trustworthy test-time evaluation of medical image reconstructions. Code available at https://github.com/matthewyccheung/conformal-metric
△ Less
Submitted 1 July, 2024; v1 submitted 23 April, 2024;
originally announced April 2024.
-
Evolving Horizons in Radiotherapy Auto-Contouring: Distilling Insights, Embracing Data-Centric Frameworks, and Moving Beyond Geometric Quantification
Authors:
Kareem A. Wahid,
Carlos E. Cardenas,
Barbara Marquez,
Tucker J. Netherton,
Benjamin H. Kann,
Laurence E. Court,
Renjie He,
Mohamed A. Naser,
Amy C. Moreno,
Clifton D. Fuller,
David Fuentes
Abstract:
Deep learning has significantly advanced the potential for automated contouring in radiotherapy planning. In this manuscript, guided by contemporary literature, we underscore three key insights: (1) High-quality training data is essential for auto-contouring algorithms; (2) Auto-contouring models demonstrate commendable performance even with limited medical image data; (3) The quantitative perform…
▽ More
Deep learning has significantly advanced the potential for automated contouring in radiotherapy planning. In this manuscript, guided by contemporary literature, we underscore three key insights: (1) High-quality training data is essential for auto-contouring algorithms; (2) Auto-contouring models demonstrate commendable performance even with limited medical image data; (3) The quantitative performance of auto-contouring is reaching a plateau. Given these insights, we emphasize the need for the radiotherapy research community to embrace data-centric approaches to further foster clinical adoption of auto-contouring technologies.
△ Less
Submitted 16 October, 2023;
originally announced October 2023.
-
Deep Learning-Based Dose Prediction for Automated, Individualized Quality Assurance of Head and Neck Radiation Therapy Plans
Authors:
Mary P. Gronberg,
Beth M. Beadle,
Adam S. Garden,
Heath Skinner,
Skylar Gay,
Tucker Netherton,
Wenhua Cao,
Carlos E. Cardenas,
Christine Chung,
David Fuentes,
Clifton D. Fuller,
Rebecca M. Howell,
Anuja Jhingran,
Tze Yee Lim,
Barbara Marquez,
Raymond Mumme,
Adenike M. Olanrewaju,
Christine B. Peterson,
Ivan Vazquez,
Thomas J. Whitaker,
Zachary Wooten,
Ming Yang,
Laurence E. Court
Abstract:
Purpose: This study aimed to use deep learning-based dose prediction to assess head and neck (HN) plan quality and identify suboptimal plans.
Methods: A total of 245 VMAT HN plans were created using RapidPlan knowledge-based planning (KBP). A subset of 112 high-quality plans was selected under the supervision of an HN radiation oncologist. We trained a 3D Dense Dilated U-Net architecture to pred…
▽ More
Purpose: This study aimed to use deep learning-based dose prediction to assess head and neck (HN) plan quality and identify suboptimal plans.
Methods: A total of 245 VMAT HN plans were created using RapidPlan knowledge-based planning (KBP). A subset of 112 high-quality plans was selected under the supervision of an HN radiation oncologist. We trained a 3D Dense Dilated U-Net architecture to predict 3-dimensional dose distributions using 3-fold cross-validation on 90 plans. Model inputs included CT images, target prescriptions, and contours for targets and organs at risk (OARs). The model's performance was assessed on the remaining 22 test plans. We then tested the application of the dose prediction model for automated review of plan quality. Dose distributions were predicted on 14 clinical plans. The predicted versus clinical OAR dose metrics were compared to flag OARs with suboptimal normal tissue sparing using a 2 Gy dose difference or 3% dose-volume threshold. OAR flags were compared to manual flags by 3 HN radiation oncologists.
Results: The predicted dose distributions were of comparable quality to the KBP plans. The differences between the predicted and KBP-planned D1%, D95%, and D99% across the targets were within -2.53%(SD=1.34%), -0.42%(SD=1.27%), and -0.12%(SD=1.97%), respectively, and the OAR mean and maximum doses were within -0.33Gy(SD=1.40Gy) and -0.96Gy(SD=2.08Gy). For the plan quality assessment study, radiation oncologists flagged 47 OARs for possible plan improvement. There was high interphysician variability; 83% of physician-flagged OARs were flagged by only one of 3 physicians. The comparative dose prediction model flagged 63 OARs, including 30 of 47 physician-flagged OARs.
Conclusion: Deep learning can predict high-quality dose distributions, which can be used as comparative dose distributions for automated, individualized assessment of HN plan quality.
△ Less
Submitted 25 April, 2023; v1 submitted 28 September, 2022;
originally announced September 2022.
