-
Foundational Models for Pathology and Endoscopy Images: Application for Gastric Inflammation
Authors:
Hamideh Kerdegari,
Kyle Higgins,
Dennis Veselkov,
Ivan Laponogov,
Inese Polaka,
Miguel Coimbra,
Junior Andrea Pescino,
Marcis Leja,
Mario Dinis-Ribeiro,
Tania Fleitas Kanonnikoff,
Kirill Veselkov
Abstract:
The integration of artificial intelligence (AI) in medical diagnostics represents a significant advancement in managing upper gastrointestinal (GI) cancer, a major cause of global cancer mortality. Specifically for gastric cancer (GC), chronic inflammation causes changes in the mucosa such as atrophy, intestinal metaplasia (IM), dysplasia and ultimately cancer. Early detection through endoscopic r…
▽ More
The integration of artificial intelligence (AI) in medical diagnostics represents a significant advancement in managing upper gastrointestinal (GI) cancer, a major cause of global cancer mortality. Specifically for gastric cancer (GC), chronic inflammation causes changes in the mucosa such as atrophy, intestinal metaplasia (IM), dysplasia and ultimately cancer. Early detection through endoscopic regular surveillance is essential for better outcomes. Foundation models (FM), which are machine or deep learning models trained on diverse data and applicable to broad use cases, offer a promising solution to enhance the accuracy of endoscopy and its subsequent pathology image analysis. This review explores the recent advancements, applications, and challenges associated with FM in endoscopy and pathology imaging. We started by elucidating the core principles and architectures underlying these models, including their training methodologies and the pivotal role of large-scale data in develo** their predictive capabilities. Moreover, this work discusses emerging trends and future research directions, emphasizing the integration of multimodal data, the development of more robust and equitable models, and the potential for real-time diagnostic support. This review aims to provide a roadmap for researchers and practitioners in navigating the complexities of incorporating FM into clinical practice for prevention/management of GC cases, thereby improving patient outcomes.
△ Less
Submitted 26 June, 2024;
originally announced June 2024.
-
A novel inverse algorithm to solve IPO-IMPT of proton FLASH therapy with sparse filters
Authors:
Nathan Harrison,
Minglei Kang,
Ruirui Liu,
Serdar Charyyev,
Niklas Wahl,
Wei Liu,
Jun Zhou,
Kristin A. Higgins,
Charles Simone,
Jeffrey Bradley,
William S. Dynan,
Liyong Lin
Abstract:
Purpose:The recently proposed IPO-IMPT framework allows simultaneous optimization of dose, dose rate, and LET for FLASH treatment planning. Finding solutions to IPO-IMPT is difficult due to computational intensiveness. Nevertheless, an inverse solution that simultaneously specifies the geometry of a sparse filter and weights of a proton intensity map is desirable for both clinical and preclinical…
▽ More
Purpose:The recently proposed IPO-IMPT framework allows simultaneous optimization of dose, dose rate, and LET for FLASH treatment planning. Finding solutions to IPO-IMPT is difficult due to computational intensiveness. Nevertheless, an inverse solution that simultaneously specifies the geometry of a sparse filter and weights of a proton intensity map is desirable for both clinical and preclinical applications. Such solutions can reduce effective biological dose to organs at risk in cancer patients as well as reduce the number of animal irradiations needed to derive extra biological dose models in preclinical studies.
Methods:Unlike our initial forward heuristic, this inverse IPO-IMPT solution includes simultaneous optimization of sparse range compensation, sparse range modulation, and spot intensity. The daunting computational tasks vital to this endeavor were resolved iteratively with a distributed computing framework to enable Simultaneous Intensity and Energy Modulation and Compensation (SIEMAC). SIEMAC was demonstrated on a human lung cancer patient and a minipig.
Results:SIEMAC improves maps of spot intensities and patient-field-specific sparse range compensators and range modulators. For the lung cancer patient, at our max nozzle current of 300 nA, dose rate coverage above 100 Gy/s increased from 57% to 96% in the lung and from 93% to 100% in the heart, and LET coverage above 4 keV/um dropped from 68% to 9% in the lung and from 26% to <1% in the heart. For a simple minipig plan, the FWHM of the dose, dose rate, and LET distributions decreased by 30%, 1.6%, and 57%, respectively, again with similar target dose coverage, thus reducing uncertainty in these quantities for preclinical studies.
Conclusion:The inverse solution to IPO-IMPT demonstrated the capability to simultaneously modulate sub-spot proton energy and intensity distributions for clinical and preclinical studies.
△ Less
Submitted 19 April, 2023; v1 submitted 22 February, 2023;
originally announced February 2023.
-
An Integrated Biological Optimization framework for proton SBRT FLASH treatment planning allows dose, dose rate, and LET optimization using patient-specific ridge filters
Authors:
Ruirui Liu,
Serdar Charyyev,
Niklas Wahl,
Wei Liu,
Minglei Kang,
Jun Zhou,
Xiaofeng Yang,
Filipa Baltazar,
Martina Palkowitsch,
Kristin Higgins,
William Dynan,
Jeffrey Bradley,
Liyong Lin
Abstract:
Purpose: Patient-specific ridge filters can modulate proton energy to obtain a conformal dose. We describe a new framework for optimization of filter design and spot maps to meet the unique demands of FLASH radiotherapy. We demonstrate an Integrated Biological Optimization IMPT (IBO-IMPT) approach for optimization of dose, dose-averaged dose rate (DADR), and dose-averaged LET (LETd). Methods: We d…
▽ More
Purpose: Patient-specific ridge filters can modulate proton energy to obtain a conformal dose. We describe a new framework for optimization of filter design and spot maps to meet the unique demands of FLASH radiotherapy. We demonstrate an Integrated Biological Optimization IMPT (IBO-IMPT) approach for optimization of dose, dose-averaged dose rate (DADR), and dose-averaged LET (LETd). Methods: We developed inverse planning software to design patient-specific ridge filters that spread the Bragg peak from a fixed-energy, 250 MeV beam to a proximal beam-specific planning target volume. The software optimizes patient-specific ridge filter and uses a Monte Carlo calculation engine, based on Geant4, to provide dose and LET influence matrices. Plan optimization, using matRAD, accommodates the IBO-IMPT objective function considering dose, dose rate, and LET simultaneously with minimum MU constraints. The framework enables design of both regularly spaced and sparse-optimized ridge filters, which allow faster delivery and selective LET optimization. Volume distributions and histograms for dose, DADR, and LETd are compared using evaluation structures specific to the heart and lung. Results: We used IBO-IMPT to design ridge filters for a central lung tumor patient. The IBO-IMPT framework selectively spared heart and lung by reducing LET and increasing dose rate, relative to IMPT planning. Sparse-optimized ridge filters were superior to regularly spaced ridge filters in dose rate. Together, these innovations substantially increased the DADR in the heart and lung while maintaining good target coverage. The volume that received a FLASH dose rate of higher 40 Gy/second increased by 31% for heart and 50% for lung. Conclusion: This proof-of-concept study demonstrates the feasibility of using an IBO-IMPT framework to accomplish proton FLASH SBPT, accounting for dose, DADR, and LETd simultaneously.
△ Less
Submitted 16 July, 2022;
originally announced July 2022.
-
High-Throughput Study of Antisolvents on the Stability of Multicomponent Metal Halide Perovskites through Robotics-Based Synthesis and Machine Learning Approaches
Authors:
Kate Higgins,
Maxim Ziatdinov,
Sergei V. Kalinin,
Mahshid Ahmadi
Abstract:
Antisolvent crystallization methods are frequently used to fabricate high-quality perovskite thin films, to produce sizable single crystals, and to synthesize nanoparticles at room temperature. However, a systematic exploration of the effect of specific antisolvents on the intrinsic stability of multicomponent metal halide perovskites has yet to be demonstrated. Here, we develop a high-throughput…
▽ More
Antisolvent crystallization methods are frequently used to fabricate high-quality perovskite thin films, to produce sizable single crystals, and to synthesize nanoparticles at room temperature. However, a systematic exploration of the effect of specific antisolvents on the intrinsic stability of multicomponent metal halide perovskites has yet to be demonstrated. Here, we develop a high-throughput experimental workflow that incorporates chemical robotic synthesis, automated characterization, and machine learning techniques to explore how the choice of antisolvent affects the intrinsic stability of binary perovskite systems in ambient conditions over time. Different combinations of the endmembers, MAPbI3, MAPbBr3, FAPbI3, FAPbBr3, CsPbI3, and CsPbBr3, are used to synthesize 15 combinatorial libraries, each with 96 unique combinations. In total, roughly 1100 different compositions are synthesized. Each library is fabricated twice using two different antisolvents: toluene and chloroform. Once synthesized, photoluminescence spectroscopy is automatically performed every 5 minutes for approximately 6 hours. Non-negative Matrix Factorization (NMF) is then utilized to map the time- and compositional-dependent optoelectronic properties. Through the utilization of this workflow for each library, we demonstrate that the selection of antisolvent is critical to the stability of metal halide perovskites in ambient conditions. We explore possible dynamical processes, such as halide segregation, responsible for either the stability or eventual degradation as caused by the choice of antisolvent. Overall, this high-throughput study demonstrates the vital role that antisolvents play in the synthesis of high-quality multicomponent metal halide perovskite systems.
△ Less
Submitted 6 June, 2021;
originally announced June 2021.
-
Deep learning-based Real-time Volumetric Imaging for Lung Stereotactic Body Radiation Therapy: A Proof of Concept Study
Authors:
Yang Lei,
Zhen Tian,
Tonghe Wang,
Kristin Higgins,
Jeffrey D. Bradley,
Walter J. Curran,
Tian Liu,
Xiaofeng Yang
Abstract:
Due to the inter- and intra- variation of respiratory motion, it is highly desired to provide real-time volumetric images during the treatment delivery of lung stereotactic body radiation therapy (SBRT) for accurate and active motion management. In this proof-of-concept study, we propose a novel generative adversarial network integrated with perceptual supervision to derive instantaneous volumetri…
▽ More
Due to the inter- and intra- variation of respiratory motion, it is highly desired to provide real-time volumetric images during the treatment delivery of lung stereotactic body radiation therapy (SBRT) for accurate and active motion management. In this proof-of-concept study, we propose a novel generative adversarial network integrated with perceptual supervision to derive instantaneous volumetric images from a single 2D projection. Our proposed network, named TransNet, consists of three modules, i.e., encoding, transformation and decoding modules. Rather than only using image distance loss between the generated 3D images and the ground truth 3D CT images to supervise the network, perceptual loss in feature space is integrated into loss function to force the TransNet to yield accurate lung boundary. Adversarial supervision is also used to improve the realism of generated 3D images. We conducted a simulation study on 20 patient cases, who had received lung SBRT treatments in our institution and undergone 4D-CT simulation, and evaluated the efficacy and consistency of our method for four different projection angles, i.e., 0, 30, 60 and 90 degree. For each 3D CT image set of a breathing phase, we simulated its 2D projections at these angles.Then for each projection angle, a patient's 3D CT images of 9 phases and the corresponding 2D projection data were used for training, with the remaining phase used for testing. The mean absolute error, normalized MAE, peak signal-to-noise ratio and structural similarity index metric achieved by our method are 99.3 HU, 0.032, 23.4 dB and 0.949, respectively. These results demonstrate the feasibility and efficacy of our 2D-to-3D method for lung cancer patients, which provides a potential solution for in-treatment real-time on-board volumetric imaging for accurate dose delivery to ensure the effectiveness of lung SBRT treatment.
△ Less
Submitted 24 May, 2020;
originally announced May 2020.
-
Quantum-enhanced capture of photons using optical ratchet states
Authors:
K. D. B. Higgins,
B. W. Lovett,
E. M. Gauger
Abstract:
Natural and artificial light harvesting systems often operate in a regime where the flux of photons is relatively low. Besides absorbing as many photons as possible it is therefore paramount to prevent excitons from annihilation via photon re-emission until they have undergone an irreversible energy conversion process. Taking inspiration from photosynthetic antenna structures, we here consider rin…
▽ More
Natural and artificial light harvesting systems often operate in a regime where the flux of photons is relatively low. Besides absorbing as many photons as possible it is therefore paramount to prevent excitons from annihilation via photon re-emission until they have undergone an irreversible energy conversion process. Taking inspiration from photosynthetic antenna structures, we here consider ring-like systems and introduce a class of states we call ratchets: excited states capable of absorbing but not emitting light. This allows our antennae to absorb further photons whilst retaining the excitations from those that have already been captured. Simulations for a ring of four sites reveal a peak power enhancement by up to a factor of 35 under ambient conditions owing to a combination of ratcheting and the prevention of emission through dark-state population. In the slow extraction limit the achievable power enhancement due to ratcheting alone exceeds 20%.
△ Less
Submitted 23 December, 2016; v1 submitted 22 April, 2015;
originally announced April 2015.
-
Superabsorption of light via quantum engineering
Authors:
K. D. B. Higgins,
S. C. Benjamin,
T. M. Stace,
G. J. Milburn,
B. W. Lovett,
E. M. Gauger
Abstract:
Almost 60 years ago Dicke introduced the term superradiance to describe a signature quantum effect: N atoms can collectively emit light at a rate proportional to N^2. Even for moderate N this represents a significant increase over the prediction of classical physics, and the effect has found applications ranging from probing exciton delocalisation in biological systems, to develo** a new class o…
▽ More
Almost 60 years ago Dicke introduced the term superradiance to describe a signature quantum effect: N atoms can collectively emit light at a rate proportional to N^2. Even for moderate N this represents a significant increase over the prediction of classical physics, and the effect has found applications ranging from probing exciton delocalisation in biological systems, to develo** a new class of laser, and even in astrophysics. Structures that super-radiate must also have enhanced absorption, but the former always dominates in natural systems. Here we show that modern quantum control techniques can overcome this restriction. Our theory establishes that superabsorption can be achieved and sustained in certain simple nanostructures, by trap** the system in a highly excited state while extracting energy into a non-radiative channel. The effect offers the prospect of a new class of quantum nanotechnology, capable of absorbing light many times faster than is currently possible; potential applications of this effect include light harvesting and photon detection. An array of quantum dots or a porphyrin ring could provide an implementation to demonstrate this effect.
△ Less
Submitted 26 February, 2014; v1 submitted 6 June, 2013;
originally announced June 2013.
-
Quantum thermometry using the ac Stark shift within the Rabi model
Authors:
Kieran D. B. Higgins,
Brendon W. Lovett,
Erik M. Gauger
Abstract:
A quantum two level system coupled to a harmonic oscillator represents a ubiquitous physical system. New experiments in circuit QED and nano-electromechanical systems (NEMS) achieve unprecedented coupling strength at large detuning between qubit and oscillator, thus requiring a theoretical treatment beyond the Jaynes Cummings model. Here we present a new method for describing the qubit dynamics in…
▽ More
A quantum two level system coupled to a harmonic oscillator represents a ubiquitous physical system. New experiments in circuit QED and nano-electromechanical systems (NEMS) achieve unprecedented coupling strength at large detuning between qubit and oscillator, thus requiring a theoretical treatment beyond the Jaynes Cummings model. Here we present a new method for describing the qubit dynamics in this regime, based on an oscillator correlation function expansion of a non-Markovian master equation in the polaron frame. Our technique yields a new numerical method as well as a succinct approximate expression for the qubit dynamics. We obtain a new expression for the ac Stark shift and show that this enables practical and precise qubit thermometry of an oscillator.
△ Less
Submitted 27 March, 2012;
originally announced March 2012.
