-
Medical Knowledge Integration into Reinforcement Learning Algorithms for Dynamic Treatment Regimes
Authors:
Sophia Yazzourh,
Nicolas Savy,
Philippe Saint-Pierre,
Michael R. Kosorok
Abstract:
The goal of precision medicine is to provide individualized treatment at each stage of chronic diseases, a concept formalized by Dynamic Treatment Regimes (DTR). These regimes adapt treatment strategies based on decision rules learned from clinical data to enhance therapeutic effectiveness. Reinforcement Learning (RL) algorithms allow to determine these decision rules conditioned by individual pat…
▽ More
The goal of precision medicine is to provide individualized treatment at each stage of chronic diseases, a concept formalized by Dynamic Treatment Regimes (DTR). These regimes adapt treatment strategies based on decision rules learned from clinical data to enhance therapeutic effectiveness. Reinforcement Learning (RL) algorithms allow to determine these decision rules conditioned by individual patient data and their medical history. The integration of medical expertise into these models makes possible to increase confidence in treatment recommendations and facilitate the adoption of this approach by healthcare professionals and patients. In this work, we examine the mathematical foundations of RL, contextualize its application in the field of DTR, and present an overview of methods to improve its effectiveness by integrating medical expertise.
△ Less
Submitted 29 June, 2024;
originally announced July 2024.
-
Aging modeling and lifetime prediction of a proton exchange membrane fuel cell using an extended Kalman filter
Authors:
Serigne Daouda Pene,
Antoine Picot,
Fabrice Gamboa,
Nicolas Savy,
Christophe Turpin,
Amine Jaafar
Abstract:
This article presents a methodology that aims to model and to provide predictive capabilities for the lifetime of Proton Exchange Membrane Fuel Cell (PEMFC). The approach integrates parametric identification, dynamic modeling, and Extended Kalman Filtering (EKF). The foundation is laid with the creation of a representative aging database, emphasizing specific operating conditions. Electrochemical…
▽ More
This article presents a methodology that aims to model and to provide predictive capabilities for the lifetime of Proton Exchange Membrane Fuel Cell (PEMFC). The approach integrates parametric identification, dynamic modeling, and Extended Kalman Filtering (EKF). The foundation is laid with the creation of a representative aging database, emphasizing specific operating conditions. Electrochemical behavior is characterized through the identification of critical parameters. The methodology extends to capture the temporal evolution of the identified parameters. We also address challenges posed by the limiting current density through a differential analysis-based modeling technique and the detection of breakpoints. This approach, involving Monte Carlo simulations, is coupled with an EKF for predicting voltage degradation. The Remaining Useful Life (RUL) is also estimated. The results show that our approach accurately predicts future voltage and RUL with very low relative errors.
△ Less
Submitted 3 June, 2024;
originally announced June 2024.
-
A time-dependent Poisson-Gamma model for recruitment forecasting in multicenter studies
Authors:
Armando Turchetta,
Nicolas Savy,
David A. Stephens,
Erica E. M. Moodie,
Marina B. Klein
Abstract:
Forecasting recruitments is a key component of the monitoring phase of multicenter studies. One of the most popular techniques in this field is the Poisson-Gamma recruitment model, a Bayesian technique built on a doubly stochastic Poisson process. This approach is based on the modeling of enrollments as a Poisson process where the recruitment rates are assumed to be constant over time and to follo…
▽ More
Forecasting recruitments is a key component of the monitoring phase of multicenter studies. One of the most popular techniques in this field is the Poisson-Gamma recruitment model, a Bayesian technique built on a doubly stochastic Poisson process. This approach is based on the modeling of enrollments as a Poisson process where the recruitment rates are assumed to be constant over time and to follow a common Gamma prior distribution. However, the constant-rate assumption is a restrictive limitation that is rarely appropriate for applications in real studies. In this paper, we illustrate a flexible generalization of this methodology which allows the enrollment rates to vary over time by modeling them through B-splines. We show the suitability of this approach for a wide range of recruitment behaviors in a simulation study and by estimating the recruitment progression of the Canadian Co-infection Cohort (CCC).
△ Less
Submitted 9 January, 2023;
originally announced January 2023.
-
Agent-Based modeling in Medical Research. Example in Health Economics
Authors:
Philippe Saint-Pierre,
Romain Demeulemeester,
Nadège Costa,
Nicolas Savy
Abstract:
This chapter presents the main lines of agent based modeling in the field of medical research. The general diagram consists of a cohort of patients (virtual or real) whose evolution is observed by means of so-called evolution models. Scenarios can then be explored by varying the parameters of the different models. This chapter presents techniques for virtual patient generation and examples of exec…
▽ More
This chapter presents the main lines of agent based modeling in the field of medical research. The general diagram consists of a cohort of patients (virtual or real) whose evolution is observed by means of so-called evolution models. Scenarios can then be explored by varying the parameters of the different models. This chapter presents techniques for virtual patient generation and examples of execution models. The advantages and disadvantages of these models are discussed as well as the pitfalls to be avoided. Finally, an application to the medico-economic study of the impact of the penetration rate of generic versions of treatments on the costs associated with HIV treatment is presented.
△ Less
Submitted 18 May, 2022;
originally announced May 2022.
-
Modelling and forecasting patient recruitment in clinical trials with patients' dropout
Authors:
Vladimir Anisimov,
Guillaume Mijoule,
Armando Turchetta,
Nicolas Savy
Abstract:
This paper focuses on statistical modelling and prediction of patient recruitment in clinical trials accounting for patients dropout. The recruitment model is based on a Poisson-gamma model introduced by Anisimov and Fedorov (2007), where the patients arrive at different centres according to Poisson processes with rates viewed as gamma-distributed random variables. Each patient can drop the study…
▽ More
This paper focuses on statistical modelling and prediction of patient recruitment in clinical trials accounting for patients dropout. The recruitment model is based on a Poisson-gamma model introduced by Anisimov and Fedorov (2007), where the patients arrive at different centres according to Poisson processes with rates viewed as gamma-distributed random variables. Each patient can drop the study during some screening period. Managing the dropout process is of a major importance but data related to dropout are rarely correctly collected. In this paper, a few models of dropout are proposed. The technique for estimating parameters and predicting the number of recruited patients over time and the recruitment time is developed. Simulation results confirm the applicability of the technique and thus, the necessity to account for patients dropout at the stage of forecasting recruitment in clinical trials.
△ Less
Submitted 14 February, 2022;
originally announced February 2022.
