-
Non-Negative Universal Differential Equations With Applications in Systems Biology
Authors:
Maren Philipps,
Antonia Körner,
Jakob Vanhoefer,
Dilan Pathirana,
Jan Hasenauer
Abstract:
Universal differential equations (UDEs) leverage the respective advantages of mechanistic models and artificial neural networks and combine them into one dynamic model. However, these hybrid models can suffer from unrealistic solutions, such as negative values for biochemical quantities. We present non-negative UDE (nUDEs), a constrained UDE variant that guarantees non-negative values. Furthermore…
▽ More
Universal differential equations (UDEs) leverage the respective advantages of mechanistic models and artificial neural networks and combine them into one dynamic model. However, these hybrid models can suffer from unrealistic solutions, such as negative values for biochemical quantities. We present non-negative UDE (nUDEs), a constrained UDE variant that guarantees non-negative values. Furthermore, we explore regularisation techniques to improve generalisation and interpretability of UDEs.
△ Less
Submitted 20 June, 2024;
originally announced June 2024.
-
Exploration of methods for computing sensitivities in ODE models at dynamic and steady states
Authors:
Polina Lakrisenko,
Dilan Pathirana,
Daniel Weindl,
Jan Hasenauer
Abstract:
Estimating parameters of dynamic models from experimental data is a challenging, and often computationally-demanding task. It requires a large number of model simulations and objective function gradient computations, if gradient-based optimization is used. The gradient depends on derivatives of the state variables with respect to parameters, also called state sensitivities, which are expensive to…
▽ More
Estimating parameters of dynamic models from experimental data is a challenging, and often computationally-demanding task. It requires a large number of model simulations and objective function gradient computations, if gradient-based optimization is used. The gradient depends on derivatives of the state variables with respect to parameters, also called state sensitivities, which are expensive to compute. In many cases, steady-state computation is a part of model simulation, either due to steady-state data or an assumption that the system is at steady state at the initial time point. Various methods are available for steady-state and gradient computation. Yet, the most efficient pair of methods (one for steady states, one for gradients) for a particular model is often not clear. Moreover, depending on the model and the available data, some methods may not be applicable or sufficiently robust. In order to facilitate the selection of methods, we explore six method pairs for computing the steady state and sensitivities at steady state using six real-world problems. The method pairs involve numerical integration or Newton's method to compute the steady-state, and -- for both forward and adjoint sensitivity analysis -- numerical integration or a tailored method to compute the sensitivities at steady-state. Our evaluation shows that the two method pairs that combine numerical integration for the steady-state with a tailored method for the sensitivities at steady-state were the most robust, and amongst the most computationally-efficient. We also observed that while Newton's method for steady-state computation yields a substantial speedup compared to numerical integration, it may lead to a large number of simulation failures. Overall, our study provides a concise overview across current methods for computing sensitivities at steady state, guiding modelers to choose the right methods.
△ Less
Submitted 26 May, 2024;
originally announced May 2024.
-
pyPESTO: A modular and scalable tool for parameter estimation for dynamic models
Authors:
Yannik Schälte,
Fabian Fröhlich,
Paul J. Jost,
Jakob Vanhoefer,
Dilan Pathirana,
Paul Stapor,
Polina Lakrisenko,
Dantong Wang,
Elba Raimúndez,
Simon Merkt,
Leonard Schmiester,
Philipp Städter,
Stephan Grein,
Erika Dudkin,
Domagoj Doresic,
Daniel Weindl,
Jan Hasenauer
Abstract:
Mechanistic models are important tools to describe and understand biological processes. However, they typically rely on unknown parameters, the estimation of which can be challenging for large and complex systems. We present pyPESTO, a modular framework for systematic parameter estimation, with scalable algorithms for optimization and uncertainty quantification. While tailored to ordinary differen…
▽ More
Mechanistic models are important tools to describe and understand biological processes. However, they typically rely on unknown parameters, the estimation of which can be challenging for large and complex systems. We present pyPESTO, a modular framework for systematic parameter estimation, with scalable algorithms for optimization and uncertainty quantification. While tailored to ordinary differential equation problems, pyPESTO is broadly applicable to black-box parameter estimation problems. Besides own implementations, it provides a unified interface to various popular simulation and inference methods. pyPESTO is implemented in Python, open-source under a 3-Clause BSD license. Code and documentation are available on GitHub (https://github.com/icb-dcm/pypesto).
△ Less
Submitted 2 May, 2023;
originally announced May 2023.
-
A protocol for dynamic model calibration
Authors:
Alejandro F. Villaverde,
Dilan Pathirana,
Fabian Fröhlich,
Jan Hasenauer,
Julio R. Banga
Abstract:
Ordinary differential equation models are nowadays widely used for the mechanistic description of biological processes and their temporal evolution. These models typically have many unknown and non-measurable parameters, which have to be determined by fitting the model to experimental data. In order to perform this task, known as parameter estimation or model calibration, the modeller faces challe…
▽ More
Ordinary differential equation models are nowadays widely used for the mechanistic description of biological processes and their temporal evolution. These models typically have many unknown and non-measurable parameters, which have to be determined by fitting the model to experimental data. In order to perform this task, known as parameter estimation or model calibration, the modeller faces challenges such as poor parameter identifiability, lack of sufficiently informative experimental data, and the existence of local minima in the objective function landscape. These issues tend to worsen with larger model sizes, increasing the computational complexity and the number of unknown parameters. An incorrectly calibrated model is problematic because it may result in inaccurate predictions and misleading conclusions. For non-expert users, there are a large number of potential pitfalls. Here, we provide a protocol that guides the user through all the steps involved in the calibration of dynamic models. We illustrate the methodology with two models, and provide all the code required to reproduce the results and perform the same analysis on new models. Our protocol provides practitioners and researchers in biological modelling with a one-stop guide that is at the same time compact and sufficiently comprehensive to cover all aspects of the problem.
△ Less
Submitted 26 May, 2021; v1 submitted 25 May, 2021;
originally announced May 2021.
-
AMICI: High-Performance Sensitivity Analysis for Large Ordinary Differential Equation Models
Authors:
Fabian Fröhlich,
Daniel Weindl,
Yannik Schälte,
Dilan Pathirana,
Łukasz Paszkowski,
Glenn Terje Lines,
Paul Stapor,
Jan Hasenauer
Abstract:
Ordinary differential equation models facilitate the understanding of cellular signal transduction and other biological processes. However, for large and comprehensive models, the computational cost of simulating or calibrating can be limiting. AMICI is a modular toolbox implemented in C++/Python/MATLAB that provides efficient simulation and sensitivity analysis routines tailored for scalable, gra…
▽ More
Ordinary differential equation models facilitate the understanding of cellular signal transduction and other biological processes. However, for large and comprehensive models, the computational cost of simulating or calibrating can be limiting. AMICI is a modular toolbox implemented in C++/Python/MATLAB that provides efficient simulation and sensitivity analysis routines tailored for scalable, gradient-based parameter estimation and uncertainty quantification.
AMICI is published under the permissive BSD-3-Clause license with source code publicly available on https://github.com/AMICI-dev/AMICI. Citeable releases are archived on Zenodo.
△ Less
Submitted 16 December, 2020;
originally announced December 2020.
-
PEtab -- interoperable specification of parameter estimation problems in systems biology
Authors:
Leonard Schmiester,
Yannik Schälte,
Frank T. Bergmann,
Tacio Camba,
Erika Dudkin,
Janine Egert,
Fabian Fröhlich,
Lara Fuhrmann,
Adrian L. Hauber,
Svenja Kemmer,
Polina Lakrisenko,
Carolin Loos,
Simon Merkt,
Wolfgang Müller,
Dilan Pathirana,
Elba Raimúndez,
Lukas Refisch,
Marcus Rosenblatt,
Paul L. Stapor,
Philipp Städter,
Dantong Wang,
Franz-Georg Wieland,
Julio R. Banga,
Jens Timmer,
Alejandro F. Villaverde
, et al. (4 additional authors not shown)
Abstract:
Reproducibility and reusability of the results of data-based modeling studies are essential. Yet, there has been -- so far -- no broadly supported format for the specification of parameter estimation problems in systems biology. Here, we introduce PEtab, a format which facilitates the specification of parameter estimation problems using Systems Biology Markup Language (SBML) models and a set of ta…
▽ More
Reproducibility and reusability of the results of data-based modeling studies are essential. Yet, there has been -- so far -- no broadly supported format for the specification of parameter estimation problems in systems biology. Here, we introduce PEtab, a format which facilitates the specification of parameter estimation problems using Systems Biology Markup Language (SBML) models and a set of tab-separated value files describing the observation model and experimental data as well as parameters to be estimated. We already implemented PEtab support into eight well-established model simulation and parameter estimation toolboxes with hundreds of users in total. We provide a Python library for validation and modification of a PEtab problem and currently 20 example parameter estimation problems based on recent studies. Specifications of PEtab, the PEtab Python library, as well as links to examples, and all supporting software tools are available at https://github.com/PEtab-dev/PEtab, a snapshot is available at https://doi.org/10.5281/zenodo.3732958. All original content is available under permissive licenses.
△ Less
Submitted 7 August, 2020; v1 submitted 2 April, 2020;
originally announced April 2020.