-
Model-Based Reinforcement Learning Control of Reaction-Diffusion Problems
Authors:
Christina Schenk,
Aditya Vasudevan,
Maciej Haranczyk,
Ignacio Romero
Abstract:
Mathematical and computational tools have proven to be reliable in decision-making processes. In recent times, in particular, machine learning-based methods are becoming increasingly popular as advanced support tools. When dealing with control problems, reinforcement learning has been applied to decision-making in several applications, most notably in games. The success of these methods in finding…
▽ More
Mathematical and computational tools have proven to be reliable in decision-making processes. In recent times, in particular, machine learning-based methods are becoming increasingly popular as advanced support tools. When dealing with control problems, reinforcement learning has been applied to decision-making in several applications, most notably in games. The success of these methods in finding solutions to complex problems motivates the exploration of new areas where they can be employed to overcome current difficulties. In this paper, we explore the use of automatic control strategies to initial boundary value problems in thermal and disease transport. Specifically, in this work, we adapt an existing reinforcement learning algorithm using a stochastic policy gradient method and we introduce two novel reward functions to drive the flow of the transported field. The new model-based framework exploits the interactions between a reaction-diffusion model and the modified agent. The results show that certain controls can be implemented successfully in these applications, although model simplifications had to be assumed.
△ Less
Submitted 22 February, 2024;
originally announced February 2024.
-
Reducing model complexity by means of the Optimal Scaling: Population Balance Model for latex particles morphology formation
Authors:
Simone Rusconi,
Christina Schenk,
Arghir Zarnescu,
Elena Akhmatskaya
Abstract:
Rational computer-aided design of multiphase polymer materials is vital for rapid progress in many important applications, such as: diagnostic tests, drug delivery, coatings, additives for constructing materials, cosmetics, etc. Several property predictive models, including the prospective Population Balance Model for Latex Particles Morphology Formation (LPMF PBM), have already been developed for…
▽ More
Rational computer-aided design of multiphase polymer materials is vital for rapid progress in many important applications, such as: diagnostic tests, drug delivery, coatings, additives for constructing materials, cosmetics, etc. Several property predictive models, including the prospective Population Balance Model for Latex Particles Morphology Formation (LPMF PBM), have already been developed for such materials. However, they lack computational efficiency, and the accurate prediction of materials' properties still remains a great challenge. To enhance performance of the LPMF PBM, we explore the feasibility of reducing its complexity through disregard of the aggregation terms of the model. The introduced nondimensionalization approach, which we call Optimal Scaling with Constraints, suggests a quantitative criterion for locating regions of slow and fast aggregation and helps to derive a family of dimensionless LPMF PBM of reduced complexity. The mathematical analysis of this new family is also provided. When compared with the original LPMF PBM, the resulting models demonstrate several orders of magnitude better computational efficiency.
△ Less
Submitted 9 February, 2024;
originally announced February 2024.
-
Linking discrete and continuum diffusion models: Well-posedness and stable finite element discretizations
Authors:
Christina Schenk,
David Portillo,
Ignacio Romero
Abstract:
In the context of mathematical modeling, it is sometimes convenient to integrate models of different nature. These types of combinations, however, might entail difficulties even when individual models are well-understood, particularly in relation to the well-posedness of the ensemble. In this article, we focus on combining two classes of dissimilar diffusive models: the first one defined over a co…
▽ More
In the context of mathematical modeling, it is sometimes convenient to integrate models of different nature. These types of combinations, however, might entail difficulties even when individual models are well-understood, particularly in relation to the well-posedness of the ensemble. In this article, we focus on combining two classes of dissimilar diffusive models: the first one defined over a continuum and the second one based on discrete equations that connect average values of the solution over disjoint subdomains. For stationary problems, we show unconditional stability of the linked problems and then the stability and convergence of its discretized counterpart when mixed finite elements are used to approximate the model on the continuum. The theoretical results are highlighted with numerical examples illustrating the effects of linking diffusive models. As a side result, we show that the methods introduced in this article can be used to infer the solution of diffusive problems with incomplete data.
△ Less
Submitted 19 January, 2023; v1 submitted 16 August, 2022;
originally announced August 2022.
-
Existence, Uniqueness and Numerical Modeling of Wine Fermentation Based on Integro-Differential Equations
Authors:
Christina Schenk,
Volker H. Schulz
Abstract:
Predictive modeling is the key factor for saving time and resources with respect to manufacturing processes such as fermentation processes arising e.g.\ in food and chemical manufacturing processes. According to Zhang et al. (2002), the open-loop dynamics of yeast are highly dependent on the initial cell mass distribution. This can be modeled via population balance models describing the single-cel…
▽ More
Predictive modeling is the key factor for saving time and resources with respect to manufacturing processes such as fermentation processes arising e.g.\ in food and chemical manufacturing processes. According to Zhang et al. (2002), the open-loop dynamics of yeast are highly dependent on the initial cell mass distribution. This can be modeled via population balance models describing the single-cell behavior of the yeast cell. There have already been several population balance models for wine fermentation in the literature. However, the new model introduced in this paper is much more detailed than the ones studied previously. This new model for the white wine fermentation process is based on a combination of components previously introduced in literature. It turns it into a system of highly nonlinear weakly hyperbolic partial/ordinary integro-differential equations. This model becomes very challenging from a theoretical and numerical point of view. Existence and uniqueness of solutions to a simplified version of the introduced problem is studied based on semigroup theory. For its numerical solution a numerical methodology based on a finite volume scheme combined with a time implicit scheme is derived. The impact of the initial cell mass distribution on the solution is studied and underlined with numerical results. The detailed model is compared to a simpler model based on ordinary differential equations. The observed differences for different initial distributions and the different models turn out to be smaller than expected. The outcomes of this paper are very interesting and useful for applied mathematicians, winemakers and process engineers.
△ Less
Submitted 14 April, 2021;
originally announced April 2021.
-
An extended model of wine fermentation including aromas and acids
Authors:
Jan Bartsch,
Alfio Borzì,
Christina Schenk,
Dominik Schmidt,
Jonas Müller,
Volker Schulz,
Kai Velten
Abstract:
The art of viticulture and the quest for making wines has a long tradition and it just started recently that mathematicians entered this field with their main contribution of modelling alcoholic fermentation. These models consist of systems of ordinary differential equations that describe the kinetics of the bio-chemical reactions occurring in the fermentation process. The aim of this paper is to…
▽ More
The art of viticulture and the quest for making wines has a long tradition and it just started recently that mathematicians entered this field with their main contribution of modelling alcoholic fermentation. These models consist of systems of ordinary differential equations that describe the kinetics of the bio-chemical reactions occurring in the fermentation process. The aim of this paper is to present a new model of wine fermentation that accurately describes the yeast dying component, the presence of glucose transporters, and the formation of aromas and acids. Therefore the new model could become a valuable tool to predict the taste of the wine and provide the starting point for an emerging control technology that aims at improving the quality of the wine by steering a well-behaved fermentation process that is also energetically more efficient. Results of numerical simulations are presented that successfully confirm the validity of the proposed model by comparison with real data.
△ Less
Submitted 5 January, 2019;
originally announced January 2019.
-
Novel model for wine fermentation including the yeast dying phase
Authors:
Alfio Borzì,
Juri Merger,
Jonas Müller,
Achim Rosch,
Christina Schenk,
Dominik Schmidt,
Stephan Schmidt,
Volker Schulz,
Kai Velten,
Christian von Wallbrunn,
Michael Zänglein
Abstract:
This paper presents a novel model for wine fermentation including a death phase for yeast and the influence of oxygen on the process. A model for the inclusion of the yeast dying phase is derived and compared to a model taken from the literature. The modeling ability of the several models is analyzed by comparing their simulation results.
This paper presents a novel model for wine fermentation including a death phase for yeast and the influence of oxygen on the process. A model for the inclusion of the yeast dying phase is derived and compared to a model taken from the literature. The modeling ability of the several models is analyzed by comparing their simulation results.
△ Less
Submitted 17 December, 2014;
originally announced December 2014.
