-
Explainable AI for Ship Collision Avoidance: Decoding Decision-Making Processes and Behavioral Intentions
Authors:
Hitoshi Yoshioka,
Hirotada Hashimoto
Abstract:
This study developed an explainable AI for ship collision avoidance. Initially, a critic network composed of sub-task critic networks was proposed to individually evaluate each sub-task in collision avoidance to clarify the AI decision-making processes involved. Additionally, an attempt was made to discern behavioral intentions through a Q-value analysis and an Attention mechanism. The former focu…
▽ More
This study developed an explainable AI for ship collision avoidance. Initially, a critic network composed of sub-task critic networks was proposed to individually evaluate each sub-task in collision avoidance to clarify the AI decision-making processes involved. Additionally, an attempt was made to discern behavioral intentions through a Q-value analysis and an Attention mechanism. The former focused on interpreting intentions by examining the increment of the Q-value resulting from AI actions, while the latter incorporated the significance of other ships in the decision-making process for collision avoidance into the learning objective. AI's behavioral intentions in collision avoidance were visualized by combining the perceived collision danger with the degree of attention to other ships. The proposed method was evaluated through a numerical experiment. The developed AI was confirmed to be able to safely avoid collisions under various congestion levels, and AI's decision-making process was rendered comprehensible to humans. The proposed method not only facilitates the understanding of DRL-based controllers/systems in the ship collision avoidance task but also extends to any task comprising sub-tasks.
△ Less
Submitted 19 May, 2024; v1 submitted 15 May, 2024;
originally announced May 2024.
-
Generalized pair-wise logit dynamic and its connection to a mean field game: theoretical and computational investigations focusing on resource management
Authors:
Hidekazu Yoshioka,
Motoh Tsujimura
Abstract:
Logit dynamics are evolution equations that describe transitions to equilibria of actions among many players. We formulate a pair-wise logit dynamic in a continuous action space with a generalized exponential function, which we call a generalized pair-wise logit dynamic, depicted by a new evolution equation nonlocal in space. We prove the well-posedness and approximability of the generalized pair-…
▽ More
Logit dynamics are evolution equations that describe transitions to equilibria of actions among many players. We formulate a pair-wise logit dynamic in a continuous action space with a generalized exponential function, which we call a generalized pair-wise logit dynamic, depicted by a new evolution equation nonlocal in space. We prove the well-posedness and approximability of the generalized pair-wise logit dynamic to show that it is computationally implementable. We also show that this dynamic has an explicit connection to a mean field game of a controlled pure-jump process, with which the two different mathematical models can be understood in a unified way. Particularly, we show that the generalized pair-wise logit dynamic is derived as a myopic version of the corresponding mean field game, and that the conditions to guarantee the existence of unique solutions are different from each other. The key in this procedure is to find the objective function to be optimized in the mean field game based on the logit function. The monotonicity of the utility is unnecessary for the generalized pair-wise logit dynamic but crucial for the mean field game. Finally, we present applications of the two approaches to fisheries management problems with collected data.
△ Less
Submitted 17 June, 2024; v1 submitted 3 March, 2024;
originally announced March 2024.
-
A rational logit dynamic for decision-making under uncertainty: well-posedness, vanishing-noise limit, and numerical approximation
Authors:
Hidekazu Yoshioka,
Motoh Tsujimura,
Yumi Yoshioka
Abstract:
The classical logit dynamic on a continuous action space for decision-making un-der uncertainty is generalized to the dynamic where the exponential function for the softmax part has been replaced by a rational one that includes the former as a special case. We call the new dynamic as the rational logit dynamic. The use of the rational logit function implies that the uncertainties have a longer tai…
▽ More
The classical logit dynamic on a continuous action space for decision-making un-der uncertainty is generalized to the dynamic where the exponential function for the softmax part has been replaced by a rational one that includes the former as a special case. We call the new dynamic as the rational logit dynamic. The use of the rational logit function implies that the uncertainties have a longer tail than that assumed in the classical one. We show that the rational logit dynamic admits a unique measure-valued solution and the solution can be approximated using a fi-nite difference discretization. We also show that the vanishing-noise limit of the rational logit dynamic exists and is different from the best-response one, demon-strating that influences of the uncertainty tail persist in the rational logit dynamic. We finally apply the rational logit dynamic to a unique fishing competition data that has been recently acquired by the authors.
△ Less
Submitted 20 February, 2024;
originally announced February 2024.
-
Reliability Quantification of Deep Reinforcement Learning-based Control
Authors:
Hitoshi Yoshioka,
Hirotada Hashimoto
Abstract:
Reliability quantification of deep reinforcement learning (DRL)-based control is a significant challenge for the practical application of artificial intelligence (AI) in safety-critical systems. This study proposes a method for quantifying the reliability of DRL-based control. First, an existing method, random noise distillation, was applied to the reliability evaluation to clarify the issues to b…
▽ More
Reliability quantification of deep reinforcement learning (DRL)-based control is a significant challenge for the practical application of artificial intelligence (AI) in safety-critical systems. This study proposes a method for quantifying the reliability of DRL-based control. First, an existing method, random noise distillation, was applied to the reliability evaluation to clarify the issues to be solved. Second, a novel method for reliability quantification was proposed to solve these issues. The reliability is quantified using two neural networks: reference and evaluator. They have the same structure with the same initial parameters. The outputs of the two networks were the same before training. During training, the evaluator network parameters were updated to maximize the difference between the reference and evaluator networks for trained data. Thus, the reliability of the DRL-based control for a state can be evaluated based on the difference in output between the two networks. The proposed method was applied to DQN-based control as an example of a simple task, and its effectiveness was demonstrated. Finally, the proposed method was applied to the problem of switching trained models depending on the state. Con-sequently, the performance of the DRL-based control was improved by switching the trained models according to their reliability.
△ Less
Submitted 13 October, 2023; v1 submitted 29 September, 2023;
originally announced September 2023.
-
The Robust Orlicz Risk with an Application to the Green Photovoltaic Power Generation
Authors:
H. Yoshioka,
M. Tsujimura
Abstract:
We propose a new recursive utility for dynamically controlling stochastic processes under model uncertainty. Our formulation uses the recently proposed dynamic robustified Orlicz risk to evaluate the risk and uncertainty within a unified framework. The corresponding Hamilton-Jacobi-Bellman (HJB) equation has novel nonlinear terms arising from the Orlicz risk. We focus on the HJB equation of a phot…
▽ More
We propose a new recursive utility for dynamically controlling stochastic processes under model uncertainty. Our formulation uses the recently proposed dynamic robustified Orlicz risk to evaluate the risk and uncertainty within a unified framework. The corresponding Hamilton-Jacobi-Bellman (HJB) equation has novel nonlinear terms arising from the Orlicz risk. We focus on the HJB equation of a photovoltaic power generation system that supplies excess electricity to a secondary purpose such as the generation of green hydrogen. Computational examples with the available data are finally presented, demonstrating that the Orlicz risk can be used for the photovoltaic power generation under different meteorological and operational conditions.
△ Less
Submitted 25 July, 2023;
originally announced July 2023.
-
Environmental management and restoration under unified risk and uncertainty using robustified dynamic Orlicz risk
Authors:
Hidekazu Yoshioka,
Motoh Tsujimura,
Futoshi Aranishi,
Tomomi Tanaka
Abstract:
Environmental management and restoration should be designed such that the risk and uncertainty owing to nonlinear stochastic systems can be successfully addressed. We apply the robustified dynamic Orlicz risk to the modeling and analysis of environmental management and restoration to consider both the risk and uncertainty within a unified theory. We focus on the control of a jump-driven hybrid sto…
▽ More
Environmental management and restoration should be designed such that the risk and uncertainty owing to nonlinear stochastic systems can be successfully addressed. We apply the robustified dynamic Orlicz risk to the modeling and analysis of environmental management and restoration to consider both the risk and uncertainty within a unified theory. We focus on the control of a jump-driven hybrid stochastic system that represents macrophyte dynamics. The dynamic programming equation based on the Orlicz risk is first obtained heuristically, from which the associated Hamilton-Jacobi-Bellman (HJB) equation is derived. In the proposed Orlicz risk, the risk aversion of the decision-maker is represented by a power coefficient that resembles a certainty equivalence, whereas the uncertainty aversion is represented by the Kullback-Leibler divergence, in which the risk and uncertainty are handled consistently and separately. The HJB equation includes a new state-dependent discount factor that arises from the uncertainty aversion, which leads to a unique, nonlinear, and nonlocal term. The link between the proposed and classical stochastic control problems is discussed with a focus on control-dependent discount rates. We propose a finite difference method for computing the HJB equation. Finally, the proposed model is applied to an optimal harvesting problem for macrophytes in a brackish lake that contains both growing and drifting populations.
△ Less
Submitted 3 June, 2023;
originally announced June 2023.
-
Stochastic optimization of a mixed moving average process for controlling non-Markovian streamflow environments
Authors:
Hidekazu Yoshioka,
Tomohiro Tanaka,
Yumi Yoshioka,
Ayumi Hashiguchi
Abstract:
We investigated a cost-constrained static ergodic control problem of the variance of measure-valued affine processes and its application in streamflow management. The controlled system is a jump-driven mixed moving average process that generates realistic subexponential autocorrelation functions, and the static nature of the control originates from a realistic observability assumption in the syste…
▽ More
We investigated a cost-constrained static ergodic control problem of the variance of measure-valued affine processes and its application in streamflow management. The controlled system is a jump-driven mixed moving average process that generates realistic subexponential autocorrelation functions, and the static nature of the control originates from a realistic observability assumption in the system. The Markovian lift was effectively used to discretize the system into a finite-dimensional process, which is easier to analyze. The resolution of the problem is based on backward Kolmogorov equations and a quadratic solution ansatz. The control problem has a closed-form solution, and the variance has both strict upper and lower bounds, indicating that the variance cannot take an arbitrary value even when it is subject to a high control cost. The correspondence between the discretized system based on the Markovian lift and the original infinite-dimensional one is discussed. Then, a convergent Markovian lift is presented to approximate the infinite-dimensional system. Finally, the control problem was applied to real cases using available data for a river reach. An extended problem subject to an additional constraint on maintaining the flow variability was also analyzed without significantly degrading the tractability of the proposed framework.
△ Less
Submitted 2 November, 2022; v1 submitted 3 October, 2022;
originally announced October 2022.
-
Modeling and computation of an integral operator Riccati equation for an infinite-dimensional stochastic differential equation governing streamflow discharge
Authors:
Hidekazu Yoshioka,
Motoh Tsujimura,
Tomohiro Tanaka,
Yumi Yoshioka,
Ayumi Hashiguchi
Abstract:
We propose a linear-quadratic (LQ) control problem of streamflow discharge by optimizing an infinite-dimensional jump-driven stochastic differential equation (SDE). Our SDE is a superposition of Ornstein-Uhlenbeck processes (supOU process), generating a sub-exponential autocorrelation function observed in actual data. The integral operator Riccati equation is heuristically derived to determine the…
▽ More
We propose a linear-quadratic (LQ) control problem of streamflow discharge by optimizing an infinite-dimensional jump-driven stochastic differential equation (SDE). Our SDE is a superposition of Ornstein-Uhlenbeck processes (supOU process), generating a sub-exponential autocorrelation function observed in actual data. The integral operator Riccati equation is heuristically derived to determine the optimal control of the infinite-dimensional system. In addition, its finite-dimensional version is derived with a discretized distribution of the reversion speed and computed by a finite difference scheme. The optimality of the Riccati equation is analyzed by a verification argument. The supOU process is parameterized based on the actual data of a perennial river. The convergence of the numerical scheme is analyzed through computational experiments. Finally, we demonstrate the application of the proposed model to realistic problems along with the Kolmogorov backward equation for the performance evaluation of controls.
△ Less
Submitted 12 April, 2022;
originally announced April 2022.
-
Hamilton-Jacobi-Bellman-Isaacs equation for rational inattention in the long-run management of river environments under uncertainty
Authors:
Hidekazu Yoshioka,
Motoh Tsujimura
Abstract:
A new stochastic control model for the long-run environmental management of rivers is mathematically and numerically analyzed, focusing on a modern sediment replenishment problem with unique nonsmooth and nonlinear properties. Rational inattention as a novel adaptive strategy to collect information and intervene against the target system is modeled using Erlangization. The system dynamics containi…
▽ More
A new stochastic control model for the long-run environmental management of rivers is mathematically and numerically analyzed, focusing on a modern sediment replenishment problem with unique nonsmooth and nonlinear properties. Rational inattention as a novel adaptive strategy to collect information and intervene against the target system is modeled using Erlangization. The system dynamics containing the river discharge following a continuous-state branching with an immigration-type process and the controlled sediment storage dynamics lead to a nonsmooth and nonlocal infinitesimal generator. Modeling uncertainty, which is ubiquitous in certain applications, is considered in a robust control framework in which deviations between the benchmark and distorted models are penalized through relative entropy. The partial integro-differential Hamilton-Jacobi-Bellman-Isaacs (HJBI) equation as an optimality equation is derived, and its uniqueness, existence, and optimality are discussed. A monotone finite difference scheme guaranteeing the boundedness and uniqueness of numerical solutions is proposed to discretize the HJBI equation and is verified based on manufactured solutions. Model applications are also conducted with the parameter values identified from the available data and physical formulae. The computational results suggest that environmental management should be rationally inattentive in a state-dependent and adaptive manner.
△ Less
Submitted 26 July, 2021;
originally announced July 2021.
-
Towards Control of Dam and Reservoir Systems with Forward-Backward Stochastic Differential Equations Driven by Clustered Jumps
Authors:
Hidekazu Yoshioka
Abstract:
We deal with a new maximum principle-based stochastic control model for river management through operating a dam and reservoir system. The model is based on coupled forward-backward stochastic differential equations (FBSDEs) derived from jump-driven streamflow dynamics and reservoir water balance. A continuous-time branching process with immigration driven by a tempered stable subordinator efficie…
▽ More
We deal with a new maximum principle-based stochastic control model for river management through operating a dam and reservoir system. The model is based on coupled forward-backward stochastic differential equations (FBSDEs) derived from jump-driven streamflow dynamics and reservoir water balance. A continuous-time branching process with immigration driven by a tempered stable subordinator efficiently describes clustered inflow streamflow dynamics. This is a completely new attempt in hydrology and control engineering. Applying a stochastic maximum principle to the dynamics based on an objective functional for designing cost-efficient control of dam and reservoir systems leads to the FBSDEs as a system of optimality equations. The FBSDEs under a linear-quadratic ansatz lead to a tractable model, while they are solved numerically in the other cases using a least-squares Monte-Carlo method. Optimal controls are found in the former, while only sub-optimal ones are computable in the latter due to a hard state constraint. Model parameters are successfully identified from a real data of a river in Japan having a dam and reservoir system. We also show that the linear-quadratic case can capture the real operation data of the system with underestimation of the outflow discharge. More complex cases with a realistic time horizon are analyzed numerically to investigate impacts of considering the environmental flows and seasonal operational purposes. Key challenges towards more sophisticated modeling and analysis with jump-driven FBSDEs are discussed as well.
△ Less
Submitted 22 April, 2021;
originally announced April 2021.
-
Impulsive fishery resource transporting strategies based on an open-ended stochastic growth model having a latent variable
Authors:
Hidekazu Yoshioka,
Tomomi Tanaka,
Futoshi Aranishi,
Motoh Tsujimura,
Yumi Yoshioka
Abstract:
In inland fisheries, transporting fishery resource individuals from a habitat to spatially apart habitat(s) has recently been considered for fisheries stock management in the natural environment. However, its mathematical optimization, especially finding when and how much of the population should be transported, is still a fundamental unresolved issue. We propose a new impulse control framework to…
▽ More
In inland fisheries, transporting fishery resource individuals from a habitat to spatially apart habitat(s) has recently been considered for fisheries stock management in the natural environment. However, its mathematical optimization, especially finding when and how much of the population should be transported, is still a fundamental unresolved issue. We propose a new impulse control framework to tackle this issue based on a simple but new stochastic growth model of individual fishes. The novel growth model governing individuals' body weights uses a Wright-Fisher model as a latent driver to reproduce plausible growth dynamics. The optimization problem is formulated as an impulse control problem of a cost-benefit functional constrained by a degenerate parabolic Fokker-Planck equation of the stochastic growth dynamics. Because the growth dynamics have an observable variable and an unobservable variable (a variable difficult or impossible to observe), we consider both full-information and partial-information cases. The latter is more involved but more realistic because of not explicitly using the unobservable variable in designing the controls. In both cases, resolving an optimization problem reduces to solving the associated Fokker-Planck and its adjoint equations, the latter being non-trivial. We present a derivation procedure of the adjoint equation and its internal boundary conditions in time to efficiently derive the optimal transporting strategy. We finally provide a demonstrative computational example of a transporting problem of Ayu sweetfish (Plecoglossus altivelis altivelis) based on the latest real data set.
△ Less
Submitted 11 March, 2021;
originally announced March 2021.
-
HJB and Fokker-Planck equations for river environmental management based on stochastic impulse control with discrete and random observation
Authors:
H. Yoshioka,
M. Tsujimura,
K. Hamagami,
Y. Yaegashi,
Y. Yoshioka
Abstract:
We formulate a new two-variable river environmental restoration problem based on jump stochastic differential equations (SDEs) governing the sediment storage and nuisance benthic algae population dynamics in a dam-downstream river. Controlling the dynamics is carried out through impulsive sediment replenishment with discrete and random observation/intervention to avoid sediment depletion and thick…
▽ More
We formulate a new two-variable river environmental restoration problem based on jump stochastic differential equations (SDEs) governing the sediment storage and nuisance benthic algae population dynamics in a dam-downstream river. Controlling the dynamics is carried out through impulsive sediment replenishment with discrete and random observation/intervention to avoid sediment depletion and thick algae growth. We consider a cost-efficient management problem of the SDEs to achieve the objectives whose resolution reduces to solving a Hamilton-Jacobi-Bellman (HJB) equation. We also consider a Fokker-Planck (FP) equation governing the probability density function of the controlled dynamics. The HJB equation has a discontinuous solution, while the FP equation has a Dirac's delta along boundaries. We show that the value function, the optimized objective function, is governed by the HJB equation in the simplified case and further that a threshold-type control is optimal. We demonstrate that simple numerical schemes can handle these equations. Finally, we numerically analyze the optimal controls and the resulting probability density functions.
△ Less
Submitted 26 May, 2021; v1 submitted 31 August, 2020;
originally announced September 2020.
-
Mathematical and computational approaches for stochastic control of river environment and ecology: from fisheries viewpoint
Authors:
Hidekazu Yoshioka
Abstract:
We present a modern stochastic control framework for dynamic optimization of river environment and ecology. We focus on a fisheries problem in Japan, and show several examples of simplified optimal control problems of stochastic differential equations modeling fishery resource dynamics, reservoir water balance dynamics, benthic algae dynamics, and sediment storage dynamics. These problems concern…
▽ More
We present a modern stochastic control framework for dynamic optimization of river environment and ecology. We focus on a fisheries problem in Japan, and show several examples of simplified optimal control problems of stochastic differential equations modeling fishery resource dynamics, reservoir water balance dynamics, benthic algae dynamics, and sediment storage dynamics. These problems concern different phenomena with each other, but they all reduce to solving degenerate parabolic or elliptic equations. Optimal controls and value functions of these problems are computed using finite difference schemes. Finally, we present a higher-dimensional problem of controlling a dam-reservoir system using a semi-Lagrangian discretization on sparse grids. Our contribution shows the state-of-art of modeling, analysis, and computation of stochastic control in environmental engineering and science, and related research areas.
△ Less
Submitted 11 November, 2020; v1 submitted 20 July, 2020;
originally announced July 2020.
-
A generalized stochastic control problem of bounded noise process under ambiguity arising in biological management
Authors:
H. Yoshioka,
M. Tsujimura
Abstract:
The objectives and contributions of this paper are mathematical and numerical analyses of a stochastic control problem of bounded population dynamics under ambiguity, an important but not well-studied problem, focusing on the optimality equation as a nonlinear degenerate parabolic partial integro-differential equation (PIDE). The ambiguity comes from lack of knowledge on the continuous and jump no…
▽ More
The objectives and contributions of this paper are mathematical and numerical analyses of a stochastic control problem of bounded population dynamics under ambiguity, an important but not well-studied problem, focusing on the optimality equation as a nonlinear degenerate parabolic partial integro-differential equation (PIDE). The ambiguity comes from lack of knowledge on the continuous and jump noises in the dynamics, and its optimization appears as nonlinear and nonlocal terms in the PIDE. Assuming a strong dynamic programming principle for continuous value functions, we characterize its solutions from both viscosity and distribution viewpoints. Numerical computation focusing on an ergodic case are presented as well to complement the mathematical analysis.
△ Less
Submitted 2 July, 2020;
originally announced July 2020.
-
Stochastic impulse control of non-smooth dynamics with partial observation and execution delay: application to an environmental restoration problem
Authors:
Hidekazu Yoshioka,
Yuta Yaegashi
Abstract:
Non-smooth dynamics driven by stochastic disturbance arise in a wide variety of engineering problems. Impulsive interventions are often employed to control stochastic systems; however, the modeling and analysis subject to execution delay have been less explored. In addition, continuously receiving information of the dynamics is not always possible. In this paper, with an application to an environm…
▽ More
Non-smooth dynamics driven by stochastic disturbance arise in a wide variety of engineering problems. Impulsive interventions are often employed to control stochastic systems; however, the modeling and analysis subject to execution delay have been less explored. In addition, continuously receiving information of the dynamics is not always possible. In this paper, with an application to an environmental restoration problem, a continuous-time stochastic impulse control problem subject to execution delay under discrete and random observations is newly formulated and analyzed. The dynamics have a non-smooth coefficient modulated by a Markov chain, and eventually attain an undesirable state like a depletion due to the non-smoothness. The goal of the control problem is to find the most cost-efficient policy that can prevent the dynamics from attaining the undesirable state. We demonstrate that finding the optimal policy reduces to solving a non-standard system of degenerate elliptic equations, the optimality equation, which is rigorously and analytically verified in a simplified case. The associated Fokker-Planck equation for the controlled dynamics is derived and solved explicitly as well. The model is finally applied to numerical computation of a recent river environmental restoration problem. The optimality and Fokker-Planck equations are successfully computed, and the optimal policy and the probability density functions are numerically obtained. The impacts of execution delay are discussed to deeper analyze the model.
△ Less
Submitted 17 January, 2021; v1 submitted 29 June, 2020;
originally announced June 2020.
-
River environmental restoration based on random observations of a non-smooth stochastic dynamical system
Authors:
Hidekazu Yoshioka
Abstract:
Earth and soils are indispensable elements of river environment. Dam-downstream environment and ecosystems have been severely affected by reduced or even stopped sediment supply from the upstream. Replenishing earth and soils from outside the river has been considered as an effective way to mitigate this issue. However, its cost-effective implementation has not been considered from a theoretical s…
▽ More
Earth and soils are indispensable elements of river environment. Dam-downstream environment and ecosystems have been severely affected by reduced or even stopped sediment supply from the upstream. Replenishing earth and soils from outside the river has been considered as an effective way to mitigate this issue. However, its cost-effective implementation has not been considered from a theoretical side. This paper presents a tractable new stochastic control model to deal with this issue. The sediment dynamics in the river environment follow non-smooth and continuous-time piecewise deterministic dynamics. The model assumes that the observation of the sediment dynamics is carried out only randomly and discretely, and that the sediment can be replenished at each observation time with cost. This partial observation assumption is consistent with the fact that continuously obtaining the environmental information is difficult in applications. The performance index to penalize the sediment depletion has a non-smooth term as well. We demonstrate that these non-smoothness factors harmonize with a dynamic programming principle, and derive the optimality equation in a degenerate elliptic form governing the most cost-efficient sediment replenishment policy. We analytically derive and verify an exact solution under a simplified condition for a discounted case, an Ergodic case, and a complete information case. A more realistic case is handled using a high-resolution finite difference scheme. We then provide the optimal sediment replenishment policy numerically.
△ Less
Submitted 10 May, 2020;
originally announced May 2020.
-
Regime-switching constrained viscosity solutions approach for controlling dam-reservoir systems
Authors:
H. Yoshioka,
Y. Yoshioka
Abstract:
A new stochastic control problem of a dam-reservoir system installed in a river is analyzed both mathematically and numerically. Water balance dynamics of the reservoir are piece-wise deterministic and are driven by a stochastic regime-switching inflow process. The system is controlled to balance among the operation purpose and the internal and downstream environmental conditions. Finding the opti…
▽ More
A new stochastic control problem of a dam-reservoir system installed in a river is analyzed both mathematically and numerically. Water balance dynamics of the reservoir are piece-wise deterministic and are driven by a stochastic regime-switching inflow process. The system is controlled to balance among the operation purpose and the internal and downstream environmental conditions. Finding the optimal operation policy of the system reduces to solving an optimality equation with a discontinuous Hamiltonian, which is a system of nonlinear degenerate parabolic (or hyperbolic) equations. We show that the optimality equation has at most one constrained viscosity solution and find the solution explicitly under certain conditions. The model is applied to numerical computation of the operation policy of an existing dam-reservoir system using a high-order finite difference scheme. The computational results can suggest how the operation policy should be adapted according to the environmental concerns of the river.
△ Less
Submitted 30 April, 2020; v1 submitted 3 January, 2020;
originally announced January 2020.
