Showing 1–2 of 2 results for author: Kalyanam, K
-
Nonlinear Moving Horizon Estimation and Model Predictive Control for Buildings with Unknown HVAC Dynamics
Authors:
Saman Mostafavi,
Harish Doddi,
Krishna Kalyanam,
David Schwartz
Abstract:
We present a solution for modeling and online identification for heating, ventilation, and air conditioning (HVAC) control in buildings. Our approach comprises: (a) a resistance-capacitance (RC) model based on first order energy balance for deriving the zone temperature dynamics, and (b) a neural network for modeling HVAC dynamics. State estimation and model identification are simultaneously perfo…
▽ More
We present a solution for modeling and online identification for heating, ventilation, and air conditioning (HVAC) control in buildings. Our approach comprises: (a) a resistance-capacitance (RC) model based on first order energy balance for deriving the zone temperature dynamics, and (b) a neural network for modeling HVAC dynamics. State estimation and model identification are simultaneously performed using nonlinear moving horizon estimation (MHE) with physical constraints for system states. We leverage the identified model in model predictive control (MPC) for occupant comfort satisfaction and HVAC energy savings and verify the approach using simulations. Our system relies only on building management system data, does not require extensive data storage, and does not require a detailed building model. This can significantly aid the large scale adoption of MPC for future occupant-centric control of grid-interactive buildings.
△ Less
Submitted 18 November, 2022;
originally announced November 2022.
-
Bounding Procedures for Stochastic Dynamic Programs with Application to the Perimeter Patrol Problem
Authors:
Myoungkuk Park,
Krishnamoorthy Kalyanam,
Swaroop Darbha,
Phil Chandler,
Meir Pachter
Abstract:
One often encounters the curse of dimensionality in the application of dynamic programming to determine optimal policies for controlled Markov chains. In this paper, we provide a method to construct sub-optimal policies along with a bound for the deviation of such a policy from the optimum via a linear programming approach. The state-space is partitioned and the optimal cost-to-go or value functio…
▽ More
One often encounters the curse of dimensionality in the application of dynamic programming to determine optimal policies for controlled Markov chains. In this paper, we provide a method to construct sub-optimal policies along with a bound for the deviation of such a policy from the optimum via a linear programming approach. The state-space is partitioned and the optimal cost-to-go or value function is approximated by a constant over each partition. By minimizing a non-negative cost function defined on the partitions, one can construct an approximate value function which also happens to be an upper bound for the optimal value function of the original Markov Decision Process (MDP). As a key result, we show that this approximate value function is {\it independent} of the non-negative cost function (or state dependent weights as it is referred to in the literature) and moreover, this is the least upper bound that one can obtain once the partitions are specified. Furthermore, we show that the restricted system of linear inequalities also embeds a family of MDPs of lower dimension, one of which can be used to construct a lower bound on the optimal value function. The construction of the lower bound requires the solution to a combinatorial problem. We apply the linear programming approach to a perimeter surveillance stochastic optimal control problem and obtain numerical results that corroborate the efficacy of the proposed methodology.
△ Less
Submitted 16 August, 2011;
originally announced August 2011.
