Showing 1–9 of 9 results for author: Agyeman, B T

Performance triggered adaptive model reduction for soil moisture estimation in precision irrigation

Authors: Sarupa Debnath, Bernard T. Agyeman, Soumya R. Sahoo, Xunyuan Yin, **feng Liu

Abstract: Accurate soil moisture information is crucial for develo** precise irrigation control strategies to enhance water use efficiency. Soil moisture estimation based on limited soil moisture sensors is crucial for obtaining comprehensive soil moisture information when dealing with large-scale agricultural fields. The major challenge in soil moisture estimation lies in the high dimensionality of the s… ▽ More Accurate soil moisture information is crucial for develo** precise irrigation control strategies to enhance water use efficiency. Soil moisture estimation based on limited soil moisture sensors is crucial for obtaining comprehensive soil moisture information when dealing with large-scale agricultural fields. The major challenge in soil moisture estimation lies in the high dimensionality of the spatially discretized agro-hydrological models. In this work, we propose a performance-triggered adaptive model reduction approach to address this challenge. The proposed approach employs a trajectory-based unsupervised machine learning technique, and a prediction performance-based triggering scheme is designed to govern model updates adaptively in a way such that the prediction error between the reduced model and the original model over a prediction horizon is maintained below a predetermined threshold. An adaptive extended Kalman filter (EKF) is designed based on the reduced model for soil moisture estimation. The applicability and performance of the proposed approach are evaluated extensively through the application to a simulated large-scale agricultural field. △ Less

Submitted 1 April, 2024; originally announced April 2024.

Optimizing the switching operation in monoclonal antibody production: Economic MPC and reinforcement learning

Authors: Sandra A. Obiri, Song Bo, Bernard T. Agyeman, Benjamin Decardi-Nelson, **feng Liu

Abstract: Monoclonal antibodies (mAbs) have emerged as indispensable assets in medicine, and are currently at the forefront of biopharmaceutical product development. However, the growing market demand and the substantial doses required for mAb clinical treatments necessitate significant progress in its large-scale production. Most of the processes for industrial mAb production rely on batch operations, whic… ▽ More Monoclonal antibodies (mAbs) have emerged as indispensable assets in medicine, and are currently at the forefront of biopharmaceutical product development. However, the growing market demand and the substantial doses required for mAb clinical treatments necessitate significant progress in its large-scale production. Most of the processes for industrial mAb production rely on batch operations, which result in significant downtime. The shift towards a fully continuous and integrated manufacturing process holds the potential to boost product yield and quality, while eliminating the extra expenses associated with storing intermediate products. The integrated continuous mAb production process can be divided into the upstream and downstream processes. One crucial aspect that ensures the continuity of the integrated process is the switching of the capture columns, which are typically chromatography columns operated in a fed-batch manner downstream. Due to the discrete nature of the switching operation, advanced process control algorithms such as economic MPC (EMPC) are computationally difficult to implement. This is because an integer nonlinear program (INLP) needs to be solved online at each sampling time. This paper introduces two computationally-efficient approaches for EMPC implementation, namely, a sigmoid function approximation approach and a rectified linear unit (ReLU) approximation approach. It also explores the application of deep reinforcement learning (DRL). These three methods are compared to the traditional switching approach which is based on a 1% product breakthrough rule and which involves no optimization. △ Less

Submitted 7 August, 2023; originally announced August 2023.

Integrating machine learning paradigms and mixed-integer model predictive control for irrigation scheduling

Authors: Bernard T. Agyeman, Mohamed Naouri, Willemijn Appels, **feng Liu, Sirish L. Shah

Abstract: The agricultural sector currently faces significant challenges in water resource conservation and crop yield optimization, primarily due to concerns over freshwater scarcity. Traditional irrigation scheduling methods often prove inadequate in meeting the needs of large-scale irrigation systems. To address this issue, this paper proposes a predictive irrigation scheduler that leverages the three pa… ▽ More The agricultural sector currently faces significant challenges in water resource conservation and crop yield optimization, primarily due to concerns over freshwater scarcity. Traditional irrigation scheduling methods often prove inadequate in meeting the needs of large-scale irrigation systems. To address this issue, this paper proposes a predictive irrigation scheduler that leverages the three paradigms of machine learning to optimize irrigation schedules. The proposed scheduler employs the k-means clustering approach to divide the field into distinct irrigation management zones based on soil hydraulic parameters and topology information. Furthermore, a long short-term memory network is employed to develop dynamic models for each management zone, enabling accurate predictions of soil moisture dynamics. Formulated as a mixed-integer model predictive control problem, the scheduler aims to maximize water uptake while minimizing overall water consumption and irrigation costs. To tackle the mixed-integer optimization challenge, the proximal policy optimization algorithm is utilized to train a reinforcement learning agent responsible for making daily irrigation decisions. To evaluate the performance of the proposed scheduler, a 26.4-hectare field in Lethbridge, Canada, was chosen as a case study for the 2015 and 2022 growing seasons. The results demonstrate the superiority of the proposed scheduler compared to a traditional irrigation scheduling method in terms of water use efficiency and crop yield improvement for both growing seasons. Notably, the proposed scheduler achieved water savings ranging from 6.4% to 22.8%, along with yield increases ranging from 2.3% to 4.3%. △ Less

Submitted 14 June, 2023; originally announced June 2023.

Control invariant set enhanced safe reinforcement learning: improved sampling efficiency, guaranteed stability and robustness

Authors: Song Bo, Bernard T. Agyeman, Xunyuan Yin, **feng Liu

Abstract: Reinforcement learning (RL) is an area of significant research interest, and safe RL in particular is attracting attention due to its ability to handle safety-driven constraints that are crucial for real-world applications. This work proposes a novel approach to RL training, called control invariant set (CIS) enhanced RL, which leverages the advantages of utilizing the explicit form of CIS to impr… ▽ More Reinforcement learning (RL) is an area of significant research interest, and safe RL in particular is attracting attention due to its ability to handle safety-driven constraints that are crucial for real-world applications. This work proposes a novel approach to RL training, called control invariant set (CIS) enhanced RL, which leverages the advantages of utilizing the explicit form of CIS to improve stability guarantees and sampling efficiency. Furthermore, the robustness of the proposed approach is investigated in the presence of uncertainty. The approach consists of two learning stages: offline and online. In the offline stage, CIS is incorporated into the reward design, initial state sampling, and state reset procedures. This incorporation of CIS facilitates improved sampling efficiency during the offline training process. In the online stage, RL is retrained whenever the predicted next step state is outside of the CIS, which serves as a stability criterion, by introducing a Safety Supervisor to examine the safety of the action and make necessary corrections. The stability analysis is conducted for both cases, with and without uncertainty. To evaluate the proposed approach, we apply it to a simulated chemical reactor. The results show a significant improvement in sampling efficiency during offline training and closed-loop stability guarantee in the online implementation, with and without uncertainty. △ Less

Submitted 24 May, 2023; originally announced May 2023.

Comments: arXiv admin note: substantial text overlap with arXiv:2304.05509

Maximizing soil moisture estimation accuracy through simultaneous hydraulic parameter estimation using microwave remote sensing: Methodology and application

Authors: Bernard T. Agyeman, Erfan Orouskhani, Mohamed Naouri, Willemijn Appels, Maik Wolleben, **feng Liu, Sirish L. Shah

Abstract: Improving the accuracy of soil moisture estimation is desirable from the perspectives of irrigation management and water conservation. To this end, this study proposes a systematic approach to select a subset of soil hydraulic parameters for estimation in large-scale agrohydrological systems to enhance soil moisture estimation accuracy. The proposed method involves simultaneous estimation of the s… ▽ More Improving the accuracy of soil moisture estimation is desirable from the perspectives of irrigation management and water conservation. To this end, this study proposes a systematic approach to select a subset of soil hydraulic parameters for estimation in large-scale agrohydrological systems to enhance soil moisture estimation accuracy. The proposed method involves simultaneous estimation of the selected parameters and the entire soil moisture distribution of the field, taking into account soil heterogeneity and using soil moisture observations obtained through microwave radiometers mounted on a center pivot irrigation system. At its core, the proposed method models the field with the cylindrical coordinate version of the Richards equation and addresses the issue of parameter estimability (quantitative parameter identifiability) through the sensitivity analysis and orthogonal projection approaches. Additionally, the study assimilates remotely sensed soil moisture observations into the field model using the extended Kalman filtering technique. The effectiveness of the proposed methodology is demonstrated through numerical simulations and a real field experiment, with cross-validation results showing a 24-43% improvement in soil moisture estimation accuracy. Overall, the study highlights the potential of this method to enhance soil moisture estimation in large-scale agricultural fields. △ Less

Submitted 24 May, 2023; originally announced May 2023.

Impact of sensor placement in soil water estimation: A real-case study

Authors: Erfan Orouskhani, Soumya R. Sahoo, Bernard T. Agyeman, Song Bo, **feng Liu

Abstract: One of the essential elements in implementing a closed-loop irrigation system is soil moisture estimation based on a limited number of available sensors. One associated problem is the determination of the optimal locations to install the sensors such that good soil moisture estimation can be obtained. In our previous work, the modal degree of observability was employed to address the problem of op… ▽ More One of the essential elements in implementing a closed-loop irrigation system is soil moisture estimation based on a limited number of available sensors. One associated problem is the determination of the optimal locations to install the sensors such that good soil moisture estimation can be obtained. In our previous work, the modal degree of observability was employed to address the problem of optimal sensor placement for soil moisture estimation of agro-hydrological systems. It was demonstrated that the optimally placed sensors can improve the soil moisture estimation performance. However, it is unclear whether the optimal sensor placement can significantly improve the soil moisture estimation performance in actual applications. In this work, we investigate the impact of sensor placement in soil moisture estimation for an actual agricultural field in Lethbridge, Alberta, Canada. In an experiment on the studied field, 42 soil moisture sensors were installed at different depths to collect the soil moisture measurements for one growing season. A three-dimensional agro-hydrological model with heterogeneous soil parameters of the studied field is developed. The modal degree of observability is applied to the three-dimensional system to determine the optimal sensor locations. The extended Kalman filter (EKF) is chosen as the data assimilation tool to estimate the soil moisture content of the studied field. Soil moisture estimation results for different scenarios are obtained and analyzed to investigate the effects of sensor placement on the performance of soil moisture estimation in the actual applications. △ Less

Submitted 12 March, 2022; originally announced March 2022.

Knowledge-based optimal irrigation scheduling of agro-hydrological systems

Authors: Soumya R. Sahoo, Bernard T. Agyeman, Sarupa Debnath, **feng Liu

Abstract: The typical agricultural irrigation scheduler provides information on how much to irrigate and when to irrigate. The accurate and effective scheduler decision for a large agricultural field is still an open research problem. In this work, we address the high dimensionality of the agricultural field and propose a systematic approach to provide optimum irrigation amount and irrigation time for three… ▽ More The typical agricultural irrigation scheduler provides information on how much to irrigate and when to irrigate. The accurate and effective scheduler decision for a large agricultural field is still an open research problem. In this work, we address the high dimensionality of the agricultural field and propose a systematic approach to provide optimum irrigation amount and irrigation time for three-dimensional agro-hydrological systems. The water dynamics of the agro-hydrological system are represented using a cylindrical three-dimensional Richards Equation. We introduce a structure-preserving model reduction technique to decrease the dimension of the system model. Using the reduced model, the optimization-based closed-loop scheduler is designed in model predictive control (MPC) environment. The closed-loop approach can handle weather disturbances and provide improved yield and water conservation. The primary objective of the proposed scheduler is to ensure maximum yield, minimum water consumption and maximize the time between the two irrigation events, which results in less electricity usage. The proposed approach is applied to three different scenarios to show the effectiveness and superiority of the proposed framework. △ Less

Submitted 12 December, 2021; originally announced December 2021.

LSTM-based model predictive control with discrete inputs for irrigation scheduling

Authors: Bernard T. Agyeman, Soumya R. Sahoo, **feng Liu, Sirish L. Shah

Abstract: The development of well-devised irrigation scheduling methods is desirable from the perspectives of plant quality and water conservation. In this article, a model predictive control (MPC) with discrete actuators is developed for irrigation scheduling, where a long short-term memory (LSTM) model of the soil-water-atmosphere system is used to evaluate the objective of ensuring optimal water uptake i… ▽ More The development of well-devised irrigation scheduling methods is desirable from the perspectives of plant quality and water conservation. In this article, a model predictive control (MPC) with discrete actuators is developed for irrigation scheduling, where a long short-term memory (LSTM) model of the soil-water-atmosphere system is used to evaluate the objective of ensuring optimal water uptake in crops while minimizing total water consumption and irrigation costs. A heuristic method involving a sigmoid function is used in this framework to enhance the computational efficiency of the scheduler. The scheduling scheme is applied to homogeneous and spatially variable fields and the results indicate that the LSTM-based MPC with discrete actuators is able to prescribe optimal or near-optimal irrigation schedules that are typical of irrigation practice. △ Less

Submitted 12 December, 2021; originally announced December 2021.

Soil moisture map construction using microwave remote sensors and sequential data assimilation

Authors: Bernard T. Agyeman, Song Bo, Soumya R. Sahoo, Xunyuan Yin, **feng Liu, Sirish L. Shah

Abstract: Microwave remote sensors mounted on center pivot irrigation systems provide a feasible approach to obtain soil moisture information, in the form of water content maps, for the implementation of closed-loop irrigation. Major challenges such as significant time delays in the soil moisture measurements, the inability of the sensors to provide soil moisture information in instances where the center pi… ▽ More Microwave remote sensors mounted on center pivot irrigation systems provide a feasible approach to obtain soil moisture information, in the form of water content maps, for the implementation of closed-loop irrigation. Major challenges such as significant time delays in the soil moisture measurements, the inability of the sensors to provide soil moisture information in instances where the center pivot is stationary, and the inability of the sensors to provide soil moisture information in the root zone reduce the usability of the water content maps in the effective implementation of closed-loop irrigation. In this paper, we seek to address the aforementioned challenges and consequently describe a water content map construction procedure that is suitable for the implementation of closed-loop irrigation. Firstly, we propose the cylindrical coordinates version of the Richards equation (field model) which naturally models fields equipped with a center pivot irrigation system. Secondly, measurements obtained from the microwave sensors are assimilated into the field model using the extended Kalman filter to form an information fusion system, which will provide frequent soil moisture estimates and predictions in the form of moisture content maps. The utility of the proposed information fusion system is first investigated with simulated microwave sensor measurements. The information fusion system is then applied to a real large-scale agriculture field where we demonstrate the its ability to address the challenges. Three performance evaluation criteria are used to validate the soil moisture estimates and predictions provided by the proposed information fusion system. △ Less

Submitted 28 September, 2020; originally announced October 2020.