Showing 1–8 of 8 results for author: Tulsyan, A

Machine learning for industrial sensing and control: A survey and practical perspective

Authors: Nathan P. Lawrence, Seshu Kumar Damarla, Jong Woo Kim, Aditya Tulsyan, Faraz Amjad, Kai Wang, Benoit Chachuat, Jong Min Lee, Biao Huang, R. Bhushan Gopaluni

Abstract: With the rise of deep learning, there has been renewed interest within the process industries to utilize data on large-scale nonlinear sensing and control problems. We identify key statistical and machine learning techniques that have seen practical success in the process industries. To do so, we start with hybrid modeling to provide a methodological framework underlying core application areas: so… ▽ More With the rise of deep learning, there has been renewed interest within the process industries to utilize data on large-scale nonlinear sensing and control problems. We identify key statistical and machine learning techniques that have seen practical success in the process industries. To do so, we start with hybrid modeling to provide a methodological framework underlying core application areas: soft sensing, process optimization, and control. Soft sensing contains a wealth of industrial applications of statistical and machine learning methods. We quantitatively identify research trends, allowing insight into the most successful techniques in practice. We consider two distinct flavors for data-driven optimization and control: hybrid modeling in conjunction with mathematical programming techniques and reinforcement learning. Throughout these application areas, we discuss their respective industrial requirements and challenges. A common challenge is the interpretability and efficiency of purely data-driven methods. This suggests a need to carefully balance deep learning techniques with domain knowledge. As a result, we highlight ways prior knowledge may be integrated into industrial machine learning applications. The treatment of methods, problems, and applications presented here is poised to inform and inspire practitioners and researchers to develop impactful data-driven sensing, optimization, and control solutions in the process industries. △ Less

Submitted 24 January, 2024; originally announced January 2024.

Comments: 48 pages

Journal ref: Control Engineering Practice 2024

Modern Machine Learning Tools for Monitoring and Control of Industrial Processes: A Survey

Authors: R. Bhushan Gopaluni, Aditya Tulsyan, Benoit Chachuat, Biao Huang, Jong Min Lee, Faraz Amjad, Seshu Kumar Damarla, Jong Woo Kim, Nathan P. Lawrence

Abstract: Over the last ten years, we have seen a significant increase in industrial data, tremendous improvement in computational power, and major theoretical advances in machine learning. This opens up an opportunity to use modern machine learning tools on large-scale nonlinear monitoring and control problems. This article provides a survey of recent results with applications in the process industry. Over the last ten years, we have seen a significant increase in industrial data, tremendous improvement in computational power, and major theoretical advances in machine learning. This opens up an opportunity to use modern machine learning tools on large-scale nonlinear monitoring and control problems. This article provides a survey of recent results with applications in the process industry. △ Less

Submitted 22 September, 2022; originally announced September 2022.

Comments: IFAC World Congress 2020

Deep Reinforcement Learning for Process Control: A Primer for Beginners

Authors: Steven Spielberg, Aditya Tulsyan, Nathan P. Lawrence, Philip D Loewen, R. Bhushan Gopaluni

Abstract: Advanced model-based controllers are well established in process industries. However, such controllers require regular maintenance to maintain acceptable performance. It is a common practice to monitor controller performance continuously and to initiate a remedial model re-identification procedure in the event of performance degradation. Such procedures are typically complicated and resource-inten… ▽ More Advanced model-based controllers are well established in process industries. However, such controllers require regular maintenance to maintain acceptable performance. It is a common practice to monitor controller performance continuously and to initiate a remedial model re-identification procedure in the event of performance degradation. Such procedures are typically complicated and resource-intensive, and they often cause costly interruptions to normal operations. In this paper, we exploit recent developments in reinforcement learning and deep learning to develop a novel adaptive, model-free controller for general discrete-time processes. The DRL controller we propose is a data-based controller that learns the control policy in real time by merely interacting with the process. The effectiveness and benefits of the DRL controller are demonstrated through many simulations. △ Less

Submitted 11 April, 2020; originally announced April 2020.

Comments: 21 pages

Journal ref: AICHE Journal 2019

Fault Tolerant and Fully Dynamic DFS in Undirected Graphs: Simple Yet Efficient

Authors: Surender Baswana, Shiv Kumar Gupta, Ayush Tulsyan

Abstract: We present an algorithm for a fault tolerant Depth First Search (DFS) Tree in an undirected graph. This algorithm is drastically simpler than the current state-of-the-art algorithms for this problem, uses optimal space and optimal preprocessing time, and still achieves better time complexity. This algorithm also leads to a better time complexity for maintaining a DFS tree in a fully dynamic enviro… ▽ More We present an algorithm for a fault tolerant Depth First Search (DFS) Tree in an undirected graph. This algorithm is drastically simpler than the current state-of-the-art algorithms for this problem, uses optimal space and optimal preprocessing time, and still achieves better time complexity. This algorithm also leads to a better time complexity for maintaining a DFS tree in a fully dynamic environment. △ Less

Submitted 27 March, 2019; v1 submitted 3 October, 2018; originally announced October 2018.

Comments: 16 pages, 2 figures

Input design for Bayesian identification of non-linear state-space models

Authors: Aditya Tulsyan, Swanand R. Khare, Biao Huang, R. Bhushan Gopaluni, J. Fraser Forbes

Abstract: We propose an algorithm for designing optimal inputs for on-line Bayesian identification of stochastic non-linear state-space models. The proposed method relies on minimization of the posterior Cramér Rao lower bound derived for the model parameters, with respect to the input sequence. To render the optimization problem computationally tractable, the inputs are parametrized as a multi-dimensional… ▽ More We propose an algorithm for designing optimal inputs for on-line Bayesian identification of stochastic non-linear state-space models. The proposed method relies on minimization of the posterior Cramér Rao lower bound derived for the model parameters, with respect to the input sequence. To render the optimization problem computationally tractable, the inputs are parametrized as a multi-dimensional Markov chain in the input space. The proposed approach is illustrated through a simulation example. △ Less

Submitted 23 July, 2013; originally announced July 2013.

Comments: This article has been published in: Tulsyan, A, S.R. Khare, B. Huang, R.B. Gopaluni and J.F. Forbes (2013). Bayesian identification of non-linear state-space models: Part I- Input design. In: Proceedings of the 10th IFAC International Symposium on Dynamics and Control of Process Systems. Mumbai, India

Journal ref: Proceedings of the 10th IFAC International Symposium on Dynamics and Control of Process Systems. Mumbai, India, 2013

Error analysis in Bayesian identification of non-linear state-space models

Authors: Aditya Tulsyan, Biao Huang, R. Bhushan Gopaluni, J. Fraser Forbes

Abstract: In the last two decades, several methods based on sequential Monte Carlo (SMC) and Markov chain Monte Carlo (MCMC) have been proposed for Bayesian identification of stochastic non-linear state-space models (SSMs). It is well known that the performance of these simulation based identification methods depends on the numerical approximations used in their design. We propose the use of posterior Cramé… ▽ More In the last two decades, several methods based on sequential Monte Carlo (SMC) and Markov chain Monte Carlo (MCMC) have been proposed for Bayesian identification of stochastic non-linear state-space models (SSMs). It is well known that the performance of these simulation based identification methods depends on the numerical approximations used in their design. We propose the use of posterior Cramér-Rao lower bound (PCRLB) as a mean square error (MSE) bound. Using PCRLB, a systematic procedure is developed to analyse the estimates delivered by Bayesian identification methods in terms of bias, MSE, and efficiency. The efficacy and utility of the proposed approach is illustrated through a numerical example. △ Less

Submitted 23 July, 2013; originally announced July 2013.

Comments: This article has been published in: Tulsyan, A, B. Huang, R.B. Gopaluni and J.F. Forbes (2013). Bayesian identification of non-linear state-space models: Part II- Error Analysis. In: Proceedings of the 10th IFAC International Symposium on Dynamics and Control of Process Systems. Mumbai, India

Journal ref: Proceedings of the 10th IFAC International Symposium on Dynamics and Control of Process Systems. Mumbai, India, 2013

On-line Bayesian parameter estimation in general non-linear state-space models: A tutorial and new results

Authors: Aditya Tulsyan, Biao Huang, R. Bhushan Gopaluni, J. Fraser Forbes

Abstract: On-line estimation plays an important role in process control and monitoring. Obtaining a theoretical solution to the simultaneous state-parameter estimation problem for non-linear stochastic systems involves solving complex multi-dimensional integrals that are not amenable to analytical solution. While basic sequential Monte-Carlo (SMC) or particle filtering (PF) algorithms for simultaneous estim… ▽ More On-line estimation plays an important role in process control and monitoring. Obtaining a theoretical solution to the simultaneous state-parameter estimation problem for non-linear stochastic systems involves solving complex multi-dimensional integrals that are not amenable to analytical solution. While basic sequential Monte-Carlo (SMC) or particle filtering (PF) algorithms for simultaneous estimation exist, it is well recognized that there is a need for making these on-line algorithms non-degenerate, fast and applicable to processes with missing measurements. To overcome the deficiencies in traditional algorithms, this work proposes a Bayesian approach to on-line state and parameter estimation. Its extension to handle missing data in real-time is also provided. The simultaneous estimation is performed by filtering an extended vector of states and parameters using an adaptive sequential-importance-resampling (SIR) filter with a kernel density estimation method. The approach uses an on-line optimization algorithm based on Kullback-Leibler (KL) divergence to allow adaptation of the SIR filter for combined state-parameter estimation. An optimal tuning rule to control the width of the kernel and the variance of the artificial noise added to the parameters is also proposed. The approach is illustrated through numerical examples. △ Less

Submitted 12 July, 2013; originally announced July 2013.

Comments: A condensed version of this article has been published in: Tulsyan, A., Huang, B., Gopaluni, R.B., Forbes, J.F. "On simultaneous on-line state and parameter estimation in non-linear state-space models". Journal of Process Control, vol 23, no. 4, 2013

Journal ref: Journal of Process Control, vol 23, no. 4, 2013

A particle filter approach to approximate posterior Cramér-Rao lower bound

Authors: Aditya Tulsyan, Biao Huang, R. Bhushan Gopaluni, J. Fraser Forbes

Abstract: The posterior Cramér-Rao lower bound (PCRLB) derived in Tichavský et al., 1998, provides a bound on the mean square error (MSE) obtained with any non-linear state filter. Computing the PCRLB involves solving complex, multi-dimensional expectations, which do not lend themselves to an easy analytical solution. Furthermore, any attempt to approximate it using numerical or simulation based approaches… ▽ More The posterior Cramér-Rao lower bound (PCRLB) derived in Tichavský et al., 1998, provides a bound on the mean square error (MSE) obtained with any non-linear state filter. Computing the PCRLB involves solving complex, multi-dimensional expectations, which do not lend themselves to an easy analytical solution. Furthermore, any attempt to approximate it using numerical or simulation based approaches require a priori access to the true states, which may not be available, except in simulations or in carefully designed experiments. To allow recursive approximation of the PCRLB when the states are hidden or unmeasured, a new approach based on sequential Monte-Carlo (SMC) or particle filters (PF) is proposed. The approach uses SMC methods to estimate the hidden states using a sequence of the available sensor measurements. The developed method is general and can be used to approximate the PCRLB in non-linear systems with non-Gaussian state and sensor noise. The efficacy of the developed method is illustrated on two simulation examples, including a practical problem of ballistic target tracking at re-entry phase. △ Less

Submitted 11 July, 2013; originally announced July 2013.

Comments: A condensed version of this article has been published in IEEE Transactions on Aerospace and Electronic Systems and is in press

Journal ref: IEEE Transactions on Aerospace and Electronic Systems, Vol. 49, no. 4, 2013