Showing 1–13 of 13 results for author: Mili, L

Measurement Uncertainty Impact on Koopman Operator Estimation of Power System Dynamics

Authors: P. Algikar, P. Sharma, M. Netto, L. Mili

Abstract: Sensor measurements are mission-critical for monitoring and controlling power systems because they provide real-time insight into the grid operating condition; however, confidence in these insights depends greatly on the quality of the sensor data. Uncertainty in sensor measurements is an intrinsic aspect of the measurement process. In this paper, we develop an analytical method to quantify the im… ▽ More Sensor measurements are mission-critical for monitoring and controlling power systems because they provide real-time insight into the grid operating condition; however, confidence in these insights depends greatly on the quality of the sensor data. Uncertainty in sensor measurements is an intrinsic aspect of the measurement process. In this paper, we develop an analytical method to quantify the impact of measurement uncertainties in numerical methods that employ the Koopman operator to identify nonlinear dynamics based on recorded data. In particular, we quantify the confidence interval of each element in the push-forward matrix from which a subset of the Koopman operator's discrete spectrum is estimated. We provide a detailed numerical analysis of the developed method applied to numerical simulations and field data collected from experiments conducted in a megawatt-scale facility at the National Renewable Energy Laboratory. △ Less

Submitted 25 March, 2024; originally announced March 2024.

Statistical analysis and method to propagate the impact of measurement uncertainty on dynamic mode decomposition

Authors: P. Algikar, P. Sharma, M. Netto, L. Mili

Abstract: We apply random matrix theory to study the impact of measurement uncertainty on dynamic mode decomposition. Specifically, when the measurements follow a normal probability density function, we show how the moments of that density propagate through the dynamic mode decomposition. While we focus on the first and second moments, the analytical expressions we derive are general and can be extended to… ▽ More We apply random matrix theory to study the impact of measurement uncertainty on dynamic mode decomposition. Specifically, when the measurements follow a normal probability density function, we show how the moments of that density propagate through the dynamic mode decomposition. While we focus on the first and second moments, the analytical expressions we derive are general and can be extended to higher-order moments. Further, the proposed numerical method to propagate uncertainty is agnostic of specific dynamic mode decomposition formulations. Of particular relevance, the estimated second moments provide confidence bounds that may be used as a metric of trustworthiness, that is, how much one can rely on a finite-dimensional linear operator to represent an underlying dynamical system. We perform numerical experiments on two canonical systems and verify the estimated confidence levels by comparing the moments to those obtained from Monte Carlo simulations. △ Less

Submitted 25 March, 2024; originally announced March 2024.

Comments: Submitted to CDC 2024

Quantifying Non-linear Dependencies in Blind Source Separation of Power System Signals using Copula Statistics

Authors: Pooja Algikar, Lamine Mili, Kiran Karra, Akash Algikar, Mohsen Ben Hassine

Abstract: The dynamics of a power system with a significant presence of renewable energy resources are growing increasingly nonlinear. This nonlinearity is a result of the intermittent nature of these resources and the switching behavior of their power electronic devices. Therefore, it is crucial to address these nonlinearity in the blind source separation methods. In this paper, we propose a blind source s… ▽ More The dynamics of a power system with a significant presence of renewable energy resources are growing increasingly nonlinear. This nonlinearity is a result of the intermittent nature of these resources and the switching behavior of their power electronic devices. Therefore, it is crucial to address these nonlinearity in the blind source separation methods. In this paper, we propose a blind source separation of a linear mixture of dependent sources based on copula statistics that measure the non-linear dependence between source component signals structured as copula density functions. The source signals are assumed to be stationary. The method minimizes the Kullback-Leibler divergence between the copula density functions of the estimated sources and of the dependency structure. The proposed method is applied to data obtained from the time-domain analysis of the classical 11-Bus 4-Machine system. Extensive simulation results demonstrate that the proposed method based on copula statistics converges faster and outperforms the state-of-the-art blind source separation method for dependent sources in terms of interference-to-signal ratio. △ Less

Submitted 10 February, 2024; v1 submitted 14 September, 2023; originally announced September 2023.

Comments: Accepted to the ISGT NA 2024

Identification of Power System Oscillation Modes using Blind Source Separation based on Copula Statistic

Authors: Pooja Algikar, Lamine Mili, Mohsen Ben Hassine, Somayeh Yarahmadi, Almuatazbellah, Boker

Abstract: The dynamics of a power system with large penetration of renewable energy resources are becoming more nonlinear due to the intermittence of these resources and the switching of their power electronic devices. Therefore, it is crucial to accurately identify the dynamical modes of oscillation of such a power system when it is subject to disturbances to initiate appropriate preventive or corrective c… ▽ More The dynamics of a power system with large penetration of renewable energy resources are becoming more nonlinear due to the intermittence of these resources and the switching of their power electronic devices. Therefore, it is crucial to accurately identify the dynamical modes of oscillation of such a power system when it is subject to disturbances to initiate appropriate preventive or corrective control actions. In this paper, we propose a high-order blind source identification (HOBI) algorithm based on the copula statistic to address these non-linear dynamics in modal analysis. The method combined with Hilbert transform (HOBI-HT) and iteration procedure (HOBMI) can identify all the modes as well as the model order from the observation signals obtained from the number of channels as low as one. We access the performance of the proposed method on numerical simulation signals and recorded data from a simulation of time domain analysis on the classical 11-Bus 4-Machine test system. Our simulation results outperform the state-of-the-art method in accuracy and effectiveness. △ Less

Submitted 7 February, 2023; originally announced February 2023.

Comments: Accepted at the IEEE PES General Meeting 2023

Robust Gaussian Process Regression with Huber Likelihood

Authors: Pooja Algikar, Lamine Mili

Abstract: Gaussian process regression in its most simplified form assumes normal homoscedastic noise and utilizes analytically tractable mean and covariance functions of predictive posterior distribution using Gaussian conditioning. Its hyperparameters are estimated by maximizing the evidence, commonly known as type II maximum likelihood estimation. Unfortunately, Bayesian inference based on Gaussian likeli… ▽ More Gaussian process regression in its most simplified form assumes normal homoscedastic noise and utilizes analytically tractable mean and covariance functions of predictive posterior distribution using Gaussian conditioning. Its hyperparameters are estimated by maximizing the evidence, commonly known as type II maximum likelihood estimation. Unfortunately, Bayesian inference based on Gaussian likelihood is not robust to outliers, which are often present in the observational training data sets. To overcome this problem, we propose a robust process model in the Gaussian process framework with the likelihood of observed data expressed as the Huber probability distribution. The proposed model employs weights based on projection statistics to scale residuals and bound the influence of vertical outliers and bad leverage points on the latent functions estimates while exhibiting a high statistical efficiency at the Gaussian and thick tailed noise distributions. The proposed method is demonstrated by two real world problems and two numerical examples using datasets with additive errors following thick tailed distributions such as Students t, Laplace, and Cauchy distribution. △ Less

Submitted 18 January, 2023; originally announced January 2023.

Comments: 20 Pages, 10 figures. Submitted to Annals of Applied Statistics

A Robust Data-driven Process Modeling Applied to Time-series Stochastic Power Flow

Authors: Pooja Algikar, Yijun Xu, Somayeh Yarahmadi, Lamine Mili

Abstract: In this paper, we propose a robust data-driven process model whose hyperparameters are robustly estimated using the Schweppe-type generalized maximum likelihood estimator. The proposed model is trained on recorded time-series data of voltage phasors and power injections to perform a time-series stochastic power flow calculation. Power system data are often corrupted with outliers caused by large e… ▽ More In this paper, we propose a robust data-driven process model whose hyperparameters are robustly estimated using the Schweppe-type generalized maximum likelihood estimator. The proposed model is trained on recorded time-series data of voltage phasors and power injections to perform a time-series stochastic power flow calculation. Power system data are often corrupted with outliers caused by large errors, fault conditions, power outages, and extreme weather, to name a few. The proposed model downweights vertical outliers and bad leverage points in the measurements of the training dataset. The weights used to bound the influence of the outliers are calculated using projection statistics, which are a robust version of Mahalanobis distances of the time series data points. The proposed method is demonstrated on the IEEE 33-Bus power distribution system and a real-world unbalanced 240-bus power distribution system heavily integrated with renewable energy sources. Our simulation results show that the proposed robust model can handle up to 25% of outliers in the training data set. △ Less

Submitted 6 January, 2023; originally announced January 2023.

Comments: Submitted to the IEEE Transactions on Power Systems

A Measurement-Based Robust Non-Gaussian Process Emulator Applied to Data-Driven Stochastic Power Flow

Authors: Pooja Algikar, Yijun Xu, Lamine Mili

Abstract: In this paper, we propose a robust non-Gaussian process emulator based on the Schweppe-type generalized maximum likelihood estimator, which is trained on metered time series of voltage phasors and power injections to perform stochastic power flow. Power system data are often corrupted with outliers caused by fault conditions, power outages, and extreme weather, to name a few. The proposed emulator… ▽ More In this paper, we propose a robust non-Gaussian process emulator based on the Schweppe-type generalized maximum likelihood estimator, which is trained on metered time series of voltage phasors and power injections to perform stochastic power flow. Power system data are often corrupted with outliers caused by fault conditions, power outages, and extreme weather, to name a few. The proposed emulator bounds the influence of the outliers using weights calculated based on projection statistics, which are robust distances of the data points associated with the rows vectors of the factor space. Specifically, the developed estimator is robust to vertical outliers and bad leverage points while retaining good leverage points in the measurements of the training dataset. The proposed method is demonstrated on an unbalanced radial IEEE 33-Bus system heavily integrated with renewable energy sources. △ Less

Submitted 9 February, 2022; originally announced February 2022.

Comments: IEEE PES GM 2022

Robust Dynamic Mode Decomposition

Authors: Amir Hossein Abolmasoumi, Marcos Netto, Lamine Mili

Abstract: This paper develops a robust dynamic mode decomposition (RDMD) method endowed with statistical and numerical robustness. Statistical robustness ensures estimation efficiency at the Gaussian and non-Gaussian probability distributions, including heavy-tailed distributions. The proposed RDMD is statistically robust because the outliers in the data set are flagged via projection statistics and suppres… ▽ More This paper develops a robust dynamic mode decomposition (RDMD) method endowed with statistical and numerical robustness. Statistical robustness ensures estimation efficiency at the Gaussian and non-Gaussian probability distributions, including heavy-tailed distributions. The proposed RDMD is statistically robust because the outliers in the data set are flagged via projection statistics and suppressed using a Schweppe-type Huber generalized maximum-likelihood estimator that minimizes a convex Huber cost function. The latter is solved using the iteratively reweighted least-squares algorithm that is known to exhibit a better convergence property and numerical stability than the Newton algorithms. Several numerical simulations using canonical models of dynamical systems demonstrate the excellent performance of the proposed RDMD method. The results reveal that it outperforms several other methods proposed in the literature. △ Less

Submitted 11 October, 2021; v1 submitted 20 May, 2021; originally announced May 2021.

Roles of Dynamic State Estimation in Power System Modeling, Monitoring and Operation

Authors: Junbo Zhao, Marcos Netto, Zhenyu Huang, Samson Shenglong Yu, Antonio Gomez-Exposito, Shaobu Wang, Innocent Kamwa, Shahrokh Akhlaghi, Lamine Mili, Vladimir Terzija, A. P. Sakis Meliopoulos, Bikash Pal, Abhinav Kumar Singh, Ali Abur, Tianshu Bi, Alireza Rouhani

Abstract: Power system dynamic state estimation (DSE) remains an active research area. This is driven by the absence of accurate models, the increasing availability of fast-sampled, time-synchronized measurements, and the advances in the capability, scalability, and affordability of computing and communications. This paper discusses the advantages of DSE as compared to static state estimation, and the imple… ▽ More Power system dynamic state estimation (DSE) remains an active research area. This is driven by the absence of accurate models, the increasing availability of fast-sampled, time-synchronized measurements, and the advances in the capability, scalability, and affordability of computing and communications. This paper discusses the advantages of DSE as compared to static state estimation, and the implementation differences between the two, including the measurement configuration, modeling framework and support software features. The important roles of DSE are discussed from modeling, monitoring and operation aspects for today's synchronous machine dominated systems and the future power electronics-interfaced generation systems. Several examples are presented to demonstrate the benefits of DSE on enhancing the operational robustness and resilience of 21st century power system through time critical applications. Future research directions are identified and discussed, paving the way for develo** the next generation of energy management systems. △ Less

Submitted 11 May, 2020; originally announced May 2020.

Comments: 9 pages, 6 figures

Probabilistic Load-Margin Assessment using Vine Copula and Gaussian Process Emulation

Authors: Yijun Xu, Kiran Karra, Lamine Mili, Mert Korkali, Xiao Chen, Zhixiong Hu

Abstract: The increasing penetration of renewable energy along with the variations of the loads bring large uncertainties in the power system states that are threatening the security of power system planning and operation. Facing these challenges, this paper proposes a cost-effective, nonparametric method to quantify the impact of uncertain power injections on the load margins. First, we propose to generate… ▽ More The increasing penetration of renewable energy along with the variations of the loads bring large uncertainties in the power system states that are threatening the security of power system planning and operation. Facing these challenges, this paper proposes a cost-effective, nonparametric method to quantify the impact of uncertain power injections on the load margins. First, we propose to generate system uncertain inputs via a novel vine copula due to its capability in simulating complex multivariate highly dependent model inputs. Furthermore, to reduce the prohibitive computational time required in the traditional Monte-Carlo method, we propose to use a nonparametric, Gaussian-process-emulator-based reduced-order model to replace the original complicated continuation power-flow model. This emulator allows us to execute the time-consuming continuation power-flow solver at the sampled values with a negligible computational cost. The simulations conducted on the IEEE 57-bus system, to which correlated renewable generation are attached, reveal the excellent performance of the proposed method. △ Less

Submitted 13 April, 2020; originally announced April 2020.

Uncertainty Quantification in Stochastic Economic Dispatch using Gaussian Process Emulation

Authors: Zhixiong Hu, Yijun Xu, Mert Korkali, Xiao Chen, Lamine Mili, Charles H. Tong

Abstract: The increasing penetration of renewable energy resources in power systems, represented as random processes, converts the traditional deterministic economic dispatch problem into a stochastic one. To solve this stochastic economic dispatch, the conventional Monte Carlo method is prohibitively time consuming for medium- and large-scale power systems. To overcome this problem, we propose in this pape… ▽ More The increasing penetration of renewable energy resources in power systems, represented as random processes, converts the traditional deterministic economic dispatch problem into a stochastic one. To solve this stochastic economic dispatch, the conventional Monte Carlo method is prohibitively time consuming for medium- and large-scale power systems. To overcome this problem, we propose in this paper a novel Gaussian-process-emulator-based approach to quantify the uncertainty in the stochastic economic dispatch considering wind power penetration. Based on the dimension-reduction results obtained by the Karhunen-Loève expansion, a Gaussian-process emulator is constructed. This surrogate allows us to evaluate the economic dispatch solver at sampled values with a negligible computational cost while maintaining a desirable accuracy. Simulation results conducted on the IEEE 118-bus system reveal that the proposed method has an excellent performance as compared to the traditional Monte Carlo method. △ Less

Submitted 19 September, 2019; originally announced September 2019.

On the Effect of Suboptimal Estimation of Mutual Information in Feature Selection and Classification

Authors: Kiran Karra, Lamine Mili

Abstract: This paper introduces a new property of estimators of the strength of statistical association, which helps characterize how well an estimator will perform in scenarios where dependencies between continuous and discrete random variables need to be rank ordered. The new property, termed the estimator response curve, is easily computable and provides a marginal distribution agnostic way to assess an… ▽ More This paper introduces a new property of estimators of the strength of statistical association, which helps characterize how well an estimator will perform in scenarios where dependencies between continuous and discrete random variables need to be rank ordered. The new property, termed the estimator response curve, is easily computable and provides a marginal distribution agnostic way to assess an estimator's performance. It overcomes notable drawbacks of current metrics of assessment, including statistical power, bias, and consistency. We utilize the estimator response curve to test various measures of the strength of association that satisfy the data processing inequality (DPI), and show that the CIM estimator's performance compares favorably to kNN, vME, AP, and H_{MI} estimators of mutual information. The estimators which were identified to be suboptimal, according to the estimator response curve, perform worse than the more optimal estimators when tested with real-world data from four different areas of science, all with varying dimensionalities and sizes. △ Less

Submitted 9 January, 2021; v1 submitted 29 April, 2018; originally announced April 2018.

Copula Index for Detecting Dependence and Monotonicity between Stochastic Signals

Authors: Kiran Karra, Lamine Mili

Abstract: This paper introduces a nonparametric copula-based index for detecting the strength and monotonicity structure of linear and nonlinear statistical dependence between pairs of random variables or stochastic signals. Our index, termed Copula Index for Detecting Dependence and Monotonicity (CIM), satisfies several desirable properties of measures of association, including Renyi's properties, the data… ▽ More This paper introduces a nonparametric copula-based index for detecting the strength and monotonicity structure of linear and nonlinear statistical dependence between pairs of random variables or stochastic signals. Our index, termed Copula Index for Detecting Dependence and Monotonicity (CIM), satisfies several desirable properties of measures of association, including Renyi's properties, the data processing inequality (DPI), and consequently self-equitability. Synthetic data simulations reveal that the statistical power of CIM compares favorably to other state-of-the-art measures of association that are proven to satisfy the DPI. Simulation results with real-world data reveal the CIM's unique ability to detect the monotonicity structure among stochastic signals to find interesting dependencies in large datasets. Additionally, simulations show that the CIM shows favorable performance to estimators of mutual information when discovering Markov network structure. △ Less

Submitted 6 October, 2018; v1 submitted 20 March, 2017; originally announced March 2017.

Comments: Keywords: copula, statistical dependency, monotonic, equitability, discrete 40 pages