Showing 1–17 of 17 results for author: Dehghanpour, K

Mitigating Smart Meter Asynchrony Error Via Multi-Objective Low Rank Matrix Recovery

Authors: Yuxuan Yuan, Kaveh Dehghanpour, Zhaoyu Wang

Abstract: Smart meters (SMs) are being widely deployed by distribution utilities across the U.S. Despite their benefits in real-time monitoring. SMs suffer from certain data quality issues; specifically, unlike phasor measurement units (PMUs) that use GPS for data synchronization, SMs are not perfectly synchronized. The asynchrony error can degrade the monitoring accuracy in distribution networks. To addres… ▽ More Smart meters (SMs) are being widely deployed by distribution utilities across the U.S. Despite their benefits in real-time monitoring. SMs suffer from certain data quality issues; specifically, unlike phasor measurement units (PMUs) that use GPS for data synchronization, SMs are not perfectly synchronized. The asynchrony error can degrade the monitoring accuracy in distribution networks. To address this challenge, we propose a principal component pursuit (PCP)-based data recovery strategy. Since asynchrony results in a loss of temporal correlation among SMs, the key idea in our solution is to leverage a PCP-based low rank matrix recovery technique to maximize the temporal correlation between multiple data streams obtained from SMs. Further, our approach has a novel multi-objective structure, which allows utilities to precisely refine and recover all SM-measured variables, including voltage and power measurements, while incorporating their inherent dependencies through power flow equations. We have performed numerical experiments using real SM data to demonstrate the effectiveness of the proposed strategy in mitigating the impact of SM asynchrony on distribution grid monitoring. △ Less

Submitted 11 May, 2021; originally announced May 2021.

A Hierarchical Deep Actor-Critic Learning Method for Joint Distribution System State Estimation

Authors: Yuxuan Yuan, Kaveh Dehghanpour, Zhaoyu Wang, Fankun Bu

Abstract: Due to increasing penetration of volatile distributed photovoltaic (PV) resources, real-time monitoring of customers at the grid-edge has become a critical task. However, this requires solving the distribution system state estimation (DSSE) jointly for both primary and secondary levels of distribution grids, which is computationally complex and lacks scalability to large systems. To achieve near r… ▽ More Due to increasing penetration of volatile distributed photovoltaic (PV) resources, real-time monitoring of customers at the grid-edge has become a critical task. However, this requires solving the distribution system state estimation (DSSE) jointly for both primary and secondary levels of distribution grids, which is computationally complex and lacks scalability to large systems. To achieve near real-time solutions for DSSE, we present a novel hierarchical reinforcement learning-aided framework: at the first layer, a weighted least squares (WLS) algorithm solves the DSSE over primary medium-voltage feeders; at the second layer, deep actor-critic (A-C) modules are trained for each secondary transformer using measurement residuals to estimate the states of low-voltage circuits and capture the impact of PVs at the grid-edge. While the A-C parameter learning process takes place offline, the trained A-C modules are deployed online for fast secondary grid state estimation; this is the key factor in scalability and computational efficiency of the framework. To maintain monitoring accuracy, the two levels exchange boundary information with each other at the secondary nodes, including transformer voltages (first layer to second layer) and active/reactive total power injection (second layer to first layer). This interactive information passing strategy results in a closed-loop structure that is able to track optimal solutions at both layers in few iterations. Moreover, our model can handle the topology changes using the Jacobian matrices of the first layer. We have performed numerical experiments using real utility data and feeder models to verify the performance of the proposed framework. △ Less

Submitted 4 December, 2020; originally announced December 2020.

Multi-Source Data Fusion Outage Location in Distribution Systems via Probabilistic Graph Models

Authors: Yuxuan Yuan, Kaveh Dehghanpour, Zhaoyu Wang, Fankun Bu

Abstract: Efficient outage location is critical to enhancing the resilience of power distribution systems. However, accurate outage location requires combining massive evidence received from diverse data sources, including smart meter (SM) last gasp signals, customer trouble calls, social media messages, weather data, vegetation information, and physical parameters of the network. This is a computationally… ▽ More Efficient outage location is critical to enhancing the resilience of power distribution systems. However, accurate outage location requires combining massive evidence received from diverse data sources, including smart meter (SM) last gasp signals, customer trouble calls, social media messages, weather data, vegetation information, and physical parameters of the network. This is a computationally complex task due to the high dimensionality of data in distribution grids. In this paper, we propose a multi-source data fusion approach to locate outage events in partially observable distribution systems using Bayesian networks (BNs). A novel aspect of the proposed approach is that it takes multi-source evidence and the complex structure of distribution systems into account using a probabilistic graphical method. Our method can radically reduce the computational complexity of outage location inference in high-dimensional spaces. The graphical structure of the proposed BN is established based on the network's topology and the causal relationship between random variables, such as the states of branches/customers and evidence. Utilizing this graphical model, accurate outage locations are obtained by leveraging a Gibbs sampling (GS) method, to infer the probabilities of de-energization for all branches. Compared with commonly-used exact inference methods that have exponential complexity in the size of the BN, GS quantifies the target conditional probability distributions in a timely manner. A case study of several real-world distribution systems is presented to validate the proposed method. △ Less

Submitted 8 May, 2021; v1 submitted 4 December, 2020; originally announced December 2020.

Enriching Load Data Using Micro-PMUs and Smart Meters

Authors: Fankun Bu, Kaveh Dehghanpour, Zhaoyu Wang

Abstract: In modern distribution systems, load uncertainty can be fully captured by micro-PMUs, which can record high-resolution data; however, in practice, micro-PMUs are installed at limited locations in distribution networks due to budgetary constraints. In contrast, smart meters are widely deployed but can only measure relatively low-resolution energy consumption, which cannot sufficiently reflect the a… ▽ More In modern distribution systems, load uncertainty can be fully captured by micro-PMUs, which can record high-resolution data; however, in practice, micro-PMUs are installed at limited locations in distribution networks due to budgetary constraints. In contrast, smart meters are widely deployed but can only measure relatively low-resolution energy consumption, which cannot sufficiently reflect the actual instantaneous load volatility within each sampling interval. In this paper, we have proposed a novel approach for enriching load data for service transformers that only have low-resolution smart meters. The key to our approach is to statistically recover the high-resolution load data, which is masked by the low-resolution data, using trained probabilistic models of service transformers that have both high and low-resolution data sources, i.e, micro-PMUs and smart meters. The overall framework consists of two steps: first, for the transformers with micro-PMUs, a Gaussian Process is leveraged to capture the relationship between the maximum/minimum load and average load within each low-resolution sampling interval of smart meters; a Markov chain model is employed to characterize the transition probability of known high-resolution load. Next, the trained models are used as teachers for the transformers with only smart meters to decompose known low-resolution load data into targeted high-resolution load data. The enriched data can recover instantaneous load uncertainty and significantly enhance distribution system observability and situational awareness. We have verified the proposed approach using real high- and low-resolution load data. △ Less

Submitted 28 November, 2020; originally announced November 2020.

Disaggregating Customer-level Behind-the-Meter PV Generation Using Smart Meter Data and Solar Exemplars

Authors: Fankun Bu, Kaveh Dehghanpour, Yuxuan Yuan, Zhaoyu Wang, Yifei Guo

Abstract: Customer-level rooftop photovoltaic (PV) has been widely integrated into distribution systems. In most cases, PVs are installed behind-the-meter (BTM), and only the net demand is recorded. Therefore, the native demand and PV generation are unknown to utilities. Separating native demand and solar generation from net demand is critical for improving grid-edge observability. In this paper, a novel ap… ▽ More Customer-level rooftop photovoltaic (PV) has been widely integrated into distribution systems. In most cases, PVs are installed behind-the-meter (BTM), and only the net demand is recorded. Therefore, the native demand and PV generation are unknown to utilities. Separating native demand and solar generation from net demand is critical for improving grid-edge observability. In this paper, a novel approach is proposed for disaggregating customer-level BTM PV generation using low-resolution but widely available hourly smart meter data. The proposed approach exploits the strong correlation between monthly nocturnal and diurnal native demands and the high similarity among PV generation profiles. First, a joint probability density function (PDF) of monthly nocturnal and diurnal native demands is constructed for customers without PVs, using Gaussian mixture modeling (GMM). Deviation from the constructed PDF is utilized to probabilistically assess the monthly solar generation of customers with PVs. Then, to identify hourly BTM solar generation for these customers, their estimated monthly solar generation is decomposed into an hourly timescale; to do this, we have proposed a maximum likelihood estimation (MLE)-based technique that utilizes hourly typical solar exemplars. Leveraging the strong monthly native demand correlation and high PV generation similarity enhances our approach's robustness against the volatility of customers' hourly load and enables highly accurate disaggregation. The proposed approach has been verified using real native demand and PV generation data. △ Less

Submitted 18 April, 2021; v1 submitted 1 September, 2020; originally announced September 2020.

Learning-Based Real-Time Event Identification Using Rich Real PMU Data

Authors: Yuxuan Yuan, Yifei Guo, Kaveh Dehghanpour, Zhaoyu Wang, Yanchao Wang

Abstract: A large-scale deployment of phasor measurement units (PMUs) that reveal the inherent physical laws of power systems from a data perspective enables an enhanced awareness of power system operation. However, the high-granularity and non-stationary nature of PMU time series and imperfect data quality could bring great technical challenges to real-time system event identification. To address these iss… ▽ More A large-scale deployment of phasor measurement units (PMUs) that reveal the inherent physical laws of power systems from a data perspective enables an enhanced awareness of power system operation. However, the high-granularity and non-stationary nature of PMU time series and imperfect data quality could bring great technical challenges to real-time system event identification. To address these issues, this paper proposes a two-stage learning-based framework. At the first stage, a Markov transition field (MTF) algorithm is exploited to extract the latent data features by encoding temporal dependency and transition statistics of PMU data in graphs. Then, a spatial pyramid pooling (SPP)-aided convolutional neural network (CNN) is established to efficiently and accurately identify operation events. The proposed method fully builds on and is also tested on a large real dataset from several tens of PMU sources (and the corresponding event logs), located across the U.S., with a time span of two consecutive years. The numerical results validate that our method has high identification accuracy while showing good robustness against poor data quality. △ Less

Submitted 17 June, 2020; originally announced June 2020.

Outage Detection in Partially Observable Distribution Systems using Smart Meters and Generative Adversarial Networks

Authors: Yuxuan Yuan, Kaveh Dehghanpour, Fankun Bu, Zhaoyu Wang

Abstract: In this paper, we present a novel data-driven approach to detect outage events in partially observable distribution systems by capturing the changes in smart meters' (SMs) data distribution. To achieve this, first, a breadth-first search (BFS)-based mechanism is proposed to decompose the network into a set of zones that maximize outage location information in partially observable systems. Then, us… ▽ More In this paper, we present a novel data-driven approach to detect outage events in partially observable distribution systems by capturing the changes in smart meters' (SMs) data distribution. To achieve this, first, a breadth-first search (BFS)-based mechanism is proposed to decompose the network into a set of zones that maximize outage location information in partially observable systems. Then, using SM data in each zone, a generative adversarial network (GAN) is designed to implicitly extract the temporal-spatial behavior in normal conditions in an unsupervised fashion. After training, an anomaly scoring technique is leveraged to determine if real-time measurements indicate an outage event in the zone. Finally, to infer the location of the outage events in a multi-zone network, a zone coordination process is proposed to take into account the interdependencies of intersecting zones. We have provided analytical guarantees of performance for our algorithm using the concept of entropy, which is leveraged to quantify outage location information in multi-zone grids. The proposed method has been tested and verified on distribution feeder models with real SM data. △ Less

Submitted 10 December, 2019; originally announced December 2019.

Statistical Modeling of Networked Solar Resources for Assessing and Mitigating Risk of Interdependent Inverter Trip** Events in Distribution Grids

Authors: Kaveh Dehghanpour, Yuxuan Yuan, Fankun Bu, Zhaoyu Wang

Abstract: It is speculated that higher penetration of inverter-based distributed photo-voltaic (PV) power generators can increase the risk of trip** events due to voltage fluctuations. To quantify this risk utilities need to solve the interactive equations of trip** events for networked PVs in real-time. However, these equations are non-differentiable, nonlinear, and exponentially complex, and thus, can… ▽ More It is speculated that higher penetration of inverter-based distributed photo-voltaic (PV) power generators can increase the risk of trip** events due to voltage fluctuations. To quantify this risk utilities need to solve the interactive equations of trip** events for networked PVs in real-time. However, these equations are non-differentiable, nonlinear, and exponentially complex, and thus, cannot be used as a tractable basis for solar curtailment prediction and mitigation. Furthermore, load/PV power values might not be available in real-time due to limited grid observability, which further complicates trip** event prediction. To address these challenges, we have employed Chebyshev's inequality to obtain an alternative probabilistic model for quantifying the risk of trip** for networked PVs. The proposed model enables operators to estimate the probability of interdependent inverter trip** events using only PV/load statistics and in a scalable manner. Furthermore, by integrating this probabilistic model into an optimization framework, countermeasures are designed to mitigate massive interdependent trip** events. Since the proposed model is parameterized using only the statistical characteristics of nodal active/reactive powers, it is especially beneficial in practical systems, which have limited real-time observability. Numerical experiments have been performed employing real data and feeder models to verify the performance of the proposed technique. △ Less

Submitted 27 January, 2020; v1 submitted 3 August, 2019; originally announced August 2019.

A Data-Driven Game-Theoretic Approach for Behind-the-Meter PV Generation Disaggregation

Authors: Fankun Bu, Kaveh Dehghanpour, Yuxuan Yuan, Zhaoyu Wang, Yingchen Zhang

Abstract: Rooftop solar photovoltaic (PV) power generator is a widely used distributed energy resource (DER) in distribution systems. Currently, the majority of PVs are installed behind-the-meter (BTM), where only customers' net demand is recorded by smart meters. Disaggregating BTM PV generation from net demand is critical to utilities for enhancing grid-edge observability. In this paper, a data-driven app… ▽ More Rooftop solar photovoltaic (PV) power generator is a widely used distributed energy resource (DER) in distribution systems. Currently, the majority of PVs are installed behind-the-meter (BTM), where only customers' net demand is recorded by smart meters. Disaggregating BTM PV generation from net demand is critical to utilities for enhancing grid-edge observability. In this paper, a data-driven approach is proposed for BTM PV generation disaggregation using solar and demand exemplars. First, a data clustering procedure is developed to construct a library of candidate load/solar exemplars. To handle the volatility of BTM resources, a novel game-theoretic learning process is proposed to adaptively generate optimal composite exemplars using the constructed library of candidate exemplars, through repeated evaluation of disaggregation residuals. Finally, the composite native demand and solar exemplars are employed to disaggregate solar generation from net demand using a semi-supervised source separator. The proposed methodology has been verified using real smart meter data and feeder models. △ Less

Submitted 29 January, 2020; v1 submitted 15 July, 2019; originally announced July 2019.

Multi-Agent Safe Policy Learning for Power Management of Networked Microgrids

Authors: Qianzhi Zhang, Kaveh Dehghanpour, Zhaoyu Wang, Feng Qiu, Dongbo Zhao

Abstract: This paper presents a supervised multi-agent safe policy learning (SMAS-PL) method for optimal power management of networked microgrids (MGs) in distribution systems. While conventional reinforcement learning (RL) algorithms are black-box decision models that could fail to satisfy grid operational constraints, our proposed method is constrained by AC power flow equations and other operational limi… ▽ More This paper presents a supervised multi-agent safe policy learning (SMAS-PL) method for optimal power management of networked microgrids (MGs) in distribution systems. While conventional reinforcement learning (RL) algorithms are black-box decision models that could fail to satisfy grid operational constraints, our proposed method is constrained by AC power flow equations and other operational limits. Accordingly, the training process employs the gradient information of operational constraints to ensure that the optimal control policy functions generate safe and feasible decisions. Furthermore, we have developed a distributed consensus-based optimization approach to train the agents' policy functions while maintaining MGs' privacy and data ownership boundaries. After training, the learned optimal policy functions can be safely used by the MGs to dispatch their local resources, without the need to solve a complex optimization problem from scratch. Numerical experiments have been devised to verify the performance of the proposed method. △ Less

Submitted 27 October, 2020; v1 submitted 3 July, 2019; originally announced July 2019.

A Time-Series Distribution Test System Based on Real Utility Data

Authors: Fankun Bu, Yuxuan Yuan, Zhaoyu Wang, Kaveh Dehghanpour, Anne Kimber

Abstract: In this paper, we provide a time-series distribution test system. This test system is a fully observable distribution grid in Midwest U.S. with smart meters (SM) installed at all end users. Our goal is to share a real U.S. distribution grid model without modification. This grid model is comprehensive and representative since it consists of both overhead lines and underground cables, and it has sta… ▽ More In this paper, we provide a time-series distribution test system. This test system is a fully observable distribution grid in Midwest U.S. with smart meters (SM) installed at all end users. Our goal is to share a real U.S. distribution grid model without modification. This grid model is comprehensive and representative since it consists of both overhead lines and underground cables, and it has standard distribution grid components such as capacitor banks, line switches, substation transformers with load tap changer and secondary distribution transformers. An important uniqueness of this grid model is it has one-year smart meter measurements at all nodes, thus bridging the gap between existing test feeders and quasi-static time-series based distribution system analysis. △ Less

Submitted 29 January, 2020; v1 submitted 10 June, 2019; originally announced June 2019.

A Data-Driven Customer Segmentation Strategy Based on Contribution to System Peak Demand

Authors: Yuxuan Yuan, Kaveh Dehghanpour, Fankun Bu, Zhaoyu Wang

Abstract: Advanced metering infrastructure (AMI) enables utilities to obtain granular energy consumption data, which offers a unique opportunity to design customer segmentation strategies based on their impact on various operational metrics in distribution grids. However, performing utility-scale segmentation for unobservable customers with only monthly billing information, remains a challenging problem. To… ▽ More Advanced metering infrastructure (AMI) enables utilities to obtain granular energy consumption data, which offers a unique opportunity to design customer segmentation strategies based on their impact on various operational metrics in distribution grids. However, performing utility-scale segmentation for unobservable customers with only monthly billing information, remains a challenging problem. To address this challenge, we propose a new metric, the coincident monthly peak contribution (CMPC), that quantifies the contribution of individual customers to system peak demand. Furthermore, a novel multi-state machine learning-based segmentation method is developed that estimates CMPC for customers without smart meters (SMs): first, a clustering technique is used to build a databank containing typical daily load patterns in different seasons using the SM data of observable customers. Next, to associate unobservable customers with the discovered typical load profiles, a classification approach is leveraged to compute the likelihood of daily consumption patterns for different unobservable households. In the third stage, a weighted clusterwise regression (WCR) model is utilized to estimate the CMPC of unobservable customers using their monthly billing data and the outcomes of the classification module. The proposed segmentation methodology has been tested and verified using real utility data. △ Less

Submitted 8 March, 2020; v1 submitted 26 October, 2018; originally announced November 2018.

A Data-Driven Framework for Assessing Cold Load Pick-up Demand in Service Restoration

Authors: Fankun Bu, Kaveh Dehghanpour, Zhaoyu Wang, Yuxuan Yuan

Abstract: Cold load pick-up (CLPU) has been a critical concern to utilities. Researchers and industry practitioners have underlined the impact of CLPU on distribution system design and service restoration. The recent large-scale deployment of smart meters has provided the industry with a huge amount of data that is highly granular, both temporally and spatially. In this paper, a data-driven framework is pro… ▽ More Cold load pick-up (CLPU) has been a critical concern to utilities. Researchers and industry practitioners have underlined the impact of CLPU on distribution system design and service restoration. The recent large-scale deployment of smart meters has provided the industry with a huge amount of data that is highly granular, both temporally and spatially. In this paper, a data-driven framework is proposed for assessing CLPU demand of residential customers using smart meter data. The proposed framework consists of two interconnected layers: 1) At the feeder level, a nonlinear auto-regression model is applied to estimate the diversified demand during the system restoration and calculate the CLPU demand ratio. 2) At the customer level, Gaussian Mixture Models (GMM) and probabilistic reasoning are used to quantify the CLPU demand increase. The proposed methodology has been verified using real smart meter data and outage cases. △ Less

Submitted 3 July, 2019; v1 submitted 11 October, 2018; originally announced October 2018.

A Learning-based Power Management for Networked Microgrids Under Incomplete Information

Authors: Qianzhi Zhang, Kaveh Dehghanpour, Zhaoyu Wang, Qiuhua Huang

Abstract: This paper presents an approximate Reinforcement Learning (RL) methodology for bi-level power management of networked Microgrids (MG) in electric distribution systems. In practice, the cooperative agent can have limited or no knowledge of the MG asset behavior and detailed models behind the Point of Common Coupling (PCC). This makes the distribution systems unobservable and impedes conventional op… ▽ More This paper presents an approximate Reinforcement Learning (RL) methodology for bi-level power management of networked Microgrids (MG) in electric distribution systems. In practice, the cooperative agent can have limited or no knowledge of the MG asset behavior and detailed models behind the Point of Common Coupling (PCC). This makes the distribution systems unobservable and impedes conventional optimization solutions for the constrained MG power management problem. To tackle this challenge, we have proposed a bi-level RL framework in a price-based environment. At the higher level, a cooperative agent performs function approximation to predict the behavior of entities under incomplete information of MG parametric models; while at the lower level, each MG provides power-flow-constrained optimal response to price signals. The function approximation scheme is then used within an adaptive RL framework to optimize the price signal as the system load and solar generation change over time. Numerical experiments have verified that, compared to previous works in the literature, the proposed privacy-preserving learning model has better adaptability and enhanced computational speed. △ Less

Submitted 13 June, 2019; v1 submitted 1 October, 2018; originally announced October 2018.

A Survey on State Estimation Techniques and Challenges in Smart Distribution Systems

Authors: Kaveh Dehghanpour, Zhaoyu Wang, Jianhui Wang, Yuxuan Yuan, Fankun Bu

Abstract: This paper presents a review of the literature on State Estimation (SE) in power systems. While covering some works related to SE in transmission systems, the main focus of this paper is Distribution System State Estimation (DSSE). The paper discusses a few critical topics of DSSE, including mathematical problem formulation, application of pseudo-measurements, metering instrument placement, networ… ▽ More This paper presents a review of the literature on State Estimation (SE) in power systems. While covering some works related to SE in transmission systems, the main focus of this paper is Distribution System State Estimation (DSSE). The paper discusses a few critical topics of DSSE, including mathematical problem formulation, application of pseudo-measurements, metering instrument placement, network topology issues, impacts of renewable penetration, and cyber-security. Both conventional and modern data-driven and probabilistic techniques have been reviewed. This paper can provide researchers and utility engineers with insights into the technical achievements, barriers, and future research directions of DSSE. △ Less

Submitted 20 September, 2018; v1 submitted 31 August, 2018; originally announced September 2018.

A Game-Theoretic Data-Driven Approach for Pseudo-Measurement Generation in Distribution System State Estimation

Authors: Kaveh Dehghanpour, Yuxuan Yuan, Zhaoyu Wang, Fankun Bu

Abstract: In this paper, we present an efficient computational framework with the purpose of generating weighted pseudo-measurements to improve the quality of Distribution System State Estimation (DSSE) and provide observability with Advanced Metering Infrastructure (AMI) against unobservable customers and missing data. The proposed technique is based on a game-theoretic expansion of Relevance Vector Machin… ▽ More In this paper, we present an efficient computational framework with the purpose of generating weighted pseudo-measurements to improve the quality of Distribution System State Estimation (DSSE) and provide observability with Advanced Metering Infrastructure (AMI) against unobservable customers and missing data. The proposed technique is based on a game-theoretic expansion of Relevance Vector Machines (RVM). This platform is able to estimate the customer power consumption data and quantify its uncertainty while reducing the prohibitive computational burden of model training for large AMI datasets. To achieve this objective, the large training set is decomposed and distributed among multiple parallel learning entities. The resulting estimations from the parallel RVMs are then combined using a game-theoretic model based on the idea of repeated games with vector payoff. It is observed that through this approach and by exploiting the seasonal changes in customers' behavior the accuracy of pseudo-measurements can be considerably improved, while introducing robustness against bad training data samples. The proposed pseudo-measurement generation model is integrated into a DSSE using a closed-loop information system, which takes advantage of a Branch Current State Estimator (BCSE) data to further improve the performance of the designed machine learning framework. This method has been tested on a practical distribution feeder model with smart meter data for verification. △ Less

Submitted 31 August, 2018; originally announced September 2018.

A Multi-Timescale Data-Driven Approach to Enhance Distribution System Observability

Authors: Yuxuan Yuan, Kaveh Dehghanpour, Fankun Bu, Zhaoyu Wang

Abstract: This paper presents a novel data-driven method that determines the daily consumption patterns of customers without smart meters (SMs) to enhance the observability of distribution systems. Using the proposed method, the daily consumption of unobserved customers is extracted from their monthly billing data based on three machine learning models: first, a spectral clustering (SC) algorithm is used to… ▽ More This paper presents a novel data-driven method that determines the daily consumption patterns of customers without smart meters (SMs) to enhance the observability of distribution systems. Using the proposed method, the daily consumption of unobserved customers is extracted from their monthly billing data based on three machine learning models: first, a spectral clustering (SC) algorithm is used to infer the typical daily load profiles of customers with SMs. Each typical daily load behavior represents a distinct class of customer behavior. In the second module, a multi-timescale learning (MTSL) model is trained to estimate the hourly consumption using monthly energy data for the customers of each class. The third stage leverages a recursive Bayesian learning (RBL) method and branch current state estimation (BCSE) residuals to estimate the daily load profiles of unobserved customers without SMs. The proposed data-driven method has been tested and verified using real utility data. △ Less

Submitted 31 August, 2018; originally announced September 2018.