-
Misaka: Interactive Swarm Testbed for Smart Grid Distributed Algorithm Test and Evaluation
Authors:
Tingliang Zhang,
Haiwang Zhong,
Zhenfei Tan,
Xinfei Yan
Abstract:
In this paper, we present Misaka, a visualized swarm testbed for smart grid algorithm evaluation, also an extendable open-source open-hardware platform for develo** tabletop tangible swarm interfaces. The platform consists of a collection of custom-designed 3 omni-directional wheels robots each 10 cm in diameter, high accuracy localization through a microdot pattern overlaid on top of the activi…
▽ More
In this paper, we present Misaka, a visualized swarm testbed for smart grid algorithm evaluation, also an extendable open-source open-hardware platform for develo** tabletop tangible swarm interfaces. The platform consists of a collection of custom-designed 3 omni-directional wheels robots each 10 cm in diameter, high accuracy localization through a microdot pattern overlaid on top of the activity sheets, and a software framework for application development and control, while remaining affordable (per unit cost about 30 USD at the prototype stage). We illustrate the potential of tabletop swarm user interfaces through a set of smart grid algorithm application scenarios developed with Misaka.
△ Less
Submitted 25 April, 2024;
originally announced April 2024.
-
Deep RAW Image Super-Resolution. A NTIRE 2024 Challenge Survey
Authors:
Marcos V. Conde,
Florin-Alexandru Vasluianu,
Radu Timofte,
Jianxing Zhang,
Jia Li,
Fan Wang,
Xiaopeng Li,
Zikun Liu,
Hyunhee Park,
Sejun Song,
Changho Kim,
Zhijuan Huang,
Hongyuan Yu,
Cheng Wan,
Wending Xiang,
Jiamin Lin,
Hang Zhong,
Qiaosong Zhang,
Yue Sun,
Xuanwu Yin,
Kunlong Zuo,
Senyan Xu,
Siyuan Jiang,
Zhi**g Sun,
Jiaying Zhu
, et al. (10 additional authors not shown)
Abstract:
This paper reviews the NTIRE 2024 RAW Image Super-Resolution Challenge, highlighting the proposed solutions and results. New methods for RAW Super-Resolution could be essential in modern Image Signal Processing (ISP) pipelines, however, this problem is not as explored as in the RGB domain. Th goal of this challenge is to upscale RAW Bayer images by 2x, considering unknown degradations such as nois…
▽ More
This paper reviews the NTIRE 2024 RAW Image Super-Resolution Challenge, highlighting the proposed solutions and results. New methods for RAW Super-Resolution could be essential in modern Image Signal Processing (ISP) pipelines, however, this problem is not as explored as in the RGB domain. Th goal of this challenge is to upscale RAW Bayer images by 2x, considering unknown degradations such as noise and blur. In the challenge, a total of 230 participants registered, and 45 submitted results during thee challenge period. The performance of the top-5 submissions is reviewed and provided here as a gauge for the current state-of-the-art in RAW Image Super-Resolution.
△ Less
Submitted 24 April, 2024;
originally announced April 2024.
-
Network-Constrained Unit Commitment with Flexible Temporal Resolution
Authors:
Zekuan Yu,
Haiwang Zhong,
Guangchun Ruan,
Xinfei Yan
Abstract:
Modern network-constrained unit commitment (NCUC) bears a heavy computational burden due to the ever-growing model scale. This situation becomes more challenging when detailed operational characteristics, complicated constraints, and multiple objectives are considered. We propose a novel simplification method to determine the flexible temporal resolution for acceleration and near-optimal solutions…
▽ More
Modern network-constrained unit commitment (NCUC) bears a heavy computational burden due to the ever-growing model scale. This situation becomes more challenging when detailed operational characteristics, complicated constraints, and multiple objectives are considered. We propose a novel simplification method to determine the flexible temporal resolution for acceleration and near-optimal solutions. The flexible temporal resolution is determined by analyzing the impact on generators in each adaptive time period with awareness of congestion effects. Additionally, multiple improvements are employed on the existing NCUC model compatible with flexible temporal resolution to reduce the number of integer variables while preserving the original features. A case study using the IEEE 118-bus and the Polish 2736-bus systems verifies that the proposed method achieves substantial acceleration with low cost variation and high accuracy.
△ Less
Submitted 8 April, 2024;
originally announced April 2024.
-
Eve Said Yes: AirBone Authentication for Head-Wearable Smart Voice Assistant
Authors:
Chenpei Huang,
Hui Zhong,
Jie Lian,
Pavana Prakash,
Dian Shi,
Yuan Xu,
Miao Pan
Abstract:
Recent advances in machine learning and natural language processing have fostered the enormous prosperity of smart voice assistants and their services, e.g., Alexa, Google Home, Siri, etc. However, voice spoofing attacks are deemed to be one of the major challenges of voice control security, and never stop evolving such as deep-learning-based voice conversion and speech synthesis techniques. To so…
▽ More
Recent advances in machine learning and natural language processing have fostered the enormous prosperity of smart voice assistants and their services, e.g., Alexa, Google Home, Siri, etc. However, voice spoofing attacks are deemed to be one of the major challenges of voice control security, and never stop evolving such as deep-learning-based voice conversion and speech synthesis techniques. To solve this problem outside the acoustic domain, we focus on head-wearable devices, such as earbuds and virtual reality (VR) headsets, which are feasible to continuously monitor the bone-conducted voice in the vibration domain. Specifically, we identify that air and bone conduction (AC/BC) from the same vocalization are coupled (or concurrent) and user-level unique, which makes them suitable behavior and biometric factors for multi-factor authentication (MFA). The legitimate user can defeat acoustic domain and even cross-domain spoofing samples with the proposed two-stage AirBone authentication. The first stage answers \textit{whether air and bone conduction utterances are time domain consistent (TC)} and the second stage runs \textit{bone conduction speaker recognition (BC-SR)}. The security level is hence increased for two reasons: (1) current acoustic attacks on smart voice assistants cannot affect bone conduction, which is in the vibration domain; (2) even for advanced cross-domain attacks, the unique bone conduction features can detect adversary's impersonation and machine-induced vibration. Finally, AirBone authentication has good usability (the same level as voice authentication) compared with traditional MFA and those specially designed to enhance smart voice security. Our experimental results show that the proposed AirBone authentication is usable and secure, and can be easily equipped by commercial off-the-shelf head wearables with good user experience.
△ Less
Submitted 26 September, 2023;
originally announced September 2023.
-
A Projection-Based Approach for Distributed Energy Resources Aggregation
Authors:
Yiran Wang,
Haiwang Zhong,
Guangchun Ruan
Abstract:
Aggregating distributed energy resources (DERs) is of great significance to improve the overall operational efficiency of smart grid. The aggregation model needs to consider various factors such as network constraints, operational constraints, and economic characteristics of the DERs. This paper constructs a multi-slot DER aggregation model that considers the above factors using feasible region pr…
▽ More
Aggregating distributed energy resources (DERs) is of great significance to improve the overall operational efficiency of smart grid. The aggregation model needs to consider various factors such as network constraints, operational constraints, and economic characteristics of the DERs. This paper constructs a multi-slot DER aggregation model that considers the above factors using feasible region projection approach, which achieved the protection of DERs data information and the elimination of internal variables. A system economic dispatch (ED) model is established for the operators to make full use of the DER clusters. We calculate the feasible regions with temporal coupling by extending the Progressive Vertex Enumeration (PVE) algorithm to high dimension by the Quickhull algorithm. Finally, an IEEE 39-bus distribution network is simulated with DERs to verify the effectiveness of the proposed model. Results show that the two-step ED derives the same results as the centralized ED.
△ Less
Submitted 7 August, 2023;
originally announced August 2023.
-
T-UNet: Triplet UNet for Change Detection in High-Resolution Remote Sensing Images
Authors:
Huan Zhong,
Chen Wu
Abstract:
Remote sensing image change detection aims to identify the differences between images acquired at different times in the same area. It is widely used in land management, environmental monitoring, disaster assessment and other fields. Currently, most change detection methods are based on Siamese network structure or early fusion structure. Siamese structure focuses on extracting object features at…
▽ More
Remote sensing image change detection aims to identify the differences between images acquired at different times in the same area. It is widely used in land management, environmental monitoring, disaster assessment and other fields. Currently, most change detection methods are based on Siamese network structure or early fusion structure. Siamese structure focuses on extracting object features at different times but lacks attention to change information, which leads to false alarms and missed detections. Early fusion (EF) structure focuses on extracting features after the fusion of images of different phases but ignores the significance of object features at different times for detecting change details, making it difficult to accurately discern the edges of changed objects. To address these issues and obtain more accurate results, we propose a novel network, Triplet UNet(T-UNet), based on a three-branch encoder, which is capable to simultaneously extract the object features and the change features between the pre- and post-time-phase images through triplet encoder. To effectively interact and fuse the features extracted from the three branches of triplet encoder, we propose a multi-branch spatial-spectral cross-attention module (MBSSCA). In the decoder stage, we introduce the channel attention mechanism (CAM) and spatial attention mechanism (SAM) to fully mine and integrate detailed textures information at the shallow layer and semantic localization information at the deep layer.
△ Less
Submitted 4 August, 2023;
originally announced August 2023.
-
Life cycle economic viability analysis of battery storage in electricity market
Authors:
Yinguo Yang,
Yiling Ye,
Zhuoxiao Cheng,
Guangchun Ruan,
Qiuyu Lu,
Xuan Wang,
Haiwang Zhong
Abstract:
Battery storage is essential to enhance the flexibility and reliability of electric power systems by providing auxiliary services and load shifting. Storage owners typically gains incentives from quick responses to auxiliary service prices, but frequent charging and discharging also reduce its lifetime. Therefore, this paper embeds the battery degradation cost into the operation simulation to avoi…
▽ More
Battery storage is essential to enhance the flexibility and reliability of electric power systems by providing auxiliary services and load shifting. Storage owners typically gains incentives from quick responses to auxiliary service prices, but frequent charging and discharging also reduce its lifetime. Therefore, this paper embeds the battery degradation cost into the operation simulation to avoid overestimated profits caused by an aggressive bidding strategy. Based on an operation simulation model, this paper conducts the economic viability analysis of whole life cycle using the internal rate of return(IRR). A clustering method and a typical day method are developed to reduce the huge computational burdens in the life-cycle simulation of battery storage. Our models and algorithms are validated by the case study of two mainstream technology routes currently: lithium nickel cobalt manganese oxide (NCM) batteries and lithium iron phosphate (LFP) batteries. Then a sensitivity analysis is presented to identify the critical factors that boost battery storage in the future. We evaluate the IRR results of different types of battery storage to provide guidance for investment portfolio.
△ Less
Submitted 28 May, 2023; v1 submitted 24 May, 2023;
originally announced May 2023.
-
Real-time scheduling of renewable power systems through planning-based reinforcement learning
Authors:
Shaohuai Liu,
**bo Liu,
Weirui Ye,
Nan Yang,
Guanglun Zhang,
Haiwang Zhong,
Chongqing Kang,
Qirong Jiang,
Xuri Song,
Fangchun Di,
Yang Gao
Abstract:
The growing renewable energy sources have posed significant challenges to traditional power scheduling. It is difficult for operators to obtain accurate day-ahead forecasts of renewable generation, thereby requiring the future scheduling system to make real-time scheduling decisions aligning with ultra-short-term forecasts. Restricted by the computation speed, traditional optimization-based method…
▽ More
The growing renewable energy sources have posed significant challenges to traditional power scheduling. It is difficult for operators to obtain accurate day-ahead forecasts of renewable generation, thereby requiring the future scheduling system to make real-time scheduling decisions aligning with ultra-short-term forecasts. Restricted by the computation speed, traditional optimization-based methods can not solve this problem. Recent developments in reinforcement learning (RL) have demonstrated the potential to solve this challenge. However, the existing RL methods are inadequate in terms of constraint complexity, algorithm performance, and environment fidelity. We are the first to propose a systematic solution based on the state-of-the-art reinforcement learning algorithm and the real power grid environment. The proposed approach enables planning and finer time resolution adjustments of power generators, including unit commitment and economic dispatch, thus increasing the grid's ability to admit more renewable energy. The well-trained scheduling agent significantly reduces renewable curtailment and load shedding, which are issues arising from traditional scheduling's reliance on inaccurate day-ahead forecasts. High-frequency control decisions exploit the existing units' flexibility, reducing the power grid's dependence on hardware transformations and saving investment and operating costs, as demonstrated in experimental results. This research exhibits the potential of reinforcement learning in promoting low-carbon and intelligent power systems and represents a solid step toward sustainable electricity generation.
△ Less
Submitted 13 March, 2023; v1 submitted 9 March, 2023;
originally announced March 2023.
-
Look-Ahead AC Optimal Power Flow: A Model-Informed Reinforcement Learning Approach
Authors:
Xinyue Wang,
Haiwang Zhong,
Guanglun Zhang,
Guangchun Ruan,
Yiliu He,
Zekuan Yu
Abstract:
With the increasing proportion of renewable energy in the generation side, it becomes more difficult to accurately predict the power generation and adapt to the large deviations between the optimal dispatch scheme and the day-ahead scheduling in the process of real-time dispatch. Therefore, it is necessary to conduct look-ahead dispatches to revise the operation plan according to the real-time sta…
▽ More
With the increasing proportion of renewable energy in the generation side, it becomes more difficult to accurately predict the power generation and adapt to the large deviations between the optimal dispatch scheme and the day-ahead scheduling in the process of real-time dispatch. Therefore, it is necessary to conduct look-ahead dispatches to revise the operation plan according to the real-time status of the power grid and reliable ultra-short-term prediction. Application of traditional model-driven methods is often limited by the scale of the power system and cannot meet the computational time requirements of real-time dispatch. Data-driven methods can provide strong online decision-making support abilities when facing large-scale systems, while it is limited by the quantity and quality of the training dataset. This paper proposes a model-informed reinforcement learning approach for look-ahead AC optimal power flow. The reinforcement learning model is first formulated based on the domain knowledge of economic dispatch, and then the physics-informed neural network is constructed to enhance the reliability and efficiency. At last, the case study based on the SG 126-bus system validates the accuracy and efficiency of the proposed approach.
△ Less
Submitted 3 March, 2023;
originally announced March 2023.
-
Non-Iterative Solution for Coordinated Optimal Dispatch via Equivalent Projection-Part II: Method and Applications
Authors:
Zhenfei Tan,
Zheng Yan,
Haiwang Zhong,
Qing Xia
Abstract:
This two-part paper develops a non-iterative coordinated optimal dispatch framework, i.e., free of iterative information exchange, via the innovation of the equivalent projection (EP) theory. The EP eliminates internal variables from technical and economic operation constraints of the subsystem and obtains an equivalent model with reduced scale, which is the key to the non-iterative coordinated op…
▽ More
This two-part paper develops a non-iterative coordinated optimal dispatch framework, i.e., free of iterative information exchange, via the innovation of the equivalent projection (EP) theory. The EP eliminates internal variables from technical and economic operation constraints of the subsystem and obtains an equivalent model with reduced scale, which is the key to the non-iterative coordinated optimization. In Part II of this paper, a novel projection algorithm with the explicit error guarantee measured by the Hausdorff distance is proposed, which characterizes the EP model by the convex hull of its vertices. This algorithm is proven to yield a conservative approximation within the prespecified error tolerance and can obtain the exact EP model if the error tolerance is set to zero, which provides flexibility to balance the computation accuracy and effort. Applications of the EP-based coordinated dispatch are demonstrated based on the multi-area coordination and transmission-distribution coordination. Case studies with a wide range of system scales verify the superiority of the proposed projection algorithm in terms of computational efficiency and scalability, and validate the effectiveness of the EP-based coordinated dispatch in comparison with the joint optimization.
△ Less
Submitted 26 February, 2023;
originally announced February 2023.
-
Non-Iterative Solution for Coordinated Optimal Dispatch via Equivalent Projection-Part I: Theory
Authors:
Zhenfei Tan,
Zheng Yan,
Haiwang Zhong,
Qing Xia
Abstract:
Coordinated optimal dispatch is of utmost importance for the efficient and secure operation of hierarchically structured power systems. Conventional coordinated optimization methods, such as the Lagrangian relaxation and Benders decomposition, require iterative information exchange among subsystems. Iterative coordination methods have drawbacks including slow convergence, risk of oscillation and d…
▽ More
Coordinated optimal dispatch is of utmost importance for the efficient and secure operation of hierarchically structured power systems. Conventional coordinated optimization methods, such as the Lagrangian relaxation and Benders decomposition, require iterative information exchange among subsystems. Iterative coordination methods have drawbacks including slow convergence, risk of oscillation and divergence, and incapability of multi-level optimization problems. To this end, this paper aims at the non-iterative coordinated optimization method for hierarchical power systems. The theory of the equivalent projection (EP) is proposed, which makes external equivalence of the optimal dispatch model of the subsystem. Based on the EP theory, a coordinated optimization framework is developed, where each subsystem submits the EP model as a substitute for its original model to participate in the cross-system coordination. The proposed coordination framework is proven to guarantee the same optimality as the joint optimization, with additional benefits of avoiding iterative information exchange, protecting privacy, compatibility with practical dispatch scheme, and capability of multi-level problems.
△ Less
Submitted 26 February, 2023;
originally announced February 2023.
-
Low-Carbon Economic Dispatch of Bulk Power Systems Using Nash Bargaining Game
Authors:
Xuyang Li,
Guangchun Ruan,
Haiwang Zhong
Abstract:
Decarbonization of power systems plays a crucial role in achieving carbon neutral goals across the globe, but there exists a sharp contradiction between the emission reduction and levelized generation cost. Therefore, it is of great importance for power system operators to take economic as well as low-carbon factors into account. This paper establishes a low-carbon economic dispatch model of bulk…
▽ More
Decarbonization of power systems plays a crucial role in achieving carbon neutral goals across the globe, but there exists a sharp contradiction between the emission reduction and levelized generation cost. Therefore, it is of great importance for power system operators to take economic as well as low-carbon factors into account. This paper establishes a low-carbon economic dispatch model of bulk power systems based on Nash bargaining game, which derives a Nash bargaining solution making a reasonable trade-off between economic and low-carbon objectives. Because the Nash bargaining solution satisfies Pareto effectiveness, we analyze the computational complexity of Pareto frontiers with parametric linear programming and interpret the inefficiency of the method. Instead, we assign a group of dynamic weights in the objective function of the proposed low-carbon economic dispatch model so as to improve the computational efficiency by decoupling time periods and avoiding the complete computation of Pareto frontiers. In the end, we validate the proposed model and the algorithm by a realistic nationwide simulation in mainland China.
△ Less
Submitted 30 January, 2023;
originally announced January 2023.
-
Transmission Congestion Management with Generalized Generation Shift Distribution Factors
Authors:
Shutong Pu,
Guangchun Ruan,
Xinfei Yan,
Haiwang Zhong
Abstract:
A major concern in modern power systems is that the popularity and fluctuating characteristics of renewable energy may cause more and more transmission congestion events. Traditional congestion management modeling involves AC or DC power flow equations, while the former equation always accompanies great amount of computation, and the latter cannot consider voltage amplitude and reactive power. The…
▽ More
A major concern in modern power systems is that the popularity and fluctuating characteristics of renewable energy may cause more and more transmission congestion events. Traditional congestion management modeling involves AC or DC power flow equations, while the former equation always accompanies great amount of computation, and the latter cannot consider voltage amplitude and reactive power. Therefore, this paper proposes a congestion management approach incorporating a specially-designed generalized generator shift distribution factor (GSDF) to derive a computationally-efficient and accurate management strategies. This congestion management strategy involves multiple balancing generators for generation shift operation. The proposed model is superior in a low computational complexity (linear equation) and versatile modeling representation with full consideration of voltage amplitude and reactive power.
△ Less
Submitted 24 December, 2022;
originally announced December 2022.
-
Improving Sample Efficiency of Deep Learning Models in Electricity Market
Authors:
Guangchun Ruan,
Jianxiao Wang,
Haiwang Zhong,
Qing Xia,
Chongqing Kang
Abstract:
The superior performance of deep learning relies heavily on a large collection of sample data, but the data insufficiency problem turns out to be relatively common in global electricity markets. How to prevent overfitting in this case becomes a fundamental challenge when training deep learning models in different market applications. With this in mind, we propose a general framework, namely Knowle…
▽ More
The superior performance of deep learning relies heavily on a large collection of sample data, but the data insufficiency problem turns out to be relatively common in global electricity markets. How to prevent overfitting in this case becomes a fundamental challenge when training deep learning models in different market applications. With this in mind, we propose a general framework, namely Knowledge-Augmented Training (KAT), to improve the sample efficiency, and the main idea is to incorporate domain knowledge into the training procedures of deep learning models. Specifically, we propose a novel data augmentation technique to generate some synthetic data, which are later processed by an improved training strategy. This KAT methodology follows and realizes the idea of combining analytical and deep learning models together. Modern learning theories demonstrate the effectiveness of our method in terms of effective prediction error feedbacks, a reliable loss function, and rich gradient noises. At last, we study two popular applications in detail: user modeling and probabilistic price forecasting. The proposed method outperforms other competitors in all numerical tests, and the underlying reasons are explained by further statistical and visualization results.
△ Less
Submitted 11 October, 2022;
originally announced October 2022.
-
Evaluation of Look-ahead Economic Dispatch Using Reinforcement Learning
Authors:
Zekuan Yu,
Guangchun Ruan,
Xinyue Wang,
Guanglun Zhang,
Yiliu He,
Haiwang Zhong
Abstract:
Modern power systems are experiencing a variety of challenges driven by renewable energy, which calls for develo** novel dispatch methods such as reinforcement learning (RL). Evaluation of these methods as well as the RL agents are largely under explored. In this paper, we propose an evaluation approach to analyze the performance of RL agents in a look-ahead economic dispatch scheme. This approa…
▽ More
Modern power systems are experiencing a variety of challenges driven by renewable energy, which calls for develo** novel dispatch methods such as reinforcement learning (RL). Evaluation of these methods as well as the RL agents are largely under explored. In this paper, we propose an evaluation approach to analyze the performance of RL agents in a look-ahead economic dispatch scheme. This approach is conducted by scanning multiple operational scenarios. In particular, a scenario generation method is developed to generate the network scenarios and demand scenarios for evaluation, and network structures are aggregated according to the change rates of power flow. Then several metrics are defined to evaluate the agents' performance from the perspective of economy and security. In the case study, we use a modified IEEE 30-bus system to illustrate the effectiveness of the proposed evaluation approach, and the simulation results reveal good and rapid adaptation to different scenarios. The comparison between different RL agents is also informative to offer advice for a better design of the learning strategies.
△ Less
Submitted 21 September, 2022;
originally announced September 2022.
-
Complexity-Oriented Per-shot Video Coding Optimization
Authors:
Hongcheng Zhong,
Jun Xu,
Chen Zhu,
Donghui Feng,
Li Song
Abstract:
Current per-shot encoding schemes aim to improve the compression efficiency by shot-level optimization. It splits a source video sequence into shots and imposes optimal sets of encoding parameters to each shot. Per-shot encoding achieved approximately 20% bitrate savings over baseline fixed QP encoding at the expense of pre-processing complexity. However, the adjustable parameter space of the curr…
▽ More
Current per-shot encoding schemes aim to improve the compression efficiency by shot-level optimization. It splits a source video sequence into shots and imposes optimal sets of encoding parameters to each shot. Per-shot encoding achieved approximately 20% bitrate savings over baseline fixed QP encoding at the expense of pre-processing complexity. However, the adjustable parameter space of the current per-shot encoding schemes only has spatial resolution and QP/CRF, resulting in a lack of encoding flexibility. In this paper, we extend the per-shot encoding framework in the complexity dimension. We believe that per-shot encoding with flexible complexity will help in deploying user-generated content. We propose a rate-distortion-complexity optimization process for encoders and a methodology to determine the coding parameters under the constraints of complexities and bitrate ladders. Experimental results show that our proposed method achieves complexity constraints ranging from 100% to 3% in a dense form compared to the slowest per-shot anchor. With similar complexities of the per-shot scheme fixed in specific presets, our proposed method achieves BDrate gain up to -19.17%.
△ Less
Submitted 23 December, 2021;
originally announced December 2021.
-
Open-Access Data and Toolbox for Tracking COVID-19 Impact on Power Systems
Authors:
Guangchun Ruan,
Zekuan Yu,
Shutong Pu,
Songtao Zhou,
Haiwang Zhong,
Le Xie,
Qing Xia,
Chongqing Kang
Abstract:
Intervention policies against COVID-19 have caused large-scale disruptions globally, and led to a series of pattern changes in the power system operation. Analyzing these pandemic-induced patterns is imperative to identify the potential risks and impacts of this extreme event. With this purpose, we developed an open-access data hub (COVID-EMDA+), an open-source toolbox (CoVEMDA), and a few evaluat…
▽ More
Intervention policies against COVID-19 have caused large-scale disruptions globally, and led to a series of pattern changes in the power system operation. Analyzing these pandemic-induced patterns is imperative to identify the potential risks and impacts of this extreme event. With this purpose, we developed an open-access data hub (COVID-EMDA+), an open-source toolbox (CoVEMDA), and a few evaluation methods to explore what the U.S. power systems are experiencing during COVID-19. These resources could be broadly used for research, public policy, and educational purposes. Technically, our data hub harmonizes a variety of raw data such as generation mix, demand profiles, electricity price, weather observations, mobility, confirmed cases and deaths. Typical methods are reformulated and standardized in our toolbox, including baseline estimation, regression analysis, and scientific visualization. Here the fluctuation index and probabilistic baseline are proposed for the first time to consider data fluctuation and estimation uncertainty. Based on these, we conduct three empirical studies on the U.S. power systems, and share new solutions and unexpected findings to address the issues of public concerns. This conveys a more complete picture of the pandemic's impacts, and also opens up several attractive topics for future work. Python, Matlab source codes, and user manuals are all publicly shared on a Github repository.
△ Less
Submitted 15 May, 2022; v1 submitted 9 December, 2021;
originally announced December 2021.
-
Estimating Demand Flexibility Using Siamese LSTM Neural Networks
Authors:
Guangchun Ruan,
Daniel S. Kirschen,
Haiwang Zhong,
Qing Xia,
Chongqing Kang
Abstract:
There is an opportunity in modern power systems to explore the demand flexibility by incentivizing consumers with dynamic prices. In this paper, we quantify demand flexibility using an efficient tool called time-varying elasticity, whose value may change depending on the prices and decision dynamics. This tool is particularly useful for evaluating the demand response potential and system reliabili…
▽ More
There is an opportunity in modern power systems to explore the demand flexibility by incentivizing consumers with dynamic prices. In this paper, we quantify demand flexibility using an efficient tool called time-varying elasticity, whose value may change depending on the prices and decision dynamics. This tool is particularly useful for evaluating the demand response potential and system reliability. Recent empirical evidences have highlighted some abnormal features when studying demand flexibility, such as delayed responses and vanishing elasticities after price spikes. Existing methods fail to capture these complicated features because they heavily rely on some predefined (often over-simplified) regression expressions. Instead, this paper proposes a model-free methodology to automatically and accurately derive the optimal estimation pattern. We further develop a two-stage estimation process with Siamese long short-term memory (LSTM) networks. Here, a LSTM network encodes the price response, while the other network estimates the time-varying elasticities. In the case study, the proposed framework and models are validated to achieve higher overall estimation accuracy and better description for various abnormal features when compared with the state-of-the-art methods.
△ Less
Submitted 2 September, 2021;
originally announced September 2021.
-
Short-Term Electricity Price Forecasting based on Graph Convolution Network and Attention Mechanism
Authors:
Yuyun Yang,
Zhenfei Tan,
Haitao Yang,
Guangchun Ruan,
Haiwang Zhong
Abstract:
In electricity markets, locational marginal price (LMP) forecasting is particularly important for market participants in making reasonable bidding strategies, managing potential trading risks, and supporting efficient system planning and operation. Unlike existing methods that only consider LMPs' temporal features, this paper tailors a spectral graph convolutional network (GCN) to greatly improve…
▽ More
In electricity markets, locational marginal price (LMP) forecasting is particularly important for market participants in making reasonable bidding strategies, managing potential trading risks, and supporting efficient system planning and operation. Unlike existing methods that only consider LMPs' temporal features, this paper tailors a spectral graph convolutional network (GCN) to greatly improve the accuracy of short-term LMP forecasting. A three-branch network structure is then designed to match the structure of LMPs' compositions. Such kind of network can extract the spatial-temporal features of LMPs, and provide fast and high-quality predictions for all nodes simultaneously. The attention mechanism is also implemented to assign varying importance weights between different nodes and time slots. Case studies based on the IEEE-118 test system and real-world data from the PJM validate that the proposed model outperforms existing forecasting models in accuracy, and maintains a robust performance by avoiding extreme errors.
△ Less
Submitted 26 July, 2021;
originally announced July 2021.
-
Review of Learning-Assisted Power System Optimization
Authors:
Guangchun Ruan,
Haiwang Zhong,
Guanglun Zhang,
Yiliu He,
Xuan Wang,
Tianjiao Pu
Abstract:
With dramatic breakthroughs in recent years, machine learning is showing great potential to upgrade the toolbox for power system optimization. Understanding the strength and limitation of machine learning approaches is crucial to decide when and how to deploy them to boost the optimization performance. This paper pays special attention to the coordination between machine learning approaches and op…
▽ More
With dramatic breakthroughs in recent years, machine learning is showing great potential to upgrade the toolbox for power system optimization. Understanding the strength and limitation of machine learning approaches is crucial to decide when and how to deploy them to boost the optimization performance. This paper pays special attention to the coordination between machine learning approaches and optimization models, and carefully evaluates how such data-driven analysis may improve the rule-based optimization. The typical references are selected and categorized into four groups: the boundary parameter improvement, the optimization option selection, the surrogate model, and the hybrid model. This taxonomy provides a novel perspective to elaborate the latest research progress and development. We further compare the design patterns of different categories, and discuss several key challenges and opportunities as well. Deep integration between machine learning approaches and optimization models is expected to become the most promising technical trend.
△ Less
Submitted 1 September, 2020; v1 submitted 30 June, 2020;
originally announced July 2020.
-
A Cross-Domain Approach to Analyzing the Short-Run Impact of COVID-19 on the U.S. Electricity Sector
Authors:
Guangchun Ruan,
Dongqi Wu,
Xiangtian Zheng,
Haiwang Zhong,
Chongqing Kang,
Munther A. Dahleh,
S. Sivaranjani,
Le Xie
Abstract:
The novel coronavirus disease (COVID-19) has rapidly spread around the globe in 2020, with the U.S. becoming the epicenter of COVID-19 cases since late March. As the U.S. begins to gradually resume economic activity, it is imperative for policymakers and power system operators to take a scientific approach to understanding and predicting the impact on the electricity sector. Here, we release a fir…
▽ More
The novel coronavirus disease (COVID-19) has rapidly spread around the globe in 2020, with the U.S. becoming the epicenter of COVID-19 cases since late March. As the U.S. begins to gradually resume economic activity, it is imperative for policymakers and power system operators to take a scientific approach to understanding and predicting the impact on the electricity sector. Here, we release a first-of-its-kind cross-domain open-access data hub, integrating data from across all existing U.S. wholesale electricity markets with COVID-19 case, weather, cellular location, and satellite imaging data. Leveraging cross-domain insights from public health and mobility data, we uncover a significant reduction in electricity consumption across that is strongly correlated with the rise in the number of COVID-19 cases, degree of social distancing, and level of commercial activity.
△ Less
Submitted 27 August, 2020; v1 submitted 11 May, 2020;
originally announced May 2020.
-
NTIRE 2020 Challenge on Perceptual Extreme Super-Resolution: Methods and Results
Authors:
Kai Zhang,
Shuhang Gu,
Radu Timofte,
Taizhang Shang,
Qiuju Dai,
Shengchen Zhu,
Tong Yang,
Yandong Guo,
Younghyun Jo,
Sejong Yang,
Seon Joo Kim,
Lin Zha,
Jiande Jiang,
Xinbo Gao,
Wen Lu,
**g Liu,
Kwang** Yoon,
Taegyun Jeon,
Kazutoshi Akita,
Takeru Ooba,
Norimichi Ukita,
Zhipeng Luo,
Yuehan Yao,
Zhenyu Xu,
Dongliang He
, et al. (38 additional authors not shown)
Abstract:
This paper reviews the NTIRE 2020 challenge on perceptual extreme super-resolution with focus on proposed solutions and results. The challenge task was to super-resolve an input image with a magnification factor 16 based on a set of prior examples of low and corresponding high resolution images. The goal is to obtain a network design capable to produce high resolution results with the best percept…
▽ More
This paper reviews the NTIRE 2020 challenge on perceptual extreme super-resolution with focus on proposed solutions and results. The challenge task was to super-resolve an input image with a magnification factor 16 based on a set of prior examples of low and corresponding high resolution images. The goal is to obtain a network design capable to produce high resolution results with the best perceptual quality and similar to the ground truth. The track had 280 registered participants, and 19 teams submitted the final results. They gauge the state-of-the-art in single image super-resolution.
△ Less
Submitted 3 May, 2020;
originally announced May 2020.
-
AirRL: A Reinforcement Learning Approach to Urban Air Quality Inference
Authors:
Huiqiang Zhong,
Cunxiang Yin,
Xiaohui Wu,
**chang Luo,
JiaWei He
Abstract:
Urban air pollution has become a major environmental problem that threatens public health. It has become increasingly important to infer fine-grained urban air quality based on existing monitoring stations. One of the challenges is how to effectively select some relevant stations for air quality inference. In this paper, we propose a novel model based on reinforcement learning for urban air qualit…
▽ More
Urban air pollution has become a major environmental problem that threatens public health. It has become increasingly important to infer fine-grained urban air quality based on existing monitoring stations. One of the challenges is how to effectively select some relevant stations for air quality inference. In this paper, we propose a novel model based on reinforcement learning for urban air quality inference. The model consists of two modules: a station selector and an air quality regressor. The station selector dynamically selects the most relevant monitoring stations when inferring air quality. The air quality regressor takes in the selected stations and makes air quality inference with deep neural network. We conduct experiments on a real-world air quality dataset and our approach achieves the highest performance compared with several popular solutions, and the experiments show significant effectiveness of proposed model in tackling problems of air quality inference.
△ Less
Submitted 26 March, 2020;
originally announced March 2020.
-
DDet: Dual-path Dynamic Enhancement Network for Real-World Image Super-Resolution
Authors:
Yukai Shi,
Haoyu Zhong,
Zhi**g Yang,
Xiaojun Yang,
Liang Lin
Abstract:
Different from traditional image super-resolution task, real image super-resolution(Real-SR) focus on the relationship between real-world high-resolution(HR) and low-resolution(LR) image. Most of the traditional image SR obtains the LR sample by applying a fixed down-sampling operator. Real-SR obtains the LR and HR image pair by incorporating different quality optical sensors. Generally, Real-SR h…
▽ More
Different from traditional image super-resolution task, real image super-resolution(Real-SR) focus on the relationship between real-world high-resolution(HR) and low-resolution(LR) image. Most of the traditional image SR obtains the LR sample by applying a fixed down-sampling operator. Real-SR obtains the LR and HR image pair by incorporating different quality optical sensors. Generally, Real-SR has more challenges as well as broader application scenarios. Previous image SR methods fail to exhibit similar performance on Real-SR as the image data is not aligned inherently. In this article, we propose a Dual-path Dynamic Enhancement Network(DDet) for Real-SR, which addresses the cross-camera image map** by realizing a dual-way dynamic sub-pixel weighted aggregation and refinement. Unlike conventional methods which stack up massive convolutional blocks for feature representation, we introduce a content-aware framework to study non-inherently aligned image pair in image SR issue. First, we use a content-adaptive component to exhibit the Multi-scale Dynamic Attention(MDA). Second, we incorporate a long-term skip connection with a Coupled Detail Manipulation(CDM) to perform collaborative compensation and manipulation. The above dual-path model is joint into a unified model and works collaboratively. Extensive experiments on the challenging benchmarks demonstrate the superiority of our model.
△ Less
Submitted 25 February, 2020;
originally announced February 2020.
-
End-to-end Language Identification using NetFV and NetVLAD
Authors:
**kun Chen,
Weicheng Cai,
Danwei Cai,
Zexin Cai,
Haibin Zhong,
Ming Li
Abstract:
In this paper, we apply the NetFV and NetVLAD layers for the end-to-end language identification task. NetFV and NetVLAD layers are the differentiable implementations of the standard Fisher Vector and Vector of Locally Aggregated Descriptors (VLAD) methods, respectively. Both of them can encode a sequence of feature vectors into a fixed dimensional vector which is very important to process those va…
▽ More
In this paper, we apply the NetFV and NetVLAD layers for the end-to-end language identification task. NetFV and NetVLAD layers are the differentiable implementations of the standard Fisher Vector and Vector of Locally Aggregated Descriptors (VLAD) methods, respectively. Both of them can encode a sequence of feature vectors into a fixed dimensional vector which is very important to process those variable-length utterances. We first present the relevances and differences between the classical i-vector and the aforementioned encoding schemes. Then, we construct a flexible end-to-end framework including a convolutional neural network (CNN) architecture and an encoding layer (NetFV or NetVLAD) for the language identification task. Experimental results on the NIST LRE 2007 close-set task show that the proposed system achieves significant EER reductions against the conventional i-vector baseline and the CNN temporal average pooling system, respectively.
△ Less
Submitted 8 September, 2018;
originally announced September 2018.
