-
Enabling Large Language Models to Perform Power System Simulations with Previously Unseen Tools: A Case of Daline
Authors:
Mengshuo Jia,
Zeyu Cui,
Gabriela Hug
Abstract:
The integration of experiment technologies with large language models (LLMs) is transforming scientific research, offering AI capabilities beyond specialized problem-solving to becoming research assistants for human scientists. In power systems, simulations are essential for research. However, LLMs face significant challenges in power system simulations due to limited pre-existing knowledge and th…
▽ More
The integration of experiment technologies with large language models (LLMs) is transforming scientific research, offering AI capabilities beyond specialized problem-solving to becoming research assistants for human scientists. In power systems, simulations are essential for research. However, LLMs face significant challenges in power system simulations due to limited pre-existing knowledge and the complexity of power grids. To address this issue, this work proposes a modular framework that integrates expertise from both the power system and LLM domains. This framework enhances LLMs' ability to perform power system simulations on previously unseen tools. Validated using 34 simulation tasks in Daline, a (optimal) power flow simulation and linearization toolbox not yet exposed to LLMs, the proposed framework improved GPT-4o's simulation coding accuracy from 0% to 96.07%, also outperforming the ChatGPT-4o web interface's 33.8% accuracy (with the entire knowledge base uploaded). These results highlight the potential of LLMs as research assistants in power systems.
△ Less
Submitted 26 June, 2024; v1 submitted 24 June, 2024;
originally announced June 2024.
-
Data-driven Power Flow Linearization: Simulation
Authors:
Mengshuo Jia,
Gabriela Hug,
Ning Zhang,
Zhaojian Wang,
Yi Wang,
Chongqing Kang
Abstract:
Building on the theoretical insights of Part I, this paper, as the second part of the tutorial, dives deeper into data-driven power flow linearization (DPFL), focusing on comprehensive numerical testing. The necessity of these simulations stems from the theoretical analysis's inherent limitations, particularly the challenge of identifying the differences in real-world performance among DPFL method…
▽ More
Building on the theoretical insights of Part I, this paper, as the second part of the tutorial, dives deeper into data-driven power flow linearization (DPFL), focusing on comprehensive numerical testing. The necessity of these simulations stems from the theoretical analysis's inherent limitations, particularly the challenge of identifying the differences in real-world performance among DPFL methods with overlap** theoretical capabilities and/or limitations. The absence of a comprehensive numerical comparison of DPFL approaches in the literature also motivates this paper, especially given the fact that over 95% of existing DPFL studies have not provided any open-source codes. To bridge the gap, this paper first reviews existing DPFL experiments, examining the adopted test scenarios, load fluctuation settings, data sources, considerations for data noise/outliers, and the comparison made so far. Subsequently, this paper evaluates a total of 44 methods, containing over 30 existing DPFL approaches, some innovative DPFL techniques, and several classic physics-driven power flow linearization methods for benchmarking. The evaluation spans various dimensions, including generalizability, applicability, accuracy, and computational efficiency, using various different test cases scaling from 9-bus to 1354-bus systems. The numerical analysis identifies and examines significant trends and consistent findings across all methods under various test cases. It also offers theoretical insights into phenomena like under-performance, failure, excessive computation times, etc. Overall, this paper identifies the differences in the performances of the wide range of DPFL methods, reveals gaps not evident from theoretical discussions, assists in method selection for real-world applications, and provides thorough discussions on open questions within DPFL research, indicating ten potential future directions.
△ Less
Submitted 10 June, 2024;
originally announced June 2024.
-
Network Diffusion -- Framework to Simulate Spreading Processes in Complex Networks
Authors:
Michał Czuba,
Mateusz Nurek,
Damian Serwata,
Yu-Xuan Qiu,
Mingshan Jia,
Katarzyna Musial,
Radosław Michalski,
Piotr Bródka
Abstract:
With the advancement of computational network science, its research scope has significantly expanded beyond static graphs to encompass more complex structures. The introduction of streaming, temporal, multilayer, and hypernetwork approaches has brought new possibilities and imposed additional requirements. For instance, by utilising these advancements, one can model structures such as social netwo…
▽ More
With the advancement of computational network science, its research scope has significantly expanded beyond static graphs to encompass more complex structures. The introduction of streaming, temporal, multilayer, and hypernetwork approaches has brought new possibilities and imposed additional requirements. For instance, by utilising these advancements, one can model structures such as social networks in a much more refined manner, which is particularly relevant in simulations of the spreading processes. Unfortunately, the pace of advancement is often too rapid for existing computational packages to keep up with the functionality updates. This results in a significant proliferation of tools used by researchers and, consequently, a lack of a universally accepted technological stack that would standardise experimental methods (as seen, e.g. in machine learning). This article addresses that issue by presenting an extended version of the Network Diffusion library. First, a survey of the existing approaches and toolkits for simulating spreading phenomena is shown and then, an overview of the framework functionalities. Finally, we report four case studies conducted with the package to demonstrate its usefulness: the impact of sanitary measures on the spread of COVID-19, the comparison of information diffusion on two temporal network models, and the effectiveness of seed selection methods in the task of influence maximisation in multilayer networks. We conclude the paper with a critical assessment of the library and the outline of still awaiting challenges to standardise research environments in computational network science.
△ Less
Submitted 28 May, 2024;
originally announced May 2024.
-
Exploring the Power of Pure Attention Mechanisms in Blind Room Parameter Estimation
Authors:
Chunxi Wang,
Maoshen Jia,
Meiran Li,
Changchun Bao,
Wenyu **
Abstract:
Dynamic parameterization of acoustic environments has drawn widespread attention in the field of audio processing. Precise representation of local room acoustic characteristics is crucial when designing audio filters for various audio rendering applications. Key parameters in this context include reverberation time (RT60) and geometric room volume. In recent years, neural networks have been extens…
▽ More
Dynamic parameterization of acoustic environments has drawn widespread attention in the field of audio processing. Precise representation of local room acoustic characteristics is crucial when designing audio filters for various audio rendering applications. Key parameters in this context include reverberation time (RT60) and geometric room volume. In recent years, neural networks have been extensively applied in the task of blind room parameter estimation. However, there remains a question of whether pure attention mechanisms can achieve superior performance in this task. To address this issue, this study employs blind room parameter estimation based on monaural noisy speech signals. Various model architectures are investigated, including a proposed attention-based model. This model is a convolution-free Audio Spectrogram Transformer, utilizing patch splitting, attention mechanisms, and cross-modality transfer learning from a pretrained Vision Transformer. Experimental results suggest that the proposed attention mechanism-based model, relying purely on attention mechanisms without using convolution, exhibits significantly improved performance across various room parameter estimation tasks, especially with the help of dedicated pretraining and data augmentation schemes. Additionally, the model demonstrates more advantageous adaptability and robustness when handling variable-length audio inputs compared to existing methods.
△ Less
Submitted 25 April, 2024; v1 submitted 25 February, 2024;
originally announced February 2024.
-
A Video Coding Method Based on Neural Network for CLIC2024
Authors:
Zhengang Li,
**gchi Zhang,
Yonghua Wang,
Xing Zeng,
Zhen Zhang,
Yunlin Long,
Menghu Jia,
Ning Wang
Abstract:
This paper presents a video coding scheme that combines traditional optimization methods with deep learning methods based on the Enhanced Compression Model (ECM). In this paper, the traditional optimization methods adaptively adjust the quantization parameter (QP). The key frame QP offset is set according to the video content characteristics, and the coding tree unit (CTU) level QP of all frames i…
▽ More
This paper presents a video coding scheme that combines traditional optimization methods with deep learning methods based on the Enhanced Compression Model (ECM). In this paper, the traditional optimization methods adaptively adjust the quantization parameter (QP). The key frame QP offset is set according to the video content characteristics, and the coding tree unit (CTU) level QP of all frames is also adjusted according to the spatial-temporal perception information. Block importance map** technology (BIM) is also introduced, which adjusts the QP according to the block importance. Meanwhile, the deep learning methods propose a convolutional neural network-based loop filter (CNNLF), which is turned on/off based on the rate-distortion optimization at the CTU and frame level. Besides, intra-prediction using neural networks (NN-intra) is proposed to further improve compression quality, where 8 neural networks are used for predicting blocks of different sizes. The experimental results show that compared with ECM-3.0, the proposed traditional methods and adding deep learning methods improve the PSNR by 0.54 dB and 1 dB at 0.05Mbps, respectively; 0.38 dB and 0.71dB at 0.5 Mbps, respectively, which proves the superiority of our method.
△ Less
Submitted 7 January, 2024;
originally announced January 2024.
-
Attention Is All You Need For Blind Room Volume Estimation
Authors:
Chunxi Wang,
Maoshen Jia,
Meiran Li,
Changchun Bao,
Wenyu **
Abstract:
In recent years, dynamic parameterization of acoustic environments has raised increasing attention in the field of audio processing. One of the key parameters that characterize the local room acoustics in isolation from orientation and directivity of sources and receivers is the geometric room volume. Convolutional neural networks (CNNs) have been widely selected as the main models for conducting…
▽ More
In recent years, dynamic parameterization of acoustic environments has raised increasing attention in the field of audio processing. One of the key parameters that characterize the local room acoustics in isolation from orientation and directivity of sources and receivers is the geometric room volume. Convolutional neural networks (CNNs) have been widely selected as the main models for conducting blind room acoustic parameter estimation, which aims to learn a direct map** from audio spectrograms to corresponding labels. With the recent trend of self-attention mechanisms, this paper introduces a purely attention-based model to blindly estimate room volumes based on single-channel noisy speech signals. We demonstrate the feasibility of eliminating the reliance on CNN for this task and the proposed Transformer architecture takes Gammatone magnitude spectral coefficients and phase spectrograms as inputs. To enhance the model performance given the task-specific dataset, cross-modality transfer learning is also applied. Experimental results demonstrate that the proposed model outperforms traditional CNN models across a wide range of real-world acoustics spaces, especially with the help of the dedicated pretraining and data augmentation schemes.
△ Less
Submitted 27 December, 2023; v1 submitted 23 September, 2023;
originally announced September 2023.
-
Toward Value-oriented Renewable Energy Forecasting: An Iterative Learning Approach
Authors:
Yufan Zhang,
Mengshuo Jia,
Honglin Wen,
Yuexin Bian,
Yuanyuan Shi
Abstract:
Energy forecasting is an essential task in power system operations. Operators usually issue forecasts and leverage them to schedule energy dispatch ahead of time. However, forecast models are typically developed in a way that overlooks the operational value of the forecasts. To bridge the gap, we design a value-oriented point forecasting approach for sequential energy dispatch problems with renewa…
▽ More
Energy forecasting is an essential task in power system operations. Operators usually issue forecasts and leverage them to schedule energy dispatch ahead of time. However, forecast models are typically developed in a way that overlooks the operational value of the forecasts. To bridge the gap, we design a value-oriented point forecasting approach for sequential energy dispatch problems with renewable energy sources. At the training phase, we align the loss function with the overall operation cost function, thereby achieving reduced operation costs. The forecast model parameter estimation is formulated as a bilevel program. Under mild assumptions, we convert the upper-level objective into an equivalent form using the dual solutions obtained from the lower-level operation problems. Additionally, a novel iterative solution strategy is proposed for the newly formulated bilevel program. Under such an iterative scheme, we show that the upper-level objective is locally linear regarding the forecast model output, and can act as the loss function. Numerical experiments demonstrate that, compared to commonly used statistical quality-oriented point forecasting methods, forecasts obtained by the proposed approach result in lower operation costs. Meanwhile, the proposed approach is more computationally efficient than traditional two-stage stochastic programs.
△ Less
Submitted 4 April, 2024; v1 submitted 1 September, 2023;
originally announced September 2023.
-
Robust Transceiver Design for Covert Integrated Sensing and Communications With Imperfect CSI
Authors:
Yuchen Zhang,
Wanli Ni,
Jianquan Wang,
Wanbin Tang,
Min Jia,
Yonina C. Eldar,
Dusit Niyato
Abstract:
We propose a robust transceiver design for a covert integrated sensing and communications (ISAC) system with imperfect channel state information (CSI). Considering both bounded and probabilistic CSI error models, we formulate worst-case and outage-constrained robust optimization problems of joint trasceiver beamforming and radar waveform design to balance the radar performance of multiple targets…
▽ More
We propose a robust transceiver design for a covert integrated sensing and communications (ISAC) system with imperfect channel state information (CSI). Considering both bounded and probabilistic CSI error models, we formulate worst-case and outage-constrained robust optimization problems of joint trasceiver beamforming and radar waveform design to balance the radar performance of multiple targets while ensuring communications performance and covertness of the system. The optimization problems are challenging due to the non-convexity arising from the semi-infinite constraints (SICs) and the coupled transceiver variables. In an effort to tackle the former difficulty, S-procedure and Bernstein-type inequality are introduced for converting the SICs into finite convex linear matrix inequalities (LMIs) and second-order cone constraints. A robust alternating optimization framework referred to alternating double-checking is developed for decoupling the transceiver design problem into feasibility-checking transmitter- and receiver-side subproblems, transforming the rank-one constraints into a set of LMIs, and verifying the feasibility of beamforming by invoking the matrix-lifting scheme. Numerical results are provided to demonstrate the effectiveness and robustness of the proposed algorithm in improving the performance of covert ISAC systems.
△ Less
Submitted 28 November, 2023; v1 submitted 29 August, 2023;
originally announced August 2023.
-
The Design of By-product Hydrogen Supply Chain Considering Large-scale Storage and Chemical Plants: A Game Theory Perspective
Authors:
Qianni Cao,
Boda Li,
Mengshuo Jia,
Chen Shen
Abstract:
Hydrogen, an essential resource in the decarbonized economy, is commonly produced as a by-product of chemical plants. To promote the use of by-product hydrogen, this paper proposes a supply chain model among chemical plants, hydrogen-storage salt caverns, and end users, considering time-of-use (TOU) hydrogen price, coalition strategies of suppliers, and road transportation of liquefied and compres…
▽ More
Hydrogen, an essential resource in the decarbonized economy, is commonly produced as a by-product of chemical plants. To promote the use of by-product hydrogen, this paper proposes a supply chain model among chemical plants, hydrogen-storage salt caverns, and end users, considering time-of-use (TOU) hydrogen price, coalition strategies of suppliers, and road transportation of liquefied and compressed hydrogen. The transport route planning problem among multiple chemical plants is modeled through a cooperative game, while the hydrogen market among the salt cavern and chemical plants is modeled through a Stackelberg game. The equilibrium of the supply chain model gives the transportation and trading strategies of individual stakeholders. Simulation results demonstrate that the proposed method can provide useful insights on by-product hydrogen market design and analysis.
△ Less
Submitted 6 November, 2022;
originally announced November 2022.
-
Joint Location and Beamforming Design for STAR-RIS Assisted NOMA Systems
Authors:
Qiling Gao,
Yuanwei Liu,
Xidong Mu,
Min Jia,
Dongbo Li,
Lajos Hanzo
Abstract:
Simultaneously transmitting and reflecting reconfigurable intelligent surface (STAR-RIS) assisted non-orthogonal multiple access (NOMA) communication systems are investigated in its vicinity, where a STAR-RIS is deployed within a predefined region for establishing communication links for users. Both beamformer-based NOMA and cluster-based NOMA schemes are employed at the multi-antenna base station…
▽ More
Simultaneously transmitting and reflecting reconfigurable intelligent surface (STAR-RIS) assisted non-orthogonal multiple access (NOMA) communication systems are investigated in its vicinity, where a STAR-RIS is deployed within a predefined region for establishing communication links for users. Both beamformer-based NOMA and cluster-based NOMA schemes are employed at the multi-antenna base station (BS). For each scheme, the STAR-RIS deployment location, the passive transmitting and reflecting beamforming (BF) of the STAR-RIS, and the active BF at the BS are jointly optimized for maximizing the weighted sum-rate (WSR) of users. To solve the resultant non-convex problems, an alternating optimization (AO) algorithm is proposed, where successive convex approximation (SCA) and semi-definite programming (SDP) methods are invoked for iteratively addressing the non-convexity of each sub-problem. Numerical results reveal that 1) the WSR performance can be significantly enhanced by optimizing the specific deployment location of the STAR-RIS; 2) both beamformer-based and cluster-based NOMA prefer asymmetric STAR-RIS deployment.
△ Less
Submitted 26 June, 2022;
originally announced June 2022.
-
Control-aware Probabilistic Load Flow for Transmission Systems: An Analytical Method
Authors:
Mengshuo Jia,
Qianni Cao,
Chen Shen,
Gabriela Hug
Abstract:
Probabilistic load flow (PLF) calculation, as a fundamental tool to analyze transmission system behavior, has been studied for decades. Despite a variety of available methods, existing PLF approaches rarely take system control into account. However, system control, as an automatic buffer between the fluctuations in random variables and the variations in system states, has a significant impact on t…
▽ More
Probabilistic load flow (PLF) calculation, as a fundamental tool to analyze transmission system behavior, has been studied for decades. Despite a variety of available methods, existing PLF approaches rarely take system control into account. However, system control, as an automatic buffer between the fluctuations in random variables and the variations in system states, has a significant impact on the final PLF result. To consider control actions' influence, this paper proposes the first analytical PLF method for the transmission grid that takes into account primary and secondary frequency controls. This method is based on a high-precision linear power flow model, whose precision is even further improved in this paper by an original correction approach. This paper also proves that if the joint probability distribution (JPD) of random variables is expressed by a Gaussian mixture model (GMM), then the JPD of system states (e.g., nodal voltages) is an infinite GMM. By leveraging this proposition, the proposed method can generate the joint PLF of the whole system, is applicable to random variables obeying any distributions, and is capable of capturing their correlation. The high accuracy and satisfactory efficiency of this method are verified on test cases scaling from 14 to 1354 buses.
△ Less
Submitted 28 February, 2022;
originally announced March 2022.
-
Chance-constrained OPF: A Distributed Method with Confidentiality Preservation
Authors:
Mengshuo Jia,
Gabriela Hug,
Yifan Su,
Chen Shen
Abstract:
Given the increased percentage of wind power in power systems, chance-constrained optimal power flow (CC-OPF) calculation, as a means to take wind power uncertainty into account with a guaranteed security level, is being promoted. Compared to the local CC-OPF within a regional grid, the global CC-OPF of a multi-regional interconnected grid is able to coordinate across different regions and therefo…
▽ More
Given the increased percentage of wind power in power systems, chance-constrained optimal power flow (CC-OPF) calculation, as a means to take wind power uncertainty into account with a guaranteed security level, is being promoted. Compared to the local CC-OPF within a regional grid, the global CC-OPF of a multi-regional interconnected grid is able to coordinate across different regions and therefore improve the economic efficiency when integrating high percentage of wind power generation. In this global problem, however, multiple regional independent system operators (ISOs) participate in the decision-making process, raising the need for distributed but coordinated approaches. Most notably, due to regulation restrictions, commercial interest, and data security, regional ISOs may refuse to share confidential information with others, including generation cost, load data, system topologies, and line parameters. But this information is needed to build and solve the global CC-OPF spanning multiple areas. To tackle these issues, this paper proposes a distributed CC-OPF method with confidentiality preservation, which enables regional ISOs to determine the optimal dispatchable generations within their regions without disclosing confidential data. This method does not require parameter tunings and will not suffer from convergence challenges. Results from IEEE test cases show that this method is highly accurate.
△ Less
Submitted 28 February, 2022;
originally announced March 2022.
-
The multi-channel potentiostat: Development and Evaluation of a Scalable Mini-Potentiostat array for investigating electrochemical reaction mechanisms
Authors:
Pattawong Pansodtee,
John Selberg,
Man** Jia,
Mohammad Jafari,
Harika Dechiraju,
Thomas Thomsen,
Marcella Gomez,
Marco Rolandi,
Mircea Teodorescu
Abstract:
A potentiostat is an essential piece of analytical equipment for studying electrochemical devices and reactions. As the design of electrochemical devices evolve applications for systems with multiple working electrodes have become more common. These applications drive a need for low-cost multi-channel potentiostat systems. We have developed a portable low-cost scalable system with a modular design…
▽ More
A potentiostat is an essential piece of analytical equipment for studying electrochemical devices and reactions. As the design of electrochemical devices evolve applications for systems with multiple working electrodes have become more common. These applications drive a need for low-cost multi-channel potentiostat systems. We have developed a portable low-cost scalable system with a modular design that can support 8 to 64 channels at a cost as low as \$8 per channel. This design can replace the functionality of commercial potentiostats which cost upwards of \$10k for certain applications. Each channel in the multi-channel potentiostat has an independent adjustable voltage source with a built-in ammeter and switch, making the device flexible for various configurations. The multi-channel potentiostat is designed for low current applications (nA range), but its purpose can change by varying its shunt resistor value. The system can either function as a standalone device or remotely controlled. We demonstrate the functionality of this system for the control of a 24-channel bioelectronic ion pump for open- and closed- loop control of pH.
△ Less
Submitted 20 May, 2021;
originally announced May 2021.
-
A fault detection scheme for PV panels in large scale PV stations with complex installation conditions
Authors:
Qianni Cao,
Chen Shen,
Mengshuo Jia
Abstract:
Faults in photovoltaic (PV) systems can seriously affect the efficiency, energy yield as well as the security of the entire PV plant, if not detected and corrected quickly. Therefore, fault diagnosis of PV arrays is indispensable for improving the reliability, efficiency, productivity and safety of PV power stations. Instead of conventional thresholding methods and artificial intelligent (AI) mach…
▽ More
Faults in photovoltaic (PV) systems can seriously affect the efficiency, energy yield as well as the security of the entire PV plant, if not detected and corrected quickly. Therefore, fault diagnosis of PV arrays is indispensable for improving the reliability, efficiency, productivity and safety of PV power stations. Instead of conventional thresholding methods and artificial intelligent (AI) machine learning approaches, an innovative Gaussian Mixture Model (GMM) based fault detection approach is proposed in this work. This approach combines the superiority of GMM in modeling stochastic power outputs of PV modules and the flexibility and simplicity of Sandia PV Array Performance Model (SPAM) to accurately detect under-performing modules. Firstly, GMM is proposed to represent the probabilistic distribution functions (PDF) of different PV modules' power outputs, and the parameter sets of which are obtained by Expectation Maximization algorithm. Secondly, a simplified explicit expression for output power of PV modules, which highlights the influences of tilt and azimuth angles, is deduced based on the SPAM. Then, an orientation independent vector C is developed to eliminate the probability distribution differences of power outputs caused by varying azimuth angles and tilt angles. Jensen-Shannon (JS) divergence, which captures the differences between probability density of C of each PV module, are generated and used as fault indicators. Simulation data acquired from the original SPAM are used to assess the performance of the proposed approach. Results show that the proposed approach successfully detects faults in PV systems. This work is especially suitable for the PV modules that have different installation parameters such as azimuth angles and tilt angles, and it does not require the use of irradiance or temperature sensors.
△ Less
Submitted 19 May, 2021;
originally announced May 2021.
-
A novel time-frequency Transformer based on self-attention mechanism and its application in fault diagnosis of rolling bearings
Authors:
Yifei Ding,
Min** Jia,
Qiuhua Miao,
Yudong Cao
Abstract:
The scope of data-driven fault diagnosis models is greatly extended through deep learning (DL). However, the classical convolution and recurrent structure have their defects in computational efficiency and feature representation, while the latest Transformer architecture based on attention mechanism has not yet been applied in this field. To solve these problems, we propose a novel time-frequency…
▽ More
The scope of data-driven fault diagnosis models is greatly extended through deep learning (DL). However, the classical convolution and recurrent structure have their defects in computational efficiency and feature representation, while the latest Transformer architecture based on attention mechanism has not yet been applied in this field. To solve these problems, we propose a novel time-frequency Transformer (TFT) model inspired by the massive success of vanilla Transformer in sequence processing. Specially, we design a fresh tokenizer and encoder module to extract effective abstractions from the time-frequency representation (TFR) of vibration signals. On this basis, a new end-to-end fault diagnosis framework based on time-frequency Transformer is presented in this paper. Through the case studies on bearing experimental datasets, we construct the optimal Transformer structure and verify its fault diagnosis performance. The superiority of the proposed method is demonstrated in comparison with the benchmark models and other state-of-the-art methods.
△ Less
Submitted 4 December, 2021; v1 submitted 19 April, 2021;
originally announced April 2021.
-
Convergence Analysis of Dual Decomposition Algorithm in Distributed Optimization: Asynchrony and Inexactness
Authors:
Yifan Su,
Zhaojian Wang,
Ming Cao,
Mengshuo Jia,
Feng Liu
Abstract:
Dual decomposition is widely utilized in distributed optimization of multi-agent systems. In practice, the dual decomposition algorithm is desired to admit an asynchronous implementation due to imperfect communication, such as time delay and packet drop. In addition, computational errors also exist when individual agents solve their own subproblems. In this paper, we analyze the convergence of the…
▽ More
Dual decomposition is widely utilized in distributed optimization of multi-agent systems. In practice, the dual decomposition algorithm is desired to admit an asynchronous implementation due to imperfect communication, such as time delay and packet drop. In addition, computational errors also exist when individual agents solve their own subproblems. In this paper, we analyze the convergence of the dual decomposition algorithm in distributed optimization when both the asynchrony in communication and the inexactness in solving subproblems exist. We find that the interaction between asynchrony and inexactness slows down the convergence rate from $\mathcal{O} ( 1 / k )$ to $\mathcal{O} ( 1 / \sqrt{k} )$. Specifically, with a constant step size, the value of objective function converges to a neighborhood of the optimal value, and the solution converges to a neighborhood of the exact optimal solution. Moreover, the violation of the constraints diminishes in $\mathcal{O} ( 1 / \sqrt{k} )$. Our result generalizes and unifies the existing ones that only consider either asynchrony or inexactness. Finally, numerical simulations validate the theoretical results.
△ Less
Submitted 3 March, 2021;
originally announced March 2021.
-
Iterative Decomposition of Joint Chance Constraints in OPF
Authors:
Mengshuo Jia,
Gabriela Hug,
Chen Shen
Abstract:
In chance-constrained OPF models, joint chance constraints (JCCs) offer a stronger guarantee on security compared to single chance constraints (SCCs). Using Boole's inequality or its improved versions to decompose JCCs into SCCs is popular, yet the conservativeness introduced is still significant. In this letter, a non-parametric iterative framework is proposed to achieve the decomposition of JCCs…
▽ More
In chance-constrained OPF models, joint chance constraints (JCCs) offer a stronger guarantee on security compared to single chance constraints (SCCs). Using Boole's inequality or its improved versions to decompose JCCs into SCCs is popular, yet the conservativeness introduced is still significant. In this letter, a non-parametric iterative framework is proposed to achieve the decomposition of JCCs with negligible conservativeness. An adaptive risk allocation strategy is also proposed and embedded in the framework. Results on an IEEE test case show that the conservativeness using the framework is nearly eliminated, thereby reducing the generation cost considerably.
△ Less
Submitted 22 October, 2020;
originally announced October 2020.
-
Fashionpedia: Ontology, Segmentation, and an Attribute Localization Dataset
Authors:
Menglin Jia,
Mengyun Shi,
Mikhail Sirotenko,
Yin Cui,
Claire Cardie,
Bharath Hariharan,
Hartwig Adam,
Serge Belongie
Abstract:
In this work we explore the task of instance segmentation with attribute localization, which unifies instance segmentation (detect and segment each object instance) and fine-grained visual attribute categorization (recognize one or multiple attributes). The proposed task requires both localizing an object and describing its properties. To illustrate the various aspects of this task, we focus on th…
▽ More
In this work we explore the task of instance segmentation with attribute localization, which unifies instance segmentation (detect and segment each object instance) and fine-grained visual attribute categorization (recognize one or multiple attributes). The proposed task requires both localizing an object and describing its properties. To illustrate the various aspects of this task, we focus on the domain of fashion and introduce Fashionpedia as a step toward map** out the visual aspects of the fashion world. Fashionpedia consists of two parts: (1) an ontology built by fashion experts containing 27 main apparel categories, 19 apparel parts, 294 fine-grained attributes and their relationships; (2) a dataset with everyday and celebrity event fashion images annotated with segmentation masks and their associated per-mask fine-grained attributes, built upon the Fashionpedia ontology. In order to solve this challenging task, we propose a novel Attribute-Mask RCNN model to jointly perform instance segmentation and localized attribute recognition, and provide a novel evaluation metric for the task. We also demonstrate instance segmentation models pre-trained on Fashionpedia achieve better transfer learning performance on other fashion datasets than ImageNet pre-training. Fashionpedia is available at: https://fashionpedia.github.io/home/index.html.
△ Less
Submitted 18 July, 2020; v1 submitted 25 April, 2020;
originally announced April 2020.
-
Privacy-preserving Distributed Probabilistic Load Flow
Authors:
Mengshuo Jia,
Yi Wang,
Chen Shen,
Gabriela Hug
Abstract:
Probabilistic load flow (PLF) allows to evaluate uncertainties introduced by renewable energy sources on system operation. Ideally, the PLF calculation is implemented for an entire grid requiring all the parameters of the transmission lines and node load/generation to be available. However, in a multi-regional interconnected grid, the independent system operators (ISOs) across regions may not shar…
▽ More
Probabilistic load flow (PLF) allows to evaluate uncertainties introduced by renewable energy sources on system operation. Ideally, the PLF calculation is implemented for an entire grid requiring all the parameters of the transmission lines and node load/generation to be available. However, in a multi-regional interconnected grid, the independent system operators (ISOs) across regions may not share the parameters of their respective areas with other ISOs. Consequently, the challenge is how to identify the functional relationship between the flows in the regional grid and the uncertain power injections of renewable generation sources across regions without full information about the entire grid. To overcome this challenge, we first propose a privacy-preserving distributed accelerated projection-based consensus algorithm for each ISO to calculate the corresponding coefficient matrix of the desired functional relationship. Then, we leverage a privacy-preserving accelerated average consensus algorithm to allow each ISO to obtain the corresponding constant vector of the same relationship. Using the two algorithms, we finally derive a privacy-preserving distributed PLF method for each ISO to analytically obtain its regional joint PLF in a fully distributed manner without revealing its parameters to other ISOs. The correctness, effectiveness, and efficiency of the proposed method are verified through a case study on the IEEE 118-bus system.
△ Less
Submitted 20 April, 2020;
originally announced April 2020.
-
Privacy-Preserving Distributed Clustering for Electrical Load Profiling
Authors:
Mengshuo Jia,
Yi Wang,
Chen Shen,
Gabriela Hug
Abstract:
Electrical load profiling supports retailers and distribution network operators in having a better understanding of the consumption behavior of consumers. However, traditional clustering methods for load profiling are centralized and require access to all the smart meter data, thus causing privacy issues for consumers and retailers. To tackle this issue, we propose a privacy-preserving distributed…
▽ More
Electrical load profiling supports retailers and distribution network operators in having a better understanding of the consumption behavior of consumers. However, traditional clustering methods for load profiling are centralized and require access to all the smart meter data, thus causing privacy issues for consumers and retailers. To tackle this issue, we propose a privacy-preserving distributed clustering framework for load profiling by develo** a privacy-preserving accelerated average consensus (PP-AAC) algorithm with proven convergence. Using the proposed framework, we modify several commonly used clustering methods, including k-means, fuzzy C-means, and Gaussian mixture model, to provide privacy-preserving distributed clustering methods. In this way, load profiling can be performed only by local calculations and information sharing between neighboring data owners without sacrificing privacy. Meanwhile, compared to traditional centralized clustering methods, the computational time consumed by each data owner is significantly reduced. The privacy and complexity of the proposed privacy-preserving distributed clustering framework are analyzed. The correctness, efficiency, effectiveness, and privacy-preserving feature of the proposed framework and the proposed PP-AAC algorithm are verified using a real-world Irish residential dataset.
△ Less
Submitted 26 February, 2020;
originally announced February 2020.
-
Distributed Generalized Nash Equilibrium Seeking for Energy Sharing Games
Authors:
Zhaojian Wang,
Feng Liu,
Zhiyuan Ma,
Yue Chen,
Mengshuo Jia,
Wei Wei,
Qiuwei Wu
Abstract:
With the proliferation of distributed generators and energy storage systems, traditional passive consumers in power systems have been gradually evolving into the so-called "prosumers", i.e., proactive consumers, which can both produce and consume power. To encourage energy exchange among prosumers, energy sharing is increasingly adopted, which is usually formulated as a generalized Nash game (GNG)…
▽ More
With the proliferation of distributed generators and energy storage systems, traditional passive consumers in power systems have been gradually evolving into the so-called "prosumers", i.e., proactive consumers, which can both produce and consume power. To encourage energy exchange among prosumers, energy sharing is increasingly adopted, which is usually formulated as a generalized Nash game (GNG). In this paper, a distributed approach is proposed to seek the Generalized Nash equilibrium (GNE) of the energy sharing game. To this end, we convert the GNG into an equivalent optimization problem. A Krasnosel'ski{ǐ}-Mann iteration type algorithm is thereby devised to solve the problem and consequently find the GNE in a distributed manner. The convergence of the proposed algorithm is proved rigorously based on the nonexpansive operator theory. The performance of the algorithm is validated by experiments with three prosumers, and the scalability is tested by simulations using 123 prosumers.
△ Less
Submitted 9 April, 2020; v1 submitted 7 November, 2019;
originally announced November 2019.
-
A Distributed Incremental Update Scheme for Probability Distribution of Wind Power Forecast Error
Authors:
Mengshuo Jia,
Chen Shen,
Zhaojian Wang
Abstract:
Due to the uncertainty of distributed wind generations (DWGs), a better understanding of the probability distributions (PD) of their wind power forecast errors (WPFEs) can help market participants (MPs) who own DWGs perform better during trading. Under the premise of an accurate PD model, considering the correlation among DWGs and absorbing the new information carried by the latest data are two wa…
▽ More
Due to the uncertainty of distributed wind generations (DWGs), a better understanding of the probability distributions (PD) of their wind power forecast errors (WPFEs) can help market participants (MPs) who own DWGs perform better during trading. Under the premise of an accurate PD model, considering the correlation among DWGs and absorbing the new information carried by the latest data are two ways to maintain an accurate PD. These two ways both require the historical and latest wind power and forecast data of all DWGs. Each MP, however, only has access to the data of its own DWGs and may refuse to share these data with MPs belonging to other stakeholders. Besides, because of the endless generation of new data, the PD updating burden increases sharply. Therefore, we use the distributed strategy to deal with the data collection problem. In addition, we further apply the incremental learning strategy to reduce the updating burden. Finally, we propose a distributed incremental update scheme to make each MP continually acquire the latest conditional PD of its DWGs' WPFE. Specifically, we first use the Gaussian-mixture-model-based (GMM-based) joint PD to characterize the correlation among DWGs. Then, we propose a distributed modified incremental GMM algorithm to enable MPs to update the parameters of the joint PD in a distributed and incremental manner. After that, we further propose a distributed derivation algorithm to make MPs derive their conditional PD of WPFE from the joint one in a distributed way. Combining the two original algorithms, we finally achieve the complete distributed incremental update scheme, by which each MP can continually obtain its latest conditional PD of its DWGs' WPFE via neighborhood communication and local calculation with its own data. The effectiveness, correctness, and efficiency of the proposed scheme are verified using the dataset from the NREL.
△ Less
Submitted 2 March, 2020; v1 submitted 24 April, 2019;
originally announced May 2019.
-
Privacy-Preserving Probabilistic Forecasting for Temporal-spatial Correlated Wind Farms
Authors:
Mengshuo Jia,
Chen Shen,
Zhiwen Wang,
Zhitong Yu
Abstract:
Adopting Secure scalar product and Secure sum techniques, we propose a privacy-preserving method to build the joint and conditional probability distribution functions of multiple wind farms' output considering the temporal-spatial correlation. The proposed method can protect the raw data of wind farms (WFs) from disclosure, and are mathematically equivalent to the centralized method which needs to…
▽ More
Adopting Secure scalar product and Secure sum techniques, we propose a privacy-preserving method to build the joint and conditional probability distribution functions of multiple wind farms' output considering the temporal-spatial correlation. The proposed method can protect the raw data of wind farms (WFs) from disclosure, and are mathematically equivalent to the centralized method which needs to gather the raw data of all WFs.
△ Less
Submitted 17 December, 2018;
originally announced January 2019.
-
A Distributed Probabilistic Modeling Algorithm for the Aggregated Power Forecast Error of Multiple Newly Built Wind Farms
Authors:
Mengshuo Jia,
Chen Shen,
Zhiwen Wang
Abstract:
The extensive penetration of wind farms (WFs) presents challenges to the operation of distribution networks (DNs). Building a probability distribution of the aggregated wind power forecast error is of great value for decision making. However, as a result of recent government incentives, many WFs are being newly built with little historical data for training distribution models. Moreover, WFs with…
▽ More
The extensive penetration of wind farms (WFs) presents challenges to the operation of distribution networks (DNs). Building a probability distribution of the aggregated wind power forecast error is of great value for decision making. However, as a result of recent government incentives, many WFs are being newly built with little historical data for training distribution models. Moreover, WFs with different stakeholders may refuse to submit the raw data to a data center for model training. To address these problems, a Gaussian mixture model (GMM) is applied to build the distribution of the aggregated wind power forecast error; then, the maximum a posteriori (MAP) estimation method is adopted to overcome the limited training data problem in GMM parameter estimation. Next, a distributed MAP estimation method is developed based on the average consensus filter algorithm to address the data privacy issue. The distribution control center is introduced into the distributed estimation process to acquire more precise estimation results and better adapt to the DN control architecture. The effectiveness of the proposed algorithm is empirically verified using historical data.
△ Less
Submitted 17 December, 2018;
originally announced December 2018.
-
Discussion of Parameters Setting for A Distributed Probabilistic Modeling Algorithm
Authors:
Mengshuo Jia,
Chen Shen,
Zhiwen Wang
Abstract:
This manuscript provides additional case analysis for the parameters setting of the distributed probabilistic modeling algorithm for the aggregated wind power forecast error.
This manuscript provides additional case analysis for the parameters setting of the distributed probabilistic modeling algorithm for the aggregated wind power forecast error.
△ Less
Submitted 4 September, 2018; v1 submitted 22 August, 2018;
originally announced August 2018.
-
Design of remote control software of near infrared Sky Brightness Monitor in Antarctica
Authors:
Zhi-yue Wang,
Ya-qi Chen,
Ming-hao Jia,
Guang-yu Zhang,
Jun Zhang,
Yi-hao Zhang,
**-ting Chen,
Hong-fei Zhang,
Peng Jiang,
Tuo Ji,
Jian Wang
Abstract:
The Near-infrared Sky Brightness Monitor (NIRBM) aims to measure the middle infrared sky background in Antarctica. The NIRBM mainly consists of an InGaAs detector, a chopper, a reflector, a cooler and a black body. The reflector can rotate to scan the sky with a field of view ranging from 0° to 180°. Electromechanical control and weak signal readout functions are accomplished by the same circuit,…
▽ More
The Near-infrared Sky Brightness Monitor (NIRBM) aims to measure the middle infrared sky background in Antarctica. The NIRBM mainly consists of an InGaAs detector, a chopper, a reflector, a cooler and a black body. The reflector can rotate to scan the sky with a field of view ranging from 0° to 180°. Electromechanical control and weak signal readout functions are accomplished by the same circuit, whose core chip is a STM32F407VG microcontroller. Considering the environment is harsh for humans in Antarctica, a multi-level remote control software system is designed and implemented. A set of EPICS IOCs are developed to control each hardware module independently via serial port communication with the STM32 microcontroller. The tornado web framework and PyEpics are introduced as a combination where PyEpics is used to monitor or change the EPICS Process Variables, functioning as a client for the EPICS framework. Tornado is responsible for the specific operation process of inter-device collaboration, and expose a set of interfaces to users to make calls. Considering the high delay and low bandwidth of the network environment, the tornado back-end is designed as a master-and-agent architecture to improve domestic user experience. The master node is deployed in Antarctic while multiple agent nodes can be deployed domestic. The master and agent nodes communicate with each other through the WebSocket protocol to exchange latest information so that bandwidth is saved. The GUI is implemented in the form of single-page application based on the Vue framework which communicates with tornado through WebSocket and AJAX requests. The web page integrates device control, data curve drawing, alarm display, auto observation and other functions together.
△ Less
Submitted 1 March, 2019; v1 submitted 5 June, 2018;
originally announced June 2018.
