Showing 1–50 of 64 results for author: Giannakis, G B

Conic Descent Redux for Memory-Efficient Optimization

Authors: Bingcong Li, Georgios B. Giannakis

Abstract: Conic programming has well-documented merits in a gamut of signal processing and machine learning tasks. This contribution revisits a recently developed first-order conic descent (CD) solver, and advances it in three aspects: intuition, theory, and algorithmic implementation. It is found that CD can afford an intuitive geometric derivation that originates from the dual problem. This opens the door… ▽ More Conic programming has well-documented merits in a gamut of signal processing and machine learning tasks. This contribution revisits a recently developed first-order conic descent (CD) solver, and advances it in three aspects: intuition, theory, and algorithmic implementation. It is found that CD can afford an intuitive geometric derivation that originates from the dual problem. This opens the door to novel algorithmic designs, with a momentum variant of CD, momentum conic descent (MOCO) exemplified. Diving deeper into the dual behavior CD and MOCO reveals: i) an analytically justified stop** criterion; and, ii) the potential to design preconditioners to speed up dual convergence. Lastly, to scale semidefinite programming (SDP) especially for low-rank solutions, a memory efficient MOCO variant is developed and numerically validated. △ Less

Submitted 13 August, 2023; originally announced August 2023.

Heavy Ball Momentum for Conditional Gradient

Authors: Bingcong Li, Alireza Sadeghi, Georgios B. Giannakis

Abstract: Conditional gradient, aka Frank Wolfe (FW) algorithms, have well-documented merits in machine learning and signal processing applications. Unlike projection-based methods, momentum cannot improve the convergence rate of FW, in general. This limitation motivates the present work, which deals with heavy ball momentum, and its impact to FW. Specifically, it is established that heavy ball offers a uni… ▽ More Conditional gradient, aka Frank Wolfe (FW) algorithms, have well-documented merits in machine learning and signal processing applications. Unlike projection-based methods, momentum cannot improve the convergence rate of FW, in general. This limitation motivates the present work, which deals with heavy ball momentum, and its impact to FW. Specifically, it is established that heavy ball offers a unifying perspective on the primal-dual (PD) convergence, and enjoys a tighter per iteration PD error rate, for multiple choices of step sizes, where PD error can serve as the stop** criterion in practice. In addition, it is asserted that restart, a scheme typically employed jointly with Nesterov's momentum, can further tighten this PD error bound. Numerical results demonstrate the usefulness of heavy ball momentum in FW iterations. △ Less

Submitted 8 October, 2021; originally announced October 2021.

Comments: Accepted to NeurIPS 2021

Learning to Solve the AC-OPF using Sensitivity-Informed Deep Neural Networks

Authors: Manish K. Singh, Vassilis Kekatos, Georgios B. Giannakis

Abstract: To shift the computational burden from real-time to offline in delay-critical power systems applications, recent works entertain the idea of using a deep neural network (DNN) to predict the solutions of the AC optimal power flow (AC-OPF) once presented load demands. As network topologies may change, training this DNN in a sample-efficient manner becomes a necessity. To improve data efficiency, thi… ▽ More To shift the computational burden from real-time to offline in delay-critical power systems applications, recent works entertain the idea of using a deep neural network (DNN) to predict the solutions of the AC optimal power flow (AC-OPF) once presented load demands. As network topologies may change, training this DNN in a sample-efficient manner becomes a necessity. To improve data efficiency, this work utilizes the fact OPF data are not simple training labels, but constitute the solutions of a parametric optimization problem. We thus advocate training a sensitivity-informed DNN (SI-DNN) to match not only the OPF optimizers, but also their partial derivatives with respect to the OPF parameters (loads). It is shown that the required Jacobian matrices do exist under mild conditions, and can be readily computed from the related primal/dual solutions. The proposed SI-DNN is compatible with a broad range of OPF solvers, including a non-convex quadratically constrained quadratic program (QCQP), its semidefinite program (SDP) relaxation, and MATPOWER; while SI-DNN can be seamlessly integrated in other learning-to-OPF schemes. Numerical tests on three benchmark power systems corroborate the advanced generalization and constraint satisfaction capabilities for the OPF solutions predicted by an SI-DNN over a conventionally trained DNN, especially in low-data setups. △ Less

Submitted 10 November, 2021; v1 submitted 26 March, 2021; originally announced March 2021.

Comments: Accepted for publication at IEEE Trans. Power Systems

Enhancing Parameter-Free Frank Wolfe with an Extra Subproblem

Authors: Bingcong Li, Lingda Wang, Georgios B. Giannakis, Zhizhen Zhao

Abstract: Aiming at convex optimization under structural constraints, this work introduces and analyzes a variant of the Frank Wolfe (FW) algorithm termed ExtraFW. The distinct feature of ExtraFW is the pair of gradients leveraged per iteration, thanks to which the decision variable is updated in a prediction-correction (PC) format. Relying on no problem dependent parameters in the step sizes, the convergen… ▽ More Aiming at convex optimization under structural constraints, this work introduces and analyzes a variant of the Frank Wolfe (FW) algorithm termed ExtraFW. The distinct feature of ExtraFW is the pair of gradients leveraged per iteration, thanks to which the decision variable is updated in a prediction-correction (PC) format. Relying on no problem dependent parameters in the step sizes, the convergence rate of ExtraFW for general convex problems is shown to be ${\cal O}(\frac{1}{k})$, which is optimal in the sense of matching the lower bound on the number of solved FW subproblems. However, the merit of ExtraFW is its faster rate ${\cal O}\big(\frac{1}{k^2} \big)$ on a class of machine learning problems. Compared with other parameter-free FW variants that have faster rates on the same problems, ExtraFW has improved rates and fine-grained analysis thanks to its PC update. Numerical tests on binary classification with different sparsity-promoting constraints demonstrate that the empirical performance of ExtraFW is significantly better than FW, and even faster than Nesterov's accelerated gradient on certain datasets. For matrix completion, ExtraFW enjoys smaller optimality gap, and lower rank than FW. △ Less

Submitted 9 December, 2020; originally announced December 2020.

Comments: To appear in AAAI 2021. arXiv admin note: text overlap with arXiv:2006.11116

How Does Momentum Help Frank Wolfe?

Authors: Bingcong Li, Mario Coutino, Georgios B. Giannakis, Geert Leus

Abstract: We unveil the connections between Frank Wolfe (FW) type algorithms and the momentum in Accelerated Gradient Methods (AGM). On the negative side, these connections illustrate why momentum is unlikely to be effective for FW type algorithms. The encouraging message behind this link, on the other hand, is that momentum is useful for FW on a class of problems. In particular, we prove that a momentum va… ▽ More We unveil the connections between Frank Wolfe (FW) type algorithms and the momentum in Accelerated Gradient Methods (AGM). On the negative side, these connections illustrate why momentum is unlikely to be effective for FW type algorithms. The encouraging message behind this link, on the other hand, is that momentum is useful for FW on a class of problems. In particular, we prove that a momentum variant of FW, that we term accelerated Frank Wolfe (AFW), converges with a faster rate $\tilde{\cal O}(\frac{1}{k^2})$ on certain constraint sets despite the same ${\cal O}(\frac{1}{k})$ rate as FW on general cases. Given the possible acceleration of AFW at almost no extra cost, it is thus a competitive alternative to FW. Numerical experiments on benchmarked machine learning tasks further validate our theoretical findings. △ Less

Submitted 19 June, 2020; originally announced June 2020.

Time-Varying Convex Optimization: Time-Structured Algorithms and Applications

Authors: Andrea Simonetto, Emiliano Dall'Anese, Santiago Paternain, Geert Leus, Georgios B. Giannakis

Abstract: Optimization underpins many of the challenges that science and technology face on a daily basis. Recent years have witnessed a major shift from traditional optimization paradigms grounded on batch algorithms for medium-scale problems to challenging dynamic, time-varying, and even huge-size settings. This is driven by technological transformations that converted infrastructural and social platforms… ▽ More Optimization underpins many of the challenges that science and technology face on a daily basis. Recent years have witnessed a major shift from traditional optimization paradigms grounded on batch algorithms for medium-scale problems to challenging dynamic, time-varying, and even huge-size settings. This is driven by technological transformations that converted infrastructural and social platforms into complex and dynamic networked systems with even pervasive sensing and computing capabilities. The present paper reviews a broad class of state-of-the-art algorithms for time-varying optimization, with an eye to both algorithmic development and performance analysis. It offers a comprehensive overview of available tools and methods, and unveils open challenges in application domains of broad interest. The real-world examples presented include smart power systems, robotics, machine learning, and data analytics, highlighting domain-specific issues and solutions. The ultimate goal is to exempify wide engineering relevance of analytical tools and pertinent theoretical foundations. △ Less

Submitted 15 June, 2020; originally announced June 2020.

Comments: 14 pages, 6 figures; to appear in the Proceedings of the IEEE

Journal ref: Proceedings of the IEEE, vol 108 (11), pages 2032-2048, 2020

Finite-Sample Analysis of Decentralized Temporal-Difference Learning with Linear Function Approximation

Authors: Jun Sun, Gang Wang, Georgios B. Giannakis, Qinmin Yang, Zaiyue Yang

Abstract: Motivated by the emerging use of multi-agent reinforcement learning (MARL) in engineering applications such as networked robotics, swarming drones, and sensor networks, we investigate the policy evaluation problem in a fully decentralized setting, using temporal-difference (TD) learning with linear function approximation to handle large state spaces in practice. The goal of a group of agents is to… ▽ More Motivated by the emerging use of multi-agent reinforcement learning (MARL) in engineering applications such as networked robotics, swarming drones, and sensor networks, we investigate the policy evaluation problem in a fully decentralized setting, using temporal-difference (TD) learning with linear function approximation to handle large state spaces in practice. The goal of a group of agents is to collaboratively learn the value function of a given policy from locally private rewards observed in a shared environment, through exchanging local estimates with neighbors. Despite their simplicity and widespread use, our theoretical understanding of such decentralized TD learning algorithms remains limited. Existing results were obtained based on i.i.d. data samples, or by imposing an `additional' projection step to control the `gradient' bias incurred by the Markovian observations. In this paper, we provide a finite-sample analysis of the fully decentralized TD(0) learning under both i.i.d. as well as Markovian samples, and prove that all local estimates converge linearly to a small neighborhood of the optimum. The resultant error bounds are the first of its type---in the sense that they hold under the most practical assumptions ---which is made possible by means of a novel multi-step Lyapunov analysis. △ Less

Submitted 29 January, 2020; v1 submitted 3 November, 2019; originally announced November 2019.

Comments: 25 pages, 3 figures

Communication-Efficient Distributed Learning via Lazily Aggregated Quantized Gradients

Authors: Jun Sun, Tianyi Chen, Georgios B. Giannakis, Zaiyue Yang

Abstract: The present paper develops a novel aggregated gradient approach for distributed machine learning that adaptively compresses the gradient communication. The key idea is to first quantize the computed gradients, and then skip less informative quantized gradient communications by reusing outdated gradients. Quantizing and skip** result in `lazy' worker-server communications, which justifies the ter… ▽ More The present paper develops a novel aggregated gradient approach for distributed machine learning that adaptively compresses the gradient communication. The key idea is to first quantize the computed gradients, and then skip less informative quantized gradient communications by reusing outdated gradients. Quantizing and skip** result in `lazy' worker-server communications, which justifies the term Lazily Aggregated Quantized gradient that is henceforth abbreviated as LAQ. Our LAQ can provably attain the same linear convergence rate as the gradient descent in the strongly convex case, while effecting major savings in the communication overhead both in transmitted bits as well as in communication rounds. Empirically, experiments with real data corroborate a significant communication reduction compared to existing gradient- and stochastic gradient-based algorithms. △ Less

Submitted 17 September, 2019; originally announced September 2019.

Comments: Accepted in NeurIPS 2019

A Multistep Lyapunov Approach for Finite-Time Analysis of Biased Stochastic Approximation

Authors: Gang Wang, Bingcong Li, Georgios B. Giannakis

Abstract: Motivated by the widespread use of temporal-difference (TD-) and Q-learning algorithms in reinforcement learning, this paper studies a class of biased stochastic approximation (SA) procedures under a mild "ergodic-like" assumption on the underlying stochastic noise sequence. Building upon a carefully designed multistep Lyapunov function that looks ahead to several future updates to accommodate the… ▽ More Motivated by the widespread use of temporal-difference (TD-) and Q-learning algorithms in reinforcement learning, this paper studies a class of biased stochastic approximation (SA) procedures under a mild "ergodic-like" assumption on the underlying stochastic noise sequence. Building upon a carefully designed multistep Lyapunov function that looks ahead to several future updates to accommodate the stochastic perturbations (for control of the gradient bias), we prove a general result on the convergence of the iterates, and use it to derive non-asymptotic bounds on the mean-square error in the case of constant stepsizes. This novel looking-ahead viewpoint renders finite-time analysis of biased SA algorithms under a large family of stochastic perturbations possible. For direct comparison with existing contributions, we also demonstrate these bounds by applying them to TD- and Q-learning with linear function approximation, under the practical Markov chain observation model. The resultant finite-time error bound for both the TD- as well as the Q-learning algorithms is the first of its kind, in the sense that it holds i) for the unmodified versions (i.e., without making any modifications to the parameter updates) using even nonlinear function approximators; as well as for Markov chains ii) under general mixing conditions and iii) starting from any initial distribution, at least one of which has to be violated for existing results to be applicable. △ Less

Submitted 1 September, 2020; v1 submitted 10 September, 2019; originally announced September 2019.

Comments: 28 Pages

Almost Tune-Free Variance Reduction

Authors: Bingcong Li, Lingda Wang, Georgios B. Giannakis

Abstract: The variance reduction class of algorithms including the representative ones, SVRG and SARAH, have well documented merits for empirical risk minimization problems. However, they require grid search to tune parameters (step size and the number of iterations per inner loop) for optimal performance. This work introduces `almost tune-free' SVRG and SARAH schemes equipped with i) Barzilai-Borwein (BB)… ▽ More The variance reduction class of algorithms including the representative ones, SVRG and SARAH, have well documented merits for empirical risk minimization problems. However, they require grid search to tune parameters (step size and the number of iterations per inner loop) for optimal performance. This work introduces `almost tune-free' SVRG and SARAH schemes equipped with i) Barzilai-Borwein (BB) step sizes; ii) averaging; and, iii) the inner loop length adjusted to the BB step sizes. In particular, SVRG, SARAH, and their BB variants are first reexamined through an `estimate sequence' lens to enable new averaging methods that tighten their convergence rates theoretically, and improve their performance empirically when the step size or the inner loop length is chosen large. Then a simple yet effective means to adjust the number of iterations per inner loop is developed to enhance the merits of the proposed averaging schemes and BB step sizes. Numerical tests corroborate the proposed methods. △ Less

Submitted 10 June, 2020; v1 submitted 25 August, 2019; originally announced August 2019.

Journal ref: ICML 2020

On the Convergence of SARAH and Beyond

Authors: Bingcong Li, Meng Ma, Georgios B. Giannakis

Abstract: The main theme of this work is a unifying algorithm, \textbf{L}oop\textbf{L}ess \textbf{S}ARAH (L2S) for problems formulated as summation of $n$ individual loss functions. L2S broadens a recently developed variance reduction method known as SARAH. To find an $ε$-accurate solution, L2S enjoys a complexity of ${\cal O}\big( (n+κ) \ln (1/ε)\big)$ for strongly convex problems. For convex problems, whe… ▽ More The main theme of this work is a unifying algorithm, \textbf{L}oop\textbf{L}ess \textbf{S}ARAH (L2S) for problems formulated as summation of $n$ individual loss functions. L2S broadens a recently developed variance reduction method known as SARAH. To find an $ε$-accurate solution, L2S enjoys a complexity of ${\cal O}\big( (n+κ) \ln (1/ε)\big)$ for strongly convex problems. For convex problems, when adopting an $n$-dependent step size, the complexity of L2S is ${\cal O}(n+ \sqrt{n}/ε)$; while for more frequently adopted $n$-independent step size, the complexity is ${\cal O}(n+ n/ε)$. Distinct from SARAH, our theoretical findings support an $n$-independent step size in convex problems without extra assumptions. For nonconvex problems, the complexity of L2S is ${\cal O}(n+ \sqrt{n}/ε)$. Our numerical tests on neural networks suggest that L2S can have better generalization properties than SARAH. Along with L2S, our side results include the linear convergence of the last iteration for SARAH in strongly convex problems. △ Less

Submitted 16 January, 2020; v1 submitted 5 June, 2019; originally announced June 2019.

Tight Linear Convergence Rate of ADMM for Decentralized Optimization

Authors: Meng Ma, Bingcong Li, Georgios B. Giannakis

Abstract: The present paper considers leveraging network topology information to improve the convergence rate of ADMM for decentralized optimization, where networked nodes work collaboratively to minimize the objective. Such problems can be solved efficiently using ADMM via decomposing the objective into easier subproblems. Properly exploiting network topology can significantly improve the algorithm perform… ▽ More The present paper considers leveraging network topology information to improve the convergence rate of ADMM for decentralized optimization, where networked nodes work collaboratively to minimize the objective. Such problems can be solved efficiently using ADMM via decomposing the objective into easier subproblems. Properly exploiting network topology can significantly improve the algorithm performance. Hybrid ADMM explores the direction of exploiting node information by taking into account node centrality but fails to utilize edge information. This paper fills the gap by incorporating both node and edge information and provides a novel convergence rate bound for decentralized ADMM that explicitly depends on network topology. Such a novel bound is attainable for certain class of problems, thus tight. The explicit dependence further suggests possible directions to optimal design of edge weights to achieve the best performance. Numerical experiments show that simple heuristic methods could achieve better performance, and also exhibits robustness to topology changes. △ Less

Submitted 24 May, 2019; originally announced May 2019.

RSA: Byzantine-Robust Stochastic Aggregation Methods for Distributed Learning from Heterogeneous Datasets

Authors: Li** Li, Wei Xu, Tianyi Chen, Georgios B. Giannakis, Qing Ling

Abstract: In this paper, we propose a class of robust stochastic subgradient methods for distributed learning from heterogeneous datasets at presence of an unknown number of Byzantine workers. The Byzantine workers, during the learning process, may send arbitrary incorrect messages to the master due to data corruptions, communication failures or malicious attacks, and consequently bias the learned model. Th… ▽ More In this paper, we propose a class of robust stochastic subgradient methods for distributed learning from heterogeneous datasets at presence of an unknown number of Byzantine workers. The Byzantine workers, during the learning process, may send arbitrary incorrect messages to the master due to data corruptions, communication failures or malicious attacks, and consequently bias the learned model. The key to the proposed methods is a regularization term incorporated with the objective function so as to robustify the learning task and mitigate the negative effects of Byzantine attacks. The resultant subgradient-based algorithms are termed Byzantine-Robust Stochastic Aggregation methods, justifying our acronym RSA used henceforth. In contrast to most of the existing algorithms, RSA does not rely on the assumption that the data are independent and identically distributed (i.i.d.) on the workers, and hence fits for a wider class of applications. Theoretically, we show that: i) RSA converges to a near-optimal solution with the learning error dependent on the number of Byzantine workers; ii) the convergence rate of RSA under Byzantine attacks is the same as that of the stochastic gradient descent method, which is free of Byzantine attacks. Numerically, experiments on real dataset corroborate the competitive performance of RSA and a complexity reduction compared to the state-of-the-art alternatives. △ Less

Submitted 11 November, 2019; v1 submitted 8 November, 2018; originally announced November 2018.

Comments: To appear in AAAI 2019

Learning and Management for Internet-of-Things: Accounting for Adaptivity and Scalability

Authors: Tianyi Chen, Sergio Barbarossa, Xin Wang, Georgios B. Giannakis, Zhi-Li Zhang

Abstract: Internet-of-Things (IoT) envisions an intelligent infrastructure of networked smart devices offering task-specific monitoring and control services. The unique features of IoT include extreme heterogeneity, massive number of devices, and unpredictable dynamics partially due to human interaction. These call for foundational innovations in network design and management. Ideally, it should allow effic… ▽ More Internet-of-Things (IoT) envisions an intelligent infrastructure of networked smart devices offering task-specific monitoring and control services. The unique features of IoT include extreme heterogeneity, massive number of devices, and unpredictable dynamics partially due to human interaction. These call for foundational innovations in network design and management. Ideally, it should allow efficient adaptation to changing environments, and low-cost implementation scalable to massive number of devices, subject to stringent latency constraints. To this end, the overarching goal of this paper is to outline a unified framework for online learning and management policies in IoT through joint advances in communication, networking, learning, and optimization. From the network architecture vantage point, the unified framework leverages a promising fog architecture that enables smart devices to have proximity access to cloud functionalities at the network edge, along the cloud-to-things continuum. From the algorithmic perspective, key innovations target online approaches adaptive to different degrees of nonstationarity in IoT dynamics, and their scalable model-free implementation under limited feedback that motivates blind or bandit approaches. The proposed framework aspires to offer a step** stone that leads to systematic designs and analysis of task-specific learning and management schemes for IoT, along with a host of new research directions to build on. △ Less

Submitted 27 October, 2018; originally announced October 2018.

Comments: Submitted on June 15 to Proceeding of IEEE Special Issue on Adaptive and Scalable Communication Networks

Learning ReLU Networks on Linearly Separable Data: Algorithm, Optimality, and Generalization

Authors: Gang Wang, Georgios B. Giannakis, Jie Chen

Abstract: Neural networks with REctified Linear Unit (ReLU) activation functions (a.k.a. ReLU networks) have achieved great empirical success in various domains. Nonetheless, existing results for learning ReLU networks either pose assumptions on the underlying data distribution being e.g. Gaussian, or require the network size and/or training size to be sufficiently large. In this context, the problem of lea… ▽ More Neural networks with REctified Linear Unit (ReLU) activation functions (a.k.a. ReLU networks) have achieved great empirical success in various domains. Nonetheless, existing results for learning ReLU networks either pose assumptions on the underlying data distribution being e.g. Gaussian, or require the network size and/or training size to be sufficiently large. In this context, the problem of learning a two-layer ReLU network is approached in a binary classification setting, where the data are linearly separable and a hinge loss criterion is adopted. Leveraging the power of random noise perturbation, this paper presents a novel stochastic gradient descent (SGD) algorithm, which can \emph{provably} train any single-hidden-layer ReLU network to attain global optimality, despite the presence of infinitely many bad local minima, maxima, and saddle points in general. This result is the first of its kind, requiring no assumptions on the data distribution, training/network size, or initialization. Convergence of the resultant iterative algorithm to a global minimum is analyzed by establishing both an upper bound and a lower bound on the number of non-zero updates to be performed. Moreover, generalization guarantees are developed for ReLU networks trained with the novel SGD leveraging classic compression bounds. These guarantees highlight a key difference (at least in the worst case) between reliably learning a ReLU network as well as a leaky ReLU network in terms of sample complexity. Numerical tests using both synthetic data and real images validate the effectiveness of the algorithm and the practical merits of the theory. △ Less

Submitted 6 April, 2019; v1 submitted 14 August, 2018; originally announced August 2018.

Comments: 23 pages, 7 figures, work in progress

LAG: Lazily Aggregated Gradient for Communication-Efficient Distributed Learning

Authors: Tianyi Chen, Georgios B. Giannakis, Tao Sun, Wotao Yin

Abstract: This paper presents a new class of gradient methods for distributed machine learning that adaptively skip the gradient calculations to learn with reduced communication and computation. Simple rules are designed to detect slowly-varying gradients and, therefore, trigger the reuse of outdated gradients. The resultant gradient-based algorithms are termed Lazily Aggregated Gradient --- justifying our… ▽ More This paper presents a new class of gradient methods for distributed machine learning that adaptively skip the gradient calculations to learn with reduced communication and computation. Simple rules are designed to detect slowly-varying gradients and, therefore, trigger the reuse of outdated gradients. The resultant gradient-based algorithms are termed Lazily Aggregated Gradient --- justifying our acronym LAG used henceforth. Theoretically, the merits of this contribution are: i) the convergence rate is the same as batch gradient descent in strongly-convex, convex, and nonconvex smooth cases; and, ii) if the distributed datasets are heterogeneous (quantified by certain measurable constants), the communication rounds needed to achieve a targeted accuracy are reduced thanks to the adaptive reuse of lagged gradients. Numerical experiments on both synthetic and real data corroborate a significant communication reduction compared to alternatives. △ Less

Submitted 30 May, 2018; v1 submitted 24 May, 2018; originally announced May 2018.

Comments: Fix a typo in equation (11)

Fast Decentralized Optimization over Networks

Authors: Meng Ma, Athanasios N. Nikolakopoulos, Georgios B. Giannakis

Abstract: The present work introduces the hybrid consensus alternating direction method of multipliers (H-CADMM), a novel framework for optimization over networks which unifies existing distributed optimization approaches, including the centralized and the decentralized consensus ADMM. H-CADMM provides a flexible tool that leverages the underlying graph topology in order to achieve a desirable sweet-spot be… ▽ More The present work introduces the hybrid consensus alternating direction method of multipliers (H-CADMM), a novel framework for optimization over networks which unifies existing distributed optimization approaches, including the centralized and the decentralized consensus ADMM. H-CADMM provides a flexible tool that leverages the underlying graph topology in order to achieve a desirable sweet-spot between node-to-node communication overhead and rate of convergence -- thereby alleviating known limitations of both C-CADMM and D-CADMM. A rigorous analysis of the novel method establishes linear convergence rate, and also guides the choice of parameters to optimize this rate. The novel hybrid update rules of H-CADMM lend themselves to "in-network acceleration" that is shown to effect considerable -- and essentially "free-of-charge" -- performance boost over the fully decentralized ADMM. Comprehensive numerical tests validate the analysis and showcase the potential of the method in tackling efficiently, widely useful learning tasks. △ Less

Submitted 9 May, 2018; v1 submitted 6 April, 2018; originally announced April 2018.

Comments: fix error in remark 4; clean up algorithms 2

Compressive Phase Retrieval via Reweighted Amplitude Flow

Authors: Liang Zhang, Gang Wang, Georgios B. Giannakis, Jie Chen

Abstract: The problem of reconstructing a sparse signal vector from magnitude-only measurements (a.k.a., compressive phase retrieval), emerges naturally in diverse applications, but it is NP-hard in general. Building on recent advances in nonconvex optimization, this paper puts forth a new algorithm that is termed compressive reweighted amplitude flow and abbreviated as CRAF, for compressive phase retrieval… ▽ More The problem of reconstructing a sparse signal vector from magnitude-only measurements (a.k.a., compressive phase retrieval), emerges naturally in diverse applications, but it is NP-hard in general. Building on recent advances in nonconvex optimization, this paper puts forth a new algorithm that is termed compressive reweighted amplitude flow and abbreviated as CRAF, for compressive phase retrieval. Specifically, CRAF operates in two stages. The first stage seeks a sparse initial guess via a new spectral procedure. In the second stage, CRAF implements a few hard thresholding based iterations using reweighted gradients. When there are sufficient measurements, CRAF provably recovers the underlying signal vector exactly with high probability under suitable conditions. Moreover, its sample complexity coincides with that of the state-of-the-art procedures. Finally, substantial simulated tests showcase remarkable performance of the new spectral initialization, as well as improved exact recovery relative to competing alternatives. △ Less

Submitted 14 December, 2017; v1 submitted 6 December, 2017; originally announced December 2017.

PSSE Redux: Convex Relaxation, Decentralized, Robust, and Dynamic Approaches

Authors: Vassilis Kekatos, Gang Wang, Hao Zhu, Georgios B. Giannakis

Abstract: This chapter aspires to glean some of the recent advances in power system state estimation (PSSE), though our collection is not exhaustive by any means. The Cram{é}r-Rao bound, a lower bound on the (co)variance of any unbiased estimator, is first derived for the PSSE setup. After reviewing the classical Gauss-Newton iterations, contemporary PSSE solvers leveraging relaxations to convex programs an… ▽ More This chapter aspires to glean some of the recent advances in power system state estimation (PSSE), though our collection is not exhaustive by any means. The Cram{é}r-Rao bound, a lower bound on the (co)variance of any unbiased estimator, is first derived for the PSSE setup. After reviewing the classical Gauss-Newton iterations, contemporary PSSE solvers leveraging relaxations to convex programs and successive convex approximations are explored. A disciplined paradigm for distributed and decentralized schemes is subsequently exemplified under linear(ized) and exact grid models. Novel bad data processing models and fresh perspectives linking critical measurements to cyber-attacks on the state estimator are presented. Finally, spurred by advances in online convex optimization, model-free and model-based state trackers are reviewed. △ Less

Submitted 13 August, 2017; originally announced August 2017.

Comments: 43 Pages, 8 figures

Solving Almost all Systems of Random Quadratic Equations

Authors: Gang Wang, Georgios B. Giannakis, Yousef Saad, Jie Chen

Abstract: This paper deals with finding an $n$-dimensional solution $x$ to a system of quadratic equations of the form $y_i=|\langle{a}_i,x\rangle|^2$ for $1\le i \le m$, which is also known as phase retrieval and is NP-hard in general. We put forth a novel procedure for minimizing the amplitude-based least-squares empirical loss, that starts with a weighted maximal correlation initialization obtainable wit… ▽ More This paper deals with finding an $n$-dimensional solution $x$ to a system of quadratic equations of the form $y_i=|\langle{a}_i,x\rangle|^2$ for $1\le i \le m$, which is also known as phase retrieval and is NP-hard in general. We put forth a novel procedure for minimizing the amplitude-based least-squares empirical loss, that starts with a weighted maximal correlation initialization obtainable with a few power or Lanczos iterations, followed by successive refinements based upon a sequence of iteratively reweighted (generalized) gradient iterations. The two (both the initialization and gradient flow) stages distinguish themselves from prior contributions by the inclusion of a fresh (re)weighting regularization technique. The overall algorithm is conceptually simple, numerically scalable, and easy-to-implement. For certain random measurement models, the novel procedure is shown capable of finding the true solution $x$ in time proportional to reading the data $\{(a_i;y_i)\}_{1\le i \le m}$. This holds with high probability and without extra assumption on the signal $x$ to be recovered, provided that the number $m$ of equations is some constant $c>0$ times the number $n$ of unknowns in the signal vector, namely, $m>cn$. Empirically, the upshots of this contribution are: i) (almost) $100\%$ perfect signal recovery in the high-dimensional (say e.g., $n\ge 2,000$) regime given only an information-theoretic limit number of noiseless equations, namely, $m=2n-1$ in the real-valued Gaussian case; and, ii) (nearly) optimal statistical accuracy in the presence of additive noise of bounded support. Finally, substantial numerical tests using both synthetic data and real images corroborate markedly improved signal recovery performance and computational efficiency of our novel procedure relative to state-of-the-art approaches. △ Less

Submitted 29 May, 2017; originally announced May 2017.

Comments: 27 pages, 8 figures

An Online Convex Optimization Approach to Dynamic Network Resource Allocation

Authors: Tianyi Chen, Qing Ling, Georgios B. Giannakis

Abstract: Existing approaches to online convex optimization (OCO) make sequential one-slot-ahead decisions, which lead to (possibly adversarial) losses that drive subsequent decision iterates. Their performance is evaluated by the so-called regret that measures the difference of losses between the online solution and the best yet fixed overall solution in hindsight. The present paper deals with online conve… ▽ More Existing approaches to online convex optimization (OCO) make sequential one-slot-ahead decisions, which lead to (possibly adversarial) losses that drive subsequent decision iterates. Their performance is evaluated by the so-called regret that measures the difference of losses between the online solution and the best yet fixed overall solution in hindsight. The present paper deals with online convex optimization involving adversarial loss functions and adversarial constraints, where the constraints are revealed after making decisions, and can be tolerable to instantaneous violations but must be satisfied in the long term. Performance of an online algorithm in this setting is assessed by: i) the difference of its losses relative to the best dynamic solution with one-slot-ahead information of the loss function and the constraint (that is here termed dynamic regret); and, ii) the accumulated amount of constraint violations (that is here termed dynamic fit). In this context, a modified online saddle-point (MOSP) scheme is developed, and proved to simultaneously yield sub-linear dynamic regret and fit, provided that the accumulated variations of per-slot minimizers and constraints are sub-linearly growing with time. MOSP is also applied to the dynamic network resource allocation task, and it is compared with the well-known stochastic dual gradient method. Under various scenarios, numerical experiments demonstrate the performance gain of MOSP relative to the state-of-the-art. △ Less

Submitted 27 January, 2017; v1 submitted 14 January, 2017; originally announced January 2017.

Randomized Block Frank-Wolfe for Convergent Large-Scale Learning

Authors: Liang Zhang, Gang Wang, Daniel Romero, Georgios B. Giannakis

Abstract: Owing to their low-complexity iterations, Frank-Wolfe (FW) solvers are well suited for various large-scale learning tasks. When block-separable constraints are present, randomized block FW (RB-FW) has been shown to further reduce complexity by updating only a fraction of coordinate blocks per iteration. To circumvent the limitations of existing methods, the present work develops step sizes for RB-… ▽ More Owing to their low-complexity iterations, Frank-Wolfe (FW) solvers are well suited for various large-scale learning tasks. When block-separable constraints are present, randomized block FW (RB-FW) has been shown to further reduce complexity by updating only a fraction of coordinate blocks per iteration. To circumvent the limitations of existing methods, the present work develops step sizes for RB-FW that enable a flexible selection of the number of blocks to update per iteration while ensuring convergence and feasibility of the iterates. To this end, convergence rates of RB-FW are established through computational bounds on a primal sub-optimality measure and on the duality gap. The novel bounds extend the existing convergence analysis, which only applies to a step-size sequence that does not generally lead to feasible iterates. Furthermore, two classes of step-size sequences that guarantee feasibility of the iterates are also proposed to enhance flexibility in choosing decay rates. The novel convergence results are markedly broadened to encompass also nonconvex objectives, and further assert that RB-FW with exact line-search reaches a stationary point at rate $\mathcal{O}(1/\sqrt{t})$. Performance of RB-FW with different step sizes and number of blocks is demonstrated in two applications, namely charging of electrical vehicles and structural support vector machines. Extensive simulated tests demonstrate the performance improvement of RB-FW relative to existing randomized single-block FW methods. △ Less

Submitted 22 September, 2017; v1 submitted 26 December, 2016; originally announced December 2016.

Decentralized RLS with Data-Adaptive Censoring for Regressions over Large-Scale Networks

Authors: Zifeng Wang, Zheng Yu, Qing Ling, Dimitris Berberidis, Georgios B. Giannakis

Abstract: The deluge of networked data motivates the development of algorithms for computation- and communication-efficient information processing. In this context, three data-adaptive censoring strategies are introduced to considerably reduce the computation and communication overhead of decentralized recursive least-squares (D-RLS) solvers. The first relies on alternating minimization and the stochastic N… ▽ More The deluge of networked data motivates the development of algorithms for computation- and communication-efficient information processing. In this context, three data-adaptive censoring strategies are introduced to considerably reduce the computation and communication overhead of decentralized recursive least-squares (D-RLS) solvers. The first relies on alternating minimization and the stochastic Newton iteration to minimize a network-wide cost, which discards observations with small innovations. In the resultant algorithm, each node performs local data-adaptive censoring to reduce computations, while exchanging its local estimate with neighbors so as to consent on a network-wide solution. The communication cost is further reduced by the second strategy, which prevents a node from transmitting its local estimate to neighbors when the innovation it induces to incoming data is minimal. In the third strategy, not only transmitting, but also receiving estimates from neighbors is prohibited when data-adaptive censoring is in effect. For all strategies, a simple criterion is provided for selecting the threshold of innovation to reach a prescribed average data reduction. The novel censoring-based (C)D-RLS algorithms are proved convergent to the optimal argument in the mean-square deviation sense. Numerical experiments validate the effectiveness of the proposed algorithms in reducing computation and communication overhead. △ Less

Submitted 12 January, 2018; v1 submitted 25 December, 2016; originally announced December 2016.

Comments: Part of this paper has appeared at the 42nd Intl. Conf. on Acoustics, Speech, and Signal Processing, New Orleans, USA, March 5-9, 2017

Scheduling of EV Battery Swap**, II: Distributed Solutions

Authors: Pengcheng You, Steven H. Low, Liang Zhang, Ruilong Deng, Georgios B. Giannakis, Youxian Sun, Zaiyue Yang

Abstract: In Part I of this paper we formulate an optimal scheduling problem for battery swap** that assigns to each electric vehicle (EV) a best station to swap its depleted battery based on its current location and state of charge. The schedule aims to minimize a weighted sum of total travel distance and generation cost over both station assignments and power flow variables, subject to EV range constrai… ▽ More In Part I of this paper we formulate an optimal scheduling problem for battery swap** that assigns to each electric vehicle (EV) a best station to swap its depleted battery based on its current location and state of charge. The schedule aims to minimize a weighted sum of total travel distance and generation cost over both station assignments and power flow variables, subject to EV range constraints, grid operational constraints and AC power flow equations. We propose there a centralized solution based on the second-order cone programming (SOCP) relaxation of optimal power flow (OPF) and generalized Benders decomposition that is suitable when global information is available. In this paper we propose two distributed solutions based on the alternating direction method of multipliers (ADMM) and dual decomposition respectively that are suitable for cases where the distribution grid, battery stations and EVs are managed by separate entities. Our algorithms allow these entities to make individual decisions but coordinate through privacy-preserving information exchanges to jointly solve an approximate version of the joint battery swap** scheduling and OPF problem. We evaluate our algorithms through simulations. △ Less

Submitted 30 November, 2016; originally announced November 2016.

Sparse Phase Retrieval via Truncated Amplitude Flow

Authors: Gang Wang, Liang Zhang, Georgios B. Giannakis, Mehmet Akcakaya, Jie Chen

Abstract: This paper develops a novel algorithm, termed \emph{SPARse Truncated Amplitude flow} (SPARTA), to reconstruct a sparse signal from a small number of magnitude-only measurements. It deals with what is also known as sparse phase retrieval (PR), which is \emph{NP-hard} in general and emerges in many science and engineering applications. Upon formulating sparse PR as an amplitude-based nonconvex optim… ▽ More This paper develops a novel algorithm, termed \emph{SPARse Truncated Amplitude flow} (SPARTA), to reconstruct a sparse signal from a small number of magnitude-only measurements. It deals with what is also known as sparse phase retrieval (PR), which is \emph{NP-hard} in general and emerges in many science and engineering applications. Upon formulating sparse PR as an amplitude-based nonconvex optimization task, SPARTA works iteratively in two stages: In stage one, the support of the underlying sparse signal is recovered using an analytically well-justified rule, and subsequently, a sparse orthogonality-promoting initialization is obtained via power iterations restricted on the support; and, in the second stage, the initialization is successively refined by means of hard thresholding based gradient-type iterations. SPARTA is a simple yet effective, scalable, and fast sparse PR solver. On the theoretical side, for any $n$-dimensional $k$-sparse ($k\ll n$) signal $\bm{x}$ with minimum (in modulus) nonzero entries on the order of $(1/\sqrt{k})\|\bm{x}\|_2$, SPARTA recovers the signal exactly (up to a global unimodular constant) from about $k^2\log n$ random Gaussian measurements with high probability. Furthermore, SPARTA incurs computational complexity on the order of $k^2n\log n$ with total runtime proportional to the time required to read the data, which improves upon the state-of-the-art by at least a factor of $k$. Finally, SPARTA is robust against additive noise of bounded support. Extensive numerical tests corroborate markedly improved recovery performance and speedups of SPARTA relative to existing alternatives. △ Less

Submitted 30 October, 2017; v1 submitted 22 November, 2016; originally announced November 2016.

Comments: 23 pages; 5 figures

Solving Large-scale Systems of Random Quadratic Equations via Stochastic Truncated Amplitude Flow

Authors: Gang Wang, Georgios B. Giannakis, Jie Chen

Abstract: A novel approach termed \emph{stochastic truncated amplitude flow} (STAF) is developed to reconstruct an unknown $n$-dimensional real-/complex-valued signal $\bm{x}$ from $m$ `phaseless' quadratic equations of the form $ψ_i=|\langle\bm{a}_i,\bm{x}\rangle|$. This problem, also known as phase retrieval from magnitude-only information, is \emph{NP-hard} in general. Adopting an amplitude-based nonconv… ▽ More A novel approach termed \emph{stochastic truncated amplitude flow} (STAF) is developed to reconstruct an unknown $n$-dimensional real-/complex-valued signal $\bm{x}$ from $m$ `phaseless' quadratic equations of the form $ψ_i=|\langle\bm{a}_i,\bm{x}\rangle|$. This problem, also known as phase retrieval from magnitude-only information, is \emph{NP-hard} in general. Adopting an amplitude-based nonconvex formulation, STAF leads to an iterative solver comprising two stages: s1) Orthogonality-promoting initialization through a stochastic variance reduced gradient algorithm; and, s2) A series of iterative refinements of the initialization using stochastic truncated gradient iterations. Both stages involve a single equation per iteration, thus rendering STAF a simple, scalable, and fast approach amenable to large-scale implementations that is useful when $n$ is large. When $\{\bm{a}_i\}_{i=1}^m$ are independent Gaussian, STAF provably recovers exactly any $\bm{x}\in\mathbb{R}^n$ exponentially fast based on order of $n$ quadratic equations. STAF is also robust in the presence of additive noise of bounded support. Simulated tests involving real Gaussian $\{\bm{a}_i\}$ vectors demonstrate that STAF empirically reconstructs any $\bm{x}\in\mathbb{R}^n$ exactly from about $2.3n$ magnitude-only measurements, outperforming state-of-the-art approaches and narrowing the gap from the information-theoretic number of equations $m=2n-1$. Extensive experiments using synthetic data and real images corroborate markedly improved performance of STAF over existing alternatives. △ Less

Submitted 29 October, 2016; originally announced October 2016.

Comments: 21 pages, 12 figures

Stochastic Averaging for Constrained Optimization with Application to Online Resource Allocation

Authors: Tianyi Chen, Aryan Mokhtari, Xin Wang, Alejandro Ribeiro, Georgios B. Giannakis

Abstract: Existing approaches to resource allocation for nowadays stochastic networks are challenged to meet fast convergence and tolerable delay requirements. The present paper leverages online learning advances to facilitate stochastic resource allocation tasks. By recognizing the central role of Lagrange multipliers, the underlying constrained optimization problem is formulated as a machine learning task… ▽ More Existing approaches to resource allocation for nowadays stochastic networks are challenged to meet fast convergence and tolerable delay requirements. The present paper leverages online learning advances to facilitate stochastic resource allocation tasks. By recognizing the central role of Lagrange multipliers, the underlying constrained optimization problem is formulated as a machine learning task involving both training and operational modes, with the goal of learning the sought multipliers in a fast and efficient manner. To this end, an order-optimal offline learning approach is developed first for batch training, and it is then generalized to the online setting with a procedure termed learn-and-adapt. The novel resource allocation protocol permeates benefits of stochastic approximation and statistical learning to obtain low-complexity online updates with learning errors close to the statistical accuracy limits, while still preserving adaptation performance, which in the stochastic network optimization context guarantees queue stability. Analysis and simulated tests demonstrate that the proposed data-driven approach improves the delay and convergence performance of existing resource allocation schemes. △ Less

Submitted 26 February, 2017; v1 submitted 7 October, 2016; originally announced October 2016.

Two-Timescale Stochastic Dispatch of Smart Distribution Grids

Authors: Luis M. Lopez-Ramos, Vassilis Kekatos, Antonio G. Marques, Georgios B. Giannakis

Abstract: Smart distribution grids should efficiently integrate stochastic renewable resources while effecting voltage regulation. The design of energy management schemes is challenging, one of the reasons being that energy management is a multistage problem where decisions are not all made at the same timescale and must account for the variability during real-time operation. The joint dispatch of slow- and… ▽ More Smart distribution grids should efficiently integrate stochastic renewable resources while effecting voltage regulation. The design of energy management schemes is challenging, one of the reasons being that energy management is a multistage problem where decisions are not all made at the same timescale and must account for the variability during real-time operation. The joint dispatch of slow- and fast-timescale controls in a smart distribution grid is considered here. The substation voltage, the energy exchanged with a main grid, and the generation schedules for small diesel generators have to be decided on a slow timescale; whereas optimal photovoltaic inverter setpoints are found on a more frequent basis. While inverter and looser voltage regulation limits are imposed at all times, tighter bus voltage constraints are enforced on the average or in probability, thus enabling more efficient renewable integration. Upon reformulating the two-stage grid dispatch as a stochastic convex-concave problem, two distribution-free schemes are put forth. An average dispatch algorithm converges provably to the optimal two-stage decisions via a sequence of convex quadratic programs. Its non-convex probabilistic alternative entails solving two slightly different convex problems and is numerically shown to converge. Numerical tests on a real-world distribution feeder verify that both novel data-driven schemes yield lower costs over competing alternatives. △ Less

Submitted 17 August, 2016; originally announced August 2016.

Comments: 8 pages, 5 figures, submitted to IEEE Transactions on Smart Grid

Learning Power Spectrum Maps from Quantized Power Measurements

Authors: Daniel Romero, Seung-Jun Kim, Georgios B. Giannakis, Roberto Lopez-Valcarce

Abstract: Power spectral density (PSD) maps providing the distribution of RF power across space and frequency are constructed using power measurements collected by a network of low-cost sensors. By introducing linear compression and quantization to a small number of bits, sensor measurements can be communicated to the fusion center with minimal bandwidth requirements. Strengths of data- and model-driven app… ▽ More Power spectral density (PSD) maps providing the distribution of RF power across space and frequency are constructed using power measurements collected by a network of low-cost sensors. By introducing linear compression and quantization to a small number of bits, sensor measurements can be communicated to the fusion center with minimal bandwidth requirements. Strengths of data- and model-driven approaches are combined to develop estimators capable of incorporating multiple forms of spectral and propagation prior information while fitting the rapid variations of shadow fading across space. To this end, novel nonparametric and semiparametric formulations are investigated. It is shown that PSD maps can be obtained using support vector machine-type solvers. In addition to batch approaches, an online algorithm attuned to real-time operation is developed. Numerical tests assess the performance of the novel algorithms. △ Less

Submitted 5 March, 2017; v1 submitted 6 June, 2016; originally announced June 2016.

Comments: Submitted Jun. 2016

Solving Systems of Random Quadratic Equations via Truncated Amplitude Flow

Authors: Gang Wang, Georgios B. Giannakis, Yonina C. Eldar

Abstract: This paper presents a new algorithm, termed \emph{truncated amplitude flow} (TAF), to recover an unknown vector $\bm{x}$ from a system of quadratic equations of the form $y_i=|\langle\bm{a}_i,\bm{x}\rangle|^2$, where $\bm{a}_i$'s are given random measurement vectors. This problem is known to be \emph{NP-hard} in general. We prove that as soon as the number of equations is on the order of the numbe… ▽ More This paper presents a new algorithm, termed \emph{truncated amplitude flow} (TAF), to recover an unknown vector $\bm{x}$ from a system of quadratic equations of the form $y_i=|\langle\bm{a}_i,\bm{x}\rangle|^2$, where $\bm{a}_i$'s are given random measurement vectors. This problem is known to be \emph{NP-hard} in general. We prove that as soon as the number of equations is on the order of the number of unknowns, TAF recovers the solution exactly (up to a global unimodular constant) with high probability and complexity growing linearly with both the number of unknowns and the number of equations. Our TAF approach adopts the \emph{amplitude-based} empirical loss function, and proceeds in two stages. In the first stage, we introduce an \emph{orthogonality-promoting} initialization that can be obtained with a few power iterations. Stage two refines the initial estimate by successive updates of scalable \emph{truncated generalized gradient iterations}, which are able to handle the rather challenging nonconvex and nonsmooth amplitude-based objective function. In particular, when vectors $\bm{x}$ and $\bm{a}_i$'s are real-valued, our gradient truncation rule provably eliminates erroneously estimated signs with high probability to markedly improve upon its untruncated version. Numerical tests using synthetic data and real images demonstrate that our initialization returns more accurate and robust estimates relative to spectral initializations. Furthermore, even under the same initialization, the proposed amplitude-based refinement outperforms existing Wirtinger flow variants, corroborating the superior performance of TAF over state-of-the-art algorithms. △ Less

Submitted 20 August, 2017; v1 submitted 26 May, 2016; originally announced May 2016.

Comments: 37 Pages, 16 figures

Two-Scale Stochastic Control for Multipoint Communication Systems with Renewables

Authors: Xin Wang, Xiao**g Chen, Tianyi Chen, Longbo Huang, Georgios B. Giannakis

Abstract: Increasing threats of global warming and climate changes call for an energy-efficient and sustainable design of future wireless communication systems. To this end, a novel two-scale stochastic control framework is put forth for smart-grid powered coordinated multi-point (CoMP) systems. Taking into account renewable energy sources (RES), dynamic pricing, two-way energy trading facilities and imperf… ▽ More Increasing threats of global warming and climate changes call for an energy-efficient and sustainable design of future wireless communication systems. To this end, a novel two-scale stochastic control framework is put forth for smart-grid powered coordinated multi-point (CoMP) systems. Taking into account renewable energy sources (RES), dynamic pricing, two-way energy trading facilities and imperfect energy storage devices, the energy management task is formulated as an infinite-horizon optimization problem minimizing the time-average energy transaction cost, subject to the users' quality of service (QoS) requirements. Leveraging the Lyapunov optimization approach as well as the stochastic subgradient method, a two-scale online control (TS-OC) approach is developed for the resultant smart-grid powered CoMP systems. Using only historical data, the proposed TS-OC makes online control decisions at two timescales, and features a provably feasible and asymptotically near-optimal solution. Numerical tests further corroborate the theoretical analysis, and demonstrate the merits of the proposed approach. △ Less

Submitted 19 August, 2016; v1 submitted 28 February, 2016; originally announced February 2016.

Comments: 10 pages, 7 figures

Scalable Electric Vehicle Charging Protocols

Authors: Liang Zhang, Vassilis Kekatos, Georgios B. Giannakis

Abstract: Although electric vehicles are considered a viable solution to reduce greenhouse gas emissions, their uncoordinated charging could have adverse effects on power system operation. Nevertheless, the task of optimal electric vehicle charging scales unfavorably with the fleet size and the number of control periods, especially when distribution grid limitations are enforced. To this end, vehicle chargi… ▽ More Although electric vehicles are considered a viable solution to reduce greenhouse gas emissions, their uncoordinated charging could have adverse effects on power system operation. Nevertheless, the task of optimal electric vehicle charging scales unfavorably with the fleet size and the number of control periods, especially when distribution grid limitations are enforced. To this end, vehicle charging is first tackled using the recently revived Frank-Wolfe method. The novel decentralized charging protocol has minimal computational requirements from vehicle controllers, enjoys provable acceleration over existing alternatives, enhances the security of the pricing mechanism against data attacks, and protects user privacy. To comply with voltage limits, a network-constrained EV charging problem is subsequently formulated. Leveraging a linearized model for unbalanced distribution grids, the goal is to minimize the power supply cost while respecting critical voltage regulation and substation capacity limitations. Optimizing variables across grid nodes is accomplished by exchanging information only between neighboring buses via the alternating direction method of multipliers. Numerical tests corroborate the optimality and efficiency of the novel schemes. △ Less

Submitted 17 January, 2016; v1 submitted 1 October, 2015; originally announced October 2015.

Voltage Regulation Algorithms for Multiphase Power Distribution Grids

Authors: Vassilis Kekatos, Liang Zhang, Georgios B. Giannakis, Ross Baldick

Abstract: Time-varying renewable energy generation can result in serious under-/over-voltage conditions in future distribution grids. Augmenting conventional utility-owned voltage regulating equipment with the reactive power capabilities of distributed generation units is a viable solution. Local control options attaining global voltage regulation optimality at fast convergence rates is the goal here. In th… ▽ More Time-varying renewable energy generation can result in serious under-/over-voltage conditions in future distribution grids. Augmenting conventional utility-owned voltage regulating equipment with the reactive power capabilities of distributed generation units is a viable solution. Local control options attaining global voltage regulation optimality at fast convergence rates is the goal here. In this context, novel reactive power control rules are analyzed under a unifying linearized grid model. For single-phase grids, our proximal gradient scheme has computational complexity comparable to that of the rule suggested by the IEEE 1547.8 standard, but it enjoys well-characterized convergence guarantees. Adding memory to the scheme results in accelerated convergence. For three-phase grids, it is shown that reactive injections have a counter-intuitive effect on bus voltage magnitudes across phases. Nevertheless, when our control scheme is applied to unbalanced conditions, it is shown to reach an equilibrium point. Yet this point may not correspond to the minimizer of a voltage regulation problem. Numerical tests using the IEEE 13-bus, the IEEE 123-bus, and a Southern California Edison 47-bus feeder with increased renewable penetration verify the convergence properties of the schemes and their resiliency to grid topology reconfigurations. △ Less

Submitted 26 August, 2015; originally announced August 2015.

Robust Smart-Grid Powered Cooperative Multipoint Systems

Authors: Xin Wang, Yu Zhang, Georgios B. Giannakis, Shuyan Hu

Abstract: A framework is introduced to integrate renewable energy sources (RES) and dynamic pricing capabilities of the smart grid into beamforming designs for coordinated multi-point (CoMP) downlink communication systems. To this end, novel models are put forth to account for harvesting, storage of nondispatchable RES, time-varying energy pricing, as well as stochastic wireless channels. Building on these… ▽ More A framework is introduced to integrate renewable energy sources (RES) and dynamic pricing capabilities of the smart grid into beamforming designs for coordinated multi-point (CoMP) downlink communication systems. To this end, novel models are put forth to account for harvesting, storage of nondispatchable RES, time-varying energy pricing, as well as stochastic wireless channels. Building on these models, robust energy management and transmit-beamforming designs are developed to minimize the worst-case energy cost subject to the worst-case user QoS guarantees for the CoMP downlink. Leveraging pertinent tools, this task is formulated as a convex problem. A Lagrange dual based subgradient iteration is then employed to find the desired optimal energy-management strategy and transmit-beamforming vectors. Numerical results are provided to demonstrate the merits of the proposed robust designs. △ Less

Submitted 7 June, 2015; originally announced June 2015.

Comments: 11 pages, 12 figures

Distributed Stochastic Market Clearing with High-Penetration Wind Power

Authors: Yu Zhang, Georgios B. Giannakis

Abstract: Integrating renewable energy into the modern power grid requires risk-cognizant dispatch of resources to account for the stochastic availability of renewables. Toward this goal, day-ahead stochastic market clearing with high-penetration wind energy is pursued in this paper based on the DC optimal power flow (OPF). The objective is to minimize the social cost which consists of conventional generati… ▽ More Integrating renewable energy into the modern power grid requires risk-cognizant dispatch of resources to account for the stochastic availability of renewables. Toward this goal, day-ahead stochastic market clearing with high-penetration wind energy is pursued in this paper based on the DC optimal power flow (OPF). The objective is to minimize the social cost which consists of conventional generation costs, end-user disutility, as well as a risk measure of the system re-dispatching cost. Capitalizing on the conditional value-at-risk (CVaR), the novel model is able to mitigate the potentially high risk of the recourse actions to compensate wind forecast errors. The resulting convex optimization task is tackled via a distribution-free sample average based approximation to bypass the prohibitively complex high-dimensional integration. Furthermore, to cope with possibly large-scale dispatchable loads, a fast distributed solver is developed with guaranteed convergence using the alternating direction method of multipliers (ADMM). Numerical results tested on a modified benchmark system are reported to corroborate the merits of the novel framework and proposed approaches. △ Less

Submitted 13 April, 2015; originally announced April 2015.

Comments: To appear in IEEE Transactions on Power Systems; 12 pages and 9 figures

Decentralized learning for wireless communications and networking

Authors: Georgios B. Giannakis, Qing Ling, Gonzalo Mateos, Ioannis D. Schizas, Hao Zhu

Abstract: This chapter deals with decentralized learning algorithms for in-network processing of graph-valued data. A generic learning problem is formulated and recast into a separable form, which is iteratively minimized using the alternating-direction method of multipliers (ADMM) so as to gain the desired degree of parallelization. Without exchanging elements from the distributed training sets and kee**… ▽ More This chapter deals with decentralized learning algorithms for in-network processing of graph-valued data. A generic learning problem is formulated and recast into a separable form, which is iteratively minimized using the alternating-direction method of multipliers (ADMM) so as to gain the desired degree of parallelization. Without exchanging elements from the distributed training sets and kee** inter-node communications at affordable levels, the local (per-node) learners consent to the desired quantity inferred globally, meaning the one obtained if the entire training data set were centrally available. Impact of the decentralized learning framework to contemporary wireless communications and networking tasks is illustrated through case studies including target tracking using wireless sensor networks, unveiling Internet traffic anomalies, power system state estimation, as well as spectrum cartography for wireless cognitive radio networks. △ Less

Submitted 30 March, 2015; originally announced March 2015.

Comments: Contributed chapter to appear in Splitting Methods in Communication and Imaging, Science and Engineering, R. Glowinski, S. Osher, and W. Yin, Editors, New York, Springer, 2015

Photovoltaic Inverter Controllers Seeking AC Optimal Power Flow Solutions

Authors: Emiliano Dall'Anese, Sairaj V. Dhople, Georgios B. Giannakis

Abstract: This paper considers future distribution networks featuring inverter-interfaced photovoltaic (PV) systems, and addresses the synthesis of feedback controllers that seek real- and reactive-power inverter setpoints corresponding to AC optimal power flow (OPF) solutions. The objective is to bridge the temporal gap between long-term system optimization and real-time inverter control, and enable seamle… ▽ More This paper considers future distribution networks featuring inverter-interfaced photovoltaic (PV) systems, and addresses the synthesis of feedback controllers that seek real- and reactive-power inverter setpoints corresponding to AC optimal power flow (OPF) solutions. The objective is to bridge the temporal gap between long-term system optimization and real-time inverter control, and enable seamless PV-owner participation without compromising system efficiency and stability. The design of the controllers is grounded on a dual epsilon-subgradient method, and semidefinite programming relaxations are advocated to bypass the non-convexity of AC OPF formulations. Global convergence of inverter output powers is analytically established for diminishing stepsize rules and strictly convex OPF costs for cases where: i) computational limits dictate asynchronous updates of the controller signals, and ii) inverter reference inputs may be updated at a faster rate than the power-output settling time. Although the focus is on PV systems, the framework naturally accommodates different types of inverter-interfaced energy resources. △ Less

Submitted 6 August, 2015; v1 submitted 31 December, 2014; originally announced January 2015.

Comments: Accepted for publication on IEEE Transactions on Power Systems

Online Energy Price Matrix Factorization for Power Grid Topology Tracking

Authors: Vassilis Kekatos, Georgios B. Giannakis, Ross Baldick

Abstract: Grid security and open markets are two major smart grid goals. Transparency of market data facilitates a competitive and efficient energy environment, yet it may also reveal critical physical system information. Recovering the grid topology based solely on publicly available market data is explored here. Real-time energy prices are calculated as the Lagrange multipliers of network-constrained econ… ▽ More Grid security and open markets are two major smart grid goals. Transparency of market data facilitates a competitive and efficient energy environment, yet it may also reveal critical physical system information. Recovering the grid topology based solely on publicly available market data is explored here. Real-time energy prices are calculated as the Lagrange multipliers of network-constrained economic dispatch; that is, via a linear program (LP) typically solved every 5 minutes. Granted the grid Laplacian is a parameter of this LP, one could infer such a topology-revealing matrix upon observing successive LP dual outcomes. The matrix of spatio-temporal prices is first shown to factor as the product of the inverse Laplacian times a sparse matrix. Leveraging results from sparse matrix decompositions, topology recovery schemes with complementary strengths are subsequently formulated. Solvers scalable to high-dimensional and streaming market data are devised. Numerical validation using real load data on the IEEE 30-bus grid provide useful input for current and future market designs. △ Less

Submitted 22 October, 2014; originally announced October 2014.

Comments: Submitted to the IEEE Trans. on Smart Grid

An Efficient Primal-Dual Approach to Chance-Constrained Economic Dispatch

Authors: Gabriela Martinez, Yu Zhang, Georgios B. Giannakis

Abstract: To effectively enhance the integration of distributed and renewable energy sources in future smart microgrids, economical energy management accounting for the principal challenge of the variable and non-dispatchable renewables is indispensable and of significant importance. Day-ahead economic generation dispatch with demand-side management for a microgrid in islanded mode is considered in this pap… ▽ More To effectively enhance the integration of distributed and renewable energy sources in future smart microgrids, economical energy management accounting for the principal challenge of the variable and non-dispatchable renewables is indispensable and of significant importance. Day-ahead economic generation dispatch with demand-side management for a microgrid in islanded mode is considered in this paper. With the goal of limiting the risk of the loss-of-load probability, a joint chance constrained optimization problem is formulated for the optimal multi-period energy scheduling with multiple wind farms. Bypassing the intractable spatio-temporal joint distribution of the wind power generation, a primal-dual approach is used to obtain a suboptimal solution efficiently. The method is based on first-order optimality conditions and successive approximation of the probabilistic constraint by generation of p-efficient points. Numerical results are reported to corroborate the merits of this approach. △ Less

Submitted 17 October, 2014; originally announced October 2014.

Comments: Appeared in 2014 North American Power Symposium

Regulation of Dynamical Systems to Optimal Solutions of Semidefinite Programs: Algorithms and Applications to AC Optimal Power Flow

Authors: Emiliano Dall'Anese, Sairaj Dhople, Georgios B. Giannakis

Abstract: This paper considers a collection of networked nonlinear dynamical systems, and addresses the synthesis of feedback controllers that seek optimal operating points corresponding to the solution of network-wide constrained optimization problems. Particular emphasis is placed on the solution of semidefinite programs (SDPs). The design of the feedback controller is grounded on a dual epsilon-subgradie… ▽ More This paper considers a collection of networked nonlinear dynamical systems, and addresses the synthesis of feedback controllers that seek optimal operating points corresponding to the solution of network-wide constrained optimization problems. Particular emphasis is placed on the solution of semidefinite programs (SDPs). The design of the feedback controller is grounded on a dual epsilon-subgradient approach, with the dual iterates utilized to dynamically update the dynamical-system reference signals. Global convergence is guaranteed for diminishing stepsize rules, even when the reference inputs are updated at a faster rate than the dynamical-system settling time. The application of the proposed framework to the control of power-electronic inverters in AC distribution systems is discussed. The objective is to bridge the time-scale separation between real-time inverter control and network-wide optimization. Optimization objectives assume the form of SDP relaxations of prototypical AC optimal power flow problems. △ Less

Submitted 2 April, 2015; v1 submitted 26 September, 2014; originally announced September 2014.

Comments: This is a longer version of a paper submitted to the 2015 American Control Conference. This version contains proofs and additional numerical results

Stochastic Reactive Power Management in Microgrids with Renewables

Authors: Vassilis Kekatos, Gang Wang, Antonio J. Conejo, Georgios B. Giannakis

Abstract: Distribution microgrids are being challenged by reverse power flows and voltage fluctuations due to renewable generation, demand response, and electric vehicles. Advances in photovoltaic (PV) inverters offer new opportunities for reactive power management provided PV owners have the right investment incentives. In this context, reactive power compensation is considered here as an ancillary service… ▽ More Distribution microgrids are being challenged by reverse power flows and voltage fluctuations due to renewable generation, demand response, and electric vehicles. Advances in photovoltaic (PV) inverters offer new opportunities for reactive power management provided PV owners have the right investment incentives. In this context, reactive power compensation is considered here as an ancillary service. Accounting for the increasing time-variability of distributed generation and demand, a stochastic reactive power compensation scheme is developed. Given uncertain active power injections, an online reactive control scheme is devised. This scheme is distribution-free and relies solely on power injection data. Reactive injections are updated using the Lagrange multipliers of a second-order cone program. Numerical tests on an industrial 47-bus microgrid and the residential IEEE 123-bus feeder corroborate the reactive power management efficiency of the novel stochastic scheme over its deterministic alternative, as well as its capability to track variations in solar generation and household demand. △ Less

Submitted 13 November, 2014; v1 submitted 23 September, 2014; originally announced September 2014.

Comments: Accepted in the IEEE Trans. on Power Systems

Optimal Dispatch of Residential Photovoltaic Inverters Under Forecasting Uncertainties

Authors: Emiliano Dall'Anese, Sairaj V. Dhople, Brian B. Johnson, Georgios B. Giannakis

Abstract: Efforts to ensure reliable operation of existing low-voltage distribution systems with high photovoltaic (PV) generation have focused on the possibility of inverters providing ancillary services such as active power curtailment and reactive power compensation. Major benefits include the possibility of averting overvoltages, which may otherwise be experienced when PV generation exceeds the demand.… ▽ More Efforts to ensure reliable operation of existing low-voltage distribution systems with high photovoltaic (PV) generation have focused on the possibility of inverters providing ancillary services such as active power curtailment and reactive power compensation. Major benefits include the possibility of averting overvoltages, which may otherwise be experienced when PV generation exceeds the demand. This paper deals with ancillary service procurement in the face of solar irradiance forecasting errors. In particular, assuming that the forecasted PV irradiance can be described by a random variable with known (empirical) distribution, the proposed uncertainty-aware optimal inverter dispatch (OID) framework indicates which inverters should provide ancillary services with a guaranteed a-priori risk level of PV generation surplus. To capture forecasting errors, and strike a balance between risk of overvoltages and (re)active power reserves, the concept of conditional value-at-risk is advocated. Due to AC power balance equations and binary inverter selection variables, the formulated OID involves the solution of a nonconvex mixed-integer nonlinear program. However, a computationally-affordable convex relaxation is derived by leveraging sparsity-promoting regularization approaches and semidefinite relaxation techniques. The proposed scheme is tested using real-world PV-generation and load-profile data for an illustrative low-voltage residential distribution system. △ Less

Submitted 7 November, 2014; v1 submitted 2 July, 2014; originally announced July 2014.

Comments: To appear in the IEEE Journal of Photovoltaics in December 2014

Decentralized Optimal Dispatch of Photovoltaic Inverters in Residential Distribution Systems

Authors: Emiliano Dall'Anese, Sairaj V. Dhople, Brian B. Johnson, Georgios B. Giannakis

Abstract: Decentralized methods for computing optimal real and reactive power setpoints for residential photovoltaic (PV) inverters are developed in this paper. It is known that conventional PV inverter controllers, which are designed to extract maximum power at unity power factor, cannot address secondary performance objectives such as voltage regulation and network loss minimization. Optimal power flow te… ▽ More Decentralized methods for computing optimal real and reactive power setpoints for residential photovoltaic (PV) inverters are developed in this paper. It is known that conventional PV inverter controllers, which are designed to extract maximum power at unity power factor, cannot address secondary performance objectives such as voltage regulation and network loss minimization. Optimal power flow techniques can be utilized to select which inverters will provide ancillary services, and to compute their optimal real and reactive power setpoints. Leveraging advances in semidefinite relaxation techniques and sparsity-promoting regularizations, such problems can be solved with reduced computational burden and with optimality guarantees. To enable large-scale implementation, a novel algorithmic framework is introduced - based on the so-called alternating direction method of multipliers - by which the optimal power flow problem in this setting can be systematically decomposed into sub-problems that can be solved in a decentralized fashion by the utility and customer-owned PV systems with limited exchanges of information. Since the computational burden is shared among multiple devices and the requirement of all-to-all communication can be circumvented, the proposed optimization approach scales to large distribution networks. △ Less

Submitted 11 September, 2014; v1 submitted 5 March, 2014; originally announced March 2014.

Comments: Accepted for publication to IEEE Transactions on Energy Conversion

Efficient Decentralized Economic Dispatch for Microgrids with Wind Power Integration

Authors: Yu Zhang, Georgios B. Giannakis

Abstract: Decentralized energy management is of paramount importance in smart microgrids with renewables for various reasons including environmental friendliness, reduced communication overhead, and resilience to failures. In this context, the present work deals with distributed economic dispatch and demand response initiatives for grid-connected microgrids with high-penetration of wind power. To cope with… ▽ More Decentralized energy management is of paramount importance in smart microgrids with renewables for various reasons including environmental friendliness, reduced communication overhead, and resilience to failures. In this context, the present work deals with distributed economic dispatch and demand response initiatives for grid-connected microgrids with high-penetration of wind power. To cope with the challenge of the wind's intrinsically stochastic availability, a novel energy planning approach involving the actual wind energy as well as the energy traded with the main grid, is introduced. A stochastic optimization problem is formulated to minimize the microgrid net cost, which includes conventional generation cost as well as the expected transaction cost incurred by wind uncertainty. To bypass the prohibitively high-dimensional integration involved, an efficient sample average approximation method is utilized to obtain a solver with guaranteed convergence. Leveraging the special infrastructure of the microgrid, a decentralized algorithm is further developed via the alternating direction method of multipliers. Case studies are tested to corroborate the merits of the novel approaches. △ Less

Submitted 23 January, 2014; originally announced January 2014.

Comments: To appear in IEEE GreenTech 2014. Submitted Sept. 2013; accepted Dec. 2013

Robust Optimal Power Flow with Wind Integration Using Conditional Value-at-Risk

Authors: Yu Zhang, Georgios B. Giannakis

Abstract: Integrating renewable energy into the power grid requires intelligent risk-aware dispatch accounting for the stochastic availability of renewables. Toward achieving this goal, a robust DC optimal flow problem is developed in the present paper for power systems with a high penetration of wind energy. The optimal dispatch is obtained as the solution to a convex program with a suitable regularizer, w… ▽ More Integrating renewable energy into the power grid requires intelligent risk-aware dispatch accounting for the stochastic availability of renewables. Toward achieving this goal, a robust DC optimal flow problem is developed in the present paper for power systems with a high penetration of wind energy. The optimal dispatch is obtained as the solution to a convex program with a suitable regularizer, which is able to mitigate the potentially high risk of inadequate wind power. The regularizer is constructed based on the energy transaction cost using conditional value-at-risk (CVaR). Bypassing the prohibitive high-dimensional integral, the distribution-free sample average approximation method is efficiently utilized for solving the resulting optimization problem. Case studies are reported to corroborate the efficacy of the novel model and approach tested on the IEEE 30-bus benchmark system with real operation data from seven wind farms. △ Less

Submitted 27 October, 2013; originally announced October 2013.

Comments: To Appear in Proc. of the 4th Intl. Conf. on Smart Grid Communications

Disaggregated Bundle Methods for Distributed Market Clearing in Power Networks

Authors: Yu Zhang, Nikolaos Gatsis, Georgios B. Giannakis

Abstract: A fast distributed approach is developed for the market clearing with large-scale demand response in electric power networks. In addition to conventional supply bids, demand offers from aggregators serving large numbers of residential smart appliances with different energy constraints are incorporated. Leveraging the Lagrangian relaxation based dual decomposition, the resulting optimization proble… ▽ More A fast distributed approach is developed for the market clearing with large-scale demand response in electric power networks. In addition to conventional supply bids, demand offers from aggregators serving large numbers of residential smart appliances with different energy constraints are incorporated. Leveraging the Lagrangian relaxation based dual decomposition, the resulting optimization problem is decomposed into separate subproblems, and then solved in a distributed fashion by the market operator and each aggregator aided by the end-user smart meters. A disaggregated bundle method is adapted for solving the dual problem with a separable structure. Compared with the conventional dual update algorithms, the proposed approach exhibits faster convergence speed, which results in reduced communication overhead. Numerical results corroborate the effectiveness of the novel approach. △ Less

Submitted 2 October, 2013; originally announced October 2013.

Comments: To appear in GlobalSIP 2013

Optimal Dispatch of Photovoltaic Inverters in Residential Distribution Systems

Authors: Emiliano Dall'Anese, Sairaj V. Dhople, Georgios B. Giannakis

Abstract: Low-voltage distribution feeders were designed to sustain unidirectional power flows to residential neighborhoods. The increased penetration of roof-top photovoltaic (PV) systems has highlighted pressing needs to address power quality and reliability concerns, especially when PV generation exceeds the household demand. A systematic method for determining the active- and reactive-power set points f… ▽ More Low-voltage distribution feeders were designed to sustain unidirectional power flows to residential neighborhoods. The increased penetration of roof-top photovoltaic (PV) systems has highlighted pressing needs to address power quality and reliability concerns, especially when PV generation exceeds the household demand. A systematic method for determining the active- and reactive-power set points for PV inverters in residential systems is proposed in this paper, with the objective of optimizing the operation of the distribution feeder and ensuring voltage regulation. Binary PV-inverter selection variables and nonlinear power-flow relations render the novel optimal inverter dispatch problem nonconvex and NP-hard. Nevertheless, sparsity-promoting regularization approaches and semidefinite relaxation techniques are leveraged to obtain a computationally feasible convex reformulation. The merits of the proposed approach are demonstrated using real-world PV-generation and load-profile data for an illustrative low-voltage residential distribution system. △ Less

Submitted 3 January, 2014; v1 submitted 14 July, 2013; originally announced July 2013.

Risk-Constrained Microgrid Reconfiguration Using Group Sparsity

Authors: Emiliano Dall'Anese, Georgios B. Giannakis

Abstract: The system reconfiguration task is considered for existing power distribution systems and microgrids, in the presence of renewable-based generation and load foresting errors. The system topology is obtained by solving a chance-constrained optimization problem, where loss-of-load (LOL) constraints and Ampacity limits of the distribution lines are enforced. Similar to various distribution system rec… ▽ More The system reconfiguration task is considered for existing power distribution systems and microgrids, in the presence of renewable-based generation and load foresting errors. The system topology is obtained by solving a chance-constrained optimization problem, where loss-of-load (LOL) constraints and Ampacity limits of the distribution lines are enforced. Similar to various distribution system reconfiguration renditions, solving the resultant problem is computationally prohibitive due to the presence of binary line selection variables. Further, lack of closed form expressions for the joint probability distribution of forecasting errors hinders tractability of LOL constraints. Nevertheless, a convex problem re-formulation is developed here by resorting to a scenario approximation technique, and by leveraging the underlying group-sparsity attribute of currents flowing on distribution lines equipped with tie and sectionalizing switches. The novel convex LOL-constrained reconfiguration scheme can also afford a distributed solution using the alternating direction method of multipliers, to address the case where multi-facilities are managed autonomously from the rest of the system. △ Less

Submitted 16 May, 2014; v1 submitted 7 June, 2013; originally announced June 2013.

Comments: The paper will appear in IEEE Transactions on Sustainable Energy (accepted May 2014)

Risk-Aware Management of Distributed Energy Resources

Authors: Yu Zhang, Nikolaos Gatsis, Vassilis Kekatos, Georgios B. Giannakis

Abstract: High wind energy penetration critically challenges the economic dispatch of current and future power systems. Supply and demand must be balanced at every bus of the grid, while respecting transmission line ratings and accounting for the stochastic nature of renewable energy sources. Aligned to that goal, a network-constrained economic dispatch is developed in this paper. To account for the uncerta… ▽ More High wind energy penetration critically challenges the economic dispatch of current and future power systems. Supply and demand must be balanced at every bus of the grid, while respecting transmission line ratings and accounting for the stochastic nature of renewable energy sources. Aligned to that goal, a network-constrained economic dispatch is developed in this paper. To account for the uncertainty of renewable energy forecasts, wind farm schedules are determined so that they can be delivered over the transmission network with a prescribed probability. Given that the distribution of wind power forecasts is rarely known, and/or uncertainties may yield non-convex feasible sets for the power schedules, a scenario approximation technique using Monte Carlo sampling is pursued. Upon utilizing the structure of the DC optimal power flow (OPF), a distribution-free convex problem formulation is derived whose complexity scales well with the wind forecast sample size. The efficacy of this novel approach is evaluated over the IEEE 30-bus power grid benchmark after including real operation data from seven wind farms. △ Less

Submitted 27 May, 2013; originally announced May 2013.

Comments: To appear in Proc. of 18th Intl. Conf. on DSP, Santorini Island, Greece, July 1-3, 2013

Sparsity-leveraging Reconfiguration of Smart Distribution Systems

Authors: Emiliano Dall'Anese, Georgios B. Giannakis

Abstract: A system reconfiguration problem is considered for three-phase power distribution networks featuring distributed generation. In lieu of binary line selection variables, the notion of group sparsity is advocated to re-formulate the nonconvex distribution system reconfiguration (DSR) problem into a convex one. Using the duality theory, it is shown that the line selection task boils down to a shrinka… ▽ More A system reconfiguration problem is considered for three-phase power distribution networks featuring distributed generation. In lieu of binary line selection variables, the notion of group sparsity is advocated to re-formulate the nonconvex distribution system reconfiguration (DSR) problem into a convex one. Using the duality theory, it is shown that the line selection task boils down to a shrinkage and thresholding operation on the line currents. Further, numerical tests illustrate the ability of the proposed scheme to identify meshed, weakly-meshed, or even radial configurations by adjusting a sparsity-tuning parameter in the DSR cost. Constraints on the voltages are investigated, and incorporated in the novel DSR problem to effect voltage regulation. △ Less

Submitted 31 January, 2014; v1 submitted 22 March, 2013; originally announced March 2013.

Comments: This is a longer version of a paper that will be published on IEEE Transactions of Power Delivery. This longer version contains proofs and additional numerical results