Showing 1–18 of 18 results for author: Chapman, A C

Fair Coordination of Distributed Energy Resources with Volt-Var Control and PV Curtailment

Authors: Daniel Gebbran, Sleiman Mhanna, Yiju Ma, Archie C. Chapman, Gregor Verbic

Abstract: This paper presents a novel distributed optimal power flow (DOPF) method for fair distributed energy resource (DER) coordination in the context of mandated rooftop PV inverter control modes. In practice, inverter reactive power control is increasingly required by grid connection codes, which often unfairly curtail PV generation of prosumers towards the end of low-voltage feeders. Similarly, optimi… ▽ More This paper presents a novel distributed optimal power flow (DOPF) method for fair distributed energy resource (DER) coordination in the context of mandated rooftop PV inverter control modes. In practice, inverter reactive power control is increasingly required by grid connection codes, which often unfairly curtail PV generation of prosumers towards the end of low-voltage feeders. Similarly, optimization-based DER coordination methods that aim solely for technically-efficient DER coordination do not consider the distribution of PV curtailment across customers. To address these concerns, we develop a tractable multi-objective DOPF method for optimal DER coordination that (i) curtails PV generation fairly across prosumers, and (ii) incorporates a standard piecewise-linear volt-var control reactive power control function without using integer variables. Three equity principles representing different interpretations of fairness are implemented in our coordination method; namely, egalitarian, proportional and uniform dynamic PV curtailment redistribution. The performance of our approach is demonstrated on low-voltage distribution feeders of different sizes (5, 10, 25, 50 and 100 prosumers) using two network topologies: line topology without lateral spurs and tree topology with lateral spurs. Each network considers three levels of PV penetration, giving 30 test systems in total. The results demonstrate the effectiveness of the proposed DOPF method for fair DER coordination: PV curtailment is equitably distributed among prosumers with a computational burden on par with conventional DOPF approaches. Moreover, different fairness methods result in different patterns of curtailment, which a regulator may choose between. △ Less

Submitted 9 March, 2022; originally announced March 2022.

Journal ref: Applied Energy, Volume 286, 15 March 2021, 116546

Practical Considerations of DER Coordination with Distributed Optimal Power Flow

Authors: Daniel Gebbran, Sleiman Mhanna, Archie C. Chapman, Wibowo Hardjawana, Branka Vucetic, Gregor Verbic

Abstract: The coordination of prosumer-owned, behind-the-meter distributed energy resources (DER) can be achieved using a multiperiod, distributed optimal power flow (DOPF), which satisfies network constraints and preserves the privacy of prosumers. To solve the problem in a distributed fashion, it is decomposed and solved using the alternating direction method of multipliers (ADMM), which may require many… ▽ More The coordination of prosumer-owned, behind-the-meter distributed energy resources (DER) can be achieved using a multiperiod, distributed optimal power flow (DOPF), which satisfies network constraints and preserves the privacy of prosumers. To solve the problem in a distributed fashion, it is decomposed and solved using the alternating direction method of multipliers (ADMM), which may require many iterations between prosumers and the central entity (i.e., an aggregator). Furthermore, the computational burden is shared among the agents with different processing capacities. Therefore, computational constraints and communication requirements may make the DOPF infeasible or impractical. In this paper, part of the DOPF (some of the prosumer subproblems) is executed on a Raspberry Pi-based hardware prototype, which emulates a low processing power, edge computing device. Four important aspects are analyzed using test cases of different complexities. The first is the computation cost of executing the subproblems in the edge computing device. The second is the algorithm operation on congested electrical networks, which impacts the convergence speed of DOPF solutions. Third, the precision of the computed solution, including the trade-off between solution quality and the number of iterations, is examined. Fourth, the communication requirements for implementation across different communication networks are investigated. The above metrics are analyzed in four scenarios involving 26-bus and 51-bus networks. △ Less

Submitted 9 March, 2022; originally announced March 2022.

Journal ref: 2020 International Conference on Smart Grids and Energy Systems (SGES), 2020

Can phase change materials in building insulation improve self-consumption of residential rooftop solar? An Australian case study

Authors: Zahra Rahimpour, Gregor Verbic, Archie C. Chapman

Abstract: This work investigates the extent to which phase change material (PCM) in the building's envelope can be used as an alternative to battery storage systems to increase self-consumption of rooftop solar photovoltaic (PV) generation. In particular, we explore the electricity cost-savings and increase in PV self-consumption that can be achieved by using PCMs and the operation of the heating, ventilati… ▽ More This work investigates the extent to which phase change material (PCM) in the building's envelope can be used as an alternative to battery storage systems to increase self-consumption of rooftop solar photovoltaic (PV) generation. In particular, we explore the electricity cost-savings and increase in PV self-consumption that can be achieved by using PCMs and the operation of the heating, ventilation, and air conditioning (HVAC) system optimised by a home energy management system (HEMS). In more detail, we consider a HEMS with an HVAC system, rooftop PV, and a PCM layer integrated into the building envelope. The objective of the HEMS optimisation is to minimise electricity costs while maximising PV self-consumption and maintaining the indoor building temperature in a preferred comfort range. Solving this problem is challenging due to PCM's nonlinear characteristics, and using methods that can deal with the resulting non-convexity of the optimisation problem, like dynamic programming is computationally expensive. Therefore, we use multi-timescale approximate dynamic programming (MADP) that we developed in our earlier work to explore a number of Australian PCM scenarios. Specifically, we analyse a large number of residential buildings across five Australian capital cities. We find that using PCM can reduce annual electricity costs by between 10.6% in Brisbane and 19% in Adelaide. However, somewhat surprisingly, using PCM reduces PV self-consumption by between 1.5% in Brisbane and 2.7% in Perth. △ Less

Submitted 9 November, 2021; originally announced November 2021.

The spatiotemporal tau statistic: a review

Authors: Timothy M. Pollington, Michael J. Tildesley, T. Déirdre Hollingsworth, Lloyd A. C. Chapman

Abstract: Introduction The tau statistic is a recent second-order correlation function that can assess the magnitude and range of global spatiotemporal clustering from epidemiological data containing geolocations of individual cases and, usually, disease onset times. This is the first review of its use, and the aspects of its computation and presentation that could affect inferences drawn and bias estimat… ▽ More Introduction The tau statistic is a recent second-order correlation function that can assess the magnitude and range of global spatiotemporal clustering from epidemiological data containing geolocations of individual cases and, usually, disease onset times. This is the first review of its use, and the aspects of its computation and presentation that could affect inferences drawn and bias estimates of the statistic. Methods Using Google Scholar we searched papers or preprints that cited the papers that first defined/reformed the statistic. We tabulated their key characteristics to understand the statistic's development since 2012. Results Only half of the 16 studies found were considered to be using true tau statistics, but their inclusion in the review still provided important insights into their analysis motivations. All papers that used graphical hypothesis testing and parameter estimation used incorrect methods. There is a lack of clarity over how to choose the time-relatedness interval to relate cases and the distance band set, that are both required to calculate the statistic. Some studies demonstrated nuanced applications of the tau statistic in settings with unusual data or time relation variables, which enriched understanding of its possibilities. A gap was noticed in the estimators available to account for variable person-time at risk. Discussion Our review comprehensively covers current uses of the tau statistic for descriptive analysis, graphical hypothesis testing, and parameter estimation of spatiotemporal clustering. We also define a new estimator of the tau statistic for disease rates. For the tau statistic there are still open questions on its implementation which we hope this review inspires others to research. △ Less

Submitted 1 December, 2019; v1 submitted 26 November, 2019; originally announced November 2019.

Comments: Corresponding author is Timothy M. Pollington. Equal contributions by T. Déirdre Hollingsworth and Lloyd A. C. Chapman. 42 pgs, 7866 words, 1 fig., 1 table. Right-to-reply date added, refs' DoI links shortened

Developments in statistical inference when assessing spatiotemporal disease clustering with the tau statistic

Authors: Timothy M. Pollington, Michael J. Tildesley, T. Déirdre Hollingsworth, Lloyd A. C. Chapman

Abstract: The tau statistic $τ$ uses geolocation and, usually, symptom onset time to assess global spatiotemporal clustering from epidemiological data. We test different factors that could affect graphical hypothesis tests of clustering or bias clustering range estimates based on the statistic, by comparison with a baseline analysis of an open access measles dataset. From re-analysing this data we find th… ▽ More The tau statistic $τ$ uses geolocation and, usually, symptom onset time to assess global spatiotemporal clustering from epidemiological data. We test different factors that could affect graphical hypothesis tests of clustering or bias clustering range estimates based on the statistic, by comparison with a baseline analysis of an open access measles dataset. From re-analysing this data we find that the spatial bootstrap sampling method used to construct the confidence interval for the tau estimate and confidence interval (CI) type can bias clustering range estimates. We suggest that the bias-corrected and accelerated (BCa) CI is essential for asymmetric sample bootstrap distributions of tau estimates. We also find evidence against no spatiotemporal clustering, $p$-value $\in$ [0,0.014] (global envelope test). We develop a tau-specific modification of the Loh & Stein spatial bootstrap sampling method, which gives more precise bootstrapped tau estimates and a 20% higher estimated clustering endpoint than previously published (36.0m; 95% BCa CI (14.9, 46.6), vs 30m) and an equivalent increase in the clustering area of elevated disease odds by 44%. What appears a modest radial bias in the range estimate is more than doubled on the areal scale, which public health resources are proportional to. This difference could have important consequences for control. Correct practice of hypothesis testing of no clustering and clustering range estimation of the tau statistic are illustrated in the Graphical abstract. We advocate proper implementation of this useful statistic, ultimately to reduce inaccuracies in control policy decisions made during disease clustering analysis. △ Less

Submitted 9 March, 2020; v1 submitted 18 November, 2019; originally announced November 2019.

Comments: Corresponding author is Timothy M. Pollington. Equal contributions by T. Déirdre Hollingsworth and Lloyd A. C. Chapman. Accepted by Spatial Statistics (7 Mch 2020). 43 pp, 4180 words, 11 figs, 1 graphical abstract. Changes: This is our post-print after refereeing prior to proof; Title; Clarity in Methods esp. spatial bootstrap**; Non-essentials moved to appendices; Public GitHub repo; Figs

A Turvey-Shapley Value Method for Distribution Network Cost Allocation

Authors: Donald Azuatalam, Archie C. Chapman, Gregor Verbič

Abstract: This paper proposes a novel cost-reflective and computationally efficient method for allocating distribution network costs to residential customers. First, the method estimates the growth in peak demand with a 50% probability of exceedance (50POE) and the associated network augmentation costs using a probabilistic long-run marginal cost computation based on the Turvey perturbation method. Second,… ▽ More This paper proposes a novel cost-reflective and computationally efficient method for allocating distribution network costs to residential customers. First, the method estimates the growth in peak demand with a 50% probability of exceedance (50POE) and the associated network augmentation costs using a probabilistic long-run marginal cost computation based on the Turvey perturbation method. Second, it allocates these costs to customers on a cost-causal basis using the Shapley value solution concept. To overcome the intractability of the exact Shapley value computation for real-world applications, we implement a fast, scalable and efficient clustering technique based on customers' peak demand contribution, which drastically reduces the Shapley value computation time. Using customer load traces from an Australian smart grid trial (Solar Home Electricity Data), we demonstrate the efficacy of our method by comparing it with established energy- and peak demand-based cost allocation approaches. △ Less

Submitted 3 September, 2019; originally announced September 2019.

Macro-action Multi-time scale Dynamic Programming for Energy Management in Buildings with Phase Change Materials

Authors: Zahra Rahimpour, Gregor Verbic, Archie C. Chapman

Abstract: This paper focuses on energy management in buildings with phase change material (PCM), which is primarily used to improve thermal performance, but can also serve as an energy storage system. In this setting, optimal scheduling of an HVAC system is challenging because of the nonlinear and non-convex characteristics of the PCM, which makes solving the corresponding optimization problem using convent… ▽ More This paper focuses on energy management in buildings with phase change material (PCM), which is primarily used to improve thermal performance, but can also serve as an energy storage system. In this setting, optimal scheduling of an HVAC system is challenging because of the nonlinear and non-convex characteristics of the PCM, which makes solving the corresponding optimization problem using conventional optimization techniques impractical. Instead, we use dynamic programming (DP) to deal with the nonlinear nature of the PCM. To overcome DP's curse of dimensionality, this paper proposes a novel methodology to reduce the computational burden, while maintaining the quality of the solution. Specifically, the method incorporates approaches from sequential decision making in artificial intelligence, including macro actions and multi-time scale Markov decision processes, coupled with an underlying state-space approximation to reduce the state-space and action-space size. The performance of the method is demonstrated on an energy management problem for a typical residential building located in Sydney, Australia. The results demonstrate that the proposed method performs well with a computational speed-up of up to 12,900 times compared to the direct application of DP. △ Less

Submitted 10 December, 2019; v1 submitted 11 June, 2019; originally announced June 2019.

Energy management of small-scale PV-battery systems: A systematic review considering practical implementation, computational requirements, quality of input data and battery degradation

Authors: Donald Azuatalam, Kaveh Paridari, Yiju Ma, Markus Förstl, Archie C. Chapman, Gregor Verbič

Abstract: The home energy management problem has many different facets, including economic viability, data uncertainty and quality of strategy employed. The existing literature in this area focuses on individual aspects of this problem without a detailed, holistic analysis of the results with regards to practicality in implementation. In this paper, we fill this gap by performing a comprehensive comparison… ▽ More The home energy management problem has many different facets, including economic viability, data uncertainty and quality of strategy employed. The existing literature in this area focuses on individual aspects of this problem without a detailed, holistic analysis of the results with regards to practicality in implementation. In this paper, we fill this gap by performing a comprehensive comparison of seven different energy management strategies, each with different levels of practicality, sophistication and computational requirements. We analyse the results in the context of these three characteristics, and also critique the modelling assumptions made by each strategy. Our analysis finds that using a more sophisticated energy management strategy may not necessarily improve the performance and economic viability of the PV-battery system due to the effects of modeling assumptions, such as the treatment of uncertainties in the input data and battery degradation effects. △ Less

Submitted 23 May, 2019; originally announced May 2019.

Probabilistic assessment of the impact of flexible loads under network tariffs in low voltage distribution networks

Authors: Donald Azuatalam, Archie C. Chapman, Gregor Verbič

Abstract: Given the historically static nature of low-voltage networks, distribution network companies do not possess tools for dealing with an increasingly variable demand due to the high penetration of distributed energy resources (DER). Within this context, this paper proposes a probabilistic framework for tariff design that minimises the impact of DER on network performance, stabilise network company re… ▽ More Given the historically static nature of low-voltage networks, distribution network companies do not possess tools for dealing with an increasingly variable demand due to the high penetration of distributed energy resources (DER). Within this context, this paper proposes a probabilistic framework for tariff design that minimises the impact of DER on network performance, stabilise network company revenue, and improves the equity of network costs allocation. To address the issue of the lack of customers' response, we also show how DER-specific tariffs can be complemented with an automated home energy management system (HEMS) that reduces peak demand while retaining the desired comfort level. The proposed framework comprises a nonparametric Bayesian model which statistically generates synthetic load and PV traces, a hot-water-use statistical model, a novel HEMS to schedule customers' controllable devices, and a probabilistic power-flow model. Test cases using both energy- and demand-based network tariffs show that flat tariffs with a peak demand component reduce the customers' cost, and alleviate network constraints. This demonstrates, first, the efficacy of the proposed tool for the development of tariffs that are beneficial for networks with a high DER penetration, and second, how customers' HEM systems can be part of the solution. △ Less

Submitted 17 July, 2020; v1 submitted 3 October, 2018; originally announced October 2018.

Impacts of Community and Distributed Energy Storage Systems on Unbalanced Low Voltage Networks

Authors: Yiju Ma, Mohammad Seydali Seyf Abad, Donald Azuatalam, Gregor Verbic, Archie. C. Chapman

Abstract: Energy storage systems (EES) are expected to be an indispensable resource for mitigating the effects on networks of high penetrations of distributed generation in the near future. This paper analyzes the benefits of EES in unbalanced low voltage (LV) networks regarding three aspects, namely, power losses, the hosting capacity and network unbalance. For doing so, a mixed integer quadratic programmm… ▽ More Energy storage systems (EES) are expected to be an indispensable resource for mitigating the effects on networks of high penetrations of distributed generation in the near future. This paper analyzes the benefits of EES in unbalanced low voltage (LV) networks regarding three aspects, namely, power losses, the hosting capacity and network unbalance. For doing so, a mixed integer quadratic programmming model (MIQP) is developed to minimize annual energy losses and determine the sizing and placement of ESS, while satisfying voltage constraints. A real unbalanced LV UK grid is adopted to examine the effects of ESS under two scenarios: the installation of one community ESS (CESS) and multiple distributed ESSs (DESSs). The results illustrate that both scenarios present high performance in accomplishing the above tasks, while DESSs, with the same aggregated size, are slightly better. This margin is expected to be amplified as the aggregated size of DESSs increases. △ Less

Submitted 20 September, 2018; originally announced September 2018.

Comments: 6 pages, 4 figures, conference paper

A Novel Probabilistic Framework to Study the Impact of PV-battery Systems on Low-Voltage Distribution Networks

Authors: Yiju Ma, Donald Azuatalam, Thomas Power, Gregor Verbic, Archie C. Chapman

Abstract: Battery storage, particularly residential battery storage coupled with rooftop PV, is emerging as an essential component of the smart grid technology mix. However, including battery storage and other flexible resources like electric vehicles and loads with thermal inertia into a probabilistic analysis based on Monte Carlo (MC) simulation is challenging, because their operational profiles are deter… ▽ More Battery storage, particularly residential battery storage coupled with rooftop PV, is emerging as an essential component of the smart grid technology mix. However, including battery storage and other flexible resources like electric vehicles and loads with thermal inertia into a probabilistic analysis based on Monte Carlo (MC) simulation is challenging, because their operational profiles are determined by computationally intensive optimization. Additionally, MC analysis requires a large pool of statistically-representative demand profiles to sample from. As a result, the analysis of the network impact of PV-battery systems has attracted little attention in the existing literature. To fill these knowledge gaps, this paper proposes a novel probabilistic framework to study the impact of PV-battery systems on low-voltage distribution networks. Specifically, the framework incorporates home energy management(HEM) operational decisions within the MC time series power flow analysis. First, using available smart meter data, we use a Bayesian nonparametric model to generate statistically-representative synthetic demand and PV profiles. Second, a policy function approximation that emulates battery scheduling decisions is used to make the simulation of optimization-based HEM feasible within the MC framework. The efficacy of our method is demonstrated on three representative low-voltage feeders, where the computation time to execute our MC framework is 5% of that when using explicit optimization methods in each MC sample. The assessment results show that uncoordinated battery scheduling has a limited beneficial impact, which is against the conjecture that batteries will serendipitously mitigate the technical problems induced by PV generation. △ Less

Submitted 12 April, 2019; v1 submitted 20 September, 2018; originally announced September 2018.

Comments: 10 pages, 7 figures

A Nonparametric Bayesian Methodology for Synthesizing Residential Solar Generation and Demand Data

Authors: Thomas Power, Gregor Verbič, Archie C. Chapman

Abstract: The uptake of behind-the-meter distributed energy resources in low-voltage distribution networks has reached a level where network issues have started to emerge, which requires new tools for operation and planning. In this paper, we propose a methodology for synthesizing stochastic demand and generation profiles for unobserved customers with rooftop PV, called prosumers. The proposed model bridges… ▽ More The uptake of behind-the-meter distributed energy resources in low-voltage distribution networks has reached a level where network issues have started to emerge, which requires new tools for operation and planning. In this paper, we propose a methodology for synthesizing stochastic demand and generation profiles for unobserved customers with rooftop PV, called prosumers. The proposed model bridges the gap between the limited available empirical data, and the large amount of high-quality, stochastic demand and generation data required for probabilistic analysis. The approach employs clustering analysis and a Dirichlet-categorical hierarchical model of the features of unobserved prosumers. Based on the data of clusters of prosumers, Markov chain models of demand and generation profiles are constructed from empirical data, and synthetic demand profiles are subsequently sampled from these. The sampled traces are cross-validated and show a good statistical fit to the observed data. Two case studies are considered to confirm the validity of the proposed methodology. The first studies the impact of behavioral differences on the synthetic demand profiles, while the second looks at the impact of varying solar generation penetration on demand profiles. △ Less

Submitted 18 December, 2018; v1 submitted 1 August, 2018; originally announced August 2018.

Computationally Efficient Market Simulation Tool for Future Grid Scenario Analysis

Authors: Shariq Riaz, Gregor Verbic, Archie C. Chapman

Abstract: The paper proposes a computationally efficient electricity market simulation tool (MST) suitable for future grid scenario analysis. The market model is based on a unit commitment (UC) problem and takes into account the uptake of emerging technologies, like demand response, battery storage, concentrated solar thermal generation, and HVDC transmission lines. To allow for a subsequent stability asses… ▽ More The paper proposes a computationally efficient electricity market simulation tool (MST) suitable for future grid scenario analysis. The market model is based on a unit commitment (UC) problem and takes into account the uptake of emerging technologies, like demand response, battery storage, concentrated solar thermal generation, and HVDC transmission lines. To allow for a subsequent stability assessment, the MST requires an explicit representation of the number of online generation units, which affects powers system inertia and reactive power support capability. These requirements render a fullfledged UC model computationally intractable, so we propose unit clustering, rolling horizon approach, and constraint reduction to increase the computational efficiency. To showcase the capability of the proposed tool, we use a simplified model of the Australian National Electricity Market with different penetrations of renewable generation. The results show that the number of online units resulting from the proposed tool is very close to the binary UC run over a week-long horizon, which is confirmed by the loadability and inertia analysis. That confirms the validity of the approach for long term future grid studies, where one is more interested in finding weak points in the system rather than in a detailed analysis of individual operating conditions. △ Less

Submitted 10 June, 2017; v1 submitted 26 January, 2017; originally announced January 2017.

Generic Demand Model Considering the Impact of Prosumers for Future Grid Scenario Analysis

Authors: Hesamoddin Marzooghi, Shariq Riaz, Gregor Verbic, Archie C. Chapman, David J. Hill

Abstract: The increasing uptake of residential PV-battery systems is bound to significantly change demand patterns of future power systems and, consequently, their dynamic performance. In this paper, we propose a generic demand model that captures the aggregated effect of a large population of price-responsive users equipped with small-scale PV-battery systems, called prosumers, for market simulation in fut… ▽ More The increasing uptake of residential PV-battery systems is bound to significantly change demand patterns of future power systems and, consequently, their dynamic performance. In this paper, we propose a generic demand model that captures the aggregated effect of a large population of price-responsive users equipped with small-scale PV-battery systems, called prosumers, for market simulation in future grid scenario analysis. The model is formulated as a bi-level program in which the upper-level unit commitment problem minimizes the total generation cost, and the lower-level problem maximizes prosumers' aggregate self-consumption. Unlike in the existing bi-level optimization frameworks that focus on the interaction between the wholesale market and an aggregator, the coupling is through the prosumers' demand, not through the electricity price. That renders the proposed model market structure agnostic, making it suitable for future grid studies where the market structure is potentially unknown. As a case study, we perform steady-state voltage stability analysis of a simplified model of the Australian National Electricity Market with significant penetration of renewable generation. The simulation results show that a high prosumer penetration changes the demand profile in ways that significantly improve the system loadability, which confirms the suitability of the proposed model for future grid studies. △ Less

Submitted 12 September, 2017; v1 submitted 19 May, 2016; originally announced May 2016.

Comments: 11 pages, 6 figures, 2 tables, Accepted for publication in IEEE Transactions on Smart Grid

A Distributed Algorithm for Demand Response with Mixed-Integer Variables

Authors: Sleiman Mhanna, Archie C. Chapman, Gregor Verbic

Abstract: This letter presents a fast distributed algorithm for aggregating a large number of households with mixed-integer variables and intricate couplings between devices. The proposed fast distributed gradient algorithm is applied to the double smoothed dual function of the adopted DR model. The results also show that, with minimal parameter adjustments, the convergence of the dual objective exhibits th… ▽ More This letter presents a fast distributed algorithm for aggregating a large number of households with mixed-integer variables and intricate couplings between devices. The proposed fast distributed gradient algorithm is applied to the double smoothed dual function of the adopted DR model. The results also show that, with minimal parameter adjustments, the convergence of the dual objective exhibits the same behavior irrespective of the system size. △ Less

Submitted 28 February, 2016; v1 submitted 1 June, 2015; originally announced June 2015.

Comments: 2 pages, 1 figure, to be published in IEEE Transactions on Smart Grid Letters

An Iterative On-Line Mechanism for Demand-Side Aggregation

Authors: Archie C. Chapman, Gregor Verbic

Abstract: This paper considers a demand-side aggregation scheme specifically for large numbers of small loads, such as households and small and medium-sized businesses. We introduce a novel auction format, called a staggered clock-proxy auction (SCPA), for on-line scheduling of these loads. This is a two phase format, consisting of: a sequence of overlap** iterative ascending-price clock auctions, one for… ▽ More This paper considers a demand-side aggregation scheme specifically for large numbers of small loads, such as households and small and medium-sized businesses. We introduce a novel auction format, called a staggered clock-proxy auction (SCPA), for on-line scheduling of these loads. This is a two phase format, consisting of: a sequence of overlap** iterative ascending-price clock auctions, one for each time-slot over a finite decision horizon, and; a set of proxy auctions that begin at the termination of each individual clock auction, and which determine the final price and allocation for each time-slot. The overlap** design of the clock phases grant bidders the ability to effectively bid on inter-temporal bundles of electricity use, thereby focusing on the most relevant parts of the price-quantity space. Since electricity is a divisible good, the proxy auction uses demand-schedule bids, which the aggregator uses to compute a uniform-price partial competitive equilibrium for each time slot. We show that, under mild assumptions on the bidders' utilities functions, the proxy phase implements the Vickrey-Clarke-Groves outcome, which makes straightforward bidding in the proxy phase a Bayes-Nash equilibrium. Furthermore, we demonstrate the SCPA in a scenario comprised of household agents with three different utility function types, and show how the mechanism enables efficient on-line energy use scheduling. △ Less

Submitted 1 June, 2015; originally announced June 2015.

Comments: 11 pages, 7 figures, submitted to IEEE Transactions on Smart Grids

Automated Planning in Repeated Adversarial Games

Authors: Enrique Munoz de Cote, Archie C. Chapman, Adam M. Sykulski, Nicholas R. Jennings

Abstract: Game theory's prescriptive power typically relies on full rationality and/or self-play interactions. In contrast, this work sets aside these fundamental premises and focuses instead on heterogeneous autonomous interactions between two or more agents. Specifically, we introduce a new and concise representation for repeated adversarial (constant-sum) games that highlight the necessary features that… ▽ More Game theory's prescriptive power typically relies on full rationality and/or self-play interactions. In contrast, this work sets aside these fundamental premises and focuses instead on heterogeneous autonomous interactions between two or more agents. Specifically, we introduce a new and concise representation for repeated adversarial (constant-sum) games that highlight the necessary features that enable an automated planing agent to reason about how to score above the game's Nash equilibrium, when facing heterogeneous adversaries. To this end, we present TeamUP, a model-based RL algorithm designed for learning and planning such an abstraction. In essence, it is somewhat similar to R-max with a cleverly engineered reward sha** that treats exploration as an adversarial optimization problem. In practice, it attempts to find an ally with which to tacitly collude (in more than two-player games) and then collaborates on a joint plan of actions that can consistently score a high utility in adversarial repeated games. We use the inaugural Lemonade Stand Game Tournament to demonstrate the effectiveness of our approach, and find that TeamUP is the best performing agent, demoting the Tournament's actual winning strategy into second place. In our experimental analysis, we show hat our strategy successfully and consistently builds collaborations with many different heterogeneous (and sometimes very sophisticated) adversaries. △ Less

Submitted 15 March, 2012; originally announced March 2012.

Comments: Appears in Proceedings of the Twenty-Sixth Conference on Uncertainty in Artificial Intelligence (UAI2010)

Report number: UAI-P-2010-PG-376-383

Filtered Fictitious Play for Perturbed Observation Potential Games and Decentralised POMDPs

Authors: Archie C. Chapman, Simon A. Williamson, Nicholas R. Jennings

Abstract: Potential games and decentralised partially observable MDPs (Dec-POMDPs) are two commonly used models of multi-agent interaction, for static optimisation and sequential decisionmaking settings, respectively. In this paper we introduce filtered fictitious play for solving repeated potential games in which each player's observations of others' actions are perturbed by random noise, and use this algo… ▽ More Potential games and decentralised partially observable MDPs (Dec-POMDPs) are two commonly used models of multi-agent interaction, for static optimisation and sequential decisionmaking settings, respectively. In this paper we introduce filtered fictitious play for solving repeated potential games in which each player's observations of others' actions are perturbed by random noise, and use this algorithm to construct an online learning method for solving Dec-POMDPs. Specifically, we prove that noise in observations prevents standard fictitious play from converging to Nash equilibrium in potential games, which also makes fictitious play impractical for solving Dec-POMDPs. To combat this, we derive filtered fictitious play, and provide conditions under which it converges to a Nash equilibrium in potential games with noisy observations. We then use filtered fictitious play to construct a solver for Dec-POMDPs, and demonstrate our new algorithm's performance in a box pushing problem. Our results show that we consistently outperform the state-of-the-art Dec-POMDP solver by an average of 100% across the range of noise in the observation function. △ Less

Submitted 14 February, 2012; originally announced February 2012.

Report number: UAI-P-2011-PG-77-85