Showing 1–50 of 57 results for author: Morales, J M

A Variable Neighborhood Search approach for solving the Rank Pricing Problem

Authors: Asunción Jiménez-Cordero, Salvador Pineda, Juan Miguel Morales

Abstract: The Rank Pricing Problem (RPP) is a challenging bilevel optimization problem with binary variables whose objective is to determine the optimal pricing strategy for a set of products to maximize the total benefit, given that customer preferences influence the price for each product. Traditional methods for solving RPP are based on exact approaches which may be computationally expensive. In contrast… ▽ More The Rank Pricing Problem (RPP) is a challenging bilevel optimization problem with binary variables whose objective is to determine the optimal pricing strategy for a set of products to maximize the total benefit, given that customer preferences influence the price for each product. Traditional methods for solving RPP are based on exact approaches which may be computationally expensive. In contrast, this paper presents a novel approach utilizing Variable Neighborhood Search (VNS), a popular heuristic known for its effectiveness in solving combinatorial optimization problems. Our proposed VNS algorithm introduces problem-specific neighborhood operators designed to effectively explore the solution space of the RPP. Even though our methodology does not have optimality guarantees, our computational experiments show that it outperforms Mixed Integer Program solvers regarding solution quality and computational burden. △ Less

Submitted 24 May, 2024; originally announced May 2024.

Design and consensus content validity of the questionnaire for b-learning education: A 2-Tuple Fuzzy Linguistic Delphi based Decision Support Tool

Authors: Rosana Montes, Cristina Zuheros, Jeovani M. Morales, Noe Zermeño, Jerónimo Duran, Francsico Herrera

Abstract: Classic Delphi and Fuzzy Delphi methods are used to test content validity of data collection tools such as questionnaires. Fuzzy Delphi takes the opinion issued by judges from a linguistic perspective reducing ambiguity in opinions by using fuzzy numbers. We propose an extension named 2-Tuple Fuzzy Linguistic Delphi method to deal with scenarios in which judges show different expertise degrees by… ▽ More Classic Delphi and Fuzzy Delphi methods are used to test content validity of data collection tools such as questionnaires. Fuzzy Delphi takes the opinion issued by judges from a linguistic perspective reducing ambiguity in opinions by using fuzzy numbers. We propose an extension named 2-Tuple Fuzzy Linguistic Delphi method to deal with scenarios in which judges show different expertise degrees by using fuzzy multigranular semantics of the linguistic terms and to obtain intermediate and final results expressed by 2-tuple linguistic values. The key idea of our proposal is to validate the full questionnaire by means of the evaluation of its parts, defining the validity of each item as a Decision Making problem. Taking the opinion of experts, we measure the degree of consensus, the degree of consistency, and the linguistic score of each item, in order to detect those items that affect, positively or negatively, the quality of the instrument. Considering the real need to evaluate a b-learning educational experience with a consensual questionnaire, we present a Decision Making model for questionnaire validation that solves it. Additionally, we contribute to this consensus reaching problem by develo** an online tool under GPL v3 license. The software visualizes the collective valuations for each iteration and assists to determine which parts of the questionnaire should be modified to reach a consensual solution. △ Less

Submitted 1 February, 2024; originally announced February 2024.

Comments: 47 pages, 7 figures

Journal ref: Open Access Volume 147 November 2023 Article number 110755

Learning-based State Estimation in Distribution Systems with Limited Real-Time Measurements

Authors: J. G. De la Varga, S. Pineda, J. M. Morales, Á. Porras

Abstract: The task of state estimation in active distribution systems faces a major challenge due to the integration of different measurements with multiple reporting rates. As a result, distribution systems are essentially unobservable in real time, indicating the existence of multiple states that result in identical values for the available measurements. Certain existing approaches utilize historical data… ▽ More The task of state estimation in active distribution systems faces a major challenge due to the integration of different measurements with multiple reporting rates. As a result, distribution systems are essentially unobservable in real time, indicating the existence of multiple states that result in identical values for the available measurements. Certain existing approaches utilize historical data to infer the relationship between real-time available measurements and the state. Other learning-based methods aim to estimate the measurements acquired with a delay, generating pseudo-measurements. Our paper presents a methodology that utilizes the outcome of an unobservable state estimator to exploit information on the joint probability distribution between real-time available measurements and delayed ones. Through numerical simulations conducted on a realistic distribution grid with insufficient real-time measurements, the proposed procedure showcases superior performance compared to existing state forecasting approaches and those relying on inferred pseudo-measurements. △ Less

Submitted 10 May, 2024; v1 submitted 31 July, 2023; originally announced July 2023.

Tight Big-Ms for Optimal Transmission Switching

Authors: Salvador Pineda, Juan Miguel Morales, Álvaro Porras, Concepción Domínguez

Abstract: This paper addresses the Optimal Transmission Switching (OTS) problem in electricity networks, which aims to find an optimal power grid topology that minimizes system operation costs while satisfying physical and operational constraints. Existing methods typically convert the OTS problem into a Mixed-Integer Linear Program (MILP) using big-M constants. However, the computational performance of the… ▽ More This paper addresses the Optimal Transmission Switching (OTS) problem in electricity networks, which aims to find an optimal power grid topology that minimizes system operation costs while satisfying physical and operational constraints. Existing methods typically convert the OTS problem into a Mixed-Integer Linear Program (MILP) using big-M constants. However, the computational performance of these approaches relies significantly on the tightness of these big-Ms. In this paper, we propose an iterative tightening strategy to strengthen the big-Ms by efficiently solving a series of bounding problems that account for the economics of the OTS objective function through an upper-bound on the generating cost. We also discuss how the performance of the proposed tightening strategy is enhanced if reduced line capacities are considered. Using the 118-bus test system we demonstrate that the proposed methodology outperforms existing approaches, offering tighter bounds and significantly reducing the computational burden of the OTS problem. △ Less

Submitted 5 April, 2024; v1 submitted 5 June, 2023; originally announced June 2023.

The Cooperative Maximum Capture Facility Location Problem

Authors: Concepción Domínguez, Ricardo Gázquez, Juan Miguel Morales, Salvador Pineda

Abstract: In the Maximum Capture Facility Location (MCFL) problem with a binary choice rule, a company intends to locate a series of facilities to maximize the captured demand, and customers patronize the facility that maximizes their utility. In this work, we generalize the MCFL problem assuming that the facilities of the decision maker act cooperatively to increase the customers' utility over the company.… ▽ More In the Maximum Capture Facility Location (MCFL) problem with a binary choice rule, a company intends to locate a series of facilities to maximize the captured demand, and customers patronize the facility that maximizes their utility. In this work, we generalize the MCFL problem assuming that the facilities of the decision maker act cooperatively to increase the customers' utility over the company. We propose a utility maximization rule between the captured utility of the decision maker and the opt-out utility of a competitor already installed in the market. Furthermore, we model the captured utility by means of an Ordered Median function (OMf) of the partial utilities of newly open facilities. We name this problem "the Cooperative Maximum Capture Facility Location problem" (CMCFL). The OMf serves as a means to compute the utility of each customer towards the company as an aggregation of ordered partial utilities, and constitutes a unifying framework for CMCFL models. We introduce a multiperiod non-linear bilevel formulation for the CMCFL with an embedded assignment problem characterizing the captured utilities. For this model, two exact resolution approaches are presented: a MILP reformulation with valid inequalities and an effective approach based on Benders' decomposition. Extensive computational experiments are provided to test our results with randomly generated data and an application to the location of charging stations for electric vehicles in the city of Trois-Rivières, Quèbec, is addressed. △ Less

Submitted 24 May, 2023; originally announced May 2023.

Comments: 32 pages, 8 tables, 2 algorithms, 8 figures

MSC Class: 90B80; 90C06; 90C11

Data Valuation from Data-Driven Optimization

Authors: Robert Mieth, Juan M. Morales, H. Vincent Poor

Abstract: With the ongoing investment in data collection and communication technology in power systems, data-driven optimization has been established as a powerful tool for system operators to handle stochastic system states caused by weather- and behavior-dependent resources. However, most methods are ignorant to data quality, which may differ based on measurement and underlying privacy-protection mechanis… ▽ More With the ongoing investment in data collection and communication technology in power systems, data-driven optimization has been established as a powerful tool for system operators to handle stochastic system states caused by weather- and behavior-dependent resources. However, most methods are ignorant to data quality, which may differ based on measurement and underlying privacy-protection mechanisms. This paper addresses this shortcoming by (i) proposing a practical data quality metric based on Wasserstein distance, (ii) leveraging a novel modification of distributionally robust optimization using information from multiple data sets with heterogeneous quality to valuate data, (iii) applying the proposed optimization framework to an optimal power flow problem, and (iv) showing a direct method to valuate data from the optimal solution. We conduct numerical experiments to analyze and illustrate the proposed model and publish the implementation open-source. △ Less

Submitted 15 December, 2023; v1 submitted 2 May, 2023; originally announced May 2023.

Learning-Assisted Optimization for Transmission Switching

Authors: Salvador Pineda, Juan Miguel Morales, Asunción Jiménez-Cordero

Abstract: The design of new strategies that exploit methods from Machine Learning to facilitate the resolution of challenging and large-scale mathematical optimization problems has recently become an avenue of prolific and promising research. In this paper, we propose a novel learning procedure to assist in the solution of a well-known computationally difficult optimization problem in power systems: The Dir… ▽ More The design of new strategies that exploit methods from Machine Learning to facilitate the resolution of challenging and large-scale mathematical optimization problems has recently become an avenue of prolific and promising research. In this paper, we propose a novel learning procedure to assist in the solution of a well-known computationally difficult optimization problem in power systems: The Direct Current Optimal Transmission Switching (DC-OTS) problem. The DC-OTS problem consists in finding the configuration of the power network that results in the cheapest dispatch of the power generating units. With the increasing variability in the operating conditions of power grids, the DC-OTS problem has lately sparked renewed interest, because operational strategies that include topological network changes have proved to be effective and efficient in hel** maintain the balance between generation and demand. The DC-OTS problem includes a set of binaries that determine the on/off status of the switchable transmission lines. Therefore, it takes the form of a mixed-integer program, which is NP-hard in general. In this paper, we propose an approach to tackle the DC-OTS problem that leverages known solutions to past instances of the problem to speed up the mixed-integer optimization of a new unseen model. Although our approach does not offer optimality guarantees, a series of numerical experiments run on a real-life power system dataset show that it features a very high success rate in identifying the optimal grid topology (especially when compared to alternative competing heuristics), while rendering remarkable speed-up factors. △ Less

Submitted 5 April, 2024; v1 submitted 14 April, 2023; originally announced April 2023.

Unifying Chance-Constrained and Robust Optimal Power Flow for Resilient Network Operations

Authors: Álvaro Porras, Line Roald, Juan Miguel Morales, Salvador Pineda

Abstract: Uncertainty in renewable energy generation has the potential to adversely impact the operation of electric networks. Numerous approaches to manage this impact have been proposed, ranging from stochastic and chance-constrained programming to robust optimization. However, these approaches either tend to be conservative or leave the system vulnerable to low probability, high impact uncertainty realiz… ▽ More Uncertainty in renewable energy generation has the potential to adversely impact the operation of electric networks. Numerous approaches to manage this impact have been proposed, ranging from stochastic and chance-constrained programming to robust optimization. However, these approaches either tend to be conservative or leave the system vulnerable to low probability, high impact uncertainty realizations. To address this issue, we propose a new formulation for stochastic optimal power flow that explicitly distinguishes between "normal operation", in which automatic generation control (AGC) is sufficient to guarantee system security, and "adverse operation", in which the system operator is required to take additional actions, e.g., manual reserve deployment. The new formulation has been compared with the classical ones in a case study on the IEEE-118 and IEEE-300 bus systems. We observe that our consideration of extreme scenarios enables solutions that are more secure than typical chance-constrained formulations, yet less costly than solutions that guarantee robust feasibility with only AGC. △ Less

Submitted 7 May, 2024; v1 submitted 9 March, 2023; originally announced March 2023.

Comments: 10 pages

The Analytical Method algorithm for trigger primitives generation at the LHC Drift Tubes detector

Authors: G. Abbiendi, J. Alcaraz Maestre, A. Álvarez Fernández, B. Álvarez González, N. Amapane, I. Bachiller, L. Barcellan, C. Baldanza, C. Battilana, M. Bellato, G. Bencze, M. Benettoni, N. Beni, A. Benvenuti, A. Bergnoli, L. C. Blanco Ramos, L. Borgonovi, A. Bragagnolo, V. Cafaro, A. Calderon, E. Calvo, R. Carlin, C. A. Carrillo Montoya, F. R. Cavallo, J. M. Cela Ruiz , et al. (121 additional authors not shown)

Abstract: The Compact Muon Solenoid (CMS) experiment prepares its Phase-2 upgrade for the high-luminosity era of the LHC operation (HL-LHC). Due to the increase of occupancy, trigger latency and rates, the full electronics of the CMS Drift Tube (DT) chambers will need to be replaced. In the new design, the time bin for the digitisation of the chamber signals will be of around 1~ns, and the totality of the s… ▽ More The Compact Muon Solenoid (CMS) experiment prepares its Phase-2 upgrade for the high-luminosity era of the LHC operation (HL-LHC). Due to the increase of occupancy, trigger latency and rates, the full electronics of the CMS Drift Tube (DT) chambers will need to be replaced. In the new design, the time bin for the digitisation of the chamber signals will be of around 1~ns, and the totality of the signals will be forwarded asynchronously to the service cavern at full resolution. The new backend system will be in charge of building the trigger primitives of each chamber. These trigger primitives contain the information at chamber level about the muon candidates position, direction, and collision time, and are used as input in the L1 CMS trigger. The added functionalities will improve the robustness of the system against ageing. An algorithm based on analytical solutions for reconstructing the DT trigger primitives, called Analytical Method, has been implemented both as a software C++ emulator and in firmware. Its performance has been estimated using the software emulator with simulated and real data samples, and through hardware implementation tests. Measured efficiencies are 96 to 98\% for all qualities and time and spatial resolutions are close to the ultimate performance of the DT chambers. A prototype chain of the HL-LHC electronics using the Analytical Method for trigger primitive generation has been installed during Long Shutdown 2 of the LHC and operated in CMS cosmic data taking campaigns in 2020 and 2021. Results from this validation step, the so-called Slice Test, are presented. △ Less

Submitted 3 February, 2023; originally announced February 2023.

Comments: 16 pages, 11 figures

Tight and Compact Sample Average Approximation for Joint Chance-constrained Problems with Applications to Optimal Power Flow

Authors: Álvaro Porras, Concepción Domínguez, Juan M. Morales, Salvador Pineda

Abstract: In this paper, we tackle the resolution of chance-constrained problems reformulated via Sample Average Approximation. The resulting data-driven deterministic reformulation takes the form of a large-scale mixed-integer program cursed with Big-Ms. We introduce an exact resolution method for the MIP that combines the addition of a set of valid inequalities to tighten the linear relaxation bound with… ▽ More In this paper, we tackle the resolution of chance-constrained problems reformulated via Sample Average Approximation. The resulting data-driven deterministic reformulation takes the form of a large-scale mixed-integer program cursed with Big-Ms. We introduce an exact resolution method for the MIP that combines the addition of a set of valid inequalities to tighten the linear relaxation bound with coefficient strengthening and constraint screening algorithms to improve its Big-Ms and considerably reduce its size. The proposed valid inequalities are based on the notion of k-envelopes, can be computed offline using polynomial-time algorithms, and added to the MIP program all at once. Furthermore, they are equally useful to boost the strengthening of the Big-Ms and the screening rate of superfluous constraints. We apply our procedures to a probabilistically-constrained version of the DC Optimal Power Flow problem with uncertain demand. The chance constraint requires that the probability of violating any of the power system's constraints be lower than some parameter $ε> 0$. In a series of numerical experiments which involve five power systems of different size, we show the efficiency of the proposed methodology and compare it with some of the best-performing convex inner approximations currently available in the literature. △ Less

Submitted 26 June, 2023; v1 submitted 6 May, 2022; originally announced May 2022.

Distributionally Robust Optimal Power Flow with Contextual Information

Authors: Adrián Esteban-Pérez, Juan M. Morales

Abstract: In this paper, we develop a distributionally robust chance-constrained formulation of the Optimal Power Flow problem (OPF) whereby the system operator can leverage contextual information. For this purpose, we exploit an ambiguity set based on probability trimmings and optimal transport through which the dispatch solution is protected against the incomplete knowledge of the relationship between the… ▽ More In this paper, we develop a distributionally robust chance-constrained formulation of the Optimal Power Flow problem (OPF) whereby the system operator can leverage contextual information. For this purpose, we exploit an ambiguity set based on probability trimmings and optimal transport through which the dispatch solution is protected against the incomplete knowledge of the relationship between the OPF uncertainties and the context that is conveyed by a sample of their joint probability distribution. We provide a tractable reformulation of the proposed distributionally robust chance-constrained OPF problem under the popular conditional-value-at-risk approximation. By way of numerical experiments run on a modified IEEE-118 bus network with wind uncertainty, we show how the power system can substantially benefit from taking into account the well-known statistical dependence between the point forecast of wind power outputs and its associated prediction error. Furthermore, the experiments conducted also reveal that the distributional robustness conferred on the OPF solution by our probability-trimmings-based approach is superior to that bestowed by alternative approaches in terms of expected cost and system reliability. △ Less

Submitted 4 October, 2022; v1 submitted 16 September, 2021; originally announced September 2021.

Comments: 44 pages, 37 figures

Prescribing net demand for two-stage electricity generation scheduling

Authors: Juan M. Morales, Miguel Á. Muñoz, Salvador Pineda

Abstract: We consider a two-stage generation scheduling problem comprising a forward dispatch and a real-time re-dispatch. The former must be conducted facing an uncertain net demand that includes non-dispatchable electricity consumption and renewable power generation. The latter copes with the plausible deviations with respect to the forward schedule by making use of balancing power during the actual opera… ▽ More We consider a two-stage generation scheduling problem comprising a forward dispatch and a real-time re-dispatch. The former must be conducted facing an uncertain net demand that includes non-dispatchable electricity consumption and renewable power generation. The latter copes with the plausible deviations with respect to the forward schedule by making use of balancing power during the actual operation of the system. Standard industry practice deals with the uncertain net demand in the forward stage by replacing it with a good estimate of its conditional expectation (usually referred to as a point forecast), so as to minimize the need for balancing power in real time. However, it is well known that the cost structure of a power system is highly asymmetric and dependent on its operating point, with the result that minimizing the amount of power imbalances is not necessarily aligned with minimizing operating costs. In this paper, we propose a bilevel program to construct, from the available historical data, a prescription of the net demand that does account for the power system's cost asymmetry. Furthermore, to accommodate the strong dependence of this cost on the power system's operating point, we use clustering to tailor the proposed prescription to the foreseen net-demand regime. By way of an illustrative example and a more realistic case study based on the European power system, we show that our approach leads to substantial cost savings compared to the customary way of doing. △ Less

Submitted 17 April, 2023; v1 submitted 2 August, 2021; originally announced August 2021.

Journal ref: Operations Research Perspectives, Vol. 10, 100268 (2023)

A Functional Data Analysis Approach to Evolution Outlier Detection for Grouped Smart Meters

Authors: A. Elías, J. M. Morales, S. Pineda

Abstract: Smart metering infrastructures collect data almost continuously in the form of fine-grained long time series. These massive data series often have common daily patterns that are repeated between similar days or seasons and shared among grouped meters. Within this context, we propose an unsupervised method to highlight individuals with abnormal daily dependency patterns, which we term evolution out… ▽ More Smart metering infrastructures collect data almost continuously in the form of fine-grained long time series. These massive data series often have common daily patterns that are repeated between similar days or seasons and shared among grouped meters. Within this context, we propose an unsupervised method to highlight individuals with abnormal daily dependency patterns, which we term evolution outliers. To this end, we approach the problem from the standpoint of Functional Data Analysis (FDA) and we use the concept of functional depth to exploit the dynamic group structure and isolate individual meters with a different evolution. The performance of the proposal is first evaluated empirically through a simulation exercise under different evolution scenarios. Subsequently, the importance and need for an evolution outlier detection method is shown by using actual smart-metering data corresponding to photo-voltaic energy generation and circuit voltage records. Here, our proposal detects outliers that might go unnoticed by other approaches of the literature that have demonstrated to be effective capturing magnitude and shape abnormalities. △ Less

Submitted 7 October, 2022; v1 submitted 2 July, 2021; originally announced July 2021.

Is learning for the unit commitment problem a low-hanging fruit?

Authors: S. Pineda, J. M. Morales

Abstract: The blast wave of machine learning and artificial intelligence has also reached the power systems community, and amid the frenzy of methods and black-box tools that have been left in its wake, it is sometimes difficult to perceive a glimmer of Occam's razor principle. In this letter, we use the unit commitment problem (UCP), an NP-hard mathematical program that is fundamental to power system opera… ▽ More The blast wave of machine learning and artificial intelligence has also reached the power systems community, and amid the frenzy of methods and black-box tools that have been left in its wake, it is sometimes difficult to perceive a glimmer of Occam's razor principle. In this letter, we use the unit commitment problem (UCP), an NP-hard mathematical program that is fundamental to power system operations, to show that simplicity must guide any strategy to solve it, in particular those that are based on learning from past UCP instances. To this end, we apply a naive algorithm to produce candidate solutions to the UCP and show, using a variety of realistically sized power systems, that we are able to find optimal or quasi-optimal solutions with remarkable speedups. Our claim is thus that any sophistication of the learning method must be backed up with a statistically significant improvement of the results in this letter. △ Less

Submitted 22 June, 2021; originally announced June 2021.

Hidden Markov and semi-Markov models: When and why are these models useful for classifying states in time series data?

Authors: Sofia Ruiz-Suarez, Vianey Leos-Barajas, Juan Manuel Morales

Abstract: Hidden Markov models (HMMs) and their extensions have proven to be powerful tools for classification of observations that stem from systems with temporal dependence as they take into account that observations close in time are likely generated from the same state (i.e.\ class). When information on the classes of the observations is available in advanced, supervised methods can be applied. In this… ▽ More Hidden Markov models (HMMs) and their extensions have proven to be powerful tools for classification of observations that stem from systems with temporal dependence as they take into account that observations close in time are likely generated from the same state (i.e.\ class). When information on the classes of the observations is available in advanced, supervised methods can be applied. In this paper, we provide details for the implementation of four models for classification in a supervised learning context: HMMs, hidden semi-Markov models (HSMMs), autoregressive-HMMs, and autoregressive-HSMMs. Using simulations, we study the classification performance under various degrees of model misspecification to characterize when it would be important to extend a basic HMM to an HSMM. As an application of these techniques we use the models to classify accelerometer data from Merino sheep to distinguish between four different behaviors of interest. In particular in the field of movement ecology, collection of fine-scale animal movement data over time to identify behavioral states has become ubiquitous, necessitating models that can account for the dependence structure in the data. We demonstrate that when the aim is to conduct classification, various degrees of model misspecification of the proposed model may not impede good classification performance unless there is high overlap between the state-dependent distributions, that is, unless the observation distributions of the different states are difficult to differentiate. △ Less

Submitted 19 November, 2021; v1 submitted 24 May, 2021; originally announced May 2021.

Learning the price response of active distribution networks for TSO-DSO coordination

Authors: Juan Miguel Morales, Salvador Pineda, Yury Dvorkin

Abstract: The increase in distributed energy resources and flexible electricity consumers has turned TSO-DSO coordination strategies into a challenging problem. Existing decomposition/decentralized methods apply divide-and-conquer strategies to trim down the computational burden of this complex problem, but rely on access to proprietary information or fail-safe real-time communication infrastructures. To ov… ▽ More The increase in distributed energy resources and flexible electricity consumers has turned TSO-DSO coordination strategies into a challenging problem. Existing decomposition/decentralized methods apply divide-and-conquer strategies to trim down the computational burden of this complex problem, but rely on access to proprietary information or fail-safe real-time communication infrastructures. To overcome these drawbacks, we propose in this paper a TSO-DSO coordination strategy that only needs a series of observations of the nodal price and the power intake at the substations connecting the transmission and distribution networks. Using this information, we learn the price response of active distribution networks (DN) using a decreasing step-wise function that can also adapt to some contextual information. The learning task can be carried out in a computationally efficient manner and the curve it produces can be interpreted as a market bid, thus averting the need to revise the current operational procedures for the transmission network. Inaccuracies derived from the learning task may lead to suboptimal decisions. However, results from a realistic case study show that the proposed methodology yields operating decisions very close to those obtained by a fully centralized coordination of transmission and distribution. △ Less

Submitted 16 September, 2021; v1 submitted 13 April, 2021; originally announced April 2021.

Cost-driven Screening of Network Constraints for the Unit Commitment Problem

Authors: Álvaro Porras, Salvador Pineda, Juan M. Morales, Asunción Jiménez-Cordero

Abstract: In an attempt to speed up the solution of the unit commitment (UC) problem, both machine-learning and optimization-based methods have been proposed to lighten the full UC formulation by removing as many superfluous line-flow constraints as possible. While the elimination strategies based on machine learning are fast and typically delete more constraints, they may be over-optimistic and result in i… ▽ More In an attempt to speed up the solution of the unit commitment (UC) problem, both machine-learning and optimization-based methods have been proposed to lighten the full UC formulation by removing as many superfluous line-flow constraints as possible. While the elimination strategies based on machine learning are fast and typically delete more constraints, they may be over-optimistic and result in infeasible UC solutions. For their part, optimization-based methods seek to identify redundant constraints in the full UC formulation by exploring the feasibility region of an LP-relaxation. In doing so, these methods only get rid of line-flow constraints whose removal leaves the feasibility region of the original UC problem unchanged. In this paper, we propose a procedure to substantially increase the line-flow constraints that are filtered out by optimization-based methods without jeopardizing their appealing ability of preserving feasibility. Our approach is based on tightening the LP-relaxation that the optimization-based method uses with a valid inequality related to the objective function of the UC problem and hence, of an economic nature. The result is that the so strengthened optimization-based method identifies not only redundant line-flow constraints but also inactive ones, thus leading to more reduced UC formulations. △ Less

Submitted 14 March, 2022; v1 submitted 12 April, 2021; originally announced April 2021.

Comments: 10 pages

Warm-starting constraint generation for mixed-integer optimization: A Machine Learning approach

Authors: Asunción Jiménez-Cordero, Juan Miguel Morales, Salvador Pineda

Abstract: Mixed Integer Linear Programs (MILP) are well known to be NP-hard (Non-deterministic Polynomial-time hard) problems in general. Even though pure optimization-based methods, such as constraint generation, are guaranteed to provide an optimal solution if enough time is given, their use in online applications remains a great challenge due to their usual excessive time requirements. To alleviate their… ▽ More Mixed Integer Linear Programs (MILP) are well known to be NP-hard (Non-deterministic Polynomial-time hard) problems in general. Even though pure optimization-based methods, such as constraint generation, are guaranteed to provide an optimal solution if enough time is given, their use in online applications remains a great challenge due to their usual excessive time requirements. To alleviate their computational burden, some machine learning techniques (ML) have been proposed in the literature, using the information provided by previously solved MILP instances. Unfortunately, these techniques report a non-negligible percentage of infeasible or suboptimal instances. By linking mathematical optimization and machine learning, this paper proposes a novel approach that speeds up the traditional constraint generation method, preserving feasibility and optimality guarantees. In particular, we first identify offline the so-called invariant constraint set of past MILP instances. We then train (also offline) a machine learning method to learn an invariant constraint set as a function of the problem parameters of each instance. Next, we predict online an invariant constraint set of the new unseen MILP application and use it to initialize the constraint generation method. This warm-started strategy significantly reduces the number of iterations to reach optimality, and therefore, the computational burden to solve online each MILP problem is significantly reduced. Very importantly, all the feasibility and optimality theoretical guarantees of the traditional constraint generation method are inherited by our proposed methodology. The computational performance of the proposed approach is quantified through synthetic and real-life MILP applications. △ Less

Submitted 15 July, 2022; v1 submitted 24 March, 2021; originally announced March 2021.

Acoustofluidic phase microscopy in a tilted segmentation-free configuration

Authors: Julián Mejía Morales, Björn Hammarström, Gian Luca Lippi, Massimo Vassalli, Peter Glynne-Jones

Abstract: A low-cost device for registration-free quantitative phase microscopy (QPM) based on the transport of intensity equation (TIE) of cells in continuous flow is presented. The method uses acoustic focusing to align cells into a single plane where all cells move at a constant speed. The acoustic focusing plane is tilted with respect to the microscope's focal plane in order to obtain cell images at mul… ▽ More A low-cost device for registration-free quantitative phase microscopy (QPM) based on the transport of intensity equation (TIE) of cells in continuous flow is presented. The method uses acoustic focusing to align cells into a single plane where all cells move at a constant speed. The acoustic focusing plane is tilted with respect to the microscope's focal plane in order to obtain cell images at multiple focal positions. As the cells are displaced at constant speed, phase maps can be generated without the need to segment and register individual objects. The proposed inclined geometry allows for the acquisition of a vertical stack without the need for any moving part, and it enables a cost-effective and robust implementation of QPM. The suitability of the solution for biological imaging is tested on blood samples, demonstrating the ability to recover the phase map of single red blood cells flowing through the microchip. △ Less

Submitted 15 January, 2021; originally announced January 2021.

Journal ref: Biomicrofluidics 15, 014102 (2021)

Spectroscopic analysis of the argon scintillation with a wavelength sensitive particle detector

Authors: R. Santorelli, E. Sanchez Garcia, P. Garcia Abia, D. González-Díaz, R. Lopez Manzano, J. J. Martinez Morales, V. Pesudo, L. Romero

Abstract: We performed a time-resolved spectroscopic study of the VUV/UV argon scintillation as a function of pressure and electric field, by means of a wavelength sensitive detector operated with different radioactive sources. Our work conveys new evidence of distinctive features of the argon light which are in contrast with the general assumption that, for particle detection purposes, the scintillation ca… ▽ More We performed a time-resolved spectroscopic study of the VUV/UV argon scintillation as a function of pressure and electric field, by means of a wavelength sensitive detector operated with different radioactive sources. Our work conveys new evidence of distinctive features of the argon light which are in contrast with the general assumption that, for particle detection purposes, the scintillation can be considered to be largely monochromatic at 128 nm (second continuum). The wavelength and the time-resolved analysis of the photon emission reveal that the dominant component of the argon scintillation during first tens of ns is in the range [160, 325] nm. This light is consistent with the third continuum emission from highly charged argon ions/molecules. This component of the scintillation is field-independent up to 25 V/cm/bar and shows a very mild dependence with pressure in the range [1,16] bar. The dynamics of the second continuum emission is dominated by the excimer formation time, whose variation as a function of the pressure has been measured. Additionally, the time and pressure-dependent features of electron-ion recombination, in the second continuum band, have been measured. This study opens new paths toward a novel particle identification technique based on the spectral information of the noble-elements scintillation light. △ Less

Submitted 15 December, 2020; originally announced December 2020.

Comments: 20 pages, 15 figures

An exact dynamic programming approach to segmented isotonic regression

Authors: Víctor Bucarey, Martine Labbé, Juan M. Morales, Salvador Pineda

Abstract: This paper proposes a polynomial-time algorithm to construct the monotone stepwise curve that minimizes the sum of squared errors with respect to a given cloud of data points. The fitted curve is also constrained on the maximum number of steps it can be composed of and on the minimum step length. Our algorithm relies on dynamic programming and is built on the basis that said curve-fitting task can… ▽ More This paper proposes a polynomial-time algorithm to construct the monotone stepwise curve that minimizes the sum of squared errors with respect to a given cloud of data points. The fitted curve is also constrained on the maximum number of steps it can be composed of and on the minimum step length. Our algorithm relies on dynamic programming and is built on the basis that said curve-fitting task can be tackled as a shortest-path type of problem. Numerical results on synthetic and realistic data sets reveal that our algorithm is able to provide the globally optimal monotone stepwise curve fit for samples with thousands of data points in less than a few hours. Furthermore, the algorithm gives a certificate on the optimality gap of any incumbent solution it generates. From a practical standpoint, this piece of research is motivated by the roll-out of smart grids and the increasing role played by the small flexible consumption of electricity in the large-scale integration of renewable energy sources into current power systems. Within this context, our algorithm constitutes an useful tool to generate bidding curves for a pool of small flexible consumers to partake in wholesale electricity markets. △ Less

Submitted 30 June, 2021; v1 submitted 7 December, 2020; originally announced December 2020.

Comments: 30 pages, 7 figures

MSC Class: 90C39 ACM Class: G.4

Distributionally robust stochastic programs with side information based on trimmings -- Extended version

Authors: Adrián Esteban-Pérez, Juan M. Morales

Abstract: We consider stochastic programs conditional on some covariate information, where the only knowledge of the possible relationship between the uncertain parameters and the covariates is reduced to a finite data sample of their joint distribution. By exploiting the close link between the notion of trimmings of a probability measure and the partial mass transportation problem, we construct a data-driv… ▽ More We consider stochastic programs conditional on some covariate information, where the only knowledge of the possible relationship between the uncertain parameters and the covariates is reduced to a finite data sample of their joint distribution. By exploiting the close link between the notion of trimmings of a probability measure and the partial mass transportation problem, we construct a data-driven Distributionally Robust Optimization (DRO) framework to hedge the decision against the intrinsic error in the process of inferring conditional information from limited joint data. We show that our approach is computationally as tractable as the standard (without side information) Wasserstein-metric-based DRO and enjoys performance guarantees. Furthermore, our DRO framework can be conveniently used to address data-driven decision-making problems under contaminated samples and naturally produces distributionally robust versions of some local nonparametric predictive methods, such as Nadaraya-Watson kernel regression and $K$-nearest neighbors, which are often used in the context of conditional stochastic optimization. Finally, the theoretical results are illustrated using a single-item newsvendor problem and a portfolio allocation problem with side information. △ Less

Submitted 20 September, 2021; v1 submitted 22 September, 2020; originally announced September 2020.

Comments: 24 figures, 76 pages

MSC Class: 90C15 Stochastic programming and 90C47 Minimax problems

A bilevel framework for decision-making under uncertainty with contextual information

Authors: Miguel Angel Muñoz, Salvador Pineda, Juan Miguel Morales

Abstract: In this paper, we propose a novel approach for data-driven decision-making under uncertainty in the presence of contextual information. Given a finite collection of observations of the uncertain parameters and potential explanatory variables (i.e., the contextual information), our approach fits a parametric model to those data that is specifically tailored to maximizing the decision value, while a… ▽ More In this paper, we propose a novel approach for data-driven decision-making under uncertainty in the presence of contextual information. Given a finite collection of observations of the uncertain parameters and potential explanatory variables (i.e., the contextual information), our approach fits a parametric model to those data that is specifically tailored to maximizing the decision value, while accounting for possible feasibility constraints. From a mathematical point of view, our framework translates into a bilevel program, for which we provide both a fast regularization procedure and a big-M-based reformulation that can be solved using off-the-shelf optimization solvers. We showcase the benefits of moving from the traditional scheme for model estimation (based on statistical quality metrics) to decision-guided prediction using three different practical problems. We also compare our approach with existing ones in a realistic case study that considers a strategic power producer that participates in the Iberian electricity market. Finally, we use these numerical simulations to analyze the conditions (in terms of the firm's cost structure and production capacity) under which our approach proves to be more advantageous to the producer. △ Less

Submitted 17 September, 2021; v1 submitted 4 August, 2020; originally announced August 2020.

A novel embedded min-max approach for feature selection in nonlinear support vector machine classification

Authors: Asunción Jiménez-Cordero, Juan Miguel Morales, Salvador Pineda

Abstract: In recent years, feature selection has become a challenging problem in several machine learning fields, such as classification problems. Support Vector Machine (SVM) is a well-known technique applied in classification tasks. Various methodologies have been proposed in the literature to select the most relevant features in SVM. Unfortunately, all of them either deal with the feature selection probl… ▽ More In recent years, feature selection has become a challenging problem in several machine learning fields, such as classification problems. Support Vector Machine (SVM) is a well-known technique applied in classification tasks. Various methodologies have been proposed in the literature to select the most relevant features in SVM. Unfortunately, all of them either deal with the feature selection problem in the linear classification setting or propose ad-hoc approaches that are difficult to implement in practice. In contrast, we propose an embedded feature selection method based on a min-max optimization problem, where a trade-off between model complexity and classification accuracy is sought. By leveraging duality theory, we equivalently reformulate the min-max problem and solve it without further ado using off-the-shelf software for nonlinear optimization. The efficiency and usefulness of our approach are tested on several benchmark data sets in terms of accuracy, number of selected features and interpretability. △ Less

Submitted 15 January, 2021; v1 submitted 21 April, 2020; originally announced April 2020.

Comments: Published at European Journal of Operational Research

Forecasting the Price-Response of a Pool of Buildings via Homothetic Inverse Optimization

Authors: Ricardo Fernández-Blanco, Juan Miguel Morales, Salvador Pineda

Abstract: This paper focuses on the day-ahead forecasting of the aggregate power of a pool of smart buildings equipped with thermostatically-controlled loads. We first propose the modeling of the aggregate behavior of its power trajectory by using a geometric approach. Specifically, we assume that the aggregate power is a homothet of a prototype building, whose physical and technical parameters are chosen t… ▽ More This paper focuses on the day-ahead forecasting of the aggregate power of a pool of smart buildings equipped with thermostatically-controlled loads. We first propose the modeling of the aggregate behavior of its power trajectory by using a geometric approach. Specifically, we assume that the aggregate power is a homothet of a prototype building, whose physical and technical parameters are chosen to be the mean of those in the pool. This allows us to preserve the building thermal dynamics of the pool. We then apply inverse optimization to estimate the homothetic parameters with bilevel programming. The lower level characterizes the price-response of the ensemble by a set of marginal utility curves and a homothet of the prototype building, which, in turn, are inferred in the upper-level problem. The upper level minimizes the mean absolute error over a training sample. This bilevel program is transformed into a regularized nonlinear problem that is initialized with the solution given by an efficient heuristic procedure. This heuristic consists in solving two linear programs and its solution is deemed a suitable proxy for the original bilevel problem. The results have been compared to state-of-the-art methodologies. △ Less

Submitted 24 March, 2021; v1 submitted 21 April, 2020; originally announced April 2020.

An Efficient Robust Approach to the Day-ahead Operation of an Aggregator of Electric Vehicles

Authors: Álvaro Porras, Ricardo Fernández-Blanco, Juan M. Morales, Salvador Pineda

Abstract: The growing use of electric vehicles (EVs) may hinder their integration into the electricity system as well as their efficient operation due to the intrinsic stochasticity associated with their driving patterns. In this work, we assume a profit-maximizer EV-aggregator who participates in the day-ahead electricity market. The aggregator accounts for the technical aspects of each individual EV and t… ▽ More The growing use of electric vehicles (EVs) may hinder their integration into the electricity system as well as their efficient operation due to the intrinsic stochasticity associated with their driving patterns. In this work, we assume a profit-maximizer EV-aggregator who participates in the day-ahead electricity market. The aggregator accounts for the technical aspects of each individual EV and the uncertainty in its driving patterns. We propose a hierarchical optimization approach to represent the decision-making of this aggregator. The upper level models the profit-maximizer aggregator's decisions on the EV-fleet operation, while a series of lower-level problems computes the worst-case EV availability profiles in terms of battery draining and energy exchange with the market. Then, this problem can be equivalently transformed into a mixed-integer linear single-level equivalent given the totally unimodular character of the constraint matrices of the lower-level problems and their convexity. Finally, we thoroughly analyze the benefits of the hierarchical model compared to the results from stochastic and deterministic models. △ Less

Submitted 19 June, 2020; v1 submitted 17 February, 2020; originally announced February 2020.

Comments: 11 pages, 6 figures

MSC Class: 90C90

Design and construction of a new detector to measure ultra-low radioactive-isotope contamination of argon

Authors: The DarkSide Collaboration, C. E. Aalseth, S. Abdelhakim, F. Acerbi, P. Agnes, R. Ajaj, I. F. M. Albuquerque, T. Alexander, A. Alici, A. K. Alton, P. Amaudruz, F. Ameli, J. Anstey, P. Antonioli, M. Arba, S. Arcelli, R. Ardito, I. J. Arnquist, P. Arpaia, D. M. Asner, A. Asunskis, M. Ave, H. O. Back, A. Barrado Olmedo, G. Batignani , et al. (306 additional authors not shown)

Abstract: Large liquid argon detectors offer one of the best avenues for the detection of galactic weakly interacting massive particles (WIMPs) via their scattering on atomic nuclei. The liquid argon target allows exquisite discrimination between nuclear and electron recoil signals via pulse-shape discrimination of the scintillation signals. Atmospheric argon (AAr), however, has a naturally occurring radioa… ▽ More Large liquid argon detectors offer one of the best avenues for the detection of galactic weakly interacting massive particles (WIMPs) via their scattering on atomic nuclei. The liquid argon target allows exquisite discrimination between nuclear and electron recoil signals via pulse-shape discrimination of the scintillation signals. Atmospheric argon (AAr), however, has a naturally occurring radioactive isotope, $^{39}$Ar, a $β$ emitter of cosmogenic origin. For large detectors, the atmospheric $^{39}$Ar activity poses pile-up concerns. The use of argon extracted from underground wells, deprived of $^{39}$Ar, is key to the physics potential of these experiments. The DarkSide-20k dark matter search experiment will operate a dual-phase time projection chamber with 50 tonnes of radio-pure underground argon (UAr), that was shown to be depleted of $^{39}$Ar with respect to AAr by a factor larger than 1400. Assessing the $^{39}$Ar content of the UAr during extraction is crucial for the success of DarkSide-20k, as well as for future experiments of the Global Argon Dark Matter Collaboration (GADMC). This will be carried out by the DArT in ArDM experiment, a small chamber made with extremely radio-pure materials that will be placed at the centre of the ArDM detector, in the Canfranc Underground Laboratory (LSC) in Spain. The ArDM LAr volume acts as an active veto for background radioactivity, mostly $γ$-rays from the ArDM detector materials and the surrounding rock. This article describes the DArT in ArDM project, including the chamber design and construction, and reviews the background required to achieve the expected performance of the detector. △ Less

Submitted 22 January, 2020; originally announced January 2020.

Comments: 13 pages, 8 figures. Corresponding author: E. Sánchez García

Study of the effects of radiation on the CMS Drift Tubes Muon Detector for the HL-LHC

Authors: G. Abbiendi, J. Alcaraz Maestre, A. Álvarez Fernández, B. Álvarez González, N. Amapane, I. Bachiller, J. M. Barcala, L. Barcellan, C. Battilana, M. Bellato, G. Bencze, M. Benettoni, N. Beni, A. Benvenuti, L. C. Blanco Ramos, A. Boletti, A. Bragagnolo, J. A. Brochero Cifuentes, V. Cafaro, A. Calderon, E. Calvo, A. Cappati, R. Carlin, C. A. Carrillo Montoya, F. R. Cavallo , et al. (118 additional authors not shown)

Abstract: The CMS drift tubes (DT) muon detector, built for withstanding the LHC expected integrated and instantaneous luminosities, will be used also in the High Luminosity LHC (HL-LHC) at a 5 times larger instantaneous luminosity and, consequently, much higher levels of radiation, reaching about 10 times the LHC integrated luminosity. Initial irradiation tests of a spare DT chamber at the CERN gamma irrad… ▽ More The CMS drift tubes (DT) muon detector, built for withstanding the LHC expected integrated and instantaneous luminosities, will be used also in the High Luminosity LHC (HL-LHC) at a 5 times larger instantaneous luminosity and, consequently, much higher levels of radiation, reaching about 10 times the LHC integrated luminosity. Initial irradiation tests of a spare DT chamber at the CERN gamma irradiation facility (GIF++), at large ($\sim$O(100)) acceleration factor, showed ageing effects resulting in a degradation of the DT cell performance. However, full CMS simulations have shown almost no impact in the muon reconstruction efficiency over the full barrel acceptance and for the full integrated luminosity. A second spare DT chamber was moved inside the GIF++ bunker in October 2017. The chamber was being irradiated at lower acceleration factors, and only 2 out of the 12 layers of the chamber were switched at working voltage when the radioactive source was active, being the other layers in standby. In this way the other non-aged layers are used as reference and as a precise and unbiased telescope of muon tracks for the efficiency computation of the aged layers of the chamber, when set at working voltage for measurements. An integrated dose equivalent to two times the expected integrated luminosity of the HL-LHC run has been absorbed by this second spare DT chamber and the final impact on the muon reconstruction efficiency is under study. Direct inspection of some extracted aged anode wires presented a melted resistive deposition of materials. Investigation on the outgassing of cell materials and of the gas components used at the GIF++ are underway. Strategies to mitigate the ageing effects are also being developed. From the long irradiation measurements of the second spare DT chamber, the effects of radiation in the performance of the DTs expected during the HL-LHC run will be presented. △ Less

Submitted 12 December, 2019; originally announced December 2019.

Comments: 10 pages, 7 figures, to be published in JINST, editor I. González Caballero

Report number: CMS CR-2019/159

Journal ref: JINST 14 C12010 (2019)

Day-ahead Operation of an Aggregator of Electric Vehicles via Optimization under Uncertainty

Authors: Álvaro Porras, Ricardo Fernández-Blanco, Juan Miguel Morales, Salvador Pineda

Abstract: We pose the aggregator's problem as a bilevel model, where the upper level minimizes the total operation costs of the fleet of EVs, while each lower level minimizes the energy available to each vehicle for transportation given a certain charging plan. Thanks to the totally unimodular character of the constraint matrix in the lower-level problems, the model can be mathematically recast as a computa… ▽ More We pose the aggregator's problem as a bilevel model, where the upper level minimizes the total operation costs of the fleet of EVs, while each lower level minimizes the energy available to each vehicle for transportation given a certain charging plan. Thanks to the totally unimodular character of the constraint matrix in the lower-level problems, the model can be mathematically recast as a computationally efficient mixed-integer program that delivers charging schedules that are robust against the uncertain availability of the EVs. Finally, we use synthetic data from the National Household Travel Survey 2017 to analyze the behavior of the EV aggregator from both economic and technical viewpoints and compare it with the results from a deterministic approach. △ Less

Submitted 25 September, 2020; v1 submitted 2 August, 2019; originally announced August 2019.

How Can Smart Buildings Be Price-Responsive?

Authors: Ricardo Fernández-Blanco, Juan Miguel Morales, Salvador Pineda

Abstract: The prospective participation of smart buildings in the electricity system is strongly related to the increasing active role of demand-side resources in the electrical grid. In addition, the growing penetration of smart meters and recent advances on home automation technologies will spur the development of new mathematical tools to help optimize the local resources of these buildings. Within this… ▽ More The prospective participation of smart buildings in the electricity system is strongly related to the increasing active role of demand-side resources in the electrical grid. In addition, the growing penetration of smart meters and recent advances on home automation technologies will spur the development of new mathematical tools to help optimize the local resources of these buildings. Within this context, this paper first provides a comprehensive model to determine the electrical consumption of a single-zone household based on economic model predictive control. The goal of this problem is to minimize the electricity consumption cost while accounting for the heating dynamics of the building, smart home appliances, and comfort constraints. This paper then identifies and analyzes the key parameters responsible for the price-responsive behaviour of smart households. △ Less

Submitted 1 August, 2019; originally announced August 2019.

Inverse Optimization with Kernel Regression: Application to the Power Forecasting and Bidding of a Fleet of Electric Vehicles

Authors: Ricardo Fernández-Blanco, Juan Miguel Morales, Salvador Pineda, Álvaro Porras

Abstract: This paper considers an aggregator of Electric Vehicles (EVs) who aims to learn the aggregate power of his/her fleet while also participating in the electricity market. The proposed approach is based on a data-driven inverse optimization (IO) method, which is highly nonlinear. To overcome such a caveat, we use a two-step estimation procedure which requires solving two convex programs. Both program… ▽ More This paper considers an aggregator of Electric Vehicles (EVs) who aims to learn the aggregate power of his/her fleet while also participating in the electricity market. The proposed approach is based on a data-driven inverse optimization (IO) method, which is highly nonlinear. To overcome such a caveat, we use a two-step estimation procedure which requires solving two convex programs. Both programs depend on penalty parameters that can be adjusted by using grid search. In addition, we propose the use of kernel regression to account for the nonlinear relationship between the behaviour of the pool of EVs and the explanatory variables, i.e., the past electricity prices and EV fleet's driving patterns. Unlike any other forecasting method, the proposed IO framework also allows the aggregator to derive a bid/offer curve, i.e. the tuple of price-quantity to be submitted to the electricity market, according to the market rules. We show the benefits of the proposed method against the machine-learning techniques that are reported to exhibit the best forecasting performance for this application in the technical literature. △ Less

Submitted 5 March, 2021; v1 submitted 1 August, 2019; originally announced August 2019.

Approximate Bayesian inference for a "steps and turns" continuous-time random walk observed at regular time intervals

Authors: Sofia Ruiz-Suarez, Vianey Leos-Barajas, Ignacio Alvarez-Castro, Juan M. Morales

Abstract: The study of animal movement is challenging because it is a process modulated by many factors acting at different spatial and temporal scales. Several models have been proposed which differ primarily in the temporal conceptualization, namely continuous and discrete time formulations. Naturally, animal movement occurs in continuous time but we tend to observe it at fixed time intervals. To account… ▽ More The study of animal movement is challenging because it is a process modulated by many factors acting at different spatial and temporal scales. Several models have been proposed which differ primarily in the temporal conceptualization, namely continuous and discrete time formulations. Naturally, animal movement occurs in continuous time but we tend to observe it at fixed time intervals. To account for the temporal mismatch between observations and movement decisions, we used a state-space model where movement decisions (steps and turns) are made in continuous time. The movement process is then observed at regular time intervals. As the likelihood function of this state-space model turned out to be complex to calculate yet simulating data is straightforward, we conduct inference using a few variations of Approximate Bayesian Computation (ABC). We explore the applicability of these methods as a function of the discrepancy between the temporal scale of the observations and that of the movement process in a simulation study. We demonstrate the application of this model to a real trajectory of a sheep that was reconstructed in high resolution using information from magnetometer and GPS devices. Our results suggest that accurate estimates can be obtained when the observations are less than 5 times the average time between changes in movement direction. The state-space model used here allowed us to connect the scales of the observations and movement decisions in an intuitive and easy to interpret way. Our findings underscore the idea that the time scale at which animal movement decisions are made needs to be considered when designing data collection protocols, and that sometimes high-frequency data may not be necessary to have good estimates of certain movement processes. △ Less

Submitted 23 July, 2019; originally announced July 2019.

Feature-driven Improvement of Renewable Energy Forecasting and Trading

Authors: Miguel Á. Muñoz, Juan M. Morales, Salvador Pineda

Abstract: Inspired from recent insights into the common ground of machine learning, optimization and decision-making, this paper proposes an easy-to-implement, but effective procedure to enhance both the quality of renewable energy forecasts and the competitive edge of renewable energy producers in electricity markets with a dual-price settlement of imbalances. The quality and economic gains brought by the… ▽ More Inspired from recent insights into the common ground of machine learning, optimization and decision-making, this paper proposes an easy-to-implement, but effective procedure to enhance both the quality of renewable energy forecasts and the competitive edge of renewable energy producers in electricity markets with a dual-price settlement of imbalances. The quality and economic gains brought by the proposed procedure essentially stem from the utilization of valuable predictors (also known as features) in a data-driven newsvendor model that renders a computationally inexpensive linear program. We illustrate the proposed procedure and numerically assess its benefits on a realistic case study that considers the aggregate wind power production in the Danish DK1 bidding zone as the variable to be predicted and traded. Within this context, our procedure leverages, among others, spatial information in the form of wind power forecasts issued by transmission system operators (TSO) in surrounding bidding zones and publicly available in online platforms. We show that our method is able to improve the quality of the wind power forecast issued by the Danish TSO by several percentage points (when measured in terms of the mean absolute or the root mean square error) and to significantly reduce the balancing costs incurred by the wind power producer. △ Less

Submitted 16 January, 2020; v1 submitted 17 July, 2019; originally announced July 2019.

Comments: 10 pages, 6 figures

Data-Driven Screening of Network Constraints for Unit Commitment

Authors: Salvador Pineda, Juan Miguel Morales, Asunción Jiménez-Cordero

Abstract: The transmission-constrained unit commitment (TC-UC) problem is one of the most relevant problems solved by independent system operators for the daily operation of power systems. Given its computational complexity, this problem is usually not solved to global optimality for real-size power systems. In this paper, we propose a data-driven method that leverages historical information to screen out n… ▽ More The transmission-constrained unit commitment (TC-UC) problem is one of the most relevant problems solved by independent system operators for the daily operation of power systems. Given its computational complexity, this problem is usually not solved to global optimality for real-size power systems. In this paper, we propose a data-driven method that leverages historical information to screen out network constraints in the TC-UC problem. First, past data on demand and renewable generation throughout the network are used to learn the congestion status of transmission lines. Then, we infer the lines that will not become congested for upcoming operating conditions based on such learning and disregard their capacity constraints. This way, we formulate a reduced TC-UC problem that is easier to solve. Numerical results on a medium- and a large-size power system show that the proposed approach outperforms existing ones by significantly reducing the computational time while obtaining solutions that are equal or close to the one obtained with the original TC-UC problem. Furthermore, the purely data-driven method we propose can be seamlessly complemented with a constraint generation procedure to guarantee that the optimal solution to the original TC-UC problem is eventually recovered. △ Less

Submitted 24 January, 2020; v1 submitted 10 July, 2019; originally announced July 2019.

Partition-based Distributionally Robust Optimization via Optimal Transport with Order Cone Constraints

Authors: Adrián Esteban-Pérez, Juan M. Morales

Abstract: In this paper we wish to tackle stochastic programs affected by ambiguity about the probability law that governs their uncertain parameters. Using optimal transport theory, we construct an ambiguity set that exploits the knowledge about the distribution of the uncertain parameters, which is provided by: (1) sample data and (2) a-priori information on the order among the probabilities that the true… ▽ More In this paper we wish to tackle stochastic programs affected by ambiguity about the probability law that governs their uncertain parameters. Using optimal transport theory, we construct an ambiguity set that exploits the knowledge about the distribution of the uncertain parameters, which is provided by: (1) sample data and (2) a-priori information on the order among the probabilities that the true data-generating distribution assigns to some regions of its support set. This type of order is enforced by means of order cone constraints and can encode a wide range of information on the shape of the probability distribution of the uncertain parameters such as information related to monotonicity or multi-modality. We seek decisions that are distributionally robust. In a number of practical cases, the resulting distributionally robust optimization (DRO) problem can be reformulated as a finite convex problem where the a-priori information translates into linear constraints. In addition, our method inherits the finite-sample performance guarantees of the Wasserstein-metric-based DRO approach proposed by Mohajerin Esfahani and Kuhn (Math Program 171(1-2):115-166. https://doi.org/10.1007/s10107-017-1172-1, 2018), while generalizing this and other popular DRO approaches. Finally, we have designed numerical experiments to analyze the performance of our approach with the newsvendor problem and the problem of a strategic firm competing à la Cournot in a market. △ Less

Submitted 13 June, 2021; v1 submitted 5 March, 2019; originally announced March 2019.

MSC Class: 90C15 Stochastic programming; 90C47 Minimax problems

Enabling Active/Passive Electricity Trading in Dual-Price Balancing Markets

Authors: Nicolò Mazzi, Alessio Trivella, Juan M. Morales

Abstract: In electricity markets with a dual-pricing scheme for balancing energy, controllable production units typically participate in the balancing market as "active" actors by offering regulating energy to the system, while renewable stochastic units are treated as "passive" participants that create imbalances and are subject to less competitive prices. Against this background, we propose an innovative… ▽ More In electricity markets with a dual-pricing scheme for balancing energy, controllable production units typically participate in the balancing market as "active" actors by offering regulating energy to the system, while renewable stochastic units are treated as "passive" participants that create imbalances and are subject to less competitive prices. Against this background, we propose an innovative market framework whereby the participant in the balancing market is allowed to act as an active agent (i.e., a provider of regulating energy) in some trading intervals and as a passive agent (i.e., a user of regulating energy) in some others. To illustrate and evaluate the proposed market framework, we consider the case of a virtual power plant (VPP) that trades in a two-settlement electricity market composed of a day-ahead and a dual-price balancing market. We formulate the optimal market offering problem of the VPP as a three-stage stochastic program, where uncertainty is in the day-ahead electricity prices, balancing prices and the power output from the renewable units. Computational experiments show that the VPP expected revenues can increase substantially compared to an active-only or passive-only participation, and in the paper we discuss how the variability of the stochastic sources affects the balancing market participation choice. △ Less

Submitted 19 December, 2018; originally announced December 2018.

A two-phase stochastic programming approach to biomass supply planning for combined heat and power plants

Authors: Ignacio Blanco, Daniela Guericke, Juan M. Morales, Henrik Madsen

Abstract: Due to the new carbon neutral policies, many district heating operators start operating their combined heat and power (CHP) plants using different types of biomass instead of fossil fuel. The contracts with the biomass suppliers are negotiated months in advance and involve many uncertainties from the energy producer's side. The demand for biomass is uncertain at that time, and heat demand and elec… ▽ More Due to the new carbon neutral policies, many district heating operators start operating their combined heat and power (CHP) plants using different types of biomass instead of fossil fuel. The contracts with the biomass suppliers are negotiated months in advance and involve many uncertainties from the energy producer's side. The demand for biomass is uncertain at that time, and heat demand and electricity prices vary drastically during the planning period. Furthermore, the optimal operation of combined heat and power plants has to consider the existing synergies between the power and heating systems. We propose a solution method using stochastic optimization to support the biomass supply planning for combined heat and power plants. Our two-phase approach determines mid-term decisions about biomass supply contracts as well as short-term decisions regarding the optimal production of the producer to ensure profitability and feasibility. We present results based on two realistic test cases. △ Less

Submitted 25 October, 2018; originally announced October 2018.

Time-Adaptive Unit Commitment

Authors: Salvador Pineda, Ricardo Fernandez-Blanco, Juan Miguel Morales

Abstract: The short-term operation of a power system is usually planned by solving a day-ahead unit commitment problem. Due to historical reasons, the commitment of the power generating units is decided over a time horizon typically consisting of the 24 hourly periods of a day. In this paper, we show that, as a result of the increasing penetration of intermittent renewable generation, this somewhat arbitrar… ▽ More The short-term operation of a power system is usually planned by solving a day-ahead unit commitment problem. Due to historical reasons, the commitment of the power generating units is decided over a time horizon typically consisting of the 24 hourly periods of a day. In this paper, we show that, as a result of the increasing penetration of intermittent renewable generation, this somewhat arbitrary and artificial division of time may prove to be significantly suboptimal and counterproductive. Instead, we propose a time-adaptive day-ahead unit commitment formulation that better captures the net-demand variability throughout the day. The proposed formulation provides the commitment and dispatch of thermal generating units over a set of 24 time periods too, but with different duration. To do that, we use a clustering procedure to select the duration of those adaptive time periods taking into account the renewable generation and demand forecasts. Numerical results show that, without increasing the computational burden, the proposed time-adaptive unit commitment allows for a more efficient use of the system flexibility, which translates into a lower operating cost and a higher penetration of renewable production than those achieved by a conventional hourly unit commitment problem. △ Less

Submitted 11 March, 2019; v1 submitted 29 September, 2018; originally announced October 2018.

Solving Linear Bilevel Problems Using Big-Ms: Not All That Glitters Is Gold

Authors: Salvador Pineda, Juan Miguel Morales

Abstract: The most common procedure to solve a linear bilevel problem in the PES community is, by far, to transform it into an equivalent single-level problem by replacing the lower level with its KKT optimality conditions. Then, the complementarity conditions are reformulated using additional binary variables and large enough constants (big-Ms) to cast the single-level problem as a mixed-integer linear pro… ▽ More The most common procedure to solve a linear bilevel problem in the PES community is, by far, to transform it into an equivalent single-level problem by replacing the lower level with its KKT optimality conditions. Then, the complementarity conditions are reformulated using additional binary variables and large enough constants (big-Ms) to cast the single-level problem as a mixed-integer linear program that can be solved using optimization software. In most cases, such large constants are tuned by trial and error. We show, through a counterexample, that this widely used trial-and-error approach may lead to highly suboptimal solutions. Then, further research is required to properly select big-M values to solve linear bilevel problems. △ Less

Submitted 27 September, 2018; originally announced September 2018.

A bicriteria perspective on L-Penalty Approaches - A corrigendum to Siddiqui and Gabriel's L-Penalty Approach for Solving MPECs

Authors: Kerstin Dächert, Sauleh Siddiqui, Javier Saez-Gallego, Steven A. Gabriel, Juan Miguel Morales

Abstract: This paper presents a corrigendum to Theorems 2 and 3 in Siddiqui S, Gabriel S (2013), An SOS1-Based Approach for Solving MPECs with a Natural Gas Market Application, Networks and Spatial Economics 13(2):205--227. In brief, we revise the claim that their L-penalty approach yields a solution satisfying complementarity for any positive value of L, in general. This becomes evident when interpreting t… ▽ More This paper presents a corrigendum to Theorems 2 and 3 in Siddiqui S, Gabriel S (2013), An SOS1-Based Approach for Solving MPECs with a Natural Gas Market Application, Networks and Spatial Economics 13(2):205--227. In brief, we revise the claim that their L-penalty approach yields a solution satisfying complementarity for any positive value of L, in general. This becomes evident when interpreting the L-penalty method as a weighted-sum scalarization of a bicriteria optimization problem. We also elaborate further assumptions under which the L-penalty approach yields a solution satisfying complementarity. △ Less

Submitted 24 July, 2018; originally announced July 2018.

Running on empty: Recharge dynamics from animal movement data

Authors: Mevin B. Hooten, Henry R. Scharf, Juan M. Morales

Abstract: Vital rates such as survival and recruitment have always been important in the study of population and community ecology. At the individual level, physiological processes such as energetics are critical in understanding biomechanics and movement ecology and also scale up to influence food webs and trophic cascades. Although vital rates and population-level characteristics are tied with individual-… ▽ More Vital rates such as survival and recruitment have always been important in the study of population and community ecology. At the individual level, physiological processes such as energetics are critical in understanding biomechanics and movement ecology and also scale up to influence food webs and trophic cascades. Although vital rates and population-level characteristics are tied with individual-level animal movement, most statistical models for telemetry data are not equipped to provide inference about these relationships because they lack the explicit, mechanistic connection to physiological dynamics. We present a framework for modeling telemetry data that explicitly includes an aggregated physiological process associated with decision making and movement in heterogeneous environments. Our framework accommodates a wide range of movement and physiological process specifications. We illustrate a specific model formulation in continuous-time to provide direct inference about gains and losses associated with physiological processes based on movement. Our approach can also be extended to accommodate auxiliary data when available. We demonstrate our model to infer mountain lion (in Colorado, USA) and African buffalo (in Kruger National Park, South Africa) recharge dynamics. △ Less

Submitted 30 January, 2020; v1 submitted 20 July, 2018; originally announced July 2018.

Setting Reserve Requirements to Approximate the Efficiency of the Stochastic Dispatch

Authors: Vladimir Dvorkin, Stefanos Delikaraoglou, Juan M. Morales

Abstract: This paper deals with the problem of clearing sequential electricity markets under uncertainty. We consider the European approach, where reserves are traded separately from energy to meet exogenous reserve requirements. Recently pro- posed stochastic dispatch models that co-optimize these services provide the most efficient solution in terms of expected operating costs by computing reserve needs e… ▽ More This paper deals with the problem of clearing sequential electricity markets under uncertainty. We consider the European approach, where reserves are traded separately from energy to meet exogenous reserve requirements. Recently pro- posed stochastic dispatch models that co-optimize these services provide the most efficient solution in terms of expected operating costs by computing reserve needs endogenously. However, these models are incompatible with existing market designs. This paper proposes a new method to compute reserve requirements that bring the outcome of sequential markets closer to the stochastic energy and reserves co-optimization in terms of cost efficiency. Our method is based on a stochastic bilevel program that implicitly improves the inter-temporal coordination of energy and reserve markets, but remains compatible with the European market design. We use two standard IEEE reliability test cases to illustrate the benefit of intelligently setting operating reserves in single and multiple reserve control zones. △ Less

Submitted 30 October, 2018; v1 submitted 12 May, 2018; originally announced May 2018.

An Integrated Market for Electricity and Natural Gas Systems with Stochastic Power Producers

Authors: Christos Ordoudis, Pierre Pinson, Juan M. Morales

Abstract: In energy systems with high shares of weather-driven renewable power sources, gas-fired power plants can serve as a back-up technology to ensure security of supply and provide short-term flexibility. Therefore, a tighter coordination between electricity and natural gas networks is foreseen. In this work, we examine different levels of coordination in terms of system integration and time coupling o… ▽ More In energy systems with high shares of weather-driven renewable power sources, gas-fired power plants can serve as a back-up technology to ensure security of supply and provide short-term flexibility. Therefore, a tighter coordination between electricity and natural gas networks is foreseen. In this work, we examine different levels of coordination in terms of system integration and time coupling of trading floors. We propose an integrated operational model for electricity and natural gas systems under uncertain power supply by applying two-stage stochastic programming. This formulation co-optimizes day-ahead and real-time dispatch of both energy systems and aims at minimizing the total expected cost. Additionally, two deterministic models, one of an integrated energy system and one that treats the two systems independently, are presented. We utilize a formulation that considers the linepack of the natural gas system, while it results in a tractable mixed-integer linear programming (MILP) model. Our analysis demonstrates the effectiveness of the proposed model in accommodating high shares of renewables and the importance of proper natural gas system modeling in short-term operations to reveal valuable flexibility of the natural gas system. Moreover, we identify the coordination parameters between the two markets and show their impact on the system's operation and dispatch. △ Less

Submitted 16 May, 2018; v1 submitted 11 May, 2018; originally announced May 2018.

Spatio-Temporal Forecasting by Coupled Stochastic Differential Equations: Applications to Solar Power

Authors: Emil B. Iversen, Rune Juhl, Jan K. Møller, Jan Kleissl, Henrik Madsen, Juan M. Morales

Abstract: Spatio-temporal problems exist in many areas of knowledge and disciplines ranging from biology to engineering and physics. However, solution strategies based on classical statistical techniques often fall short due to the large number of parameters that are to be estimated and the huge amount of data that need to be handled. In this paper we apply known techniques in a novel way to provide a frame… ▽ More Spatio-temporal problems exist in many areas of knowledge and disciplines ranging from biology to engineering and physics. However, solution strategies based on classical statistical techniques often fall short due to the large number of parameters that are to be estimated and the huge amount of data that need to be handled. In this paper we apply known techniques in a novel way to provide a framework for spatio-temporal modeling which is both computationally efficient and has a low dimensional parameter space. We present a micro-to-macro approach whereby the local dynamics are first modeled and subsequently combined to capture the global system behavior. The proposed methodology relies on coupled stochastic differential equations and is applied to produce spatio-temporal forecasts for a solar power plant for very short horizons, which essentially implies tracking clouds moving across the field of solar power inverters. We outperform simple and complex benchmarks while providing forecasts for 70 spatial dimensions and 24 lead times (i.e., for a total number of random variables equal to 1680). The resulting model can provide all sorts of forecast products, ranging from point forecasts and co-variances to predictive densities, multi-horizon forecasts, and space-time trajectories. △ Less

Submitted 14 June, 2017; originally announced June 2017.

Comments: 24 pages, 6 figures

Multi-scale modeling of animal movement and general behavior data using hidden Markov models with hierarchical structures

Authors: Vianey Leos-Barajas, Eric Gangloff, Timo Adam, Roland Langrock, Floris M. van Beest, Jacob Nabe-Nielsen, Juan M. Morales

Abstract: Hidden Markov models (HMMs) are commonly used to model animal movement data and infer aspects of animal behavior. An HMM assumes that each data point from a time series of observations stems from one of $N$ possible states. The states are loosely connected to behavioral modes that manifest themselves at the temporal resolution at which observations are made. However, due to advances in tag technol… ▽ More Hidden Markov models (HMMs) are commonly used to model animal movement data and infer aspects of animal behavior. An HMM assumes that each data point from a time series of observations stems from one of $N$ possible states. The states are loosely connected to behavioral modes that manifest themselves at the temporal resolution at which observations are made. However, due to advances in tag technology, data can be collected at increasingly fine temporal resolutions. Yet, inferences at time scales cruder than those at which data are collected, and which correspond to larger-scale behavioral processes, are not yet answered via HMMs. We include additional hierarchical structures to the basic HMM framework in order to incorporate multiple Markov chains at various time scales. The hierarchically structured HMMs allow for behavioral inferences at multiple time scales and can also serve as a means to avoid coarsening data. Our proposed framework is one of the first that models animal behavior simultaneously at multiple time scales, opening new possibilities in the area of animal movement modeling. We illustrate the application of hierarchically structured HMMs in two real-data examples: (i) vertical movements of harbor porpoises observed in the field, and (ii) garter snake movement data collected as part of an experimental design. △ Less

Submitted 12 February, 2017; originally announced February 2017.

Comments: 28 pages, 4 figures

Short-term Forecasting of Price-responsive Loads Using Inverse Optimization

Authors: Javier Saez-Gallego, Juan M. Morales

Abstract: We consider the problem of forecasting the aggregate demand of a pool of price-responsive consumers of electricity. The price-response of the aggregation is modeled by an optimization problem that is characterized by a set of marginal utility curves and minimum and maximum power consumption limits. The task of estimating these parameters is addressed using a generalized inverse optimization scheme… ▽ More We consider the problem of forecasting the aggregate demand of a pool of price-responsive consumers of electricity. The price-response of the aggregation is modeled by an optimization problem that is characterized by a set of marginal utility curves and minimum and maximum power consumption limits. The task of estimating these parameters is addressed using a generalized inverse optimization scheme that, in turn, requires solving a nonconvex mathematical program. We introduce a solution method that overcomes the nonconvexities by solving instead two linear problems with a penalty term, which is statistically adjusted by using a cross-validation algorithm. The proposed methodology is data-driven and leverages information from regressors, such as time and weather variables, to account for changes in the parameter estimates. The power load of a group of heating, ventilation, and air conditioning systems in buildings is simulated, and the results show that the aggregate demand of the group can be successfully captured by the proposed model, making it suitable for short-term forecasting purposes. △ Less

Submitted 25 July, 2016; originally announced July 2016.

An Efficient Robust Solution to the Two-Stage Stochastic Unit Commitment Problem

Authors: Ignacio Blanco, Juan M. Morales

Abstract: This paper proposes a reformulation of the scenario-based two-stage unit commitment problem under uncertainty that allows finding unit-commitment plans that perform reasonably well both in expectation and for the worst case realization of the uncertainties. The proposed reformulation is based on partitioning the sample space of the uncertain factors by clustering the scenarios that approximate the… ▽ More This paper proposes a reformulation of the scenario-based two-stage unit commitment problem under uncertainty that allows finding unit-commitment plans that perform reasonably well both in expectation and for the worst case realization of the uncertainties. The proposed reformulation is based on partitioning the sample space of the uncertain factors by clustering the scenarios that approximate their probability distributions. It is, furthermore, very amenable to decomposition and parallelization using a column-and-constraint generation procedure. △ Less

Submitted 20 June, 2016; originally announced June 2016.

On the Inefficiency of the Merit Order in Forward Electricity Markets with Uncertain Supply

Authors: Juan M. Morales, Salvador Pineda

Abstract: This paper provides insight on the economic inefficiency of the classical merit-order dispatch in electricity markets with uncertain supply. For this, we consider a power system whose operation is driven by a two-stage electricity market, with a forward and a real-time market. We analyze two different clearing mechanisms: a conventional one, whereby the forward and the balancing markets are indepe… ▽ More This paper provides insight on the economic inefficiency of the classical merit-order dispatch in electricity markets with uncertain supply. For this, we consider a power system whose operation is driven by a two-stage electricity market, with a forward and a real-time market. We analyze two different clearing mechanisms: a conventional one, whereby the forward and the balancing markets are independently cleared following a merit order, and a stochastic one, whereby both market stages are co-optimized with a view to minimizing the expected aggregate system operating cost. We first derive analytical formulae to determine the dispatch rule prompted by the co-optimized two-stage market for a stylized power system with flexible, inflexible and stochastic power generation and infinite transmission capacity. This exercise sheds light on the conditions for the stochastic market-clearing mechanism to break the merit order. We then introduce and characterize two enhanced variants of the conventional two-stage market that result in either price-consistent or cost-efficient merit-order dispatch solutions, respectively. The first of these variants corresponds to a conventional two-stage market that allows for virtual bidding, while the second requires that the stochastic power production be centrally dispatched. Finally, we discuss the practical implications of our analytical results and illustrate our conclusions through examples. △ Less

Submitted 27 May, 2016; v1 submitted 22 July, 2015; originally announced July 2015.

Comments: 51 pages

MSC Class: 90C90; 90C25; 91A10 ACM Class: J.4; G.1.6

Commitment and Dispatch of Heat and Power Units via Affinely Adjustable Robust Optimization

Authors: Marco Zugno, Juan M. Morales, Henrik Madsen

Abstract: The joint management of heat and power systems is believed to be key to the integration of renewables into energy systems with a large penetration of district heating. Determining the day-ahead unit commitment and production schedules for these systems is an optimization problem subject to uncertainty stemming from the unpredictability of demand and prices for heat and electricity. Furthermore, ow… ▽ More The joint management of heat and power systems is believed to be key to the integration of renewables into energy systems with a large penetration of district heating. Determining the day-ahead unit commitment and production schedules for these systems is an optimization problem subject to uncertainty stemming from the unpredictability of demand and prices for heat and electricity. Furthermore, owing to the dynamic features of production and heat storage units as well as to the length and granularity of the optimization horizon (e.g., one whole day with hourly resolution), this problem is in essence a multi-stage one. We propose a formulation based on robust optimization where recourse decisions are approximated as linear or piecewise-linear functions of the uncertain parameters. This approach allows for a rigorous modeling of the uncertainty in multi-stage decision-making without compromising computational tractability. We perform an extensive numerical study based on data from the Copenhagen area in Denmark, which highlights important features of the proposed model. Firstly, we illustrate commitment and dispatch choices that increase conservativeness in the robust optimization approach. Secondly, we appraise the gain obtained by switching from linear to piecewise-linear decision rules within robust optimization. Furthermore, we give directions for selecting the parameters defining the uncertainty set (size, budget) and assess the resulting trade-off between average profit and conservativeness of the solution. Finally, we perform a thorough comparison with competing models based on deterministic optimization and stochastic programming. △ Less

Submitted 21 July, 2015; originally announced July 2015.

Comments: 31 pages

MSC Class: 90CXX ACM Class: G.1.6

A Data-driven Bidding Model for a Cluster of Price-responsive Consumers of Electricity

Authors: Javier Saez-Gallego, Juan M. Morales, Marco Zugno, Henrik Madsen

Abstract: This paper deals with the market-bidding problem of a cluster of price-responsive consumers of electricity. We develop an inverse optimization scheme that, recast as a bilevel programming problem, uses price-consumption data to estimate the complex market bid that best captures the price-response of the cluster. The complex market bid is defined as a series of marginal utility functions plus some… ▽ More This paper deals with the market-bidding problem of a cluster of price-responsive consumers of electricity. We develop an inverse optimization scheme that, recast as a bilevel programming problem, uses price-consumption data to estimate the complex market bid that best captures the price-response of the cluster. The complex market bid is defined as a series of marginal utility functions plus some constraints on demand, such as maximum pick-up and drop-off rates. The proposed modeling approach also leverages information on exogenous factors that may influence the consumption behavior of the cluster, e.g., weather conditions and calendar effects. We test the proposed methodology for a particular application: forecasting the power consumption of a small aggregation of households that took part in the Olympic Peninsula project. Results show that the price-sensitive consumption of the cluster of flexible loads can be largely captured in the form of a complex market bid, so that this could be ultimately used for the cluster to participate in the wholesale electricity market. △ Less

Submitted 2 November, 2015; v1 submitted 22 June, 2015; originally announced June 2015.