Showing 1–31 of 31 results for author: Garcia, J D

The LiteBIRD mission to explore cosmic inflation

Authors: T. Ghigna, A. Adler, K. Aizawa, H. Akamatsu, R. Akizawa, E. Allys, A. Anand, J. Aumont, J. Austermann, S. Azzoni, C. Baccigalupi, M. Ballardini, A. J. Banday, R. B. Barreiro, N. Bartolo, S. Basak, A. Basyrov, S. Beckman, M. Bersanelli, M. Bortolami, F. Bouchet, T. Brinckmann, P. Campeti, E. Carinos, A. Carones , et al. (134 additional authors not shown)

Abstract: LiteBIRD, the next-generation cosmic microwave background (CMB) experiment, aims for a launch in Japan's fiscal year 2032, marking a major advancement in the exploration of primordial cosmology and fundamental physics. Orbiting the Sun-Earth Lagrangian point L2, this JAXA-led strategic L-class mission will conduct a comprehensive map** of the CMB polarization across the entire sky. During its 3-… ▽ More LiteBIRD, the next-generation cosmic microwave background (CMB) experiment, aims for a launch in Japan's fiscal year 2032, marking a major advancement in the exploration of primordial cosmology and fundamental physics. Orbiting the Sun-Earth Lagrangian point L2, this JAXA-led strategic L-class mission will conduct a comprehensive map** of the CMB polarization across the entire sky. During its 3-year mission, LiteBIRD will employ three telescopes within 15 unique frequency bands (ranging from 34 through 448 GHz), targeting a sensitivity of 2.2\,$μ$K-arcmin and a resolution of 0.5$^\circ$ at 100\,GHz. Its primary goal is to measure the tensor-to-scalar ratio $r$ with an uncertainty $δr = 0.001$, including systematic errors and margin. If $r \geq 0.01$, LiteBIRD expects to achieve a $>5σ$ detection in the $\ell=$2-10 and $\ell=$11-200 ranges separately, providing crucial insight into the early Universe. We describe LiteBIRD's scientific objectives, the application of systems engineering to mission requirements, the anticipated scientific impact, and the operations and scanning strategies vital to minimizing systematic effects. We will also highlight LiteBIRD's synergies with concurrent CMB projects. △ Less

Submitted 4 June, 2024; originally announced June 2024.

Comments: 23 pages, 9 figures, 1 table, SPIE Astronomical Telescopes + Instrumentation 2024

Long-term Hydrothermal Bid-based Market Simulator

Authors: Joaquim Dias Garcia, Alexandre Street, Mario Veiga Pereira

Abstract: Simulating long-term hydrothermal bid-based markets considering strategic agents is a challenging task. The representation of strategic agents considering inter-temporal constraints within a stochastic framework brings additional complexity to the already difficult single-period bilevel, thus, non-convex, optimal bidding problem. Thus, we propose a simulation methodology that effectively addresses… ▽ More Simulating long-term hydrothermal bid-based markets considering strategic agents is a challenging task. The representation of strategic agents considering inter-temporal constraints within a stochastic framework brings additional complexity to the already difficult single-period bilevel, thus, non-convex, optimal bidding problem. Thus, we propose a simulation methodology that effectively addresses these challenges for large-scale hydrothermal power systems. We demonstrate the effectiveness of the framework through a case study with real data from the large-scale Brazilian power system. In the case studies, we show the effects of market concentration in power systems and how contracts can be used to mitigate them. In particular, we show how market power might affect the current setting in Brazil. The developed method can strongly benefit policy makers, market monitors, and market designers as simulations can be used to understand existing power systems and experiment with alternative designs. △ Less

Submitted 11 March, 2024; originally announced March 2024.

A Multicut Approach to Compute Upper Bounds for Risk-Averse SDDP

Authors: Joaquim Dias Garcia, Iago Leal, Raphael Chabar, Mario Veiga Pereira

Abstract: Stochastic Dual Dynamic Programming (SDDP) is a widely used and fundamental algorithm for solving multistage stochastic optimization problems. Although SDDP has been frequently applied to solve risk-averse models with the Conditional Value-at-Risk (CVaR), it is known that the estimation of upper bounds is a methodological challenge, and many methods are computationally intensive. In practice, this… ▽ More Stochastic Dual Dynamic Programming (SDDP) is a widely used and fundamental algorithm for solving multistage stochastic optimization problems. Although SDDP has been frequently applied to solve risk-averse models with the Conditional Value-at-Risk (CVaR), it is known that the estimation of upper bounds is a methodological challenge, and many methods are computationally intensive. In practice, this leaves most SDDP implementations without a practical and clear stop** criterion. In this paper, we propose using the information already contained in a multicut formulation of SDDP to solve this problem with a simple and computationally efficient methodology. The multicut version of SDDP, in contrast with the typical average cut, preserves the information about which scenarios give rise to the worst costs, thus contributing to the CVaR value. We use this fact to modify the standard sampling method on the forward step so the average of multiple paths approximates the nested CVaR cost. We highlight that minimal changes are required in the SDDP algorithm and there is no additional computational burden for a fixed number of iterations. We present multiple case studies to empirically demonstrate the effectiveness of the method. First, we use a small hydrothermal dispatch test case, in which we can write the deterministic equivalent of the entire scenario tree to show that the method perfectly computes the correct objective values. Then, we present results using a standard approximation of the Brazilian operation problem and a real hydrothermal dispatch case based on data from Colombia. Our numerical experiments showed that this method consistently calculates upper bounds higher than lower bounds for those risk-averse problems and that lower bounds are improved thanks to the better exploration of the scenarios tree. △ Less

Submitted 24 July, 2023; originally announced July 2023.

QUBO.jl: A Julia Ecosystem for Quadratic Unconstrained Binary Optimization

Authors: Pedro Maciel Xavier, Pedro Ripper, Tiago Andrade, Joaquim Dias Garcia, Nelson Maculan, David E. Bernal Neira

Abstract: We present QUBO.jl, an end-to-end Julia package for working with QUBO (Quadratic Unconstrained Binary Optimization) instances. This tool aims to convert a broad range of JuMP problems for straightforward application in many physics and physics-inspired solution methods whose standard optimization form is equivalent to the QUBO. These methods include quantum annealing, quantum gate-circuit optimiza… ▽ More We present QUBO.jl, an end-to-end Julia package for working with QUBO (Quadratic Unconstrained Binary Optimization) instances. This tool aims to convert a broad range of JuMP problems for straightforward application in many physics and physics-inspired solution methods whose standard optimization form is equivalent to the QUBO. These methods include quantum annealing, quantum gate-circuit optimization algorithms (Quantum Optimization Alternating Ansatz, Variational Quantum Eigensolver), other hardware-accelerated platforms, such as Coherent Ising Machines and Simulated Bifurcation Machines, and more traditional methods such as simulated annealing. Besides working with reformulations, QUBO.jl allows its users to interface with the aforementioned hardware, sending QUBO models in various file formats and retrieving results for subsequent analysis. QUBO.jl was written as a JuMP / MathOptInterface (MOI) layer that automatically maps between the input and output frames, thus providing a smooth modeling experience. △ Less

Submitted 31 August, 2023; v1 submitted 5 July, 2023; originally announced July 2023.

Comparing BilevelJuMP.jl Formulations: Support Vector Regression Hyperparameter Tuning

Authors: Joaquim Dias Garcia, Guilherme Bodin, Alexandre Street

Abstract: In this technical report, we compare multiple reformulation techniques and solvers that can be used with the Julia package BilevelJuMP. We focus on the special case of Hyperparameter Tuning for Support Vector Regression. We describe a bilevel model for the problem in question. Then we present code for generating data and models that solve the problem. Finally, we present results and a brief analys… ▽ More In this technical report, we compare multiple reformulation techniques and solvers that can be used with the Julia package BilevelJuMP. We focus on the special case of Hyperparameter Tuning for Support Vector Regression. We describe a bilevel model for the problem in question. Then we present code for generating data and models that solve the problem. Finally, we present results and a brief analysis. △ Less

Submitted 26 May, 2023; originally announced May 2023.

Comments: arXiv admin note: substantial text overlap with arXiv:2205.02307

Regularization and Optimization in Model-Based Clustering

Authors: Raphael Araujo Sampaio, Joaquim Dias Garcia, Marcus Poggi, Thibaut Vidal

Abstract: Due to their conceptual simplicity, k-means algorithm variants have been extensively used for unsupervised cluster analysis. However, one main shortcoming of these algorithms is that they essentially fit a mixture of identical spherical Gaussians to data that vastly deviates from such a distribution. In comparison, general Gaussian Mixture Models (GMMs) can fit richer structures but require estima… ▽ More Due to their conceptual simplicity, k-means algorithm variants have been extensively used for unsupervised cluster analysis. However, one main shortcoming of these algorithms is that they essentially fit a mixture of identical spherical Gaussians to data that vastly deviates from such a distribution. In comparison, general Gaussian Mixture Models (GMMs) can fit richer structures but require estimating a quadratic number of parameters per cluster to represent the covariance matrices. This poses two main issues: (i) the underlying optimization problems are challenging due to their larger number of local minima, and (ii) their solutions can overfit the data. In this work, we design search strategies that circumvent both issues. We develop more effective optimization algorithms for general GMMs, and we combine these algorithms with regularization strategies that avoid overfitting. Through extensive computational analyses, we observe that optimization or regularization in isolation does not substantially improve cluster recovery. However, combining these techniques permits a completely new level of performance previously unachieved by k-means algorithm variants, unraveling vastly different cluster structures. These results shed new light on the current status quo between GMM and k-means methods and suggest the more frequent use of general GMMs for data exploration. To facilitate such applications, we provide open-source code as well as Julia packages (UnsupervisedClustering.jl and RegularizedCovarianceMatrices.jl) implementing the proposed techniques. △ Less

Submitted 5 February, 2024; v1 submitted 5 February, 2023; originally announced February 2023.

Flexible Differentiable Optimization via Model Transformations

Authors: Mathieu Besançon, Joaquim Dias Garcia, Benoît Legat, Akshay Sharma

Abstract: We introduce DiffOpt.jl, a Julia library to differentiate through the solution of optimization problems with respect to arbitrary parameters present in the objective and/or constraints. The library builds upon MathOptInterface, thus leveraging the rich ecosystem of solvers and composing well with modeling languages like JuMP. DiffOpt offers both forward and reverse differentiation modes, enabling… ▽ More We introduce DiffOpt.jl, a Julia library to differentiate through the solution of optimization problems with respect to arbitrary parameters present in the objective and/or constraints. The library builds upon MathOptInterface, thus leveraging the rich ecosystem of solvers and composing well with modeling languages like JuMP. DiffOpt offers both forward and reverse differentiation modes, enabling multiple use cases from hyperparameter optimization to backpropagation and sensitivity analysis, bridging constrained optimization with end-to-end differentiable programming. DiffOpt is built on two known rules for differentiating quadratic programming and conic programming standard forms. However, thanks ability to differentiate through model transformation, the user is not limited to these forms and can differentiate with respect to the parameters of any model that can be reformulated into these standard forms. This notably includes programs mixing affine conic constraints and convex quadratic constraints or objective function. △ Less

Submitted 31 July, 2023; v1 submitted 10 June, 2022; originally announced June 2022.

JuMP 1.0: Recent improvements to a modeling language for mathematical optimization

Authors: Miles Lubin, Oscar Dowson, Joaquim Dias Garcia, Joey Huchette, Benoît Legat, Juan Pablo Vielma

Abstract: JuMP is an algebraic modeling language embedded in the Julia programming language. JuMP allows users to model optimization problems of a variety of kinds, including linear programming, integer programming, conic optimization, semidefinite programming, and nonlinear programming, and handles the low-level details of communicating with solvers. After nearly 10 years in development, JuMP 1.0 was relea… ▽ More JuMP is an algebraic modeling language embedded in the Julia programming language. JuMP allows users to model optimization problems of a variety of kinds, including linear programming, integer programming, conic optimization, semidefinite programming, and nonlinear programming, and handles the low-level details of communicating with solvers. After nearly 10 years in development, JuMP 1.0 was released in March, 2022. In this short communication, we highlight the improvements to JuMP from recent releases up to and including 1.0. △ Less

Submitted 19 March, 2023; v1 submitted 31 May, 2022; originally announced June 2022.

BilevelJuMP.jl: Modeling and Solving Bilevel Optimization in Julia

Authors: Joaquim Dias Garcia, Guilherme Bodin, Alexandre Street

Abstract: In this paper we present BilevelJuMP, a new Julia package to support bilevel optimization within the JuMP framework. The package is a Julia library that enables the user to describe both upper and lower-level optimization problems using the JuMP algebraic syntax. Due to the generality and flexibility our library inherits from JuMP's syntax, our package allows users to model bilevel optimization pr… ▽ More In this paper we present BilevelJuMP, a new Julia package to support bilevel optimization within the JuMP framework. The package is a Julia library that enables the user to describe both upper and lower-level optimization problems using the JuMP algebraic syntax. Due to the generality and flexibility our library inherits from JuMP's syntax, our package allows users to model bilevel optimization problems with conic constraints in the lower level and all JuMP supported constraints in the upper level (Conic, Quadratic, Non-Linear, Integer, etc.). Moreover, the user-defined problem can be subsequently solved by various techniques relying on mathematical program with equilibrium constraints (MPEC) reformulations. Manipulations on the original problem data are possible due to MathOptInterface.jl's structures and Dualization.jl features. Hence, the proposed package allows quickly model, deploy, and thereby experiment bilevel models based on off-the-shelf mixed integer linear programming and nonlinear solvers. △ Less

Submitted 6 June, 2022; v1 submitted 4 May, 2022; originally announced May 2022.

An Integrated Progressive Hedging and Benders Decomposition with Multiple Master Method to Solve the Brazilian Generation Expansion Problem

Authors: Alessandro Soares, Alexandre Street, Tiago Andrade, Joaquim Dias Garcia

Abstract: This paper exploits the decomposition structure of the large-scale hydrothermal generation expansion planning problem with an integrated modified Benders Decomposition and Progressive Hedging approach. We consider detailed and realistic data from the Brazilian power system to represent hourly chronological constraints based on typical days per month and year. Also, we represent the multistage stoc… ▽ More This paper exploits the decomposition structure of the large-scale hydrothermal generation expansion planning problem with an integrated modified Benders Decomposition and Progressive Hedging approach. We consider detailed and realistic data from the Brazilian power system to represent hourly chronological constraints based on typical days per month and year. Also, we represent the multistage stochastic nature of the optimal hydrothermal operational policy through co-optimized linear decision rules for individual reservoirs. Therefore, we ensure investment decisions compatible with a nonanticipative (implementable) operational policy. To solve the large-scale optimization problem, we propose an improved Benders Decomposition method with multiple instances of the master problem, each of which strengthened by primal cuts and new Benders cuts generated by each master's trial solution. Additionally, our new approach allows using Progressive Hedging penalization terms for accelerating the convergence of the method. We show that our method is 60\% faster than the benchmark. Finally, the consideration of a nonanticipative operational policy can save 7.64\% of the total cost (16.18\% of the investment costs) and significantly improve spot price profiles. △ Less

Submitted 1 December, 2021; v1 submitted 6 August, 2021; originally announced August 2021.

Assessing the Cost of Network Simplifications in Long-Term Hydrothermal Dispatch Planning Models

Authors: Andrew W. Rosemberg, Alexandre Street, Joaquim Dias Garcia, Davi M. Valladão, Thuener Silva, Oscar Dowson

Abstract: The sustainable utilization of hydro energy relies on accurate estimates of the opportunity cost of the water. This value is calculated through long-term hydrothermal dispatch problems (LTHDP), and the recent literature has raised awareness about the consequences of modeling simplifications in these problems. The inaccurate representation of Kirchhoff's voltage law under the premise of a DC power… ▽ More The sustainable utilization of hydro energy relies on accurate estimates of the opportunity cost of the water. This value is calculated through long-term hydrothermal dispatch problems (LTHDP), and the recent literature has raised awareness about the consequences of modeling simplifications in these problems. The inaccurate representation of Kirchhoff's voltage law under the premise of a DC power flow is an example. Under a non-linear AC model, however, the LTHDP becomes intractable, and the literature lacks an accurate evaluation method of different modeling alternatives. In this paper, we extend the state-of-the-art cost-assessment framework of network approximations for LTHDP and bring relevant and practical new insights. First, we increase the quality of the assessment by using an AC power flow to simulate and compare the performance of five policies based on different network approximations. Second, we find that the tightest network relaxation (based on semidefinite programming) is not the one exhibiting the best performance. Results show that the DC {power flow} with quadratic losses approximation exhibits the lowest expected cost and inconsistency gaps. Finally, its computational burden is lower than that exhibited by the semidefinite relaxation, whereas market distortions are significantly reduced in comparison to previously published benchmarks based on DC power flow. △ Less

Submitted 12 September, 2021; v1 submitted 20 July, 2021; originally announced July 2021.

Application-Driven Learning: A Closed-Loop Prediction and Optimization Approach Applied to Dynamic Reserves and Demand Forecasting

Authors: Joaquim Dias Garcia, Alexandre Street, Tito Homem-de-Mello, Francisco D. Muñoz

Abstract: Forecasting and decision-making are generally modeled as two sequential steps with no feedback, following an open-loop approach. In this paper, we present application-driven learning, a new closed-loop framework in which the processes of forecasting and decision-making are merged and co-optimized through a bilevel optimization problem. We present our methodology in a general format and prove that… ▽ More Forecasting and decision-making are generally modeled as two sequential steps with no feedback, following an open-loop approach. In this paper, we present application-driven learning, a new closed-loop framework in which the processes of forecasting and decision-making are merged and co-optimized through a bilevel optimization problem. We present our methodology in a general format and prove that the solution converges to the best estimator in terms of the expected cost of the selected application. Then, we propose two solution methods: an exact method based on the KKT conditions of the second-level problem and a scalable heuristic approach suitable for decomposition methods. The proposed methodology is applied to the relevant problem of defining dynamic reserve requirements and conditional load forecasts, offering an alternative approach to current ad hoc procedures implemented in industry practices. We benchmark our methodology with the standard sequential least-squares forecast and dispatch planning process. We apply the proposed methodology to an illustrative system and to a wide range of instances, from dozens of buses to large-scale realistic systems with thousands of buses. Our results show that the proposed methodology is scalable and yields consistently better performance than the standard open-loop approach. △ Less

Submitted 8 April, 2024; v1 submitted 25 February, 2021; originally announced February 2021.

Multiscale Stochastic Simulation of the US Pacific Northwest Using Distributed Computing and Databases with Integrated Inflow and Variable Renewable Energy

Authors: Joaquim Dias Garcia, Guilherme Machado, André Dias, Gerson Couto, John Ollis, John Fazio, Daniel Hua

Abstract: Modelling challenges of the United States Pacific Northwest system have grown in the last decade. Besides classical modelling difficulties such as a complex hydro cascade with many operational constraints, we have seen higher penetration of variable renewable energy inside and outside the system leading to internal issues and completely different power exchanges with the West Coast System. The ana… ▽ More Modelling challenges of the United States Pacific Northwest system have grown in the last decade. Besides classical modelling difficulties such as a complex hydro cascade with many operational constraints, we have seen higher penetration of variable renewable energy inside and outside the system leading to internal issues and completely different power exchanges with the West Coast System. The analysis of adequacy and reliability of this system motivated the design and implementation of a five-step simulator including four planning phases and an operation step. The five levels were modeled as mathematical programs that are linked from top to bottom by fixed decisions and improvements in forecasts, on the other hand they are also linked from bottom to top by system updated states. The solution of the millions of resulting mathematical programs was made possible by applying state of the art optimization techniques and high performance data bases in a massively parallel environment. △ Less

Submitted 5 August, 2020; originally announced August 2020.

Application of Progressive Hedging to Var Expansion Planning Under Uncertainty

Authors: Igor Carvalho, Tiago Andrade, Joaquim Dias Garcia, Maria de Lujan Latorre

Abstract: This paper describes the application of a Progressive Hedging (PH) algorithm to the least-cost var planning under uncertainty. The method PH is a scenario-based decomposition technique for solving stochastic programs, i.e., it decomposes a large scale stochastic problem into s deterministic subproblems and couples the decision from the s subproblems to form a solution for the original stochastic p… ▽ More This paper describes the application of a Progressive Hedging (PH) algorithm to the least-cost var planning under uncertainty. The method PH is a scenario-based decomposition technique for solving stochastic programs, i.e., it decomposes a large scale stochastic problem into s deterministic subproblems and couples the decision from the s subproblems to form a solution for the original stochastic problem. The effectiveness and computational performance of the proposed methodology will be illustrated with var planning studies for the IEEE 24-bus system (5 operating scenarios), the 200-bus Bolivian system (1,152 operating scenarios) and the 1,600-bus Colombian system (180 scenarios). △ Less

Submitted 17 April, 2020; originally announced April 2020.

Modeling Multiscale Variable Renewable Energy and Inflow Scenarios in Very Large Regions with Nonparametric Bayesian Networks

Authors: Julio Alberto Dias, Guilherme Machado, Alessandro Soares, Joaquim Dias Garcia

Abstract: In this paper, we propose a non-parametric Bayesian network method to generate synthetic scenarios of hourly generation for variable renewable energy(VRE) plants. The methodology consists of a non-parametric estimation of the probability distribution of VRE generation, followed by an inverse probability integral transform, in order to obtain normally distributed variables of VRE generation. Then,… ▽ More In this paper, we propose a non-parametric Bayesian network method to generate synthetic scenarios of hourly generation for variable renewable energy(VRE) plants. The methodology consists of a non-parametric estimation of the probability distribution of VRE generation, followed by an inverse probability integral transform, in order to obtain normally distributed variables of VRE generation. Then, we build a Bayesian network based on the evaluation of the spatial correlation between variables (VRE generation and hydro inflows, but load forecast, temperature, and other types of random variables could also be used with the proposed framework), to generate future synthetic scenarios while kee** the historical spatial correlation structure. Finally, we present a real-life case study, that uses real data from the Brazilian power system, to show the improvements that the present methodology allows for real-life studies. △ Less

Submitted 10 March, 2020; originally announced March 2020.

A parallel-computing algorithm for high-energy physics particle tracking and decoding using GPU architectures

Authors: Placido Fernandez Declara, Daniel Hugo Cámpora Pérez, Javier Garcia-Blas, Dorothea vom Bruch, J. Daniel Garcia, Niko Neufeld

Abstract: Real-time data processing is one of the central processes of particle physics experiments which require large computing resources. The LHCb (Large Hadron Collider beauty) experiment will be upgraded to cope with a particle bunch collision rate of 30 million times per second, producing $10^9$ particles/s. 40 Tbits/s need to be processed in real-time to make filtering decisions to store data. This p… ▽ More Real-time data processing is one of the central processes of particle physics experiments which require large computing resources. The LHCb (Large Hadron Collider beauty) experiment will be upgraded to cope with a particle bunch collision rate of 30 million times per second, producing $10^9$ particles/s. 40 Tbits/s need to be processed in real-time to make filtering decisions to store data. This poses a computing challenge that requires exploration of modern hardware and software solutions. We present Compass, a particle tracking algorithm and a parallel raw input decoding optimised for GPUs. It is designed for highly parallel architectures, data-oriented and optimised for fast and localised data access. Our algorithm is configurable, and we explore the trade-off in computing and physics performance of various configurations. A CPU implementation that delivers the same physics performance as our GPU implementation is presented. We discuss the achieved physics performance and validate it with Monte Carlo simulated data. We show a computing performance analysis comparing consumer and server grade GPUs, and a CPU. We show the feasibility of using a full GPU decoding and particle tracking algorithm for high-throughput particle trajectories reconstruction, where our algorithm improves the throughput up to 7.4$\times$ compared to the LHCb baseline. △ Less

Submitted 26 February, 2020; originally announced February 2020.

Comments: 15 pages, 13 figures

Journal ref: IEEE Access 7, 91612 (2019)

MathOptInterface: a data structure for mathematical optimization problems

Authors: Benoit Legat, Oscar Dowson, Joaquim Dias Garcia, Miles Lubin

Abstract: We introduce MathOptInterface, an abstract data structure for representing mathematical optimization problems based on combining pre-defined functions and sets. MathOptInterface is significantly more general than existing data structures in the literature, encompassing, for example, a spectrum of problems classes from integer programming with indicator constraints to bilinear semidefinite programm… ▽ More We introduce MathOptInterface, an abstract data structure for representing mathematical optimization problems based on combining pre-defined functions and sets. MathOptInterface is significantly more general than existing data structures in the literature, encompassing, for example, a spectrum of problems classes from integer programming with indicator constraints to bilinear semidefinite programming. We also outline an automated rewriting system between equivalent formulations of a constraint. MathOptInterface has been implemented in practice, forming the foundation of a recent rewrite of JuMP, an open-source algebraic modeling language in the Julia language. The regularity of the MathOptInterface representation leads naturally to a general file format for mathematical optimization we call MathOptFormat. In addition, the automated rewriting system provides modeling power to users while making it easy to connect new solvers to JuMP. △ Less

Submitted 16 September, 2020; v1 submitted 9 February, 2020; originally announced February 2020.

Community Detection for Power Systems Network Aggregation Considering Renewable Variability

Authors: Raphael Araujo Sampaio, Gerson Couto Oliveira, Luiz Carlos da Costa Jr., Joaquim Dias Garcia

Abstract: The increasing penetration of variable renewable energy (VRE) has brought significant challenges for power systems planning and operation. These highly variable sources are typically distributed in the grid; therefore, a detailed representation of transmission bottlenecks is fundamental to approximate the impact of the transmission network on the dispatch with VRE resources. The fine grain tempora… ▽ More The increasing penetration of variable renewable energy (VRE) has brought significant challenges for power systems planning and operation. These highly variable sources are typically distributed in the grid; therefore, a detailed representation of transmission bottlenecks is fundamental to approximate the impact of the transmission network on the dispatch with VRE resources. The fine grain temporal scale of short term and day-ahead dispatch, taking into account the network constraints, also mandatory for mid-term planning studies, combined with the high variability of the VRE has brought the need to represent these uncertainties in stochastic optimization models while taking into account the transmission system. These requirements impose a computational burden to solve the planning and operation models. We propose a methodology based on community detection to aggregate the network representation, capable of preserving the locational marginal price (LMP) differences in multiple VRE scenarios, and describe a real-world operational planning study. The optimal expected cost solution considering aggregated networks is compared with the full network representation. Both representations were embedded in an operation model relying on Stochastic Dual Dynamic Programming (SDDP) to deal with the random variables in a multi-stage problem. △ Less

Submitted 8 November, 2019; originally announced November 2019.

Reliability-Constrained Power System Expansion Planning: A Stochastic Risk-Averse Optimization Approach

Authors: Luiz Carlos da Costa Jr., Fernanda Souza Thomé, Joaquim Dias Garcia, Mario V. F. Pereira

Abstract: This work presents a methodology to incorporate reliability constraints in the optimal power systems expansion planning problem. Besides LOLP and EPNS, traditionally used in power systems, this work proposes the use of the risk measures VaR (Value-at-Risk) and CVaR (Conditional Value-at-Risk), widely used in financial markets. The explicit consideration of reliability constraints in the planning p… ▽ More This work presents a methodology to incorporate reliability constraints in the optimal power systems expansion planning problem. Besides LOLP and EPNS, traditionally used in power systems, this work proposes the use of the risk measures VaR (Value-at-Risk) and CVaR (Conditional Value-at-Risk), widely used in financial markets. The explicit consideration of reliability constraints in the planning problem can be an extremely hard task and, in order to minimize computational effort, this work applies the Benders decomposition technique splitting the expansion planning problem into an investment problem and two sub-problems to evaluate the system's operation cost and the reliability index. The operation sub-problem is solved by Stochastic Dual Dynamic Programming (SDDP) and the reliability sub-problem by Monte Carlo simulation. The proposed methodology is applied to the real problem of optimal expansion planning of the Bolivian power system. △ Less

Submitted 28 October, 2019; originally announced October 2019.

Message Passing for Complex Question Answering over Knowledge Graphs

Authors: Svitlana Vakulenko, Javier David Fernandez Garcia, Axel Polleres, Maarten de Rijke, Michael Cochez

Abstract: Question answering over knowledge graphs (KGQA) has evolved from simple single-fact questions to complex questions that require graph traversal and aggregation. We propose a novel approach for complex KGQA that uses unsupervised message passing, which propagates confidence scores obtained by parsing an input question and matching terms in the knowledge graph to a set of possible answers. First, we… ▽ More Question answering over knowledge graphs (KGQA) has evolved from simple single-fact questions to complex questions that require graph traversal and aggregation. We propose a novel approach for complex KGQA that uses unsupervised message passing, which propagates confidence scores obtained by parsing an input question and matching terms in the knowledge graph to a set of possible answers. First, we identify entity, relationship, and class names mentioned in a natural language question, and map these to their counterparts in the graph. Then, the confidence scores of these map**s propagate through the graph structure to locate the answer entities. Finally, these are aggregated depending on the identified question type. This approach can be efficiently implemented as a series of sparse matrix multiplications mimicking joins over small local subgraphs. Our evaluation results show that the proposed approach outperforms the state-of-the-art on the LC-QuAD benchmark. Moreover, we show that the performance of the approach depends only on the quality of the question interpretation results, i.e., given a correct relevance score distribution, our approach always produces a correct answer ranking. Our error analysis reveals correct answers missing from the benchmark dataset and inconsistencies in the DBpedia knowledge graph. Finally, we provide a comprehensive evaluation of the proposed approach accompanied with an ablation study and an error analysis, which showcase the pitfalls for each of the question answering components in more detail. △ Less

Submitted 19 August, 2019; originally announced August 2019.

Comments: Accepted in CIKM 2019

Modelling power markets with multi-stage stochastic Nash equilibria

Authors: Joaquim Dias Garcia, Raphael Chabar

Abstract: The modelling of modern power markets requires the representation of the following main features: (i) a stochastic dynamic decision process, with uncertainties related to renewable production and fuel costs, among others; and (ii) a game-theoretic framework that represents the strategic behavior of multiple agents, for example in daily price bids. These features can be in theory represented as a s… ▽ More The modelling of modern power markets requires the representation of the following main features: (i) a stochastic dynamic decision process, with uncertainties related to renewable production and fuel costs, among others; and (ii) a game-theoretic framework that represents the strategic behavior of multiple agents, for example in daily price bids. These features can be in theory represented as a stochastic dynamic programming recursion, where we have a Nash equilibrium for multiple agents. However, the resulting problem is very challenging to solve. This work presents an iterative process to solve the above problem for realistic power systems. The proposed algorithm is consist of a fixed point algorithm, in which, each step is solved via stochastic dual dynamic programming method. The application of the proposed algorithm are illustrated in case studies with the Panama systems. △ Less

Submitted 29 March, 2019; originally announced March 2019.

Fibrations, unique path lifting, and continuous monodromy

Authors: Hanspeter Fischer, Jacob D. Garcia

Abstract: Given a path-connected space $X$ and $H\leqπ_1(X,x_0)$, there is essentially only one construction of a map $p_H:(\widetilde{X}_H,\widetilde{x}_0)\rightarrow(X,x_0)$ with connected and locally path-connected domain that can possibly have the following two properties: $(p_{H})_{\#}π_1(\widetilde{X}_H,\widetilde{x}_0)=H$ and $p_H$ has the unique lifting property. $\widetilde{X}_H$ consists of equiva… ▽ More Given a path-connected space $X$ and $H\leqπ_1(X,x_0)$, there is essentially only one construction of a map $p_H:(\widetilde{X}_H,\widetilde{x}_0)\rightarrow(X,x_0)$ with connected and locally path-connected domain that can possibly have the following two properties: $(p_{H})_{\#}π_1(\widetilde{X}_H,\widetilde{x}_0)=H$ and $p_H$ has the unique lifting property. $\widetilde{X}_H$ consists of equivalence classes of paths starting at $x_0$, appropriately topologized, and $p_H$ is the endpoint projection. For $p_H$ to have these two properties, $T_1$ fibers are necessary and unique path lifting is sufficient. However, $p_H$ always admits the standard lifts of paths. We show that $p_H$ has unique path lifting if it has continuous (standard) monodromies toward a $T_1$ fiber over $x_0$. Assuming, in addition, that $H$ is locally quasinormal (e.g., if $H$ is normal) we show that $X$ is homotopically path Hausdorff relative to $H$. We show that $p_H$ is a fibration if $X$ is locally path connected, $H$ is locally quasinormal, and all (standard) monodromies are continuous. △ Less

Submitted 19 December, 2019; v1 submitted 31 January, 2019; originally announced February 2019.

Comments: 9 pages; revised abstract and introduction for version 2

MSC Class: 57M10; 55Q05; 55R65

Journal ref: Topology and its Applications 270 (2020) 107047

Exploiting Low-Rank Structure in Semidefinite Programming by Approximate Operator Splitting

Authors: Mario Souto, Joaquim D. Garcia, Alvaro Veiga

Abstract: In contrast with many other convex optimization classes, state-of-the-art semidefinite programming solvers are yet unable to efficiently solve large scale instances. This work aims to reduce this scalability gap by proposing a novel proximal algorithm for solving general semidefinite programming problems. The proposed methodology, based on the primal-dual hybrid gradient method, allows the presenc… ▽ More In contrast with many other convex optimization classes, state-of-the-art semidefinite programming solvers are yet unable to efficiently solve large scale instances. This work aims to reduce this scalability gap by proposing a novel proximal algorithm for solving general semidefinite programming problems. The proposed methodology, based on the primal-dual hybrid gradient method, allows the presence of linear inequalities without the need of adding extra slack variables and avoids solving a linear system at each iteration. More importantly, it does simultaneously compute the dual variables associated with the linear constraints. The main contribution of this work is to achieve a substantial speedup by effectively adjusting the proposed algorithm in order to exploit the low-rank property inherent to several semidefinite programming problems. This proposed modification is the key element that allows the operator splitting method to efficiently scale to larger instances. Convergence guarantees are presented along with an intuitive interpretation of the algorithm. Additionally, an open source semidefinite programming solver, called ProxSDP, is made available and implementation details are discussed. Case studies are presented in order to evaluate the performance of the proposed methodology. △ Less

Submitted 19 December, 2018; v1 submitted 11 October, 2018; originally announced October 2018.

A Quantum Extension of the Semiclassical Theory of Electrical Susceptibility

Authors: Jairo David García, Boris A. Rodríguez

Abstract: It is shown here how the semiclassical theory of electrical susceptibility can be extended to the case in which both radiation and matter are quantized. This is done specifically for the cases of linear and second order susceptibilities. The expressions derived allow to determine a set of conditions for the validity of the semiclassical approximation and predict interesting new phenomena such as p… ▽ More It is shown here how the semiclassical theory of electrical susceptibility can be extended to the case in which both radiation and matter are quantized. This is done specifically for the cases of linear and second order susceptibilities. The expressions derived allow to determine a set of conditions for the validity of the semiclassical approximation and predict interesting new phenomena such as photon number dependent susceptibility. △ Less

Submitted 31 May, 2018; originally announced May 2018.

Comments: 10 pages, 8 figures

A Low-Frequency Tone Sweep Method for in-Service Fault Location in Sub-Carrier Multiplexed Optical Fiber Networks

Authors: Gustavo C. Amaral, Diego C. Villafani, Andrea Baldivieso, Joaquim Dias Garcia, Renata G. Leibel, Luis E. Y. Herrera, Patryk J. Urban, Jean Pierre von der Weid

Abstract: We demonstrate an optical fiber fault location method based on the frequency response of the modulated fiber optical backscattered signal in a steady state low-frequency step regime. Careful calibration and measurement allows for the reconstruction of the fiber transfer function, which, associated to its mathematical model, is capable of extracting the fiber characteristics. The technique is capab… ▽ More We demonstrate an optical fiber fault location method based on the frequency response of the modulated fiber optical backscattered signal in a steady state low-frequency step regime. Careful calibration and measurement allows for the reconstruction of the fiber transfer function, which, associated to its mathematical model, is capable of extracting the fiber characteristics. The technique is capable of identifying non-reflective fault events in an optical fiber link and is perfectly compatible with previous methods that focus on the reflective events. The fact that the recuperation of the complex signal is performed in the frequency domain and not via a Fourier Transform enables the measurements to overcome the spatial resolution limitation of Fourier Transform incoherent-OFDR measurements even with frequency sweep ranges down to 100-100000 Hz. This result is backed up by a less than 10 meters difference in fault location when compared to standard OTDR measurements. △ Less

Submitted 6 September, 2016; originally announced September 2016.

Comments: 11 pages, 5 figures, submitted to Journal of Lightwave Technology on September 4th 2016

FRIDA: diffraction-limited imaging and integral-field spectroscopy for the GTC

Authors: Alan M. Watson, José A. Acosta-Pulido, Luis C. Álvarez-Núñez, Vicente Bringas-Rico, Nicolás Cardiel, Salvador Cuevas, Oscar Chapa, José Javier Díaz García, Stephen S. Eikenberry, Carlos Espejo, Rubén A. Flores-Meza, Jorge Fuentes-Fernández, Jesús Gallego, José Leonardo Garcés Medina, Francisco Garzón López, Peter Hammersley, Carolina Keiman, Gerardo Lara, José Alberto López, Pablo L. López, Diana Lucero, Heidy Moreno Arce, Sergio Pascual Ramirez, Jesús Patrón Recio, Almudena Prieto , et al. (5 additional authors not shown)

Abstract: FRIDA is a diffraction-limited imager and integral-field spectrometer that is being built for the adaptive-optics focus of the Gran Telescopio Canarias. In imaging mode FRIDA will provide scales of 0.010, 0.020 and 0.040 arcsec/pixel and in IFS mode spectral resolutions of 1500, 4000 and 30,000. FRIDA is starting systems integration and is scheduled to complete fully integrated system tests at the… ▽ More FRIDA is a diffraction-limited imager and integral-field spectrometer that is being built for the adaptive-optics focus of the Gran Telescopio Canarias. In imaging mode FRIDA will provide scales of 0.010, 0.020 and 0.040 arcsec/pixel and in IFS mode spectral resolutions of 1500, 4000 and 30,000. FRIDA is starting systems integration and is scheduled to complete fully integrated system tests at the laboratory by the end of 2017 and to be delivered to GTC shortly thereafter. In this contribution we present a summary of its design, fabrication, current status and potential scientific applications. △ Less

Submitted 31 May, 2016; originally announced May 2016.

Comments: To appear in the proceedings of SPIE conference 9908 "Ground-based and Airborne Instrumentation for Astronomy VI". 8 pages

Fast Polarization Switch for Polarization-Based Quantum Communication

Authors: Vinicius M. Lima, Felipe Calliari, Joaquim D. Garcia, João Pedro D. Garcia, Gustavo C. Amaral, Guilherme P. Temporão, Jean Pierre von der Weid

Abstract: We present a complete optoelectronic unit for polarization visualization, switching and control. The system is based on an FPGA unit and comprises: an acquisition unit containing an analog polarimeter and digital-to-analog converters, an FPGA capable of implementing an optimal algorithm for three-stage arbitrary polarization tracking, and an electronic driver with analog-to-digital converters capa… ▽ More We present a complete optoelectronic unit for polarization visualization, switching and control. The system is based on an FPGA unit and comprises: an acquisition unit containing an analog polarimeter and digital-to-analog converters, an FPGA capable of implementing an optimal algorithm for three-stage arbitrary polarization tracking, and an electronic driver with analog-to-digital converters capable of interfacing with Lithium-Niobate-based Polarization Controllers. The results, determined via simulation of real-parameter devices, show that fast polarization switch is achievable. △ Less

Submitted 30 April, 2016; originally announced May 2016.

Comments: 8 pages, 7 figures

An Optimal Polarization Tracking Algorithm for Lithium-Niobate-based Polarization Controllers

Authors: Joaquim D. Garcia, Gustavo C. Amaral

Abstract: We present an optimal algorithm for the three-stage arbitrary polarization tracking using Lithium-Niobate-based Polarization Controllers: device calibration, polarization state rotation, and stabilization. The theoretical model representing the lithium-niobate-based polarization controller is derived and the methodology is successfully applied. Results are numerically simulated in the MATLAB envir… ▽ More We present an optimal algorithm for the three-stage arbitrary polarization tracking using Lithium-Niobate-based Polarization Controllers: device calibration, polarization state rotation, and stabilization. The theoretical model representing the lithium-niobate-based polarization controller is derived and the methodology is successfully applied. Results are numerically simulated in the MATLAB environment. △ Less

Submitted 11 March, 2016; originally announced March 2016.

Comments: 8 pages, 4 figures

$\ell_1$ Adaptive Trend Filter via Fast Coordinate Descent

Authors: Mario Souto, Joaquim D. Garcia, Gustavo C. Amaral

Abstract: Identifying the unknown underlying trend of a given noisy signal is extremely useful for a wide range of applications. The number of potential trends might be exponential, which can be computationally exhaustive even for short signals. Another challenge, is the presence of abrupt changes and outliers at unknown times which impart resourceful information regarding the signal's characteristics. In t… ▽ More Identifying the unknown underlying trend of a given noisy signal is extremely useful for a wide range of applications. The number of potential trends might be exponential, which can be computationally exhaustive even for short signals. Another challenge, is the presence of abrupt changes and outliers at unknown times which impart resourceful information regarding the signal's characteristics. In this paper, we present the $\ell_1$ Adaptive Trend Filter, which can consistently identify the components in the underlying trend and multiple level-shifts, even in the presence of outliers. Additionally, an enhanced coordinate descent algorithm which exploit the filter design is presented. Some implementation details are discussed and a version in the Julia language is presented along with two distinct applications to illustrate the filter's potential. △ Less

Submitted 16 May, 2016; v1 submitted 11 March, 2016; originally announced March 2016.

Comments: 9 pages, 2 figures

Adaptive Filter for Automatic Identification of Multiple Faults in a Noisy OTDR Profile

Authors: Jean Pierre von der Weid, Mario H. Souto, Joaquim D. Garcia, Gustavo C. Amaral

Abstract: We present a novel methodology able to distinguish meaningful level shifts from typical signal fluctuations. A two-stage regularization filtering can accurately identify the location of the significant level-shifts with an efficient parameter-free algorithm. The developed methodology demands low computational effort and can easily be embedded in a dedicated processing unit. Our case studies compar… ▽ More We present a novel methodology able to distinguish meaningful level shifts from typical signal fluctuations. A two-stage regularization filtering can accurately identify the location of the significant level-shifts with an efficient parameter-free algorithm. The developed methodology demands low computational effort and can easily be embedded in a dedicated processing unit. Our case studies compare the new methodology with current available ones and show that it is the most adequate technique for fast detection of multiple unknown level-shifts in a noisy OTDR profile. △ Less

Submitted 13 February, 2016; originally announced February 2016.

Comments: 15 pages, 4 figures

THERMAP: a mid-infrared spectro-imager for space missions to small bodies in the inner solar system

Authors: O. Groussin, J. Licandro, J. Helbert, J. -L. Reynaud, P. Levacher, M. Reyes García-Talavera, V. Alí-Lagoa, P. -E. Blanc, E. Brageot, B. Davidsson, M. Delbó, M. Deleuze, A. Delsanti, J. J. Diaz Garcia, K. Dohlen, D. Ferrand, S. Green, L. Jorda, E. Joven Álvarez, J. Knollenberg, E. Kührt, P. Lamy, E. Lellouch, J. Le Merrer, B. Marty , et al. (6 additional authors not shown)

Abstract: We present THERMAP, a mid-infrared (8-16 μm) spectro-imager for space missions to small bodies in the inner solar system, developed in the framework of the MarcoPolo-R asteroid sample return mission. THERMAP is very well suited to characterize the surface thermal environment of a NEO and to map its surface composition. The instrument has two channels, one for imaging and one for spectroscopy: it i… ▽ More We present THERMAP, a mid-infrared (8-16 μm) spectro-imager for space missions to small bodies in the inner solar system, developed in the framework of the MarcoPolo-R asteroid sample return mission. THERMAP is very well suited to characterize the surface thermal environment of a NEO and to map its surface composition. The instrument has two channels, one for imaging and one for spectroscopy: it is both a thermal camera with full 2D imaging capabilities and a slit spectrometer. THERMAP takes advantage of the recent technological developments of uncooled microbolometers detectors, sensitive in the mid-infrared spectral range. THERMAP can acquire thermal images (8-18 μm) of the surface and perform absolute temperature measurements with a precision better than 3.5 K above 200 K. THERMAP can acquire mid-infrared spectra (8-16 μm) of the surface with a spectral resolution Δλ of 0.3 μm. For surface temperatures above 350 K, spectra have a signal-to-noise ratio >60 in the spectral range 9-13 μm where most emission features occur. △ Less

Submitted 9 September, 2015; originally announced September 2015.

Comments: 21 pages, 12 figures, 3 tables; Experimental Astronomy: in press