Showing 1–17 of 17 results for author: Großmann, E

Optimal Neighborhood Exploration for Dynamic Independent Sets

Authors: Jannick Borowitz, Ernestine Großmann, Christian Schulz

Abstract: A dynamic graph algorithm is a data structure that supports edge insertions, deletions, and specific problem queries. While extensive research exists on dynamic algorithms for graph problems solvable in polynomial time, most of these algorithms have not been implemented or empirically evaluated. This work addresses the NP-complete maximum weight and cardinality independent set problems in a dyna… ▽ More A dynamic graph algorithm is a data structure that supports edge insertions, deletions, and specific problem queries. While extensive research exists on dynamic algorithms for graph problems solvable in polynomial time, most of these algorithms have not been implemented or empirically evaluated. This work addresses the NP-complete maximum weight and cardinality independent set problems in a dynamic setting, applicable to areas like dynamic map-labeling and vehicle routing. Real-world instances can be vast, with millions of vertices and edges, making it challenging to find near-optimal solutions quickly. Exact solvers can find optimal solutions but have exponential worst-case runtimes. Conversely, heuristic algorithms use local search techniques to improve solutions by optimizing vertices. In this work, we introduce a novel local search technique called optimal neighborhood exploration. This technique creates independent subproblems that are solved to optimality, leading to improved overall solutions. Through numerous experiments, we assess the effectiveness of our approach and compare it with other state-of-the-art dynamic solvers. Our algorithm features a parameter, the subproblem size, that balances running time and solution quality. With this parameter, our configuration matches state-of-the-art performance for the cardinality independent set problem. By increasing the parameter, we significantly enhance solution quality. △ Less

Submitted 9 July, 2024; originally announced July 2024.

Comments: arXiv admin note: text overlap with arXiv:2208.13645

Logic-Based Discrete-Steepest Descent: A Solution Method for Process Synthesis Generalized Disjunctive Programs

Authors: Daniel Ovalle, David A. Liñán, Albert Lee, Jorge M. Gómez, Luis Ricardez-Sandoval, Ignacio E. Grossmann, David E. Bernal Neira

Abstract: The optimization of chemical processes is challenging due to the nonlinearities arising from process physics and discrete design decisions. In particular, optimal synthesis and design of chemical processes can be posed as a Generalized Disjunctive Programming (GDP) superstructure problem. Various solution methods are available to address these problems, such as reformulating them as Mixed-Integer… ▽ More The optimization of chemical processes is challenging due to the nonlinearities arising from process physics and discrete design decisions. In particular, optimal synthesis and design of chemical processes can be posed as a Generalized Disjunctive Programming (GDP) superstructure problem. Various solution methods are available to address these problems, such as reformulating them as Mixed-Integer Nonlinear Programming (MINLP) problems; nevertheless, algorithms explicitly designed to solve the GDP problem and potentially leverage its structure remain scarce. This paper presents the Logic-based Discrete-Steepest Descent Algorithm (LD-SDA) as a solution method for GDP problems involving ordered Boolean variables. The LD-SDA reformulates these ordered Boolean variables into integer decisions called external variables. The LD-SDA solves the reformulated GDP problem using a two-level decomposition approach where the upper-level subproblem determines external variable configurations. Subsequently, the remaining continuous and discrete variables are solved as a subproblem only involving those constraints relevant to the given external variable arrangement, effectively taking advantage of the structure of the GDP problem. The advantages of LD-SDA are illustrated through a batch processing case study, a reactor superstructure, a distillation column, and a catalytic distillation column, and its open-source implementation is available online. The results show convergence efficiency and solution quality improvements compared to conventional GDP and MINLP solvers. △ Less

Submitted 8 May, 2024; originally announced May 2024.

Comments: 34 pages, 14 figures

Engineering Weighted Connectivity Augmentation Algorithms

Authors: Marcelo Fonseca Faraj, Ernestine Großmann, Felix Joos, Thomas Möller, Christian Schulz

Abstract: Increasing the connectivity of a graph is a pivotal challenge in robust network design. The weighted connectivity augmentation problem is a common version of the problem that takes link costs into consideration. The problem is then to find a minimum cost subset of a given set of weighted links that increases the connectivity of a graph by one when the links are added to the edge set of the input i… ▽ More Increasing the connectivity of a graph is a pivotal challenge in robust network design. The weighted connectivity augmentation problem is a common version of the problem that takes link costs into consideration. The problem is then to find a minimum cost subset of a given set of weighted links that increases the connectivity of a graph by one when the links are added to the edge set of the input instance. In this work, we give a first implementation of recently discovered better-than-2 approximations. Furthermore, we propose three new heuristic and one exact approach. These include a greedy algorithm considering link costs and the number of unique cuts covered, an approach based on minimum spanning trees and a local search algorithm that may improve a given solution by swap** links of paths. Our exact approach uses an ILP formulation with efficient cut enumeration as well as a fast initialization routine. We then perform an extensive experimental evaluation which shows that our algorithms are faster and yield the best solutions compared to the current state-of-the-art as well as the recently discovered better-than-2 approximation algorithms. Our novel local search algorithm can improve solution quality even further. △ Less

Submitted 12 February, 2024; originally announced February 2024.

FLASH-TB: Integrating Arc-Flags and Trip-Based Public Transit Routing

Authors: Ernestine Großmann, Jonas Sauer, Christian Schulz, Patrick Steil, Sascha Witt

Abstract: We present FLASH-TB, a journey planning algorithm for public transit networks that combines Trip-Based Public Transit Routing (TB) with the Arc-Flags speedup technique. The basic idea is simple: The network is partitioned into a configurable number of cells. For each cell and each possible transfer between two vehicles, the algorithm precomputes a flag that indicates whether the transfer is requir… ▽ More We present FLASH-TB, a journey planning algorithm for public transit networks that combines Trip-Based Public Transit Routing (TB) with the Arc-Flags speedup technique. The basic idea is simple: The network is partitioned into a configurable number of cells. For each cell and each possible transfer between two vehicles, the algorithm precomputes a flag that indicates whether the transfer is required to reach the cell. During a query, only flagged transfers are explored. Our algorithm improves upon previous attempts to apply Arc-Flags to public transit networks, which saw limited success due to conflicting rules for pruning the search space. We show that these rules can be reconciled while still producing correct results. Because the number of cells is configurable, FLASH-TB offers a tradeoff between query time and memory consumption. It is significantly more space-efficient than existing techniques with a comparable preprocessing time, which store generalized shortest-path trees: to match their query performance, it requires up to two orders of magnitude less memory. The fastest configuration of FLASH-TB achieves a speedup of more than two orders of magnitude over TB, offering sub-millisecond query times even on large countrywide networks. △ Less

Submitted 20 December, 2023; originally announced December 2023.

Comments: arXiv admin note: text overlap with arXiv:2302.07168

Scalable Algorithms for 2-Packing Sets on Arbitrary Graphs

Authors: Jannick Borowitz, Ernestine Großmann, Christian Schulz, Dominik Schweisgut

Abstract: A 2-packing set for an undirected graph $G=(V,E)$ is a subset $\mathcal{S} \subset V$ such that any two vertices $v_1,v_2 \in \mathcal{S}$ have no common neighbors. Finding a 2-packing set of maximum cardinality is a NP-hard problem. We develop a new approach to solve this problem on arbitrary graphs using its close relation to the independent set problem. Thereby, our algorithm red2pack uses new… ▽ More A 2-packing set for an undirected graph $G=(V,E)$ is a subset $\mathcal{S} \subset V$ such that any two vertices $v_1,v_2 \in \mathcal{S}$ have no common neighbors. Finding a 2-packing set of maximum cardinality is a NP-hard problem. We develop a new approach to solve this problem on arbitrary graphs using its close relation to the independent set problem. Thereby, our algorithm red2pack uses new data reduction rules specific to the 2-packing set problem as well as a graph transformation. Our experiments show that we outperform the state-of-the-art for arbitrary graphs with respect to solution quality and also are able to compute solutions multiple orders of magnitude faster than previously possible. For example, we are able to solve 63% of the graphs in the tested data set to optimality in less than a second while the competitor for arbitrary graphs can only solve 5% of these graphs to optimality even with a 10 hour time limit. Moreover, our approach can solve a wide range of large instances that have previously been unsolved. △ Less

Submitted 12 February, 2024; v1 submitted 29 August, 2023; originally announced August 2023.

Extensions to the Guaranteed Service Model for Industrial Applications of Multi-Echelon Inventory Optimization

Authors: Victoria G. Achkar, Braulio B. Brunaud, Hector D. Perez, Rami Musa, Carlos A. Mendez, Ignacio E. Grossmann

Abstract: Multi-echelon inventory optimization (MEIO) plays a key role in a supply chain seeking to achieve specified customer service levels with a minimum capital in inventory. In this work, we propose a generalized MEIO model based on the Guaranteed Service approach to allocate safety stock levels across the network at the lowest holding cost. This model integrates several existing and some novel feature… ▽ More Multi-echelon inventory optimization (MEIO) plays a key role in a supply chain seeking to achieve specified customer service levels with a minimum capital in inventory. In this work, we propose a generalized MEIO model based on the Guaranteed Service approach to allocate safety stock levels across the network at the lowest holding cost. This model integrates several existing and some novel features that are usually present in pharmaceutical multi-echelon supply chains into a single model: review periods, manufacturing facilities, hybrid nodes (nodes with both internal and external demand), minimum order quantities (MOQ), and different service level performance indicators (fill rate and cycle service levels). We include a polynomial regression to approximate fill rates as a possible target measure to set safety stocks. To improve efficiency, we propose a nonlinear programming model to support decision making, which can be reformulated as a Quadratically Constrained Program (QCP), which leads to order of magnitude reductions in computational time. The performance of the model is evaluated by solving illustrative and real-world cases, and is validated with simulation. △ Less

Submitted 19 June, 2023; originally announced June 2023.

DisjunctiveProgramming.jl: Generalized Disjunctive Programming Models and Algorithms for JuMP

Authors: Hector D. Perez, Shivank Joshi, Ignacio E. Grossmann

Abstract: We present a Julia package, DisjunctiveProgramming.jl, that extends the functionality in JuMP.jl to allow modeling problems via logical propositions and disjunctive constraints. Such models can then be reformulated into Mixed-Integer Programs (MIPs) that can be solved with the various MIP solvers supported by JuMP. To do so, logical propositions are converted to Conjunctive Normal Form (CNF) and r… ▽ More We present a Julia package, DisjunctiveProgramming.jl, that extends the functionality in JuMP.jl to allow modeling problems via logical propositions and disjunctive constraints. Such models can then be reformulated into Mixed-Integer Programs (MIPs) that can be solved with the various MIP solvers supported by JuMP. To do so, logical propositions are converted to Conjunctive Normal Form (CNF) and reformulated into equivalent algebraic constraints. Disjunctions are reformulated into mixed-integer constraints via the reformulation technique specified by the user (Big-M or Hull reformulations). The package supports reformulations for disjunctions containing linear, quadratic, and nonlinear constraints. △ Less

Submitted 8 March, 2023; originally announced April 2023.

Comments: 6 pages

Integrated investment, retrofit and abandonment planning of energy systems with short-term and long-term uncertainty using enhanced Benders decomposition

Authors: Hongyu Zhang, Ignacio E. Grossmann, Brage Rugstad Knudsen, Ken McKinnon, Rodrigo Garcia Nava, Asgeir Tomasgard

Abstract: We propose the REORIENT (REnewable resOuRce Investment for the ENergy Transition) model for energy systems planning with the following novelties: (1) integrating capacity expansion, retrofit and abandonment planning, and (2) using multi-horizon stochastic mixed-integer linear programming with short-term and long-term uncertainty. We apply the model to the European energy system considering: (a) in… ▽ More We propose the REORIENT (REnewable resOuRce Investment for the ENergy Transition) model for energy systems planning with the following novelties: (1) integrating capacity expansion, retrofit and abandonment planning, and (2) using multi-horizon stochastic mixed-integer linear programming with short-term and long-term uncertainty. We apply the model to the European energy system considering: (a) investment in new hydrogen infrastructures, (b) capacity expansion of the European power system, (c) retrofitting oil and gas infrastructures in the North Sea region for hydrogen production and distribution, and abandoning existing infrastructures, and (d) long-term uncertainty in oil and gas prices and short-term uncertainty in time series parameters. We utilise the special structure of multi-horizon stochastic programming and propose an enhanced Benders decomposition to solve the model efficiently. We first conduct a sensitivity analysis on retrofitting costs of oil and gas infrastructures. We then compare the REORIENT model with a conventional investment planning model regarding costs and investment decisions. Finally, the computational performance of the algorithm is presented. The results show that: (1) when the retrofitting cost is below 20% of the cost of building new ones, retrofitting is economical for most of the existing pipelines, (2) platform clusters keep producing oil due to the massive profit, and the clusters are abandoned in the last investment stage, (3) compared with a traditional investment planning model, the REORIENT model yields 24% lower investment cost in the North Sea region, and (4) the enhanced Benders algorithm is up to 6.8 times faster than the reference algorithm. △ Less

Submitted 17 March, 2023; originally announced March 2023.

Extensions to Generalized Disjunctive Programming: Hierarchical Structures and First-order Logic

Authors: Hector D. Perez, Ignacio E. Grossmann

Abstract: Optimization problems with discrete-continuous decisions are traditionally modeled in algebraic form via (non)linear mixed-integer programming. A more systematic approach to modeling such systems is to use Generalized Disjunctive Programming (GDP), which extends the Disjunctive Programming paradigm proposed by Egon Balas to allow modeling systems from a logic-based level of abstraction that captur… ▽ More Optimization problems with discrete-continuous decisions are traditionally modeled in algebraic form via (non)linear mixed-integer programming. A more systematic approach to modeling such systems is to use Generalized Disjunctive Programming (GDP), which extends the Disjunctive Programming paradigm proposed by Egon Balas to allow modeling systems from a logic-based level of abstraction that captures the fundamental rules governing such systems via algebraic constraints and logic. Although GDP provides a more general way of modeling systems, it warrants further generalization to encompass systems presenting a hierarchical structure. This work extends the GDP literature to address three major alternatives for modeling and solving systems with nested (hierarchical) disjunctions: explicit nested disjunctions, equivalent single-level disjunctions, and flattening via basic steps. We also provide theoretical proofs on the relaxation tightness of such alternatives, showing that explicitly modeling nested disjunctions is superior to the traditional approach discussed in literature for dealing with nested disjunctions. △ Less

Submitted 7 March, 2023; originally announced March 2023.

Comments: 35 pages

Arc-Flags Meet Trip-Based Public Transit Routing

Authors: Ernestine Großmann, Jonas Sauer, Christian Schulz, Patrick Steil

Abstract: We present Arc-Flag TB, a journey planning algorithm for public transit networks which combines Trip-Based Public Transit Routing (TB) with the Arc-Flags speedup technique. Compared to previous attempts to apply Arc-Flags to public transit networks, which saw limited success, our approach uses stronger pruning rules to reduce the search space. Our experiments show that Arc-Flag TB achieves a speed… ▽ More We present Arc-Flag TB, a journey planning algorithm for public transit networks which combines Trip-Based Public Transit Routing (TB) with the Arc-Flags speedup technique. Compared to previous attempts to apply Arc-Flags to public transit networks, which saw limited success, our approach uses stronger pruning rules to reduce the search space. Our experiments show that Arc-Flag TB achieves a speedup of up to two orders of magnitude over TB, offering query times of less than a millisecond even on large countrywide networks. Compared to the state-of-the-art speedup technique Trip-Based Public Transit Routing Using Condensed Search Trees (TB-CST), our algorithm achieves similar query times but requires significantly less additional memory. Other state-of-the-art algorithms which achieve even faster query times, e.g., Public Transit Labeling, require enormous memory usage. In contrast, Arc-Flag TB offers a tradeoff between query performance and memory usage due to the fact that the number of regions in the network partition required by our algorithm is a configurable parameter. We also identify an issue in the transfer precomputation of TB that affects both TB-CST and Arc-Flag TB, leading to incorrect answers for some queries. This has not been previously recognized by the author of TB-CST. We provide discussion on how to resolve this issue in the future. Currently, Arc-Flag TB answers 1-6% of queries incorrectly, compared to over 20% for TB-CST on some networks. △ Less

Submitted 14 February, 2023; originally announced February 2023.

Engineering Fully Dynamic $Δ$-Orientation Algorithms

Authors: Jannick Borowitz, Ernestine Großmann, Christian Schulz

Abstract: A (fully) dynamic graph algorithm is a data structure that supports edge insertions, edge deletions, and answers certain queries that are specific to the problem under consideration. There has been a lot of research on dynamic algorithms for graph problems that are solvable in polynomial time by a static algorithm. However, while there is a large body of theoretical work on efficient dynamic graph… ▽ More A (fully) dynamic graph algorithm is a data structure that supports edge insertions, edge deletions, and answers certain queries that are specific to the problem under consideration. There has been a lot of research on dynamic algorithms for graph problems that are solvable in polynomial time by a static algorithm. However, while there is a large body of theoretical work on efficient dynamic graph algorithms, a lot of these algorithms were never implemented and empirically evaluated. In this work, we consider the fully dynamic edge orientation problem, also called fully dynamic $Δ$-orientation problem, which is to maintain an orientation of the edges of an undirected graph such that the out-degree is low. If edges are inserted or deleted, one may have to flip the orientation of some edges in order to avoid vertices having a large out-degree. While there has been theoretical work on dynamic versions of this problem, currently there is no experimental evaluation available. In this work, we close this gap and engineer a range of new dynamic edge orientation algorithms as well as algorithms from the current literature. Moreover, we evaluate these algorithms on real-world dynamic graphs. The best algorithm considered in this paper in terms of quality, based on a simple breadth-first search, computes the optimum result on more than 90% of the instances and is on average only 2.4% worse than the optimum solution. △ Less

Submitted 18 January, 2023; v1 submitted 17 January, 2023; originally announced January 2023.

Finding Near-Optimal Weight Independent Sets at Scale

Authors: Ernestine Großmann, Sebastian Lamm, Christian Schulz, Darren Strash

Abstract: Computing maximum weight independent sets in graphs is an important NP-hard optimization problem. The problem is particularly difficult to solve in large graphs for which data reduction techniques do not work well. To be more precise, state-of-the-art branch-and-reduce algorithms can solve many large-scale graphs if reductions are applicable. Otherwise, their performance quickly degrades due to br… ▽ More Computing maximum weight independent sets in graphs is an important NP-hard optimization problem. The problem is particularly difficult to solve in large graphs for which data reduction techniques do not work well. To be more precise, state-of-the-art branch-and-reduce algorithms can solve many large-scale graphs if reductions are applicable. Otherwise, their performance quickly degrades due to branching requiring exponential time. In this paper, we develop an advanced memetic algorithm to tackle the problem, which incorporates recent data reduction techniques to compute near-optimal weighted independent sets in huge sparse networks. More precisely, we use a memetic approach to recursively choose vertices that are likely to be in a large-weight independent set. We include these vertices into the solution, and further reduce the graph. We show that identifying and removing vertices likely to be in large-weight independent sets opens up the reduction space and speeds up the computation of large-weight independent sets remarkably. Our experimental evaluation indicates that we are able to outperform state-of-the-art algorithms. For example, our two algorithm configurations compute the best results among all competing algorithms for 205 out of 207 instances. Thus can be seen as a useful tool when large-weight independent sets need to be computed in~practice. △ Less

Submitted 21 April, 2023; v1 submitted 29 August, 2022; originally announced August 2022.

Modelling and analysis of offshore energy hubs

Authors: Hongyu Zhang, Asgeir Tomasgard, Brage Rugstad Knudsen, Harald G. Svendsen, Steffen J. Bakker, Ignacio E. Grossmann

Abstract: Clean, multi-carrier Offshore Energy Hubs (OEHs) may become pivotal for efficient offshore wind power generation and distribution. In addition, OEHs may provide decarbonised energy supply for maritime transport, oil and gas recovery, and offshore farming while also enabling conversion and temporary storage of liquefied decarbonised energy carriers for export. Here, we investigate the role of OEHs… ▽ More Clean, multi-carrier Offshore Energy Hubs (OEHs) may become pivotal for efficient offshore wind power generation and distribution. In addition, OEHs may provide decarbonised energy supply for maritime transport, oil and gas recovery, and offshore farming while also enabling conversion and temporary storage of liquefied decarbonised energy carriers for export. Here, we investigate the role of OEHs in the transition of the Norwegian continental shelf energy system towards zero-emission energy supply. We develop a mixed-integer linear programming model for investment planning and operational optimisation to achieve decarbonisation at minimum costs. We consider clean technologies, including offshore wind, offshore solar, OEHs and subsea cables. We conduct sensitivity analysis on CO$_2$ tax, CO$_2$ budget and the capacity of power from shore. The results show that (a) a hard carbon cap is necessary for stimulating a zero-emission offshore energy system; (b) offshore wind integration and power from shore can more than halve current emissions, but OEHs with storage are necessary for zero-emission production and (c) at certain CO$_2$ tax levels, the system with OEHs can potentially reduce CO$_2$ emissions by 50% and energy losses by 10%, compared to a system with only offshore renewables, gas turbines and power from shore. △ Less

Submitted 12 October, 2021; originally announced October 2021.

Convex Mixed-Integer Nonlinear Programs Derived from Generalized Disjunctive Programming using Cones

Authors: David E. Bernal Neira, Ignacio E. Grossmann

Abstract: We propose the formulation of convex Generalized Disjunctive Programming (GDP) problems using conic inequalities leading to conic GDP problems. We then show the reformulation of conic GDPs into Mixed-Integer Conic Programming (MICP) problems through both the big-M and hull reformulations. These reformulations have the advantage that they are representable using the same cones as the original conic… ▽ More We propose the formulation of convex Generalized Disjunctive Programming (GDP) problems using conic inequalities leading to conic GDP problems. We then show the reformulation of conic GDPs into Mixed-Integer Conic Programming (MICP) problems through both the big-M and hull reformulations. These reformulations have the advantage that they are representable using the same cones as the original conic GDP. In the case of the hull reformulation, they require no approximation of the perspective function. Moreover, the MICP problems derived can be solved by specialized conic solvers and offer a natural extended formulation amenable to both conic and gradient-based solvers. We present the closed form of several convex functions and their respective perspectives in conic sets, allowing users to formulate their conic GDP problems easily. We finally implement a large set of conic GDP examples and solve them via the scalar nonlinear and conic mixed-integer reformulations. These examples include applications from Process Systems Engineering, Machine learning, and randomly generated instances. Our results show that the conic structure can be exploited to solve these challenging MICP problems more efficiently. Our main contribution is providing the reformulations, examples, and computational results that support the claim that taking advantage of conic formulations of convex GDP instead of their nonlinear algebraic descriptions can lead to a more efficient solution to these problems. △ Less

Submitted 18 February, 2024; v1 submitted 20 September, 2021; originally announced September 2021.

Comments: Main document: 28 pages, 3 figures, 1 table. Appendices: 9 pages, 3 tables

MSC Class: 90C11; 90C25; 90C26 ACM Class: G.1.6; F.2.2

Zero- and Low-Field Sensing with Nitrogen Vacancy Centers

Authors: Philipp J. Vetter, Alastair Marshall, Genko T. Genov, Tim F. Weiss, Nico Striegler, Eva F. Großmann, Santiago Oviedo Casado, Javier Cerrillo, Javier Prior, Philipp Neumann, Fedor Jelezko

Abstract: Over the years, an enormous effort has been made to establish nitrogen vacancy (NV) centers in diamond as easily accessible and precise magnetic field sensors. However, most of their sensing protocols rely on the application of bias magnetic fields, preventing their usage in zero- or low-field experiments. We overcome this limitation by exploiting the full spin $S=1$ nature of the NV center, allow… ▽ More Over the years, an enormous effort has been made to establish nitrogen vacancy (NV) centers in diamond as easily accessible and precise magnetic field sensors. However, most of their sensing protocols rely on the application of bias magnetic fields, preventing their usage in zero- or low-field experiments. We overcome this limitation by exploiting the full spin $S=1$ nature of the NV center, allowing us to detect nuclear spin signals at zero- and low-field with a linearly polarized microwave field. As conventional dynamical decoupling protocols fail in this regime, we develop new robust pulse sequences and optimized pulse pairs, which allow us to sense temperature and weak AC magnetic fields and achieve an efficient decoupling from environmental noise. Our work allows for much broader and simpler applications of NV centers as magnetic field sensors in the zero- and low-field regime and can be further extended to three-level systems in ions and atoms. △ Less

Submitted 2 February, 2022; v1 submitted 22 July, 2021; originally announced July 2021.

Journal ref: Physical Review Applied 17.4 (2022): 044028

OR-Gym: A Reinforcement Learning Library for Operations Research Problems

Authors: Christian D. Hubbs, Hector D. Perez, Owais Sarwar, Nikolaos V. Sahinidis, Ignacio E. Grossmann, John M. Wassick

Abstract: Reinforcement learning (RL) has been widely applied to game-playing and surpassed the best human-level performance in many domains, yet there are few use-cases in industrial or commercial settings. We introduce OR-Gym, an open-source library for develo** reinforcement learning algorithms to address operations research problems. In this paper, we apply reinforcement learning to the knapsack, mult… ▽ More Reinforcement learning (RL) has been widely applied to game-playing and surpassed the best human-level performance in many domains, yet there are few use-cases in industrial or commercial settings. We introduce OR-Gym, an open-source library for develo** reinforcement learning algorithms to address operations research problems. In this paper, we apply reinforcement learning to the knapsack, multi-dimensional bin packing, multi-echelon supply chain, and multi-period asset allocation model problems, as well as benchmark the RL solutions against MILP and heuristic models. These problems are used in logistics, finance, engineering, and are common in many business operation settings. We develop environments based on prototypical models in the literature and implement various optimization and heuristic models in order to benchmark the RL results. By re-framing a series of classic optimization problems as RL tasks, we seek to provide a new tool for the operations research community, while also opening those in the RL community to many of the problems and challenges in the OR field. △ Less

Submitted 17 October, 2020; v1 submitted 14 August, 2020; originally announced August 2020.

Comments: 29 pages, 10 figures

MSC Class: 90-10 ACM Class: I.2.8

A Theory of Probabilistic Boosting, Decision Trees and Matryoshki

Authors: Etienne Grossmann

Abstract: We present a theory of boosting probabilistic classifiers. We place ourselves in the situation of a user who only provides a stop** parameter and a probabilistic weak learner/classifier and compare three types of boosting algorithms: probabilistic Adaboost, decision tree, and tree of trees of ... of trees, which we call matryoshka. "Nested tree," "embedded tree" and "recursive tree" are also a… ▽ More We present a theory of boosting probabilistic classifiers. We place ourselves in the situation of a user who only provides a stop** parameter and a probabilistic weak learner/classifier and compare three types of boosting algorithms: probabilistic Adaboost, decision tree, and tree of trees of ... of trees, which we call matryoshka. "Nested tree," "embedded tree" and "recursive tree" are also appropriate names for this algorithm, which is one of our contributions. Our other contribution is the theoretical analysis of the algorithms, in which we give training error bounds. This analysis suggests that the matryoshka leverages probabilistic weak classifiers more efficiently than simple decision trees. △ Less

Submitted 25 July, 2006; originally announced July 2006.

ACM Class: I.5.1; I.2.6; G.3