-
A Penalty-Based Guardrail Algorithm for Non-Decreasing Optimization with Inequality Constraints
Authors:
Ksenija Stepanovic,
Wendelin Böhmer,
Mathijs de Weerdt
Abstract:
Traditional mathematical programming solvers require long computational times to solve constrained minimization problems of complex and large-scale physical systems. Therefore, these problems are often transformed into unconstrained ones, and solved with computationally efficient optimization approaches based on first-order information, such as the gradient descent method. However, for unconstrain…
▽ More
Traditional mathematical programming solvers require long computational times to solve constrained minimization problems of complex and large-scale physical systems. Therefore, these problems are often transformed into unconstrained ones, and solved with computationally efficient optimization approaches based on first-order information, such as the gradient descent method. However, for unconstrained problems, balancing the minimization of the objective function with the reduction of constraint violations is challenging. We consider the class of time-dependent minimization problems with increasing (possibly) nonlinear and non-convex objective function and non-decreasing (possibly) nonlinear and non-convex inequality constraints. To efficiently solve them, we propose a penalty-based guardrail algorithm (PGA). This algorithm adapts a standard penalty-based method by dynamically updating the right-hand side of the constraints with a guardrail variable which adds a margin to prevent violations. We evaluate PGA on two novel application domains: a simplified model of a district heating system and an optimization model derived from learned deep neural networks. Our method significantly outperforms mathematical programming solvers and the standard penalty-based method, and achieves better performance and faster convergence than a state-of-the-art algorithm (IPDD) within a specified time limit.
△ Less
Submitted 3 May, 2024;
originally announced May 2024.
-
To the Max: Reinventing Reward in Reinforcement Learning
Authors:
Grigorii Veviurko,
Wendelin Böhmer,
Mathijs de Weerdt
Abstract:
In reinforcement learning (RL), different rewards can define the same optimal policy but result in drastically different learning performance. For some, the agent gets stuck with a suboptimal behavior, and for others, it solves the task efficiently. Choosing a good reward function is hence an extremely important yet challenging problem. In this paper, we explore an alternative approach to using re…
▽ More
In reinforcement learning (RL), different rewards can define the same optimal policy but result in drastically different learning performance. For some, the agent gets stuck with a suboptimal behavior, and for others, it solves the task efficiently. Choosing a good reward function is hence an extremely important yet challenging problem. In this paper, we explore an alternative approach to using rewards for learning. We introduce max-reward RL, where an agent optimizes the maximum rather than the cumulative reward. Unlike earlier works, our approach works for deterministic and stochastic environments and can be easily combined with state-of-the-art RL algorithms. In the experiments, we study the performance of max-reward RL algorithms in two goal-reaching environments from Gymnasium-Robotics and demonstrate its benefits over standard RL. The code is publicly available.
△ Less
Submitted 2 February, 2024;
originally announced February 2024.
-
Learning From Scenarios for Stochastic Repairable Scheduling
Authors:
Kim van den Houten,
David M. J. Tax,
Esteban Freydell,
Mathijs de Weerdt
Abstract:
When optimizing problems with uncertain parameter values in a linear objective, decision-focused learning enables end-to-end learning of these values. We are interested in a stochastic scheduling problem, in which processing times are uncertain, which brings uncertain values in the constraints, and thus repair of an initial schedule may be needed. Historical realizations of the stochastic processi…
▽ More
When optimizing problems with uncertain parameter values in a linear objective, decision-focused learning enables end-to-end learning of these values. We are interested in a stochastic scheduling problem, in which processing times are uncertain, which brings uncertain values in the constraints, and thus repair of an initial schedule may be needed. Historical realizations of the stochastic processing times are available. We show how existing decision-focused learning techniques based on stochastic smoothing can be adapted to this scheduling problem. We include an extensive experimental evaluation to investigate in which situations decision-focused learning outperforms the state of the art for such situations: scenario-based stochastic optimization.
△ Less
Submitted 6 December, 2023;
originally announced December 2023.
-
When Effort May Fail: Equilibria of Shared Effort with a Threshold
Authors:
Gleb Polevoy,
Stojan Trajanovski,
Mathijs de Weerdt
Abstract:
Shared effort games model people investing resources in public projects, where the share of the generated values is predefined. In linear $θ$ sharing (effort) games, a project's value is linear in the total contribution, while the threshold $θ$ for effort defines which contributors win and receive their (equal) share. Thresholds between 0 and 1 model games such as paper co-authorship and shared as…
▽ More
Shared effort games model people investing resources in public projects, where the share of the generated values is predefined. In linear $θ$ sharing (effort) games, a project's value is linear in the total contribution, while the threshold $θ$ for effort defines which contributors win and receive their (equal) share. Thresholds between 0 and 1 model games such as paper co-authorship and shared assignments, where a minimum positive contribution is required for sharing in the value. We constructively characterise the conditions for the existence of a pure equilibrium for $θ\in\{0,1\}$, and for two-player games with a general threshold,% and find the prices of anarchy and stability. For more players, we also provide existence and efficiency results, and use generalised fictitious play simulations to show when a pure equilibrium exists and what its efficiency is. We also prove mixed equilibria always exist and bound their efficiency. This facilitates reaching socially efficient equilibria.
△ Less
Submitted 3 December, 2023;
originally announced December 2023.
-
You Shall Pass: Dealing with the Zero-Gradient Problem in Predict and Optimize for Convex Optimization
Authors:
Grigorii Veviurko,
Wendelin Böhmer,
Mathijs de Weerdt
Abstract:
Predict and optimize is an increasingly popular decision-making paradigm that employs machine learning to predict unknown parameters of optimization problems. Instead of minimizing the prediction error of the parameters, it trains predictive models using task performance as a loss function. The key challenge to train such models is the computation of the Jacobian of the solution of the optimizatio…
▽ More
Predict and optimize is an increasingly popular decision-making paradigm that employs machine learning to predict unknown parameters of optimization problems. Instead of minimizing the prediction error of the parameters, it trains predictive models using task performance as a loss function. The key challenge to train such models is the computation of the Jacobian of the solution of the optimization problem with respect to its parameters. For linear problems, this Jacobian is known to be zero or undefined; hence, approximations are usually employed. For non-linear convex problems, however, it is common to use the exact Jacobian. This paper demonstrates that the zero-gradient problem appears in the non-linear case as well -- the Jacobian can have a sizeable null space, thereby causing the training process to get stuck in suboptimal points. Through formal proofs, this paper shows that smoothing the feasible set resolves this problem. Combining this insight with known techniques from the literature, such as quadratic programming approximation and projection distance regularization, a novel method to approximate the Jacobian is derived. In simulation experiments, the proposed method increases the performance in the non-linear case and at least matches the existing state-of-the-art methods for linear problems.
△ Less
Submitted 2 February, 2024; v1 submitted 30 July, 2023;
originally announced July 2023.
-
Necessary and Sufficient Conditions for Optimal Decision Trees using Dynamic Programming
Authors:
Jacobus G. M. van der Linden,
Mathijs M. de Weerdt,
Emir Demirović
Abstract:
Global optimization of decision trees has shown to be promising in terms of accuracy, size, and consequently human comprehensibility. However, many of the methods used rely on general-purpose solvers for which scalability remains an issue. Dynamic programming methods have been shown to scale much better because they exploit the tree structure by solving subtrees as independent subproblems. However…
▽ More
Global optimization of decision trees has shown to be promising in terms of accuracy, size, and consequently human comprehensibility. However, many of the methods used rely on general-purpose solvers for which scalability remains an issue. Dynamic programming methods have been shown to scale much better because they exploit the tree structure by solving subtrees as independent subproblems. However, this only works when an objective can be optimized separately for subtrees. We explore this relationship in detail and show the necessary and sufficient conditions for such separability and generalize previous dynamic programming approaches into a framework that can optimize any combination of separable objectives and constraints. Experiments on five application domains show the general applicability of this framework, while outperforming the scalability of general-purpose solvers by a large margin.
△ Less
Submitted 15 January, 2024; v1 submitted 31 May, 2023;
originally announced May 2023.
-
EXPObench: Benchmarking Surrogate-based Optimisation Algorithms on Expensive Black-box Functions
Authors:
Laurens Bliek,
Arthur Guijt,
Rickard Karlsson,
Sicco Verwer,
Mathijs de Weerdt
Abstract:
Surrogate algorithms such as Bayesian optimisation are especially designed for black-box optimisation problems with expensive objectives, such as hyperparameter tuning or simulation-based optimisation. In the literature, these algorithms are usually evaluated with synthetic benchmarks which are well established but have no expensive objective, and only on one or two real-life applications which va…
▽ More
Surrogate algorithms such as Bayesian optimisation are especially designed for black-box optimisation problems with expensive objectives, such as hyperparameter tuning or simulation-based optimisation. In the literature, these algorithms are usually evaluated with synthetic benchmarks which are well established but have no expensive objective, and only on one or two real-life applications which vary wildly between papers. There is a clear lack of standardisation when it comes to benchmarking surrogate algorithms on real-life, expensive, black-box objective functions. This makes it very difficult to draw conclusions on the effect of algorithmic contributions and to give substantial advice on which method to use when. A new benchmark library, EXPObench, provides first steps towards such a standardisation. The library is used to provide an extensive comparison of six different surrogate algorithms on four expensive optimisation problems from different real-life applications. This has led to new insights regarding the relative importance of exploration, the evaluation time of the objective, and the used model. We also provide rules of thumb for which surrogate algorithm to use in which situation. A further contribution is that we make the algorithms and benchmark problem instances publicly available, contributing to more uniform analysis of surrogate algorithms. Most importantly, we include the performance of the six algorithms on all evaluated problem instances. This results in a unique new dataset that lowers the bar for researching new methods as the number of expensive evaluations required for comparison is significantly reduced.
△ Less
Submitted 1 December, 2022; v1 submitted 8 June, 2021;
originally announced June 2021.
-
The Maintenance Scheduling and Location Choice Problem for Railway Rolling Stock
Authors:
Jordi Zomer,
Nikola Bešinović,
Mathijs M. de Weerdt,
Rob M. P. Goverde
Abstract:
Due to increasing railway use, the capacity at railway yards and maintenance locations is becoming limiting. Therefore, the scheduling of rolling stock maintenance and the choice regarding optimal locations to perform maintenance is increasingly complicated. This research introduces a Maintenance Scheduling and Location Choice Problem (MSLCP). It simultaneously determines maintenance locations and…
▽ More
Due to increasing railway use, the capacity at railway yards and maintenance locations is becoming limiting. Therefore, the scheduling of rolling stock maintenance and the choice regarding optimal locations to perform maintenance is increasingly complicated. This research introduces a Maintenance Scheduling and Location Choice Problem (MSLCP). It simultaneously determines maintenance locations and maintenance schedules of rolling stock, while it also considers the available capacity of maintenance locations, measured in the number of available teams. To solve the MSLCP, an optimization framework based on Logic-Based Benders' Decomposition (LBBD) is proposed by combining two models, the Maintenance Location Choice Problem (MLCP) and the Activity Planning Problem (APP), to assess the capacity of a MLCP solution. Within the LBBD, four cut generation procedures are introduced to improve the computational performance: a naive procedure, two heuristic procedures and the so-called min-cut procedure that aims to exploit the specific characteristics of the problem at hand. The framework is demonstrated on a realistic scenarios from the Dutch railways. It is shown that the best choice for cut generation procedure depends on the objective: when aiming to find a good but not necessarily optimal solution, the min-cut procedure performs best, whereas when aiming for the optimal solution, one of the heuristic procedures is the preferred option. The techniques used in the current research are new to the current field and offer interesting next research opportunities.
△ Less
Submitted 28 February, 2021;
originally announced March 2021.
-
The Maintenance Location Choice Problem for Railway Rolling Stock
Authors:
Jordi Zomer,
Nikola Bešinović,
Mathijs M. de Weerdt,
Rob M. P. Goverde
Abstract:
Due to increasing railway use, the capacity at railway yards and maintenance locations is becoming limiting to accommodate existing rolling stock. To reduce capacity issues at maintenance locations during nighttime, railway undertakings consider performing more daytime maintenance, but the choice at which locations personnel needs to be stationed for daytime maintenance is not straightforward. Amo…
▽ More
Due to increasing railway use, the capacity at railway yards and maintenance locations is becoming limiting to accommodate existing rolling stock. To reduce capacity issues at maintenance locations during nighttime, railway undertakings consider performing more daytime maintenance, but the choice at which locations personnel needs to be stationed for daytime maintenance is not straightforward. Among other things, it depends on the planned rolling stock circulation and the maintenance activities that need to be performed. This paper presents the Maintenance Location Choice Problem (MLCP) and provides a Mixed Integer Linear Programming model for this problem. The model demonstrates that for a representative rolling stock circulation from the Dutch railways a substantial amount of maintenance activities can be performed during daytime. Also, it is shown that the location choice delivered by the model is robust under various time horizons and rolling stock circulations. Moreover, the running time for optimizing the model is considered acceptable for planning purposes.
△ Less
Submitted 8 December, 2020;
originally announced December 2020.
-
ReproducedPapers.org: Openly teaching and structuring machine learning reproducibility
Authors:
Burak Yildiz,
Hayley Hung,
Jesse H. Krijthe,
Cynthia C. S. Liem,
Marco Loog,
Gosia Migut,
Frans Oliehoek,
Annibale Panichella,
Przemyslaw Pawelczak,
Stjepan Picek,
Mathijs de Weerdt,
Jan van Gemert
Abstract:
We present ReproducedPapers.org: an open online repository for teaching and structuring machine learning reproducibility. We evaluate doing a reproduction project among students and the added value of an online reproduction repository among AI researchers. We use anonymous self-assessment surveys and obtained 144 responses. Results suggest that students who do a reproduction project place more val…
▽ More
We present ReproducedPapers.org: an open online repository for teaching and structuring machine learning reproducibility. We evaluate doing a reproduction project among students and the added value of an online reproduction repository among AI researchers. We use anonymous self-assessment surveys and obtained 144 responses. Results suggest that students who do a reproduction project place more value on scientific reproductions and become more critical thinkers. Students and AI researchers agree that our online reproduction repository is valuable.
△ Less
Submitted 1 December, 2020;
originally announced December 2020.
-
Continuous surrogate-based optimization algorithms are well-suited for expensive discrete problems
Authors:
Rickard Karlsson,
Laurens Bliek,
Sicco Verwer,
Mathijs de Weerdt
Abstract:
One method to solve expensive black-box optimization problems is to use a surrogate model that approximates the objective based on previous observed evaluations. The surrogate, which is cheaper to evaluate, is optimized instead to find an approximate solution to the original problem. In the case of discrete problems, recent research has revolved around surrogate models that are specifically constr…
▽ More
One method to solve expensive black-box optimization problems is to use a surrogate model that approximates the objective based on previous observed evaluations. The surrogate, which is cheaper to evaluate, is optimized instead to find an approximate solution to the original problem. In the case of discrete problems, recent research has revolved around surrogate models that are specifically constructed to deal with discrete structures. A main motivation is that literature considers continuous methods, such as Bayesian optimization with Gaussian processes as the surrogate, to be sub-optimal (especially in higher dimensions) because they ignore the discrete structure by, e.g., rounding off real-valued solutions to integers. However, we claim that this is not true. In fact, we present empirical evidence showing that the use of continuous surrogate models displays competitive performance on a set of high-dimensional discrete benchmark problems, including a real-life application, against state-of-the-art discrete surrogate-based methods. Our experiments on different discrete structures and time constraints also give more insight into which algorithms work well on which type of problem.
△ Less
Submitted 30 November, 2020; v1 submitted 6 November, 2020;
originally announced November 2020.
-
Train Unit Shunting and Servicing: a Real-Life Application of Multi-Agent Path Finding
Authors:
Jesse Mulderij,
Bob Huisman,
Denise Tönissen,
Koos van der Linden,
Mathijs de Weerdt
Abstract:
In between transportation services, trains are parked and maintained at shunting yards. The conflict-free routing of trains to and on these yards and the scheduling of service and maintenance tasks is known as the train unit shunting and service problem. Efficient use of the capacity of these yards is becoming increasingly important, because of increasing numbers of trains without proportional ext…
▽ More
In between transportation services, trains are parked and maintained at shunting yards. The conflict-free routing of trains to and on these yards and the scheduling of service and maintenance tasks is known as the train unit shunting and service problem. Efficient use of the capacity of these yards is becoming increasingly important, because of increasing numbers of trains without proportional extensions of the yards. Efficiently scheduling maintenance activities is extremely challenging: currently only heuristics succeed in finding solutions to the integrated problem at all. Bounds are needed to determine the quality of these heuristics, and also to support investment decisions on increasing the yard capacity. For this, a complete algorithm for a possibly relaxed problem model is required. We analyze the potential of extending the model for multi-agent path finding to be used for such a relaxation.
△ Less
Submitted 18 June, 2020;
originally announced June 2020.
-
Black-box Mixed-Variable Optimisation using a Surrogate Model that Satisfies Integer Constraints
Authors:
Laurens Bliek,
Arthur Guijt,
Sicco Verwer,
Mathijs de Weerdt
Abstract:
A challenging problem in both engineering and computer science is that of minimising a function for which we have no mathematical formulation available, that is expensive to evaluate, and that contains continuous and integer variables, for example in automatic algorithm configuration. Surrogate-based algorithms are very suitable for this type of problem, but most existing techniques are designed w…
▽ More
A challenging problem in both engineering and computer science is that of minimising a function for which we have no mathematical formulation available, that is expensive to evaluate, and that contains continuous and integer variables, for example in automatic algorithm configuration. Surrogate-based algorithms are very suitable for this type of problem, but most existing techniques are designed with only continuous or only discrete variables in mind. Mixed-Variable ReLU-based Surrogate Modelling (MVRSM) is a surrogate-based algorithm that uses a linear combination of rectified linear units, defined in such a way that (local) optima satisfy the integer constraints. This method outperforms the state of the art on several synthetic benchmarks with up to 238 continuous and integer variables, and achieves competitive performance on two real-life benchmarks: XGBoost hyperparameter tuning and Electrostatic Precipitator optimisation.
△ Less
Submitted 15 September, 2020; v1 submitted 8 June, 2020;
originally announced June 2020.
-
Black-box Combinatorial Optimization using Models with Integer-valued Minima
Authors:
Laurens Bliek,
Sicco Verwer,
Mathijs de Weerdt
Abstract:
When a black-box optimization objective can only be evaluated with costly or noisy measurements, most standard optimization algorithms are unsuited to find the optimal solution. Specialized algorithms that deal with exactly this situation make use of surrogate models. These models are usually continuous and smooth, which is beneficial for continuous optimization problems, but not necessarily for c…
▽ More
When a black-box optimization objective can only be evaluated with costly or noisy measurements, most standard optimization algorithms are unsuited to find the optimal solution. Specialized algorithms that deal with exactly this situation make use of surrogate models. These models are usually continuous and smooth, which is beneficial for continuous optimization problems, but not necessarily for combinatorial problems. However, by choosing the basis functions of the surrogate model in a certain way, we show that it can be guaranteed that the optimal solution of the surrogate model is integer. This approach outperforms random search, simulated annealing and one Bayesian optimization algorithm on the problem of finding robust routes for a noise-perturbed traveling salesman benchmark problem, with similar performance as another Bayesian optimization algorithm, and outperforms all compared algorithms on a convex binary optimization problem with a large number of variables.
△ Less
Submitted 20 November, 2019;
originally announced November 2019.
-
Order Acceptance and Scheduling with Sequence-dependent Setup Times: a New Memetic Algorithm and Benchmark of the State of the Art
Authors:
Lei He,
Arthur Guijt,
Mathijs de Weerdt,
Lining Xing,
Neil Yorke-Smith
Abstract:
The Order Acceptance and Scheduling (OAS) problem describes a class of real-world problems such as in smart manufacturing and satellite scheduling. This problem consists of simultaneously selecting a subset of orders to be processed as well as determining the associated schedule. A common generalization includes sequence-dependent setup times and time windows. A novel memetic algorithm for this pr…
▽ More
The Order Acceptance and Scheduling (OAS) problem describes a class of real-world problems such as in smart manufacturing and satellite scheduling. This problem consists of simultaneously selecting a subset of orders to be processed as well as determining the associated schedule. A common generalization includes sequence-dependent setup times and time windows. A novel memetic algorithm for this problem, called Sparrow, comprises a hybridization of biased random key genetic algorithm (BRKGA) and adaptive large neighbourhood search (ALNS). Sparrow integrates the exploration ability of BRKGA and the exploitation ability of ALNS. On a set of standard benchmark instances, this algorithm obtains better-quality solutions with runtimes comparable to state-of-the-art algorithms. To further understand the strengths and weaknesses of these algorithms, their performance is also compared on a set of new benchmark instances with more realistic properties. We conclude that Sparrow is distinguished by its ability to solve difficult instances from the OAS literature, and that the hybrid steady-state genetic algorithm (HSSGA) performs well on large instances in terms of optimality gap, although taking more time than Sparrow.
△ Less
Submitted 4 October, 2019;
originally announced October 2019.
-
Complexity of Scheduling Charging in the Smart Grid
Authors:
Mathijs de Weerdt,
Michael Albert,
Vincent Conitzer
Abstract:
In the smart grid, the intent is to use flexibility in demand, both to balance demand and supply as well as to resolve potential congestion. A first prominent example of such flexible demand is the charging of electric vehicles, which do not necessarily need to be charged as soon as they are plugged in. The problem of optimally scheduling the charging demand of electric vehicles within the constra…
▽ More
In the smart grid, the intent is to use flexibility in demand, both to balance demand and supply as well as to resolve potential congestion. A first prominent example of such flexible demand is the charging of electric vehicles, which do not necessarily need to be charged as soon as they are plugged in. The problem of optimally scheduling the charging demand of electric vehicles within the constraints of the electricity infrastructure is called the charge scheduling problem. The models of the charging speed, horizon, and charging demand determine the computational complexity of the charge scheduling problem. For about 20 variants, we show, using a dynamic programming approach, that the problem is either in P or weakly NP-hard. We also show that about 10 variants of the problem are strongly NP-hard, presenting a potentially significant obstacle to their use in practical situations of scale.
△ Less
Submitted 21 September, 2017;
originally announced September 2017.
-
Towards Decision Support in Reciprocation
Authors:
Gleb Polevoy,
Mathijs de Weerdt,
Catholijn Jonker
Abstract:
People often interact repeatedly: with relatives, through file sharing, in politics, etc. Many such interactions are reciprocal: reacting to the actions of the other. In order to facilitate decisions regarding reciprocal interactions, we analyze the development of reciprocation over time. To this end, we propose a model for such interactions that is simple enough to enable formal analysis, but is…
▽ More
People often interact repeatedly: with relatives, through file sharing, in politics, etc. Many such interactions are reciprocal: reacting to the actions of the other. In order to facilitate decisions regarding reciprocal interactions, we analyze the development of reciprocation over time. To this end, we propose a model for such interactions that is simple enough to enable formal analysis, but is sufficient to predict how such interactions will evolve. Inspired by existing models of international interactions and arguments between spouses, we suggest a model with two reciprocating attitudes where an agent's action is a weighted combination of the others' last actions (reacting) and either i) her innate kindness, or ii) her own last action (inertia). We analyze a network of repeatedly interacting agents, each having one of these attitudes, and prove that their actions converge to specific limits. Convergence means that the interaction stabilizes, and the limits indicate the behavior after the stabilization. For two agents, we describe the interaction process and find the limit values. For a general connected network, we find these limit values if all the agents employ the second attitude, and show that the agents' actions then all become equal. In the other cases, we study the limit values using simulations. We discuss how these results predict the development of the interaction and can be used to help agents decide on their behavior.
△ Less
Submitted 27 February, 2016; v1 submitted 28 January, 2016;
originally announced January 2016.
-
Solving Transition-Independent Multi-agent MDPs with Sparse Interactions (Extended version)
Authors:
Joris Scharpff,
Diederik M. Roijers,
Frans A. Oliehoek,
Matthijs T. J. Spaan,
Mathijs M. de Weerdt
Abstract:
In cooperative multi-agent sequential decision making under uncertainty, agents must coordinate to find an optimal joint policy that maximises joint value. Typical algorithms exploit additive structure in the value function, but in the fully-observable multi-agent MDP setting (MMDP) such structure is not present. We propose a new optimal solver for transition-independent MMDPs, in which agents can…
▽ More
In cooperative multi-agent sequential decision making under uncertainty, agents must coordinate to find an optimal joint policy that maximises joint value. Typical algorithms exploit additive structure in the value function, but in the fully-observable multi-agent MDP setting (MMDP) such structure is not present. We propose a new optimal solver for transition-independent MMDPs, in which agents can only affect their own state but their reward depends on joint transitions. We represent these dependencies compactly in conditional return graphs (CRGs). Using CRGs the value of a joint policy and the bounds on partially specified joint policies can be efficiently computed. We propose CoRe, a novel branch-and-bound policy search algorithm building on CRGs. CoRe typically requires less runtime than the available alternatives and finds solutions to problems previously unsolvable.
△ Less
Submitted 11 February, 2016; v1 submitted 29 November, 2015;
originally announced November 2015.
-
Scheduling with two non-unit task lengths is NP-complete
Authors:
Jan Elffers,
Mathijs de Weerdt
Abstract:
The non-preemptive job scheduling problem with release times and deadlines on a single machine is fundamental to many scheduling problems. We parameterize this problem by the set of job lengths the jobs can have. The case where all job lengths are identical is known to be solvable in polynomial time. We prove that the problem with two job lengths is NP-complete, except for the case in which the sh…
▽ More
The non-preemptive job scheduling problem with release times and deadlines on a single machine is fundamental to many scheduling problems. We parameterize this problem by the set of job lengths the jobs can have. The case where all job lengths are identical is known to be solvable in polynomial time. We prove that the problem with two job lengths is NP-complete, except for the case in which the short jobs have unit job length, which was already known to be efficiently solvable. The proof uses a reduction from satisfiability to an auxiliary scheduling problem that includes a set of paired jobs that each have both an early and a late deadline, and of which at least one should be scheduled before the early deadline. This reduction is enabled by not only these pairwise dependencies between jobs, but also by dependencies introduced by specifically constructed sets of jobs which have deadlines close to each other. The auxiliary scheduling problem in its turn can be reduced to the scheduling problem with two job lengths by representing each pair of jobs with two deadlines by four different jobs.
△ Less
Submitted 31 October, 2017; v1 submitted 9 December, 2014;
originally announced December 2014.
-
Computing All-Pairs Shortest Paths by Leveraging Low Treewidth
Authors:
Léon R. Planken,
Mathijs M. de Weerdt,
Roman P. J. van der Krogt
Abstract:
We present two new and efficient algorithms for computing all-pairs shortest paths. The algorithms operate on directed graphs with real (possibly negative) weights. They make use of directed path consistency along a vertex ordering d. Both algorithms run in O(n^2 w_d) time, where w_d is the graph width induced by this vertex ordering. For graphs of constant treewidth, this yields O(n^2) time, w…
▽ More
We present two new and efficient algorithms for computing all-pairs shortest paths. The algorithms operate on directed graphs with real (possibly negative) weights. They make use of directed path consistency along a vertex ordering d. Both algorithms run in O(n^2 w_d) time, where w_d is the graph width induced by this vertex ordering. For graphs of constant treewidth, this yields O(n^2) time, which is optimal. On chordal graphs, the algorithms run in O(nm) time. In addition, we present a variant that exploits graph separators to arrive at a run time of O(n w_d^2 + n^2 s_d) on general graphs, where s_d andlt= w_d is the size of the largest minimal separator induced by the vertex ordering d. We show empirically that on both constructed and realistic benchmarks, in many cases the algorithms outperform Floyd-Warshalls as well as Johnsons algorithm, which represent the current state of the art with a run time of O(n^3) and O(nm + n^2 log n), respectively. Our algorithms can be used for spatial and temporal reasoning, such as for the Simple Temporal Problem, which underlines their relevance to the planning and scheduling community.
△ Less
Submitted 18 January, 2014;
originally announced January 2014.
