Showing 1–2 of 2 results for author: Wirth, S

A Reinforcement Learning Approach for Scheduling Problems With Improved Generalization Through Order Swap**

Authors: Deepak Vivekanandan, Samuel Wirth, Patrick Karlbauer, Noah Klarmann

Abstract: The scheduling of production resources (such as associating jobs to machines) plays a vital role for the manufacturing industry not only for saving energy but also for increasing the overall efficiency. Among the different job scheduling problems, the JSSP is addressed in this work. JSSP falls into the category of NP-hard COP, in which solving the problem through exhaustive search becomes unfeasib… ▽ More The scheduling of production resources (such as associating jobs to machines) plays a vital role for the manufacturing industry not only for saving energy but also for increasing the overall efficiency. Among the different job scheduling problems, the JSSP is addressed in this work. JSSP falls into the category of NP-hard COP, in which solving the problem through exhaustive search becomes unfeasible. Simple heuristics such as FIFO, LPT and metaheuristics such as Taboo search are often adopted to solve the problem by truncating the search space. The viability of the methods becomes inefficient for large problem sizes as it is either far from the optimum or time consuming. In recent years, the research towards using DRL to solve COP has gained interest and has shown promising results in terms of solution quality and computational efficiency. In this work, we provide an novel approach to solve the JSSP examining the objectives generalization and solution effectiveness using DRL. In particular, we employ the PPO algorithm that adopts the policy-gradient paradigm that is found to perform well in the constrained dispatching of jobs. We incorporated an OSM in the environment to achieve better generalized learning of the problem. The performance of the presented approach is analyzed in depth by using a set of available benchmark instances and comparing our results with the work of other groups. △ Less

Submitted 6 March, 2023; v1 submitted 27 February, 2023; originally announced February 2023.

SoS certification for symmetric quadratic functions and its connection to constrained Boolean hypercube optimization

Authors: Adam Kurpisz, Aaron Potechin, Elias Samuel Wirth

Abstract: We study the rank of the Sum of Squares (SoS) hierarchy over the Boolean hypercube for Symmetric Quadratic Functions (SQFs) in $n$ variables with roots placed in points $k-1$ and $k$. Functions of this type have played a central role in deepening the understanding of the performance of the SoS method for various unconstrained Boolean hypercube optimization problems, including the Max Cut problem.… ▽ More We study the rank of the Sum of Squares (SoS) hierarchy over the Boolean hypercube for Symmetric Quadratic Functions (SQFs) in $n$ variables with roots placed in points $k-1$ and $k$. Functions of this type have played a central role in deepening the understanding of the performance of the SoS method for various unconstrained Boolean hypercube optimization problems, including the Max Cut problem. Recently, Lee, Prakash, de Wolf, and Yuen proved a lower bound on the SoS rank for SQFs of $Ω(\sqrt{k(n-k)})$ and conjectured the lower bound of $Ω(n)$ by similarity to a polynomial representation of the $n$-bit OR function. Using Chebyshev polynomials, we refute the Lee -- Prakash -- de~Wolf -- Yuen conjecture and prove that the SoS rank for SQFs is at most $O(\sqrt{nk}\log(n))$. We connect this result to two constrained Boolean hypercube optimization problems. First, we provide a degree $O( \sqrt{n})$ SoS certificate that matches the known SoS rank lower bound for an instance of Min Knapsack, a problem that was intensively studied in the literature. Second, we study an instance of the Set Cover problem for which Bienstock and Zuckerberg conjectured an SoS rank lower bound of $n/4$. We refute the Bienstock -- Zuckerberg conjecture and provide a degree $O(\sqrt{n}\log(n))$ SoS certificate for this problem. △ Less

Submitted 8 July, 2021; originally announced July 2021.