-
A Robust Unsupervised Ensemble of Feature-Based Explanations using Restricted Boltzmann Machines
Authors:
Vadim Borisov,
Johannes Meier,
Johan van den Heuvel,
Hamed Jalali,
Gjergji Kasneci
Abstract:
Understanding the results of deep neural networks is an essential step towards wider acceptance of deep learning algorithms. Many approaches address the issue of interpreting artificial neural networks, but often provide divergent explanations. Moreover, different hyperparameters of an explanatory method can lead to conflicting interpretations. In this paper, we propose a technique for aggregating…
▽ More
Understanding the results of deep neural networks is an essential step towards wider acceptance of deep learning algorithms. Many approaches address the issue of interpreting artificial neural networks, but often provide divergent explanations. Moreover, different hyperparameters of an explanatory method can lead to conflicting interpretations. In this paper, we propose a technique for aggregating the feature attributions of different explanatory algorithms using Restricted Boltzmann Machines (RBMs) to achieve a more reliable and robust interpretation of deep neural networks. Several challenging experiments on real-world datasets show that the proposed RBM method outperforms popular feature attribution methods and basic ensemble techniques.
△ Less
Submitted 14 November, 2021;
originally announced November 2021.
-
CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithms
Authors:
Martin Pawelczyk,
Sascha Bielawski,
Johannes van den Heuvel,
Tobias Richter,
Gjergji Kasneci
Abstract:
Counterfactual explanations provide means for prescriptive model explanations by suggesting actionable feature changes (e.g., increase income) that allow individuals to achieve favorable outcomes in the future (e.g., insurance approval). Choosing an appropriate method is a crucial aspect for meaningful counterfactual explanations. As documented in recent reviews, there exists a quickly growing lit…
▽ More
Counterfactual explanations provide means for prescriptive model explanations by suggesting actionable feature changes (e.g., increase income) that allow individuals to achieve favorable outcomes in the future (e.g., insurance approval). Choosing an appropriate method is a crucial aspect for meaningful counterfactual explanations. As documented in recent reviews, there exists a quickly growing literature with available methods. Yet, in the absence of widely available opensource implementations, the decision in favor of certain models is primarily based on what is readily available. Going forward - to guarantee meaningful comparisons across explanation methods - we present CARLA (Counterfactual And Recourse LibrAry), a python library for benchmarking counterfactual explanation methods across both different data sets and different machine learning models. In summary, our work provides the following contributions: (i) an extensive benchmark of 11 popular counterfactual explanation methods, (ii) a benchmarking framework for research on future counterfactual explanation methods, and (iii) a standardized set of integrated evaluation measures and data sets for transparent and extensive comparisons of these methods. We have open-sourced CARLA and our experimental results on Github, making them available as competitive baselines. We welcome contributions from other research groups and practitioners.
△ Less
Submitted 2 August, 2021;
originally announced August 2021.
-
Uniform Orderings for Generalized Coloring Numbers
Authors:
Jan van den Heuvel,
H. A. Kierstead
Abstract:
The generalized coloring numbers col_r(G) (also denoted by scol_r(G)) and wcol_r(G) of a graph G were introduced by Kierstead and Yang as a generalization of the usual coloring number, and have found important theoretical and algorithmic applications. For each distance r, these numbers are determined by an "optimal" ordering of the vertices of G. We study the question of whether it is possible to…
▽ More
The generalized coloring numbers col_r(G) (also denoted by scol_r(G)) and wcol_r(G) of a graph G were introduced by Kierstead and Yang as a generalization of the usual coloring number, and have found important theoretical and algorithmic applications. For each distance r, these numbers are determined by an "optimal" ordering of the vertices of G. We study the question of whether it is possible to find a single "uniform" ordering that is "good" for all distances r. We show that the answer to this question is essentially "yes". Our results give new characterizations of graph classes with bounded expansion and nowhere dense graph classes.
△ Less
Submitted 16 December, 2019; v1 submitted 28 July, 2019;
originally announced July 2019.
-
Model-Checking on Ordered Structures
Authors:
Kord Eickmeyer,
Jan van den Heuvel,
Ken-ichi Kawarabayashi,
Stephan Kreutzer,
Patrice Ossona de Mendez,
Michał Pilipczuk,
Daniel A. Quiroz,
Roman Rabinovich,
Sebastian Siebertz
Abstract:
We study the model-checking problem for first- and monadic second-order logic on finite relational structures. The problem of verifying whether a formula of these logics is true on a given structure is considered intractable in general, but it does become tractable on interesting classes of structures, such as on classes whose Gaifman graphs have bounded treewidth. In this paper we continue this l…
▽ More
We study the model-checking problem for first- and monadic second-order logic on finite relational structures. The problem of verifying whether a formula of these logics is true on a given structure is considered intractable in general, but it does become tractable on interesting classes of structures, such as on classes whose Gaifman graphs have bounded treewidth. In this paper we continue this line of research and study model-checking for first- and monadic second-order logic in the presence of an ordering on the input structure. We do so in two settings: the general ordered case, where the input structures are equipped with a fixed order or successor relation, and the order invariant case, where the formulas may resort to an ordering, but their truth must be independent of the particular choice of order. In the first setting we show very strong intractability results for most interesting classes of structures. In contrast, in the order invariant case we obtain tractability results for order-invariant monadic second-order formulas on the same classes of graphs as in the unordered case. For first-order logic, we obtain tractability of successor-invariant formulas on classes whose Gaifman graphs have bounded expansion. Furthermore, we show that model-checking for order-invariant first-order formulas is tractable on coloured posets of bounded width.
△ Less
Submitted 18 December, 2018;
originally announced December 2018.
-
Model-Checking for Successor-Invariant First-Order Formulas on Graph Classes of Bounded Expansion
Authors:
Jan van den Heuvel,
Stephan Kreutzer,
Michał Pilipczuk,
Daniel A. Quiroz,
Roman Rabinovich,
Sebastian Siebertz
Abstract:
A successor-invariant first-order formula is a formula that has access to an auxiliary successor relation on a structure's universe, but the model relation is independent of the particular interpretation of this relation. It is well known that successor-invariant formulas are more expressive on finite structures than plain first-order formulas without a successor relation. This naturally raises th…
▽ More
A successor-invariant first-order formula is a formula that has access to an auxiliary successor relation on a structure's universe, but the model relation is independent of the particular interpretation of this relation. It is well known that successor-invariant formulas are more expressive on finite structures than plain first-order formulas without a successor relation. This naturally raises the question whether this increase in expressive power comes at an extra cost to solve the model-checking problem, that is, the problem to decide whether a given structure together with some (and hence every) successor relation is a model of a given formula. It was shown earlier that adding successor-invariance to first-order logic essentially comes at no extra cost for the model-checking problem on classes of finite structures whose underlying Gaifman graph is planar [Engelmann et al., 2012], excludes a fixed minor [Eickmeyer et al., 2013] or a fixed topological minor [Eickmeyer and Kawarabayashi, 2016; Kreutzer et al., 2016]. In this work we show that the model-checking problem for successor-invariant formulas is fixed-parameter tractable on any class of finite structures whose underlying Gaifman graphs form a class of bounded expansion. Our result generalises all earlier results and comes close to the best tractability results on nowhere dense classes of graphs currently known for plain first-order logic.
△ Less
Submitted 21 May, 2017; v1 submitted 30 January, 2017;
originally announced January 2017.
-
On the Generalised Colouring Numbers of Graphs that Exclude a Fixed Minor
Authors:
Jan van den Heuvel,
Patrice Ossona de Mendez,
Daniel Quiroz,
Roman Rabinovich,
Sebastian Siebertz
Abstract:
The generalised colouring numbers $\mathrm{col}_r(G)$ and $\mathrm{wcol}_r(G)$ were introduced by Kierstead and Yang as a generalisation of the usual colouring number, and have since then found important theoretical and algorithmic applications. In this paper, we dramatically improve upon the known upper bounds for generalised colouring numbers for graphs excluding a fixed minor, from the exponent…
▽ More
The generalised colouring numbers $\mathrm{col}_r(G)$ and $\mathrm{wcol}_r(G)$ were introduced by Kierstead and Yang as a generalisation of the usual colouring number, and have since then found important theoretical and algorithmic applications. In this paper, we dramatically improve upon the known upper bounds for generalised colouring numbers for graphs excluding a fixed minor, from the exponential bounds of Grohe et al. to a linear bound for the $r$-colouring number $\mathrm{col}_r$ and a polynomial bound for the weak $r$-colouring number $\mathrm{wcol}_r$. In particular, we show that if $G$ excludes $K_t$ as a minor, for some fixed $t\ge4$, then $\mathrm{col}_r(G)\le\binom{t-1}{2}\,(2r+1)$ and $\mathrm{wcol}_r(G)\le\binom{r+t-2}{t-2}\cdot(t-3)(2r+1)\in\mathcal{O}(r^{\,t-1})$. In the case of graphs $G$ of bounded genus $g$, we improve the bounds to $\mathrm{col}_r(G)\le(2g+3)(2r+1)$ (and even $\mathrm{col}_r(G)\le5r+1$ if $g=0$, i.e. if $G$ is planar) and $\mathrm{wcol}_r(G)\le\Bigl(2g+\binom{r+2}{2}\Bigr)\,(2r+1)$.
△ Less
Submitted 1 April, 2020; v1 submitted 29 February, 2016;
originally announced February 2016.
-
The Complexity of Change
Authors:
Jan van den Heuvel
Abstract:
Many combinatorial problems can be formulated as "Can I transform configuration 1 into configuration 2, if certain transformations only are allowed?". An example of such a question is: given two k-colourings of a graph, can I transform the first k-colouring into the second one, by recolouring one vertex at a time, and always maintaining a proper k-colouring? Another example is: given two solutions…
▽ More
Many combinatorial problems can be formulated as "Can I transform configuration 1 into configuration 2, if certain transformations only are allowed?". An example of such a question is: given two k-colourings of a graph, can I transform the first k-colouring into the second one, by recolouring one vertex at a time, and always maintaining a proper k-colouring? Another example is: given two solutions of a SAT-instance, can I transform the first solution into the second one, by changing the truth value one variable at a time, and always maintaining a solution of the SAT-instance? Other examples can be found in many classical puzzles, such as the 15-Puzzle and Rubik's Cube.
In this survey we shall give an overview of some older and more recent work on this type of problem. The emphasis will be on the computational complexity of the problems: how hard is it to decide if a certain transformation is possible or not?
△ Less
Submitted 10 December, 2013;
originally announced December 2013.
-
Frugal Colouring of Graphs
Authors:
Omid Amini,
Louis Esperet,
Jan Van Den Heuvel
Abstract:
A $k$-frugal colouring of a graph $G$ is a proper colouring of the vertices of $G$ such that no colour appears more than $k$ times in the neighbourhood of a vertex. This type of colouring was introduced by Hind, Molloy and Reed in 1997. In this paper, we study the frugal chromatic number of planar graphs, planar graphs with large girth, and outerplanar graphs, and relate this parameter with seve…
▽ More
A $k$-frugal colouring of a graph $G$ is a proper colouring of the vertices of $G$ such that no colour appears more than $k$ times in the neighbourhood of a vertex. This type of colouring was introduced by Hind, Molloy and Reed in 1997. In this paper, we study the frugal chromatic number of planar graphs, planar graphs with large girth, and outerplanar graphs, and relate this parameter with several well-studied colourings, such as colouring of the square, cyclic colouring, and $L(p,q)$-labelling. We also study frugal edge-colourings of multigraphs.
△ Less
Submitted 3 May, 2007;
originally announced May 2007.
