Showing 1–1 of 1 results for author: Leon, J E

Efficient Computation of Shap Explanation Scores for Neural Network Classifiers via Knowledge Compilation

Authors: Leopoldo Bertossi, Jorge E. Leon

Abstract: The use of Shap scores has become widespread in Explainable AI. However, their computation is in general intractable, in particular when done with a black-box classifier, such as neural network. Recent research has unveiled classes of open-box Boolean Circuit classifiers for which Shap can be computed efficiently. We show how to transform binary neural networks into those circuits for efficient Sh… ▽ More The use of Shap scores has become widespread in Explainable AI. However, their computation is in general intractable, in particular when done with a black-box classifier, such as neural network. Recent research has unveiled classes of open-box Boolean Circuit classifiers for which Shap can be computed efficiently. We show how to transform binary neural networks into those circuits for efficient Shap computation.We use logic-based knowledge compilation techniques. The performance gain is huge, as we show in the light of our experiments. △ Less

Submitted 22 July, 2023; v1 submitted 11 March, 2023; originally announced March 2023.

Comments: Substantial revision of previous version with the same title. To appear in conference proceedings. It replaces the previously uploaded paper "Opening Up the Neural Network Classifier for Shap Score Computation", by the same authors