Showing 1–1 of 1 results for author: Greenfield, A

MDL-motivated compression of GLM ensembles increases interpretability and retains predictive power

Authors: Boris Hayete, Matthew Valko, Alex Greenfield, Raymond Yan

Abstract: Over the years, ensemble methods have become a staple of machine learning. Similarly, generalized linear models (GLMs) have become very popular for a wide variety of statistical inference tasks. The former have been shown to enhance out- of-sample predictive power and the latter possess easy interpretability. Recently, ensembles of GLMs have been proposed as a possibility. On the downside, this ap… ▽ More Over the years, ensemble methods have become a staple of machine learning. Similarly, generalized linear models (GLMs) have become very popular for a wide variety of statistical inference tasks. The former have been shown to enhance out- of-sample predictive power and the latter possess easy interpretability. Recently, ensembles of GLMs have been proposed as a possibility. On the downside, this approach loses the interpretability that GLMs possess. We show that minimum description length (MDL)-motivated compression of the inferred ensembles can be used to recover interpretability without much, if any, downside to performance and illustrate on a number of standard classification data sets. △ Less

Submitted 21 November, 2016; originally announced November 2016.

Comments: The authors would like to acknowledge Leon Furchtgott and Fred Gruber for their invaluable feedback on the manuscript, and Fred Gruber for his help with LATEX. Presented at NIPS 2016 Workshop on Interpretable Machine Learning in Complex Systems