Skip to main content

Showing 1–18 of 18 results for author: Grosse-Wentrup, M

Searching in archive stat. Search in all archives.
.
  1. arXiv:2304.03113  [pdf, other

    stat.ML cs.LG

    Efficient SAGE Estimation via Causal Structure Learning

    Authors: Christoph Luther, Gunnar König, Moritz Grosse-Wentrup

    Abstract: The Shapley Additive Global Importance (SAGE) value is a theoretically appealing interpretability method that fairly attributes global importance to a model's features. However, its exact calculation requires the computation of the feature's surplus performance contributions over an exponential number of feature sets. This is computationally expensive, particularly because estimating the surplus c… ▽ More

    Submitted 6 April, 2023; originally announced April 2023.

    Comments: equal contribution between Luther and König; accepted at AISTATS 2023

  2. arXiv:2210.15709  [pdf, other

    stat.ML cs.LG

    Improvement-Focused Causal Recourse (ICR)

    Authors: Gunnar König, Timo Freiesleben, Moritz Grosse-Wentrup

    Abstract: Algorithmic recourse recommendations, such as Karimi et al.'s (2021) causal recourse (CR), inform stakeholders of how to act to revert unfavourable decisions. However, some actions lead to acceptance (i.e., revert the model's decision) but do not lead to improvement (i.e., may not revert the underlying real-world state). To recommend such actions is to recommend fooling the predictor. We introduce… ▽ More

    Submitted 27 October, 2022; originally announced October 2022.

    Comments: under review

  3. arXiv:2107.07853  [pdf, ps, other

    stat.ML cs.LG

    A Causal Perspective on Meaningful and Robust Algorithmic Recourse

    Authors: Gunnar König, Timo Freiesleben, Moritz Grosse-Wentrup

    Abstract: Algorithmic recourse explanations inform stakeholders on how to act to revert unfavorable predictions. However, in general ML models do not predict well in interventional distributions. Thus, an action that changes the prediction in the desired way may not lead to an improvement of the underlying target. Such recourse is neither meaningful nor robust to model refits. Extending the work of Karimi e… ▽ More

    Submitted 16 July, 2021; originally announced July 2021.

    Comments: ICML (International Conference on Machine Learning) Workshop on Algorithmic Recourse

  4. arXiv:2106.08086  [pdf, other

    stat.ML cs.LG

    Decomposition of Global Feature Importance into Direct and Associative Components (DEDACT)

    Authors: Gunnar König, Timo Freiesleben, Bernd Bischl, Giuseppe Casalicchio, Moritz Grosse-Wentrup

    Abstract: Global model-agnostic feature importance measures either quantify whether features are directly used for a model's predictions (direct importance) or whether they contain prediction-relevant information (associative importance). Direct importance provides causal insight into the model's mechanism, yet it fails to expose the leakage of information from associated but not directly used variables. In… ▽ More

    Submitted 15 June, 2021; originally announced June 2021.

  5. arXiv:2106.03480  [pdf, other

    stat.ML cs.LG

    A Distance Covariance-based Kernel for Nonlinear Causal Clustering in Heterogeneous Populations

    Authors: Alex Markham, Richeek Das, Moritz Grosse-Wentrup

    Abstract: We consider the problem of causal structure learning in the setting of heterogeneous populations, i.e., populations in which a single causal structure does not adequately represent all population members, as is common in biological and social sciences. To this end, we introduce a distance covariance-based kernel designed specifically to measure the similarity between the underlying nonlinear causa… ▽ More

    Submitted 18 February, 2022; v1 submitted 7 June, 2021; originally announced June 2021.

    Comments: 17 pages, 3 figures; accepted to 1st Conference on Causal Learning and Reasoning (CLeaR 2022)

  6. Relative Feature Importance

    Authors: Gunnar König, Christoph Molnar, Bernd Bischl, Moritz Grosse-Wentrup

    Abstract: Interpretable Machine Learning (IML) methods are used to gain insight into the relevance of a feature of interest for the performance of a model. Commonly used IML methods differ in whether they consider features of interest in isolation, e.g., Permutation Feature Importance (PFI), or in relation to all remaining feature variables, e.g., Conditional Feature Importance (CFI). As such, the perturbat… ▽ More

    Submitted 16 July, 2020; originally announced July 2020.

    Journal ref: In Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), 9318--9325

  7. arXiv:2007.04131  [pdf, other

    stat.ML cs.LG

    General Pitfalls of Model-Agnostic Interpretation Methods for Machine Learning Models

    Authors: Christoph Molnar, Gunnar König, Julia Herbinger, Timo Freiesleben, Susanne Dandl, Christian A. Scholbeck, Giuseppe Casalicchio, Moritz Grosse-Wentrup, Bernd Bischl

    Abstract: An increasing number of model-agnostic interpretation techniques for machine learning (ML) models such as partial dependence plots (PDP), permutation feature importance (PFI) and Shapley values provide insightful model interpretations, but can lead to wrong conclusions if applied incorrectly. We highlight many general pitfalls of ML model interpretation, such as using interpretation techniques in… ▽ More

    Submitted 17 August, 2021; v1 submitted 8 July, 2020; originally announced July 2020.

  8. arXiv:1910.08778  [pdf, other

    stat.ML cs.LG

    Measurement Dependence Inducing Latent Causal Models

    Authors: Alex Markham, Moritz Grosse-Wentrup

    Abstract: We consider the task of causal structure learning over measurement dependence inducing latent (MeDIL) causal models. We show that this task can be framed in terms of the graph theoretic problem of finding edge clique covers,resulting in an algorithm for returning minimal MeDIL causal models (minMCMs). This algorithm is non-parametric, requiring no assumptions about linearity or Gaussianity. Furthe… ▽ More

    Submitted 21 September, 2020; v1 submitted 19 October, 2019; originally announced October 2019.

    Comments: 10 pages, 5 figures; presented at UAI 2020; changes from previous version: updated abstract, fixed errors due to TeX compilation of UAI notice and page numbers in some references, added published proceedings reference

    Journal ref: Proceedings of the 36th Conference on Uncertainty in Artificial Intelligence (UAI), PMLR 124:590-599, 2020

  9. arXiv:1707.00819  [pdf, other

    stat.ML cs.AI cs.LG stat.ME

    Causal Consistency of Structural Equation Models

    Authors: Paul K. Rubenstein, Sebastian Weichwald, Stephan Bongers, Joris M. Mooij, Dominik Janzing, Moritz Grosse-Wentrup, Bernhard Schölkopf

    Abstract: Complex systems can be modelled at various levels of detail. Ideally, causal models of the same system should be consistent with one another in the sense that they agree in their predictions of the effects of interventions. We formalise this notion of consistency in the case of Structural Equation Models (SEMs) by introducing exact transformations between SEMs. This provides a general language to… ▽ More

    Submitted 4 July, 2017; originally announced July 2017.

    Comments: equal contribution between Rubenstein and Weichwald; accepted manuscript

    Journal ref: Proceedings of the Annual Conference on Uncertainty in Artificial Intelligence, UAI 2017 ( http://auai.org/uai2017/proceedings/papers/11.pdf )

  10. arXiv:1704.08851  [pdf, ps, other

    q-bio.NC stat.AP stat.ME

    The right tool for the right question --- beyond the encoding versus decoding dichotomy

    Authors: Sebastian Weichwald, Moritz Grosse-Wentrup

    Abstract: There are two major questions that neuroimaging studies attempt to answer: First, how are sensory stimuli represented in the brain (which we term the stimulus-based setting)? And, second, how does the brain generate cognition (termed the response-based setting)? There has been a lively debate in the neuroimaging community whether encoding and decoding models can provide insights into these questio… ▽ More

    Submitted 28 April, 2017; originally announced April 2017.

    Comments: preprint

  11. arXiv:1701.01437   

    stat.ML

    NIPS 2016 Workshop on Representation Learning in Artificial and Biological Neural Networks (MLINI 2016)

    Authors: Leila Wehbe, Anwar Nunez-Elizalde, Marcel van Gerven, Irina Rish, Brian Murphy, Moritz Grosse-Wentrup, Georg Langs, Guillermo Cecchi

    Abstract: This workshop explores the interface between cognitive neuroscience and recent advances in AI fields that aim to reproduce human performance such as natural language processing and computer vision, and specifically deep learning approaches to such problems. When studying the cognitive capabilities of the brain, scientists follow a system identification approach in which they present different st… ▽ More

    Submitted 10 April, 2017; v1 submitted 6 January, 2017; originally announced January 2017.

  12. arXiv:1605.07094  [pdf, other

    q-bio.NC cs.IT cs.LG stat.ML

    A note on the expected minimum error probability in equientropic channels

    Authors: Sebastian Weichwald, Tatiana Fomina, Bernhard Schölkopf, Moritz Grosse-Wentrup

    Abstract: While the channel capacity reflects a theoretical upper bound on the achievable information transmission rate in the limit of infinitely many bits, it does not characterise the information transfer of a given encoding routine with finitely many bits. In this note, we characterise the quality of a code (i. e. a given encoding routine) by an upper bound on the expected minimum error probability that… ▽ More

    Submitted 4 April, 2017; v1 submitted 23 May, 2016; originally announced May 2016.

  13. arXiv:1605.04435   

    stat.ML

    Proceedings of the 5th Workshop on Machine Learning and Interpretation in Neuroimaging (MLINI) at NIPS 2015

    Authors: I. Rish, L. Wehbe, G. Langs, M. Grosse-Wentrup, B. Murphy, G. Cecchi

    Abstract: This volume is a collection of contributions from the 5th Workshop on Machine Learning and Interpretation in Neuroimaging (MLINI) at the Neural Information Processing Systems (NIPS 2015) conference. Modern multivariate statistical methods developed in the rapidly growing field of machine learning are being increasingly applied to various problems in neuroimaging, from cognitive state detection to… ▽ More

    Submitted 14 May, 2016; originally announced May 2016.

  14. arXiv:1605.00391  [pdf, other

    stat.ME cs.LG stat.AP stat.ML

    Recovery of non-linear cause-effect relationships from linearly mixed neuroimaging data

    Authors: Sebastian Weichwald, Arthur Gretton, Bernhard Schölkopf, Moritz Grosse-Wentrup

    Abstract: Causal inference concerns the identification of cause-effect relationships between variables. However, often only linear combinations of variables constitute meaningful causal variables. For example, recovering the signal of a cortical source from electroencephalography requires a well-tuned combination of signals recorded at multiple electrodes. We recently introduced the MERLiN (Mixture Effect R… ▽ More

    Submitted 30 September, 2016; v1 submitted 2 May, 2016; originally announced May 2016.

    Comments: arXiv admin note: text overlap with arXiv:1512.01255

    Journal ref: Pattern Recognition in Neuroimaging (PRNI), International Workshop on, 1-4, 2016

  15. arXiv:1512.04808  [pdf, other

    stat.ML cs.LG q-bio.NC stat.ME

    Causal and anti-causal learning in pattern recognition for neuroimaging

    Authors: Sebastian Weichwald, Bernhard Schölkopf, Tonio Ball, Moritz Grosse-Wentrup

    Abstract: Pattern recognition in neuroimaging distinguishes between two types of models: encoding- and decoding models. This distinction is based on the insight that brain state features, that are found to be relevant in an experimental paradigm, carry a different meaning in encoding- than in decoding models. In this paper, we argue that this distinction is not sufficient: Relevant features in encoding- and… ▽ More

    Submitted 15 December, 2015; originally announced December 2015.

    Comments: accepted manuscript

    Journal ref: Pattern Recognition in Neuroimaging, 2014 International Workshop on, 1-4, 2014

  16. arXiv:1512.04274  [pdf, other

    stat.ML q-bio.NC q-bio.QM

    Decoding index finger position from EEG using random forests

    Authors: Sebastian Weichwald, Timm Meyer, Bernhard Schölkopf, Tonio Ball, Moritz Grosse-Wentrup

    Abstract: While invasively recorded brain activity is known to provide detailed information on motor commands, it is an open question at what level of detail information about positions of body parts can be decoded from non-invasively acquired signals. In this work it is shown that index finger positions can be differentiated from non-invasive electroencephalographic (EEG) recordings in healthy human subjec… ▽ More

    Submitted 14 December, 2015; originally announced December 2015.

    Comments: accepted manuscript

    Journal ref: Cognitive Information Processing (CIP), 2014 4th International Workshop on, 1-6, 2014

  17. arXiv:1512.01255  [pdf, other

    stat.ME q-bio.NC stat.AP stat.ML

    MERLiN: Mixture Effect Recovery in Linear Networks

    Authors: Sebastian Weichwald, Moritz Grosse-Wentrup, Arthur Gretton

    Abstract: Causal inference concerns the identification of cause-effect relationships between variables, e.g. establishing whether a stimulus affects activity in a certain brain region. The observed variables themselves often do not constitute meaningful causal variables, however, and linear combinations need to be considered. In electroencephalographic studies, for example, one is not interested in establis… ▽ More

    Submitted 27 September, 2016; v1 submitted 3 December, 2015; originally announced December 2015.

    Journal ref: IEEE Journal of Selected Topics in Signal Processing, 10(7), 1254-1266, 2016

  18. arXiv:1511.04780  [pdf, other

    stat.ML cs.LG q-bio.NC stat.AP

    Causal interpretation rules for encoding and decoding models in neuroimaging

    Authors: Sebastian Weichwald, Timm Meyer, Ozan Özdenizci, Bernhard Schölkopf, Tonio Ball, Moritz Grosse-Wentrup

    Abstract: Causal terminology is often introduced in the interpretation of encoding and decoding models trained on neuroimaging data. In this article, we investigate which causal statements are warranted and which ones are not supported by empirical evidence. We argue that the distinction between encoding and decoding models is not sufficient for this purpose: relevant features in encoding and decoding model… ▽ More

    Submitted 15 November, 2015; originally announced November 2015.

    Comments: accepted manuscript

    Journal ref: NeuroImage, 110:48-59, 2015