-
Algorithmic Recourse in the Wild: Understanding the Impact of Data and Model Shifts
Authors:
Kaivalya Rawal,
Ece Kamar,
Himabindu Lakkaraju
Abstract:
As predictive models are increasingly being deployed to make a variety of consequential decisions, there is a growing emphasis on designing algorithms that can provide recourse to affected individuals. Existing recourse algorithms function under the assumption that the underlying predictive model does not change. However, models are regularly updated in practice for several reasons including data…
▽ More
As predictive models are increasingly being deployed to make a variety of consequential decisions, there is a growing emphasis on designing algorithms that can provide recourse to affected individuals. Existing recourse algorithms function under the assumption that the underlying predictive model does not change. However, models are regularly updated in practice for several reasons including data distribution shifts. In this work, we make the first attempt at understanding how model updates resulting from data distribution shifts impact the algorithmic recourses generated by state-of-the-art algorithms. We carry out a rigorous theoretical and empirical analysis to address the above question. Our theoretical results establish a lower bound on the probability of recourse invalidation due to model shifts, and show the existence of a tradeoff between this invalidation probability and typical notions of "cost" minimized by modern recourse generation algorithms. We experiment with multiple synthetic and real world datasets, capturing different kinds of distribution shifts including temporal shifts, geospatial shifts, and shifts due to data correction. These experiments demonstrate that model updation due to all the aforementioned distribution shifts can potentially invalidate recourses generated by state-of-the-art algorithms. Our findings thus not only expose previously unknown flaws in the current recourse generation paradigm, but also pave the way for fundamentally rethinking the design and development of recourse generation algorithms.
△ Less
Submitted 25 June, 2021; v1 submitted 21 December, 2020;
originally announced December 2020.
-
Beyond Individualized Recourse: Interpretable and Interactive Summaries of Actionable Recourses
Authors:
Kaivalya Rawal,
Himabindu Lakkaraju
Abstract:
As predictive models are increasingly being deployed in high-stakes decision-making, there has been a lot of interest in develo** algorithms which can provide recourses to affected individuals. While develo** such tools is important, it is even more critical to analyse and interpret a predictive model, and vet it thoroughly to ensure that the recourses it offers are meaningful and non-discrimi…
▽ More
As predictive models are increasingly being deployed in high-stakes decision-making, there has been a lot of interest in develo** algorithms which can provide recourses to affected individuals. While develo** such tools is important, it is even more critical to analyse and interpret a predictive model, and vet it thoroughly to ensure that the recourses it offers are meaningful and non-discriminatory before it is deployed in the real world. To this end, we propose a novel model agnostic framework called Actionable Recourse Summaries (AReS) to construct global counterfactual explanations which provide an interpretable and accurate summary of recourses for the entire population. We formulate a novel objective which simultaneously optimizes for correctness of the recourses and interpretability of the explanations, while minimizing overall recourse costs across the entire population. More specifically, our objective enables us to learn, with optimality guarantees on recourse correctness, a small number of compact rule sets each of which capture recourses for well defined subpopulations within the data. We also demonstrate theoretically that several of the prior approaches proposed to generate recourses for individuals are special cases of our framework. Experimental evaluation with real world datasets and user studies demonstrate that our framework can provide decision makers with a comprehensive overview of recourses corresponding to any black box model, and consequently help detect undesirable model biases and discrimination.
△ Less
Submitted 28 October, 2020; v1 submitted 15 September, 2020;
originally announced September 2020.
-
Maximizing Contrasting Opinions in Signed Social Networks
Authors:
Kaivalya Rawal,
Arijit Khan
Abstract:
The classic influence maximization problem finds a limited number of influential seed users in a social network such that the expected number of influenced users in the network, following an influence cascade model, is maximized. The problem has been studied in different settings, with further generalization of the graph structure, e.g., edge weights and polarities, target user categories, etc. In…
▽ More
The classic influence maximization problem finds a limited number of influential seed users in a social network such that the expected number of influenced users in the network, following an influence cascade model, is maximized. The problem has been studied in different settings, with further generalization of the graph structure, e.g., edge weights and polarities, target user categories, etc. In this paper, we introduce a unique influence diffusion scenario involving a population that split into two distinct groups, with opposing views. We aim at finding the top-$k$ influential seed nodes so to simultaneously maximize the adoption of two distinct, antithetical opinions in the two groups, respectively. Efficiently finding such influential users is essential in a wide range of applications such as increasing voter engagement and turnout, steering public debates and discussions on societal issues with contentious opinions. We formulate this novel problem with the voter model to simulate opinion diffusion and dynamics, and then design a linear-time and exact algorithm COSiNeMax, while also investigating the long-term opinion characteristics in the network. Our experiments with several real-world datasets demonstrate the effectiveness and efficiency of the proposed algorithm, compared to various baselines.
△ Less
Submitted 26 October, 2019;
originally announced October 2019.
