-
Unprocessing Seven Years of Algorithmic Fairness
Authors:
André F. Cruz,
Moritz Hardt
Abstract:
Seven years ago, researchers proposed a postprocessing method to equalize the error rates of a model across different demographic groups. The work launched hundreds of papers purporting to improve over the postprocessing baseline. We empirically evaluate these claims through thousands of model evaluations on several tabular datasets. We find that the fairness-accuracy Pareto frontier achieved by p…
▽ More
Seven years ago, researchers proposed a postprocessing method to equalize the error rates of a model across different demographic groups. The work launched hundreds of papers purporting to improve over the postprocessing baseline. We empirically evaluate these claims through thousands of model evaluations on several tabular datasets. We find that the fairness-accuracy Pareto frontier achieved by postprocessing contains all other methods we were feasibly able to evaluate. In doing so, we address two common methodological errors that have confounded previous observations. One relates to the comparison of methods with different unconstrained base models. The other concerns methods achieving different levels of constraint relaxation. At the heart of our study is a simple idea we call unprocessing that roughly corresponds to the inverse of postprocessing. Unprocessing allows for a direct comparison of methods using different underlying models and levels of relaxation.
△ Less
Submitted 15 March, 2024; v1 submitted 12 June, 2023;
originally announced June 2023.
-
FairGBM: Gradient Boosting with Fairness Constraints
Authors:
André F Cruz,
Catarina Belém,
Sérgio Jesus,
João Bravo,
Pedro Saleiro,
Pedro Bizarro
Abstract:
Tabular data is prevalent in many high-stakes domains, such as financial services or public policy. Gradient Boosted Decision Trees (GBDT) are popular in these settings due to their scalability, performance, and low training cost. While fairness in these domains is a foremost concern, existing in-processing Fair ML methods are either incompatible with GBDT, or incur in significant performance loss…
▽ More
Tabular data is prevalent in many high-stakes domains, such as financial services or public policy. Gradient Boosted Decision Trees (GBDT) are popular in these settings due to their scalability, performance, and low training cost. While fairness in these domains is a foremost concern, existing in-processing Fair ML methods are either incompatible with GBDT, or incur in significant performance losses while taking considerably longer to train. We present FairGBM, a dual ascent learning framework for training GBDT under fairness constraints, with little to no impact on predictive performance when compared to unconstrained GBDT. Since observational fairness metrics are non-differentiable, we propose smooth convex error rate proxies for common fairness criteria, enabling gradient-based optimization using a ``proxy-Lagrangian'' formulation. Our implementation shows an order of magnitude speedup in training time relative to related work, a pivotal aspect to foster the widespread adoption of FairGBM by real-world practitioners.
△ Less
Submitted 3 March, 2023; v1 submitted 16 September, 2022;
originally announced September 2022.
-
Understanding Unfairness in Fraud Detection through Model and Data Bias Interactions
Authors:
José Pombal,
André F. Cruz,
João Bravo,
Pedro Saleiro,
Mário A. T. Figueiredo,
Pedro Bizarro
Abstract:
In recent years, machine learning algorithms have become ubiquitous in a multitude of high-stakes decision-making applications. The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to incorporate biases embedded within. A biased model can then make decisions that disproportionately harm certain groups in society -- limiting their access to financial…
▽ More
In recent years, machine learning algorithms have become ubiquitous in a multitude of high-stakes decision-making applications. The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to incorporate biases embedded within. A biased model can then make decisions that disproportionately harm certain groups in society -- limiting their access to financial services, for example. The awareness of this problem has given rise to the field of Fair ML, which focuses on studying, measuring, and mitigating unfairness in algorithmic prediction, with respect to a set of protected groups (e.g., race or gender). However, the underlying causes for algorithmic unfairness still remain elusive, with researchers divided between blaming either the ML algorithms or the data they are trained on. In this work, we maintain that algorithmic unfairness stems from interactions between models and biases in the data, rather than from isolated contributions of either of them. To this end, we propose a taxonomy to characterize data bias and we study a set of hypotheses regarding the fairness-accuracy trade-offs that fairness-blind ML algorithms exhibit under different data bias settings. On our real-world account-opening fraud use case, we find that each setting entails specific trade-offs, affecting fairness in expected value and variance -- the latter often going unnoticed. Moreover, we show how algorithms compare differently in terms of accuracy and fairness, depending on the biases affecting the data. Finally, we note that under specific data bias conditions, simple pre-processing interventions can successfully balance group-wise error rates, while the same techniques fail in more complex settings.
△ Less
Submitted 13 July, 2022;
originally announced July 2022.
-
Promoting Fairness through Hyperparameter Optimization
Authors:
André F. Cruz,
Pedro Saleiro,
Catarina Belém,
Carlos Soares,
Pedro Bizarro
Abstract:
Considerable research effort has been guided towards algorithmic fairness but real-world adoption of bias reduction techniques is still scarce. Existing methods are either metric- or model-specific, require access to sensitive attributes at inference time, or carry high development or deployment costs. This work explores the unfairness that emerges when optimizing ML models solely for predictive p…
▽ More
Considerable research effort has been guided towards algorithmic fairness but real-world adoption of bias reduction techniques is still scarce. Existing methods are either metric- or model-specific, require access to sensitive attributes at inference time, or carry high development or deployment costs. This work explores the unfairness that emerges when optimizing ML models solely for predictive performance, and how to mitigate it with a simple and easily deployed intervention: fairness-aware hyperparameter optimization (HO). We propose and evaluate fairness-aware variants of three popular HO algorithms: Fair Random Search, Fair TPE, and Fairband. We validate our approach on a real-world bank account opening fraud case-study, as well as on three datasets from the fairness literature. Results show that, without extra training cost, it is feasible to find models with 111% mean fairness increase and just 6% decrease in performance when compared with fairness-blind HO.
△ Less
Submitted 11 October, 2021; v1 submitted 23 March, 2021;
originally announced March 2021.
-
Beyond gold nanoparticles cytotoxicity: potential to impair metastasis hallmarks
Authors:
Jenifer Pendiuk Gonçalves,
Anderson Fraga da Cruz,
Heloise Ribeiro de Barros,
Beatriz Santana Borges,
Lia Carolina Almeida Soares de Medeiros,
Maurilio José Soares,
Mayara Padovan dos Santos,
Marco Tadeu Grassi,
Anil Chandra,
Loretta Laureana del Mercato,
Gustavo Rodrigues Rossi,
Edvaldo da Silva Trindade,
Izabel Cristina Riegel Vidotti,
Carolina Camargo de Oliveira
Abstract:
This study aimed to investigate the antitumor effect of ultrasmall gold nanoparticles (AuNPs), around 3 nm, stabilized by the anionic polysaccharide gum arabic (GA-AuNPs). The focus was downregulation of cancer hallmarks of aggressive tumors, using a highly metastatic model of melanoma. We first demonstrated that GA-AuNPs showed excellent stability under biological environment. Non-cytotoxic conce…
▽ More
This study aimed to investigate the antitumor effect of ultrasmall gold nanoparticles (AuNPs), around 3 nm, stabilized by the anionic polysaccharide gum arabic (GA-AuNPs). The focus was downregulation of cancer hallmarks of aggressive tumors, using a highly metastatic model of melanoma. We first demonstrated that GA-AuNPs showed excellent stability under biological environment. Non-cytotoxic concentrations to seven different cell lines, including tumorigenic and non-tumorigenic cells, were determined by standard 2D in vitro assays. Gold concentrations below 2.4 mg L-1 were non-cytotoxic and therefore chosen for further analyses. Cells exposed to GA-AuNPs were uptaken by melanoma cells through endocytic processes. Next, we described remarkable biological properties using non-cytotoxic concentrations of this nanomaterial. Invasion through an extracellular matrix barrier as well as 3D growth capacity (anchorage-independent colony formation and spheroids growth) were negatively affected by 2.4 mg L-1 GA-AuNPs. Additionally, exposed spheroids showed morphological changes, suggesting that GA-AuNPs could penetrate into the preformed tumor and affect its integrity. All together these results demonstrate that side effects, such as cytotoxicity, can be avoided by choosing the right concentration, nevertheless, preserving desirable effects such as modulation of key tumor cell malignancy features.
△ Less
Submitted 18 January, 2021;
originally announced January 2021.
-
TimeSHAP: Explaining Recurrent Models through Sequence Perturbations
Authors:
João Bento,
Pedro Saleiro,
André F. Cruz,
Mário A. T. Figueiredo,
Pedro Bizarro
Abstract:
Although recurrent neural networks (RNNs) are state-of-the-art in numerous sequential decision-making tasks, there has been little research on explaining their predictions. In this work, we present TimeSHAP, a model-agnostic recurrent explainer that builds upon KernelSHAP and extends it to the sequential domain. TimeSHAP computes feature-, timestep-, and cell-level attributions. As sequences may b…
▽ More
Although recurrent neural networks (RNNs) are state-of-the-art in numerous sequential decision-making tasks, there has been little research on explaining their predictions. In this work, we present TimeSHAP, a model-agnostic recurrent explainer that builds upon KernelSHAP and extends it to the sequential domain. TimeSHAP computes feature-, timestep-, and cell-level attributions. As sequences may be arbitrarily long, we further propose a pruning method that is shown to dramatically decrease both its computational cost and the variance of its attributions. We use TimeSHAP to explain the predictions of a real-world bank account takeover fraud detection RNN model, and draw key insights from its explanations: i) the model identifies important features and events aligned with what fraud analysts consider cues for account takeover; ii) positive predicted sequences can be pruned to only 10% of the original length, as older events have residual attribution values; iii) the most recent input event of positive predictions only contributes on average to 41% of the model's score; iv) notably high attribution to client's age, suggesting a potential discriminatory reasoning, later confirmed as higher false positive rates for older clients.
△ Less
Submitted 26 June, 2021; v1 submitted 30 November, 2020;
originally announced December 2020.
-
A Bandit-Based Algorithm for Fairness-Aware Hyperparameter Optimization
Authors:
André F. Cruz,
Pedro Saleiro,
Catarina Belém,
Carlos Soares,
Pedro Bizarro
Abstract:
Considerable research effort has been guided towards algorithmic fairness but there is still no major breakthrough. In practice, an exhaustive search over all possible techniques and hyperparameters is needed to find optimal fairness-accuracy trade-offs. Hence, coupled with the lack of tools for ML practitioners, real-world adoption of bias reduction methods is still scarce. To address this, we pr…
▽ More
Considerable research effort has been guided towards algorithmic fairness but there is still no major breakthrough. In practice, an exhaustive search over all possible techniques and hyperparameters is needed to find optimal fairness-accuracy trade-offs. Hence, coupled with the lack of tools for ML practitioners, real-world adoption of bias reduction methods is still scarce. To address this, we present Fairband, a bandit-based fairness-aware hyperparameter optimization (HO) algorithm. Fairband is conceptually simple, resource-efficient, easy to implement, and agnostic to both the objective metrics, model types and the hyperparameter space being explored. Moreover, by introducing fairness notions into HO, we enable seamless and efficient integration of fairness objectives into real-world ML pipelines. We compare Fairband with popular HO methods on four real-world decision-making datasets. We show that Fairband can efficiently navigate the fairness-accuracy trade-off through hyperparameter optimization. Furthermore, without extra training cost, it consistently finds configurations attaining substantially improved fairness at a comparatively small decrease in predictive accuracy.
△ Less
Submitted 22 October, 2020; v1 submitted 7 October, 2020;
originally announced October 2020.
-
A Discrete Algorithm to the Calculus of Variations
Authors:
Celia T. L. M. Pereira,
Pedro A. F. Cruz,
Delfim F. M. Torres
Abstract:
A numerical study of an algorithm proposed by Gusein Guseinov, which determines approximations to the optimal solution of problems of calculus of variations using two discretizations and correspondent Euler-Lagrange equations, is investigated. The results we obtain to discretizations of the brachistochrone problem and Mania example with Lavrentiev's phenomenon are compared with the solutions fou…
▽ More
A numerical study of an algorithm proposed by Gusein Guseinov, which determines approximations to the optimal solution of problems of calculus of variations using two discretizations and correspondent Euler-Lagrange equations, is investigated. The results we obtain to discretizations of the brachistochrone problem and Mania example with Lavrentiev's phenomenon are compared with the solutions found by other methods and solvers. We conclude that Guseinov's method presents better solutions in most of the cases studied.
△ Less
Submitted 3 March, 2010;
originally announced March 2010.
-
A non-classical class of variational problems
Authors:
Pedro A. F. Cruz,
Delfim F. M. Torres,
Alan S. I. Zinober
Abstract:
We study a new non-classical class of variational problems that is motivated by some recent research on the non-linear revenue problem in the field of economics. This class of problem can be set up as a maximising problem in the Calculus of Variations (CoV) or Optimal Control. However, the state value at the final fixed time, y(T), is a priori unknown and the integrand is a function of the unkno…
▽ More
We study a new non-classical class of variational problems that is motivated by some recent research on the non-linear revenue problem in the field of economics. This class of problem can be set up as a maximising problem in the Calculus of Variations (CoV) or Optimal Control. However, the state value at the final fixed time, y(T), is a priori unknown and the integrand is a function of the unknown y(T). This is a non-standard CoV problem. In this paper we apply the new costate boundary conditions p(T) in the formulation of the CoV problem. We solve some sample examples in this problem class using the numerical shooting method to solve the resulting TPBVP, and incorporate the free y(T) as an additional unknown. Essentially the same results are obtained using symbolic algebra software.
△ Less
Submitted 2 November, 2009;
originally announced November 2009.
-
Evolution Strategies in Optimization Problems
Authors:
Pedro A. F. Cruz,
Delfim F. M. Torres
Abstract:
Evolution Strategies are inspired in biology and part of a larger research field known as Evolutionary Algorithms. Those strategies perform a random search in the space of admissible functions, aiming to optimize some given objective function. We show that simple evolution strategies are a useful tool in optimal control, permitting to obtain, in an efficient way, good approximations to the solut…
▽ More
Evolution Strategies are inspired in biology and part of a larger research field known as Evolutionary Algorithms. Those strategies perform a random search in the space of admissible functions, aiming to optimize some given objective function. We show that simple evolution strategies are a useful tool in optimal control, permitting to obtain, in an efficient way, good approximations to the solutions of some recent and challenging optimal control problems.
△ Less
Submitted 7 September, 2007;
originally announced September 2007.
