Aequitas: A Bias and Fairness Audit Toolkit
Authors:
Pedro Saleiro,
Benedict Kuester,
Loren Hinkson,
Jesse London,
Abby Stevens,
Ari Anisfeld,
Kit T. Rodolfa,
Rayid Ghani
Abstract:
Recent work has raised concerns on the risk of unintended bias in AI systems being used nowadays that can affect individuals unfairly based on race, gender or religion, among other possible characteristics. While a lot of bias metrics and fairness definitions have been proposed in recent years, there is no consensus on which metric/definition should be used and there are very few available resourc…
▽ More
Recent work has raised concerns on the risk of unintended bias in AI systems being used nowadays that can affect individuals unfairly based on race, gender or religion, among other possible characteristics. While a lot of bias metrics and fairness definitions have been proposed in recent years, there is no consensus on which metric/definition should be used and there are very few available resources to operationalize them. Therefore, despite recent awareness, auditing for bias and fairness when develo** and deploying AI systems is not yet a standard practice. We present Aequitas, an open source bias and fairness audit toolkit that is an intuitive and easy to use addition to the machine learning workflow, enabling users to seamlessly test models for several bias and fairness metrics in relation to multiple population sub-groups. Aequitas facilitates informed and equitable decisions around develo** and deploying algorithmic decision making systems for both data scientists, machine learning researchers and policymakers.
△ Less
Submitted 29 April, 2019; v1 submitted 13 November, 2018;
originally announced November 2018.
