Fairness On The Ground: Applying Algorithmic Fairness Approaches to Production Systems
Authors:
Chloé Bakalar,
Renata Barreto,
Stevie Bergman,
Miranda Bogen,
Bobbie Chern,
Sam Corbett-Davies,
Melissa Hall,
Isabel Kloumann,
Michelle Lam,
Joaquin Quiñonero Candela,
Manish Raghavan,
Joshua Simons,
Jonathan Tannen,
Edmund Tong,
Kate Vredenburgh,
Jie**g Zhao
Abstract:
Many technical approaches have been proposed for ensuring that decisions made by machine learning systems are fair, but few of these proposals have been stress-tested in real-world systems. This paper presents an example of one team's approach to the challenge of applying algorithmic fairness approaches to complex production systems within the context of a large technology company. We discuss how…
▽ More
Many technical approaches have been proposed for ensuring that decisions made by machine learning systems are fair, but few of these proposals have been stress-tested in real-world systems. This paper presents an example of one team's approach to the challenge of applying algorithmic fairness approaches to complex production systems within the context of a large technology company. We discuss how we disentangle normative questions of product and policy design (like, "how should the system trade off between different stakeholders' interests and needs?") from empirical questions of system implementation (like, "is the system achieving the desired tradeoff in practice?"). We also present an approach for answering questions of the latter sort, which allows us to measure how machine learning systems and human labelers are making these tradeoffs across different relevant groups. We hope our experience integrating fairness tools and approaches into large-scale and complex production systems will be useful to other practitioners facing similar challenges, and illuminating to academics and researchers looking to better address the needs of practitioners.
△ Less
Submitted 24 March, 2021; v1 submitted 10 March, 2021;
originally announced March 2021.
Embedded EthiCS: Integrating Ethics Broadly Across Computer Science Education
Authors:
Barbara J. Grosz,
David Gray Grant,
Kate Vredenburgh,
Jeff Behrends,
Lily Hu,
Alison Simmons,
Jim Waldo
Abstract:
Computing technologies have become pervasive in daily life, sometimes bringing unintended but harmful consequences. For students to learn to think not only about what technology they could create, but also about what technology they should create, computer science curricula must expand to include ethical reasoning about the societal value and impact of these technologies. This paper presents Embed…
▽ More
Computing technologies have become pervasive in daily life, sometimes bringing unintended but harmful consequences. For students to learn to think not only about what technology they could create, but also about what technology they should create, computer science curricula must expand to include ethical reasoning about the societal value and impact of these technologies. This paper presents Embedded EthiCS, a novel approach to integrating ethics into computer science education that incorporates ethical reasoning throughout courses in the standard computer science curriculum. It thus changes existing courses rather than requiring wholly new courses. The paper describes a pilot Embedded EthiCS program that embeds philosophers teaching ethical reasoning directly into computer science courses. It discusses lessons learned and challenges to implementing such a program across different types of academic institutions.
△ Less
Submitted 16 August, 2018;
originally announced August 2018.
