Use large language models to promote equity
Authors:
Emma Pierson,
Divya Shanmugam,
Rajiv Movva,
Jon Kleinberg,
Monica Agrawal,
Mark Dredze,
Kadija Ferryman,
Judy Wawira Gichoya,
Dan Jurafsky,
Pang Wei Koh,
Karen Levy,
Sendhil Mullainathan,
Ziad Obermeyer,
Harini Suresh,
Keyon Vafa
Abstract:
Advances in large language models (LLMs) have driven an explosion of interest about their societal impacts. Much of the discourse around how they will impact social equity has been cautionary or negative, focusing on questions like "how might LLMs be biased and how would we mitigate those biases?" This is a vital discussion: the ways in which AI generally, and LLMs specifically, can entrench biase…
▽ More
Advances in large language models (LLMs) have driven an explosion of interest about their societal impacts. Much of the discourse around how they will impact social equity has been cautionary or negative, focusing on questions like "how might LLMs be biased and how would we mitigate those biases?" This is a vital discussion: the ways in which AI generally, and LLMs specifically, can entrench biases have been well-documented. But equally vital, and much less discussed, is the more opportunity-focused counterpoint: "what promising applications do LLMs enable that could promote equity?" If LLMs are to enable a more equitable world, it is not enough just to play defense against their biases and failure modes. We must also go on offense, applying them positively to equity-enhancing use cases to increase opportunities for underserved groups and reduce societal discrimination. There are many choices which determine the impact of AI, and a fundamental choice very early in the pipeline is the problems we choose to apply it to. If we focus only later in the pipeline -- making LLMs marginally more fair as they facilitate use cases which intrinsically entrench power -- we will miss an important opportunity to guide them to equitable impacts. Here, we highlight the emerging potential of LLMs to promote equity by presenting four newly possible, promising research directions, while kee** risks and cautionary points in clear view.
△ Less
Submitted 22 December, 2023;
originally announced December 2023.
Ethical Machine Learning in Health Care
Authors:
Irene Y. Chen,
Emma Pierson,
Sherri Rose,
Shalmali Joshi,
Kadija Ferryman,
Marzyeh Ghassemi
Abstract:
The use of machine learning (ML) in health care raises numerous ethical concerns, especially as models can amplify existing health inequities. Here, we outline ethical considerations for equitable ML in the advancement of health care. Specifically, we frame ethics of ML in health care through the lens of social justice. We describe ongoing efforts and outline challenges in a proposed pipeline of e…
▽ More
The use of machine learning (ML) in health care raises numerous ethical concerns, especially as models can amplify existing health inequities. Here, we outline ethical considerations for equitable ML in the advancement of health care. Specifically, we frame ethics of ML in health care through the lens of social justice. We describe ongoing efforts and outline challenges in a proposed pipeline of ethical ML in health, ranging from problem selection to post-deployment considerations. We close by summarizing recommendations to address these challenges.
△ Less
Submitted 7 October, 2020; v1 submitted 22 September, 2020;
originally announced September 2020.
