Studying Bias in GANs through the Lens of Race
Authors:
Vongani H. Maluleke,
Neerja Thakkar,
Tim Brooks,
Ethan Weber,
Trevor Darrell,
Alexei A. Efros,
Angjoo Kanazawa,
Devin Guillory
Abstract:
In this work, we study how the performance and evaluation of generative image models are impacted by the racial composition of their training datasets. By examining and controlling the racial distributions in various training datasets, we are able to observe the impacts of different training distributions on generated image quality and the racial distributions of the generated images. Our results…
▽ More
In this work, we study how the performance and evaluation of generative image models are impacted by the racial composition of their training datasets. By examining and controlling the racial distributions in various training datasets, we are able to observe the impacts of different training distributions on generated image quality and the racial distributions of the generated images. Our results show that the racial compositions of generated images successfully preserve that of the training data. However, we observe that truncation, a technique used to generate higher quality images during inference, exacerbates racial imbalances in the data. Lastly, when examining the relationship between image quality and race, we find that the highest perceived visual quality images of a given race come from a distribution where that race is well-represented, and that annotators consistently prefer generated images of white people over those of Black people.
△ Less
Submitted 14 September, 2022; v1 submitted 6 September, 2022;
originally announced September 2022.
