-
Exploring Causes of Demographic Variations In Face Recognition Accuracy
Authors:
Gabriella Pangelinan,
K. S. Krishnapriya,
Vitor Albiero,
Grace Bezold,
Kai Zhang,
Kushal Vangara,
Michael C. King,
Kevin W. Bowyer
Abstract:
In recent years, media reports have called out bias and racism in face recognition technology. We review experimental results exploring several speculated causes for asymmetric cross-demographic performance. We consider accuracy differences as represented by variations in non-mated (impostor) and / or mated (genuine) distributions for 1-to-1 face matching. Possible causes explored include differen…
▽ More
In recent years, media reports have called out bias and racism in face recognition technology. We review experimental results exploring several speculated causes for asymmetric cross-demographic performance. We consider accuracy differences as represented by variations in non-mated (impostor) and / or mated (genuine) distributions for 1-to-1 face matching. Possible causes explored include differences in skin tone, face size and shape, imbalance in number of identities and images in the training data, and amount of face visible in the test data ("face pixels"). We find that demographic differences in face pixel information of the test images appear to most directly impact the resultant differences in face recognition accuracy.
△ Less
Submitted 14 April, 2023;
originally announced April 2023.
-
Heterogeneous Singlet Fission in a Covalently Linked Pentacene Dimer
Authors:
Woojae Kim,
Naitik A. Panjwani,
K. C. Krishnapriya,
Kanad Majumder,
Jyotishman Dasgupta,
Robert Bittl,
Satish Patil,
Andrew J. Musser
Abstract:
Molecular dimers are widely utilized as a tool to investigate the structure-property relationships behind the complex photophysical processes of condensed-phase systems, where structural tuning remains a challenge. This approach often implicitly treats the dimers as static, with their relevant state energies and couplings determined by their optimized geometry. Here, we consider the shortcomings o…
▽ More
Molecular dimers are widely utilized as a tool to investigate the structure-property relationships behind the complex photophysical processes of condensed-phase systems, where structural tuning remains a challenge. This approach often implicitly treats the dimers as static, with their relevant state energies and couplings determined by their optimized geometry. Here, we consider the shortcomings of this approach: dimers are more accurately treated as dynamic model systems, with the potential for significant conformational heterogeneity that evolves in time and is intimately connected with interchromophore coupling strengths. We highlight this concept in the singlet fission dynamics of a pentacene dimer that is covalently linked through phenyl-diketopyrrolopyrrole and acetylene bridges. Unrestricted rotations lead to a vast array of rotational conformers in the ground state. Consequently, we find that every step in the cascade of singlet fission processes - triplet-pair formation from S1, triplet-pair recombination, spin evolution within the pair, and free triplet formation - is qualitatively and quantitatively altered by the conformer geometry. At room temperature, we find evidence of dynamic interconversion between conformers on the multiple TT surfaces. Measurements in frozen solution at 150 K emphasize the significance of static disorder. Our data reveals the presence of sub-populations that result in excitation-dependent electron spin polarization. These phenomena demand consideration of multidimensional potential energy surfaces that define multiple sub-ensembles in the excited state, a picture we refer to as heterogeneous singlet fission. More broadly, our results call into question the general static approach to molecular dimer photophysics, that each step in consecutive excited-state relaxation pathways can be delineated with a single, unique rate constant and yield.
△ Less
Submitted 11 April, 2023;
originally announced April 2023.
-
Face Recognition Accuracy Across Demographics: Shining a Light Into the Problem
Authors:
Haiyu Wu,
Vítor Albiero,
K. S. Krishnapriya,
Michael C. King,
Kevin W. Bowyer
Abstract:
We explore varying face recognition accuracy across demographic groups as a phenomenon partly caused by differences in face illumination. We observe that for a common operational scenario with controlled image acquisition, there is a large difference in face region brightness between African-American and Caucasian, and also a smaller difference between male and female. We show that impostor image…
▽ More
We explore varying face recognition accuracy across demographic groups as a phenomenon partly caused by differences in face illumination. We observe that for a common operational scenario with controlled image acquisition, there is a large difference in face region brightness between African-American and Caucasian, and also a smaller difference between male and female. We show that impostor image pairs with both faces under-exposed, or both overexposed, have an increased false match rate (FMR). Conversely, image pairs with strongly different face brightness have a decreased similarity measure. We propose a brightness information metric to measure variation in brightness in the face and show that face brightness that is too low or too high has reduced information in the face region, providing a cause for the lower accuracy. Based on this, for operational scenarios with controlled image acquisition, illumination should be adjusted for each individual to obtain appropriate face image brightness. This is the first work that we are aware of to explore how the level of brightness of the skin region in a pair of face images (rather than a single image) impacts face recognition accuracy, and to evaluate this as a systematic factor causing unequal accuracy across demographics. The code is at https://github.com/HaiyuWu/FaceBrightness.
△ Less
Submitted 16 April, 2023; v1 submitted 3 June, 2022;
originally announced June 2022.
-
Analysis of Manual and Automated Skin Tone Assignments for Face Recognition Applications
Authors:
KS Krishnapriya,
Michael C. King,
Kevin W. Bowyer
Abstract:
News reports have suggested that darker skin tone causes an increase in face recognition errors. The Fitzpatrick scale is widely used in dermatology to classify sensitivity to sun exposure and skin tone. In this paper, we analyze a set of manual Fitzpatrick skin type assignments and also employ the individual typology angle to automatically estimate the skin tone from face images. The set of manua…
▽ More
News reports have suggested that darker skin tone causes an increase in face recognition errors. The Fitzpatrick scale is widely used in dermatology to classify sensitivity to sun exposure and skin tone. In this paper, we analyze a set of manual Fitzpatrick skin type assignments and also employ the individual typology angle to automatically estimate the skin tone from face images. The set of manual skin tone rating experiments shows that there are inconsistencies between human raters that are difficult to eliminate. Efforts to automate skin tone rating suggest that it is particularly challenging on images collected without a calibration object in the scene. However, after the color-correction, the level of agreement between automated and manual approaches is found to be 96% or better for the MORPH images. To our knowledge, this is the first work to: (a) examine the consistency of manual skin tone ratings across observers, (b) document that there is substantial variation in the rating of the same image by different observers even when exemplar images are given for guidance and all images are color-corrected, and (c) compare manual versus automated skin tone ratings.
△ Less
Submitted 29 April, 2021;
originally announced April 2021.
-
Characterizing the Variability in Face Recognition Accuracy Relative to Race
Authors:
KS Krishnapriya,
Kushal Vangara,
Michael C. King,
Vitor Albiero,
Kevin Bowyer
Abstract:
Many recent news headlines have labeled face recognition technology as biased or racist. We report on a methodical investigation into differences in face recognition accuracy between African-American and Caucasian image cohorts of the MORPH dataset. We find that, for all four matchers considered, the impostor and the genuine distributions are statistically significantly different between cohorts.…
▽ More
Many recent news headlines have labeled face recognition technology as biased or racist. We report on a methodical investigation into differences in face recognition accuracy between African-American and Caucasian image cohorts of the MORPH dataset. We find that, for all four matchers considered, the impostor and the genuine distributions are statistically significantly different between cohorts. For a fixed decision threshold, the African-American image cohort has a higher false match rate and a lower false non-match rate. ROC curves compare verification rates at the same false match rate, but the different cohorts achieve the same false match rate at different thresholds. This means that ROC comparisons are not relevant to operational scenarios that use a fixed decision threshold. We show that, for the ResNet matcher, the two cohorts have approximately equal separation of impostor and genuine distributions. Using ICAO compliance as a standard of image quality, we find that the initial image cohorts have unequal rates of good quality images. The ICAO-compliant subsets of the original image cohorts show improved accuracy, with the main effect being to reducing the low-similarity tail of the genuine distributions.
△ Less
Submitted 8 May, 2019; v1 submitted 15 April, 2019;
originally announced April 2019.
