The Effect of Model Compression on Fairness in Facial Expression Recognition
Authors:
Samuil Stoychev,
Hatice Gunes
Abstract:
Deep neural networks have proved hugely successful, achieving human-like performance on a variety of tasks. However, they are also computationally expensive, which has motivated the development of model compression techniques which reduce the resource consumption associated with deep learning models. Nevertheless, recent studies have suggested that model compression can have an adverse effect on a…
▽ More
Deep neural networks have proved hugely successful, achieving human-like performance on a variety of tasks. However, they are also computationally expensive, which has motivated the development of model compression techniques which reduce the resource consumption associated with deep learning models. Nevertheless, recent studies have suggested that model compression can have an adverse effect on algorithmic fairness, amplifying existing biases in machine learning models. With this project we aim to extend those studies to the context of facial expression recognition. To do that, we set up a neural network classifier to perform facial expression recognition and implement several model compression techniques on top of it. We then run experiments on two facial expression datasets, namely the Extended Cohn-Kanade Dataset (CK+DB) and the Real-World Affective Faces Database (RAF-DB), to examine the individual and combined effect that compression techniques have on the model size, accuracy and fairness. Our experimental results show that: (i) Compression and quantisation achieve significant reduction in model size with minimal impact on overall accuracy for both CK+DB and RAF-DB; (ii) in terms of model accuracy, the classifier trained and tested on RAF-DB seems more robust to compression compared to the CK+ DB; (iii) for RAF-DB, the different compression strategies do not seem to increase the gap in predictive performance across the sensitive attributes of gender, race and age which is in contrast with the results on the CK+DB, where compression seems to amplify existing biases for gender. We analyse the results and discuss the potential reasons for our findings.
△ Less
Submitted 5 January, 2022;
originally announced January 2022.
Exploring Interatomic Coulombic Decay by Free Electron Lasers
Authors:
Philipp V. Demekhin,
Spas D. Stoychev,
Alexander I. Kuleff,
Lorenz S. Cederbaum
Abstract:
To exploit the high intensity of laser radiation, we propose to select frequencies at which single-photon absorption is of too low energy and two or more photons are needed to produce states of an atom that can undergo interatomic Coulombic decay (ICD) with its neighbors. For Ne dimer it is explicitly demonstrated that the proposed scheme to investigate interatomic processes by multiphoton absorpt…
▽ More
To exploit the high intensity of laser radiation, we propose to select frequencies at which single-photon absorption is of too low energy and two or more photons are needed to produce states of an atom that can undergo interatomic Coulombic decay (ICD) with its neighbors. For Ne dimer it is explicitly demonstrated that the proposed scheme to investigate interatomic processes by multiphoton absorption is much more efficient than with single-photon absorption of sufficiently large frequency as used until now. Extensive calculations on Ne dimer including all the involved nuclear dynamics and the losses by ionization of the participating states show how the low-energy ICD electrons and Ne$^+$ pairs are produced for different laser intensities and pulse durations. At higher intensities the production of Ne$^+$ pairs by successive ionization of the two atoms becomes competitive and the respective emitted electrons interfere coherently with the ICD electrons. It is also demonstrated that a measurement after a time delay can be used to determine the contribution of ICD even at high laser intensity.
△ Less
Submitted 11 August, 2011; v1 submitted 5 June, 2011;
originally announced June 2011.
