-
SUPER: Selfie Undistortion and Head Pose Editing with Identity Preservation
Authors:
Polina Karpikova,
Andrei Spiridonov,
Anna Vorontsova,
Anastasia Yaschenko,
Ekaterina Radionova,
Igor Medvedev,
Alexander Limonov
Abstract:
Self-portraits captured from a short distance might look unnatural or even unattractive due to heavy distortions making facial features malformed, and ill-placed head poses. In this paper, we propose SUPER, a novel method of eliminating distortions and adjusting head pose in a close-up face crop. We perform 3D GAN inversion for a facial image by optimizing camera parameters and face latent code, w…
▽ More
Self-portraits captured from a short distance might look unnatural or even unattractive due to heavy distortions making facial features malformed, and ill-placed head poses. In this paper, we propose SUPER, a novel method of eliminating distortions and adjusting head pose in a close-up face crop. We perform 3D GAN inversion for a facial image by optimizing camera parameters and face latent code, which gives a generated image. Besides, we estimate depth from the obtained latent code, create a depth-induced 3D mesh, and render it with updated camera parameters to obtain a warped portrait. Finally, we apply the visibility-based blending so that visible regions are reprojected, and occluded parts are restored with a generative model. Experiments on face undistortion benchmarks and on our self-collected Head Rotation dataset (HeRo), show that SUPER outperforms previous approaches both qualitatively and quantitatively, opening new possibilities for photorealistic selfie editing.
△ Less
Submitted 18 June, 2024;
originally announced June 2024.
-
Quadruplet Loss For Improving the Robustness to Face Morphing Attacks
Authors:
Iurii Medvedev,
Nuno Gonçalves
Abstract:
Recent advancements in deep learning have revolutionized technology and security measures, necessitating robust identification methods. Biometric approaches, leveraging personalized characteristics, offer a promising solution. However, Face Recognition Systems are vulnerable to sophisticated attacks, notably face morphing techniques, enabling the creation of fraudulent documents. In this study, we…
▽ More
Recent advancements in deep learning have revolutionized technology and security measures, necessitating robust identification methods. Biometric approaches, leveraging personalized characteristics, offer a promising solution. However, Face Recognition Systems are vulnerable to sophisticated attacks, notably face morphing techniques, enabling the creation of fraudulent documents. In this study, we introduce a novel quadruplet loss function for increasing the robustness of face recognition systems against morphing attacks. Our approach involves specific sampling of face image quadruplets, combined with face morphs, for network training. Experimental results demonstrate the efficiency of our strategy in improving the robustness of face recognition networks against morphing attacks.
△ Less
Submitted 22 February, 2024;
originally announced February 2024.
-
Fused Classification For Differential Face Morphing Detection
Authors:
Iurii Medvedev,
Joana Pimenta,
Nuno Gonçalves
Abstract:
Face morphing, a sophisticated presentation attack technique, poses significant security risks to face recognition systems. Traditional methods struggle to detect morphing attacks, which involve blending multiple face images to create a synthetic image that can match different individuals. In this paper, we focus on the differential detection of face morphing and propose an extended approach based…
▽ More
Face morphing, a sophisticated presentation attack technique, poses significant security risks to face recognition systems. Traditional methods struggle to detect morphing attacks, which involve blending multiple face images to create a synthetic image that can match different individuals. In this paper, we focus on the differential detection of face morphing and propose an extended approach based on fused classification method for no-reference scenario. We introduce a public face morphing detection benchmark for the differential scenario and utilize a specific data mining technique to enhance the performance of our approach. Experimental results demonstrate the effectiveness of our method in detecting morphing attacks.
△ Less
Submitted 1 September, 2023;
originally announced September 2023.
-
Impact of Image Context for Single Deep Learning Face Morphing Attack Detection
Authors:
Joana Pimenta,
Iurii Medvedev,
Nuno Gonçalves
Abstract:
The increase in security concerns due to technological advancements has led to the popularity of biometric approaches that utilize physiological or behavioral characteristics for enhanced recognition. Face recognition systems (FRSs) have become prevalent, but they are still vulnerable to image manipulation techniques such as face morphing attacks. This study investigates the impact of the alignmen…
▽ More
The increase in security concerns due to technological advancements has led to the popularity of biometric approaches that utilize physiological or behavioral characteristics for enhanced recognition. Face recognition systems (FRSs) have become prevalent, but they are still vulnerable to image manipulation techniques such as face morphing attacks. This study investigates the impact of the alignment settings of input images on deep learning face morphing detection performance. We analyze the interconnections between the face contour and image context and suggest optimal alignment conditions for face morphing detection.
△ Less
Submitted 1 September, 2023;
originally announced September 2023.
-
Neural Implicit Morphing of Face Images
Authors:
Guilherme Schardong,
Tiago Novello,
Hallison Paz,
Iurii Medvedev,
Vinícius da Silva,
Luiz Velho,
Nuno Gonçalves
Abstract:
Face morphing is a problem in computer graphics with numerous artistic and forensic applications. It is challenging due to variations in pose, lighting, gender, and ethnicity. This task consists of a war** for feature alignment and a blending for a seamless transition between the warped images. We propose to leverage coord-based neural networks to represent such war**s and blendings of face im…
▽ More
Face morphing is a problem in computer graphics with numerous artistic and forensic applications. It is challenging due to variations in pose, lighting, gender, and ethnicity. This task consists of a war** for feature alignment and a blending for a seamless transition between the warped images. We propose to leverage coord-based neural networks to represent such war**s and blendings of face images. During training, we exploit the smoothness and flexibility of such networks by combining energy functionals employed in classical approaches without discretizations. Additionally, our method is time-dependent, allowing a continuous war**/blending of the images. During morphing inference, we need both direct and inverse transformations of the time-dependent war**. The first (second) is responsible for war** the target (source) image into the source (target) image. Our neural war** stores those maps in a single network dismissing the need for inverting them. The results of our experiments indicate that our method is competitive with both classical and generative models under the lens of image quality and face-morphing detectors. Aesthetically, the resulting images present a seamless blending of diverse faces not yet usual in the literature.
△ Less
Submitted 13 June, 2024; v1 submitted 26 August, 2023;
originally announced August 2023.
-
EFaR 2023: Efficient Face Recognition Competition
Authors:
Jan Niklas Kolf,
Fadi Boutros,
Jurek Elliesen,
Markus Theuerkauf,
Naser Damer,
Mohamad Alansari,
Oussama Abdul Hay,
Sara Alansari,
Sajid Javed,
Naoufel Werghi,
Klemen Grm,
Vitomir Štruc,
Fernando Alonso-Fernandez,
Kevin Hernandez Diaz,
Josef Bigun,
Anjith George,
Christophe Ecabert,
Hatef Otroshi Shahreza,
Ketan Kotwal,
Sébastien Marcel,
Iurii Medvedev,
Bo **,
Diogo Nunes,
Ahmad Hassanpour,
Pankaj Khatiwada
, et al. (2 additional authors not shown)
Abstract:
This paper presents the summary of the Efficient Face Recognition Competition (EFaR) held at the 2023 International Joint Conference on Biometrics (IJCB 2023). The competition received 17 submissions from 6 different teams. To drive further development of efficient face recognition models, the submitted solutions are ranked based on a weighted score of the achieved verification accuracies on a div…
▽ More
This paper presents the summary of the Efficient Face Recognition Competition (EFaR) held at the 2023 International Joint Conference on Biometrics (IJCB 2023). The competition received 17 submissions from 6 different teams. To drive further development of efficient face recognition models, the submitted solutions are ranked based on a weighted score of the achieved verification accuracies on a diverse set of benchmarks, as well as the deployability given by the number of floating-point operations and model size. The evaluation of submissions is extended to bias, cross-quality, and large-scale recognition benchmarks. Overall, the paper gives an overview of the achieved performance values of the submitted solutions as well as a diverse set of baselines. The submitted solutions use small, efficient network architectures to reduce the computational cost, some solutions apply model quantization. An outlook on possible techniques that are underrepresented in current solutions is given as well.
△ Less
Submitted 8 August, 2023;
originally announced August 2023.
-
Neural Haircut: Prior-Guided Strand-Based Hair Reconstruction
Authors:
Vanessa Sklyarova,
Jenya Chelishev,
Andreea Dogaru,
Igor Medvedev,
Victor Lempitsky,
Egor Zakharov
Abstract:
Generating realistic human 3D reconstructions using image or video data is essential for various communication and entertainment applications. While existing methods achieved impressive results for body and facial regions, realistic hair modeling still remains challenging due to its high mechanical complexity. This work proposes an approach capable of accurate hair geometry reconstruction at a str…
▽ More
Generating realistic human 3D reconstructions using image or video data is essential for various communication and entertainment applications. While existing methods achieved impressive results for body and facial regions, realistic hair modeling still remains challenging due to its high mechanical complexity. This work proposes an approach capable of accurate hair geometry reconstruction at a strand level from a monocular video or multi-view images captured in uncontrolled lighting conditions. Our method has two stages, with the first stage performing joint reconstruction of coarse hair and bust shapes and hair orientation using implicit volumetric representations. The second stage then estimates a strand-level hair reconstruction by reconciling in a single optimization process the coarse volumetric constraints with hair strand and hairstyle priors learned from the synthetic data. To further increase the reconstruction fidelity, we incorporate image-based losses into the fitting process using a new differentiable renderer. The combined system, named Neural Haircut, achieves high realism and personalization of the reconstructed hairstyles.
△ Less
Submitted 12 June, 2023; v1 submitted 9 June, 2023;
originally announced June 2023.
-
Young Labeled Faces in the Wild (YLFW): A Dataset for Children Faces Recognition
Authors:
Iurii Medvedev,
Farhad Shadmand,
Nuno Gonçalves
Abstract:
Face recognition has achieved outstanding performance in the last decade with the development of deep learning techniques.
Nowadays, the challenges in face recognition are related to specific scenarios, for instance, the performance under diverse image quality, the robustness for aging and edge cases of person age (children and elders), distinguishing of related identities.
In this set of prob…
▽ More
Face recognition has achieved outstanding performance in the last decade with the development of deep learning techniques.
Nowadays, the challenges in face recognition are related to specific scenarios, for instance, the performance under diverse image quality, the robustness for aging and edge cases of person age (children and elders), distinguishing of related identities.
In this set of problems, recognizing children's faces is one of the most sensitive and important. One of the reasons for this problem is the existing bias towards adults in existing face datasets.
In this work, we present a benchmark dataset for children's face recognition, which is compiled similarly to the famous face recognition benchmarks LFW, CALFW, CPLFW, XQLFW and AgeDB.
We also present a development dataset (separated into train and test parts) for adapting face recognition models for face images of children.
The proposed data is balanced for African, Asian, Caucasian, and Indian races. To the best of our knowledge, this is the first standartized data tool set for benchmarking and the largest collection for development for children's face recognition. Several face recognition experiments are presented to demonstrate the performance of the proposed data tool set.
△ Less
Submitted 13 January, 2023;
originally announced January 2023.
-
MorDeephy: Face Morphing Detection Via Fused Classification
Authors:
Iurii Medvedev,
Farhad Shadmand,
Nuno Gonçalves
Abstract:
Face morphing attack detection (MAD) is one of the most challenging tasks in the field of face recognition nowadays. In this work, we introduce a novel deep learning strategy for a single image face morphing detection, which implies the discrimination of morphed face images along with a sophisticated face recognition task in a complex classification scheme. It is directed onto learning the deep fa…
▽ More
Face morphing attack detection (MAD) is one of the most challenging tasks in the field of face recognition nowadays. In this work, we introduce a novel deep learning strategy for a single image face morphing detection, which implies the discrimination of morphed face images along with a sophisticated face recognition task in a complex classification scheme. It is directed onto learning the deep facial features, which carry information about the authenticity of these features. Our work also introduces several additional contributions: the public and easy-to-use face morphing detection benchmark and the results of our wild datasets filtering strategy. Our method, which we call MorDeephy, achieved the state of the art performance and demonstrated a prominent ability for generalising the task of morphing detection to unseen scenarios.
△ Less
Submitted 5 August, 2022;
originally announced August 2022.
