-
Deepfake Sentry: Harnessing Ensemble Intelligence for Resilient Detection and Generalisation
Authors:
Liviu-Daniel Ştefan,
Dan-Cristian Stanciu,
Mihai Dogariu,
Mihai Gabriel Constantin,
Andrei Cosmin Jitaru,
Bogdan Ionescu
Abstract:
Recent advancements in Generative Adversarial Networks (GANs) have enabled photorealistic image generation with high quality. However, the malicious use of such generated media has raised concerns regarding visual misinformation. Although deepfake detection research has demonstrated high accuracy, it is vulnerable to advances in generation techniques and adversarial iterations on detection counter…
▽ More
Recent advancements in Generative Adversarial Networks (GANs) have enabled photorealistic image generation with high quality. However, the malicious use of such generated media has raised concerns regarding visual misinformation. Although deepfake detection research has demonstrated high accuracy, it is vulnerable to advances in generation techniques and adversarial iterations on detection countermeasures. To address this, we propose a proactive and sustainable deepfake training augmentation solution that introduces artificial fingerprints into models. We achieve this by employing an ensemble learning approach that incorporates a pool of autoencoders that mimic the effect of the artefacts introduced by the deepfake generator models. Experiments on three datasets reveal that our proposed ensemble autoencoder-based data augmentation learning approach offers improvements in terms of generalisation, resistance against basic data perturbations such as noise, blurring, sharpness enhancement, and affine transforms, resilience to commonly used lossy compression algorithms such as JPEG, and enhanced resistance against adversarial attacks.
△ Less
Submitted 29 March, 2024;
originally announced April 2024.
-
Proposal for a distributed, community-driven academic publishing system
Authors:
Matteo Barbone,
Mustafa Gündoğan,
Dhiren M. Kara,
Benjamin **ault,
Alejandro Rodriguez-Pardo Montblanch,
Lucio Stefan,
Anthony K. C. Tan
Abstract:
We propose an academic publishing system where research papers are stored in a network of data centres owned by university libraries and research institutions, and are interfaced with the academic community through a website. In our system, the editor is replaced by an initial adjusted community-wide evaluation, the standard peer-review is accompanied by a post-publication open-ended and community…
▽ More
We propose an academic publishing system where research papers are stored in a network of data centres owned by university libraries and research institutions, and are interfaced with the academic community through a website. In our system, the editor is replaced by an initial adjusted community-wide evaluation, the standard peer-review is accompanied by a post-publication open-ended and community-wide review process, aiming at a more objective and longer-term evaluation, the publishing costs are reduced to the running costs of the servers, and access is fully open. Our proposal addresses the fundamental problems of the current system: it reduces publishing costs, allowing easier access by less well-funded institutions (especially from develo** countries); it makes the editorial evaluation distributed and more transparent; it speeds up the peer review process by eliminating the need for multiple resubmissions; and it introduces a long-term, community-wide evaluation of papers, ensuring their continued relevance and accuracy; while maximising its main goals, i.e. ensuring the highest quality of peer review and giving the best referees, the most visibility and the most credit to the best papers. Our scheme is time-efficient, financially sustainable, ethically fair and represents a significant improvement over the current system.
△ Less
Submitted 23 April, 2023;
originally announced April 2023.
-
Face Verification with Challenging Imposters and Diversified Demographics
Authors:
Adrian Popescu,
Liviu-Daniel Ştefan,
Jérôme Deshayes-Chossart,
Bogdan Ionescu
Abstract:
Face verification aims to distinguish between genuine and imposter pairs of faces, which include the same or different identities, respectively. The performance reported in recent years gives the impression that the task is practically solved. Here, we revisit the problem and argue that existing evaluation datasets were built using two oversimplifying design choices. First, the usual identity sele…
▽ More
Face verification aims to distinguish between genuine and imposter pairs of faces, which include the same or different identities, respectively. The performance reported in recent years gives the impression that the task is practically solved. Here, we revisit the problem and argue that existing evaluation datasets were built using two oversimplifying design choices. First, the usual identity selection to form imposter pairs is not challenging enough because, in practice, verification is needed to detect challenging imposters. Second, the underlying demographics of existing datasets are often insufficient to account for the wide diversity of facial characteristics of people from across the world. To mitigate these limitations, we introduce the $FaVCI2D$ dataset. Imposter pairs are challenging because they include visually similar faces selected from a large pool of demographically diversified identities. The dataset also includes metadata related to gender, country and age to facilitate fine-grained analysis of results. $FaVCI2D$ is generated from freely distributable resources. Experiments with state-of-the-art deep models that provide nearly 100\% performance on existing datasets show a significant performance drop for $FaVCI2D$, confirming our starting hypothesis. Equally important, we analyze legal and ethical challenges which appeared in recent years and hindered the development of face analysis research. We introduce a series of design choices which address these challenges and make the dataset constitution and usage more sustainable and fairer. $FaVCI2D$ is available at~\url{https://github.com/AIMultimediaLab/FaVCI2D-Face-Verification-with-Challenging-Imposters-and-Diversified-Demographics}.
△ Less
Submitted 16 October, 2021;
originally announced October 2021.
-
The generating of Fractal Images Using MathCAD Program
Authors:
Laura Stefan
Abstract:
This paper presents the graphic representation in the z-plane of the first three iterations of the algorithm that generates the Sierpinski Gasket. It analyzes the influence of the f(z) map when we represent fractal images.
This paper presents the graphic representation in the z-plane of the first three iterations of the algorithm that generates the Sierpinski Gasket. It analyzes the influence of the f(z) map when we represent fractal images.
△ Less
Submitted 24 March, 2009;
originally announced March 2009.
