-
Faster Than Lies: Real-time Deepfake Detection using Binary Neural Networks
Authors:
Lanzino Romeo,
Fontana Federico,
Diko Anxhelo,
Marini Marco Raoul,
Cinque Luigi
Abstract:
Deepfake detection aims to contrast the spread of deep-generated media that undermines trust in online content. While existing methods focus on large and complex models, the need for real-time detection demands greater efficiency. With this in mind, unlike previous work, we introduce a novel deepfake detection approach on images using Binary Neural Networks (BNNs) for fast inference with minimal a…
▽ More
Deepfake detection aims to contrast the spread of deep-generated media that undermines trust in online content. While existing methods focus on large and complex models, the need for real-time detection demands greater efficiency. With this in mind, unlike previous work, we introduce a novel deepfake detection approach on images using Binary Neural Networks (BNNs) for fast inference with minimal accuracy loss. Moreover, our method incorporates Fast Fourier Transform (FFT) and Local Binary Pattern (LBP) as additional channel features to uncover manipulation traces in frequency and texture domains. Evaluations on COCOFake, DFFD, and CIFAKE datasets demonstrate our method's state-of-the-art performance in most scenarios with a significant efficiency gain of up to a $20\times$ reduction in FLOPs during inference. Finally, by exploring BNNs in deepfake detection to balance accuracy and efficiency, this work paves the way for future research on efficient deepfake detection.
△ Less
Submitted 7 June, 2024;
originally announced June 2024.
-
A hybrid feature learning approach based on convolutional kernels for ATM fault prediction using event-log data
Authors:
Víctor Manuel Vargas,
Riccardo Rosati,
César Hervás-Martínez,
Adriano Mancini,
Luca Romeo,
Pedro Antonio Gutiérrez
Abstract:
Predictive Maintenance (PdM) methods aim to facilitate the scheduling of maintenance work before equipment failure. In this context, detecting early faults in automated teller machines (ATMs) has become increasingly important since these machines are susceptible to various types of unpredictable failures. ATMs track execution status by generating massive event-log data that collect system messages…
▽ More
Predictive Maintenance (PdM) methods aim to facilitate the scheduling of maintenance work before equipment failure. In this context, detecting early faults in automated teller machines (ATMs) has become increasingly important since these machines are susceptible to various types of unpredictable failures. ATMs track execution status by generating massive event-log data that collect system messages unrelated to the failure event. Predicting machine failure based on event logs poses additional challenges, mainly in extracting features that might represent sequences of events indicating impending failures. Accordingly, feature learning approaches are currently being used in PdM, where informative features are learned automatically from minimally processed sensor data. However, a gap remains to be seen on how these approaches can be exploited for deriving relevant features from event-log-based data. To fill this gap, we present a predictive model based on a convolutional kernel (MiniROCKET and HYDRA) to extract features from the original event-log data and a linear classifier to classify the sample based on the learned features. The proposed methodology is applied to a significant real-world collected dataset. Experimental results demonstrated how one of the proposed convolutional kernels (i.e. HYDRA) exhibited the best classification performance (accuracy of 0.759 and AUC of 0.693). In addition, statistical analysis revealed that the HYDRA and MiniROCKET models significantly overcome one of the established state-of-the-art approaches in time series classification (InceptionTime), and three non-temporal ML methods from the literature. The predictive model was integrated into a container-based decision support system to support operators in the timely maintenance of ATMs.
△ Less
Submitted 17 May, 2023;
originally announced May 2023.
-
A novel staggered semi-implicit space-time discontinuous Galerkin method for the incompressible Navier-Stokes equations
Authors:
Francesco Lohengrin Romeo,
Michael Dumbser,
Maurizio Tavelli
Abstract:
A new high order accurate staggered semi-implicit space-time discontinuous Galerkin (DG) method is presented for the simulation of viscous incompressible flows on unstructured triangular grids in two space dimensions. The staggered DG scheme defines the discrete pressure on the primal triangular mesh, while the discrete velocity is defined on a staggered edge-based dual quadrilateral mesh. In this…
▽ More
A new high order accurate staggered semi-implicit space-time discontinuous Galerkin (DG) method is presented for the simulation of viscous incompressible flows on unstructured triangular grids in two space dimensions. The staggered DG scheme defines the discrete pressure on the primal triangular mesh, while the discrete velocity is defined on a staggered edge-based dual quadrilateral mesh. In this paper, a new pair of equal-order-interpolation velocity-pressure finite elements is proposed. On the primary triangular mesh (the pressure elements) the basis functions are piecewise polynomials of degree $N$ and are allowed to jump on the boundaries of each triangle. On the dual mesh instead (the velocity elements), the basis functions consist in the union of piecewise polynomials of degree $N$ on the two subtriangles that compose each quadrilateral and are allowed to jump only on the dual element boundaries, while they are continuous inside. In other words, the basis functions on the dual mesh are built by continuous finite elements on the subtriangles. This choice allows the construction of an efficient, quadrature-free and memory saving algorithm. In our coupled space-time pressure correction formulation for the incompressible Navier-Stokes equations, arbitrary high order of accuracy in time is achieved through the use of time-dependent test and basis functions, in combination with simple and efficient Picard iterations. Several numerical tests on classical benchmarks confirm that the proposed method outperforms existing staggered semi-implicit space-time DG schemes, not only from a computer memory point of view, but also concerning the computational time.
△ Less
Submitted 15 March, 2020;
originally announced March 2020.
-
A semi-implicit high-order space-time scheme on staggered meshes for the 2D incompressible Navier-Stokes equations
Authors:
Francesco Lohengrin Romeo
Abstract:
A new high order accurate semi-implicit space-time Discontinuous Galerkin method on staggered grids, for the simulation of viscous incompressible flows on two-dimensional domains is presented. The designed scheme is of the Arbitrary Lagrangian Eulerian type, which is suitable to work on fixed as well as on moving meshes. In our space-time formulation, by expressing the numerical solution in terms…
▽ More
A new high order accurate semi-implicit space-time Discontinuous Galerkin method on staggered grids, for the simulation of viscous incompressible flows on two-dimensional domains is presented. The designed scheme is of the Arbitrary Lagrangian Eulerian type, which is suitable to work on fixed as well as on moving meshes. In our space-time formulation, by expressing the numerical solution in terms of piecewise space-time polynomials, an arbitrary high order of accuracy in time is achieved through a simple and efficient method of Picard iterations. For the dual mesh, the basis functions consist in the union of continuous piecewise polynomials on the two subtriangles within the quadrilaterals: this allows the construction of a quadrature-free scheme, resulting in a very efficient algorithm. Some numerical examples confirm that the proposed method outperforms existing ones.
△ Less
Submitted 15 March, 2020;
originally announced March 2020.
-
Using qualia information to identify lexical semantic classes in an unsupervised clustering task
Authors:
Lauren Romeo,
Sara Mendes,
Núria Bel
Abstract:
Acquiring lexical information is a complex problem, typically approached by relying on a number of contexts to contribute information for classification. One of the first issues to address in this domain is the determination of such contexts. The work presented here proposes the use of automatically obtained FORMAL role descriptors as features used to draw nouns from the same lexical semantic clas…
▽ More
Acquiring lexical information is a complex problem, typically approached by relying on a number of contexts to contribute information for classification. One of the first issues to address in this domain is the determination of such contexts. The work presented here proposes the use of automatically obtained FORMAL role descriptors as features used to draw nouns from the same lexical semantic class together in an unsupervised clustering task. We have dealt with three lexical semantic classes (HUMAN, LOCATION and EVENT) in English. The results obtained show that it is possible to discriminate between elements from different lexical semantic classes using only FORMAL role information, hence validating our initial hypothesis. Also, iterating our method accurately accounts for fine-grained distinctions within lexical classes, namely distinctions involving ambiguous expressions. Moreover, a filtering and bootstrap** strategy employed in extracting FORMAL role descriptors proved to minimize effects of sparse data and noise in our task.
△ Less
Submitted 11 March, 2013;
originally announced March 2013.
-
Automatic lexical semantic classification of nouns
Authors:
Núria Bel,
Lauren Romeo,
Muntsa Padró
Abstract:
The work we present here addresses cue-based noun classification in English and Spanish. Its main objective is to automatically acquire lexical semantic information by classifying nouns into previously known noun lexical classes. This is achieved by using particular aspects of linguistic contexts as cues that identify a specific lexical class. Here we concentrate on the task of identifying such cu…
▽ More
The work we present here addresses cue-based noun classification in English and Spanish. Its main objective is to automatically acquire lexical semantic information by classifying nouns into previously known noun lexical classes. This is achieved by using particular aspects of linguistic contexts as cues that identify a specific lexical class. Here we concentrate on the task of identifying such cues and the theoretical background that allows for an assessment of the complexity of the task. The results show that, despite of the a-priori complexity of the task, cue-based classification is a useful tool in the automatic acquisition of lexical semantic classes.
△ Less
Submitted 8 March, 2013;
originally announced March 2013.
