-
Every Breath You Don't Take: Deepfake Speech Detection Using Breath
Authors:
Seth Layton,
Thiago De Andrade,
Daniel Olszewski,
Kevin Warren,
Kevin Butler,
Patrick Traynor
Abstract:
Deepfake speech represents a real and growing threat to systems and society. Many detectors have been created to aid in defense against speech deepfakes. While these detectors implement myriad methodologies, many rely on low-level fragments of the speech generation process. We hypothesize that breath, a higher-level part of speech, is a key component of natural speech and thus improper generation…
▽ More
Deepfake speech represents a real and growing threat to systems and society. Many detectors have been created to aid in defense against speech deepfakes. While these detectors implement myriad methodologies, many rely on low-level fragments of the speech generation process. We hypothesize that breath, a higher-level part of speech, is a key component of natural speech and thus improper generation in deepfake speech is a performant discriminator. To evaluate this, we create a breath detector and leverage this against a custom dataset of online news article audio to discriminate between real/deepfake speech. Additionally, we make this custom dataset publicly available to facilitate comparison for future work. Applying our simple breath detector as a deepfake speech discriminator on in-the-wild samples allows for accurate classification (perfect 1.0 AUPRC and 0.0 EER on test data) across 33.6 hours of audio. We compare our model with the state-of-the-art SSL-wav2vec model and show that this complex deep learning model completely fails to classify the same in-the-wild samples (0.72 AUPRC and 0.99 EER).
△ Less
Submitted 26 April, 2024; v1 submitted 23 April, 2024;
originally announced April 2024.
-
Alignment-Free Coupling to Arrays of Diamond Microdisk Cavities for Scalable Spin-Photon Interfaces
Authors:
Helaman R. Flores,
Samuel R. Layton,
Dirk Englund,
Ryan M. Camacho
Abstract:
We propose a scalable design for a spin-photon interface to a color center in a diamond microdisk. The design consists of a silicon oxynitride hexagonal lattice overlaid on a diamond microdisk to enable vertical emission from the microdisk into low-numerical aperture modes, with quantum efficiencies as high as 45\% for a tin vacancy (SnV) center. Our design is robust to manufacturing errors, poten…
▽ More
We propose a scalable design for a spin-photon interface to a color center in a diamond microdisk. The design consists of a silicon oxynitride hexagonal lattice overlaid on a diamond microdisk to enable vertical emission from the microdisk into low-numerical aperture modes, with quantum efficiencies as high as 45\% for a tin vacancy (SnV) center. Our design is robust to manufacturing errors, potentially enabling large scale fabrication of quantum emitters coupled to optical collection modes. We also introduce a novel approach for optimizing the free space performance of a complex structure using a dipole model, achieving comparable results to full-wave finite difference time domain simulations with a 650,000 times reduction in computational time.
△ Less
Submitted 9 December, 2023;
originally announced December 2023.
-
Inexact Krylov iterations and relaxation strategies with fast-multipole boundary element method
Authors:
Tingyu Wang,
Simon K. Layton,
Lorena A. Barba
Abstract:
Boundary element methods produce dense linear systems that can be accelerated via multipole expansions. Solved with Krylov methods, this implies computing the matrix-vector products within each iteration with some error, at an accuracy controlled by the order of the expansion, $p$. We take advantage of a unique property of Krylov iterations that allow lower accuracy of the matrix-vector products a…
▽ More
Boundary element methods produce dense linear systems that can be accelerated via multipole expansions. Solved with Krylov methods, this implies computing the matrix-vector products within each iteration with some error, at an accuracy controlled by the order of the expansion, $p$. We take advantage of a unique property of Krylov iterations that allow lower accuracy of the matrix-vector products as convergence proceeds, and propose a relaxation strategy based on progressively decreasing $p$. In extensive numerical tests of the relaxed Krylov iterations, we obtained speed-ups of between $2.1\times$ and $3.3\times$ for Laplace problems and between $1.7\times$ and $4.0\times$ for Stokes problems. We include an application to Stokes flow around red blood cells, computing with up to 64 cells and problem size up to 131k boundary elements and nearly 400k unknowns. The study was done with an in-house multi-threaded C++ code, on a hexa-core CPU. The code is available on its version-control repository, \href{https://github.com/barbagroup/fmm-bem-relaxed}{https://github.com/barbagroup/fmm-bem-relaxed}.
△ Less
Submitted 1 October, 2016; v1 submitted 19 June, 2015;
originally announced June 2015.
-
cuIBM -- A GPU-accelerated Immersed Boundary Method
Authors:
Simon K Layton,
Anush Krishnan,
Lorena A. Barba
Abstract:
A projection-based immersed boundary method is dominated by sparse linear algebra routines. Using the open-source Cusp library, we observe a speedup (with respect to a single CPU core) which reflects the constraints of a bandwidth-dominated problem on the GPU. Nevertheless, GPUs offer the capacity to solve large problems on commodity hardware. This work includes validation and a convergence study…
▽ More
A projection-based immersed boundary method is dominated by sparse linear algebra routines. Using the open-source Cusp library, we observe a speedup (with respect to a single CPU core) which reflects the constraints of a bandwidth-dominated problem on the GPU. Nevertheless, GPUs offer the capacity to solve large problems on commodity hardware. This work includes validation and a convergence study of the GPU-accelerated IBM, and various optimizations.
△ Less
Submitted 8 April, 2016; v1 submitted 16 September, 2011;
originally announced September 2011.
-
How to obtain efficient GPU kernels: an illustration using FMM & FGT algorithms
Authors:
Felipe A. Cruz,
Simon K. Layton,
Lorena A. Barba
Abstract:
Computing on graphics processors is maybe one of the most important developments in computational science to happen in decades. Not since the arrival of the Beowulf cluster, which combined open source software with commodity hardware to truly democratize high-performance computing, has the community been so electrified. Like then, the opportunity comes with challenges. The formulation of scientifi…
▽ More
Computing on graphics processors is maybe one of the most important developments in computational science to happen in decades. Not since the arrival of the Beowulf cluster, which combined open source software with commodity hardware to truly democratize high-performance computing, has the community been so electrified. Like then, the opportunity comes with challenges. The formulation of scientific algorithms to take advantage of the performance offered by the new architecture requires rethinking core methods. Here, we have tackled fast summation algorithms (fast multipole method and fast Gauss transform), and applied algorithmic redesign for attaining performance on gpus. The progression of performance improvements attained illustrates the exercise of formulating algorithms for the massively parallel architecture of the gpu. The end result has been gpu kernels that run at over 500 Gigaflops on one nvidia Tesla C1060 card, thereby reaching close to practical peak. We can confidently say that gpu computing is not just a vogue, it is truly an irresistible trend in high-performance computing.
△ Less
Submitted 1 March, 2011; v1 submitted 17 September, 2010;
originally announced September 2010.
