-
DocXplain: A Novel Model-Agnostic Explainability Method for Document Image Classification
Authors:
Saifullah Saifullah,
Stefan Agne,
Andreas Dengel,
Sheraz Ahmed
Abstract:
Deep learning (DL) has revolutionized the field of document image analysis, showcasing superhuman performance across a diverse set of tasks. However, the inherent black-box nature of deep learning models still presents a significant challenge to their safe and robust deployment in industry. Regrettably, while a plethora of research has been dedicated in recent years to the development of DL-powere…
▽ More
Deep learning (DL) has revolutionized the field of document image analysis, showcasing superhuman performance across a diverse set of tasks. However, the inherent black-box nature of deep learning models still presents a significant challenge to their safe and robust deployment in industry. Regrettably, while a plethora of research has been dedicated in recent years to the development of DL-powered document analysis systems, research addressing their transparency aspects has been relatively scarce. In this paper, we aim to bridge this research gap by introducing DocXplain, a novel model-agnostic explainability method specifically designed for generating high interpretability feature attribution maps for the task of document image classification. In particular, our approach involves independently segmenting the foreground and background features of the documents into different document elements and then ablating these elements to assign feature importance. We extensively evaluate our proposed approach in the context of document image classification, utilizing 4 different evaluation metrics, 2 widely recognized document benchmark datasets, and 10 state-of-the-art document image classification models. By conducting a thorough quantitative and qualitative analysis against 9 existing state-of-the-art attribution methods, we demonstrate the superiority of our approach in terms of both faithfulness and interpretability. To the best of the authors' knowledge, this work presents the first model-agnostic attribution-based explainability method specifically tailored for document images. We anticipate that our work will significantly contribute to advancing research on transparency, fairness, and robustness of document image classification models.
△ Less
Submitted 4 July, 2024;
originally announced July 2024.
-
PrIeD-KIE: Towards Privacy Preserved Document Key Information Extraction
Authors:
Saifullah Saifullah,
Stefan Agne,
Andreas Dengel,
Sheraz Ahmed
Abstract:
In this paper, we introduce strategies for develo** private Key Information Extraction (KIE) systems by leveraging large pretrained document foundation models in conjunction with differential privacy (DP), federated learning (FL), and Differentially Private Federated Learning (DP-FL). Through extensive experimentation on six benchmark datasets (FUNSD, CORD, SROIE, WildReceipts, XFUND, and DOCILE…
▽ More
In this paper, we introduce strategies for develo** private Key Information Extraction (KIE) systems by leveraging large pretrained document foundation models in conjunction with differential privacy (DP), federated learning (FL), and Differentially Private Federated Learning (DP-FL). Through extensive experimentation on six benchmark datasets (FUNSD, CORD, SROIE, WildReceipts, XFUND, and DOCILE), we demonstrate that large document foundation models can be effectively fine-tuned for the KIE task under private settings to achieve adequate performance while maintaining strong privacy guarantees. Moreover, by thoroughly analyzing the impact of various training and model parameters on model performance, we propose simple yet effective guidelines for achieving an optimal privacy-utility trade-off for the KIE task under global DP. Finally, we introduce FeAm-DP, a novel DP-FL algorithm that enables efficiently upscaling global DP from a standalone context to a multi-client federated environment. We conduct a comprehensive evaluation of the algorithm across various client and privacy settings, and demonstrate its capability to achieve comparable performance and privacy guarantees to standalone DP, even when accommodating an increasing number of participating clients. Overall, our study offers valuable insights into the development of private KIE systems, and highlights the potential of document foundation models for privacy-preserved Document AI applications. To the best of authors' knowledge, this is the first work that explores privacy preserved document KIE using document foundation models.
△ Less
Submitted 5 October, 2023;
originally announced October 2023.
-
Repeated radiation damage and thermal annealing of avalanche photodiodes
Authors:
Ian DSouza,
Jean-Philippe Bourgoin,
Brendon L. Higgins,
** Gyu Lim,
Ramy Tannous,
Sascha Agne,
Brian Moffat,
Vadim Makarov,
Thomas Jennewein
Abstract:
Avalanche photodiodes (APDs) are well-suited for single-photon detection on quantum communication satellites as they are a mature technology with high detection efficiency without requiring cryogenic cooling. They are, however, prone to significantly increased thermal noise caused by in-orbit radiation damage. Previous work demonstrated that a one-time application of thermal annealing reduces radi…
▽ More
Avalanche photodiodes (APDs) are well-suited for single-photon detection on quantum communication satellites as they are a mature technology with high detection efficiency without requiring cryogenic cooling. They are, however, prone to significantly increased thermal noise caused by in-orbit radiation damage. Previous work demonstrated that a one-time application of thermal annealing reduces radiation-damage-induced APD thermal noise. Here we examine the effect of cyclical proton irradiation and thermal annealing. We use an accelerated testing environment which emulates a realistic two-year operating profile of a satellite in low-Earth-orbit. We show that repeated thermal annealing is effective at maintaining thermal noise of silicon APDs within a range suitable for quantum key distribution throughout the nominal mission life, and beyond. We examine two strategies -- annealing at a fixed period of time, and annealing only when the thermal noise exceeds a pre-defined limit. We find both strategies exhibit similar thermal noise at end-of-life, with a slight overall advantage to annealing conditionally. We also observe that afterpulsing probability of the detector increases with cumulative proton irradiation. This knowledge helps guide design and tasking decisions for future space-borne quantum communication applications.
△ Less
Submitted 20 May, 2021; v1 submitted 9 July, 2020;
originally announced July 2020.
-
Overcoming detection loss and noise in squeezing-based optical sensing
Authors:
Gaetano Frascella,
Sascha Agne,
Farid Ya. Khalili,
Maria V. Chekhova
Abstract:
Among the known resources of quantum metrology, one of the most practical and efficient is squeezing. Squeezed states of atoms and light improve the sensing of the phase, magnetic field, polarization, mechanical displacement. They promise to considerably increase signal-to-noise ratio in imaging and spectroscopy, and are already used in real-life gravitational-wave detectors. But despite being mor…
▽ More
Among the known resources of quantum metrology, one of the most practical and efficient is squeezing. Squeezed states of atoms and light improve the sensing of the phase, magnetic field, polarization, mechanical displacement. They promise to considerably increase signal-to-noise ratio in imaging and spectroscopy, and are already used in real-life gravitational-wave detectors. But despite being more robust than other states, they are still very fragile, which narrows the scope of their application. In particular, squeezed states are useless in measurements where the detection is inefficient or the noise is high. Here, we experimentally demonstrate a remedy against loss and noise: strong noiseless amplification before detection. This way, we achieve loss-tolerant operation of an interferometer fed with squeezed and coherent light. With only 50\% detection efficiency and with noise exceeding the level of squeezed light more than 50 times, we overcome the shot-noise limit by 6~dB. Sub-shot-noise phase sensitivity survives up to 87\% loss. Application of this technique to other types of optical sensing and imaging promises a full use of quantum resources in these fields.
△ Less
Submitted 5 March, 2021; v1 submitted 18 May, 2020;
originally announced May 2020.
-
Hong-Ou-Mandel interference of unconventional temporal laser modes
Authors:
Sascha Agne,
Jeongwan **,
Katanya B. Kuntz,
Filippo M. Miatto,
Jean-Philippe Bourgoin,
Thomas Jennewein
Abstract:
The Hong-Ou-Mandel (HOM) effect ranks among the most notable quantum interference phenomena, and is central to many applications in quantum technologies. The fundamental effect appears when two independent and indistinguishable photons are superimposed on a beam splitter, which achieves a complete suppression of coincidences between the two output ports. Much less studied, however, is when the fie…
▽ More
The Hong-Ou-Mandel (HOM) effect ranks among the most notable quantum interference phenomena, and is central to many applications in quantum technologies. The fundamental effect appears when two independent and indistinguishable photons are superimposed on a beam splitter, which achieves a complete suppression of coincidences between the two output ports. Much less studied, however, is when the fields share coherence (continuous-wave lasers) or mode envelope properties (pulsed lasers). In this case, we expect the existence of two distinct and concurrent HOM interference regimes: the traditional HOM dip on the coherence length time scale, and a structured HOM interference pattern on the pulse length scale. We develop a theoretical framework that describes HOM interference for laser fields having arbitrary temporal waveforms and only partial overlap in time. We observe structured HOM interference from a continuous-wave laser via fast polarization modulation and time-resolved single photon detection fast enough to resolve these structured HOM dips.
△ Less
Submitted 17 June, 2020; v1 submitted 23 April, 2020;
originally announced April 2020.
-
Genuine time-bin-encoded quantum key distribution over a turbulent depolarizing free-space channel
Authors:
Jeongwan **,
Jean-Philippe Bourgoin,
Ramy Tannous,
Sascha Agne,
Christopher J. Pugh,
Katanya B. Kuntz,
Brendon L. Higgins,
Thomas Jennewein
Abstract:
Despite its widespread use in fiber optics, encoding quantum information in photonic time-bin states is usually considered impractical for free-space quantum communication as turbulence-induced spatial distortion impedes the analysis of time-bin states at the receiver. Here, we demonstrate quantum key distribution using time-bin photonic states distorted by turbulence and depolarization during fre…
▽ More
Despite its widespread use in fiber optics, encoding quantum information in photonic time-bin states is usually considered impractical for free-space quantum communication as turbulence-induced spatial distortion impedes the analysis of time-bin states at the receiver. Here, we demonstrate quantum key distribution using time-bin photonic states distorted by turbulence and depolarization during free-space transmission. Utilizing a novel analyzer apparatus, we observe stable quantum bit error ratios of 5.32 %, suitable for generating secure keys, despite significant wavefront distortions and polarization fluctuations across a 1.2 km channel. This shows the viability of time-bin quantum communication over long-distance free-space channels, which will simplify direct fiber/free-space interfaces and enable new approaches for practical free-space quantum communication over multi-mode, turbulent, or depolarizing channels.
△ Less
Submitted 17 December, 2019; v1 submitted 16 March, 2019;
originally announced March 2019.
-
Airborne demonstration of a quantum key distribution receiver payload
Authors:
Christopher J. Pugh,
Sarah Kaiser,
Jean-Philippe Bourgoin,
Jeongwan **,
Nigar Sultana,
Sascha Agne,
Elena Anisimova,
Vadim Makarov,
Eric Choi,
Brendon L. Higgins,
Thomas Jennewein
Abstract:
Satellite-based quantum terminals are a feasible way to extend the reach of quantum communication protocols such as quantum key distribution (QKD) to the global scale. To that end, prior demonstrations have shown QKD transmissions from airborne platforms to receivers on ground, but none have shown QKD transmissions from ground to a moving aircraft, the latter scenario having simplicity and flexibi…
▽ More
Satellite-based quantum terminals are a feasible way to extend the reach of quantum communication protocols such as quantum key distribution (QKD) to the global scale. To that end, prior demonstrations have shown QKD transmissions from airborne platforms to receivers on ground, but none have shown QKD transmissions from ground to a moving aircraft, the latter scenario having simplicity and flexibility advantages for a hypothetical satellite. Here, we demonstrate QKD from a ground transmitter to a receiver prototype mounted on an airplane in flight. We have specifically designed our receiver prototype to consist of many components that are compatible with the environment and resource constraints of a satellite. Coupled with our relocatable ground station system, optical links with distances of 3-10 km were maintained and quantum signals transmitted while traversing angular rates similar to those observed of low-Earth-orbit satellites. For some passes of the aircraft over the ground station, links were established within 10 s of position data transmission, and with link times of a few minutes and received quantum bit error rates typically 3-5%, we generated secure keys up to 868 kb in length. By successfully generating secure keys over several different pass configurations, we demonstrate the viability of technology that constitutes a quantum receiver satellite payload and provide a blueprint for future satellite missions to build upon.
△ Less
Submitted 9 June, 2017; v1 submitted 19 December, 2016;
originally announced December 2016.
-
Observation of genuine three-photon interference
Authors:
Sascha Agne,
Thomas Kauten,
Jeongwan **,
Evan Meyer-Scott,
Jeff Z. Salvail,
Deny R. Hamel,
Kevin J. Resch,
Gregor Weihs,
Thomas Jennewein
Abstract:
Multiparticle quantum interference is critical for our understanding and exploitation of quantum information, and for fundamental tests of quantum mechanics. A remarkable example of multi-partite correlations is exhibited by the Greenberger-Horne-Zeilinger (GHZ) state. In a GHZ state, three particles are correlated while no pairwise correlation is found. The manifestation of these strong correlati…
▽ More
Multiparticle quantum interference is critical for our understanding and exploitation of quantum information, and for fundamental tests of quantum mechanics. A remarkable example of multi-partite correlations is exhibited by the Greenberger-Horne-Zeilinger (GHZ) state. In a GHZ state, three particles are correlated while no pairwise correlation is found. The manifestation of these strong correlations in an interferometric setting has been studied theoretically since 1990 but no three-photon GHZ interferometer has been realized experimentally. Here we demonstrate three-photon interference that does not originate from two-photon or single photon interference. We observe phase-dependent variation of three-photon coincidences with 90.5 \pm 5.0 % visibility in a generalized Franson interferometer using energy-time entangled photon triplets. The demonstration of these strong correlations in an interferometric setting provides new avenues for multiphoton interferometry, fundamental tests of quantum mechanics and quantum information applications in higher dimensions.
△ Less
Submitted 19 April, 2017; v1 submitted 23 September, 2016;
originally announced September 2016.
-
Inexpensive LED-based spectrophotometer for analyzing optical coatings
Authors:
Kayla Hardie,
Sascha Agne,
Katanya B. Kuntz,
Thomas Jennewein
Abstract:
Optical coatings are widespread in everyday life, from camera lenses to glasses, to complex optics experiments. A simple, reliable device that can quickly and inexpensively analyze optical coatings is a valuable laboratory tool. Such a device can identify unknown or mislabelled optics, and characterize the transmission spectra of optical elements used in an experiment. We present the design and ch…
▽ More
Optical coatings are widespread in everyday life, from camera lenses to glasses, to complex optics experiments. A simple, reliable device that can quickly and inexpensively analyze optical coatings is a valuable laboratory tool. Such a device can identify unknown or mislabelled optics, and characterize the transmission spectra of optical elements used in an experiment. We present the design and characterization of a LED-based spectrophotometer, and demonstrate its ability to identify different optical coatings. Our approach uses ten LEDs that cover a spectrum from 365 nm to 1000 nm. A small servomotor and microcontroller rotates a LED board to sequentially position each LED over an optical sample, and the transmitted light corresponding to each LED is measured with a silicon photodetector. The device is automated, portable, inexpensive, user-friendly and simple to build.
△ Less
Submitted 8 June, 2016;
originally announced June 2016.
-
Demonstration of analyzers for multimode photonic time-bin qubits
Authors:
Jeongwan **,
Sascha Agne,
Jean-Philippe Bourgoin,
Yanbao Zhang,
Norbert Lütkenhaus,
Thomas Jennewein
Abstract:
We demonstrate two approaches for unbalanced interferometers as time-bin qubit analyzers for quantum communication, robust against mode distortions and polarization effects as expected from free-space quantum communication systems including wavefront deformations, path fluctuations, pointing errors, and optical elements. Despite strong spatial and temporal distortions of the optical mode of a time…
▽ More
We demonstrate two approaches for unbalanced interferometers as time-bin qubit analyzers for quantum communication, robust against mode distortions and polarization effects as expected from free-space quantum communication systems including wavefront deformations, path fluctuations, pointing errors, and optical elements. Despite strong spatial and temporal distortions of the optical mode of a time-bin qubit, entangled with a separate polarization qubit, we verify entanglement using the Negative Partial Transpose, with the measured visibility of up to 0.85$\pm$0.01. The robustness of the analyzers is further demonstrated for various angles of incidence up to 0.2$^{\circ}$. The output of the interferometers is coupled into multimode fiber yielding a high system throughput of 0.74. Therefore, these analyzers are suitable and efficient for quantum communication over multimode optical channels.
△ Less
Submitted 27 April, 2018; v1 submitted 24 September, 2015;
originally announced September 2015.
