-
Examining Pathological Bias in a Generative Adversarial Network Discriminator: A Case Study on a StyleGAN3 Model
Authors:
Alvin Grissom II,
Ryan F. Lei,
Matt Gusdorff,
Jeova Farias Sales Rocha Neto,
Bailey Lin,
Ryan Trotter
Abstract:
Generative adversarial networks (GANs) generate photorealistic faces that are often indistinguishable by humans from real faces. While biases in machine learning models are often assumed to be due to biases in training data, we find pathological internal color and luminance biases in the discriminator of a pre-trained StyleGAN3-r model that are not explicable by the training data. We also find tha…
▽ More
Generative adversarial networks (GANs) generate photorealistic faces that are often indistinguishable by humans from real faces. While biases in machine learning models are often assumed to be due to biases in training data, we find pathological internal color and luminance biases in the discriminator of a pre-trained StyleGAN3-r model that are not explicable by the training data. We also find that the discriminator systematically stratifies scores by both image- and face-level qualities and that this disproportionately affects images across gender, race, and other categories. We examine axes common in research on stereoty** in social psychology.
△ Less
Submitted 12 March, 2024; v1 submitted 15 February, 2024;
originally announced February 2024.
-
Rare but Severe Neural Machine Translation Errors Induced by Minimal Deletion: An Empirical Study on Chinese and English
Authors:
Ruikang Shi,
Alvin Grissom II,
Duc Minh Trinh
Abstract:
We examine the inducement of rare but severe errors in English-Chinese and Chinese-English in-domain neural machine translation by minimal deletion of the source text with character-based models. By deleting a single character, we can induce severe translation errors. We categorize these errors and compare the results of deleting single characters and single words. We also examine the effect of tr…
▽ More
We examine the inducement of rare but severe errors in English-Chinese and Chinese-English in-domain neural machine translation by minimal deletion of the source text with character-based models. By deleting a single character, we can induce severe translation errors. We categorize these errors and compare the results of deleting single characters and single words. We also examine the effect of training data size on the number and types of pathological cases induced by these minimal perturbations, finding significant variation. We find that deleting a word hurts overall translation score more than deleting a character, but certain errors are more likely to occur when deleting characters, with language direction also influencing the effect.
△ Less
Submitted 16 September, 2022; v1 submitted 5 September, 2022;
originally announced September 2022.
-
External Dynamic InTerference Estimation and Removal (EDITER) for low field MRI
Authors:
Sai Abitha Srinivas,
Stephen F Cauley,
Jason P Stockmann,
Charlotte R Sappo,
Christopher E Vaughn,
Lawrence L Wald,
William A Grissom,
Clarissa Z Cooley
Abstract:
Purpose: Point-of-care MRI requires operation outside of a faraday shielded room normally used to block image-degrading electromagnetic Interference (EMI). To address this, we introduce the EDITER method, an external sensor based dynamic EMI estimation and removal method to retrospectively remove time-varying external interference sources.
Theory and Methods: The method acquires data from multip…
▽ More
Purpose: Point-of-care MRI requires operation outside of a faraday shielded room normally used to block image-degrading electromagnetic Interference (EMI). To address this, we introduce the EDITER method, an external sensor based dynamic EMI estimation and removal method to retrospectively remove time-varying external interference sources.
Theory and Methods: The method acquires data from multiple EMI detectors (tuned receive coils and electrodes placed on the body) simultaneous with the primary MR coil during image data acquisition. We dynamically calculate impulse response functions that map the data from the detectors to the artifacts in the kspace data, then remove the transformed detected EMI from the MR data. Performance of the EDITER algorithm was assessed in phantom and in vivo imaging experiments in an 80mT portable brain MRI in a controlled EMI environment and with an open 47.5mT MRI scanner in an uncontrolled EMI setting.
Results: In the controlled setting, the effectiveness of the EDITER technique was demonstrated for specific types of introduced EMI sources with up to a 97% reduction of structured EMI and up to 76% reduction of broadband EMI. In the uncontrolled EMI experiments, we demonstrate EMI reductions of 37% with a single pickup coil and 89% with a single electrode and up to 99% with both.
Conclusion: The EDITER technique is a flexible and robust method to improve image quality in portable MRI systems with minimal passive shielding. This could reduce the reliance of MRI on shielded rooms and allow for truly portable MRI with specialized compact POC scanners
△ Less
Submitted 29 April, 2021; v1 submitted 17 April, 2021;
originally announced April 2021.
-
Ultra-high spatial resolution BOLD fMRI in humans using combined segmented-accelerated VFA-FLEET with a recursive RF pulse design
Authors:
Avery J. L. Berman,
William A. Grissom,
Thomas Witzel,
Shahin Nasr,
Daniel J. Park,
Kawin Setsompop,
Jonathan R. Polimeni
Abstract:
Purpose
To alleviate the spatial encoding limitations of single-shot EPI by develo** multi-shot segmented EPI for ultra-high-resolution fMRI with reduced ghosting artifacts from subject motion and respiration.
Methods
Segmented EPI can reduce readout duration and reduce acceleration factors, however, the time elapsed between segment acquisitions (on the order of seconds) can result in inte…
▽ More
Purpose
To alleviate the spatial encoding limitations of single-shot EPI by develo** multi-shot segmented EPI for ultra-high-resolution fMRI with reduced ghosting artifacts from subject motion and respiration.
Methods
Segmented EPI can reduce readout duration and reduce acceleration factors, however, the time elapsed between segment acquisitions (on the order of seconds) can result in intermittent ghosting, limiting its use for fMRI. Here, "FLEET" segment ordering--where segments are looped over before slices--was combined with a variable flip angle progression (VFA-FLEET) to improve inter-segment fidelity and maximize signal for fMRI. Scaling a sinc pulse's flip angle for each segment (VFA-FLEET-Sinc) produced inconsistent slice profiles and ghosting, therefore, a recursive Shinnar-Le Roux (SLR) RF pulse design was developed (VFA-FLEET-SLR) to generate unique pulses for every segment that together produce consistent slice profiles and signals.
Results
The temporal stability of VFA-FLEET-SLR was compared against conventional-segmented EPI and VFA-FLEET-Sinc at 3 T and 7 T. VFA-FLEET-SLR showed reductions in both intermittent and stable ghosting compared to conventional-segmented and VFA-FLEET-Sinc, resulting in improved image quality with a minor trade-off in temporal SNR. Combining VFA-FLEET-SLR with acceleration, we achieved a 0.6-mm isotropic acquisition at 7 T--without zoomed imaging or partial Fourier--demonstrating reliable detection of BOLD responses to a visual stimulus. To counteract the increased repetition time from segmentation, simultaneous multi-slice VFA-FLEET-SLR was demonstrated using RF-encoded controlled aliasing.
Conclusions
VFA-FLEET with a recursive RF pulse design supports acquisitions with low levels of artifact and spatial blur, enabling fMRI at previously inaccessible spatial resolutions with a "full-brain" field of view.
△ Less
Submitted 3 July, 2020;
originally announced July 2020.
-
Accelerated spin-echo fMRI using Multisection Excitation by Simultaneous Spin-echo Interleaving (MESSI) with complex-encoded generalized SLIce Dithered Enhanced Resolution (cgSlider) Simultaneous Multi-Slice Echo-Planar Imaging
Authors:
SoHyun Han,
Congyu Liao,
Mary Kate Manhard,
Daniel Joseph Park,
Berkin Bilgic,
Merlin J. Fair,
Fuyixue Wang,
Anna I. Blazejewska,
William A. Grissom,
Jonathan R. Polimeni,
Kawin Setsompop
Abstract:
Spin-echo functional MRI (SE-fMRI) has the potential to improve spatial specificity when compared to gradient-echo fMRI. However, high spatiotemporal resolution SE-fMRI with large slice-coverage is challenging as SE-fMRI requires a long echo time (TE) to generate blood oxygenation level-dependent (BOLD) contrast, leading to long repetition times (TR). The aim of this work is to develop an acquisit…
▽ More
Spin-echo functional MRI (SE-fMRI) has the potential to improve spatial specificity when compared to gradient-echo fMRI. However, high spatiotemporal resolution SE-fMRI with large slice-coverage is challenging as SE-fMRI requires a long echo time (TE) to generate blood oxygenation level-dependent (BOLD) contrast, leading to long repetition times (TR). The aim of this work is to develop an acquisition method that enhances the slice-coverage of SE-fMRI at high spatiotemporal resolution. An acquisition scheme was developed entitled Multisection Excitation by Simultaneous Spin-echo Interleaving (MESSI) with complex-encoded generalized SLIce Dithered Enhanced Resolution (cgSlider). MESSI utilizes the dead-time during the long TE by interleaving the excitation and readout of two slices to enable 2x slice-acceleration, while cgSlider utilizes the stable temporal background phase in SE-fMRI to encode and decode two adjacent slices simultaneously with a phase-constrained reconstruction method. The proposed cgSlider-MESSI was also combined with Simultaneous Multi-Slice (SMS) to achieve further slice-acceleration. This combined approach was used to achieve 1.5mm isotropic whole-brain SE-fMRI with a temporal resolution of 1.5s and was evaluated using sensory stimulation and breath-hold tasks at 3T. Compared to conventional SE-SMS, cgSlider-MESSI-SMS provides four-fold increase in slice-coverage for the same TR, with comparable temporal signal-to-noise ratio. Corresponding fMRI activation from cgSlider-MESSI-SMS for both fMRI tasks were consistent with those from conventional SE-SMS. Overall, cgSlider-MESSI-SMS achieved a 32x encoding-acceleration by combining RinplanexMBxcgSliderxMESSI=4x2x2x2. High-quality, high-resolution whole-brain SE-fMRI was acquired at a short TR using cgSlider-MESSI-SMS.
△ Less
Submitted 30 October, 2019;
originally announced October 2019.
-
Investigating Sports Commentator Bias within a Large Corpus of American Football Broadcasts
Authors:
Jack Merullo,
Luke Yeh,
Abram Handler,
Alvin Grissom II,
Brendan O'Connor,
Mohit Iyyer
Abstract:
Sports broadcasters inject drama into play-by-play commentary by building team and player narratives through subjective analyses and anecdotes. Prior studies based on small datasets and manual coding show that such theatrics evince commentator bias in sports broadcasts. To examine this phenomenon, we assemble FOOTBALL, which contains 1,455 broadcast transcripts from American football games across…
▽ More
Sports broadcasters inject drama into play-by-play commentary by building team and player narratives through subjective analyses and anecdotes. Prior studies based on small datasets and manual coding show that such theatrics evince commentator bias in sports broadcasts. To examine this phenomenon, we assemble FOOTBALL, which contains 1,455 broadcast transcripts from American football games across six decades that are automatically annotated with 250K player mentions and linked with racial metadata. We identify major confounding factors for researchers examining racial bias in FOOTBALL, and perform a computational analysis that supports conclusions from prior social science studies.
△ Less
Submitted 18 October, 2019; v1 submitted 7 September, 2019;
originally announced September 2019.
-
High-fidelity, high-isotropic resolution diffusion imaging through gSlider acquisition with B1+ & T1 corrections and integrated ΔB0/Rx shim array
Authors:
Congyu Liao,
Jason Stockmann,
Qiyuan Tian,
Berkin Bilgic,
Nicolas S. Arango,
Mary Kate Manhard,
William A. Grissom,
Lawrence L. Wald,
Kawin Setsompop
Abstract:
Purpose: B1+ and T1 corrections and dynamic multi-coil shimming approaches were proposed to improve the fidelity of high isotropic resolution Generalized slice dithered enhanced resolution (gSlider) diffusion imaging. Methods: An extended reconstruction incorporating B1+ inhomogeneity and T1 recovery information was developed to mitigate slab-boundary artifacts in short-TR gSlider acquisitions. Sl…
▽ More
Purpose: B1+ and T1 corrections and dynamic multi-coil shimming approaches were proposed to improve the fidelity of high isotropic resolution Generalized slice dithered enhanced resolution (gSlider) diffusion imaging. Methods: An extended reconstruction incorporating B1+ inhomogeneity and T1 recovery information was developed to mitigate slab-boundary artifacts in short-TR gSlider acquisitions. Slab-by-slab dynamic B0 shimming using a multi-coil integrated ΔB0/Rx shim-array, and high in-plane acceleration (Rinplane=4) achieved with virtual-coil GRAPPA were also incorporated into a 1 mm isotropic resolution gSlider acquisition/reconstruction framework to achieve an 8-11 fold reduction in geometric distortion compared to single-shot EPI. Results: The slab-boundary artifacts were alleviated by the proposed B1+ and T1 corrections compared to the standard gSlider reconstruction pipeline for short-TR acquisitions. Dynamic shimming provided >50% reduction in geometric distortion compared to conventional global 2nd order shimming. 1 mm isotropic resolution diffusion data show that the typically problematic temporal and frontal lobes of the brain can be imaged with high geometric fidelity using dynamic shimming. Conclusions: The proposed B1+ and T1 corrections and local-field control substantially improved the fidelity of high isotropic resolution diffusion imaging, with reduced slab-boundary artifacts and geometric distortion compared to conventional gSlider acquisition and reconstruction. This enabled high-fidelity whole-brain 1 mm isotropic diffusion imaging with 64 diffusion-directions in 20 minutes using a 3T clinical scanner.
△ Less
Submitted 26 March, 2019; v1 submitted 13 November, 2018;
originally announced November 2018.
-
Pathologies of Neural Models Make Interpretations Difficult
Authors:
Shi Feng,
Eric Wallace,
Alvin Grissom II,
Mohit Iyyer,
Pedro Rodriguez,
Jordan Boyd-Graber
Abstract:
One way to interpret neural model predictions is to highlight the most important input features---for example, a heatmap visualization over the words in an input sentence. In existing interpretation methods for NLP, a word's importance is determined by either input perturbation---measuring the decrease in model confidence when that word is removed---or by the gradient with respect to that word. To…
▽ More
One way to interpret neural model predictions is to highlight the most important input features---for example, a heatmap visualization over the words in an input sentence. In existing interpretation methods for NLP, a word's importance is determined by either input perturbation---measuring the decrease in model confidence when that word is removed---or by the gradient with respect to that word. To understand the limitations of these methods, we use input reduction, which iteratively removes the least important word from the input. This exposes pathological behaviors of neural models: the remaining words appear nonsensical to humans and are not the ones determined as important by interpretation methods. As we confirm with human experiments, the reduced examples lack information to support the prediction of any label, but models still make the same predictions with high confidence. To explain these counterintuitive results, we draw connections to adversarial examples and confidence calibration: pathological behaviors reveal difficulties in interpreting neural models trained with maximum likelihood. To mitigate their deficiencies, we fine-tune the models by encouraging high entropy outputs on reduced examples. Fine-tuned models become more interpretable under input reduction without accuracy loss on regular examples.
△ Less
Submitted 28 August, 2018; v1 submitted 20 April, 2018;
originally announced April 2018.
-
Ghost Reduction in Echo-Planar Imaging by Joint Reconstruction of Images and Line-to-Line Delays and Phase Errors
Authors:
Julianna D. Ianni,
E. Brian Welch,
William A. Grissom
Abstract:
PURPOSE: To correct line-to-line delays and phase errors in echo-planar imaging (EPI). THEORY AND METHODS: EPI- trajectory auto-corrected image reconstruction (EPI-TrACR) is an iterative maximum-likelihood technique that exploits data redundancy provided by multiple receive coils between nearby lines of k-space to determine and correct line-to-line trajectory delays and phase errors that cause gho…
▽ More
PURPOSE: To correct line-to-line delays and phase errors in echo-planar imaging (EPI). THEORY AND METHODS: EPI- trajectory auto-corrected image reconstruction (EPI-TrACR) is an iterative maximum-likelihood technique that exploits data redundancy provided by multiple receive coils between nearby lines of k-space to determine and correct line-to-line trajectory delays and phase errors that cause ghosting artifacts. EPI-TrACR was applied to in vivo data acquired at 7 Tesla across acceleration and multishot factors, and in a dynamic time series. The method was efficiently implemented using a segmented FFT and compared to a conventional calibrated reconstruction. RESULTS: Compared to conventional calibrated reconstructions, EPI-TrACR reduced ghosting up to moderate acceleration factors and across multishot factors. It also maintained low ghosting in a dynamic time series. Averaged over all cases, EPI-TrACR reduced root-mean-square ghosted signal outside the brain by 27% compared to calibrated reconstruction. CONCLUSION: EPI-TrACR is effective in automatically correcting line-to-line delays and phase errors in multishot, accelerated, and dynamic EPI. While the method benefits from additional calibration data, it is not a requirement.
△ Less
Submitted 26 June, 2017;
originally announced June 2017.
