-
Non-Formality of $S^2$ via the free loop space
Authors:
Ryan McGowan,
Florian Naef,
Brian O'Callaghan
Abstract:
We show that the $E_1$-equivalence $C^\bullet(S^2) \simeq H^\bullet(S^2)$ does not intertwine the inclusion of constant loops into the free loop space $S^2 \to LS^2$. That is, the isomorphism $HH_\bullet(H^\bullet(S^2)) \cong H^\bullet(LS^2)$ does not preserve the obvious maps to $H^\bullet(S^2)$ that exist on both sides. We give an explicit computation of the defect in terms of the $E_\infty$-str…
▽ More
We show that the $E_1$-equivalence $C^\bullet(S^2) \simeq H^\bullet(S^2)$ does not intertwine the inclusion of constant loops into the free loop space $S^2 \to LS^2$. That is, the isomorphism $HH_\bullet(H^\bullet(S^2)) \cong H^\bullet(LS^2)$ does not preserve the obvious maps to $H^\bullet(S^2)$ that exist on both sides. We give an explicit computation of the defect in terms of the $E_\infty$-structure on $C^\bullet(S^2)$. Finally, we relate our calculation to recent work of Poirier-Tradler on the string topology of $S^2$.
△ Less
Submitted 20 May, 2024;
originally announced May 2024.
-
Prediction of recurrence free survival of head and neck cancer using PET/CT radiomics and clinical information
Authors:
Mona Furukawa,
Daniel R. McGowan,
Bartłomiej W. Papież
Abstract:
The 5-year survival rate of Head and Neck Cancer (HNC) has not improved over the past decade and one common cause of treatment failure is recurrence. In this paper, we built Cox proportional hazard (CoxPH) models that predict the recurrence free survival (RFS) of oropharyngeal HNC patients. Our models utilise both clinical information and multimodal radiomics features extracted from tumour regions…
▽ More
The 5-year survival rate of Head and Neck Cancer (HNC) has not improved over the past decade and one common cause of treatment failure is recurrence. In this paper, we built Cox proportional hazard (CoxPH) models that predict the recurrence free survival (RFS) of oropharyngeal HNC patients. Our models utilise both clinical information and multimodal radiomics features extracted from tumour regions in Computed Tomography (CT) and Positron Emission Tomography (PET). Furthermore, we were one of the first studies to explore the impact of segmentation accuracy on the predictive power of the extracted radiomics features, through under- and over-segmentation study. Our models were trained using the HEad and neCK TumOR (HECKTOR) challenge data, and the best performing model achieved a concordance index (C-index) of 0.74 for the model utilising clinical information and multimodal CT and PET radiomics features, which compares favourably with the model that only used clinical information (C-index of 0.67). Our under- and over-segmentation study confirms that segmentation accuracy affects radiomics extraction, however, it affects PET and CT differently.
△ Less
Submitted 28 February, 2024;
originally announced February 2024.
-
Autopet Challenge 2023: nnUNet-based whole-body 3D PET-CT Tumour Segmentation
Authors:
Anissa Alloula,
Daniel R McGowan,
Bartłomiej W. Papież
Abstract:
Fluorodeoxyglucose Positron Emission Tomography (FDG-PET) combined with Computed Tomography (CT) scans are critical in oncology to the identification of solid tumours and the monitoring of their progression. However, precise and consistent lesion segmentation remains challenging, as manual segmentation is time-consuming and subject to intra- and inter-observer variability. Despite their promise, a…
▽ More
Fluorodeoxyglucose Positron Emission Tomography (FDG-PET) combined with Computed Tomography (CT) scans are critical in oncology to the identification of solid tumours and the monitoring of their progression. However, precise and consistent lesion segmentation remains challenging, as manual segmentation is time-consuming and subject to intra- and inter-observer variability. Despite their promise, automated segmentation methods often struggle with false positive segmentation of regions of healthy metabolic activity, particularly when presented with such a complex range of tumours across the whole body. In this paper, we explore the application of the nnUNet to tumour segmentation of whole-body PET-CT scans and conduct different experiments on optimal training and post-processing strategies. Our best model obtains a Dice score of 69\% and a false negative and false positive volume of 6.27 and 5.78 mL respectively, on our internal test set. This model is submitted as part of the autoPET 2023 challenge. Our code is available at: https://github.com/anissa218/autopet\_nnunet
△ Less
Submitted 24 September, 2023;
originally announced September 2023.
-
Robust Acoustic and Semantic Contextual Biasing in Neural Transducers for Speech Recognition
Authors:
Xuandi Fu,
Kanthashree Mysore Sathyendra,
Ankur Gandhe,
**g Liu,
Grant P. Strimel,
Ross McGowan,
Athanasios Mouchtaris
Abstract:
Attention-based contextual biasing approaches have shown significant improvements in the recognition of generic and/or personal rare-words in End-to-End Automatic Speech Recognition (E2E ASR) systems like neural transducers. These approaches employ cross-attention to bias the model towards specific contextual entities injected as bias-phrases to the model. Prior approaches typically relied on subw…
▽ More
Attention-based contextual biasing approaches have shown significant improvements in the recognition of generic and/or personal rare-words in End-to-End Automatic Speech Recognition (E2E ASR) systems like neural transducers. These approaches employ cross-attention to bias the model towards specific contextual entities injected as bias-phrases to the model. Prior approaches typically relied on subword encoders for encoding the bias phrases. However, subword tokenizations are coarse and fail to capture granular pronunciation information which is crucial for biasing based on acoustic similarity. In this work, we propose to use lightweight character representations to encode fine-grained pronunciation features to improve contextual biasing guided by acoustic similarity between the audio and the contextual entities (termed acoustic biasing). We further integrate pretrained neural language model (NLM) based encoders to encode the utterance's semantic context along with contextual entities to perform biasing informed by the utterance's semantic context (termed semantic biasing). Experiments using a Conformer Transducer model on the Librispeech dataset show a 4.62% - 9.26% relative WER improvement on different biasing list sizes over the baseline contextual model when incorporating our proposed acoustic and semantic biasing approach. On a large-scale in-house dataset, we observe 7.91% relative WER improvement compared to our baseline model. On tail utterances, the improvements are even more pronounced with 36.80% and 23.40% relative WER improvements on Librispeech rare words and an in-house testset respectively.
△ Less
Submitted 9 May, 2023;
originally announced May 2023.
-
Dual-Attention Neural Transducers for Efficient Wake Word Spotting in Speech Recognition
Authors:
Saumya Y. Sahai,
**g Liu,
Thejaswi Muniyappa,
Kanthashree M. Sathyendra,
Anastasios Alexandridis,
Grant P. Strimel,
Ross McGowan,
Ariya Rastrow,
Feng-Ju Chang,
Athanasios Mouchtaris,
Siegfried Kunzmann
Abstract:
We present dual-attention neural biasing, an architecture designed to boost Wake Words (WW) recognition and improve inference time latency on speech recognition tasks. This architecture enables a dynamic switch for its runtime compute paths by exploiting WW spotting to select which branch of its attention networks to execute for an input audio frame. With this approach, we effectively improve WW s…
▽ More
We present dual-attention neural biasing, an architecture designed to boost Wake Words (WW) recognition and improve inference time latency on speech recognition tasks. This architecture enables a dynamic switch for its runtime compute paths by exploiting WW spotting to select which branch of its attention networks to execute for an input audio frame. With this approach, we effectively improve WW spotting accuracy while saving runtime compute cost as defined by floating point operations (FLOPs). Using an in-house de-identified dataset, we demonstrate that the proposed dual-attention network can reduce the compute cost by $90\%$ for WW audio frames, with only $1\%$ increase in the number of parameters. This architecture improves WW F1 score by $16\%$ relative and improves generic rare word error rate by $3\%$ relative compared to the baselines.
△ Less
Submitted 4 April, 2023; v1 submitted 2 April, 2023;
originally announced April 2023.
-
Dialog act guided contextual adapter for personalized speech recognition
Authors:
Feng-Ju Chang,
Thejaswi Muniyappa,
Kanthashree Mysore Sathyendra,
Kai Wei,
Grant P. Strimel,
Ross McGowan
Abstract:
Personalization in multi-turn dialogs has been a long standing challenge for end-to-end automatic speech recognition (E2E ASR) models. Recent work on contextual adapters has tackled rare word recognition using user catalogs. This adaptation, however, does not incorporate an important cue, the dialog act, which is available in a multi-turn dialog scenario. In this work, we propose a dialog act guid…
▽ More
Personalization in multi-turn dialogs has been a long standing challenge for end-to-end automatic speech recognition (E2E ASR) models. Recent work on contextual adapters has tackled rare word recognition using user catalogs. This adaptation, however, does not incorporate an important cue, the dialog act, which is available in a multi-turn dialog scenario. In this work, we propose a dialog act guided contextual adapter network. Specifically, it leverages dialog acts to select the most relevant user catalogs and creates queries based on both -- the audio as well as the semantic relationship between the carrier phrase and user catalogs to better guide the contextual biasing. On industrial voice assistant datasets, our model outperforms both the baselines - dialog act encoder-only model, and the contextual adaptation, leading to the most improvement over the no-context model: 58% average relative word error rate reduction (WERR) in the multi-turn dialog scenario, in comparison to the prior-art contextual adapter, which has achieved 39% WERR over the no-context model.
△ Less
Submitted 31 March, 2023;
originally announced March 2023.
-
Attentive Contextual Carryover for Multi-Turn End-to-End Spoken Language Understanding
Authors:
Kai Wei,
Thanh Tran,
Feng-Ju Chang,
Kanthashree Mysore Sathyendra,
Thejaswi Muniyappa,
**g Liu,
Anirudh Raju,
Ross McGowan,
Nathan Susanj,
Ariya Rastrow,
Grant P. Strimel
Abstract:
Recent years have seen significant advances in end-to-end (E2E) spoken language understanding (SLU) systems, which directly predict intents and slots from spoken audio. While dialogue history has been exploited to improve conventional text-based natural language understanding systems, current E2E SLU approaches have not yet incorporated such critical contextual signals in multi-turn and task-orien…
▽ More
Recent years have seen significant advances in end-to-end (E2E) spoken language understanding (SLU) systems, which directly predict intents and slots from spoken audio. While dialogue history has been exploited to improve conventional text-based natural language understanding systems, current E2E SLU approaches have not yet incorporated such critical contextual signals in multi-turn and task-oriented dialogues. In this work, we propose a contextual E2E SLU model architecture that uses a multi-head attention mechanism over encoded previous utterances and dialogue acts (actions taken by the voice assistant) of a multi-turn dialogue. We detail alternative methods to integrate these contexts into the state-ofthe-art recurrent and transformer-based models. When applied to a large de-identified dataset of utterances collected by a voice assistant, our method reduces average word and semantic error rates by 10.8% and 12.6%, respectively. We also present results on a publicly available dataset and show that our method significantly improves performance over a noncontextual baseline
△ Less
Submitted 13 December, 2021;
originally announced December 2021.
-
Multimodal PET/CT Tumour Segmentation and Prediction of Progression-Free Survival using a Full-Scale UNet with Attention
Authors:
Emmanuelle Bourigault,
Daniel R. McGowan,
Abolfazl Mehranian,
Bartłomiej W. Papież
Abstract:
Segmentation of head and neck (H\&N) tumours and prediction of patient outcome are crucial for patient's disease diagnosis and treatment monitoring. Current developments of robust deep learning models are hindered by the lack of large multi-centre, multi-modal data with quality annotations. The MICCAI 2021 HEad and neCK TumOR (HECKTOR) segmentation and outcome prediction challenge creates a platfo…
▽ More
Segmentation of head and neck (H\&N) tumours and prediction of patient outcome are crucial for patient's disease diagnosis and treatment monitoring. Current developments of robust deep learning models are hindered by the lack of large multi-centre, multi-modal data with quality annotations. The MICCAI 2021 HEad and neCK TumOR (HECKTOR) segmentation and outcome prediction challenge creates a platform for comparing segmentation methods of the primary gross target volume on fluoro-deoxyglucose (FDG)-PET and Computed Tomography images and prediction of progression-free survival in H\&N oropharyngeal cancer.For the segmentation task, we proposed a new network based on an encoder-decoder architecture with full inter- and intra-skip connections to take advantage of low-level and high-level semantics at full scales. Additionally, we used Conditional Random Fields as a post-processing step to refine the predicted segmentation maps. We trained multiple neural networks for tumor volume segmentation, and these segmentations were ensembled achieving an average Dice Similarity Coefficient of 0.75 in cross-validation, and 0.76 on the challenge testing data set. For prediction of patient progression free survival task, we propose a Cox proportional hazard regression combining clinical, radiomic, and deep learning features. Our survival prediction model achieved a concordance index of 0.82 in cross-validation, and 0.62 on the challenge testing data set.
△ Less
Submitted 6 November, 2021;
originally announced November 2021.
-
Status of the CRESST Dark Matter Search
Authors:
J. Schmaler,
G. Angloher,
M. Bauer,
I. Bavykina,
A. Bento,
A. Brown,
C. Bucci,
C. Ciemniak,
C. Coppi,
G. Deuter,
F. von Feilitzsch,
D. Hauff,
S. Henry,
P. Huff,
J. Imber,
S. Ingleby,
C. Isaila,
J. Jochum,
M. Kiefer,
M. Kimmerle,
H. Kraus,
J. -C. Lanfranchi,
R. F. Lang,
M. Malek,
R. McGowan
, et al. (16 additional authors not shown)
Abstract:
The CRESST experiment aims for a detection of dark matter in the form of WIMPs. These particles are expected to scatter elastically off the nuclei of a target material, thereby depositing energy on the recoiling nucleus. CRESST uses scintillating CaWO4 crystals as such a target. The energy deposited by an interacting particle is primarily converted to phonons which are detected by transition edg…
▽ More
The CRESST experiment aims for a detection of dark matter in the form of WIMPs. These particles are expected to scatter elastically off the nuclei of a target material, thereby depositing energy on the recoiling nucleus. CRESST uses scintillating CaWO4 crystals as such a target. The energy deposited by an interacting particle is primarily converted to phonons which are detected by transition edge sensors. In addition, a small fraction of the interaction energy is emitted from the crystals in the form of scintillation light which is measured in coincidence with the phonon signal by a separate cryogenic light detector for each target crystal. The ratio of light to phonon energy permits the discrimination between the nuclear recoils expected from WIMPs and events from radioactive backgrounds which primarily lead to electron recoils. CRESST has shown the success of this method in a commissioning run in 2007 and, since then, further investigated possibilities for an even better suppression of backgrounds. Here, we report on a new class of background events observed in the course of this work. The consequences of this observation are discussed and we present the current status of the experiment.
△ Less
Submitted 18 December, 2009;
originally announced December 2009.
-
Composite CaWO4 Detectors for the CRESST-II Experiment
Authors:
M. Kiefer,
G. Angloher,
M. Bauer,
I. Bavykina,
A. Bento,
A. Brown,
C. Bucci,
C. Ciemniak,
C. Coppi,
G. Deuter,
F. von Feilitzsch,
D. Hauff,
S. Henry,
P. Huff,
J. Imber,
S. Ingleby,
C. Isaila,
J. Jochum,
M. Kimmerle,
H. Kraus,
J. -C. Lanfranchi,
R. F. Lang,
M. Malek,
R. McGowan,
V. B. Mikhailik
, et al. (16 additional authors not shown)
Abstract:
CRESST-II, standing for Cryogenic Rare Events Search with Superconducting Thermometers phase II, is an experiment searching for Dark Matter. In the LNGS facility in Gran Sasso, Italy, a cryogenic detector setup is operated in order to detect WIMPs by elastic scattering off nuclei, generating phononic lattice excitations and scintillation light. The thermometers used in the experiment consist of…
▽ More
CRESST-II, standing for Cryogenic Rare Events Search with Superconducting Thermometers phase II, is an experiment searching for Dark Matter. In the LNGS facility in Gran Sasso, Italy, a cryogenic detector setup is operated in order to detect WIMPs by elastic scattering off nuclei, generating phononic lattice excitations and scintillation light. The thermometers used in the experiment consist of a tungsten thin-film structure evaporated onto the CaWO4 absorber crystal. The process of evaporation causes a decrease in the scintillation light output. This, together with the need of a big-scale detector production for the upcoming EURECA experiment lead to investigations for producing thermometers on smaller crystals which are glued onto the absorber crystal. In our Run 31 we tested composite detectors for the first time in the Gran Sasso setup. They seem to produce higher light yields as hoped and could provide an additional time based discrimination mechanism for low light yield clamp events.
△ Less
Submitted 1 December, 2009;
originally announced December 2009.
-
Scintillator Non-Proportionality and Gamma Quenching in CaWO4
Authors:
R. F. Lang,
G. Angloher,
M. Bauer,
I. Bavykina,
A. Bento,
A. Brown,
C. Bucci,
C. Ciemniak,
C. Coppi,
G. Deuter,
F. von Feilitzsch,
D. Hauff,
S. Henry,
P. Huff,
J. Imber,
S. Ingleby,
C. Isaila,
J. Jochum,
M. Kiefer,
M. Kimmerle,
H. Kraus,
J. -C. Lanfranchi,
M. Malek,
R. McGowan,
V. B. Mikhailik
, et al. (16 additional authors not shown)
Abstract:
We measure and explain scintillator non-proportionality and gamma quenching of CaWO4 at low energies and low temperatures. Phonons that are created following an interaction in the scintillating crystal at temperatures of 15mK are used for a calorimetric measurement of the deposited energy, and the scintillation light is measured with a separate cryogenic light detector. Making use of radioactivi…
▽ More
We measure and explain scintillator non-proportionality and gamma quenching of CaWO4 at low energies and low temperatures. Phonons that are created following an interaction in the scintillating crystal at temperatures of 15mK are used for a calorimetric measurement of the deposited energy, and the scintillation light is measured with a separate cryogenic light detector. Making use of radioactivity intrinsic to the scintillating crystal, the scintillator non-proportionality is mapped out to electron energies <5keV. The observed behavior is in agreement with a simple model based on Birks' law and the stop** power dE/dx for electrons. We find for Birks' constant $k_B=(18.5\pm0.7)$nm/keV in CaWO4. Gamma lines allow a measurement of the reduced light yield of photons with respect to electrons, as expected in the presence of scintillator non-proportionality. In particular, we show that gamma-induced events in CaWO4 give only about 90 percent of the light yield of electrons, at energies between 40keV and 80keV.
△ Less
Submitted 22 October, 2009;
originally announced October 2009.
-
Electron and Gamma Background in CRESST Detectors
Authors:
R. F. Lang,
G. Angloher,
M. Bauer,
I. Bavykina,
A. Bento,
A. Brown,
C. Bucci,
C. Ciemniak,
C. Coppi,
G. Deuter,
F. von Feilitzsch,
D. Hauff,
S. Henry,
P. Huff,
J. Imber,
S. Ingleby,
C. Isaila,
J. Jochum,
M. Kiefer,
M. Kimmerle,
H. Kraus,
J. -C. Lanfranchi,
B. Majorovits,
M. Malek,
R. McGowan
, et al. (17 additional authors not shown)
Abstract:
The CRESST experiment monitors 300g CaWO_4 crystals as targets for particle interactions in an ultra low background environment. In this paper, we analyze the background spectra that are recorded by three detectors over many weeks of data taking. Understanding these spectra is mandatory if one wants to further reduce the background level, and allows us to cross-check the calibration of the detec…
▽ More
The CRESST experiment monitors 300g CaWO_4 crystals as targets for particle interactions in an ultra low background environment. In this paper, we analyze the background spectra that are recorded by three detectors over many weeks of data taking. Understanding these spectra is mandatory if one wants to further reduce the background level, and allows us to cross-check the calibration of the detectors. We identify a variety of sources, such as intrinsic contaminations due to primordial radioisotopes and cosmogenic activation of the target material. In particular, we detect a 3.6keV X-ray line from the decay of 41-Ca with an activity of (26\pm4)μBq, corresponding to a ratio 41-Ca/40-Ca=(2.2\pm0.3)\times10^{-16}.
△ Less
Submitted 26 May, 2009;
originally announced May 2009.
-
Discrimination of Recoil Backgrounds in Scintillating Calorimeters
Authors:
R. F. Lang,
G. Angloher,
M. Bauer,
I. Bavykina,
A. Bento,
A. Brown,
C. Bucci,
C. Ciemniak,
C. Coppi,
G. Deuter,
F. von Feilitzsch,
D. Hauff,
S. Henry,
P. Huff,
J. Imber,
S. Ingleby,
C. Isaila,
J. Jochum,
M. Kiefer,
M. Kimmerle,
H. Kraus,
J. -C. Lanfranchi,
M. Malek,
R. McGowan,
V. B. Mikhailik
, et al. (16 additional authors not shown)
Abstract:
The alpha decay of $\n{{}^{210}Po}$ is a dangerous background to rare event searches. Here, we describe observations related to this alpha decay in the Cryogenic Rare Event Search with Superconducting Thermometers (CRESST). We find that lead nuclei show a scintillation light yield in our $\n{CaWO_4}$ crystals of $0.0142\pm0.0013$ relative to electrons of the same energy. We describe a way to dis…
▽ More
The alpha decay of $\n{{}^{210}Po}$ is a dangerous background to rare event searches. Here, we describe observations related to this alpha decay in the Cryogenic Rare Event Search with Superconducting Thermometers (CRESST). We find that lead nuclei show a scintillation light yield in our $\n{CaWO_4}$ crystals of $0.0142\pm0.0013$ relative to electrons of the same energy. We describe a way to discriminate this source of nuclear recoil background by means of a scintillating foil, and demonstrate its effectiveness. This leads to an observable difference in the pulse shape of the light detector, which can be used to tag these events. Differences in pulse shape of the phonon detector between lead and electron recoils are also extracted, opening the window to future additional background suppression techniques based on pulse shape discrimination in such experiments.
△ Less
Submitted 26 March, 2009;
originally announced March 2009.
-
Commissioning Run of the CRESST-II Dark Matter Search
Authors:
G. Angloher,
M. Bauer,
I. Bavykina,
A. Bento,
A. Brown,
C. Bucci,
C. Ciemniak,
C. Coppi,
G. Deuter,
F. von Feilitzsch,
D. Hauff,
S. Henry,
P. Huff,
J. Imber,
S. Ingleby,
C. Isaila,
J. Jochum,
M. Kiefer,
M. Kimmerle,
H. Kraus,
J. -C. Lanfranchi,
R. F. Lang,
B. Majorovits,
M. Malek,
R. McGowan
, et al. (18 additional authors not shown)
Abstract:
The CRESST cryogenic direct dark matter search at Gran Sasso, searching for WIMPs via nuclear recoil, has been upgraded to CRESST-II by several changes and improvements.We present the results of a commissioning run carried out in 2007.
The basic element of CRESST-II is a detector module consisting of a large (~ 300 g) CaWO_4 crystal and a very sensitive smaller (~ 2 g) light detector to detect…
▽ More
The CRESST cryogenic direct dark matter search at Gran Sasso, searching for WIMPs via nuclear recoil, has been upgraded to CRESST-II by several changes and improvements.We present the results of a commissioning run carried out in 2007.
The basic element of CRESST-II is a detector module consisting of a large (~ 300 g) CaWO_4 crystal and a very sensitive smaller (~ 2 g) light detector to detect the scintillation light from the CaWO_4.Information from light-quenching factor studies allows the definition of a region of the energy-light yield plane which corresponds to tungsten recoils. A neutron test is reported which supports the principle of using the light yield to identify the recoiling nucleus.
Data obtained with two detector modules for a total exposure of 48 kg-days are presented. Judging by the rate of events in the "all nuclear recoils" acceptance region the apparatus shows a factor ~ten improvement with respect to previous results, which we attribute principally to the presence of the neutron shield.
In the "tungsten recoils" acceptance region three events are found, corresponding to a rate of 0.063 per kg-day. Standard assumptions on the dark matter flux, coherent or spin independent interactions,then yield a limit for WIMP-nucleon scattering of 4.8 \times 10^{-7}pb, at M{WIMP} ~50 GeV.
△ Less
Submitted 16 February, 2009; v1 submitted 10 September, 2008;
originally announced September 2008.
