-
Fast refacing of MR images with a generative neural network lowers re-identification risk and preserves volumetric consistency
Authors:
Nataliia Molchanova,
Bénédicte Maréchal,
Jean-Philippe Thiran,
Tobias Kober,
Till Huelnhagen,
Jonas Richiardi
Abstract:
With the rise of open data, identifiability of individuals based on 3D renderings obtained from routine structural magnetic resonance imaging (MRI) scans of the head has become a growing privacy concern. To protect subject privacy, several algorithms have been developed to de-identify imaging data using blurring, defacing or refacing. Completely removing facial structures provides the best re-iden…
▽ More
With the rise of open data, identifiability of individuals based on 3D renderings obtained from routine structural magnetic resonance imaging (MRI) scans of the head has become a growing privacy concern. To protect subject privacy, several algorithms have been developed to de-identify imaging data using blurring, defacing or refacing. Completely removing facial structures provides the best re-identification protection but can significantly impact post-processing steps, like brain morphometry. As an alternative, refacing methods that replace individual facial structures with generic templates have a lower effect on the geometry and intensity distribution of original scans, and are able to provide more consistent post-processing results by the price of higher re-identification risk and computational complexity. In the current study, we propose a novel method for anonymised face generation for defaced 3D T1-weighted scans based on a 3D conditional generative adversarial network. To evaluate the performance of the proposed de-identification tool, a comparative study was conducted between several existing defacing and refacing tools, with two different segmentation algorithms (FAST and Morphobox). The aim was to evaluate (i) impact on brain morphometry reproducibility, (ii) re-identification risk, (iii) balance between (i) and (ii), and (iv) the processing time. The proposed method takes 9 seconds for face generation and is suitable for recovering consistent post-processing results after defacing.
△ Less
Submitted 26 May, 2023;
originally announced May 2023.
-
Zero-shot Cross-Linguistic Learning of Event Semantics
Authors:
Malihe Alikhani,
Thomas Kober,
Bashar Alhafni,
Yue Chen,
Mert Inan,
Elizabeth Nielsen,
Shahab Raji,
Mark Steedman,
Matthew Stone
Abstract:
Typologically diverse languages offer systems of lexical and grammatical aspect that allow speakers to focus on facets of event structure in ways that comport with the specific communicative setting and discourse constraints they face. In this paper, we look specifically at captions of images across Arabic, Chinese, Farsi, German, Russian, and Turkish and describe a computational model for predict…
▽ More
Typologically diverse languages offer systems of lexical and grammatical aspect that allow speakers to focus on facets of event structure in ways that comport with the specific communicative setting and discourse constraints they face. In this paper, we look specifically at captions of images across Arabic, Chinese, Farsi, German, Russian, and Turkish and describe a computational model for predicting lexical aspects. Despite the heterogeneity of these languages, and the salient invocation of distinctive linguistic resources across their caption corpora, speakers of these languages show surprising similarities in the ways they frame image content. We leverage this observation for zero-shot cross-lingual learning and show that lexical aspects can be predicted for a given language despite not having observed any annotated data for this language at all.
△ Less
Submitted 5 July, 2022;
originally announced July 2022.
-
Validation and Generalizability of Self-Supervised Image Reconstruction Methods for Undersampled MRI
Authors:
Thomas Yu,
Tom Hilbert,
Gian Franco Piredda,
Arun Joseph,
Gabriele Bonanno,
Salim Zenkhri,
Patrick Omoumi,
Meritxell Bach Cuadra,
Erick Jorge Canales-Rodríguez,
Tobias Kober,
Jean-Philippe Thiran
Abstract:
Deep learning methods have become the state of the art for undersampled MR reconstruction. Particularly for cases where it is infeasible or impossible for ground truth, fully sampled data to be acquired, self-supervised machine learning methods for reconstruction are becoming increasingly used. However potential issues in the validation of such methods, as well as their generalizability, remain un…
▽ More
Deep learning methods have become the state of the art for undersampled MR reconstruction. Particularly for cases where it is infeasible or impossible for ground truth, fully sampled data to be acquired, self-supervised machine learning methods for reconstruction are becoming increasingly used. However potential issues in the validation of such methods, as well as their generalizability, remain underexplored. In this paper, we investigate important aspects of the validation of self-supervised algorithms for reconstruction of undersampled MR images: quantitative evaluation of prospective reconstructions, potential differences between prospective and retrospective reconstructions, suitability of commonly used quantitative metrics, and generalizability. Two self-supervised algorithms based on self-supervised denoising and the deep image prior were investigated. These methods are compared to a least squares fitting and a compressed sensing reconstruction using in-vivo and phantom data. Their generalizability was tested with prospectively under-sampled data from experimental conditions different to the training. We show that prospective reconstructions can exhibit significant distortion relative to retrospective reconstructions/ground truth. Furthermore, pixel-wise quantitative metrics may not capture differences in perceptual quality accurately, in contrast to a perceptual metric. In addition, all methods showed potential for generalization; however, generalizability is more affected by changes in anatomy/contrast than other changes. We further showed that no-reference image metrics correspond well with human rating of image quality for studying generalizability. Finally, we showed that a well-tuned compressed sensing reconstruction and learned denoising perform similarly on all data.
△ Less
Submitted 12 September, 2022; v1 submitted 29 January, 2022;
originally announced January 2022.
-
Cortical lesions, central vein sign, and paramagnetic rim lesions in multiple sclerosis: emerging machine learning techniques and future avenues
Authors:
Francesco La Rosa,
Maxence Wynen,
Omar Al-Louzi,
Erin S Beck,
Till Huelnhagen,
Pietro Maggi,
Jean-Philippe Thiran,
Tobias Kober,
Russell T Shinohara,
Pascal Sati,
Daniel S Reich,
Cristina Granziera,
Martina Absinta,
Meritxell Bach Cuadra
Abstract:
The current multiple sclerosis (MS) diagnostic criteria lack specificity, and this may lead to misdiagnosis, which remains an issue in present-day clinical practice. In addition, conventional biomarkers only moderately correlate with MS disease progression. Recently, advanced MS lesional imaging biomarkers such as cortical lesions (CL), the central vein sign (CVS), and paramagnetic rim lesions (PR…
▽ More
The current multiple sclerosis (MS) diagnostic criteria lack specificity, and this may lead to misdiagnosis, which remains an issue in present-day clinical practice. In addition, conventional biomarkers only moderately correlate with MS disease progression. Recently, advanced MS lesional imaging biomarkers such as cortical lesions (CL), the central vein sign (CVS), and paramagnetic rim lesions (PRL), visible in specialized magnetic resonance imaging (MRI) sequences, have shown higher specificity in differential diagnosis. Moreover, studies have shown that CL and PRL are potential prognostic biomarkers, the former correlating with cognitive impairments and the latter with early disability progression. As machine learning-based methods have achieved extraordinary performance in the assessment of conventional imaging biomarkers, such as white matter lesion segmentation, several automated or semi-automated methods have been proposed for CL, CVS, and PRL as well. In the present review, we first introduce these advanced MS imaging biomarkers and their imaging methods. Subsequently, we describe the corresponding machine learning-based methods that were used to tackle these clinical questions, putting them into context with respect to the challenges they are still facing, including non-standardized MRI protocols, limited datasets, and moderate inter-rater variability. We conclude by presenting the current limitations that prevent their broader deployment and suggesting future research directions.
△ Less
Submitted 19 January, 2022;
originally announced January 2022.
-
FaBiAN: A Fetal Brain magnetic resonance Acquisition Numerical phantom
Authors:
Hélène Lajous,
Christopher W. Roy,
Tom Hilbert,
Priscille de Dumast,
Sébastien Tourbier,
Yasser Alemán-Gómez,
Jérôme Yerly,
Thomas Yu,
Hamza Kebiri,
Kelly Payette,
Jean-Baptiste Ledoux,
Reto Meuli,
Patric Hagmann,
Andras Jakab,
Vincent Dunet,
Mériam Koob,
Tobias Kober,
Matthias Stuber,
Meritxell Bach Cuadra
Abstract:
Accurate characterization of in utero human brain maturation is critical as it involves complex and interconnected structural and functional processes that may influence health later in life. Magnetic resonance imaging is a powerful tool to investigate equivocal neurological patterns during fetal development. However, the number of acquisitions of satisfactory quality available in this cohort of s…
▽ More
Accurate characterization of in utero human brain maturation is critical as it involves complex and interconnected structural and functional processes that may influence health later in life. Magnetic resonance imaging is a powerful tool to investigate equivocal neurological patterns during fetal development. However, the number of acquisitions of satisfactory quality available in this cohort of sensitive subjects remains scarce, thus hindering the validation of advanced image processing techniques. Numerical phantoms can mitigate these limitations by providing a controlled environment with a known ground truth. In this work, we present FaBiAN, an open-source Fetal Brain magnetic resonance Acquisition Numerical phantom that simulates clinical T2-weighted fast spin echo sequences of the fetal brain. This unique tool is based on a general, flexible and realistic setup that includes stochastic fetal movements, thus providing images of the fetal brain throughout maturation comparable to clinical acquisitions. We demonstrate its value to evaluate the robustness and optimize the accuracy of an algorithm for super-resolution fetal brain magnetic resonance imaging from simulated motion-corrupted 2D low-resolution series as compared to a synthetic high-resolution reference volume. We also show that the images generated can complement clinical datasets to support data-intensive deep learning methods for fetal brain tissue segmentation.
△ Less
Submitted 6 September, 2021;
originally announced September 2021.
-
Multi-compartment diffusion MRI, T2 relaxometry and myelin water imaging as neuroimaging descriptors for anomalous tissue detection
Authors:
Elda Fischi-Gomez,
Jonathan Rafael-Patino,
Marco Pizzolato,
Gian Franco Piredda,
Tom Hilbert,
Tobias Kober,
Erick J. Canales-Rodriguez,
Jean-Philippe Thiran
Abstract:
Multiple sclerosis (MS) is an inflammatory and neurodegenerative disease characterized by diffuse and focal areas of tissue loss. Conventional MRI techniques such as T1-weighted and T2-weighted scans are generally used in the diagnosis and prognosis of the disease. Yet, these methods are limited by the lack of specificity between lesions, their perilesional area and non-lesional tissue. Alternativ…
▽ More
Multiple sclerosis (MS) is an inflammatory and neurodegenerative disease characterized by diffuse and focal areas of tissue loss. Conventional MRI techniques such as T1-weighted and T2-weighted scans are generally used in the diagnosis and prognosis of the disease. Yet, these methods are limited by the lack of specificity between lesions, their perilesional area and non-lesional tissue. Alternative MRI techniques exhibit a higher level of sensitivity to focal and diffuse MS pathology than conventional MRI acquisitions. However, they still suffer from limited specificity when considered alone. In this work, we have combined tissue microstructure information derived from multicompartment diffusion MRI and T2 relaxometry models to explore the voxel-based prediction power of a machine learning model in a cohort of MS patients and healthy controls. Our results show that the combination of multi-modal features, together with a boosting enhanced decision-tree based classifier, which combines a set of weak classifiers to form a strong classifier via a voting mechanism, is able to utilise the complementary information for the classification of abnormal tissue.
△ Less
Submitted 15 April, 2021;
originally announced April 2021.
-
Aspectuality Across Genre: A Distributional Semantics Approach
Authors:
Thomas Kober,
Malihe Alikhani,
Matthew Stone,
Mark Steedman
Abstract:
The interpretation of the lexical aspect of verbs in English plays a crucial role for recognizing textual entailment and learning discourse-level inferences. We show that two elementary dimensions of aspectual class, states vs. events, and telic vs. atelic events, can be modelled effectively with distributional semantics. We find that a verb's local context is most indicative of its aspectual clas…
▽ More
The interpretation of the lexical aspect of verbs in English plays a crucial role for recognizing textual entailment and learning discourse-level inferences. We show that two elementary dimensions of aspectual class, states vs. events, and telic vs. atelic events, can be modelled effectively with distributional semantics. We find that a verb's local context is most indicative of its aspectual class, and demonstrate that closed class words tend to be stronger discriminating contexts than content words. Our approach outperforms previous work on three datasets. Lastly, we contribute a dataset of human--human conversations annotated with lexical aspect and present experiments that show the correlation of telicity with genre and discourse goals.
△ Less
Submitted 31 October, 2020;
originally announced November 2020.
-
STAR: A Schema-Guided Dialog Dataset for Transfer Learning
Authors:
Johannes E. M. Mosig,
Shikib Mehri,
Thomas Kober
Abstract:
We present STAR, a schema-guided task-oriented dialog dataset consisting of 127,833 utterances and knowledge base queries across 5,820 task-oriented dialogs in 13 domains that is especially designed to facilitate task and domain transfer learning in task-oriented dialog. Furthermore, we propose a scalable crowd-sourcing paradigm to collect arbitrarily large datasets of the same quality as STAR. Mo…
▽ More
We present STAR, a schema-guided task-oriented dialog dataset consisting of 127,833 utterances and knowledge base queries across 5,820 task-oriented dialogs in 13 domains that is especially designed to facilitate task and domain transfer learning in task-oriented dialog. Furthermore, we propose a scalable crowd-sourcing paradigm to collect arbitrarily large datasets of the same quality as STAR. Moreover, we introduce novel schema-guided dialog models that use an explicit description of the task(s) to generalize from known to unknown tasks. We demonstrate the effectiveness of these models, particularly for zero-shot generalization across tasks and domains.
△ Less
Submitted 22 October, 2020;
originally announced October 2020.
-
Going Beyond T-SNE: Exposing \texttt{whatlies} in Text Embeddings
Authors:
Vincent D. Warmerdam,
Thomas Kober,
Rachael Tatman
Abstract:
We introduce whatlies, an open source toolkit for visually inspecting word and sentence embeddings. The project offers a unified and extensible API with current support for a range of popular embedding backends including spaCy, tfhub, huggingface transformers, gensim, fastText and BytePair embeddings. The package combines a domain specific language for vector arithmetic with visualisation tools th…
▽ More
We introduce whatlies, an open source toolkit for visually inspecting word and sentence embeddings. The project offers a unified and extensible API with current support for a range of popular embedding backends including spaCy, tfhub, huggingface transformers, gensim, fastText and BytePair embeddings. The package combines a domain specific language for vector arithmetic with visualisation tools that make exploring word embeddings more intuitive and concise. It offers support for many popular dimensionality reduction techniques as well as many interactive visualisations that can either be statically exported or shared via Jupyter notebooks. The project documentation is available from https://rasahq.github.io/whatlies/.
△ Less
Submitted 4 September, 2020;
originally announced September 2020.
-
T2 Map** from Super-Resolution-Reconstructed Clinical Fast Spin Echo Magnetic Resonance Acquisitions
Authors:
Hélène Lajous,
Tom Hilbert,
Christopher W. Roy,
Sébastien Tourbier,
Priscille de Dumast,
Thomas Yu,
Jean-Philippe Thiran,
Jean-Baptiste Ledoux,
Davide Piccini,
Patric Hagmann,
Reto Meuli,
Tobias Kober,
Matthias Stuber,
Ruud B. van Heeswijk,
Meritxell Bach Cuadra
Abstract:
Relaxometry studies in preterm and at-term newborns have provided insight into brain microstructure, thus opening new avenues for studying normal brain development and supporting diagnosis in equivocal neurological situations. However, such quantitative techniques require long acquisition times and therefore cannot be straightforwardly translated to in utero brain developmental studies. In clinica…
▽ More
Relaxometry studies in preterm and at-term newborns have provided insight into brain microstructure, thus opening new avenues for studying normal brain development and supporting diagnosis in equivocal neurological situations. However, such quantitative techniques require long acquisition times and therefore cannot be straightforwardly translated to in utero brain developmental studies. In clinical fetal brain magnetic resonance imaging routine, 2D low-resolution T2-weighted fast spin echo sequences are used to minimize the effects of unpredictable fetal motion during acquisition. As super-resolution techniques make it possible to reconstruct a 3D high-resolution volume of the fetal brain from clinical low-resolution images, their combination with quantitative acquisition schemes could provide fast and accurate T2 measurements. In this context, the present work demonstrates the feasibility of using super-resolution reconstruction from conventional T2-weighted fast spin echo sequences for 3D isotropic T2 map**. A quantitative magnetic resonance phantom was imaged using a clinical T2-weighted fast spin echo sequence at variable echo time to allow for super-resolution reconstruction at every echo time and subsequent T2 map** of samples whose relaxometric properties are close to those of fetal brain tissue. We demonstrate that this approach is highly repeatable, accurate and robust when using six echo times (total acquisition time under 9 minutes) as compared to gold-standard single-echo spin echo sequences (several hours for one single 2D slice).
△ Less
Submitted 23 July, 2020;
originally announced July 2020.
-
Model-Informed Machine Learning for Multi-component T2 Relaxometry
Authors:
Thomas Yu,
Erick Jorge Canales Rodriguez,
Marco Pizzolato,
Gian Franco Piredda,
Tom Hilbert,
Elda Fischi-Gomez,
Matthias Weigel,
Muhamed Barakovic,
Meritxell Bach-Cuadra,
Cristina Granziera,
Tobias Kober,
Jean-Philippe Thiran
Abstract:
Recovering the T2 distribution from multi-echo T2 magnetic resonance (MR) signals is challenging but has high potential as it provides biomarkers characterizing the tissue micro-structure, such as the myelin water fraction (MWF). In this work, we propose to combine machine learning and aspects of parametric (fitting from the MRI signal using biophysical models) and non-parametric (model-free fitti…
▽ More
Recovering the T2 distribution from multi-echo T2 magnetic resonance (MR) signals is challenging but has high potential as it provides biomarkers characterizing the tissue micro-structure, such as the myelin water fraction (MWF). In this work, we propose to combine machine learning and aspects of parametric (fitting from the MRI signal using biophysical models) and non-parametric (model-free fitting of the T2 distribution from the signal) approaches to T2 relaxometry in brain tissue by using a multi-layer perceptron (MLP) for the distribution reconstruction. For training our network, we construct an extensive synthetic dataset derived from biophysical models in order to constrain the outputs with \textit{a priori} knowledge of \textit{in vivo} distributions. The proposed approach, called Model-Informed Machine Learning (MIML), takes as input the MR signal and directly outputs the associated T2 distribution. We evaluate MIML in comparison to non-parametric and parametric approaches on synthetic data, an ex vivo scan, and high-resolution scans of healthy subjects and a subject with Multiple Sclerosis. In synthetic data, MIML provides more accurate and noise-robust distributions. In real data, MWF maps derived from MIML exhibit the greatest conformity to anatomical scans, have the highest correlation to a histological map of myelin volume, and the best unambiguous lesion visualization and localization, with superior contrast between lesions and normal appearing tissue. In whole-brain analysis, MIML is 22 to 4980 times faster than non-parametric and parametric methods, respectively.
△ Less
Submitted 20 July, 2020;
originally announced July 2020.
-
SPARCQ: A new approach for fat fraction map** using asymmetries in the phase-cycled bSSFP signal profile
Authors:
Giulia MC Rossi,
Adele LC Mackowiak,
Tom Hilbert,
Berk C Acikgoz,
Katarzyna Pierzchała,
Tobias Kober,
Jessica AM Bastiaansen
Abstract:
Purpose: To develop SPARCQ (Signal Profile Asymmetries for Rapid Compartment Quantification), a novel approach to quantify fat fraction using asymmetries in the phase-cycled bSSFP profile. Methods: SPARCQ uses phase-cycling to obtain bSSFP frequency profiles, which display asymmetries in the presence of fat and water at certain repetition times. For each voxel, the measured signal profile is decom…
▽ More
Purpose: To develop SPARCQ (Signal Profile Asymmetries for Rapid Compartment Quantification), a novel approach to quantify fat fraction using asymmetries in the phase-cycled bSSFP profile. Methods: SPARCQ uses phase-cycling to obtain bSSFP frequency profiles, which display asymmetries in the presence of fat and water at certain repetition times. For each voxel, the measured signal profile is decomposed into a weighted sum of simulated profiles via multi-compartment dictionary matching. Each dictionary entry represents a single-compartment bSSFP profile with a specific off-resonance frequency and relaxation time ratio. Using the results of dictionary matching, the fractions of the different off-resonance components are extracted for each voxel, generating quantitative maps of water and fat fraction and banding-artifact-free images for the entire image volume. SPARCQ was validated using simulations, experiments in a water-fat phantom and in knees of healthy volunteers. Experimental results were compared with reference proton density fat fractions obtained with 1H-MRS (phantoms) and with multiecho gradient-echo MRI (phantoms and volunteers). SPARCQ repeatability was evaluated in six scan-rescan experiments. Results: Simulations showed that fat fraction quantification is accurate and robust for signal-to-noise ratios greater than 20. Phantom experiments demonstrated good agreement between SPARCQ and gold standard fat fractions. In volunteers, banding-artifact-free quantitative maps and water-fat-separated images obtained with SPARCQ and ME-GRE demonstrated the expected contrast between fatty and non-fatty tissues. The coefficient of repeatability of SPARCQ fat fraction was 0.0512. Conclusion: SPARCQ demonstrates potential for fat quantification using asymmetries in bSSFP profiles, and may be a promising alternative to conventional fat fraction quantification techniques.
△ Less
Submitted 13 April, 2023; v1 submitted 19 May, 2020;
originally announced May 2020.
-
Data Augmentation for Hypernymy Detection
Authors:
Thomas Kober,
Julie Weeds,
Lorenzo Bertolini,
David Weir
Abstract:
The automatic detection of hypernymy relationships represents a challenging problem in NLP. The successful application of state-of-the-art supervised approaches using distributed representations has generally been impeded by the limited availability of high quality training data. We have developed two novel data augmentation techniques which generate new training examples from existing ones. First…
▽ More
The automatic detection of hypernymy relationships represents a challenging problem in NLP. The successful application of state-of-the-art supervised approaches using distributed representations has generally been impeded by the limited availability of high quality training data. We have developed two novel data augmentation techniques which generate new training examples from existing ones. First, we combine the linguistic principles of hypernym transitivity and intersective modifier-noun composition to generate additional pairs of vectors, such as "small dog - dog" or "small dog - animal", for which a hypernymy relationship can be assumed. Second, we use generative adversarial networks (GANs) to generate pairs of vectors for which the hypernymy relation can also be assumed. We furthermore present two complementary strategies for extending an existing dataset by leveraging linguistic resources such as WordNet. Using an evaluation across 3 different datasets for hypernymy detection and 2 different vector spaces, we demonstrate that both of the proposed automatic data augmentation and dataset extension strategies substantially improve classifier performance.
△ Less
Submitted 21 January, 2021; v1 submitted 4 May, 2020;
originally announced May 2020.
-
Compressed Sensing with Signal Averaging for Improved Sensitivity and Motion Artifact Reduction in Fluorine-19 MRI
Authors:
Emeline Darçot,
Jérôme Yerly,
Tom Hilbert,
Roberto Colotti,
Elena Najdenovska,
Tobias Kober,
Matthias Stuber,
Ruud B. van Heeswijk
Abstract:
Fluorine-19 (19F) MRI of injected perfluorocarbon emulsions (PFCs) allows for the non-invasive quantification of inflammation and cell tracking, but suffers from a low signal-to-noise ratio and extended scan time. To address this limitation, we tested the hypothesis that a 19F MRI pulse sequence that combines a specific undersampling regime with signal averaging has increased sensitivity and robus…
▽ More
Fluorine-19 (19F) MRI of injected perfluorocarbon emulsions (PFCs) allows for the non-invasive quantification of inflammation and cell tracking, but suffers from a low signal-to-noise ratio and extended scan time. To address this limitation, we tested the hypothesis that a 19F MRI pulse sequence that combines a specific undersampling regime with signal averaging has increased sensitivity and robustness against motion artifacts compared to a non-averaged fully-sampled dataset, when both are reconstructed with compressed sensing. To this end, numerical simulations and phantom experiments were performed to characterize the point spread function (PSF) of undersampling patterns and the vulnerability to noise of acquisition-reconstruction strategies with paired numbers of x signal averages and acceleration factor x (NAx-AFx). At all investigated noise levels, the DSC of the acquisition-reconstruction strategies strongly depended on the regularization parameters and acceleration factor. In phantoms, motion robustness of an NA8-AF8 undersampling pattern versus NA1-AF1 was evaluated with simulated and real motions. Differences were assessed with Dice similarity coefficients (DSC), and were consistently higher for NA8-AF8 compared to NA1-AF1 strategy, for both simulated and real cyclic motions (P<0.001). Both acquisition-reconstruction strategies were validated in vivo in mice (n=2) injected with perfluoropolyether. These images displayed a sharper delineation of the liver with the NA8-AF8 strategy than with the NA1-AF1 strategy. In conclusion, we validated the hypothesis that in 19F MRI, the combination of undersampling and averaging improves both the sensitivity and the robustness against motion artifacts compared to a non-averaged fully-sampled dataset, when both are reconstructed with compressed sensing.
△ Less
Submitted 8 October, 2020; v1 submitted 10 September, 2019;
originally announced September 2019.
-
Magnetization Transfer in Magnetic Resonance Fingerprinting
Authors:
Tom Hilbert,
Ding Xia,
Kai Tobias Block,
Zidan Yu,
Riccardo Lattanzi,
Daniel K. Sodickson,
Tobias Kober,
Martijn A. Cloos
Abstract:
Purpose: To study the effects of magnetization transfer (MT, in which a semisolid spin pool interacts with the free pool), in the context of magnetic resonance fingerprinting (MRF).
Methods: Simulations and phantom experiments were performed to study the impact of MT on the MRF signal and its potential influence on T1 and T2 estimation. Subsequently, an MRF sequence implementing off-resonance MT…
▽ More
Purpose: To study the effects of magnetization transfer (MT, in which a semisolid spin pool interacts with the free pool), in the context of magnetic resonance fingerprinting (MRF).
Methods: Simulations and phantom experiments were performed to study the impact of MT on the MRF signal and its potential influence on T1 and T2 estimation. Subsequently, an MRF sequence implementing off-resonance MT pulses and a dictionary with an MT dimension by incorporating a two-pool model were used to estimate the fractional pool size in addition to the B1+, T1, and T2 values. The proposed method was evaluated in the human brain.
Results: Simulations and phantom experiments showed that an MRF signal obtained from a cross-linked bovine serum sample is influenced by MT. Using a dictionary based on an MT model, a better match between simulations and acquired MR signals can be obtained (NRMSE 1.3% versus 4.7%). Adding off-resonance MT pulses can improve the differentiation of MT from T1 and T2. In-vivo results showed that MT affects the MRF signals from white matter (fractional pool-size ~16%) and gray matter (fractional pool-size ~10%). Furthermore, longer T1 (~1060 ms versus ~860 ms) and T2 values (~47 ms versus ~35 ms) can be observed in white matter if MT is accounted for.
Conclusion: Our experiments demonstrated a potential influence of MT on the quantification of T1 and T2 with MRF. A model that encompasses MT effects can improve the accuracy of estimated relaxation parameters and allows quantification of the fractional pool size.
△ Less
Submitted 30 July, 2019;
originally announced July 2019.
-
Temporal and Aspectual Entailment
Authors:
Thomas Kober,
Sander Bijl de Vroe,
Mark Steedman
Abstract:
Inferences regarding "Jane's arrival in London" from predications such as "Jane is going to London" or "Jane has gone to London" depend on tense and aspect of the predications. Tense determines the temporal location of the predication in the past, present or future of the time of utterance. The aspectual auxiliaries on the other hand specify the internal constituency of the event, i.e. whether the…
▽ More
Inferences regarding "Jane's arrival in London" from predications such as "Jane is going to London" or "Jane has gone to London" depend on tense and aspect of the predications. Tense determines the temporal location of the predication in the past, present or future of the time of utterance. The aspectual auxiliaries on the other hand specify the internal constituency of the event, i.e. whether the event of "going to London" is completed and whether its consequences hold at that time or not. While tense and aspect are among the most important factors for determining natural language inference, there has been very little work to show whether modern NLP models capture these semantic concepts. In this paper we propose a novel entailment dataset and analyse the ability of a range of recently proposed NLP models to perform inference on temporal predications. We show that the models encode a substantial amount of morphosyntactic information relating to tense and aspect, but fail to model inferences that require reasoning with these semantic properties.
△ Less
Submitted 2 April, 2019;
originally announced April 2019.
-
Shallow vs deep learning architectures for white matter lesion segmentation in the early stages of multiple sclerosis
Authors:
Francesco La Rosa,
Mário João Fartaria,
Tobias Kober,
Jonas Richiardi,
Cristina Granziera,
Jean-Philippe Thiran,
Meritxell Bach Cuadra
Abstract:
In this work, we present a comparison of a shallow and a deep learning architecture for the automated segmentation of white matter lesions in MR images of multiple sclerosis patients. In particular, we train and test both methods on early stage disease patients, to verify their performance in challenging conditions, more similar to a clinical setting than what is typically provided in multiple scl…
▽ More
In this work, we present a comparison of a shallow and a deep learning architecture for the automated segmentation of white matter lesions in MR images of multiple sclerosis patients. In particular, we train and test both methods on early stage disease patients, to verify their performance in challenging conditions, more similar to a clinical setting than what is typically provided in multiple sclerosis segmentation challenges. Furthermore, we evaluate a prototype naive combination of the two methods, which refines the final segmentation. All methods were trained on 32 patients, and the evaluation was performed on a pure test set of 73 cases. Results show low lesion-wise false positives (30%) for the deep learning architecture, whereas the shallow architecture yields the best Dice coefficient (63%) and volume difference (19%). Combining both shallow and deep architectures further improves the lesion-wise metrics (69% and 26% lesion-wise true and false positive rate, respectively).
△ Less
Submitted 10 September, 2018;
originally announced September 2018.
-
Improving Semantic Composition with Offset Inference
Authors:
Thomas Kober,
Julie Weeds,
Jeremy Reffin,
David Weir
Abstract:
Count-based distributional semantic models suffer from sparsity due to unobserved but plausible co-occurrences in any text collection. This problem is amplified for models like Anchored Packed Trees (APTs), that take the grammatical type of a co-occurrence into account. We therefore introduce a novel form of distributional inference that exploits the rich type structure in APTs and infers missing…
▽ More
Count-based distributional semantic models suffer from sparsity due to unobserved but plausible co-occurrences in any text collection. This problem is amplified for models like Anchored Packed Trees (APTs), that take the grammatical type of a co-occurrence into account. We therefore introduce a novel form of distributional inference that exploits the rich type structure in APTs and infers missing data by the same mechanism that is used for semantic composition.
△ Less
Submitted 21 April, 2017;
originally announced April 2017.
-
One Representation per Word - Does it make Sense for Composition?
Authors:
Thomas Kober,
Julie Weeds,
John Wilkie,
Jeremy Reffin,
David Weir
Abstract:
In this paper, we investigate whether an a priori disambiguation of word senses is strictly necessary or whether the meaning of a word in context can be disambiguated through composition alone. We evaluate the performance of off-the-shelf single-vector and multi-sense vector models on a benchmark phrase similarity task and a novel task for word-sense discrimination. We find that single-sense vecto…
▽ More
In this paper, we investigate whether an a priori disambiguation of word senses is strictly necessary or whether the meaning of a word in context can be disambiguated through composition alone. We evaluate the performance of off-the-shelf single-vector and multi-sense vector models on a benchmark phrase similarity task and a novel task for word-sense discrimination. We find that single-sense vector models perform as well or better than multi-sense vector models despite arguably less clean elementary representations. Our findings furthermore show that simple composition functions such as pointwise addition are able to recover sense specific information from a single-sense vector model remarkably well.
△ Less
Submitted 22 February, 2017;
originally announced February 2017.
-
Aligning Packed Dependency Trees: a theory of composition for distributional semantics
Authors:
David Weir,
Julie Weeds,
Jeremy Reffin,
Thomas Kober
Abstract:
We present a new framework for compositional distributional semantics in which the distributional contexts of lexemes are expressed in terms of anchored packed dependency trees. We show that these structures have the potential to capture the full sentential contexts of a lexeme and provide a uniform basis for the composition of distributional knowledge in a way that captures both mutual disambigua…
▽ More
We present a new framework for compositional distributional semantics in which the distributional contexts of lexemes are expressed in terms of anchored packed dependency trees. We show that these structures have the potential to capture the full sentential contexts of a lexeme and provide a uniform basis for the composition of distributional knowledge in a way that captures both mutual disambiguation and generalization.
△ Less
Submitted 25 August, 2016;
originally announced August 2016.
-
Improving Sparse Word Representations with Distributional Inference for Semantic Composition
Authors:
Thomas Kober,
Julie Weeds,
Jeremy Reffin,
David Weir
Abstract:
Distributional models are derived from co-occurrences in a corpus, where only a small proportion of all possible plausible co-occurrences will be observed. This results in a very sparse vector space, requiring a mechanism for inferring missing knowledge. Most methods face this challenge in ways that render the resulting word representations uninterpretable, with the consequence that semantic compo…
▽ More
Distributional models are derived from co-occurrences in a corpus, where only a small proportion of all possible plausible co-occurrences will be observed. This results in a very sparse vector space, requiring a mechanism for inferring missing knowledge. Most methods face this challenge in ways that render the resulting word representations uninterpretable, with the consequence that semantic composition becomes hard to model. In this paper we explore an alternative which involves explicitly inferring unobserved co-occurrences using the distributional neighbourhood. We show that distributional inference improves sparse word representations on several word similarity benchmarks and demonstrate that our model is competitive with the state-of-the-art for adjective-noun, noun-noun and verb-object compositions while being fully interpretable.
△ Less
Submitted 24 August, 2016;
originally announced August 2016.