-
MR sequence design using digital twins of non-idealized hardware
Authors:
Daniel J West,
Felix Glang,
Jonathan Endres,
David Leitão,
Moritz Zaiss,
Joseph V Hajnal,
Shaihan J Malik
Abstract:
MRI systems are traditionally engineered to produce close to idealized performance, enabling a simplified pulse sequence design philosophy. An example of this is control of eddy currents produced by gradient fields; usually these are compensated by pre-emphasizing demanded waveforms. This process typically happens invisibly to the pulse designer, allowing them to assume the achieved gradient wavef…
▽ More
MRI systems are traditionally engineered to produce close to idealized performance, enabling a simplified pulse sequence design philosophy. An example of this is control of eddy currents produced by gradient fields; usually these are compensated by pre-emphasizing demanded waveforms. This process typically happens invisibly to the pulse designer, allowing them to assume the achieved gradient waveform will be as desired. Whilst convenient, this imposes stricter limits on the sequence design than the hardware can handle (for example, pre-emphasis adds an additional overhead to amplifiers). This strategy can be undesirable particularly for lower performance or resource-limited hardware. Instead we explore the use of a 'digital twin' (i.e. an end-to-end model of the scanner system) to optimize control inputs, resulting in sequences that inherently compensate for known imperfections. We explore digital twin optimization specifically for gradient system imperfections as an exemplar. This is first explored in simulations using a simple exponential eddy current model, then experimentally using an empirical gradient impulse response function on a 7T MRI system. When unconstrained, digital twin optimization reproduces classic pre-emphasis. When strict hardware constraints are imposed (simulating lower performance hardware), it identifies novel sequences for scenarios where classic pre-emphasis would be unachievable. Experimentally, the optimization approach was demonstrated to substantially reduce ghosting effects in echo planar images on a 7T system. Digital twin optimization may allow more efficient use of hardware by taking a whole system approach. Ultimately this could enable the use of cheaper hardware without loss of performance.
△ Less
Submitted 26 March, 2024;
originally announced March 2024.
-
Cost-Sensitive Learning to Defer to Multiple Experts with Workload Constraints
Authors:
Jean V. Alves,
Diogo Leitão,
Sérgio Jesus,
Marco O. P. Sampaio,
Javier Liébana,
Pedro Saleiro,
Mário A. T. Figueiredo,
Pedro Bizarro
Abstract:
Learning to defer (L2D) aims to improve human-AI collaboration systems by learning how to defer decisions to humans when they are more likely to be correct than an ML classifier. Existing research in L2D overlooks key aspects of real-world systems that impede its practical adoption, namely: i) neglecting cost-sensitive scenarios, where type 1 and type 2 errors have different costs; ii) requiring c…
▽ More
Learning to defer (L2D) aims to improve human-AI collaboration systems by learning how to defer decisions to humans when they are more likely to be correct than an ML classifier. Existing research in L2D overlooks key aspects of real-world systems that impede its practical adoption, namely: i) neglecting cost-sensitive scenarios, where type 1 and type 2 errors have different costs; ii) requiring concurrent human predictions for every instance of the training dataset and iii) not dealing with human work capacity constraints. To address these issues, we propose the deferral under cost and capacity constraints framework (DeCCaF). DeCCaF is a novel L2D approach, employing supervised learning to model the probability of human error under less restrictive data requirements (only one expert prediction per instance) and using constraint programming to globally minimize the error cost subject to workload limitations. We test DeCCaF in a series of cost-sensitive fraud detection scenarios with different teams of 9 synthetic fraud analysts, with individual work capacity constraints. The results demonstrate that our approach performs significantly better than the baselines in a wide array of scenarios, achieving an average 8.4% reduction in the misclassification cost.
△ Less
Submitted 21 March, 2024; v1 submitted 11 March, 2024;
originally announced March 2024.
-
FiFAR: A Fraud Detection Dataset for Learning to Defer
Authors:
Jean V. Alves,
Diogo Leitão,
Sérgio Jesus,
Marco O. P. Sampaio,
Pedro Saleiro,
Mário A. T. Figueiredo,
Pedro Bizarro
Abstract:
Public dataset limitations have significantly hindered the development and benchmarking of learning to defer (L2D) algorithms, which aim to optimally combine human and AI capabilities in hybrid decision-making systems. In such systems, human availability and domain-specific concerns introduce difficulties, while obtaining human predictions for training and evaluation is costly. Financial fraud det…
▽ More
Public dataset limitations have significantly hindered the development and benchmarking of learning to defer (L2D) algorithms, which aim to optimally combine human and AI capabilities in hybrid decision-making systems. In such systems, human availability and domain-specific concerns introduce difficulties, while obtaining human predictions for training and evaluation is costly. Financial fraud detection is a high-stakes setting where algorithms and human experts often work in tandem; however, there are no publicly available datasets for L2D concerning this important application of human-AI teaming. To fill this gap in L2D research, we introduce the Financial Fraud Alert Review Dataset (FiFAR), a synthetic bank account fraud detection dataset, containing the predictions of a team of 50 highly complex and varied synthetic fraud analysts, with varied bias and feature dependence. We also provide a realistic definition of human work capacity constraints, an aspect of L2D systems that is often overlooked, allowing for extensive testing of assignment systems under real-world conditions. We use our dataset to develop a capacity-aware L2D method and rejection learning approach under realistic data availability conditions, and benchmark these baselines under an array of 300 distinct testing scenarios. We believe that this dataset will serve as a pivotal instrument in facilitating a systematic, rigorous, reproducible, and transparent evaluation and comparison of L2D methods, thereby fostering the development of more synergistic human-AI collaboration in decision-making systems. The public dataset and detailed synthetic expert information are available at: https://github.com/feedzai/fifar-dataset
△ Less
Submitted 20 December, 2023;
originally announced December 2023.
-
Human-AI Collaboration in Decision-Making: Beyond Learning to Defer
Authors:
Diogo Leitão,
Pedro Saleiro,
Mário A. T. Figueiredo,
Pedro Bizarro
Abstract:
Human-AI collaboration (HAIC) in decision-making aims to create synergistic teaming between human decision-makers and AI systems. Learning to defer (L2D) has been presented as a promising framework to determine who among humans and AI should make which decisions in order to optimize the performance and fairness of the combined system. Nevertheless, L2D entails several often unfeasible requirements…
▽ More
Human-AI collaboration (HAIC) in decision-making aims to create synergistic teaming between human decision-makers and AI systems. Learning to defer (L2D) has been presented as a promising framework to determine who among humans and AI should make which decisions in order to optimize the performance and fairness of the combined system. Nevertheless, L2D entails several often unfeasible requirements, such as the availability of predictions from humans for every instance or ground-truth labels that are independent from said humans. Furthermore, neither L2D nor alternative approaches tackle fundamental issues of deploying HAIC systems in real-world settings, such as capacity management or dealing with dynamic environments. In this paper, we aim to identify and review these and other limitations, pointing to where opportunities for future research in HAIC may lie.
△ Less
Submitted 13 July, 2022; v1 submitted 27 June, 2022;
originally announced June 2022.
-
Parallel transmit PUlse design for Saturation Homogeneity (PUSH) for Magnetization Transfer imaging at 7T
Authors:
David Leitão,
Raphael Tomi-Tricot,
Pip Bridgen,
Tom Wilkinson,
Patrick Liebig,
Rene Gumbrecht,
Dieter Ritter,
Sharon L. Giles,
Ana Baburamani,
Jan Sedlacik,
Joseph V. Hajnal,
Shaihan J. Malik
Abstract:
Purpose: This work proposes a novel RF pulse design for parallel transmit (pTx) systems to obtain uniform saturation of semisolid magnetization for Magnetization Transfer (MT) contrast in the presence of transmit field ($B_1^+$) inhomogeneities. The semisolid magnetization is usually modeled as being purely longitudinal, with the applied $B_1^+$ field saturating but not rotating its magnetization,…
▽ More
Purpose: This work proposes a novel RF pulse design for parallel transmit (pTx) systems to obtain uniform saturation of semisolid magnetization for Magnetization Transfer (MT) contrast in the presence of transmit field ($B_1^+$) inhomogeneities. The semisolid magnetization is usually modeled as being purely longitudinal, with the applied $B_1^+$ field saturating but not rotating its magnetization, thus standard pTx pulse design methods do not apply. Theory and Methods: Pulse design for Saturation Homogeneity (PUSH) optimizes pTx RF pulses by considering uniformity of root-mean squared $B_1^+$, $B_1^{rms}$, which relates to the rate of semisolid saturation. Here we considered designs consisting of a small number of spatially non-selective sub-pulses optimized over either a single 2D plane or 3D. Simulations and in vivo experiments on a 7T Terra system with an 8-TX Nova head coil in 5 subjects were carried out to study the homogenization of $B_1^{rms}$ and of the MT contrast by acquiring MT ratio maps. Results: Simulations and in vivo experiments showed up to 6 and 2 times more uniform $B_1^{rms}$ compared to circular polarized (CP) mode for 2D and 3D optimizations, respectively. This translated into 4 and 1.25 times more uniform MT contrast, consistently for all subjects, where 2 sub-pulses were enough for the implementation and coil used. Conclusion: The proposed PUSH method obtains more uniform and higher MT contrast than CP mode within the same SAR budget.
△ Less
Submitted 16 January, 2022;
originally announced January 2022.
-
A four-state magnetic tunnel junction switchable with spin-orbit torques
Authors:
Shubhankar Das,
Ariel Zaig,
Moty Schultz,
Susana Cardoso,
Diana C Leitao,
Lior Klein
Abstract:
We present a magnetic tunnel junction (MTJ) where its two ferromagnetic layers are in the form of a single ellipse (SE) and two-crossing ellipses (TCE). The MTJ exhibits four distinct resistance states corresponding to the four remanent states of the TCE structure. Flowing current in an underlying Ta layer generates in the adjacent TCE structure spin-orbit torques which induce field-free switching…
▽ More
We present a magnetic tunnel junction (MTJ) where its two ferromagnetic layers are in the form of a single ellipse (SE) and two-crossing ellipses (TCE). The MTJ exhibits four distinct resistance states corresponding to the four remanent states of the TCE structure. Flowing current in an underlying Ta layer generates in the adjacent TCE structure spin-orbit torques which induce field-free switching of the four-state MTJ between all its resistance states. The demonstrated four-state MTJ is an important step towards fabricating multi-level MTJs with numerous resistance states which could be important in various spintronics applications, such as multi-level magnetic random access or neuromorphic memory.
△ Less
Submitted 20 August, 2020; v1 submitted 3 July, 2020;
originally announced July 2020.
-
Efficiency analysis for quantitative MRI of T1 and T2 relaxometry methods
Authors:
David Leitão,
Rui Pedro A. G. Teixeira,
Anthony Price,
Alena Uus,
Joseph V. Hajnal,
Shaihan J. Malik
Abstract:
This study presents a comparison of quantitative MRI methods based on an efficiency metric that quantifies their intrinsic ability to extract information about tissue parameters. Under a regime of unbiased parameter estimates, an intrinsic efficiency metric $η$ was derived for fully-sampled experiments which can be used to both optimize and compare sequences. Here we optimize and compare several s…
▽ More
This study presents a comparison of quantitative MRI methods based on an efficiency metric that quantifies their intrinsic ability to extract information about tissue parameters. Under a regime of unbiased parameter estimates, an intrinsic efficiency metric $η$ was derived for fully-sampled experiments which can be used to both optimize and compare sequences. Here we optimize and compare several steady-state and transient gradient-echo based qMRI methods, such as magnetic resonance fingerprinting (MRF), for joint T1 and T2 map**. The impact of undersampling was also evaluated, assuming incoherent aliasing that is treated as noise by parameter estimation. In-vivo validation of the efficiency metric was also performed. Transient methods such as MRF can be up to 3.5 times more efficient than steady-state methods, when spatial undersampling is ignored. If incoherent aliasing is treated as noise during least-squares parameter estimation, the efficiency is reduced in proportion to the SNR of the data, with reduction factors of 5 often seen for practical SNR levels. In-vivo validation showed a very good agreement between the theoretical and experimentally predicted efficiency. This work presents and validates an efficiency metric to optimize and compare the performance of qMRI methods. Transient methods were found to be intrinsically more efficient than steady-state methods, however the effect of spatial undersampling can significantly erode this advantage.
△ Less
Submitted 1 March, 2021; v1 submitted 6 May, 2020;
originally announced May 2020.