Showing 1–39 of 39 results for author: Tamir, I

Ambient Diffusion Posterior Sampling: Solving Inverse Problems with Diffusion Models trained on Corrupted Data

Authors: Asad Aali, Giannis Daras, Brett Levac, Sidharth Kumar, Alexandros G. Dimakis, Jonathan I. Tamir

Abstract: We provide a framework for solving inverse problems with diffusion models learned from linearly corrupted data. Our method, Ambient Diffusion Posterior Sampling (A-DPS), leverages a generative model pre-trained on one type of corruption (e.g. image inpainting) to perform posterior sampling conditioned on measurements from a potentially different forward process (e.g. image blurring). We test the e… ▽ More We provide a framework for solving inverse problems with diffusion models learned from linearly corrupted data. Our method, Ambient Diffusion Posterior Sampling (A-DPS), leverages a generative model pre-trained on one type of corruption (e.g. image inpainting) to perform posterior sampling conditioned on measurements from a potentially different forward process (e.g. image blurring). We test the efficacy of our approach on standard natural image datasets (CelebA, FFHQ, and AFHQ) and we show that A-DPS can sometimes outperform models trained on clean data for several image restoration tasks in both speed and performance. We further extend the Ambient Diffusion framework to train MRI models with access only to Fourier subsampled multi-coil MRI measurements at various acceleration factors (R=2, 4, 6, 8). We again observe that models trained on highly subsampled data are better priors for solving inverse problems in the high acceleration regime than models trained on fully sampled data. We open-source our code and the trained Ambient Diffusion MRI models: https://github.com/utcsilab/ambient-diffusion-mri . △ Less

Submitted 13 March, 2024; originally announced March 2024.

Comments: Pre-print, work in progress

Optimizing Sampling Patterns for Compressed Sensing MRI with Diffusion Generative Models

Authors: Sriram Ravula, Brett Levac, Ajil Jalal, Jonathan I. Tamir, Alexandros G. Dimakis

Abstract: Diffusion-based generative models have been used as powerful priors for magnetic resonance imaging (MRI) reconstruction. We present a learning method to optimize sub-sampling patterns for compressed sensing multi-coil MRI that leverages pre-trained diffusion generative models. Crucially, during training we use a single-step reconstruction based on the posterior mean estimate given by the diffusion… ▽ More Diffusion-based generative models have been used as powerful priors for magnetic resonance imaging (MRI) reconstruction. We present a learning method to optimize sub-sampling patterns for compressed sensing multi-coil MRI that leverages pre-trained diffusion generative models. Crucially, during training we use a single-step reconstruction based on the posterior mean estimate given by the diffusion model and the MRI measurement process. Experiments across varying anatomies, acceleration factors, and pattern types show that sampling operators learned with our method lead to competitive, and in the case of 2D patterns, improved reconstructions compared to baseline patterns. Our method requires as few as five training images to learn effective sampling patterns. △ Less

Submitted 5 June, 2023; originally announced June 2023.

Solving Inverse Problems with Score-Based Generative Priors learned from Noisy Data

Authors: Asad Aali, Marius Arvinte, Sidharth Kumar, Jonathan I. Tamir

Abstract: We present SURE-Score: an approach for learning score-based generative models using training samples corrupted by additive Gaussian noise. When a large training set of clean samples is available, solving inverse problems via score-based (diffusion) generative models trained on the underlying fully-sampled data distribution has recently been shown to outperform end-to-end supervised deep learning.… ▽ More We present SURE-Score: an approach for learning score-based generative models using training samples corrupted by additive Gaussian noise. When a large training set of clean samples is available, solving inverse problems via score-based (diffusion) generative models trained on the underlying fully-sampled data distribution has recently been shown to outperform end-to-end supervised deep learning. In practice, such a large collection of training data may be prohibitively expensive to acquire in the first place. In this work, we present an approach for approximately learning a score-based generative model of the clean distribution, from noisy training data. We formulate and justify a novel loss function that leverages Stein's unbiased risk estimate to jointly denoise the data and learn the score function via denoising score matching, while using only the noisy samples. We demonstrate the generality of SURE-Score by learning priors and applying posterior sampling to ill-posed inverse problems in two practical applications from different domains: compressive wireless multiple-input multiple-output channel estimation and accelerated 2D multi-coil magnetic resonance imaging reconstruction, where we demonstrate competitive reconstruction performance when learning at signal-to-noise ratio values of 0 and 10 dB, respectively. △ Less

Submitted 1 May, 2023; originally announced May 2023.

MRI Reconstruction with Side Information using Diffusion Models

Authors: Brett Levac, Ajil Jalal, Kannan Ramchandran, Jonathan I. Tamir

Abstract: Magnetic resonance imaging (MRI) exam protocols consist of multiple contrast-weighted images of the same anatomy to emphasize different tissue properties. Due to the long acquisition times required to collect fully sampled k-space measurements, it is common to only collect a fraction of k-space for each scan and subsequently solve independent inverse problems for each image contrast. Recently, the… ▽ More Magnetic resonance imaging (MRI) exam protocols consist of multiple contrast-weighted images of the same anatomy to emphasize different tissue properties. Due to the long acquisition times required to collect fully sampled k-space measurements, it is common to only collect a fraction of k-space for each scan and subsequently solve independent inverse problems for each image contrast. Recently, there has been a push to further accelerate MRI exams using data-driven priors, and generative models in particular, to regularize the ill-posed inverse problem of image reconstruction. These methods have shown promising improvements over classical methods. However, many of the approaches neglect the additional information present in a clinical MRI exam like the multi-contrast nature of the data and treat each scan as an independent reconstruction. In this work we show that by learning a joint Bayesian prior over multi-contrast data with a score-based generative model we are able to leverage the underlying structure between random variables related to a given imaging problem. This leads to an improvement in image reconstruction fidelity over generative models that rely only on a marginal prior over the image contrast of interest. △ Less

Submitted 6 June, 2023; v1 submitted 26 March, 2023; originally announced March 2023.

High-fidelity Direct Contrast Synthesis from Magnetic Resonance Fingerprinting

Authors: Ke Wang, Mariya Doneva, Jakob Meineke, Thomas Amthor, Ekin Karasan, Fei Tan, Jonathan I. Tamir, Stella X. Yu, Michael Lustig

Abstract: Magnetic Resonance Fingerprinting (MRF) is an efficient quantitative MRI technique that can extract important tissue and system parameters such as T1, T2, B0, and B1 from a single scan. This property also makes it attractive for retrospectively synthesizing contrast-weighted images. In general, contrast-weighted images like T1-weighted, T2-weighted, etc., can be synthesized directly from parameter… ▽ More Magnetic Resonance Fingerprinting (MRF) is an efficient quantitative MRI technique that can extract important tissue and system parameters such as T1, T2, B0, and B1 from a single scan. This property also makes it attractive for retrospectively synthesizing contrast-weighted images. In general, contrast-weighted images like T1-weighted, T2-weighted, etc., can be synthesized directly from parameter maps through spin-dynamics simulation (i.e., Bloch or Extended Phase Graph models). However, these approaches often exhibit artifacts due to imperfections in the map**, the sequence modeling, and the data acquisition. Here we propose a supervised learning-based method that directly synthesizes contrast-weighted images from the MRF data without going through the quantitative map** and spin-dynamics simulation. To implement our direct contrast synthesis (DCS) method, we deploy a conditional Generative Adversarial Network (GAN) framework and propose a multi-branch U-Net as the generator. The input MRF data are used to directly synthesize T1-weighted, T2-weighted, and fluid-attenuated inversion recovery (FLAIR) images through supervised training on paired MRF and target spin echo-based contrast-weighted scans. In-vivo experiments demonstrate excellent image quality compared to simulation-based contrast synthesis and previous DCS methods, both visually as well as by quantitative metrics. We also demonstrate cases where our trained model is able to mitigate in-flow and spiral off-resonance artifacts that are typically seen in MRF reconstructions and thus more faithfully represent conventional spin echo-based contrast-weighted images. △ Less

Submitted 21 December, 2022; originally announced December 2022.

Comments: 19 pages, 8 figures

Diode effect in Josephson junctions with a single magnetic atom

Authors: Martina Trahms, Larissa Melischek, Jacob F. Steiner, Bharti Mahendru, Idan Tamir, Nils Bogdanoff, Olof Peters, Gael Reecht, Clemens B. Winkelmann, Felix von Oppen, Katharina J. Franke

Abstract: Current flow in electronic devices can be asymmetric with bias direction, a phenomenon underlying the utility of diodes and known as non-reciprocal charge transport. The promise of dissipationless electronics has recently stimulated the quest for superconducting diodes, and non-reciprocal superconducting devices have been realized in various non-centrosymmetric systems. Probing the ultimate limits… ▽ More Current flow in electronic devices can be asymmetric with bias direction, a phenomenon underlying the utility of diodes and known as non-reciprocal charge transport. The promise of dissipationless electronics has recently stimulated the quest for superconducting diodes, and non-reciprocal superconducting devices have been realized in various non-centrosymmetric systems. Probing the ultimate limits of miniaturization, we have created atomic-scale Pb--Pb Josephson junctions in a scanning tunneling microscope. Pristine junctions stabilized by a single Pb atom exhibit hysteretic behavior, confirming the high quality of the junctions, but no asymmetry between the bias directions. Non-reciprocal supercurrents emerge when inserting a single magnetic atom into the junction, with the preferred direction depending on the atomic species. Aided by theoretical modelling, we trace the non-reciprocity to quasiparticle currents flowing via Yu-Shiba-Rusinov (YSR) states inside the superconducting energy gap. Our results open new avenues for creating atomic-scale Josephson diodes and tuning their properties through single-atom manipulation. △ Less

Submitted 8 December, 2022; originally announced December 2022.

Journal ref: Nature 615, 628 (2023)

Accelerated Motion Correction with Deep Generative Diffusion Models

Authors: Brett Levac, Sidharth Kumar, Ajil Jalal, Jonathan I. Tamir

Abstract: Magnetic Resonance Imaging (MRI) is a powerful medical imaging modality, but unfortunately suffers from long scan times which, aside from increasing operational costs, can lead to image artifacts due to patient motion. Motion during the acquisition leads to inconsistencies in measured data that manifest as blurring and ghosting if unaccounted for in the image reconstruction process. Various deep l… ▽ More Magnetic Resonance Imaging (MRI) is a powerful medical imaging modality, but unfortunately suffers from long scan times which, aside from increasing operational costs, can lead to image artifacts due to patient motion. Motion during the acquisition leads to inconsistencies in measured data that manifest as blurring and ghosting if unaccounted for in the image reconstruction process. Various deep learning based reconstruction techniques have been proposed which decrease scan time by reducing the number of measurements needed for a high fidelity reconstructed image. Additionally, deep learning has been used to correct motion using end-to-end techniques. This, however, increases susceptibility to distribution shifts at test time (sampling pattern, motion level). In this work we propose a framework for jointly reconstructing highly sub-sampled MRI data while estimating patient motion using diffusion based generative models. Our method does not make specific assumptions on the sampling trajectory or motion pattern at training time and thus can be flexibly applied to various types of measurement models and patient motion. We demonstrate our framework on retrospectively accelerated 2D brain MRI corrupted by rigid motion. △ Less

Submitted 28 September, 2023; v1 submitted 31 October, 2022; originally announced November 2022.

FSE Compensated Motion Correction for MRI Using Data Driven Methods

Authors: Brett Levac, Sidharth Kumar, Sofia Kardonik, Jonathan I. Tamir

Abstract: Magnetic Resonance Imaging (MRI) is a widely used medical imaging modality boasting great soft tissue contrast without ionizing radiation, but unfortunately suffers from long acquisition times. Long scan times can lead to motion artifacts, for example due to bulk patient motion such as head movement and periodic motion produced by the heart or lungs. Motion artifacts can degrade image quality and… ▽ More Magnetic Resonance Imaging (MRI) is a widely used medical imaging modality boasting great soft tissue contrast without ionizing radiation, but unfortunately suffers from long acquisition times. Long scan times can lead to motion artifacts, for example due to bulk patient motion such as head movement and periodic motion produced by the heart or lungs. Motion artifacts can degrade image quality and in some cases render the scans nondiagnostic. To combat this problem, prospective and retrospective motion correction techniques have been introduced. More recently, data driven methods using deep neural networks have been proposed. As a large number of publicly available MRI datasets are based on Fast Spin Echo (FSE) sequences, methods that use them for training should incorporate the correct FSE acquisition dynamics. Unfortunately, when simulating training data, many approaches fail to generate accurate motion-corrupt images by neglecting the effects of the temporal ordering of the k-space lines as well as neglecting the signal decay throughout the FSE echo train. In this work, we highlight this consequence and demonstrate a training method which correctly simulates the data acquisition process of FSE sequences with higher fidelity by including sample ordering and signal decay dynamics. Through numerical experiments, we show that accounting for the FSE acquisition leads to better motion correction performance during inference. △ Less

Submitted 1 July, 2022; originally announced July 2022.

Few-Max: Few-Shot Domain Adaptation for Unsupervised Contrastive Representation Learning

Authors: Ali Lotfi Rezaabad, Sidharth Kumar, Sriram Vishwanath, Jonathan I. Tamir

Abstract: Contrastive self-supervised learning methods learn to map data points such as images into non-parametric representation space without requiring labels. While highly successful, current methods require a large amount of data in the training phase. In situations where the target training set is limited in size, generalization is known to be poor. Pretraining on a large source data set and fine-tunin… ▽ More Contrastive self-supervised learning methods learn to map data points such as images into non-parametric representation space without requiring labels. While highly successful, current methods require a large amount of data in the training phase. In situations where the target training set is limited in size, generalization is known to be poor. Pretraining on a large source data set and fine-tuning on the target samples is prone to overfitting in the few-shot regime, where only a small number of target samples are available. Motivated by this, we propose a domain adaption method for self-supervised contrastive learning, termed Few-Max, to address the issue of adaptation to a target distribution under few-shot learning. To quantify the representation quality, we evaluate Few-Max on a range of source and target datasets, including ImageNet, VisDA, and fastMRI, on which Few-Max consistently outperforms other approaches. △ Less

Submitted 22 June, 2022; v1 submitted 21 June, 2022; originally announced June 2022.

An untrained deep learning method for reconstructing dynamic magnetic resonance images from accelerated model-based data

Authors: Kalina P. Slavkova, Julie C. DiCarlo, Viraj Wadhwa, Chengyue Wu, John Virostko, Sidharth Kumar, Thomas E. Yankeelov, Jonathan I. Tamir

Abstract: The purpose of this work is to implement physics-based regularization as a stop** condition in tuning an untrained deep neural network for reconstructing MR images from accelerated data. The ConvDecoder neural network was trained with a physics-based regularization term incorporating the spoiled gradient echo equation that describes variable-flip angle (VFA) data. Fully-sampled VFA k-space data… ▽ More The purpose of this work is to implement physics-based regularization as a stop** condition in tuning an untrained deep neural network for reconstructing MR images from accelerated data. The ConvDecoder neural network was trained with a physics-based regularization term incorporating the spoiled gradient echo equation that describes variable-flip angle (VFA) data. Fully-sampled VFA k-space data were retrospectively accelerated by factors of R={8,12,18,36} and reconstructed with ConvDecoder (CD), ConvDecoder with the proposed regularization (CD+r), locally low-rank (LR) reconstruction, and compressed sensing with L1-wavelet regularization (L1). Final images from CD+r training were evaluated at the \emph{argmin} of the regularization loss; whereas the CD, LR, and L1 reconstructions were chosen optimally based on ground truth data. The performance measures used were the normalized root-mean square error, the concordance correlation coefficient (CCC), and the structural similarity index (SSIM). The CD+r reconstructions, chosen using the stop** condition, yielded SSIMs that were similar to the CD (p=0.47) and LR SSIMs (p=0.95) across R and that were significantly higher than the L1 SSIMs (p=0.04). The CCC values for the CD+r T1 maps across all R and subjects were greater than those corresponding to the L1 (p=0.15) and LR (p=0.13) T1 maps, respectively. For R > 12 (<4.2 minutes scan time), L1 and LR T1 maps exhibit a loss of spatially refined details compared to CD+r. We conclude that the use of an untrained neural network together with a physics-based regularization loss shows promise as a measure for determining the optimal stop** point in training without relying on fully-sampled ground truth data. △ Less

Submitted 5 October, 2022; v1 submitted 3 May, 2022; originally announced May 2022.

Comments: 45 pages, 7 figures, 2 Tables, supplementary material included (10 figures, 4 tables)

Polynomial Preconditioners for Regularized Linear Inverse Problems

Authors: Siddharth Srinivasan Iyer, Frank Ong, Xiaozhi Cao, Congyu Liao, Luca Daniel, Jonathan I. Tamir, Kawin Setsompop

Abstract: This work aims to accelerate the convergence of proximal gradient methods used to solve regularized linear inverse problems. This is achieved by designing a polynomial-based preconditioner that targets the eigenvalue spectrum of the normal operator derived from the linear operator. The preconditioner does not assume any explicit structure on the linear function and thus can be deployed in diverse… ▽ More This work aims to accelerate the convergence of proximal gradient methods used to solve regularized linear inverse problems. This is achieved by designing a polynomial-based preconditioner that targets the eigenvalue spectrum of the normal operator derived from the linear operator. The preconditioner does not assume any explicit structure on the linear function and thus can be deployed in diverse applications of interest. The efficacy of the preconditioner is validated on three different Magnetic Resonance Imaging applications, where it is seen to achieve faster iterative convergence while achieving similar reconstruction quality. △ Less

Submitted 25 September, 2022; v1 submitted 21 April, 2022; originally announced April 2022.

MIMO Channel Estimation using Score-Based Generative Models

Authors: Marius Arvinte, Jonathan I Tamir

Abstract: Channel estimation is a critical task in multiple-input multiple-output (MIMO) digital communications that substantially effects end-to-end system performance. In this work, we introduce a novel approach for channel estimation using deep score-based generative models. A model is trained to estimate the gradient of the logarithm of a distribution and is used to iteratively refine estimates given me… ▽ More Channel estimation is a critical task in multiple-input multiple-output (MIMO) digital communications that substantially effects end-to-end system performance. In this work, we introduce a novel approach for channel estimation using deep score-based generative models. A model is trained to estimate the gradient of the logarithm of a distribution and is used to iteratively refine estimates given measurements of a signal. We introduce a framework for training score-based generative models for wireless MIMO channels and performing channel estimation based on posterior sampling at test time. We derive theoretical robustness guarantees for channel estimation with posterior sampling in single-input single-output scenarios, and experimentally verify performance in the MIMO setting. Our results in simulated channels show competitive in-distribution performance, and robust out-of-distribution performance, with gains of up to $5$ dB in end-to-end coded communication performance compared to supervised deep learning methods. Simulations on the number of pilots show that high fidelity channel estimation with $25$% pilot density is possible for MIMO channel sizes of up to $64 \times 256$. Complexity analysis reveals that model size can efficiently trade performance for estimation latency, and that the proposed approach is competitive with compressed sensing in terms of floating-point operation (FLOP) count. △ Less

Submitted 7 November, 2022; v1 submitted 14 April, 2022; originally announced April 2022.

Direct observation of intrinsic surface magnetic disorder in amorphous superconducting films

Authors: Idan Tamir, Martina Trahms, Franzisca Gorniaczyk, Felix von Oppen, Dan Shahar, Katharina J. Franke

Abstract: The interplay between disorder and interactions can dramatically influence the physical properties of thin-film superconductors. In the most extreme case, strong disorder is able to suppress superconductivity as an insulating phase emerges. Due to the known pair-breaking potential of magnetic disorder on superconductors, the research focus is on the influence of non-magnetic disorder. Here we prov… ▽ More The interplay between disorder and interactions can dramatically influence the physical properties of thin-film superconductors. In the most extreme case, strong disorder is able to suppress superconductivity as an insulating phase emerges. Due to the known pair-breaking potential of magnetic disorder on superconductors, the research focus is on the influence of non-magnetic disorder. Here we provide direct evidence that magnetic disorder is also present at the surface of amorphous superconducting films. This magnetic disorder is present even in the absence of magnetic impurity atoms and is intimately related to the surface termination itself. While bulk superconductivity survives in sufficiently thick films, we suggest that magnetic disorder may crucially affect the superconductor-to-insulator transition in the thin-film limit. △ Less

Submitted 8 December, 2021; originally announced December 2021.

Shot-noise measurements of single-atom junctions

Authors: Idan Tamir, Verena Caspari, Daniela Rolf, Christian Lotze, Katharina J. Franke

Abstract: Current fluctuations related to the discreteness of charge passing through small constrictions are termed shot noise. This unavoidable noise provides both advantages - being a direct measurement of the transmitted particles' charge, and disadvantages - a main noise source in nanoscale devices operating at low temperature. While better understanding of shot noise is desired, the technical difficult… ▽ More Current fluctuations related to the discreteness of charge passing through small constrictions are termed shot noise. This unavoidable noise provides both advantages - being a direct measurement of the transmitted particles' charge, and disadvantages - a main noise source in nanoscale devices operating at low temperature. While better understanding of shot noise is desired, the technical difficulties in measuring it result in relatively few experimental works, especially in single-atom structures. Here we describe a local shot-noise measurement apparatus, and demonstrate successful noise measurements through single-atom junctions. Our apparatus, based on a scanning tunneling microscope operates at liquid helium temperatures. It includes a broadband commercial amplifier mounted in close proximity to the tunnel junction, thus reducing both thermal noise and the input capacitance that limit traditional noise measurements. The full capabilities of the microscope are maintained in the modified system and a quick transition between different measurement modes is possible. △ Less

Submitted 17 November, 2021; originally announced November 2021.

Journal ref: Review of Scientific Instruments 93, 023702 (2022)

Score-Based Generative Models for Robust Channel Estimation

Authors: Marius Arvinte, Jonathan I Tamir

Abstract: Channel estimation is a critical task in digital communications that greatly impacts end-to-end system performance. In this work, we introduce a novel approach for multiple-input multiple-output (MIMO) channel estimation using score-based generative models. Our method uses a deep neural network that is trained to estimate the gradient of the log-prior of wireless channels at any point in high-dime… ▽ More Channel estimation is a critical task in digital communications that greatly impacts end-to-end system performance. In this work, we introduce a novel approach for multiple-input multiple-output (MIMO) channel estimation using score-based generative models. Our method uses a deep neural network that is trained to estimate the gradient of the log-prior of wireless channels at any point in high-dimensional space, and leverages this model to solve channel estimation via posterior sampling. We train a score-based model on channel realizations from the CDL-D model for two antenna spacings and show that the approach leads to competitive in- and out-of-distribution performance when compared to generative adversarial network (GAN) and compressed sensing (CS) methods. When tested on CDL-D channels, the approach leads to a gain of at least $5$ dB in channel estimation error compared to GAN methods in-distribution at $λ/2$ antenna spacing. When tested on CDL-C channels which are never seen during training or fine-tuned on, the approach leads to end-to-end coded performance gains of up to $3$ dB compared to CS methods and losses of only $0.5$ dB compared to ideal channel knowledge. △ Less

Submitted 14 February, 2022; v1 submitted 15 November, 2021; originally announced November 2021.

Wideband and Entropy-Aware Deep Soft Bit Quantization

Authors: Marius Arvinte, Jonathan I. Tamir

Abstract: Deep learning has been recently applied to physical layer processing in digital communication systems in order to improve end-to-end performance. In this work, we introduce a novel deep learning solution for soft bit quantization across wideband channels. Our method is trained end-to-end with quantization- and entropy-aware augmentations to the loss function and is used at inference in conjunction… ▽ More Deep learning has been recently applied to physical layer processing in digital communication systems in order to improve end-to-end performance. In this work, we introduce a novel deep learning solution for soft bit quantization across wideband channels. Our method is trained end-to-end with quantization- and entropy-aware augmentations to the loss function and is used at inference in conjunction with source coding to achieve near-optimal compression gains over wideband channels. To efficiently train our method, we prove and verify that a fixed feature space quantization scheme is sufficient for efficient learning. When tested on channel distributions never seen during training, the proposed method achieves a compression gain of up to $10 \%$ in the high SNR regime versus previous state-of-the-art methods. To encourage reproducible research, our implementation is publicly available at https://github.com/utcsilab/wideband-llr-deep. △ Less

Submitted 18 October, 2021; originally announced October 2021.

Subtle Data Crimes: Naively training machine learning algorithms could lead to overly-optimistic results

Authors: Efrat Shimron, Jonathan I. Tamir, Ke Wang, Michael Lustig

Abstract: While open databases are an important resource in the Deep Learning (DL) era, they are sometimes used "off-label": data published for one task are used for training algorithms for a different one. This work aims to highlight that in some cases, this common practice may lead to biased, overly-optimistic results. We demonstrate this phenomenon for inverse problem solvers and show how their biased pe… ▽ More While open databases are an important resource in the Deep Learning (DL) era, they are sometimes used "off-label": data published for one task are used for training algorithms for a different one. This work aims to highlight that in some cases, this common practice may lead to biased, overly-optimistic results. We demonstrate this phenomenon for inverse problem solvers and show how their biased performance stems from hidden data preprocessing pipelines. We describe two preprocessing pipelines typical of open-access databases and study their effects on three well-established algorithms developed for Magnetic Resonance Imaging (MRI) reconstruction: Compressed Sensing (CS), Dictionary Learning (DictL), and DL. In this large-scale study we performed extensive computations. Our results demonstrate that the CS, DictL and DL algorithms yield systematically biased results when naively trained on seemingly-appropriate data: the Normalized Root Mean Square Error (NRMSE) improves consistently with the preprocessing extent, showing an artificial increase of 25%-48% in some cases. Since this phenomenon is generally unknown, biased results are sometimes published as state-of-the-art; we refer to that as subtle data crimes. This work hence raises a red flag regarding naive off-label usage of Big Data and reveals the vulnerability of modern inverse problem solvers to the resulting bias. △ Less

Submitted 14 December, 2021; v1 submitted 16 September, 2021; originally announced September 2021.

Comments: 16 pages, 7 figures, two tables. Submitted to a journal

High Fidelity Deep Learning-based MRI Reconstruction with Instance-wise Discriminative Feature Matching Loss

Authors: Ke Wang, Jonathan I Tamir, Alfredo De Goyeneche, Uri Wollner, Rafi Brada, Stella Yu, Michael Lustig

Abstract: Purpose: To improve reconstruction fidelity of fine structures and textures in deep learning (DL) based reconstructions. Methods: A novel patch-based Unsupervised Feature Loss (UFLoss) is proposed and incorporated into the training of DL-based reconstruction frameworks in order to preserve perceptual similarity and high-order statistics. The UFLoss provides instance-level discrimination by mappi… ▽ More Purpose: To improve reconstruction fidelity of fine structures and textures in deep learning (DL) based reconstructions. Methods: A novel patch-based Unsupervised Feature Loss (UFLoss) is proposed and incorporated into the training of DL-based reconstruction frameworks in order to preserve perceptual similarity and high-order statistics. The UFLoss provides instance-level discrimination by map** similar instances to similar low-dimensional feature vectors and is trained without any human annotation. By adding an additional loss function on the low-dimensional feature space during training, the reconstruction frameworks from under-sampled or corrupted data can reproduce more realistic images that are closer to the original with finer textures, sharper edges, and improved overall image quality. The performance of the proposed UFLoss is demonstrated on unrolled networks for accelerated 2D and 3D knee MRI reconstruction with retrospective under-sampling. Quantitative metrics including NRMSE, SSIM, and our proposed UFLoss were used to evaluate the performance of the proposed method and compare it with others. Results: In-vivo experiments indicate that adding the UFLoss encourages sharper edges and more faithful contrasts compared to traditional and learning-based methods with pure l2 loss. More detailed textures can be seen in both 2D and 3D knee MR images. Quantitative results indicate that reconstruction with UFLoss can provide comparable NRMSE and a higher SSIM while achieving a much lower UFLoss value. Conclusion: We present UFLoss, a patch-based unsupervised learned feature loss, which allows the training of DL-based reconstruction to obtain more detailed texture, finer features, and sharper edges with higher overall image quality under DL-based reconstruction frameworks. △ Less

Submitted 27 August, 2021; originally announced August 2021.

Comments: 35 pages, 13 figures

Robust Compressed Sensing MRI with Deep Generative Priors

Authors: Ajil Jalal, Marius Arvinte, Giannis Daras, Eric Price, Alexandros G. Dimakis, Jonathan I. Tamir

Abstract: The CSGM framework (Bora-Jalal-Price-Dimakis'17) has shown that deep generative priors can be powerful tools for solving inverse problems. However, to date this framework has been empirically successful only on certain datasets (for example, human faces and MNIST digits), and it is known to perform poorly on out-of-distribution samples. In this paper, we present the first successful application of… ▽ More The CSGM framework (Bora-Jalal-Price-Dimakis'17) has shown that deep generative priors can be powerful tools for solving inverse problems. However, to date this framework has been empirically successful only on certain datasets (for example, human faces and MNIST digits), and it is known to perform poorly on out-of-distribution samples. In this paper, we present the first successful application of the CSGM framework on clinical MRI data. We train a generative prior on brain scans from the fastMRI dataset, and show that posterior sampling via Langevin dynamics achieves high quality reconstructions. Furthermore, our experiments and theory show that posterior sampling is robust to changes in the ground-truth distribution and measurement process. Our code and models are available at: \url{https://github.com/utcsilab/csgm-mri-langevin}. △ Less

Submitted 6 December, 2021; v1 submitted 3 August, 2021; originally announced August 2021.

Wave-encoding and Shuffling Enables Rapid Time Resolved Structural Imaging

Authors: Siddharth Iyer, Daniel Polak, Congyu Liao, Jonathan I. Tamir, Stephen F. Cauley, Borjan Gagoski, Wei-Ching Lo, Berkin Bilgic, Kawin Setsompop

Abstract: T2-Shuffling reconstructs multiple sharp T2-weighted images from a single volumetric fast spin-echo (3D-FSE) scan. Wave-CAIPI is a parallel imaging technique that achieves good reconstruction at high accelerations through additional sinusoidal gradients that induce a voxel spreading effect in the readout direction to better take advantage of coil-sensitivity information. In this work, the Shufflin… ▽ More T2-Shuffling reconstructs multiple sharp T2-weighted images from a single volumetric fast spin-echo (3D-FSE) scan. Wave-CAIPI is a parallel imaging technique that achieves good reconstruction at high accelerations through additional sinusoidal gradients that induce a voxel spreading effect in the readout direction to better take advantage of coil-sensitivity information. In this work, the Shuffling model in T2-Shuffling is augmented with wave-encoding to achieve higher acceleration capability. The resulting "Wave-Shuffling" approach is applied to 3D-FSE and Magnetization-Prepared Rapid Gradient-Echo (MPRAGE) to achieve rapid, 1 mm-isotropic resolution, time-resolved structural imaging. △ Less

Submitted 31 May, 2022; v1 submitted 29 March, 2021; originally announced March 2021.

Memory-efficient Learning for High-Dimensional MRI Reconstruction

Authors: Ke Wang, Michael Kellman, Christopher M. Sandino, Kevin Zhang, Shreyas S. Vasanawala, Jonathan I. Tamir, Stella X. Yu, Michael Lustig

Abstract: Deep learning (DL) based unrolled reconstructions have shown state-of-the-art performance for under-sampled magnetic resonance imaging (MRI). Similar to compressed sensing, DL can leverage high-dimensional data (e.g. 3D, 2D+time, 3D+time) to further improve performance. However, network size and depth are currently limited by the GPU memory required for backpropagation. Here we use a memory-effici… ▽ More Deep learning (DL) based unrolled reconstructions have shown state-of-the-art performance for under-sampled magnetic resonance imaging (MRI). Similar to compressed sensing, DL can leverage high-dimensional data (e.g. 3D, 2D+time, 3D+time) to further improve performance. However, network size and depth are currently limited by the GPU memory required for backpropagation. Here we use a memory-efficient learning (MEL) framework which favorably trades off storage with a manageable increase in computation during training. Using MEL with multi-dimensional data, we demonstrate improved image reconstruction performance for in-vivo 3D MRI and 2D+time cardiac cine MRI. MEL uses far less GPU memory while marginally increasing the training time, which enables new applications of DL to high-dimensional MRI. △ Less

Submitted 5 March, 2021; originally announced March 2021.

Comments: 14 pages, 8 figures

Deep J-Sense: Accelerated MRI Reconstruction via Unrolled Alternating Optimization

Authors: Marius Arvinte, Sriram Vishwanath, Ahmed H. Tewfik, Jonathan I. Tamir

Abstract: Accelerated multi-coil magnetic resonance imaging reconstruction has seen a substantial recent improvement combining compressed sensing with deep learning. However, most of these methods rely on estimates of the coil sensitivity profiles, or on calibration data for estimating model parameters. Prior work has shown that these methods degrade in performance when the quality of these estimators are p… ▽ More Accelerated multi-coil magnetic resonance imaging reconstruction has seen a substantial recent improvement combining compressed sensing with deep learning. However, most of these methods rely on estimates of the coil sensitivity profiles, or on calibration data for estimating model parameters. Prior work has shown that these methods degrade in performance when the quality of these estimators are poor or when the scan parameters differ from the training conditions. Here we introduce Deep J-Sense as a deep learning approach that builds on unrolled alternating minimization and increases robustness: our algorithm refines both the magnetization (image) kernel and the coil sensitivity maps. Experimental results on a subset of the knee fastMRI dataset show that this increases reconstruction performance and provides a significant degree of robustness to varying acceleration factors and calibration region sizes. △ Less

Submitted 11 April, 2021; v1 submitted 2 March, 2021; originally announced March 2021.

Limited role of vortices in transport in highly disordered superconductors near $B_{c2}$

Authors: Adam Doron, Tal Levinson, Franzisca Gorniaczyk, Idan Tamir, Dan Shahar

Abstract: At finite temperatures and magnetic fields, type-II superconductors in the mixed state have a non-zero resistance that is overwhelmingly associated with vortex motion. In this work we study amorphous indium oxide films, which are thicker than the superconducting coherence length, and show that near $B_{c2}$ their resistance in the presence of perpendicular and in-plane magnetic fields becomes almo… ▽ More At finite temperatures and magnetic fields, type-II superconductors in the mixed state have a non-zero resistance that is overwhelmingly associated with vortex motion. In this work we study amorphous indium oxide films, which are thicker than the superconducting coherence length, and show that near $B_{c2}$ their resistance in the presence of perpendicular and in-plane magnetic fields becomes almost isotropic. Up to a linear rescaling of the magnetic fields both the equilibrium resistance as well as the non-equilibrium current-voltage characteristics are insensitive to magnetic field orientation suggesting that, for our superconductors, there is no fundamental difference in transport between perpendicular and in-plane magnetic fields. Additionally we show that this near-isotropic behavior extends to the insulating phase of amorphous indium oxide films of larger disorder strength that undergo a magnetic field driven superconductor-insulator transition. This near-isotropic behavior raises questions regarding the role of vortices in transport and the origin of resistance in thin-film superconductors. △ Less

Submitted 7 November, 2019; originally announced November 2019.

Unsupervised Deep Basis Pursuit: Learning inverse problems without ground-truth data

Authors: Jonathan I. Tamir, Stella X. Yu, Michael Lustig

Abstract: Basis pursuit is a compressed sensing optimization in which the l1-norm is minimized subject to model error constraints. Here we use a deep neural network prior instead of l1-regularization. Using known noise statistics, we jointly learn the prior and reconstruct images without access to ground-truth data. During training, we use alternating minimization across an unrolled iterative network and jo… ▽ More Basis pursuit is a compressed sensing optimization in which the l1-norm is minimized subject to model error constraints. Here we use a deep neural network prior instead of l1-regularization. Using known noise statistics, we jointly learn the prior and reconstruct images without access to ground-truth data. During training, we use alternating minimization across an unrolled iterative network and jointly solve for the neural network weights and training set image reconstructions. At inference, we fix the weights and pass the measurements through the network. We compare reconstruction performance between unsupervised and supervised (i.e. with ground-truth) methods. We hypothesize this technique could be used to learn reconstruction when ground-truth data are unavailable, such as in high-resolution dynamic MRI. △ Less

Submitted 14 February, 2020; v1 submitted 29 October, 2019; originally announced October 2019.

Comments: https://deep-inverse.org/

The Critical Current of Disordered Superconductors near T=0

Authors: Adam Doron, Tal Levinson, Franzisca Gorniaczyk, Idan Tamir, Dan Shahar

Abstract: An increasing current through a superconductor can result in a discontinuous increase in the differential resistance at the critical current. This critical current is typically associated either with breaking of Cooper-pairs (de-pairing) or with a collective motion of vortices (de-pinning). In this work we measure superconducting amorphous indium oxide films at low temperatures and high magnetic f… ▽ More An increasing current through a superconductor can result in a discontinuous increase in the differential resistance at the critical current. This critical current is typically associated either with breaking of Cooper-pairs (de-pairing) or with a collective motion of vortices (de-pinning). In this work we measure superconducting amorphous indium oxide films at low temperatures and high magnetic fields. Using heat-balance considerations we demonstrate that the current-voltage characteristics are well explained by electron overheating that occurs due to the thermal decoupling of the electrons from the host phonons. As a result the electrons overheat to a significantly higher temperature than that of the lattice. By solving the heat-balance equation we are able to accurately predict the critical currents in a variety of experimental conditions. The heat-balance approach stems directly from energy conservation. As such it is universal and applies to diverse situations from critical currents in superconductors to climate bi-stabilities that can initiate another ice-age. One disadvantage of the universal nature of this approach is that it is insensitive to the microscopic details of the system, which limits our ability to draw conclusions regarding the initial departure from equilibrium. △ Less

Submitted 25 August, 2019; originally announced August 2019.

Productization Challenges of Contextual Multi-Armed Bandits

Authors: David Abensur, Ivan Balashov, Shaked Bar, Ronny Lempel, Nurit Moscovici, Ilan Orlov, Danny Rosenstein, Ido Tamir

Abstract: Contextual Multi-Armed Bandits is a well-known and accepted online optimization algorithm, that is used in many Web experiences to tailor content or presentation to users' traffic. Much has been published on theoretical guarantees (e.g. regret bounds) of proposed algorithmic variants, but relatively little attention has been devoted to the challenges encountered while productizing contextual bandi… ▽ More Contextual Multi-Armed Bandits is a well-known and accepted online optimization algorithm, that is used in many Web experiences to tailor content or presentation to users' traffic. Much has been published on theoretical guarantees (e.g. regret bounds) of proposed algorithmic variants, but relatively little attention has been devoted to the challenges encountered while productizing contextual bandits schemes in large scale settings. This work enumerates several productization challenges we encountered while leveraging contextual bandits for two concrete use cases at scale. We discuss how to (1) determine the context (engineer the features) that model the bandit arms; (2) sanity check the health of the optimization process; (3) evaluate the process in an offline manner; (4) add potential actions (arms) on the fly to a running process; (5) subject the decision process to constraints; and (6) iteratively improve the online learning algorithm. For each such challenge, we explain the issue, provide our approach, and relate to prior art where applicable. △ Less

Submitted 10 July, 2019; originally announced July 2019.

Computational MRI with Physics-based Constraints: Application to Multi-contrast and Quantitative Imaging

Authors: Jonathan I. Tamir, Frank Ong, Suma Anand, Ekin Karasan, Ke Wang, Michael Lustig

Abstract: Compressed sensing takes advantage of low-dimensional signal structure to reduce sampling requirements far below the Nyquist rate. In magnetic resonance imaging (MRI), this often takes the form of sparsity through wavelet transform, finite differences, and low rank extensions. Though powerful, these image priors are phenomenological in nature and do not account for the mechanism behind the image f… ▽ More Compressed sensing takes advantage of low-dimensional signal structure to reduce sampling requirements far below the Nyquist rate. In magnetic resonance imaging (MRI), this often takes the form of sparsity through wavelet transform, finite differences, and low rank extensions. Though powerful, these image priors are phenomenological in nature and do not account for the mechanism behind the image formation. On the other hand, MRI signal dynamics are governed by physical laws, which can be explicitly modeled and used as priors for reconstruction. {1}These explicit and implicit signal priors can be synergistically combined in an inverse problem framework to recover sharp, multi-contrast images from highly accelerated scans. Furthermore, the physics-based constraints provide a recipe for recovering quantitative, bio-physical parameters from the data. This article introduces physics-based modeling constraints in MRI and shows how they can be used in conjunction with compressed sensing for image reconstruction and quantitative imaging. We describe model-based quantitative MRI, as well as its linear subspace approximation. We also discuss approaches to selecting user-controllable scan parameters given knowledge of the physical model. We present several MRI applications that take advantage of this framework for the purpose of multi-contrast imaging and quantitative map**. △ Less

Submitted 26 June, 2019; originally announced June 2019.

PHT-bot: Deep-Learning based system for automatic risk stratification of COPD patients based upon signs of Pulmonary Hypertension

Authors: David Chettrit, Orna Bregman Amitai, Itamar Tamir, Amir Bar, Eldad Elnekave

Abstract: Chronic Obstructive Pulmonary Disease (COPD) is a leading cause of morbidity and mortality worldwide. Identifying those at highest risk of deterioration would allow more effective distribution of preventative and surveillance resources. Secondary pulmonary hypertension is a manifestation of advanced COPD, which can be reliably diagnosed by the main Pulmonary Artery (PA) to Ascending Aorta (Ao) rat… ▽ More Chronic Obstructive Pulmonary Disease (COPD) is a leading cause of morbidity and mortality worldwide. Identifying those at highest risk of deterioration would allow more effective distribution of preventative and surveillance resources. Secondary pulmonary hypertension is a manifestation of advanced COPD, which can be reliably diagnosed by the main Pulmonary Artery (PA) to Ascending Aorta (Ao) ratio. In effect, a PA diameter to Ao diameter ratio of greater than 1 has been demonstrated to be a reliable marker of increased pulmonary arterial pressure. Although clinically valuable and readily visualized, the manual assessment of the PA and the Ao diameters is time consuming and under-reported. The present study describes a non invasive method to measure the diameters of both the Ao and the PA from contrast-enhanced chest Computed Tomography (CT). The solution applies deep learning techniques in order to select the correct axial slice to measure, and to segment both arteries. The system achieves test Pearson correlation coefficient scores of 93% for the Ao and 92% for the PA. To the best of our knowledge, it is the first such fully automated solution. △ Less

Submitted 28 May, 2019; originally announced May 2019.

Journal ref: Proc. SPIE 10950, Medical Imaging 2019: Computer-Aided Diagnosis, 109500O

Clinically Deployed Distributed Magnetic Resonance Imaging Reconstruction: Application to Pediatric Knee Imaging

Authors: Michael J. Anderson, Jonathan I. Tamir, Javier S. Turek, Marcus T. Alley, Theodore L. Willke, Shreyas S. Vasanawala, Michael Lustig

Abstract: Magnetic resonance imaging is capable of producing volumetric images without ionizing radiation. Nonetheless, long acquisitions lead to prohibitively long exams. Compressed sensing (CS) can enable faster scanning via sub-sampling with reduced artifacts. However, CS requires significantly higher reconstruction computation, limiting current clinical applications to 2D/3D or limited-resolution dynami… ▽ More Magnetic resonance imaging is capable of producing volumetric images without ionizing radiation. Nonetheless, long acquisitions lead to prohibitively long exams. Compressed sensing (CS) can enable faster scanning via sub-sampling with reduced artifacts. However, CS requires significantly higher reconstruction computation, limiting current clinical applications to 2D/3D or limited-resolution dynamic imaging. Here we analyze the practical limitations to T2 Shuffling, a four-dimensional CS-based acquisition, which provides sharp 3D-isotropic-resolution and multi-contrast images in a single scan. Our improvements to the pipeline on a single machine provide a 3x overall reconstruction speedup, which allowed us to add algorithmic changes improving image quality. Using four machines, we achieved additional 2.1x improvement through distributed parallelization. Our solution reduced the reconstruction time in the hospital to 90 seconds on a 4-node cluster, enabling its use clinically. To understand the implications of scaling this application, we simulated running our reconstructions with a multiple scanner setup typical in hospitals. △ Less

Submitted 11 September, 2018; originally announced September 2018.

MSC Class: 68W15; 68U10

Excessive Noise as a Test for Many-Body Localization

Authors: I. Tamir, T. Levinson, F. Gorniaczyk, A. Doron, J. Lieb, D. Shahar

Abstract: Recent experimental reports suggested the existence of a finite-temperature insulator in the vicinity of the superconductor-insulator transition. The rapid decay of conductivity over a narrow temperature range was theoretically linked to both a finite-temperature transition to a many-body-localized state, and to a charge-Berezinskii Kosterlitz Thouless transition. Here we report of low-frequency n… ▽ More Recent experimental reports suggested the existence of a finite-temperature insulator in the vicinity of the superconductor-insulator transition. The rapid decay of conductivity over a narrow temperature range was theoretically linked to both a finite-temperature transition to a many-body-localized state, and to a charge-Berezinskii Kosterlitz Thouless transition. Here we report of low-frequency noise measurements of such insulators to test for many body localization. We observed a huge enhancement of the low-temperatures noise when exceeding a threshold voltage for nonlinear conductivity and discuss our results in light of the theoretical models. △ Less

Submitted 29 January, 2019; v1 submitted 25 June, 2018; originally announced June 2018.

Comments: 5 pages, 4 figures

Journal ref: Phys. Rev. B 99, 035135 (2019)

TextRay: Mining Clinical Reports to Gain a Broad Understanding of Chest X-rays

Authors: Jonathan Laserson, Christine Dan Lantsman, Michal Cohen-Sfady, Itamar Tamir, Eli Goz, Chen Brestel, Shir Bar, Maya Atar, Eldad Elnekave

Abstract: The chest X-ray (CXR) is by far the most commonly performed radiological examination for screening and diagnosis of many cardiac and pulmonary diseases. There is an immense world-wide shortage of physicians capable of providing rapid and accurate interpretation of this study. A radiologist-driven analysis of over two million CXR reports generated an ontology including the 40 most prevalent patholo… ▽ More The chest X-ray (CXR) is by far the most commonly performed radiological examination for screening and diagnosis of many cardiac and pulmonary diseases. There is an immense world-wide shortage of physicians capable of providing rapid and accurate interpretation of this study. A radiologist-driven analysis of over two million CXR reports generated an ontology including the 40 most prevalent pathologies on CXR. By manually tagging a relatively small set of sentences, we were able to construct a training set of 959k studies. A deep learning model was trained to predict the findings given the patient frontal and lateral scans. For 12 of the findings we compare the model performance against a team of radiologists and show that in most cases the radiologists agree on average more with the algorithm than with each other. △ Less

Submitted 6 June, 2018; originally announced June 2018.

Comments: Accepted to MICCAI 2018

The Temperature dependence of the magneto-resistance peak in highly disordered superconductors

Authors: Adam Doron, Idan Tamir, Tal Levinson, Franzisca Gorniaczyk, Dan Shahar

Abstract: Highly disordered superconductors have a rich phase diagram. At a moderate magnetic field (B) the samples go through the superconductor-insulator quantum phase transition. In the insulating phase, the resistance increases sharply with B up to a magneto-resistance peak beyond which the resistance drops with B. In this manuscript we follow the temperature (T) evolution of this magneto-resistance pea… ▽ More Highly disordered superconductors have a rich phase diagram. At a moderate magnetic field (B) the samples go through the superconductor-insulator quantum phase transition. In the insulating phase, the resistance increases sharply with B up to a magneto-resistance peak beyond which the resistance drops with B. In this manuscript we follow the temperature (T) evolution of this magneto-resistance peak. We show that as T is reduced, the peak appears at lower B's approaching the critical field of the superconductor-insulator transition. Due to experimental limitations we are unable to determine whether the T=0 limiting position of the peak matches that of the critical field or is at comparable but slightly higher B. We show that, although the peak appears at different B values, its resistance follows an activated T dependence over a large T range with a prefactor that is very similar to the quantum of resistance for cooper-pairs. △ Less

Submitted 23 April, 2018; originally announced April 2018.

Journal ref: Phys. Rev. B 98, 184515 (2018)

Extreme Sensitivity of the Superconducting State in Thin Films

Authors: I. Tamir, A. Benyamini, E. J. Telford, F. Gorniaczyk, A. Doron, T. Levinson, D. Wang, F. Gay, B. Sacépé, J. Hone, K. Watanabe, T. Taniguchi, C. R. Dean, A. N. Pasupathy, D. Shahar

Abstract: All non-interacting two-dimensional electronic systems are expected to exhibit an insulating ground state. This conspicuous absence of the metallic phase has been challenged only in the case of low-disorder, low density, semiconducting systems where strong interactions dominate the electronic state. Unexpectedly, over the last two decades, there have been multiple reports on the observation of a s… ▽ More All non-interacting two-dimensional electronic systems are expected to exhibit an insulating ground state. This conspicuous absence of the metallic phase has been challenged only in the case of low-disorder, low density, semiconducting systems where strong interactions dominate the electronic state. Unexpectedly, over the last two decades, there have been multiple reports on the observation of a state with metallic characteristics on a variety of thin-film superconductors. To date, no theoretical explanation has been able to fully capture the existence of such a state for the large variety of superconductors exhibiting it. Here we show that for two very different thin-film superconductors, amorphous indium-oxide and a single-crystal of 2H-NbSe2, this metallic state can be eliminated by filtering external radiation. Our results show that these superconducting films are extremely sensitive to external perturbations leading to the suppression of superconductivity and the appearance of temperature independent, metallic like, transport at low temperatures. We relate the extreme sensitivity to the theoretical observation that, in two-dimensions, superconductivity is only marginally stable. △ Less

Submitted 12 April, 2018; originally announced April 2018.

Comments: 10 pages, 6 figures

Absence of cyclotron resonance in the anomalous metallic phase in InO$_x$

Authors: Youcheng Wang, Idan Tamir, Dan Shahar, N. P. Armitage

Abstract: It is observed that many thin superconducting films with not too high disorder level (generally R$_N/\Box \leq 2000 Ω$) placed in magnetic field show an anomalous metallic phase where the resistance is low but still finite as temperature goes to zero. Here we report in weakly disordered amorphous InO$_x$ thin films, that this "Bose metal" metal phase possesses no cyclotron resonance and hence non-… ▽ More It is observed that many thin superconducting films with not too high disorder level (generally R$_N/\Box \leq 2000 Ω$) placed in magnetic field show an anomalous metallic phase where the resistance is low but still finite as temperature goes to zero. Here we report in weakly disordered amorphous InO$_x$ thin films, that this "Bose metal" metal phase possesses no cyclotron resonance and hence non-Drude electrodynamics. Its microwave dynamical conductivity shows signatures of remaining short-range superconducting correlations and strong phase fluctuations through the whole anomalous regime. The absence of a finite frequency resonant mode can be associated with a vanishing downstream component of the vortex current parallel to the supercurrent and an emergent particle-hole symmetry of this anomalous metal, which establishes its non-Fermi liquid character. △ Less

Submitted 20 April, 2018; v1 submitted 6 August, 2017; originally announced August 2017.

Comments: 3 figures in the manuscript and 8 supplementary figures

Journal ref: Phys. Rev. Lett. 120, 167002 (2018)

Non-equilibrium restoration of duality symmetry in the vicinity of the superconductor-insulator transition

Authors: I. Tamir, A. Doron, T. Levinson, F. Gorniaczyk, G. C. Tewari, D. Shahar

Abstract: The magnetic field driven superconductor to insulator transition in thin films was theoretically analyzed via a vortex-charge duality transformation applied to the Hamiltonian. Vortices condensation was conjectured as the underline physical mechanism of the insulating phase. Experimental evidence supported duality symmetry across the magnetic-field driven superconductor to insulator transition in… ▽ More The magnetic field driven superconductor to insulator transition in thin films was theoretically analyzed via a vortex-charge duality transformation applied to the Hamiltonian. Vortices condensation was conjectured as the underline physical mechanism of the insulating phase. Experimental evidence supported duality symmetry across the magnetic-field driven superconductor to insulator transition in amorphous Indium Oxide films. Counterintuitively, duality symmetry is broken at low temperatures where the insulating phase develops strongly non linear current-voltage characteristics. Here, we follow the breakdown of duality symmetry down to very low temperatures and demonstrate the restoration of duality symmetry out of equilibrium. △ Less

Submitted 28 September, 2017; v1 submitted 12 June, 2017; originally announced June 2017.

Comments: 4 pages, 3 figures

Journal ref: Phys. Rev. B 96, 104513 (2017)

A Direct Determination of the Temperature of Overheated Electrons in an Insulator

Authors: Tal Levinson, Adam Doron, Idan Tamir, Girish Chandra Tewari, Dan Shahar

Abstract: Highly disordered superconductors, in the magnetic-field-driven insulating state, can show discontinuous current-voltage characteristics. Electron overheating has been shown to give a consistent description of this behavior, but there are other, more exotic, explanations including a novel, superinsulating state and a many-body localized state. We present AC-DC crossed-measurements, in which the ap… ▽ More Highly disordered superconductors, in the magnetic-field-driven insulating state, can show discontinuous current-voltage characteristics. Electron overheating has been shown to give a consistent description of this behavior, but there are other, more exotic, explanations including a novel, superinsulating state and a many-body localized state. We present AC-DC crossed-measurements, in which the application of a DC voltage is applied along our sample, while a small AC voltage is applied in the transverse direction. We varied the DC voltage and observed a simultaneous discontinuity in both AC and DC currents. We show that the inferred electron-temperature in the transverse measurement matches that in the longitudinal one, strongly supporting electron overheating as the source of observed current-voltage characteristics. Our measurement technique may be applicable as a method of probing electron overheating in many other physical systems, which show discontinuous or non-linear current-voltage characteristics. △ Less

Submitted 30 June, 2016; v1 submitted 22 June, 2016; originally announced June 2016.

Journal ref: Phys. Rev. B 94, 174204 (2016)

Instability of insulators near quantum phase transitions

Authors: Adam Doron, Idan Tamir, Tal Levinson, Maoz Ovadia, Benjamin Sacépé, Dan Shahar

Abstract: Thin films of Amorphous indium oxide undergo a magnetic field driven superconducting to insulator quantum phase transition. In the insulating phase, the current-voltage characteristics show large current discontinuities due to overheating of electrons. We show that the onset voltage for the discontinuities vanishes as we approach the quantum critical point. As a result the insulating phase becom… ▽ More Thin films of Amorphous indium oxide undergo a magnetic field driven superconducting to insulator quantum phase transition. In the insulating phase, the current-voltage characteristics show large current discontinuities due to overheating of electrons. We show that the onset voltage for the discontinuities vanishes as we approach the quantum critical point. As a result the insulating phase becomes unstable with respect to any applied voltage making it, at least experimentally, immeasurable. We emphasize that unlike previous reports of the absence of linear response near quantum phase transitions, in our system, the departure from equilibrium is discontinuous. Because the conditions for these discontinuities are satisfied in most insulators at low temperatures, and due to the decay of all characteristic energy scales near quantum phase transitions, we believe that this instability is general and should occur in various systems while approaching their quantum critical point. Accounting for this instability is crucial for determining the critical behavior of systems near the transition. △ Less

Submitted 9 November, 2017; v1 submitted 21 June, 2016; originally announced June 2016.

Journal ref: Phys. Rev. Lett. 119, 247001 (2017)

High field termination of a Cooper-pair insulator

Authors: B. Sacepe, J. Seidemann, M. Ovadia, I. Tamir, D. Shahar, C. Chapelier, C. Strunk, B. A. Piot

Abstract: We conducted a systematic study of the disorder dependence of the termination of superconductivity, at high magnetic fields (B), of amorphous indium oxide films. Our lower disorder films show conventional behavior where superconductivity is terminated with a transition to a metallic state at a well-defined critical field, Bc2. Our higher disorder samples undergo a B-induced transition into a stron… ▽ More We conducted a systematic study of the disorder dependence of the termination of superconductivity, at high magnetic fields (B), of amorphous indium oxide films. Our lower disorder films show conventional behavior where superconductivity is terminated with a transition to a metallic state at a well-defined critical field, Bc2. Our higher disorder samples undergo a B-induced transition into a strongly insulating state, which terminates at higher B's forming an insulating peak. We demonstrate that the B terminating this peak coincides with Bc2 of the lower disorder samples. Additionally we show that, beyond this field, these samples enter a different insulating state in which the magnetic field dependence of the resistance is weak. These results provide crucial evidence for the importance of Cooper-pairing in the insulating peak regime. △ Less

Submitted 26 June, 2015; v1 submitted 2 April, 2015; originally announced April 2015.

Comments: 5 pages, 3 figures, minor changes

Journal ref: Phys. Rev. B 91, 220508(R) (2015)

Evidence for a Finite Temperature Insulator

Authors: M. Ovadia, D. Kalok, I. Tamir, S. Mitra, B. Sacepe, D. Shahar

Abstract: In superconductors the zero-resistance current-flow is protected from dissipation at finite temperatures (T) by virtue of the short-circuit condition maintained by the electrons that remain in the condensed state. The recently suggested finite-T insulator and the "superinsulating" phase are different because any residual mechanism of conduction will eventually become dominant as the finite-T insul… ▽ More In superconductors the zero-resistance current-flow is protected from dissipation at finite temperatures (T) by virtue of the short-circuit condition maintained by the electrons that remain in the condensed state. The recently suggested finite-T insulator and the "superinsulating" phase are different because any residual mechanism of conduction will eventually become dominant as the finite-T insulator sets-in. If the residual conduction is small it may be possible to observe the transition to these intriguing states. We show that the conductivity of the high magnetic-field insulator terminating superconductivity in amorphous indium-oxide exhibits an abrupt drop, and seem to approach a zero conductance at T<0.04 K. We discuss our results in the light of theories that lead to a finite-T insulator. △ Less

Submitted 8 February, 2016; v1 submitted 29 June, 2014; originally announced June 2014.

Journal ref: Scientific Reports 5, Article number: 13503 (2015)