Skip to main content

Showing 1–50 of 65 results for author: Golland, P

Searching in archive cs. Search in all archives.
.
  1. arXiv:2406.11737  [pdf, other

    cs.CV cs.GR

    InterNeRF: Scaling Radiance Fields via Parameter Interpolation

    Authors: Clinton Wang, Peter Hedman, Polina Golland, Jonathan T. Barron, Daniel Duckworth

    Abstract: Neural Radiance Fields (NeRFs) have unmatched fidelity on large, real-world scenes. A common approach for scaling NeRFs is to partition the scene into regions, each of which is assigned its own parameters. When implemented naively, such an approach is limited by poor test-time scaling and inconsistent appearance and geometry. We instead propose InterNeRF, a novel architecture for rendering a targe… ▽ More

    Submitted 17 June, 2024; originally announced June 2024.

    Comments: Presented at CVPR 2024 Neural Rendering Intelligence Workshop

  2. arXiv:2404.00132  [pdf, other

    eess.IV cs.CV

    FetalDiffusion: Pose-Controllable 3D Fetal MRI Synthesis with Conditional Diffusion Model

    Authors: Molin Zhang, Polina Golland, Patricia Ellen Grant, Elfar Adalsteinsson

    Abstract: The quality of fetal MRI is significantly affected by unpredictable and substantial fetal motion, leading to the introduction of artifacts even when fast acquisition sequences are employed. The development of 3D real-time fetal pose estimation approaches on volumetric EPI fetal MRI opens up a promising avenue for fetal motion monitoring and prediction. Challenges arise in fetal pose estimation due… ▽ More

    Submitted 29 March, 2024; originally announced April 2024.

    Comments: 8 pages, 3 figures, 2 tables, submitted to MICCAI 2024, code available if accepted

  3. arXiv:2402.02318  [pdf, other

    cs.LG cs.CL

    Diversity Measurement and Subset Selection for Instruction Tuning Datasets

    Authors: Peiqi Wang, Yikang Shen, Zhen Guo, Matthew Stallone, Yoon Kim, Polina Golland, Rameswar Panda

    Abstract: We aim to select data subsets for the fine-tuning of large language models to more effectively follow instructions. Prior work has emphasized the importance of diversity in dataset curation but relied on heuristics such as the number of tasks. In this paper, we use determinantal point processes to capture the diversity and quality of instruction tuning datasets for subset selection. We propose to… ▽ More

    Submitted 3 February, 2024; originally announced February 2024.

  4. SE(3)-Equivariant and Noise-Invariant 3D Rigid Motion Tracking in Brain MRI

    Authors: Benjamin Billot, Neel Dey, Daniel Moyer, Malte Hoffmann, Esra Abaci Turk, Borjan Gagoski, Ellen Grant, Polina Golland

    Abstract: Rigid motion tracking is paramount in many medical imaging applications where movements need to be detected, corrected, or accounted for. Modern strategies rely on convolutional neural networks (CNN) and pose this problem as rigid registration. Yet, CNNs do not exploit natural symmetries in this task, as they are equivariant to translations (their outputs shift with their inputs) but not to rotati… ▽ More

    Submitted 12 June, 2024; v1 submitted 20 December, 2023; originally announced December 2023.

    Comments: Published at IEEE transactions on Medical Imaging

  5. arXiv:2312.06358  [pdf, other

    cs.CV

    Intraoperative 2D/3D Image Registration via Differentiable X-ray Rendering

    Authors: Vivek Gopalakrishnan, Neel Dey, Polina Golland

    Abstract: Surgical decisions are informed by aligning rapid portable 2D intraoperative images (e.g., X-rays) to a high-fidelity 3D preoperative reference scan (e.g., CT). 2D/3D image registration often fails in practice: conventional optimization methods are prohibitively slow and susceptible to local minima, while neural networks trained on small datasets fail on new patients or require impractical landmar… ▽ More

    Submitted 27 March, 2024; v1 submitted 11 December, 2023; originally announced December 2023.

    Comments: CVPR 2024

  6. Shape-aware Segmentation of the Placenta in BOLD Fetal MRI Time Series

    Authors: S. Mazdak Abulnaga, Neel Dey, Sean I. Young, Eileen Pan, Katherine I. Hobgood, Clinton J. Wang, P. Ellen Grant, Esra Abaci Turk, Polina Golland

    Abstract: Blood oxygen level dependent (BOLD) MRI time series with maternal hyperoxia can assess placental oxygenation and function. Measuring precise BOLD changes in the placenta requires accurate temporal placental segmentation and is confounded by fetal and maternal motion, contractions, and hyperoxia-induced intensity changes. Current BOLD placenta segmentation methods warp a manually annotated subject-… ▽ More

    Submitted 8 December, 2023; originally announced December 2023.

    Comments: Accepted for publication at the Journal of Machine Learning for Biomedical Imaging (MELBA) https://melba-journal.org/2023:017. arXiv admin note: substantial text overlap with arXiv:2208.02895

    Journal ref: Machine.Learning.for.Biomedical.Imaging. 2 (2023)

  7. arXiv:2312.03102  [pdf

    eess.IV cs.CV cs.LG

    Fully Convolutional Slice-to-Volume Reconstruction for Single-Stack MRI

    Authors: Sean I. Young, Yaƫl Balbastre, Bruce Fischl, Polina Golland, Juan Eugenio Iglesias

    Abstract: In magnetic resonance imaging (MRI), slice-to-volume reconstruction (SVR) refers to computational reconstruction of an unknown 3D magnetic resonance volume from stacks of 2D slices corrupted by motion. While promising, current SVR methods require multiple slice stacks for accurate 3D reconstruction, leading to long scans and limiting their use in time-sensitive applications such as fetal fMRI. Her… ▽ More

    Submitted 28 February, 2024; v1 submitted 5 December, 2023; originally announced December 2023.

    Comments: Accepted to CVPR 2024

  8. arXiv:2311.02874  [pdf, other

    eess.IV cs.CV cs.LG

    Dynamic Neural Fields for Learning Atlases of 4D Fetal MRI Time-series

    Authors: Zeen Chi, Zhongxiao Cong, Clinton J. Wang, Yingcheng Liu, Esra Abaci Turk, P. Ellen Grant, S. Mazdak Abulnaga, Polina Golland, Neel Dey

    Abstract: We present a method for fast biomedical image atlas construction using neural fields. Atlases are key to biomedical image analysis tasks, yet conventional and deep network estimation methods remain time-intensive. In this preliminary work, we frame subject-specific atlas building as learning a neural field of deformable spatiotemporal observations. We apply our method to learning subject-specific… ▽ More

    Submitted 6 November, 2023; originally announced November 2023.

    Comments: 6 pages, 2 figures. Accepted by Medical Imaging Meets NeurIPS 2023

  9. arXiv:2310.19635  [pdf, other

    cs.CV

    Bidirectional Captioning for Clinically Accurate and Interpretable Models

    Authors: Keegan Quigley, Miriam Cha, Josh Barua, Geeticka Chauhan, Seth Berkowitz, Steven Horng, Polina Golland

    Abstract: Vision-language pretraining has been shown to produce high-quality visual encoders which transfer efficiently to downstream computer vision tasks. While generative language models have gained widespread attention, image captioning has thus far been mostly overlooked as a form of cross-modal pretraining in favor of contrastive learning, especially in medical image analysis. In this paper, we experi… ▽ More

    Submitted 30 October, 2023; originally announced October 2023.

    Comments: 12 pages, 7 figures. Code release to follow

  10. arXiv:2310.05133  [pdf, other

    cs.CV cs.LG

    Geometry Aware Field-to-field Transformations for 3D Semantic Segmentation

    Authors: Dominik Hollidt, Clinton Wang, Polina Golland, Marc Pollefeys

    Abstract: We present a novel approach to perform 3D semantic segmentation solely from 2D supervision by leveraging Neural Radiance Fields (NeRFs). By extracting features along a surface point cloud, we achieve a compact representation of the scene which is sample-efficient and conducive to 3D reasoning. Learning this feature space in an unsupervised manner via masked autoencoding enables few-shot segmentati… ▽ More

    Submitted 8 October, 2023; originally announced October 2023.

    Comments: 8 pages

  11. arXiv:2310.03870  [pdf, other

    cs.CV

    Consistency Regularization Improves Placenta Segmentation in Fetal EPI MRI Time Series

    Authors: Yingcheng Liu, Neerav Karani, Neel Dey, S. Mazdak Abulnaga, Junshen Xu, P. Ellen Grant, Esra Abaci Turk, Polina Golland

    Abstract: The placenta plays a crucial role in fetal development. Automated 3D placenta segmentation from fetal EPI MRI holds promise for advancing prenatal care. This paper proposes an effective semi-supervised learning method for improving placenta segmentation in fetal EPI MRI time series. We employ consistency regularization loss that promotes consistency under spatial transformation of the same image a… ▽ More

    Submitted 15 October, 2023; v1 submitted 5 October, 2023; originally announced October 2023.

  12. arXiv:2307.12560  [pdf, other

    cs.CV

    Interpolating between Images with Diffusion Models

    Authors: Clinton J. Wang, Polina Golland

    Abstract: One little-explored frontier of image generation and editing is the task of interpolating between two input images, a feature missing from all currently deployed image generation pipelines. We argue that such a feature can expand the creative applications of such models, and propose a method for zero-shot interpolation using latent diffusion models. We apply interpolation in the latent space at a… ▽ More

    Submitted 24 July, 2023; originally announced July 2023.

    Comments: Presented at ICML 2023 Workshop on Challenges of Deploying Generative AI

  13. arXiv:2307.08163  [pdf, other

    cs.CV

    Boundary-weighted logit consistency improves calibration of segmentation networks

    Authors: Neerav Karani, Neel Dey, Polina Golland

    Abstract: Neural network prediction probabilities and accuracy are often only weakly-correlated. Inherent label ambiguity in training data for image segmentation aggravates such miscalibration. We show that logit consistency across stochastic transformations acts as a spatially varying regularizer that prevents overconfident predictions at pixels with ambiguous labels. Our boundary-weighted extension of thi… ▽ More

    Submitted 16 July, 2023; originally announced July 2023.

    Comments: Accepted for publication at MICCAI 2023

  14. arXiv:2307.07044  [pdf, other

    cs.CV cs.LG

    AnyStar: Domain randomized universal star-convex 3D instance segmentation

    Authors: Neel Dey, S. Mazdak Abulnaga, Benjamin Billot, Esra Abaci Turk, P. Ellen Grant, Adrian V. Dalca, Polina Golland

    Abstract: Star-convex shapes arise across bio-microscopy and radiology in the form of nuclei, nodules, metastases, and other units. Existing instance segmentation networks for such structures train on densely labeled instances for each dataset, which requires substantial and often impractical manual annotation effort. Further, significant reengineering or finetuning is needed when presented with new dataset… ▽ More

    Submitted 13 July, 2023; originally announced July 2023.

    Comments: Code available at https://github.com/neel-dey/AnyStar

  15. arXiv:2305.03413  [pdf, other

    eess.IV cs.CV cs.LG q-bio.QM

    Domain-agnostic segmentation of thalamic nuclei from joint structural and diffusion MRI

    Authors: Henry F. J. Tregidgo, Sonja Soskic, Mark D. Olchanyi, Juri Althonayan, Benjamin Billot, Chiara Maffei, Polina Golland, Anastasia Yendiki, Daniel C. Alexander, Martina Bocchetta, Jonathan D. Rohrer, Juan Eugenio Iglesias

    Abstract: The human thalamus is a highly connected subcortical grey-matter structure within the brain. It comprises dozens of nuclei with different function and connectivity, which are affected differently by disease. For this reason, there is growing interest in studying the thalamic nuclei in vivo with MRI. Tools are available to segment the thalamus from 1 mm T1 scans, but the contrast of the lateral and… ▽ More

    Submitted 5 May, 2023; originally announced May 2023.

    Comments: Under review

  16. arXiv:2304.13181  [pdf, other

    cs.LG cs.CV

    Sample-Specific Debiasing for Better Image-Text Models

    Authors: Peiqi Wang, Yingcheng Liu, Ching-Yun Ko, William M. Wells, Seth Berkowitz, Steven Horng, Polina Golland

    Abstract: Self-supervised representation learning on image-text data facilitates crucial medical applications, such as image classification, visual grounding, and cross-modal retrieval. One common approach involves contrasting semantically similar (positive) and dissimilar (negative) pairs of data points. Drawing negative samples uniformly from the training data set introduces false negatives, i.e., samples… ▽ More

    Submitted 12 August, 2023; v1 submitted 25 April, 2023; originally announced April 2023.

    Comments: Machine Learning for Healthcare Conference 2023

  17. arXiv:2301.10365  [pdf, other

    eess.IV cs.CV cs.LG

    Data Consistent Deep Rigid MRI Motion Correction

    Authors: Nalini M. Singh, Neel Dey, Malte Hoffmann, Bruce Fischl, Elfar Adalsteinsson, Robert Frost, Adrian V. Dalca, Polina Golland

    Abstract: Motion artifacts are a pervasive problem in MRI, leading to misdiagnosis or mischaracterization in population-level imaging studies. Current retrospective rigid intra-slice motion correction techniques jointly optimize estimates of the image and the motion parameters. In this paper, we use a deep network to reduce the joint image-motion parameter search to a search over rigid motion parameters alo… ▽ More

    Submitted 16 November, 2023; v1 submitted 24 January, 2023; originally announced January 2023.

    Comments: Presented at MIDL 2023. 14 pages, 6 figures. Keywords: motion correction, magnetic resonance imaging, deep learning

  18. Using Multiple Instance Learning to Build Multimodal Representations

    Authors: Peiqi Wang, William M. Wells, Seth Berkowitz, Steven Horng, Polina Golland

    Abstract: Image-text multimodal representation learning aligns data across modalities and enables important medical applications, e.g., image classification, visual grounding, and cross-modal retrieval. In this work, we establish a connection between multimodal representation learning and multiple instance learning. Based on this connection, we propose a generic framework for constructing permutation-invari… ▽ More

    Submitted 9 March, 2023; v1 submitted 11 December, 2022; originally announced December 2022.

  19. arXiv:2209.14267  [pdf, ps, other

    cs.LG cs.CV

    Less is More: Rethinking Few-Shot Learning and Recurrent Neural Nets

    Authors: Deborah Pereg, Martin Villiger, Brett Bouma, Polina Golland

    Abstract: The statistical supervised learning framework assumes an input-output set with a joint probability distribution that is reliably represented by the training dataset. The learner is then required to output a prediction rule learned from the training dataset's input-output pairs. In this work, we provide meaningful insights into the asymptotic equipartition property (AEP) \citep{Shannon:1948} in the… ▽ More

    Submitted 25 February, 2023; v1 submitted 28 September, 2022; originally announced September 2022.

  20. arXiv:2208.12737  [pdf, other

    cs.CV cs.GR

    Fast Auto-Differentiable Digitally Reconstructed Radiographs for Solving Inverse Problems in Intraoperative Imaging

    Authors: Vivek Gopalakrishnan, Polina Golland

    Abstract: The use of digitally reconstructed radiographs (DRRs) to solve inverse problems such as slice-to-volume registration and 3D reconstruction is well-studied in preoperative settings. In intraoperative imaging, the utility of DRRs is limited by the challenges in generating them in real-time and supporting optimization procedures that rely on repeated DRR synthesis. While immense progress has been mad… ▽ More

    Submitted 26 August, 2022; originally announced August 2022.

    Comments: Published in Clinical Image-based Procedures (CLIP) workshop at MICCAI 2022

  21. RadTex: Learning Efficient Radiograph Representations from Text Reports

    Authors: Keegan Quigley, Miriam Cha, Ruizhi Liao, Geeticka Chauhan, Steven Horng, Seth Berkowitz, Polina Golland

    Abstract: Automated analysis of chest radiography using deep learning has tremendous potential to enhance the clinical diagnosis of diseases in patients. However, deep learning models typically require large amounts of annotated data to achieve high performance -- often an obstacle to medical domain adaptation. In this paper, we build a data-efficient learning framework that utilizes radiology reports to im… ▽ More

    Submitted 7 April, 2023; v1 submitted 5 August, 2022; originally announced August 2022.

    Comments: Awarded Best Paper at Resource Efficient Medical Image Analysis (REMIA) Workshop, MICCAI 2022

  22. arXiv:2208.02895  [pdf, other

    eess.IV cs.CV cs.LG

    Automatic Segmentation of the Placenta in BOLD MRI Time Series

    Authors: S. Mazdak Abulnaga, Sean I. Young, Katherine Hobgood, Eileen Pan, Clinton J. Wang, P. Ellen Grant, Esra Abaci Turk, Polina Golland

    Abstract: Blood oxygen level dependent (BOLD) MRI with maternal hyperoxia can assess oxygen transport within the placenta and has emerged as a promising tool to study placental function. Measuring signal changes over time requires segmenting the placenta in each volume of the time series. Due to the large number of volumes in the BOLD time series, existing studies rely on registration to map all volumes to… ▽ More

    Submitted 4 August, 2022; originally announced August 2022.

    Comments: Accepted at MICCAI PIPPI 2022

  23. arXiv:2206.10802  [pdf, other

    eess.IV cs.CV

    SVoRT: Iterative Transformer for Slice-to-Volume Registration in Fetal Brain MRI

    Authors: Junshen Xu, Daniel Moyer, P. Ellen Grant, Polina Golland, Juan Eugenio Iglesias, Elfar Adalsteinsson

    Abstract: Volumetric reconstruction of fetal brains from multiple stacks of MR slices, acquired in the presence of almost unpredictable and often severe subject motion, is a challenging task that is highly sensitive to the initialization of slice-to-volume transformations. We propose a novel slice-to-volume registration method using Transformers trained on synthetically transformed data, which model multipl… ▽ More

    Submitted 21 June, 2022; originally announced June 2022.

    Comments: Accepted by MICCAI 2022

  24. arXiv:2206.01178  [pdf, other

    cs.LG cs.CV cs.NE

    Discretization Invariant Networks for Learning Maps between Neural Fields

    Authors: Clinton J. Wang, Polina Golland

    Abstract: With the emergence of powerful representations of continuous data in the form of neural fields, there is a need for discretization invariant learning: an approach for learning maps between functions on continuous domains without being sensitive to how the function is sampled. We present a new framework for understanding and designing discretization invariant neural networks (DI-Nets), which genera… ▽ More

    Submitted 19 October, 2023; v1 submitted 2 June, 2022; originally announced June 2022.

    Comments: Published in Transactions on Machine Learning Research 2023

  25. arXiv:2202.02952  [pdf

    eess.IV cs.CV cs.LG

    Supervision by Denoising for Medical Image Segmentation

    Authors: Sean I. Young, Adrian V. Dalca, Enzo Ferrante, Polina Golland, Christopher A. Metzler, Bruce Fischl, Juan Eugenio Iglesias

    Abstract: Learning-based image reconstruction models, such as those based on the U-Net, require a large set of labeled images if good generalization is to be guaranteed. In some imaging domains, however, labeled data with pixel- or voxel-level label accuracy are scarce due to the cost of acquiring them. This problem is exacerbated further in domains like medical imaging, where there is no single ground trut… ▽ More

    Submitted 4 January, 2024; v1 submitted 7 February, 2022; originally announced February 2022.

    Comments: To appear in the IEEE Transactions on Pattern Analysis and Machine Intelligence

  26. arXiv:2202.02568  [pdf, other

    cs.GR cs.AI

    Symmetric Volume Maps: Order-Invariant Volumetric Mesh Correspondence with Free Boundary

    Authors: S. Mazdak Abulnaga, Oded Stein, Polina Golland, Justin Solomon

    Abstract: Although shape correspondence is a central problem in geometry processing, most methods for this task apply only to two-dimensional surfaces. The neglected task of volumetric correspondence--a natural extension relevant to shapes extracted from simulation, medical imaging, and volume rendering--presents unique challenges that do not appear in the two-dimensional case. In this work, we propose a me… ▽ More

    Submitted 16 November, 2022; v1 submitted 5 February, 2022; originally announced February 2022.

    Comments: Accepted to ACM Transactions on Graphics. Our code is available at https://github.com/mabulnaga/symmetric-volume-maps

  27. arXiv:2112.06693  [pdf, other

    eess.IV cs.CV cs.LG

    Hypernet-Ensemble Learning of Segmentation Probability for Medical Image Segmentation with Ambiguous Labels

    Authors: Sungmin Hong, Anna K. Bonkhoff, Andrew Hoopes, Martin Bretzner, Markus D. Schirmer, Anne-Katrin Giese, Adrian V. Dalca, Polina Golland, Natalia S. Rost

    Abstract: Despite the superior performance of Deep Learning (DL) on numerous segmentation tasks, the DL-based approaches are notoriously overconfident about their prediction with highly polarized label probability. This is often not desirable for many applications with the inherent label ambiguity even in human annotations. This challenge has been addressed by leveraging multiple annotations per image and t… ▽ More

    Submitted 13 December, 2021; originally announced December 2021.

    MSC Class: 68T07 (Primary) 92C55; 94A08 (Secondary) ACM Class: I.4; I.4.6; I.2; I.2.1; I.5.1; I.5.4; J.3

  28. arXiv:2111.07900  [pdf, other

    cs.CV

    Volumetric Parameterization of the Placenta to a Flattened Template

    Authors: S. Mazdak Abulnaga, Esra Abaci Turk, Mikhail Bessmeltsev, P. Ellen Grant, Justin Solomon, Polina Golland

    Abstract: We present a volumetric mesh-based algorithm for parameterizing the placenta to a flattened template to enable effective visualization of local anatomy and function. MRI shows potential as a research tool as it provides signals directly related to placental function. However, due to the curved and highly variable in vivo shape of the placenta, interpreting and visualizing these images is difficult… ▽ More

    Submitted 15 November, 2021; originally announced November 2021.

    Comments: Accepted to IEEE TMI ( (c) IEEE). This manuscript expands the MICCAI 2019 paper (ar** additional template models and extensions to improve robustness, expanded evaluation on a significantly larger dataset, and experiments and discussion demonstrating utility for clinical research. Code is available at https://github.com/mabulnaga/placenta-flattening

  29. arXiv:2111.07048  [pdf, other

    cs.CV

    Image Classification with Consistent Supporting Evidence

    Authors: Peiqi Wang, Ruizhi Liao, Daniel Moyer, Seth Berkowitz, Steven Horng, Polina Golland

    Abstract: Adoption of machine learning models in healthcare requires end users' trust in the system. Models that provide additional supportive evidence for their predictions promise to facilitate adoption. We define consistent evidence to be both compatible and sufficient with respect to model predictions. We propose measures of model inconsistency and regularizers that promote more consistent evidence. We… ▽ More

    Submitted 13 November, 2021; originally announced November 2021.

    Comments: 13 pages, 6 figures, proceedings of the Machine Learning for Health NeurIPS Workshop, 2021

  30. arXiv:2107.09700  [pdf, other

    eess.IV cs.CV cs.LG

    3D-StyleGAN: A Style-Based Generative Adversarial Network for Generative Modeling of Three-Dimensional Medical Images

    Authors: Sungmin Hong, Razvan Marinescu, Adrian V. Dalca, Anna K. Bonkhoff, Martin Bretzner, Natalia S. Rost, Polina Golland

    Abstract: Image synthesis via Generative Adversarial Networks (GANs) of three-dimensional (3D) medical images has great potential that can be extended to many medical applications, such as, image enhancement and disease progression modeling. However, current GAN technologies for 3D medical image synthesis need to be significantly improved to be readily adapted to real-world medical problems. In this paper,… ▽ More

    Submitted 20 July, 2021; originally announced July 2021.

    Comments: 11 pages, 6 figures, 2 tables. Provisionally Accepted at DGM4MICCAI workshop in MICCAI 2021

    MSC Class: 68T07 (Primary) 68T01 (Secondary) ACM Class: I.2; I.4

  31. arXiv:2106.12407  [pdf, other

    eess.IV cs.CV

    STRESS: Super-Resolution for Dynamic Fetal MRI using Self-Supervised Learning

    Authors: Junshen Xu, Esra Abaci Turk, P. Ellen Grant, Polina Golland, Elfar Adalsteinsson

    Abstract: Fetal motion is unpredictable and rapid on the scale of conventional MR scan times. Therefore, dynamic fetal MRI, which aims at capturing fetal motion and dynamics of fetal function, is limited to fast imaging techniques with compromises in image quality and resolution. Super-resolution for dynamic fetal MRI is still a challenge, especially when multi-oriented stacks of image slices for oversampli… ▽ More

    Submitted 30 June, 2021; v1 submitted 23 June, 2021; originally announced June 2021.

  32. arXiv:2105.05137  [pdf, other

    eess.IV cs.CV

    Segmentation of Anatomical Layers and Artifacts in Intravascular Polarization Sensitive Optical Coherence Tomography Using Attending Physician and Boundary Cardinality Losses

    Authors: Mohammad Haft-Javaherian, Martin Villiger, Kenichiro Otsuka, Joost Daemen, Peter Libby, Polina Golland, Brett E. Bouma

    Abstract: Intravascular ultrasound and optical coherence tomography are widely available for characterizing coronary stenoses and provide critical vessel parameters to optimize percutaneous intervention. Intravascular polarization-sensitive optical coherence tomography (PS-OCT) simultaneously provides high-resolution cross-sectional images of vascular structures while also revealing preponderant tissue comp… ▽ More

    Submitted 13 September, 2022; v1 submitted 11 May, 2021; originally announced May 2021.

  33. arXiv:2103.14696  [pdf, other

    cs.GR

    BrainPainter v2: Mouse Brain Visualization Software

    Authors: Vedvayas Mallela, Polina Golland, Razvan V. Marinescu

    Abstract: BrainPainter is a software for the 3D visualization of human brain structures; it generates colored brain images using user-defined biomarker data for each brain region. However, BrainPainter is only able to generate human brain images. In this paper, we present updates to the existing BrainPainter software which enables the generation of mouse brain images. We load meshes for each mouse brain reg… ▽ More

    Submitted 24 March, 2021; originally announced March 2021.

    Comments: 9 pages, 4 figures, 2 movies (see ancillary files)

    ACM Class: I.3.5

  34. arXiv:2103.10255  [pdf, other

    cs.CV cs.LG q-bio.QM

    Equivariant Filters for Efficient Tracking in 3D Imaging

    Authors: Daniel Moyer, Esra Abaci Turk, P Ellen Grant, William M. Wells, Polina Golland

    Abstract: We demonstrate an object tracking method for 3D images with fixed computational cost and state-of-the-art performance. Previous methods predicted transformation parameters from convolutional layers. We instead propose an architecture that does not include either flattening of convolutional features or fully connected layers, but instead relies on equivariant filters to preserve transformations bet… ▽ More

    Submitted 27 September, 2021; v1 submitted 18 March, 2021; originally announced March 2021.

    Comments: MICCAI 2021 Early Accept

  35. Multimodal Representation Learning via Maximization of Local Mutual Information

    Authors: Ruizhi Liao, Daniel Moyer, Miriam Cha, Keegan Quigley, Seth Berkowitz, Steven Horng, Polina Golland, William M. Wells

    Abstract: We propose and demonstrate a representation learning approach by maximizing the mutual information between local features of images and text. The goal of this approach is to learn useful image representations by taking advantage of the rich information contained in the free text that describes the findings in the image. Our method trains image and text encoders by encouraging the resulting represe… ▽ More

    Submitted 14 December, 2021; v1 submitted 7 March, 2021; originally announced March 2021.

    Comments: In Proceedings of International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), 2021

    Journal ref: In International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 273-283. Springer, Cham, 2021

  36. arXiv:2101.06255  [pdf, ps, other

    cs.LG cs.CV eess.IV q-bio.QM stat.ML

    Harmonization and the Worst Scanner Syndrome

    Authors: Daniel Moyer, Polina Golland

    Abstract: We show that for a wide class of harmonization/domain-invariance schemes several undesirable properties are unavoidable. If a predictive machine is made invariant to a set of domains, the accuracy of the output predictions (as measured by mutual information) is limited by the domain with the least amount of information to begin with. If a real label value is highly informative about the source dom… ▽ More

    Submitted 21 April, 2021; v1 submitted 15 January, 2021; originally announced January 2021.

    Comments: Med-NeurIPS 2020 Workshop Paper, updated 4/2021

  37. arXiv:2012.13340  [pdf, other

    eess.IV cs.CV

    Joint super-resolution and synthesis of 1 mm isotropic MP-RAGE volumes from clinical MRI exams with scans of different orientation, resolution and contrast

    Authors: Juan Eugenio Iglesias, Benjamin Billot, Yael Balbastre, Azadeh Tabari, John Conklin, Daniel C. Alexander, Polina Golland, Brian L. Edlow, Bruce Fischl

    Abstract: Most existing algorithms for automatic 3D morphometry of human brain MRI scans are designed for data with near-isotropic voxels at approximately 1 mm resolution, and frequently have contrast constraints as well - typically requiring T1 scans (e.g., MP-RAGE). This limitation prevents the analysis of millions of MRI scans acquired with large inter-slice spacing ("thick slice") in clinical settings e… ▽ More

    Submitted 24 December, 2020; originally announced December 2020.

  38. arXiv:2012.04567  [pdf, other

    cs.CV cs.LG cs.NE eess.IV stat.ML

    Bayesian Image Reconstruction using Deep Generative Models

    Authors: Razvan V Marinescu, Daniel Moyer, Polina Golland

    Abstract: Machine learning models are commonly trained end-to-end and in a supervised setting, using paired (input, output) data. Examples include recent super-resolution methods that train on pairs of (low-resolution, high-resolution) images. However, these end-to-end approaches require re-training every time there is a distribution shift in the inputs (e.g., night images vs daylight) or relevant latent va… ▽ More

    Submitted 9 December, 2021; v1 submitted 8 December, 2020; originally announced December 2020.

    Comments: 27 pages, 17 figures, 5 tables

    Journal ref: NeurIPS 2021 Workshop on Deep Generative Models and Downstream Applications

  39. arXiv:2010.12721  [pdf, other

    cs.LG stat.ML

    PEP: Parameter Ensembling by Perturbation

    Authors: Alireza Mehrtash, Purang Abolmaesumi, Polina Golland, Tina Kapur, Demian Wassermann, William M. Wells III

    Abstract: Ensembling is now recognized as an effective approach for increasing the predictive performance and calibration of deep networks. We introduce a new approach, Parameter Ensembling by Perturbation (PEP), that constructs an ensemble of parameter values as random perturbations of the optimal parameter set from training by a Gaussian with a single variance parameter. The variance is chosen to maximize… ▽ More

    Submitted 23 October, 2020; originally announced October 2020.

    Comments: NeurIPS 2020

  40. arXiv:2010.04757  [pdf, other

    cs.CV

    Predictive Modeling of Anatomy with Genetic and Clinical Data

    Authors: Adrian V. Dalca, Ramesh Sridharan, Mert R. Sabuncu, Polina Golland

    Abstract: We present a semi-parametric generative model for predicting anatomy of a patient in subsequent scans following a single baseline image. Such predictive modeling promises to facilitate novel analyses in both voxel-level studies and longitudinal biomarker evaluation. We capture anatomical change through a combination of population-wide regression and a non-parametric model of the subject's health b… ▽ More

    Submitted 9 October, 2020; originally announced October 2020.

    Comments: MICCAI 2015. Keywords: Neuroimaging, Anatomical prediction, Synthesis, Simulation, Genetics, Generative model, Linear mixed effects, Kernel Machines

  41. arXiv:2010.01766  [pdf, other

    cs.LG stat.ML

    DEMI: Discriminative Estimator of Mutual Information

    Authors: Ruizhi Liao, Daniel Moyer, Polina Golland, William M. Wells

    Abstract: Estimating mutual information between continuous random variables is often intractable and extremely challenging for high-dimensional data. Recent progress has leveraged neural networks to optimize variational lower bounds on mutual information. Although showing promise for this difficult problem, the variational methods have been theoretically and empirically proven to have serious statistical li… ▽ More

    Submitted 29 November, 2020; v1 submitted 5 October, 2020; originally announced October 2020.

  42. arXiv:2008.09884  [pdf, other

    cs.CV

    Joint Modeling of Chest Radiographs and Radiology Reports for Pulmonary Edema Assessment

    Authors: Geeticka Chauhan, Ruizhi Liao, William Wells, Jacob Andreas, Xin Wang, Seth Berkowitz, Steven Horng, Peter Szolovits, Polina Golland

    Abstract: We propose and demonstrate a novel machine learning algorithm that assesses pulmonary edema severity from chest radiographs. While large publicly available datasets of chest radiographs and free-text radiology reports exist, only limited numerical edema severity labels can be extracted from radiology reports. This is a significant challenge in learning such models for image classification. To take… ▽ More

    Submitted 22 August, 2020; originally announced August 2020.

    Comments: The two first authors contributed equally. To be published in the proceedings of MICCAI 2020

  43. Deep Learning to Quantify Pulmonary Edema in Chest Radiographs

    Authors: Steven Horng, Ruizhi Liao, Xin Wang, Sandeep Dalal, Polina Golland, Seth J Berkowitz

    Abstract: Purpose: To develop a machine learning model to classify the severity grades of pulmonary edema on chest radiographs. Materials and Methods: In this retrospective study, 369,071 chest radiographs and associated radiology reports from 64,581 (mean age, 51.71; 54.51% women) patients from the MIMIC-CXR chest radiograph dataset were included. This dataset was split into patients with and without con… ▽ More

    Submitted 7 January, 2021; v1 submitted 13 August, 2020; originally announced August 2020.

    Comments: The two first authors contributed equally

  44. arXiv:2007.08146  [pdf, other

    cs.CV eess.IV

    Enhanced detection of fetal pose in 3D MRI by Deep Reinforcement Learning with physical structure priors on anatomy

    Authors: Molin Zhang, Junshen Xu, Esra Abaci Turk, P. Ellen Grant, Polina Golland, Elfar Adalsteinsson

    Abstract: Fetal MRI is heavily constrained by unpredictable and substantial fetal motion that causes image artifacts and limits the set of viable diagnostic image contrasts. Current mitigation of motion artifacts is predominantly performed by fast, single-shot MRI and retrospective motion correction. Estimation of fetal pose in real time during MRI stands to benefit prospective methods to detect and mitigat… ▽ More

    Submitted 16 July, 2020; originally announced July 2020.

    Comments: 10 pages, 3 figures, MICCAI 2020

  45. arXiv:2007.01441  [pdf, other

    cs.CV cs.LG eess.IV

    Joint Frequency and Image Space Learning for MRI Reconstruction and Analysis

    Authors: Nalini M. Singh, Juan Eugenio Iglesias, Elfar Adalsteinsson, Adrian V. Dalca, Polina Golland

    Abstract: We propose neural network layers that explicitly combine frequency and image feature representations and show that they can be used as a versatile building block for reconstruction from frequency space data. Our work is motivated by the challenges arising in MRI acquisition where the signal is a corrupted Fourier transform of the desired image. The proposed joint learning schemes enable both corre… ▽ More

    Submitted 17 June, 2022; v1 submitted 2 July, 2020; originally announced July 2020.

    Comments: Accepted for publication at the Journal of Machine Learning for Biomedical Imaging (MELBA) https://www.melba-journal.org/papers/2022:018.html

  46. arXiv:2006.12704  [pdf, other

    eess.IV cs.CV

    Semi-Supervised Learning for Fetal Brain MRI Quality Assessment with ROI consistency

    Authors: Junshen Xu, Sayeri Lala, Borjan Gagoski, Esra Abaci Turk, P. Ellen Grant, Polina Golland, Elfar Adalsteinsson

    Abstract: Fetal brain MRI is useful for diagnosing brain abnormalities but is challenged by fetal motion. The current protocol for T2-weighted fetal brain MRI is not robust to motion so image volumes are degraded by inter- and intra- slice motion artifacts. Besides, manual annotation for fetal MR image quality assessment are usually time-consuming. Therefore, in this work, a semi-supervised deep learning me… ▽ More

    Submitted 22 June, 2020; originally announced June 2020.

  47. arXiv:2004.12926  [pdf

    cs.CY cs.AI q-bio.NC

    A New Age of Computing and the Brain

    Authors: Polina Golland, Jack Gallant, Greg Hager, Hanspeter Pfister, Christos Papadimitriou, Stefan Schaal, Joshua T. Vogelstein

    Abstract: The history of computer science and brain sciences are intertwined. In his unfinished manuscript "The Computer and the Brain," von Neumann debates whether or not the brain can be thought of as a computing machine and identifies some of the similarities and differences between natural and artificial computation. Turing, in his 1950 article in Mind, argues that computing devices could ultimately emu… ▽ More

    Submitted 27 April, 2020; originally announced April 2020.

    Comments: A Computing Community Consortium (CCC) workshop report, 24 pages

    Report number: ccc2014report_5

  48. arXiv:1907.07783  [pdf, other

    eess.IV cs.CG cs.CV cs.LG

    Patient-specific Conditional Joint Models of Shape, Image Features and Clinical Indicators

    Authors: Bernhard Egger, Markus D. Schirmer, Florian Dubost, Marco J. Nardin, Natalia S. Rost, Polina Golland

    Abstract: We propose and demonstrate a joint model of anatomical shapes, image features and clinical indicators for statistical shape modeling and medical image analysis. The key idea is to employ a copula model to separate the joint dependency structure from the marginal distributions of variables of interest. This separation provides flexibility on the assumptions made during the modeling process. The pro… ▽ More

    Submitted 17 July, 2019; originally announced July 2019.

    Comments: Supplementary material: https://www.youtube.com/watch?v=gPoHP_iFQIA

    Journal ref: MICCAI 2019, the 22nd International Conference on Medical Image Computing and Computer Assisted Intervention, in Shenzhen, China

  49. arXiv:1907.04500  [pdf, other

    eess.IV cs.CV

    Fetal Pose Estimation in Volumetric MRI using a 3D Convolution Neural Network

    Authors: Junshen Xu, Molin Zhang, Esra Abaci Turk, Larry Zhang, Ellen Grant, Kui Ying, Polina Golland, Elfar Adalsteinsson

    Abstract: The performance and diagnostic utility of magnetic resonance imaging (MRI) in pregnancy is fundamentally constrained by fetal motion. Motion of the fetus, which is unpredictable and rapid on the scale of conventional imaging times, limits the set of viable acquisition techniques to single-shot imaging with severe compromises in signal-to-noise ratio and diagnostic contrast, and frequently results… ▽ More

    Submitted 9 July, 2019; originally announced July 2019.

    Comments: MICCAI 2019

  50. arXiv:1905.08627  [pdf, other

    cs.GR eess.IV

    BrainPainter: A software for the visualisation of brain structures, biomarkers and associated pathological processes

    Authors: Razvan V. Marinescu, Arman Eshaghi, Daniel C. Alexander, Polina Golland

    Abstract: We present BrainPainter, a software that automatically generates images of highlighted brain structures given a list of numbers corresponding to the output colours of each region. Compared to existing visualisation software (i.e. Freesurfer, SPM, 3D Slicer), BrainPainter has three key advantages: (1) it does not require the input data to be in a specialised format, allowing BrainPainter to be used… ▽ More

    Submitted 22 August, 2019; v1 submitted 21 May, 2019; originally announced May 2019.

    Comments: Accepted at the MICCAI Multimodal Brain Imaging Analysis (MBIA) workshop, 2019