One-shot Localization and Segmentation of Medical Images with Foundation Models
Authors:
Deepa Anand,
Gurunath Reddy M,
Vanika Singhal,
Dattesh D. Shanbhag,
Shriram KS,
Uday Patil,
Chitresh Bhushan,
Kavitha Manickam,
Dawei Gui,
Rakesh Mullick,
Avinash Gopal,
Parminder Bhatia,
Taha Kass-Hout
Abstract:
Recent advances in Vision Transformers (ViT) and Stable Diffusion (SD) models with their ability to capture rich semantic features of the image have been used for image correspondence tasks on natural images. In this paper, we examine the ability of a variety of pre-trained ViT (DINO, DINOv2, SAM, CLIP) and SD models, trained exclusively on natural images, for solving the correspondence problems o…
▽ More
Recent advances in Vision Transformers (ViT) and Stable Diffusion (SD) models with their ability to capture rich semantic features of the image have been used for image correspondence tasks on natural images. In this paper, we examine the ability of a variety of pre-trained ViT (DINO, DINOv2, SAM, CLIP) and SD models, trained exclusively on natural images, for solving the correspondence problems on medical images. While many works have made a case for in-domain training, we show that the models trained on natural images can offer good performance on medical images across different modalities (CT,MR,Ultrasound) sourced from various manufacturers, over multiple anatomical regions (brain, thorax, abdomen, extremities), and on wide variety of tasks. Further, we leverage the correspondence with respect to a template image to prompt a Segment Anything (SAM) model to arrive at single shot segmentation, achieving dice range of 62%-90% across tasks, using just one image as reference. We also show that our single-shot method outperforms the recently proposed few-shot segmentation method - UniverSeg (Dice range 47%-80%) on most of the semantic segmentation tasks(six out of seven) across medical imaging modalities.
△ Less
Submitted 28 October, 2023;
originally announced October 2023.
Probability Mass Functions for which Sources have the Maximum Minimum Expected Length
Authors:
Shivkumar K. Manickam
Abstract:
Let $\mathcal{P}_n$ be the set of all probability mass functions (PMFs) $(p_1,p_2,\ldots,p_n)$ that satisfy $p_i>0$ for $1\leq i \leq n$. Define the minimum expected length function $\mathcal{L}_D :\mathcal{P}_n \rightarrow \mathbb{R}$ such that $\mathcal{L}_D (P)$ is the minimum expected length of a prefix code, formed out of an alphabet of size $D$, for the discrete memoryless source having $P$…
▽ More
Let $\mathcal{P}_n$ be the set of all probability mass functions (PMFs) $(p_1,p_2,\ldots,p_n)$ that satisfy $p_i>0$ for $1\leq i \leq n$. Define the minimum expected length function $\mathcal{L}_D :\mathcal{P}_n \rightarrow \mathbb{R}$ such that $\mathcal{L}_D (P)$ is the minimum expected length of a prefix code, formed out of an alphabet of size $D$, for the discrete memoryless source having $P$ as its source distribution. It is well-known that the function $\mathcal{L}_D$ attains its maximum value at the uniform distribution. Further, when $n$ is of the form $D^m$, with $m$ being a positive integer, PMFs other than the uniform distribution at which $\mathcal{L}_D$ attains its maximum value are known. However, a complete characterization of all such PMFs at which the minimum expected length function attains its maximum value has not been done so far. This is done in this paper.
△ Less
Submitted 9 March, 2019;
originally announced March 2019.
