Showing 1–15 of 15 results for author: Mousavi, H S

Adaptive Transform Domain Image Super-resolution Via Orthogonally Regularized Deep Networks

Authors: Tiantong Guo, Hojjat S. Mousavi, Vishal Monga

Abstract: Deep learning methods, in particular, trained Convolutional Neural Networks (CNN) have recently been shown to produce compelling results for single image Super-Resolution (SR). Invariably, a CNN is learned to map the Low Resolution (LR) image to its corresponding High Resolution (HR) version in the spatial domain. We propose a novel network structure for learning the SR map** function in an imag… ▽ More Deep learning methods, in particular, trained Convolutional Neural Networks (CNN) have recently been shown to produce compelling results for single image Super-Resolution (SR). Invariably, a CNN is learned to map the Low Resolution (LR) image to its corresponding High Resolution (HR) version in the spatial domain. We propose a novel network structure for learning the SR map** function in an image transform domain, specifically the Discrete Cosine Transform (DCT). As the first contribution, we show that DCT can be integrated into the network structure as a Convolutional DCT (CDCT) layer. With the CDCT layer, we construct the DCT Deep SR (DCT-DSR) network. We further extend the DCT-DSR to allow the CDCT layer to become trainable (i.e., optimizable). Because this layer represents an image transform, we enforce pairwise orthogonality constraints and newly formulated complexity order constraints on the individual basis functions/filters. This Orthogonally Regularized Deep SR network (ORDSR) simplifies the SR task by taking advantage of image transform domain while adapting the design of transform basis to the training image set. Experimental results show ORDSR achieves state-of-the-art SR image quality with fewer parameters than most of the deep CNN methods. A particular success of ORDSR is in overcoming the artifacts introduced by bicubic interpolation. A key burden of deep SR has been identified as the requirement of generous training LR and HR image pairs; ORSDR exhibits a much more graceful degradation as training size is reduced with significant benefits in the regime of limited training. Analysis of memory and computation requirements confirms that ORDSR can allow for a more efficient network with faster inference. △ Less

Submitted 22 April, 2019; originally announced April 2019.

Enhanced Signal Recovery via Sparsity Inducing Image Priors

Authors: Hojjat Seyed Mousavi

Abstract: Parsimony in signal representation is a topic of active research. Sparse signal processing and representation is the outcome of this line of research which has many applications in information processing and has shown significant improvement in real-world applications such as recovery, classification, clustering, super resolution, etc. This vast influence of sparse signal processing in real-world… ▽ More Parsimony in signal representation is a topic of active research. Sparse signal processing and representation is the outcome of this line of research which has many applications in information processing and has shown significant improvement in real-world applications such as recovery, classification, clustering, super resolution, etc. This vast influence of sparse signal processing in real-world problems raises a significant need in develo** novel sparse signal representation algorithms to obtain more robust systems. In such algorithms, a few open challenges remain in (a) efficiently posing sparsity on signals that can capture the structure of underlying signal and (b) the design of tractable algorithms that can recover signals under aforementioned sparse models. △ Less

Submitted 13 May, 2018; originally announced May 2018.

Comments: PhD dissertation

Deep Image Super Resolution via Natural Image Priors

Authors: Hojjat S. Mousavi, Tiantong Guo, Vishal Monga

Abstract: Single image super-resolution (SR) via deep learning has recently gained significant attention in the literature. Convolutional neural networks (CNNs) are typically learned to represent the map** between low-resolution (LR) and high-resolution (HR) images/patches with the help of training examples. Most existing deep networks for SR produce high quality results when training data is abundant. Ho… ▽ More Single image super-resolution (SR) via deep learning has recently gained significant attention in the literature. Convolutional neural networks (CNNs) are typically learned to represent the map** between low-resolution (LR) and high-resolution (HR) images/patches with the help of training examples. Most existing deep networks for SR produce high quality results when training data is abundant. However, their performance degrades sharply when training is limited. We propose to regularize deep structures with prior knowledge about the images so that they can capture more structural information from the same limited data. In particular, we incorporate in a tractable fashion within the CNN framework, natural image priors which have shown to have much recent success in imaging and vision inverse problems. Experimental results show that the proposed deep network with natural image priors is particularly effective in training starved regimes. △ Less

Submitted 8 February, 2018; originally announced February 2018.

Orthogonally Regularized Deep Networks For Image Super-resolution

Authors: Tiantong Guo, Hojjat S. Mousavi, Vishal Monga

Abstract: Deep learning methods, in particular trained Convolutional Neural Networks (CNNs) have recently been shown to produce compelling state-of-the-art results for single image Super-Resolution (SR). Invariably, a CNN is learned to map the low resolution (LR) image to its corresponding high resolution (HR) version in the spatial domain. Aiming for faster inference and more efficient solutions than solvi… ▽ More Deep learning methods, in particular trained Convolutional Neural Networks (CNNs) have recently been shown to produce compelling state-of-the-art results for single image Super-Resolution (SR). Invariably, a CNN is learned to map the low resolution (LR) image to its corresponding high resolution (HR) version in the spatial domain. Aiming for faster inference and more efficient solutions than solving the SR problem in the spatial domain, we propose a novel network structure for learning the SR map** function in an image transform domain, specifically the Discrete Cosine Transform (DCT). As a first contribution, we show that DCT can be integrated into the network structure as a Convolutional DCT (CDCT) layer. We further extend the network to allow the CDCT layer to become trainable (i.e. optimizable). Because this layer represents an image transform, we enforce pairwise orthogonality constraints on the individual basis functions/filters. This Orthogonally Regularized Deep SR network (ORDSR) simplifies the SR task by taking advantage of image transform domain while adapting the design of transform basis to the training image set. △ Less

Submitted 6 February, 2018; originally announced February 2018.

Adaptive matching pursuit for sparse signal recovery

Authors: Tiep H. Vu, Hojjat S. Mousavi, Vishal Monga

Abstract: Spike and Slab priors have been of much recent interest in signal processing as a means of inducing sparsity in Bayesian inference. Applications domains that benefit from the use of these priors include sparse recovery, regression and classification. It is well-known that solving for the sparse coefficient vector to maximize these priors results in a hard non-convex and mixed integer programming p… ▽ More Spike and Slab priors have been of much recent interest in signal processing as a means of inducing sparsity in Bayesian inference. Applications domains that benefit from the use of these priors include sparse recovery, regression and classification. It is well-known that solving for the sparse coefficient vector to maximize these priors results in a hard non-convex and mixed integer programming problem. Most existing solutions to this optimization problem either involve simplifying assumptions/relaxations or are computationally expensive. We propose a new greedy and adaptive matching pursuit (AMP) algorithm to directly solve this hard problem. Essentially, in each step of the algorithm, the set of active elements would be updated by either adding or removing one index, whichever results in better improvement. In addition, the intermediate steps of the algorithm are calculated via an inexpensive Cholesky decomposition which makes the algorithm much faster. Results on simulated data sets as well as real-world image recovery challenges confirm the benefits of the proposed AMP, particularly in providing a superior cost-quality trade-off over existing alternatives. △ Less

Submitted 12 September, 2016; originally announced October 2016.

Comments: ICASSP

Sparsity-based Color Image Super Resolution via Exploiting Cross Channel Constraints

Authors: Hojjat S. Mousavi, Vishal Monga

Abstract: Sparsity constrained single image super-resolution (SR) has been of much recent interest. A typical approach involves sparsely representing patches in a low-resolution (LR) input image via a dictionary of example LR patches, and then using the coefficients of this representation to generate the high-resolution (HR) output via an analogous HR dictionary. However, most existing sparse representation… ▽ More Sparsity constrained single image super-resolution (SR) has been of much recent interest. A typical approach involves sparsely representing patches in a low-resolution (LR) input image via a dictionary of example LR patches, and then using the coefficients of this representation to generate the high-resolution (HR) output via an analogous HR dictionary. However, most existing sparse representation methods for super resolution focus on the luminance channel information and do not capture interactions between color channels. In this work, we extend sparsity based super-resolution to multiple color channels by taking color information into account. Edge similarities amongst RGB color bands are exploited as cross channel correlation constraints. These additional constraints lead to a new optimization problem which is not easily solvable; however, a tractable solution is proposed to solve it efficiently. Moreover, to fully exploit the complementary information among color channels, a dictionary learning method is also proposed specifically to learn color dictionaries that encourage edge similarities. Merits of the proposed method over state of the art are demonstrated both visually and quantitatively using image quality metrics. △ Less

Submitted 4 October, 2016; originally announced October 2016.

Large Enhancement of Circular Dichroism Using an Embossed Chiral Metamaterial

Authors: S. Hamed Shams Mousavi, Sajanlal R. Panikkanvalappil, Mostafa A. El-Sayed, Ali A. Eftekhar, Ali Adibi

Abstract: In the close vicinity of a chiral nanostructure, the circular dichroism of a biomolecule could be greatly enhanced, due to the interaction with the local superchiral fields. Modest enhancement of optical activity using a planar metamaterial, with some chiral properties, and achiral nanoparticles has been previously reported. A more substantial chirality enhancement can be achieved in the local fil… ▽ More In the close vicinity of a chiral nanostructure, the circular dichroism of a biomolecule could be greatly enhanced, due to the interaction with the local superchiral fields. Modest enhancement of optical activity using a planar metamaterial, with some chiral properties, and achiral nanoparticles has been previously reported. A more substantial chirality enhancement can be achieved in the local filed of a chiral nanostructure with a three-dimensional arrangement. Using an embossed chiral nanostructure designed for chiroptical sensing, we measure the circular dichroism spectra of two biomolecules, Chlorophylls A and B, at the molecular level, using a simple polarization resolved reflection measurement. This experiment is the first realization of the on-resonance surface-enhanced circular dichroism, achieved by matching the chiral resonances of a strongly chiral metamaterial with that of a chiral molecule, resulting in an unprecedentedly large differential CD spectrum from a monolayer of a chiral material. △ Less

Submitted 18 April, 2016; originally announced April 2016.

Histopathological Image Classification using Discriminative Feature-oriented Dictionary Learning

Authors: Tiep Huu Vu, Hojjat Seyed Mousavi, Vishal Monga, Arvind UK Rao, Ganesh Rao

Abstract: In histopathological image analysis, feature extraction for classification is a challenging task due to the diversity of histology features suitable for each problem as well as presence of rich geometrical structures. In this paper, we propose an automatic feature discovery framework via learning class-specific dictionaries and present a low-complexity method for classification and disease grading… ▽ More In histopathological image analysis, feature extraction for classification is a challenging task due to the diversity of histology features suitable for each problem as well as presence of rich geometrical structures. In this paper, we propose an automatic feature discovery framework via learning class-specific dictionaries and present a low-complexity method for classification and disease grading in histopathology. Essentially, our Discriminative Feature-oriented Dictionary Learning (DFDL) method learns class-specific dictionaries such that under a sparsity constraint, the learned dictionaries allow representing a new image sample parsimoniously via the dictionary corresponding to the class identity of the sample. At the same time, the dictionary is designed to be poorly capable of representing samples from other classes. Experiments on three challenging real-world image databases: 1) histopathological images of intraductal breast lesions, 2) mammalian kidney, lung and spleen images provided by the Animal Diagnostics Lab (ADL) at Pennsylvania State University, and 3) brain tumor images from The Cancer Genome Atlas (TCGA) database, reveal the merits of our proposal over state-of-the-art alternatives. {Moreover, we demonstrate that DFDL exhibits a more graceful decay in classification accuracy against the number of training images which is highly desirable in practice where generous training is often not available △ Less

Submitted 29 March, 2016; v1 submitted 16 June, 2015; originally announced June 2015.

Comments: Accepted version to Transaction on Medical Imaging, 13 pages

ICR: Iterative Convex Refinement for Sparse Signal Recovery Using Spike and Slab Priors

Authors: Hojjat S. Mousavi, Vishal Monga, Trac D. Tran

Abstract: In this letter, we address sparse signal recovery using spike and slab priors. In particular, we focus on a Bayesian framework where sparsity is enforced on reconstruction coefficients via probabilistic priors. The optimization resulting from spike and slab prior maximization is known to be a hard non-convex problem, and existing solutions involve simplifying assumptions and/or relaxations. We pro… ▽ More In this letter, we address sparse signal recovery using spike and slab priors. In particular, we focus on a Bayesian framework where sparsity is enforced on reconstruction coefficients via probabilistic priors. The optimization resulting from spike and slab prior maximization is known to be a hard non-convex problem, and existing solutions involve simplifying assumptions and/or relaxations. We propose an approach called Iterative Convex Refinement (ICR) that aims to solve the aforementioned optimization problem directly allowing for greater generality in the sparse structure. Essentially, ICR solves a sequence of convex optimization problems such that sequence of solutions converges to a sub-optimal solution of the original hard optimization problem. We propose two versions of our algorithm: a.) an unconstrained version, and b.) with a non-negativity constraint on sparse coefficients, which may be required in some real-world problems. Experimental validation is performed on both synthetic data and for a real-world image recovery problem, which illustrates merits of ICR over state of the art alternatives. △ Less

Submitted 16 February, 2015; originally announced February 2015.

Comments: Submitted to IEEE Signal Processing Letters, Feb 2015

DFDL: Discriminative Feature-oriented Dictionary Learning for Histopathological Image Classification

Authors: Tiep H. Vu, Hojjat S. Mousavi, Vishal Monga, UK Arvind Rao, Ganesh Rao

Abstract: In histopathological image analysis, feature extraction for classification is a challenging task due to the diversity of histology features suitable for each problem as well as presence of rich geometrical structure. In this paper, we propose an automatic feature discovery framework for extracting discriminative class-specific features and present a low-complexity method for classification and dis… ▽ More In histopathological image analysis, feature extraction for classification is a challenging task due to the diversity of histology features suitable for each problem as well as presence of rich geometrical structure. In this paper, we propose an automatic feature discovery framework for extracting discriminative class-specific features and present a low-complexity method for classification and disease grading in histopathology. Essentially, our Discriminative Feature-oriented Dictionary Learning (DFDL) method learns class-specific features which are suitable for representing samples from the same class while are poorly capable of representing samples from other classes. Experiments on three challenging real-world image databases: 1) histopathological images of intraductal breast lesions, 2) mammalian lung images provided by the Animal Diagnostics Lab (ADL) at Pennsylvania State University, and 3) brain tumor images from The Cancer Genome Atlas (TCGA) database, show the significance of DFDL model in a variety problems over state-of-the-art methods △ Less

Submitted 3 February, 2015; originally announced February 2015.

Comments: Accepted to IEEE International Symposium on Biomedical Imaging (ISBI), 2015

Multi-task Image Classification via Collaborative, Hierarchical Spike-and-Slab Priors

Authors: Hojjat Seyed Mousavi, Umamahesh Srinivas, Vishal Monga, Yuanming Suo, Minh Dao, Trac. D. Tran

Abstract: Promising results have been achieved in image classification problems by exploiting the discriminative power of sparse representations for classification (SRC). Recently, it has been shown that the use of \emph{class-specific} spike-and-slab priors in conjunction with the class-specific dictionaries from SRC is particularly effective in low training scenarios. As a logical extension, we build on t… ▽ More Promising results have been achieved in image classification problems by exploiting the discriminative power of sparse representations for classification (SRC). Recently, it has been shown that the use of \emph{class-specific} spike-and-slab priors in conjunction with the class-specific dictionaries from SRC is particularly effective in low training scenarios. As a logical extension, we build on this framework for multitask scenarios, wherein multiple representations of the same physical phenomena are available. We experimentally demonstrate the benefits of mining joint information from different camera views for multi-view face recognition. △ Less

Submitted 30 January, 2015; originally announced January 2015.

Comments: Accepted to International Conference in Image Processing (ICIP) 2014

Band-edge Bilayer Plasmonic Nanostructure for Surface Enhanced Raman Spectroscopy

Authors: S. Hamed Shams Mousavi, Ali A. Eftekhar, Amir H. Atabaki, Ali Adibi

Abstract: Spectroscopic analysis of large biomolecules is critical in a number of applications, including medical diagnostics and label-free biosensing. Recently, it has been shown that Raman spectroscopy of proteins can be used to diagnose some diseases, including a few types of cancer. These experiments have however been performed using traditional Raman spectroscopy and the development of the Surface enh… ▽ More Spectroscopic analysis of large biomolecules is critical in a number of applications, including medical diagnostics and label-free biosensing. Recently, it has been shown that Raman spectroscopy of proteins can be used to diagnose some diseases, including a few types of cancer. These experiments have however been performed using traditional Raman spectroscopy and the development of the Surface enhanced Raman spectroscopy (SERS) assays suitable for large biomolecules could lead to a substantial decrease in the amount of specimen necessary for these experiments. We present a new method to achieve high local field enhancement in surface enhanced Raman spectroscopy through the simultaneous adjustment of the lattice plasmons and localized surface plasmon polaritons, in a periodic bilayer nanoantenna array resulting in a high enhancement factor over the sensing area, with relatively high uniformity. The proposed plasmonic nanostructure is comprised of two interacting nanoantenna layers, providing a sharp band-edge lattice plasmon mode and a wide-band localized surface plasmon for the separate enhancement of the pump and emitted Raman signals. We demonstrate the application of the proposed nanostructure for the spectral analysis of large biomolecules by binding a protein (streptavidin) selectively on the hot-spots between the two stacked layers, using a low concentration solution (100 nM) and we successfully acquire its SERS spectrum. △ Less

Submitted 5 January, 2015; v1 submitted 25 December, 2014; originally announced December 2014.

Decoy State Quantum Key Distribution Using Homodyne Detection

Authors: S. Hamed Shams Mousavi, Philippe Gallion

Abstract: In this paper, we propose to use the decoy-state technique to improve the security of the quantum key distribution (QKD) systems based on homodyne detection against the photon number splitting (PNS) attack. The decoy-state technique is a powerful tool that can significantly boost the secure transmission range of the QKD systems. However it has not yet been applied to the systems that use coherent… ▽ More In this paper, we propose to use the decoy-state technique to improve the security of the quantum key distribution (QKD) systems based on homodyne detection against the photon number splitting (PNS) attack. The decoy-state technique is a powerful tool that can significantly boost the secure transmission range of the QKD systems. However it has not yet been applied to the systems that use coherent detection. After adapting this theory to the systems based on homodyne detection, we quantify the secure performance and transmission range of the resulting system. △ Less

Submitted 22 November, 2014; originally announced November 2014.

Comments: Submitted to Physical Reviews A

Hyperspectral fluorescence microscopy based on Compressive Sampling

Authors: Makhlad Chahid, Jerome Bobin, Hamed Shams Mousavi, Emmanuel Candes, Maxime Dahan, Vincent Studer

Abstract: The mathematical theory of compressed sensing (CS) asserts that one can acquire signals from measurements whose rate is much lower than the total bandwidth. Whereas the CS theory is now well developed, challenges concerning hardware implementations of CS-based acquisition devices-especially in optics-have only started being addressed. This paper presents an implementation of compressive sensing in… ▽ More The mathematical theory of compressed sensing (CS) asserts that one can acquire signals from measurements whose rate is much lower than the total bandwidth. Whereas the CS theory is now well developed, challenges concerning hardware implementations of CS-based acquisition devices-especially in optics-have only started being addressed. This paper presents an implementation of compressive sensing in fluorescence microscopy and its applications to biomedical imaging. Our CS microscope combines a dynamic structured wide-field illumination and a fast and sensitive single-point fluorescence detection to enable reconstructions of images of fluorescent beads, cells, and tissues with undersampling ratios (between the number of pixels and number of measurements) up to 32. We further demonstrate a hyperspectral mode and record images with 128 spectral channels and undersampling ratios up to 64, illustrating the potential benefits of CS acquisition for higher-dimensional signals, which typically exhibits extreme redundancy. Altogether, our results emphasize the interest of CS schemes for acquisition at a significantly reduced rate and point to some remaining challenges for CS fluorescence microscopy. △ Less

Submitted 17 July, 2013; originally announced July 2013.

Compressive Fluorescence Microscopy for Biological and Hyperspectral Imaging

Authors: Vincent Studer, Jerome Bobin, Makhlad Chahid, S. Hamed Shams Mousavi, Emmanuel Candes, Maxime Dahan

Abstract: The mathematical theory of compressed sensing (CS) asserts that one can acquire signals from measurements whose rate is much lower than the total bandwidth. Whereas the CS theory is now well developed, challenges concerning hardware implementations of CS-based acquisition devices---especially in optics---have only started being addressed. This paper presents an implementation of compressive sensin… ▽ More The mathematical theory of compressed sensing (CS) asserts that one can acquire signals from measurements whose rate is much lower than the total bandwidth. Whereas the CS theory is now well developed, challenges concerning hardware implementations of CS-based acquisition devices---especially in optics---have only started being addressed. This paper presents an implementation of compressive sensing in fluorescence microscopy and its applications to biomedical imaging. Our CS microscope combines a dynamic structured wide-field illumination and a fast and sensitive single-point fluorescence detection to enable reconstructions of images of fluorescent beads, cells and tissues with undersampling ratios (between the number of pixels and number of measurements) up to 32. We further demonstrate a hyperspectral mode and record images with 128 spectral channels and undersampling ratios up to 64, illustrating the potential benefits of CS acquisition for higher dimensional signals which typically exhibits extreme redundancy. Altogether, our results emphasize the interest of CS schemes for acquisition at a significantly reduced rate and point out to some remaining challenges for CS fluorescence microscopy. △ Less

Submitted 16 June, 2012; v1 submitted 3 January, 2012; originally announced January 2012.

Comments: Submitted to Proceedings of the National Academy of Sciences of the United States of America