Showing 1–14 of 14 results for author: Agam, G

LSTM Framework for Classification of Radar and Communications Signals

Authors: Victoria Clerico, Jorge Gonzalez-Lopez, Gady Agam, Jesus Grajal

Abstract: Although radar and communications signal classification are usually treated separately, they share similar characteristics, and methods applied in one domain can be potentially applied in the other. We propose a simple and unified scheme for the classification of radar and communications signals using Long Short-Term Memory (LSTM) neural networks. This proposal provides an improvement of the state… ▽ More Although radar and communications signal classification are usually treated separately, they share similar characteristics, and methods applied in one domain can be potentially applied in the other. We propose a simple and unified scheme for the classification of radar and communications signals using Long Short-Term Memory (LSTM) neural networks. This proposal provides an improvement of the state of the art on radar signals where LSTM models are starting to be applied within schemes of higher complexity. To date, there is no standard public dataset for radar signals. Therefore, we propose DeepRadar2022, a radar dataset used in our systematic evaluations that is available publicly and will facilitate a standard comparison between methods. △ Less

Submitted 4 May, 2023; originally announced May 2023.

Comments: This paper was submitted to the Radar Conference 2023

A dynamic intermediate state limits the folding rate of a discontinuous two-domain protein

Authors: Ganesh Agam, Anders Barth, Don C. Lamb

Abstract: Protein folding is an indispensable process for the majority of proteins after their synthesis from ribosomes in the cell. Most in vitro protein folding studies have focused on single-domain proteins. Hence, it is important to understand the folding process of multi-domain proteins, especially when domains are discontinuous. We choose the Maltose binding protein (MBP) as a model system. In particu… ▽ More Protein folding is an indispensable process for the majority of proteins after their synthesis from ribosomes in the cell. Most in vitro protein folding studies have focused on single-domain proteins. Hence, it is important to understand the folding process of multi-domain proteins, especially when domains are discontinuous. We choose the Maltose binding protein (MBP) as a model system. In particular, we studied a mutant of MBP that folds slowly. Here, using two- and three-color single-molecule Foerster resonance energy transfer (smFRET) experiments, we study the refolding of both the domains and the interaction between the domains of DM-MBP. Initial two-color smFRET measurements of the N-terminal domain (NTD) reveal the presence of a folding intermediate. The same folding intermediate is observed in measurements monitoring the C- terminal domain (CTD) and the NTD-CTD (N-C) interface. The refolding intermediate is dynamic on the sub-millisecond timescale. Quantitative analysis on underlying dynamic interconversions revealed a delay in NTD folding imposed by the entropic barrier being the primary cause for slow DM-MBP folding. Moreover, CTD folds after NTD completes the folding. Using three-color smFRET, we could show the NTD folds first and CTD later in a same protein. Molecular dynamic simulations for temperature-induced unfolding on WT- and DM-MBP identify a folding nucleus in the NTD, which is rich in hydrophobic residues, and explains why the two mutations slow down the folding kinetics. In the presence of the bacterial Hsp60 chaperonin system GroEL/ES, we observe that DM-MBP is dynamic within the chaperonin cavity but the chaperonin limits the conformational space of substrate. Hence, confinement aids DM-MBP in overcoming the entropic barrier. The study reports on the subtle tuning and co-dependency for protein folding between two-domains with a discontinuous arrangement. △ Less

Submitted 7 February, 2022; v1 submitted 16 December, 2021; originally announced December 2021.

Semi-supervised Domain Adaptation for Semantic Segmentation

Authors: Ying Chen, Xu Ouyang, Kaiyue Zhu, Gady Agam

Abstract: Deep learning approaches for semantic segmentation rely primarily on supervised learning approaches and require substantial efforts in producing pixel-level annotations. Further, such approaches may perform poorly when applied to unseen image domains. To cope with these limitations, both unsupervised domain adaptation (UDA) with full source supervision but without target supervision and semi-super… ▽ More Deep learning approaches for semantic segmentation rely primarily on supervised learning approaches and require substantial efforts in producing pixel-level annotations. Further, such approaches may perform poorly when applied to unseen image domains. To cope with these limitations, both unsupervised domain adaptation (UDA) with full source supervision but without target supervision and semi-supervised learning (SSL) with partial supervision have been proposed. While such methods are effective at aligning different feature distributions, there is still a need to efficiently exploit unlabeled data to address the performance gap with respect to fully-supervised methods. In this paper we address semi-supervised domain adaptation (SSDA) for semantic segmentation, where a large amount of labeled source data as well as a small amount of labeled target data are available. We propose a novel and effective two-step semi-supervised dual-domain adaptation (SSDDA) approach to address both cross- and intra-domain gaps in semantic segmentation. The proposed framework is comprised of two mixing modules. First, we conduct a cross-domain adaptation via an image-level mixing strategy, which learns to align the distribution shift of features between the source data and target data. Second, intra-domain adaptation is achieved using a separate student-teacher network which is built to generate category-level data augmentation by mixing unlabeled target data in a way that respects predicted object boundaries. We demonstrate that the proposed approach outperforms state-of-the-art methods on two common synthetic-to-real semantic segmentation benchmarks. An extensive ablation study is provided to further validate the effectiveness of our approach. △ Less

Submitted 20 October, 2021; originally announced October 2021.

Mask-based Data Augmentation for Semi-supervised Semantic Segmentation

Authors: Ying Chen, Xu Ouyang, Kaiyue Zhu, Gady Agam

Abstract: Semantic segmentation using convolutional neural networks (CNN) is a crucial component in image analysis. Training a CNN to perform semantic segmentation requires a large amount of labeled data, where the production of such labeled data is both costly and labor intensive. Semi-supervised learning algorithms address this issue by utilizing unlabeled data and so reduce the amount of labeled data nee… ▽ More Semantic segmentation using convolutional neural networks (CNN) is a crucial component in image analysis. Training a CNN to perform semantic segmentation requires a large amount of labeled data, where the production of such labeled data is both costly and labor intensive. Semi-supervised learning algorithms address this issue by utilizing unlabeled data and so reduce the amount of labeled data needed for training. In particular, data augmentation techniques such as CutMix and ClassMix generate additional training data from existing labeled data. In this paper we propose a new approach for data augmentation, termed ComplexMix, which incorporates aspects of CutMix and ClassMix with improved performance. The proposed approach has the ability to control the complexity of the augmented data while attempting to be semantically-correct and address the tradeoff between complexity and correctness. The proposed ComplexMix approach is evaluated on a standard dataset for semantic segmentation and compared to other state-of-the-art techniques. Experimental results show that our method yields improvement over state-of-the-art methods on standard datasets for semantic image segmentation. △ Less

Submitted 25 January, 2021; originally announced January 2021.

Domain Adaptation on Semantic Segmentation for Aerial Images

Authors: Ying Chen, Xu Ouyang, Kaiyue Zhu, Gady Agam

Abstract: Semantic segmentation has achieved significant advances in recent years. While deep neural networks perform semantic segmentation well, their success rely on pixel level supervision which is expensive and time-consuming. Further, training using data from one domain may not generalize well to data from a new domain due to a domain gap between data distributions in the different domains. This domain… ▽ More Semantic segmentation has achieved significant advances in recent years. While deep neural networks perform semantic segmentation well, their success rely on pixel level supervision which is expensive and time-consuming. Further, training using data from one domain may not generalize well to data from a new domain due to a domain gap between data distributions in the different domains. This domain gap is particularly evident in aerial images where visual appearance depends on the type of environment imaged, season, weather, and time of day when the environment is imaged. Subsequently, this distribution gap leads to severe accuracy loss when using a pretrained segmentation model to analyze new data with different characteristics. In this paper, we propose a novel unsupervised domain adaptation framework to address domain shift in the context of aerial semantic image segmentation. To this end, we solve the problem of domain shift by learn the soft label distribution difference between the source and target domains. Further, we also apply entropy minimization on the target domain to produce high-confident prediction rather than using high-confident prediction by pseudo-labeling. We demonstrate the effectiveness of our domain adaptation framework using the challenge image segmentation dataset of ISPRS, and show improvement over state-of-the-art methods in terms of various metrics. △ Less

Submitted 11 December, 2020; v1 submitted 3 December, 2020; originally announced December 2020.

Accelerated WGAN update strategy with loss change rate balancing

Authors: Xu Ouyang, Gady Agam

Abstract: Optimizing the discriminator in Generative Adversarial Networks (GANs) to completion in the inner training loop is computationally prohibitive, and on finite datasets would result in overfitting. To address this, a common update strategy is to alternate between k optimization steps for the discriminator D and one optimization step for the generator G. This strategy is repeated in various GAN algor… ▽ More Optimizing the discriminator in Generative Adversarial Networks (GANs) to completion in the inner training loop is computationally prohibitive, and on finite datasets would result in overfitting. To address this, a common update strategy is to alternate between k optimization steps for the discriminator D and one optimization step for the generator G. This strategy is repeated in various GAN algorithms where k is selected empirically. In this paper, we show that this update strategy is not optimal in terms of accuracy and convergence speed, and propose a new update strategy for Wasserstein GANs (WGAN) and other GANs using the WGAN loss(e.g. WGAN-GP, Deblur GAN, and Super-resolution GAN). The proposed update strategy is based on a loss change ratio comparison of G and D. We demonstrate that the proposed strategy improves both convergence speed and accuracy. △ Less

Submitted 2 November, 2020; v1 submitted 27 August, 2020; originally announced August 2020.

Adjusting Neutrino Interaction Models and Evaluating Uncertainties using NOvA Near Detector Data

Authors: NOvA Collaboration, M. A. Acero, P. Adamson, G. Agam, L. Aliaga, T. Alion, V. Allakhverdian, N. Anfimov, A. Antoshkin, L. Asquith, A. Aurisano, A. Back, C. Backhouse, M. Baird, N. Balashov, P. Baldi, B. A. Bambah, S. Bashar, K. Bays, S. Bending, R. Bernstein, V. Bhatnagar, B. Bhuyan, J. Bian, J. Blair , et al. (170 additional authors not shown)

Abstract: The two-detector design of the NOvA neutrino oscillation experiment, in which two functionally identical detectors are exposed to an intense neutrino beam, aids in canceling leading order effects of cross-section uncertainties. However, limited knowledge of neutrino interaction cross sections still gives rise to some of the largest systematic uncertainties in current oscillation measurements. We s… ▽ More The two-detector design of the NOvA neutrino oscillation experiment, in which two functionally identical detectors are exposed to an intense neutrino beam, aids in canceling leading order effects of cross-section uncertainties. However, limited knowledge of neutrino interaction cross sections still gives rise to some of the largest systematic uncertainties in current oscillation measurements. We show contemporary models of neutrino interactions to be discrepant with data from NOvA, consistent with discrepancies seen in other experiments. Adjustments to neutrino interaction models in GENIE that improve agreement with our data are presented. We also describe systematic uncertainties on these models, including uncertainties on multi-nucleon interactions from a newly developed procedure using NOvA near detector data. △ Less

Submitted 10 December, 2020; v1 submitted 15 June, 2020; originally announced June 2020.

Comments: Code implementing adjustments to GENIE 2.12.2 described in this paper is available at https://github.com/novaexperiment/NOvARwgt-public

Report number: FERMILAB-PUB-20-243-ND

Journal ref: Eur. Phys. J. C 80, 1119 (2020)

Supernova neutrino detection in NOvA

Authors: NOvA Collaboration, M. A. Acero, P. Adamson, G. Agam, L. Aliaga, T. Alion, V. Allakhverdian, N. Anfimov, A. Antoshkin, E. Arrieta-Diaz, L. Asquith, A. Aurisano, A. Back, C. Backhouse, M. Baird, N. Balashov, P. Baldi, B. A. Bambah, S. Bashar, K. Bays, S. Bending, R. Bernstein, V. Bhatnagar, B. Bhuyan, J. Bian , et al. (177 additional authors not shown)

Abstract: The NOvA long-baseline neutrino experiment uses a pair of large, segmented, liquid-scintillator calorimeters to study neutrino oscillations, using GeV-scale neutrinos from the Fermilab NuMI beam. These detectors are also sensitive to the flux of neutrinos which are emitted during a core-collapse supernova through inverse beta decay interactions on carbon at energies of… ▽ More The NOvA long-baseline neutrino experiment uses a pair of large, segmented, liquid-scintillator calorimeters to study neutrino oscillations, using GeV-scale neutrinos from the Fermilab NuMI beam. These detectors are also sensitive to the flux of neutrinos which are emitted during a core-collapse supernova through inverse beta decay interactions on carbon at energies of $\mathcal{O}(10~\text{MeV})$. This signature provides a means to study the dominant mode of energy release for a core-collapse supernova occurring in our galaxy. We describe the data-driven software trigger system developed and employed by the NOvA experiment to identify and record neutrino data from nearby galactic supernovae. This technique has been used by NOvA to self-trigger on potential core-collapse supernovae in our galaxy, with an estimated sensitivity reaching out to 10~kpc distance while achieving a detection efficiency of 23\% to 49\% for supernovae from progenitor stars with masses of 9.6M$_\odot$ to 27M$_\odot$, respectively. △ Less

Submitted 29 July, 2020; v1 submitted 14 May, 2020; originally announced May 2020.

Comments: 30 pages, 17 figures

Report number: FERMILAB-PUB-20-201-E

Journal ref: JCAP 10 (2020) 014

Generating Image Sequence from Description with LSTM Conditional GAN

Authors: Xu Ouyang, Xi Zhang, Di Ma, Gady Agam

Abstract: Generating images from word descriptions is a challenging task. Generative adversarial networks(GANs) are shown to be able to generate realistic images of real-life objects. In this paper, we propose a new neural network architecture of LSTM Conditional Generative Adversarial Networks to generate images of real-life objects. Our proposed model is trained on the Oxford-102 Flowers and Caltech-UCSD… ▽ More Generating images from word descriptions is a challenging task. Generative adversarial networks(GANs) are shown to be able to generate realistic images of real-life objects. In this paper, we propose a new neural network architecture of LSTM Conditional Generative Adversarial Networks to generate images of real-life objects. Our proposed model is trained on the Oxford-102 Flowers and Caltech-UCSD Birds-200-2011 datasets. We demonstrate that our proposed model produces the better results surpassing other state-of-art approaches. △ Less

Submitted 8 June, 2018; originally announced June 2018.

Comments: Accepted by ICPR 2018

Layered Optical Flow Estimation Using a Deep Neural Network with a Soft Mask

Authors: Xi Zhang, Di Ma, Xu Ouyang, Shanshan Jiang, Lin Gan, Gady Agam

Abstract: Using a layered representation for motion estimation has the advantage of being able to cope with discontinuities and occlusions. In this paper, we learn to estimate optical flow by combining a layered motion representation with deep learning. Instead of pre-segmenting the image to layers, the proposed approach automatically generates a layered representation of optical flow using the proposed sof… ▽ More Using a layered representation for motion estimation has the advantage of being able to cope with discontinuities and occlusions. In this paper, we learn to estimate optical flow by combining a layered motion representation with deep learning. Instead of pre-segmenting the image to layers, the proposed approach automatically generates a layered representation of optical flow using the proposed soft-mask module. The essential components of the soft-mask module are maxout and fuse operations, which enable a disjoint layered representation of optical flow and more accurate flow estimation. We show that by using masks the motion estimate results in a quadratic function of input features in the output layer. The proposed soft-mask module can be added to any existing optical flow estimation networks by replacing their flow output layer. In this work, we use FlowNet as the base network to which we add the soft-mask module. The resulting network is tested on three well-known benchmarks with both supervised and unsupervised flow estimation tasks. Evaluation results show that the proposed network achieve better results compared with the original FlowNet. △ Less

Submitted 9 May, 2018; originally announced May 2018.

Lecture video indexing using boosted margin maximizing neural networks

Authors: Di Ma, Xi Zhang, Xu Ouyang, Gady Agam

Abstract: This paper presents a novel approach for lecture video indexing using a boosted deep convolutional neural network system. The indexing is performed by matching high quality slide images, for which text is either known or extracted, to lower resolution video frames with possible noise, perspective distortion, and occlusions. We propose a deep neural network integrated with a boosting framework comp… ▽ More This paper presents a novel approach for lecture video indexing using a boosted deep convolutional neural network system. The indexing is performed by matching high quality slide images, for which text is either known or extracted, to lower resolution video frames with possible noise, perspective distortion, and occlusions. We propose a deep neural network integrated with a boosting framework composed of two sub-networks targeting feature extraction and similarity determination to perform the matching. The trained network is given as input a pair of slide image and a candidate video frame image and produces the similarity between them. A boosting framework is integrated into our proposed network during the training process. Experimental results show that the proposed approach is much more capable of handling occlusion, spatial transformations, and other types of noises when compared with known approaches. △ Less

Submitted 2 December, 2017; originally announced December 2017.

Comments: Accepted by ICMLA 2017

CGMOS: Certainty Guided Minority OverSampling

Authors: Xi Zhang, Di Ma, Lin Gan, Shanshan Jiang, Gady Agam

Abstract: Handling imbalanced datasets is a challenging problem that if not treated correctly results in reduced classification performance. Imbalanced datasets are commonly handled using minority oversampling, whereas the SMOTE algorithm is a successful oversampling algorithm with numerous extensions. SMOTE extensions do not have a theoretical guarantee during training to work better than SMOTE and in many… ▽ More Handling imbalanced datasets is a challenging problem that if not treated correctly results in reduced classification performance. Imbalanced datasets are commonly handled using minority oversampling, whereas the SMOTE algorithm is a successful oversampling algorithm with numerous extensions. SMOTE extensions do not have a theoretical guarantee during training to work better than SMOTE and in many instances their performance is data dependent. In this paper we propose a novel extension to the SMOTE algorithm with a theoretical guarantee for improved classification performance. The proposed approach considers the classification performance of both the majority and minority classes. In the proposed approach CGMOS (Certainty Guided Minority OverSampling) new data points are added by considering certainty changes in the dataset. The paper provides a proof that the proposed algorithm is guaranteed to work better than SMOTE for training data. Further experimental results on 30 real-world datasets show that CGMOS works better than existing algorithms when using 6 different classifiers. △ Less

Submitted 21 July, 2016; originally announced July 2016.

Comments: Accepted by The 25th ACM International Conference on Information and Knowledge Management (CIKM 2016)

Learning from Synthetic Data Using a Stacked Multichannel Autoencoder

Authors: Xi Zhang, Yanwei Fu, Shanshan Jiang, Leonid Sigal, Gady Agam

Abstract: Learning from synthetic data has many important and practical applications. An example of application is photo-sketch recognition. Using synthetic data is challenging due to the differences in feature distributions between synthetic and real data, a phenomenon we term synthetic gap. In this paper, we investigate and formalize a general framework-Stacked Multichannel Autoencoder (SMCAE) that enable… ▽ More Learning from synthetic data has many important and practical applications. An example of application is photo-sketch recognition. Using synthetic data is challenging due to the differences in feature distributions between synthetic and real data, a phenomenon we term synthetic gap. In this paper, we investigate and formalize a general framework-Stacked Multichannel Autoencoder (SMCAE) that enables bridging the synthetic gap and learning from synthetic data more efficiently. In particular, we show that our SMCAE can not only transform and use synthetic data on the challenging face-sketch recognition task, but that it can also help simulate real images, which can be used for training classifiers for recognition. Preliminary experiments validate the effectiveness of the framework. △ Less

Submitted 21 September, 2015; v1 submitted 17 September, 2015; originally announced September 2015.

Learning Classifiers from Synthetic Data Using a Multichannel Autoencoder

Authors: Xi Zhang, Yanwei Fu, Andi Zang, Leonid Sigal, Gady Agam

Abstract: We propose a method for using synthetic data to help learning classifiers. Synthetic data, even is generated based on real data, normally results in a shift from the distribution of real data in feature space. To bridge the gap between the real and synthetic data, and jointly learn from synthetic and real data, this paper proposes a Multichannel Autoencoder(MCAE). We show that by suing MCAE, it is… ▽ More We propose a method for using synthetic data to help learning classifiers. Synthetic data, even is generated based on real data, normally results in a shift from the distribution of real data in feature space. To bridge the gap between the real and synthetic data, and jointly learn from synthetic and real data, this paper proposes a Multichannel Autoencoder(MCAE). We show that by suing MCAE, it is possible to learn a better feature representation for classification. To evaluate the proposed approach, we conduct experiments on two types of datasets. Experimental results on two datasets validate the efficiency of our MCAE model and our methodology of generating synthetic data. △ Less

Submitted 10 March, 2015; originally announced March 2015.

Comments: 10 pages