Showing 1–50 of 66 results for author: Tran, T D

A gradient flow method for smooth splines versus least-squares fitting on Riemannian manifolds

Authors: Chun-Chi Lin, The Dung Tran

Abstract: This article presents a novel resolution to the problem of spline interpolation versus least-squares fitting on smooth Riemannian manifolds utilizing the method of gradient flows of networks. This approach represents a contribution to both geometric control theory and statistical shape data analysis. Our work encompasses a rigorous proof for the existence of global solutions in Hölder spaces for t… ▽ More This article presents a novel resolution to the problem of spline interpolation versus least-squares fitting on smooth Riemannian manifolds utilizing the method of gradient flows of networks. This approach represents a contribution to both geometric control theory and statistical shape data analysis. Our work encompasses a rigorous proof for the existence of global solutions in Hölder spaces for the gradient flow. The asymptotic limits of these solutions establish the existence of the spline interpolation versus least-squares fitting problem on smooth Riemannian manifolds, offering a comprehensive solution. Notably, the constructive nature of the proof suggests potential numerical schemes for finding solutions. △ Less

Submitted 29 May, 2024; v1 submitted 28 February, 2024; originally announced February 2024.

Comments: the article is merged into another one of the authors' papers, arXiv:2312.10513

MSC Class: primary 35K52; 49J20; secondary 41A15; 35K25

Physical Layer Location Privacy in SIMO Communication Using Fake Paths Injection

Authors: Trong Duy Tran, Maxime Ferreira Da Costa, Linh Trung Nguyen

Abstract: Fake path injection is an emerging paradigm for inducing privacy over wireless networks. In this paper, fake paths are injected by the transmitter into a SIMO multipath communication channel to preserve her physical location from an eavesdropper. A novel statistical privacy metric is defined as the ratio between the largest (resp. smallest) eigenvalues of Bob's (resp. Eve's) Cramér-Rao lower bound… ▽ More Fake path injection is an emerging paradigm for inducing privacy over wireless networks. In this paper, fake paths are injected by the transmitter into a SIMO multipath communication channel to preserve her physical location from an eavesdropper. A novel statistical privacy metric is defined as the ratio between the largest (resp. smallest) eigenvalues of Bob's (resp. Eve's) Cramér-Rao lower bound on the SIMO multipath channel parameters to assess the privacy enhancements. Leveraging the spectral properties of generalized Vandermonde matrices, bounds on the privacy margin of the proposed scheme are derived. Specifically, it is shown that the privacy margin increases quadratically in the inverse of the separation between the true and the fake paths under Eve's perspective. Numerical simulations further showcase the approach's benefit. △ Less

Submitted 2 February, 2024; originally announced February 2024.

Extracting periodontitis diagnosis in clinical notes with RoBERTa and regular expression

Authors: Yao-Shun Chuang, Chun-Teh Lee, Ryan Brandon, Trung Duong Tran, Oluwabunmi Tokede, Muhammad F. Walji, Xiaoqian Jiang

Abstract: This study aimed to utilize text processing and natural language processing (NLP) models to mine clinical notes for the diagnosis of periodontitis and to evaluate the performance of a named entity recognition (NER) model on different regular expression (RE) methods. Two complexity levels of RE methods were used to extract and generate the training data. The SpaCy package and RoBERTa transformer mo… ▽ More This study aimed to utilize text processing and natural language processing (NLP) models to mine clinical notes for the diagnosis of periodontitis and to evaluate the performance of a named entity recognition (NER) model on different regular expression (RE) methods. Two complexity levels of RE methods were used to extract and generate the training data. The SpaCy package and RoBERTa transformer models were used to build the NER model and evaluate its performance with the manual-labeled gold standards. The comparison of the RE methods with the gold standard showed that as the complexity increased in the RE algorithms, the F1 score increased from 0.3-0.4 to around 0.9. The NER models demonstrated excellent predictions, with the simple RE method showing 0.84-0.92 in the evaluation metrics, and the advanced and combined RE method demonstrating 0.95-0.99 in the evaluation. This study provided an example of the benefit of combining NER methods and NLP models in extracting target information from free-text to structured data and fulfilling the need for missing diagnoses from unstructured notes. △ Less

Submitted 17 November, 2023; originally announced November 2023.

Comments: IEEE ICHI 2023, see https://ieeeichi.github.io/ICHI2023/program.html

STEER: Semantic Turn Extension-Expansion Recognition for Voice Assistants

Authors: Leon Liyang Zhang, Jiarui Lu, Joel Ruben Antony Moniz, Aditya Kulkarni, Dhivya Piraviperumal, Tien Dung Tran, Nicholas Tzou, Hong Yu

Abstract: In the context of a voice assistant system, steering refers to the phenomenon in which a user issues a follow-up command attempting to direct or clarify a previous turn. We propose STEER, a steering detection model that predicts whether a follow-up turn is a user's attempt to steer the previous command. Constructing a training dataset for steering use cases poses challenges due to the cold-start p… ▽ More In the context of a voice assistant system, steering refers to the phenomenon in which a user issues a follow-up command attempting to direct or clarify a previous turn. We propose STEER, a steering detection model that predicts whether a follow-up turn is a user's attempt to steer the previous command. Constructing a training dataset for steering use cases poses challenges due to the cold-start problem. To overcome this, we developed heuristic rules to sample opt-in usage data, approximating positive and negative samples without any annotation. Our experimental results show promising performance in identifying steering intent, with over 95% accuracy on our sampled data. Moreover, STEER, in conjunction with our sampling strategy, aligns effectively with real-world steering scenarios, as evidenced by its strong zero-shot performance on a human-graded evaluation set. In addition to relying solely on user transcripts as input, we introduce STEER+, an enhanced version of the model. STEER+ utilizes a semantic parse tree to provide more context on out-of-vocabulary words, such as named entities that often occur at the sentence boundary. This further improves model performance, reducing error rate in domains where entities frequently appear, such as messaging. Lastly, we present a data analysis that highlights the improvement in user experience when voice assistants support steering use cases. △ Less

Submitted 25 October, 2023; originally announced October 2023.

Comments: EMNLP 2023 Industry Track

Circular-Line Trajectory Tracking Controller for Mobile Robot using Multi-Pixy2 Sensors

Authors: Xuan Quang Ngo, Tri Duc Tran, Huy Hung Nguyen, Van Dong Nguyen, Van Tu Duong, Tan Tien Nguyen

Abstract: This study suggests a novel tracking method that employs three Pixy2 sensors to identify the desired line trajectories instead of traditional perceiving means. Firstly, the kinematic model of the mobile robot is derived from the information gathered by three Pixy2 sensors. Secondly, the sliding mode controller is implemented to regulate the tracking error. Finally, simulation results are analyzed… ▽ More This study suggests a novel tracking method that employs three Pixy2 sensors to identify the desired line trajectories instead of traditional perceiving means. Firstly, the kinematic model of the mobile robot is derived from the information gathered by three Pixy2 sensors. Secondly, the sliding mode controller is implemented to regulate the tracking error. Finally, simulation results are analyzed to show the effectiveness of the proposed method. △ Less

Submitted 12 August, 2023; originally announced September 2023.

Comments: 6 pages, 12 figures, the 2023 International Symposium on Electrical and Electronics Engineering, Ho Chi Minh, Viet Nam, 2023

Robust Approximation Algorithms for Non-monotone $k$-Submodular Maximization under a Knapsack Constraint

Authors: Dung T. K. Ha, Canh V. Pham, Tan D. Tran, Huan X. Hoang

Abstract: The problem of non-monotone $k$-submodular maximization under a knapsack constraint ($\kSMK$) over the ground set size $n$ has been raised in many applications in machine learning, such as data summarization, information propagation, etc. However, existing algorithms for the problem are facing questioning of how to overcome the non-monotone case and how to fast return a good solution in case of th… ▽ More The problem of non-monotone $k$-submodular maximization under a knapsack constraint ($\kSMK$) over the ground set size $n$ has been raised in many applications in machine learning, such as data summarization, information propagation, etc. However, existing algorithms for the problem are facing questioning of how to overcome the non-monotone case and how to fast return a good solution in case of the big size of data. This paper introduces two deterministic approximation algorithms for the problem that competitively improve the query complexity of existing algorithms. Our first algorithm, $\LAA$, returns an approximation ratio of $1/19$ within $O(nk)$ query complexity. The second one, $\RLA$, improves the approximation ratio to $1/5-ε$ in $O(nk)$ queries, where $ε$ is an input parameter. Our algorithms are the first ones that provide constant approximation ratios within only $O(nk)$ query complexity for the non-monotone objective. They, therefore, need fewer the number of queries than state-of-the-the-art ones by a factor of $Ω(\log n)$. Besides the theoretical analysis, we have evaluated our proposed ones with several experiments in some instances: Influence Maximization and Sensor Placement for the problem. The results confirm that our algorithms ensure theoretical quality as the cutting-edge techniques and significantly reduce the number of queries. △ Less

Submitted 21 September, 2023; originally announced September 2023.

Comments: 12 pages

Report number: KSE-ID38

Linear Query Approximation Algorithms for Non-monotone Submodular Maximization under Knapsack Constraint

Authors: Canh V. Pham, Tan D. Tran, Dung T. K. Ha, My T. Thai

Abstract: This work, for the first time, introduces two constant factor approximation algorithms with linear query complexity for non-monotone submodular maximization over a ground set of size $n$ subject to a knapsack constraint, $\mathsf{DLA}$ and $\mathsf{RLA}$. $\mathsf{DLA}$ is a deterministic algorithm that provides an approximation factor of $6+ε$ while $\mathsf{RLA}$ is a randomized algorithm with a… ▽ More This work, for the first time, introduces two constant factor approximation algorithms with linear query complexity for non-monotone submodular maximization over a ground set of size $n$ subject to a knapsack constraint, $\mathsf{DLA}$ and $\mathsf{RLA}$. $\mathsf{DLA}$ is a deterministic algorithm that provides an approximation factor of $6+ε$ while $\mathsf{RLA}$ is a randomized algorithm with an approximation factor of $4+ε$. Both run in $O(n \log(1/ε)/ε)$ query complexity. The key idea to obtain a constant approximation ratio with linear query lies in: (1) dividing the ground set into two appropriate subsets to find the near-optimal solution over these subsets with linear queries, and (2) combining a threshold greedy with properties of two disjoint sets or a random selection process to improve solution quality. In addition to the theoretical analysis, we have evaluated our proposed solutions with three applications: Revenue Maximization, Image Summarization, and Maximum Weighted Cut, showing that our algorithms not only return comparative results to state-of-the-art algorithms but also require significantly fewer queries. △ Less

Submitted 10 July, 2023; v1 submitted 17 May, 2023; originally announced May 2023.

Tunneling in a very slow ion-molecule reaction

Authors: Robert Wild, Markus Nötzold, Malcolm Simpson, Thuy Dung Tran, Roland Wester

Abstract: Quantum tunneling reactions play a significant role in chemistry when classical pathways are energetically forbidden, be it in gas phase reactions, surface diffusion, or liquid phase chemistry. In general, such tunneling reactions are challenging to calculate theoretically, given the high dimensionality of the quantum dynamics, and also very difficult to identify experimentally. Hydrogenic systems… ▽ More Quantum tunneling reactions play a significant role in chemistry when classical pathways are energetically forbidden, be it in gas phase reactions, surface diffusion, or liquid phase chemistry. In general, such tunneling reactions are challenging to calculate theoretically, given the high dimensionality of the quantum dynamics, and also very difficult to identify experimentally. Hydrogenic systems, however, allow for accurate first-principles calculations. In this way the rate of the gas phase proton transfer tunneling reaction of hydrogen molecules with deuterium anions, H_2 + D^- --> H^- + HD, has been calculated, but has so far lacked experimental verification. Here we present high-sensitivity measurements of the reaction rate carried out in a cryogenic 22-pole ion trap. We observe an extremely low rate constant of (5.2 +- 1.6) x 10^(-20) cm^3/s. This measured value agrees with quantum tunneling calculations, serving as a benchmark for molecular theory and advancing the understanding of fundamental collision processes. A deviation of the reaction rate from linear scaling, which is observed at high H_2 densities, can be traced back to previously unobserved heating dynamics in radiofrequency ion traps. △ Less

Submitted 27 March, 2023; originally announced March 2023.

Journal ref: Nature 615, 425 (2023)

From User Perceptions to Technical Improvement: Enabling People Who Stutter to Better Use Speech Recognition

Authors: Colin Lea, Zifang Huang, Lauren Tooley, Jaya Narain, Dianna Yee, Panayiotis Georgiou, Tien Dung Tran, Jeffrey P. Bigham, Leah Findlater

Abstract: Consumer speech recognition systems do not work as well for many people with speech diferences, such as stuttering, relative to the rest of the general population. However, what is not clear is the degree to which these systems do not work, how they can be improved, or how much people want to use them. In this paper, we frst address these questions using results from a 61-person survey from people… ▽ More Consumer speech recognition systems do not work as well for many people with speech diferences, such as stuttering, relative to the rest of the general population. However, what is not clear is the degree to which these systems do not work, how they can be improved, or how much people want to use them. In this paper, we frst address these questions using results from a 61-person survey from people who stutter and fnd participants want to use speech recognition but are frequently cut of, misunderstood, or speech predictions do not represent intent. In a second study, where 91 people who stutter recorded voice assistant commands and dictation, we quantify how dysfuencies impede performance in a consumer-grade speech recognition system. Through three technical investigations, we demonstrate how many common errors can be prevented, resulting in a system that cuts utterances of 79.1% less often and improves word error rate from 25.4% to 9.9%. △ Less

Submitted 27 February, 2023; v1 submitted 17 February, 2023; originally announced February 2023.

Comments: CHI 2023

Deep filter bank regression for super-resolution of anisotropic MR brain images

Authors: Samuel W. Remedios, Shuo Han, Yuan Xue, Aaron Carass, Trac D. Tran, Dzung L. Pham, Jerry L. Prince

Abstract: In 2D multi-slice magnetic resonance (MR) acquisition, the through-plane signals are typically of lower resolution than the in-plane signals. While contemporary super-resolution (SR) methods aim to recover the underlying high-resolution volume, the estimated high-frequency information is implicit via end-to-end data-driven training rather than being explicitly stated and sought. To address this, w… ▽ More In 2D multi-slice magnetic resonance (MR) acquisition, the through-plane signals are typically of lower resolution than the in-plane signals. While contemporary super-resolution (SR) methods aim to recover the underlying high-resolution volume, the estimated high-frequency information is implicit via end-to-end data-driven training rather than being explicitly stated and sought. To address this, we reframe the SR problem statement in terms of perfect reconstruction filter banks, enabling us to identify and directly estimate the missing information. In this work, we propose a two-stage approach to approximate the completion of a perfect reconstruction filter bank corresponding to the anisotropic acquisition of a particular scan. In stage 1, we estimate the missing filters using gradient descent and in stage 2, we use deep networks to learn the map** from coarse coefficients to detail coefficients. In addition, the proposed formulation does not rely on external training data, circumventing the need for domain shift correction. Under our approach, SR performance is improved particularly in "slice gap" scenarios, likely due to the constrained solution space imposed by the framework. △ Less

Submitted 6 September, 2022; originally announced September 2022.

Approximate Message Passing with Parameter Estimation for Heavily Quantized Measurements

Authors: Shuai Huang, Deqiang Qiu, Trac D. Tran

Abstract: Designing efficient sparse recovery algorithms that could handle noisy quantized measurements is important in a variety of applications -- from radar to source localization, spectrum sensing and wireless networking. We take advantage of the approximate message passing (AMP) framework to achieve this goal given its high computational efficiency and state-of-the-art performance. In AMP, the signal o… ▽ More Designing efficient sparse recovery algorithms that could handle noisy quantized measurements is important in a variety of applications -- from radar to source localization, spectrum sensing and wireless networking. We take advantage of the approximate message passing (AMP) framework to achieve this goal given its high computational efficiency and state-of-the-art performance. In AMP, the signal of interest is assumed to follow certain prior distribution with unknown parameters. Previous works focused on finding the parameters that maximize the measurement likelihood via expectation maximization -- an increasingly difficult problem to solve in cases involving complicated probability models. In this paper, we treat the parameters as unknown variables and compute their posteriors via AMP. The parameters and signal of interest can then be jointly recovered. Compared to previous methods, the proposed approach leads to a simple and elegant parameter estimation scheme, allowing us to directly work with 1-bit quantization noise model. We then further extend our approach to general multi-bit quantization noise model. Experimental results show that the proposed framework provides significant improvement over state-of-the-art methods across a wide range of sparsity and noise levels. △ Less

Submitted 20 May, 2022; originally announced May 2022.

Comments: arXiv admin note: text overlap with arXiv:2007.07679

Journal ref: IEEE Transactions on Signal Processing, Vol. 70, pp. 2062-2077, Apr. 2022

How easy is it for investment managers to deploy their talent in green and brown stocks?

Authors: David Ardia, Keven Bluteau, Thien Duy Tran

Abstract: We explore the realized alpha-performance heterogeneity in green and brown stocks' universes using the peer performance ratios of Ardia and Boudt (2018). Focusing on S&P 500 index firms over 2014-2020 and defining peer groups in terms of firms' greenhouse gas emission levels, we find that, on average, about 20% of the stocks differentiate themselves from their peers in terms of future performance.… ▽ More We explore the realized alpha-performance heterogeneity in green and brown stocks' universes using the peer performance ratios of Ardia and Boudt (2018). Focusing on S&P 500 index firms over 2014-2020 and defining peer groups in terms of firms' greenhouse gas emission levels, we find that, on average, about 20% of the stocks differentiate themselves from their peers in terms of future performance. We see a much higher time-variation in this opportunity set within brown stocks. Furthermore, the performance heterogeneity has decreased over time, especially for green stocks, implying that it is now more difficult for investment managers to deploy their skills when choosing among low-GHG intensity stocks. △ Less

Submitted 13 April, 2023; v1 submitted 14 January, 2022; originally announced January 2022.

Journal ref: Finance Research Letters, Volume 48, August 2022, 102992

One-Leg Stance of Humanoid Robot using Active Balance Control

Authors: Tri Duc Tran, Anh Khoa Lanh Luu, Van Tu Duong, Huy Hung Nguyen, Tan Tien Nguyen

Abstract: The task of self-balancing is one of the most important tasks when develo** humanoid robots. This paper proposes a novel external balance mechanism for humanoid robot to maintain sideway balance. First, a dynamic model of the humanoid robot with balance mechanism and its simplified model are introduced. Secondly, a backstep**-based control method is utilized to split the system into two sub-sy… ▽ More The task of self-balancing is one of the most important tasks when develo** humanoid robots. This paper proposes a novel external balance mechanism for humanoid robot to maintain sideway balance. First, a dynamic model of the humanoid robot with balance mechanism and its simplified model are introduced. Secondly, a backstep**-based control method is utilized to split the system into two sub-systems. Then, a minimum observer-based controller is used to control the first sub-system. Since the second sub-system has unknown parameters, a model reference adaptive controller (MRAC) is used to control it. The proposed design divides the walking and balancing into two separated tasks, allowing the walking control can be executed independently of the balancing control. Furthermore, the use of the balance mechanism ensures the humanoid robot's hip movement does not exceed the threshold of a human when walking. Thus, making the overall pose of the humanoid robot looks more natural. An experiment is carried out on a commercial humanoid robot known as UXA-90 to evaluate the effectiveness of the proposed method. △ Less

Submitted 24 July, 2021; originally announced July 2021.

Dynamic curriculum learning via data parameters for noise robust keyword spotting

Authors: Takuya Higuchi, Shreyas Saxena, Mehrez Souden, Tien Dung Tran, Masood Delfarah, Chandra Dhir

Abstract: We propose dynamic curriculum learning via data parameters for noise robust keyword spotting. Data parameter learning has recently been introduced for image processing, where weight parameters, so-called data parameters, for target classes and instances are introduced and optimized along with model parameters. The data parameters scale logits and control importance over classes and instances durin… ▽ More We propose dynamic curriculum learning via data parameters for noise robust keyword spotting. Data parameter learning has recently been introduced for image processing, where weight parameters, so-called data parameters, for target classes and instances are introduced and optimized along with model parameters. The data parameters scale logits and control importance over classes and instances during training, which enables automatic curriculum learning without additional annotations for training data. Similarly, in this paper, we propose using this curriculum learning approach for acoustic modeling, and train an acoustic model on clean and noisy utterances with the data parameters. The proposed approach automatically learns the difficulty of the classes and instances, e.g. due to low speech to noise ratio (SNR), in the gradient descent optimization and performs curriculum learning. This curriculum learning leads to overall improvement of the accuracy of the acoustic model. We evaluate the effectiveness of the proposed approach on a keyword spotting task. Experimental results show 7.7% relative reduction in false reject ratio with the data parameters compared to a baseline model which is simply trained on the multiconditioned dataset. △ Less

Submitted 18 February, 2021; originally announced February 2021.

Comments: Accepted at ICASSP 2021

Optical Flow Estimation via Motion Feature Recovery

Authors: Yang Jiao, Guangming Shi, Trac D. Tran

Abstract: Optical flow estimation with occlusion or large displacement is a problematic challenge due to the lost of corresponding pixels between consecutive frames. In this paper, we discover that the lost information is related to a large quantity of motion features (more than 40%) computed from the popular discriminative cost-volume feature would completely vanish due to invalid sampling, leading to the… ▽ More Optical flow estimation with occlusion or large displacement is a problematic challenge due to the lost of corresponding pixels between consecutive frames. In this paper, we discover that the lost information is related to a large quantity of motion features (more than 40%) computed from the popular discriminative cost-volume feature would completely vanish due to invalid sampling, leading to the low efficiency of optical flow learning. We call this phenomenon the Vanishing Cost Volume Problem. Inspired by the fact that local motion tends to be highly consistent within a short temporal window, we propose a novel iterative Motion Feature Recovery (MFR) method to address the vanishing cost volume via modeling motion consistency across multiple frames. In each MFR iteration, invalid entries from original motion features are first determined based on the current flow. Then, an efficient network is designed to adaptively learn the motion correlation to recover invalid features for lost-information restoration. The final optical flow is then decoded from the recovered motion features. Experimental results on Sintel and KITTI show that our method achieves state-of-the-art performances. In fact, MFR currently ranks second on Sintel public website. △ Less

Submitted 15 January, 2021; originally announced January 2021.

Comments: 5 pages

Levy noise-induced self-induced stochastic resonance in a memristive neuron

Authors: Marius E. Yamakou, Tat Dat Tran

Abstract: Self-induced stochastic resonance (SISR) is a subtle resonance mechanism requiring a nontrivial scaling limit between the stochastic and the deterministic timescales of an excitable system, leading to the emergence of a limit cycle behavior which is absent without noise. All previous studies on SISR in neural systems have only considered the idealized Gaussian white noise. Moreover, these studies… ▽ More Self-induced stochastic resonance (SISR) is a subtle resonance mechanism requiring a nontrivial scaling limit between the stochastic and the deterministic timescales of an excitable system, leading to the emergence of a limit cycle behavior which is absent without noise. All previous studies on SISR in neural systems have only considered the idealized Gaussian white noise. Moreover, these studies have ignored one electrophysiological aspect of the nerve cell: its memristive properties. In this paper, first, we show that in the excitable regime, the asymptotic matching of the Levy timescale (that follows a power law, unlike Gaussian noise that follows Kramers law) and the deterministic timescale (controlled by the singular parameter) can also induce a strong SISR. In addition, it is shown that the degree of SISR induced by Levy noise is not always higher than that of Gaussian noise. Second, we show that, for both types of noises, the two memristive properties of the neuron have opposite effects on the degree of SISR: the stronger the feedback gain parameter that controls the modulation of the membrane potential with the magnetic flux and the weaker the feedback gain parameter that controls the saturation of the magnetic flux, the higher the degree of SISR. Finally, we show that, for both types of noises, the degree of SISR in the memristive neuron is always higher than in the non-memristive neuron. Our results could find applications in designing neuromorphic circuits operating in noisy regimes. △ Less

Submitted 23 April, 2021; v1 submitted 5 December, 2020; originally announced December 2020.

Comments: 18 pages, 7 figures

2D+3D Facial Expression Recognition via Discriminative Dynamic Range Enhancement and Multi-Scale Learning

Authors: Yang Jiao, Yi Niu, Trac D. Tran, Guangming Shi

Abstract: In 2D+3D facial expression recognition (FER), existing methods generate multi-view geometry maps to enhance the depth feature representation. However, this may introduce false estimations due to local plane fitting from incomplete point clouds. In this paper, we propose a novel Map Generation technique from the viewpoint of information theory, to boost the slight 3D expression differences from str… ▽ More In 2D+3D facial expression recognition (FER), existing methods generate multi-view geometry maps to enhance the depth feature representation. However, this may introduce false estimations due to local plane fitting from incomplete point clouds. In this paper, we propose a novel Map Generation technique from the viewpoint of information theory, to boost the slight 3D expression differences from strong personality variations. First, we examine the HDR depth data to extract the discriminative dynamic range $r_{dis}$, and maximize the entropy of $r_{dis}$ to a global optimum. Then, to prevent the large deformation caused by over-enhancement, we introduce a depth distortion constraint and reduce the complexity from $O(KN^2)$ to $O(KNτ)$. Furthermore, the constrained optimization is modeled as a $K$-edges maximum weight path problem in a directed acyclic graph, and we solve it efficiently via dynamic programming. Finally, we also design an efficient Facial Attention structure to automatically locate subtle discriminative facial parts for multi-scale learning, and train it with a proposed loss function $\mathcal{L}_{FA}$ without any facial landmarks. Experimental results on different datasets show that the proposed method is effective and outperforms the state-of-the-art 2D+3D FER methods in both FER accuracy and the output entropy of the generated maps. △ Less

Submitted 16 November, 2020; originally announced November 2020.

EffiScene: Efficient Per-Pixel Rigidity Inference for Unsupervised Joint Learning of Optical Flow, Depth, Camera Pose and Motion Segmentation

Authors: Yang Jiao, Trac D. Tran, Guangming Shi

Abstract: This paper addresses the challenging unsupervised scene flow estimation problem by jointly learning four low-level vision sub-tasks: optical flow $\textbf{F}$, stereo-depth $\textbf{D}$, camera pose $\textbf{P}$ and motion segmentation $\textbf{S}$. Our key insight is that the rigidity of the scene shares the same inherent geometrical structure with object movements and scene depth. Hence, rigidit… ▽ More This paper addresses the challenging unsupervised scene flow estimation problem by jointly learning four low-level vision sub-tasks: optical flow $\textbf{F}$, stereo-depth $\textbf{D}$, camera pose $\textbf{P}$ and motion segmentation $\textbf{S}$. Our key insight is that the rigidity of the scene shares the same inherent geometrical structure with object movements and scene depth. Hence, rigidity from $\textbf{S}$ can be inferred by jointly coupling $\textbf{F}$, $\textbf{D}$ and $\textbf{P}$ to achieve more robust estimation. To this end, we propose a novel scene flow framework named EffiScene with efficient joint rigidity learning, going beyond the existing pipeline with independent auxiliary structures. In EffiScene, we first estimate optical flow and depth at the coarse level and then compute camera pose by Perspective-$n$-Points method. To jointly learn local rigidity, we design a novel Rigidity From Motion (RfM) layer with three principal components: \emph{}{(i)} correlation extraction; \emph{}{(ii)} boundary learning; and \emph{}{(iii)} outlier exclusion. Final outputs are fused based on the rigid map $M_R$ from RfM at finer levels. To efficiently train EffiScene, two new losses $\mathcal{L}_{bnd}$ and $\mathcal{L}_{unc}$ are designed to prevent trivial solutions and to regularize the flow boundary discontinuity. Extensive experiments on scene flow benchmark KITTI show that our method is effective and significantly improves the state-of-the-art approaches for all sub-tasks, i.e. optical flow ($5.19 \rightarrow 4.20$), depth estimation ($3.78 \rightarrow 3.46$), visual odometry ($0.012 \rightarrow 0.011$) and motion segmentation ($0.57 \rightarrow 0.62$). △ Less

Submitted 14 May, 2021; v1 submitted 16 November, 2020; originally announced November 2020.

Comments: Accpeted by IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) 2021; v1 - original submit v2 - camera ready version v3 - correct small bugs in Equation(2)

Differentiation of measures on complete Riemannian manifolds

Authors: Jürgen Jost, Hông Vân Lê, Tat Dat Tran

Abstract: In this note we give a new proof of a version of the Besicovitch covering theorem, given in \cite{EG1992}, \cite{Bogachev2007} and extended in \cite{Federer1969}, for locally finite Borel measures on finite dimensional complete Riemannian manifolds $(M,g)$. As a consequence, we prove a differentiation theorem for Borel measures on $(M,g)$, which gives a formula for the Radon-Nikodym density of two… ▽ More In this note we give a new proof of a version of the Besicovitch covering theorem, given in \cite{EG1992}, \cite{Bogachev2007} and extended in \cite{Federer1969}, for locally finite Borel measures on finite dimensional complete Riemannian manifolds $(M,g)$. As a consequence, we prove a differentiation theorem for Borel measures on $(M,g)$, which gives a formula for the Radon-Nikodym density of two nonnegative locally finite Borel measures $ν_1, ν_2$ on $(M, g)$ such that $ν_1 \ll ν_2$, extending the known case when $(M, g)$ is a standard Euclidean space. △ Less

Submitted 30 August, 2020; originally announced August 2020.

Comments: 13 p., This is a revised version of the Appendix in our earlier e-print arXiv:1905.11448

Bayesian Massive MIMO Channel Estimation with Parameter Estimation Using Low-Resolution ADCs

Authors: Shuai Huang, Deqiang Qiu, Trac D. Tran

Abstract: In order to reduce hardware complexity and power consumption, massive multiple-input multiple-output (MIMO) systems employ low-resolution analog-to-digital converters (ADCs) to acquire quantized measurements $\boldsymbol y$. This poses new challenges to the channel estimation problem, and the sparse prior on the channel coefficient vector $\boldsymbol x$ in the angle domain is often used to compen… ▽ More In order to reduce hardware complexity and power consumption, massive multiple-input multiple-output (MIMO) systems employ low-resolution analog-to-digital converters (ADCs) to acquire quantized measurements $\boldsymbol y$. This poses new challenges to the channel estimation problem, and the sparse prior on the channel coefficient vector $\boldsymbol x$ in the angle domain is often used to compensate for the information lost during quantization. By interpreting the sparse prior from a probabilistic perspective, we can assume $\boldsymbol x$ follows certain sparse prior distribution and recover it using approximate message passing (AMP). However, the distribution parameters are unknown in practice and need to be estimated. Due to the increased computational complexity in the quantization noise model, previous works either use an approximated noise model or manually tune the noise distribution parameters. In this paper, we treat both signals and parameters as random variables and recover them jointly within the AMP framework. The proposed approach leads to a much simpler parameter estimation method, allowing us to work with the quantization noise model directly. Experimental results show that the proposed approach achieves state-of-the-art performance under various noise levels and does not require parameter tuning, making it a practical and maintenance-free approach for channel estimation. △ Less

Submitted 11 February, 2021; v1 submitted 28 July, 2020; originally announced July 2020.

1-Bit Compressive Sensing via Approximate Message Passing with Built-in Parameter Estimation

Authors: Shuai Huang, Trac D. Tran

Abstract: 1-bit compressive sensing aims to recover sparse signals from quantized 1-bit measurements. Designing efficient approaches that could handle noisy 1-bit measurements is important in a variety of applications. In this paper we use the approximate message passing (AMP) to achieve this goal due to its high computational efficiency and state-of-the-art performance. In AMP the signal of interest is ass… ▽ More 1-bit compressive sensing aims to recover sparse signals from quantized 1-bit measurements. Designing efficient approaches that could handle noisy 1-bit measurements is important in a variety of applications. In this paper we use the approximate message passing (AMP) to achieve this goal due to its high computational efficiency and state-of-the-art performance. In AMP the signal of interest is assumed to follow some prior distribution, and its posterior distribution can be computed and used to recover the signal. In practice, the parameters of the prior distributions are often unknown and need to be estimated. Previous works tried to find the parameters that maximize either the measurement likelihood via expectation maximization, which becomes increasingly difficult to solve in cases of complicated probability models. Here we propose to treat the parameters as unknown variables and compute their posteriors via AMP as well, so that the parameters and the signal can be recovered jointly. Compared to previous methods, the proposed approach leads to a simple and elegant parameter estimation scheme, allowing us to directly work with 1-bit quantization noise model. Experimental results show that the proposed approach generally perform much better than the other state-of-the-art methods in the zero-noise and moderate-noise regimes, and outperforms them in most of the cases in the high-noise regime. △ Less

Submitted 26 April, 2022; v1 submitted 15 July, 2020; originally announced July 2020.

On the asymptotic behavior of the Diaconis and Freedman's chain in a multidimensional simplex

Authors: Marc Peigné, Tat Dat Tran

Abstract: In this paper, we give out a setting of an Diaconis and Freedman's chain in a multidimensional simplex and consider its asymptotic behavior. By using techniques in random iterated functions theory and quasi-compact operators theory, we first give out some sufficient conditions which ensure the existence and uniqueness of an invariant probability measure. In some particular cases, we give out expli… ▽ More In this paper, we give out a setting of an Diaconis and Freedman's chain in a multidimensional simplex and consider its asymptotic behavior. By using techniques in random iterated functions theory and quasi-compact operators theory, we first give out some sufficient conditions which ensure the existence and uniqueness of an invariant probability measure. In some particular cases, we give out explicit formulas of the invariant probability density. Moreover, we completely classify all behaviors of this chain in dimensional two. Eventually, some other settings of the chain are discussed. △ Less

Submitted 3 June, 2020; originally announced June 2020.

Comments: 21 pages, 9 figures. Comments are welcome

MSC Class: 60J05; 60F05

Adaptive Bet-Hedging Revisited: Considerations of Risk and Time Horizon

Authors: Omri Tal, Tat Dat Tran

Abstract: Models of adaptive bet-hedging commonly adopt insights from Kelly's famous work on optimal gambling strategies and the financial value of information. In particular, such models seek evolutionary solutions that maximize long term average growth rate of lineages, even in the face of highly stochastic growth trajectories. Here, we argue for extensive departures from the standard approach to better a… ▽ More Models of adaptive bet-hedging commonly adopt insights from Kelly's famous work on optimal gambling strategies and the financial value of information. In particular, such models seek evolutionary solutions that maximize long term average growth rate of lineages, even in the face of highly stochastic growth trajectories. Here, we argue for extensive departures from the standard approach to better account for evolutionary contingencies. Crucially, we incorporate considerations of volatility minimization, motivated by interim extinction risk in finite populations, within a finite time horizon approach to growth maximization. We find that a game-theoretic competitive-optimality approach best captures these additional constraints, and derive the equilibria solutions under straightforward fitness payoff functions and extinction risks. We show that for both maximal growth and minimal time relative payoffs the log-optimal strategy is a unique pure-strategy symmetric equilibrium, invariant with evolutionary time horizon and robust to low extinction risks. △ Less

Submitted 17 March, 2020; v1 submitted 15 March, 2020; originally announced March 2020.

Comments: Accepted for publication in Bulletin of Mathematical Biology

Next-generation Wireless Solutions for the Smart Factory, Smart Vehicles, the Smart Grid and Smart Cities

Authors: Tai Manh Ho, Thinh Duy Tran, Ti Ti Nguyen, S. M. Ahsan Kazmi, Long Bao Le, Choong Seon Hong, Lajos Hanzo

Abstract: 5G wireless systems will extend mobile communication services beyond mobile telephony, mobile broadband, and massive machine-type communication into new application domains, namely the so-called vertical domains including the smart factory, smart vehicles, smart grid, smart city, etc. Supporting these vertical domains comes with demanding requirements: high-availability, high-reliability, low-late… ▽ More 5G wireless systems will extend mobile communication services beyond mobile telephony, mobile broadband, and massive machine-type communication into new application domains, namely the so-called vertical domains including the smart factory, smart vehicles, smart grid, smart city, etc. Supporting these vertical domains comes with demanding requirements: high-availability, high-reliability, low-latency, and in some cases, high-accuracy positioning. In this survey, we first identify the potential key performance requirements of 5G communication in support of automation in the vertical domains and highlight the 5G enabling technologies conceived for meeting these requirements. We then discuss the key challenges faced both by industry and academia which have to be addressed in order to support automation in the vertical domains. We also provide a survey of the related research dedicated to automation in the vertical domains. Finally, our vision of 6G wireless systems is discussed briefly. △ Less

Submitted 23 July, 2019; originally announced July 2019.

Magnetic lattices for ultracold atoms

Authors: Tien Duy Tran, Yibo Wang, ALex Glaetzle, Shannon Whitlock, Andrei Sidorov, Peter Hannaford

Abstract: This article reviews the development in our laboratory of magnetic lattices comprising periodic arrays of magnetic microtraps created by patterned magnetic films to trap periodic arrays of ultracold atoms. Recent achievements include the realisation of multiple Bose-Einstein condensates in a 10 micron-period one-dimensional magnetic lattice; the fabrication of sub-micron-period square and triangul… ▽ More This article reviews the development in our laboratory of magnetic lattices comprising periodic arrays of magnetic microtraps created by patterned magnetic films to trap periodic arrays of ultracold atoms. Recent achievements include the realisation of multiple Bose-Einstein condensates in a 10 micron-period one-dimensional magnetic lattice; the fabrication of sub-micron-period square and triangular magnetic lattice structures suitable for quantum tunnelling experiments; the trap** of ultracold atoms in a sub-micron-period triangular magnetic lattice; and a proposal to use long-range interacting Rydberg atoms to achieve spin-spin interactions between sites in a large-spacing magnetic lattice. △ Less

Submitted 20 June, 2019; originally announced June 2019.

Probabilistic morphisms and Bayesian nonparametrics

Authors: Jürgen Jost, Hông Vân Lê, Tat Dat Tran

Abstract: In this paper we develop a functorial language of probabilistic morphisms and apply it to some basic problems in Bayesian nonparametrics. First we extend and unify the Kleisli category of probabilistic morphisms proposed by Lawvere and Giry with the category of statistical models proposed by Chentsov and Morse-Sacksteder. Then we introduce the notion of a Bayesian statistical model that formalizes… ▽ More In this paper we develop a functorial language of probabilistic morphisms and apply it to some basic problems in Bayesian nonparametrics. First we extend and unify the Kleisli category of probabilistic morphisms proposed by Lawvere and Giry with the category of statistical models proposed by Chentsov and Morse-Sacksteder. Then we introduce the notion of a Bayesian statistical model that formalizes the notion of a parameter space with a given prior distribution in Bayesian statistics. {We revisit the existence of a posterior distribution, using probabilistic morphisms}. In particular, we give an explicit formula for posterior distributions of the Bayesian statistical model, assuming that the underlying parameter space is a Souslin space and the sample space is a subset in a complete connected finite dimensional Riemannian manifold. Then we give a new proof of the existence of Dirichlet measures over any measurable space using a functorial property of the Dirichlet map constructed by Sethuraman. △ Less

Submitted 21 March, 2021; v1 submitted 27 May, 2019; originally announced May 2019.

Comments: Final version: 22 p. Version 2: minor corrections, Proposition 2.10 added, improved presentation, 39 p., version 1: 38 p. comments welcome!

MSC Class: 62G99; 18C20; 28C20

Journal ref: Eur. Phys. J. Plus (2021) 136:441

A Scale Invariant Flatness Measure for Deep Network Minima

Authors: Akshay Rangamani, Nam H. Nguyen, Abhishek Kumar, Dzung Phan, Sang H. Chin, Trac D. Tran

Abstract: It has been empirically observed that the flatness of minima obtained from training deep networks seems to correlate with better generalization. However, for deep networks with positively homogeneous activations, most measures of sharpness/flatness are not invariant to rescaling of the network parameters, corresponding to the same function. This means that the measure of flatness/sharpness can be… ▽ More It has been empirically observed that the flatness of minima obtained from training deep networks seems to correlate with better generalization. However, for deep networks with positively homogeneous activations, most measures of sharpness/flatness are not invariant to rescaling of the network parameters, corresponding to the same function. This means that the measure of flatness/sharpness can be made as small or as large as possible through rescaling, rendering the quantitative measures meaningless. In this paper we show that for deep networks with positively homogenous activations, these rescalings constitute equivalence relations, and that these equivalence relations induce a quotient manifold structure in the parameter space. Using this manifold structure and an appropriate metric, we propose a Hessian-based measure for flatness that is invariant to rescaling. We use this new measure to confirm the proposition that Large-Batch SGD minima are indeed sharper than Small-Batch SGD minima. △ Less

Submitted 6 February, 2019; originally announced February 2019.

Reducing Sampling Ratios Improves Bagging in Sparse Regression

Authors: Luoluo Liu, Sang Peter Chin, Trac D. Tran

Abstract: Bagging, a powerful ensemble method from machine learning, improves the performance of unstable predictors. Although the power of Bagging has been shown mostly in classification problems, we demonstrate the success of employing Bagging in sparse regression over the baseline method (L1 minimization). The framework employs the generalized version of the original Bagging with various bootstrap ratios… ▽ More Bagging, a powerful ensemble method from machine learning, improves the performance of unstable predictors. Although the power of Bagging has been shown mostly in classification problems, we demonstrate the success of employing Bagging in sparse regression over the baseline method (L1 minimization). The framework employs the generalized version of the original Bagging with various bootstrap ratios. The performance limits associated with different choices of bootstrap sampling ratio L/m and number of estimates K is analyzed theoretically. Simulation shows that the proposed method yields state-of-the-art recovery performance, outperforming L1 minimization and Bolasso in the challenging case of low levels of measurements. A lower L/m ratio (60% - 90%) leads to better performance, especially with a small number of measurements. With the reduced sampling rate, SNR improves over the original Bagging by up to 24%. With a properly chosen sampling ratio, a reasonably small number of estimates K = 30 gives satisfying result, even though increasing K is discovered to always improve or at least maintain the performance. △ Less

Submitted 1 May, 2019; v1 submitted 20 December, 2018; originally announced December 2018.

Comments: arXiv admin note: substantial text overlap with arXiv:1810.03743

Generative Adversarial Networks for Recovering Missing Spectral Information

Authors: Dung N. Tran, Trac D. Tran, Lam Nguyen

Abstract: Ultra-wideband (UWB) radar systems nowadays typical operate in the low frequency spectrum to achieve penetration capability. However, this spectrum is also shared by many others communication systems, which causes missing information in the frequency bands. To recover this missing spectral information, we propose a generative adversarial network, called SARGAN, that learns the relationship between… ▽ More Ultra-wideband (UWB) radar systems nowadays typical operate in the low frequency spectrum to achieve penetration capability. However, this spectrum is also shared by many others communication systems, which causes missing information in the frequency bands. To recover this missing spectral information, we propose a generative adversarial network, called SARGAN, that learns the relationship between original and missing band signals by observing these training pairs in a clever way. Initial results shows that this approach is promising in tackling this challenging missing band problem. △ Less

Submitted 12 December, 2018; v1 submitted 11 December, 2018; originally announced December 2018.

Comments: arXiv admin note: text overlap with arXiv:1707.06873 by other authors

JOBS: Joint-Sparse Optimization from Bootstrap Samples

Authors: Luoluo Liu, Sang Peter Chin, Trac D. Tran

Abstract: Classical signal recovery based on $\ell_1$ minimization solves the least squares problem with all available measurements via sparsity-promoting regularization. In practice, it is often the case that not all measurements are available or required for recovery. Measurements might be corrupted/missing or they arrive sequentially in streaming fashion. In this paper, we propose a global sparse recover… ▽ More Classical signal recovery based on $\ell_1$ minimization solves the least squares problem with all available measurements via sparsity-promoting regularization. In practice, it is often the case that not all measurements are available or required for recovery. Measurements might be corrupted/missing or they arrive sequentially in streaming fashion. In this paper, we propose a global sparse recovery strategy based on subsets of measurements, named JOBS, in which multiple measurements vectors are generated from the original pool of measurements via bootstrap**, and then a joint-sparse constraint is enforced to ensure support consistency among multiple predictors. The final estimate is obtained by averaging over the $K$ predictors. The performance limits associated with different choices of number of bootstrap samples $L$ and number of estimates $K$ is analyzed theoretically. Simulation results validate some of the theoretical analysis, and show that the proposed method yields state-of-the-art recovery performance, outperforming $\ell_1$ minimization and a few other existing bootstrap-based techniques in the challenging case of low levels of measurements and is preferable over other bagging-based methods in the streaming setting since it performs better with small $K$ and $L$ for data-sets with large sizes. △ Less

Submitted 10 December, 2018; v1 submitted 8 October, 2018; originally announced October 2018.

Stochastic FitzHugh-Nagumo neuron model in excitable regime embeds a leaky integrate-and-fire model

Authors: Marius E. Yamakou, Tat Dat Tran, Luu Hoang Duc, Juergen Jost

Abstract: In this paper, we provide a complete mathematical construction for a stochastic leaky-integrate-and-fire model (LIF) mimicking the interspike interval (ISI) statistics of a stochastic FitzHugh-Nagumo neuron model (FHN) in the excitable regime, where the unique fixed point is stable. Under specific types of noises, we prove that there exists a global random attractor for the stochastic FHN system.… ▽ More In this paper, we provide a complete mathematical construction for a stochastic leaky-integrate-and-fire model (LIF) mimicking the interspike interval (ISI) statistics of a stochastic FitzHugh-Nagumo neuron model (FHN) in the excitable regime, where the unique fixed point is stable. Under specific types of noises, we prove that there exists a global random attractor for the stochastic FHN system. The linearization method is then applied to estimate the firing time and to derive the associated radial equation representing a LIF equation. This result confirms the previous prediction in [Ditlevsen, S. and Greenwood, P. (2013). The Morris-Lecar neuron model embeds a leaky integrate-and-fire model. Journal of Mathematical Biology, 67(2):239-259] for the Morris-Lecar neuron model in the bistability regime consisting of a stable fixed point and a stable limit cycle. △ Less

Submitted 23 February, 2019; v1 submitted 19 June, 2018; originally announced June 2018.

Comments: 15 pages, 7 figures, 1 table. arXiv admin note: text overlap with arXiv:1108.0073 by other authors

MSC Class: 60GXX; 92BXX

Journal ref: J. Math. Biol. (2019) 79: 509

Contributions to the asymptotic study of Hermite driven processes

Authors: Thi Thanh Diu Tran

Abstract: This thesis consists of two parts. Part I is an introduction to Hermite processes, Hermite random fields, Fisher information and to the papers constituting the thesis. More precisely, in Section 1 we introduce Hermite processes in a nutshell, as well as some of its basic properties. It is the necessary background for the articles [a] and [c]. In Section 2 we consider briefly the multiparameter H… ▽ More This thesis consists of two parts. Part I is an introduction to Hermite processes, Hermite random fields, Fisher information and to the papers constituting the thesis. More precisely, in Section 1 we introduce Hermite processes in a nutshell, as well as some of its basic properties. It is the necessary background for the articles [a] and [c]. In Section 2 we consider briefly the multiparameter Hermite random fields and we study some less elementary facts which are used in the article [b]. In section 3, we recall some terminology about Fisher information related to the article [d]. Finally, our articles [a] to [d] are summarised in Section 4. Part II consists of the articles themselves: [a] T.T. Diu Tran (2017): Non-central limit theorem for quadratic functionals of Hermite-driven long memory moving average processes. \textit{Stochastic and Dynamics}, \textbf{18}, no. 4. [b] T.T. Diu Tran (2016): Asymptotic behavior for quadratic variations of non-Gaussian multiparameter Hermite random fields. Under revision for \textit{Probability and Mathematical Statistics}. [c] I. Nourdin, T.T. Diu Tran (2017): Statistical inference for Vasicek-type model driven by Hermite processes. Submitted to \textit{Stochastic Process and their Applications}. [d] T.T. Diu Tran (2017+): Fisher information and multivariate Fouth Moment Theorem. Main results have already been obtained. It should be submitted soon. △ Less

Submitted 15 February, 2018; originally announced February 2018.

Comments: PhD Thesis (Univ. Luxembourg). 129 pages. Related articles: arXiv:1607.08278, arXiv:1712.05915, arXiv:1611.03674 and forthcoming papers Link on Uni.Lux: http://orbilu.uni.lu/handle/10993/34790

Statistical inference for Vasicek-type model driven by Hermite processes

Authors: Ivan Nourdin, T. T. Diu Tran

Abstract: Let $Z$ denote a Hermite process of order $q \geq 1$ and self-similarity parameter $H \in (\frac{1}{2}, 1)$. This process is $H$-self-similar, has stationary increments and exhibits long-range dependence. When $q=1$, it corresponds to the fractional Brownian motion, whereas it is not Gaussian as soon as $q\geq 2$. In this paper, we deal with a Vasicek-type model driven by $Z$, of the form… ▽ More Let $Z$ denote a Hermite process of order $q \geq 1$ and self-similarity parameter $H \in (\frac{1}{2}, 1)$. This process is $H$-self-similar, has stationary increments and exhibits long-range dependence. When $q=1$, it corresponds to the fractional Brownian motion, whereas it is not Gaussian as soon as $q\geq 2$. In this paper, we deal with a Vasicek-type model driven by $Z$, of the form $dX_t = a(b - X_t)dt +dZ_t$. Here, $a > 0$ and $b \in \mathbb{R}$ are considered as unknown drift parameters. We provide estimators for $a$ and $b$ based on continuous-time observations. For all possible values of $H$ and $q$, we prove strong consistency and we analyze the asymptotic fluctuations. △ Less

Submitted 11 October, 2018; v1 submitted 16 December, 2017; originally announced December 2017.

Comments: 19 pages, revised according to referee's report

Adversarial Deep Structured Nets for Mass Segmentation from Mammograms

Authors: Wentao Zhu, Xiang Xiang, Trac D. Tran, Gregory D. Hager, Xiaohui Xie

Abstract: Mass segmentation provides effective morphological features which are important for mass diagnosis. In this work, we propose a novel end-to-end network for mammographic mass segmentation which employs a fully convolutional network (FCN) to model a potential function, followed by a CRF to perform structured learning. Because the mass distribution varies greatly with pixel position, the FCN is combi… ▽ More Mass segmentation provides effective morphological features which are important for mass diagnosis. In this work, we propose a novel end-to-end network for mammographic mass segmentation which employs a fully convolutional network (FCN) to model a potential function, followed by a CRF to perform structured learning. Because the mass distribution varies greatly with pixel position, the FCN is combined with a position priori. Further, we employ adversarial training to eliminate over-fitting due to the small sizes of mammogram datasets. Multi-scale FCN is employed to improve the segmentation performance. Experimental results on two public datasets, INbreast and DDSM-BCRP, demonstrate that our end-to-end network achieves better performance than state-of-the-art approaches. \footnote{https://github.com/wentaozhu/adversarial-deep-structural-networks.git} △ Less

Submitted 25 December, 2017; v1 submitted 24 October, 2017; originally announced October 2017.

Comments: Accepted by ISBI2018. arXiv admin note: substantial text overlap with arXiv:1612.05970

Sparse Coding and Autoencoders

Authors: Akshay Rangamani, Anirbit Mukherjee, Amitabh Basu, Tejaswini Ganapathy, Ashish Arora, Sang Chin, Trac D. Tran

Abstract: In "Dictionary Learning" one tries to recover incoherent matrices $A^* \in \mathbb{R}^{n \times h}$ (typically overcomplete and whose columns are assumed to be normalized) and sparse vectors $x^* \in \mathbb{R}^h$ with a small support of size $h^p$ for some $0 <p < 1$ while having access to observations $y \in \mathbb{R}^n$ where $y = A^*x^*$. In this work we undertake a rigorous analysis of wheth… ▽ More In "Dictionary Learning" one tries to recover incoherent matrices $A^* \in \mathbb{R}^{n \times h}$ (typically overcomplete and whose columns are assumed to be normalized) and sparse vectors $x^* \in \mathbb{R}^h$ with a small support of size $h^p$ for some $0 <p < 1$ while having access to observations $y \in \mathbb{R}^n$ where $y = A^*x^*$. In this work we undertake a rigorous analysis of whether gradient descent on the squared loss of an autoencoder can solve the dictionary learning problem. The "Autoencoder" architecture we consider is a $\mathbb{R}^n \rightarrow \mathbb{R}^n$ map** with a single ReLU activation layer of size $h$. Under very mild distributional assumptions on $x^*$, we prove that the norm of the expected gradient of the standard squared loss function is asymptotically (in sparse code dimension) negligible for all points in a small neighborhood of $A^*$. This is supported with experimental evidence using synthetic data. We also conduct experiments to suggest that $A^*$ is a local minimum. Along the way we prove that a layer of ReLU gates can be set up to automatically recover the support of the sparse codes. This property holds independent of the loss function. We believe that it could be of independent interest. △ Less

Submitted 20 October, 2017; v1 submitted 11 August, 2017; originally announced August 2017.

Comments: In this new version of the paper with a small change in the distributional assumptions we are actually able to prove the asymptotic criticality of a neighbourhood of the ground truth dictionary for even just the standard squared loss of the ReLU autoencoder (unlike the regularized loss in the older version)

Automatic Vertebra Labeling in Large-Scale 3D CT using Deep Image-to-Image Network with Message Passing and Sparsity Regularization

Authors: Dong Yang, Tao Xiong, Daguang Xu, Qiangui Huang, David Liu, S. Kevin Zhou, Zhoubing Xu, **Hyeong Park, Mingqing Chen, Trac D. Tran, Sang Peter Chin, Dimitris Metaxas, Dorin Comaniciu

Abstract: Automatic localization and labeling of vertebra in 3D medical images plays an important role in many clinical tasks, including pathological diagnosis, surgical planning and postoperative assessment. However, the unusual conditions of pathological cases, such as the abnormal spine curvature, bright visual imaging artifacts caused by metal implants, and the limited field of view, increase the diffic… ▽ More Automatic localization and labeling of vertebra in 3D medical images plays an important role in many clinical tasks, including pathological diagnosis, surgical planning and postoperative assessment. However, the unusual conditions of pathological cases, such as the abnormal spine curvature, bright visual imaging artifacts caused by metal implants, and the limited field of view, increase the difficulties of accurate localization. In this paper, we propose an automatic and fast algorithm to localize and label the vertebra centroids in 3D CT volumes. First, we deploy a deep image-to-image network (DI2IN) to initialize vertebra locations, employing the convolutional encoder-decoder architecture together with multi-level feature concatenation and deep supervision. Next, the centroid probability maps from DI2IN are iteratively evolved with the message passing schemes based on the mutual relation of vertebra centroids. Finally, the localization results are refined with sparsity regularization. The proposed method is evaluated on a public dataset of 302 spine CT volumes with various pathologies. Our method outperforms other state-of-the-art methods in terms of localization accuracy. The run time is around 3 seconds on average per case. To further boost the performance, we retrain the DI2IN on additional 1000+ 3D CT volumes from different patients. To the best of our knowledge, this is the first time more than 1000 3D CT volumes with expert annotation are adopted in experiments for the anatomic landmark detection tasks. Our experimental results show that training with such a large dataset significantly improves the performance and the overall identification rate, for the first time by our knowledge, reaches 90 %. △ Less

Submitted 16 May, 2017; originally announced May 2017.

Sparse Signal Recovery via Generalized Entropy Functions Minimization

Authors: Shuai Huang, Trac D. Tran

Abstract: Compressive sensing relies on the sparse prior imposed on the signal of interest to solve the ill-posed recovery problem in an under-determined linear system. The objective function used to enforce the sparse prior information should be both effective and easily optimizable. Motivated by the entropy concept from information theory, in this paper we propose the generalized Shannon entropy function… ▽ More Compressive sensing relies on the sparse prior imposed on the signal of interest to solve the ill-posed recovery problem in an under-determined linear system. The objective function used to enforce the sparse prior information should be both effective and easily optimizable. Motivated by the entropy concept from information theory, in this paper we propose the generalized Shannon entropy function and Rényi entropy function of the signal as the sparsity promoting regularizers. Both entropy functions are nonconvex, non-separable. Their local minimums only occur on the boundaries of the orthants in the Euclidean space. Compared to other popular objective functions, minimizing the generalized entropy functions adaptively promotes multiple high-energy coefficients while suppressing the rest low-energy coefficients. The corresponding optimization problems can be recasted into a series of reweighted $l_1$-norm minimization problems and then solved efficiently by adapting the FISTA. Sparse signal recovery experiments on both the simulated and real data show the proposed entropy functions minimization approaches perform better than other popular approaches and achieve state-of-the-art performances. △ Less

Submitted 23 February, 2020; v1 submitted 30 March, 2017; originally announced March 2017.

Journal ref: IEEE Transactions on Signal Processing, Vol. 67 (5), Mar. 2019

Regularizing Face Verification Nets For Pain Intensity Regression

Authors: Feng Wang, Xiang Xiang, Chang Liu, Trac D. Tran, Austin Reiter, Gregory D. Hager, Harry Quon, Jian Cheng, Alan L. Yuille

Abstract: Limited labeled data are available for the research of estimating facial expression intensities. For instance, the ability to train deep networks for automated pain assessment is limited by small datasets with labels of patient-reported pain intensities. Fortunately, fine-tuning from a data-extensive pre-trained domain, such as face verification, can alleviate this problem. In this paper, we propo… ▽ More Limited labeled data are available for the research of estimating facial expression intensities. For instance, the ability to train deep networks for automated pain assessment is limited by small datasets with labels of patient-reported pain intensities. Fortunately, fine-tuning from a data-extensive pre-trained domain, such as face verification, can alleviate this problem. In this paper, we propose a network that fine-tunes a state-of-the-art face verification network using a regularized regression loss and additional data with expression labels. In this way, the expression intensity regression task can benefit from the rich feature representations trained on a huge amount of data for face verification. The proposed regularized deep regressor is applied to estimate the pain expression intensity and verified on the widely-used UNBC-McMaster Shoulder-Pain dataset, achieving the state-of-the-art performance. A weighted evaluation metric is also proposed to address the imbalance issue of different pain intensities. △ Less

Submitted 1 June, 2017; v1 submitted 22 February, 2017; originally announced February 2017.

Comments: 5 pages, 3 figure; Camera-ready version to appear at IEEE ICIP 2017

Supervised Deep Sparse Coding Networks

Authors: Xiaoxia Sun, Nasser M. Nasrabadi, Trac D. Tran

Abstract: In this paper, we describe the deep sparse coding network (SCN), a novel deep network that encodes intermediate representations with nonnegative sparse coding. The SCN is built upon a number of cascading bottleneck modules, where each module consists of two sparse coding layers with relatively wide and slim dictionaries that are specialized to produce high dimensional discriminative features and l… ▽ More In this paper, we describe the deep sparse coding network (SCN), a novel deep network that encodes intermediate representations with nonnegative sparse coding. The SCN is built upon a number of cascading bottleneck modules, where each module consists of two sparse coding layers with relatively wide and slim dictionaries that are specialized to produce high dimensional discriminative features and low dimensional representations for clustering, respectively. During training, both the dictionaries and regularization parameters are optimized with an end-to-end supervised learning algorithm based on multilevel optimization. Effectiveness of an SCN with seven bottleneck modules is verified on several popular benchmark datasets. Remarkably, with few parameters to learn, our SCN achieves 5.81% and 19.93% classification error rate on CIFAR-10 and CIFAR-100, respectively. △ Less

Submitted 22 May, 2017; v1 submitted 28 January, 2017; originally announced January 2017.

Linear Disentangled Representation Learning for Facial Actions

Authors: Xiang Xiang, Trac D. Tran

Abstract: Limited annotated data available for the recognition of facial expression and action units embarrasses the training of deep networks, which can learn disentangled invariant features. However, a linear model with just several parameters normally is not demanding in terms of training data. In this paper, we propose an elegant linear model to untangle confounding factors in challenging realistic mult… ▽ More Limited annotated data available for the recognition of facial expression and action units embarrasses the training of deep networks, which can learn disentangled invariant features. However, a linear model with just several parameters normally is not demanding in terms of training data. In this paper, we propose an elegant linear model to untangle confounding factors in challenging realistic multichannel signals such as 2D face videos. The simple yet powerful model does not rely on huge training data and is natural for recognizing facial actions without explicitly disentangling the identity. Base on well-understood intuitive linear models such as Sparse Representation based Classification (SRC), previous attempts require a prepossessing of explicit decoupling which is practically inexact. Instead, we exploit the low-rank property across frames to subtract the underlying neutral faces which are modeled jointly with sparse representation on the action components with group sparsity enforced. On the extended Cohn-Kanade dataset (CK+), our one-shot automatic method on raw face videos performs as competitive as SRC applied on manually prepared action components and performs even better than SRC in terms of true positive rate. We apply the model to the even more challenging task of facial action unit recognition, verified on the MPI Face Video Database (MPI-VDB) achieving a decent performance. All the programs and data have been made publicly available. △ Less

Submitted 11 January, 2017; originally announced January 2017.

Comments: Codes available at https://github.com/eglxiang/icassp15_emotion and https://github.com/eglxiang/FacialAU. arXiv admin note: text overlap with arXiv:1410.1606

Adversarial Deep Structural Networks for Mammographic Mass Segmentation

Authors: Wentao Zhu, Xiang Xiang, Trac D. Tran, Xiaohui Xie

Abstract: Mass segmentation is an important task in mammogram analysis, providing effective morphological features and regions of interest (ROI) for mass detection and classification. Inspired by the success of using deep convolutional features for natural image analysis and conditional random fields (CRF) for structural learning, we propose an end-to-end network for mammographic mass segmentation. The netw… ▽ More Mass segmentation is an important task in mammogram analysis, providing effective morphological features and regions of interest (ROI) for mass detection and classification. Inspired by the success of using deep convolutional features for natural image analysis and conditional random fields (CRF) for structural learning, we propose an end-to-end network for mammographic mass segmentation. The network employs a fully convolutional network (FCN) to model potential function, followed by a CRF to perform structural learning. Because the mass distribution varies greatly with pixel position, the FCN is combined with position priori for the task. Due to the small size of mammogram datasets, we use adversarial training to control over-fitting. Four models with different convolutional kernels are further fused to improve the segmentation results. Experimental results on two public datasets, INbreast and DDSM-BCRP, show that our end-to-end network combined with adversarial training achieves the-state-of-the-art results. △ Less

Submitted 9 June, 2017; v1 submitted 18 December, 2016; originally announced December 2016.

Comments: First version on arXiv 2016, MICCAI 2017 Deep Learning in Medical Image Analysis (DLMIA) workshop

Asymptotic behavior for quadratic variations of non-Gaussian multiparameter Hermite random fields

Authors: T. T. Diu Tran

Abstract: Let $(Z^{q, H}_t)_{t \in [0, 1]^d}$ denote a $d$-parameter Hermite random field of order $q \geq 1$ and self-similarity parameter $H = (H_1, \ldots, H_d) \in (\frac{1}{2}, 1)^d$. This process is $H$-self-similar, has stationary increments and exhibits long-range dependence. Particular examples include fractional Brownian motion ($q=1$, $d=1$), fractional Brownian sheet $(q=1, d \geq 2)$, Rosenblat… ▽ More Let $(Z^{q, H}_t)_{t \in [0, 1]^d}$ denote a $d$-parameter Hermite random field of order $q \geq 1$ and self-similarity parameter $H = (H_1, \ldots, H_d) \in (\frac{1}{2}, 1)^d$. This process is $H$-self-similar, has stationary increments and exhibits long-range dependence. Particular examples include fractional Brownian motion ($q=1$, $d=1$), fractional Brownian sheet $(q=1, d \geq 2)$, Rosenblatt process ($q=2$, $d=1$) as well as Rosenblatt sheet $(q=2, d \geq 2)$. For any $q \geq 2, d\geq 1$ and $H \in (\frac{1}{2}, 1)^d$ we show in this paper that a proper normalization of the quadratic variation of $Z^{q, H}$ converges in $L^2(Ω)$ to a standard $d$-parameter Rosenblatt random variable with self-similarity index $H" = 1+ (2H-2)/q$. △ Less

Submitted 21 December, 2017; v1 submitted 11 November, 2016; originally announced November 2016.

MSC Class: 60F05; 60G18; 60H05; 60H07

Pose-Selective Max Pooling for Measuring Similarity

Authors: Xiang Xiang, Trac D. Tran

Abstract: In this paper, we deal with two challenges for measuring the similarity of the subject identities in practical video-based face recognition - the variation of the head pose in uncontrolled environments and the computational expense of processing videos. Since the frame-wise feature mean is unable to characterize the pose diversity among frames, we define and preserve the overall pose diversity and… ▽ More In this paper, we deal with two challenges for measuring the similarity of the subject identities in practical video-based face recognition - the variation of the head pose in uncontrolled environments and the computational expense of processing videos. Since the frame-wise feature mean is unable to characterize the pose diversity among frames, we define and preserve the overall pose diversity and closeness in a video. Then, identity will be the only source of variation across videos since the pose varies even within a single video. Instead of simply using all the frames, we select those faces whose pose point is closest to the centroid of the K-means cluster containing that pose point. Then, we represent a video as a bag of frame-wise deep face features while the number of features has been reduced from hundreds to K. Since the video representation can well represent the identity, now we measure the subject similarity between two videos as the max correlation among all possible pairs in the two bags of features. On the official 5,000 video-pairs of the YouTube Face dataset for face verification, our algorithm achieves a comparable performance with VGG-face that averages over deep features of all frames. Other vision tasks can also benefit from the generic idea of employing geometric cues to improve the descriptiveness of deep features. △ Less

Submitted 13 November, 2016; v1 submitted 22 September, 2016; originally announced September 2016.

Comments: The tutorial and program associated with this paper are available at https://github.com/eglxiang/ytf yet for non-commercial use

Ergodicity of scalar stochastic differential equations with Hölder continuous coefficients

Authors: Duc Hoang Luu, Tat Dat Tran, Jürgen Jost

Abstract: It is well-known that for a one dimensional stochastic differential equation driven by Brownian noise, with coefficient functions satisfying the assumptions of the Yamada-Watanabe theorem \cite{yamada1,yamada2} and the Feller test for explosions \cite{feller51,feller54}, there exists a unique stationary distribution with respect to the Markov semigroup of transition probabilities. We consider syst… ▽ More It is well-known that for a one dimensional stochastic differential equation driven by Brownian noise, with coefficient functions satisfying the assumptions of the Yamada-Watanabe theorem \cite{yamada1,yamada2} and the Feller test for explosions \cite{feller51,feller54}, there exists a unique stationary distribution with respect to the Markov semigroup of transition probabilities. We consider systems on a restricted domain $D$ of the phase space $\mathbb{R}$ and study the rate of convergence to the stationary distribution. Using a geometrical approach that uses the so called {\it free energy function} on the density function space, we prove that the density functions, which are solutions of the Fokker-Planck equation, converge to the stationary density function exponentially under the Kullback-Leibler {divergence}, thus also in the total variation norm. The results show that there is a relation between the Bakry-Emery curvature dimension condition and the dissipativity condition of the transformed system under the Fisher-Lamperti transformation. Several applications are discussed, including the Cox-Ingersoll-Ross model and the Ait-Sahalia model in finance and the Wright-Fisher model in population genetics. △ Less

Submitted 24 August, 2016; originally announced August 2016.

Non-Central Limit Theorem for Quadratic Functionals of Hermite-Driven Long Memory Moving Average Processes

Authors: T. T. Diu Tran

Abstract: Let $(Z_t^{(q, H)})_{t \geq 0}$ denote a Hermite process of order $q \geq 1$ and self-similarity parameter $H \in (\frac{1}{2}, 1)$. Consider the Hermite-driven moving average process $$X_t^{(q, H)} = \int_0^t x(t-u) dZ^{(q, H)}(u), \qquad t \geq 0.$$ In the special case of $x(u) = e^{-θu}, θ> 0$, $X$ is the non-stationary Hermite Ornstein-Uhlenbeck process of order $q$. Under suitable integrabili… ▽ More Let $(Z_t^{(q, H)})_{t \geq 0}$ denote a Hermite process of order $q \geq 1$ and self-similarity parameter $H \in (\frac{1}{2}, 1)$. Consider the Hermite-driven moving average process $$X_t^{(q, H)} = \int_0^t x(t-u) dZ^{(q, H)}(u), \qquad t \geq 0.$$ In the special case of $x(u) = e^{-θu}, θ> 0$, $X$ is the non-stationary Hermite Ornstein-Uhlenbeck process of order $q$. Under suitable integrability conditions on the kernel $x$, we prove that as $T \to \infty$, the normalized quadratic functional $$G_T^{(q, H)}(t)=\frac{1}{T^{2H_0 - 1}}\int_0^{Tt}\Big(\big(X_s^{(q, H)}\big)^2 - E\Big[\big(X_s^{(q, H)}\big)^2\Big]\Big) ds , \qquad t \geq 0,$$ where $H_0 = 1 + (H-1)/q$, converges in the sense of finite-dimensional distribution to the Rosenblatt process of parameter $H' = 1 + (2H-2)/q$, up to a multiplicative constant, irrespective of self-similarity parameter whenever $q \geq 2$. In the Gaussian case $(q=1)$, our result complements the study started by Nourdin \textit{et al} in arXiv:1502.03369, where either central or non-central limit theorems may arise depending on the value of self-similarity parameter. A crucial key in our analysis is an extension of the connection between the classical multiple Wiener-Itô integral and the one with respect to a random spectral measure (initiated by Taqqu (1979)), which may be independent of interest. △ Less

Submitted 18 May, 2017; v1 submitted 27 July, 2016; originally announced July 2016.

Comments: Accepted for publication in Stoch. Dyn

MSC Class: 60F05; 60G22; 60H05; 60H07

Sparse Signal Recovery using Generalized Approximate Message Passing with Built-in Parameter Estimation

Authors: Shuai Huang, Trac D. Tran

Abstract: The generalized approximate message passing (GAMP) algorithm under the Bayesian setting shows advantage in recovering under-sampled sparse signals from corrupted observations. Compared to conventional convex optimization methods, it has a much lower complexity and is computationally tractable. In the GAMP framework, the sparse signal and the observation are viewed to be generated according to some… ▽ More The generalized approximate message passing (GAMP) algorithm under the Bayesian setting shows advantage in recovering under-sampled sparse signals from corrupted observations. Compared to conventional convex optimization methods, it has a much lower complexity and is computationally tractable. In the GAMP framework, the sparse signal and the observation are viewed to be generated according to some pre-specified probability distributions in the input and output channels. However, the parameters of the distributions are usually unknown in practice. In this paper, we propose an extended GAMP algorithm with built-in parameter estimation (PE-GAMP) and present its empirical convergence analysis. PE-GAMP treats the parameters as unknown random variables with simple priors and jointly estimates them with the sparse signals. Compared with Expectation Maximization (EM) based parameter estimation methods, the proposed PE-GAMP could draw information from the prior distributions of the parameters to perform parameter estimation. It is also more robust and much simpler, which enables us to consider more complex signal distributions apart from the usual Bernoulli-Gaussian (BGm) mixture distribution. Specifically, the formulations of Bernoulli-Exponential mixture (BEm) distribution and Laplace distribution are given in this paper. Simulated noiseless sparse signal recovery experiments demonstrate that the performance of the proposed PE-GAMP matches the oracle GAMP algorithm. When noise is present, both the simulated experiments and the real image recovery experiments show that PE-GAMP is still able to maintain its robustness and outperform EM based parameter estimation method when the sampling ratio is small. Additionally, using the BEm formulation of the PE-GAMP, we can successfully perform non-negative sparse coding of local image patches and provide useful features for the image classification task. △ Less

Submitted 11 January, 2017; v1 submitted 2 June, 2016; originally announced June 2016.

Detecting Burnscar from Hyperspectral Imagery via Sparse Representation with Low-Rank Interference

Authors: Minh Dao, Xiang Xiang, Bulent Ayhan, Chiman Kwan, Trac D. Tran

Abstract: In this paper, we propose a burnscar detection model for hyperspectral imaging (HSI) data. The proposed model contains two-processing steps in which the first step separate and then suppress the cloud information presenting in the data set using an RPCA algorithm and the second step detect the burnscar area in the low-rank component output of the first step. Experiments are conducted on the public… ▽ More In this paper, we propose a burnscar detection model for hyperspectral imaging (HSI) data. The proposed model contains two-processing steps in which the first step separate and then suppress the cloud information presenting in the data set using an RPCA algorithm and the second step detect the burnscar area in the low-rank component output of the first step. Experiments are conducted on the public MODIS dataset available at NASA official website. △ Less

Submitted 17 May, 2016; v1 submitted 1 May, 2016; originally announced May 2016.

Comments: It is not a publishable version at this point as there is no IP coverage at the moment

Sparse Coding with Fast Image Alignment via Large Displacement Optical Flow

Authors: Xiaoxia Sun, Nasser M. Nasrabadi, Trac D. Tran

Abstract: Sparse representation-based classifiers have shown outstanding accuracy and robustness in image classification tasks even with the presence of intense noise and occlusion. However, it has been discovered that the performance degrades significantly either when test image is not aligned with the dictionary atoms or the dictionary atoms themselves are not aligned with each other, in which cases the s… ▽ More Sparse representation-based classifiers have shown outstanding accuracy and robustness in image classification tasks even with the presence of intense noise and occlusion. However, it has been discovered that the performance degrades significantly either when test image is not aligned with the dictionary atoms or the dictionary atoms themselves are not aligned with each other, in which cases the sparse linear representation assumption fails. In this paper, having both training and test images misaligned, we introduce a novel sparse coding framework that is able to efficiently adapt the dictionary atoms to the test image via large displacement optical flow. In the proposed algorithm, every dictionary atom is automatically aligned with the input image and the sparse code is then recovered using the adapted dictionary atoms. A corresponding supervised dictionary learning algorithm is also developed for the proposed framework. Experimental results on digit datasets recognition verify the efficacy and robustness of the proposed algorithm. △ Less

Submitted 21 December, 2015; originally announced December 2015.

Comments: ICASSP 2016

ICR: Iterative Convex Refinement for Sparse Signal Recovery Using Spike and Slab Priors

Authors: Hojjat S. Mousavi, Vishal Monga, Trac D. Tran

Abstract: In this letter, we address sparse signal recovery using spike and slab priors. In particular, we focus on a Bayesian framework where sparsity is enforced on reconstruction coefficients via probabilistic priors. The optimization resulting from spike and slab prior maximization is known to be a hard non-convex problem, and existing solutions involve simplifying assumptions and/or relaxations. We pro… ▽ More In this letter, we address sparse signal recovery using spike and slab priors. In particular, we focus on a Bayesian framework where sparsity is enforced on reconstruction coefficients via probabilistic priors. The optimization resulting from spike and slab prior maximization is known to be a hard non-convex problem, and existing solutions involve simplifying assumptions and/or relaxations. We propose an approach called Iterative Convex Refinement (ICR) that aims to solve the aforementioned optimization problem directly allowing for greater generality in the sparse structure. Essentially, ICR solves a sequence of convex optimization problems such that sequence of solutions converges to a sub-optimal solution of the original hard optimization problem. We propose two versions of our algorithm: a.) an unconstrained version, and b.) with a non-negativity constraint on sparse coefficients, which may be required in some real-world problems. Experimental validation is performed on both synthetic data and for a real-world image recovery problem, which illustrates merits of ICR over state of the art alternatives. △ Less

Submitted 16 February, 2015; originally announced February 2015.

Comments: Submitted to IEEE Signal Processing Letters, Feb 2015

Task-Driven Dictionary Learning for Hyperspectral Image Classification with Structured Sparsity Constraints

Authors: Xiaoxia Sun, Nasser M. Nasrabadi, Trac D. Tran

Abstract: Sparse representation models a signal as a linear combination of a small number of dictionary atoms. As a generative model, it requires the dictionary to be highly redundant in order to ensure both a stable high sparsity level and a low reconstruction error for the signal. However, in practice, this requirement is usually impaired by the lack of labelled training samples. Fortunately, previous res… ▽ More Sparse representation models a signal as a linear combination of a small number of dictionary atoms. As a generative model, it requires the dictionary to be highly redundant in order to ensure both a stable high sparsity level and a low reconstruction error for the signal. However, in practice, this requirement is usually impaired by the lack of labelled training samples. Fortunately, previous research has shown that the requirement for a redundant dictionary can be less rigorous if simultaneous sparse approximation is employed, which can be carried out by enforcing various structured sparsity constraints on the sparse codes of the neighboring pixels. In addition, numerous works have shown that applying a variety of dictionary learning methods for the sparse representation model can also improve the classification performance. In this paper, we highlight the task-driven dictionary learning algorithm, which is a general framework for the supervised dictionary learning method. We propose to enforce structured sparsity priors on the task-driven dictionary learning method in order to improve the performance of the hyperspectral classification. Our approach is able to benefit from both the advantages of the simultaneous sparse representation and those of the supervised dictionary learning. We enforce two different structured sparsity priors, the joint and Laplacian sparsity, on the task-driven dictionary learning method and provide the details of the corresponding optimization algorithms. Experiments on numerous popular hyperspectral images demonstrate that the classification performance of our approach is superior to sparse representation classifier with structured priors or the task-driven dictionary learning method. △ Less

Submitted 3 February, 2015; originally announced February 2015.