Showing 1–30 of 30 results for author: Nguyen, C V

Transfer Learning in ECG Diagnosis: Is It Effective?

Authors: Cuong V. Nguyen, Cuong D. Do

Abstract: The adoption of deep learning in ECG diagnosis is often hindered by the scarcity of large, well-labeled datasets in real-world scenarios, leading to the use of transfer learning to leverage features learned from larger datasets. Yet the prevailing assumption that transfer learning consistently outperforms training from scratch has never been systematically validated. In this study, we conduct the… ▽ More The adoption of deep learning in ECG diagnosis is often hindered by the scarcity of large, well-labeled datasets in real-world scenarios, leading to the use of transfer learning to leverage features learned from larger datasets. Yet the prevailing assumption that transfer learning consistently outperforms training from scratch has never been systematically validated. In this study, we conduct the first extensive empirical study on the effectiveness of transfer learning in multi-label ECG classification, by investigating comparing the fine-tuning performance with that of training from scratch, covering a variety of ECG datasets and deep neural networks. We confirm that fine-tuning is the preferable choice for small downstream datasets; however, when the dataset is sufficiently large, training from scratch can achieve comparable performance, albeit requiring a longer training time to catch up. Furthermore, we find that transfer learning exhibits better compatibility with convolutional neural networks than with recurrent neural networks, which are the two most prevalent architectures for time-series ECG applications. Our results underscore the importance of transfer learning in ECG diagnosis, yet depending on the amount of available data, researchers may opt not to use it, considering the non-negligible cost associated with pre-training. △ Less

Submitted 26 June, 2024; v1 submitted 2 February, 2024; originally announced February 2024.

Explainable Severity ranking via pairwise n-hidden comparison: a case study of glaucoma

Authors: Hong Nguyen, Cuong V. Nguyen, Shrikanth Narayanan, Benjamin Y. Xu, Michael Pazzani

Abstract: Primary open-angle glaucoma (POAG) is a chronic and progressive optic nerve condition that results in an acquired loss of optic nerve fibers and potential blindness. The gradual onset of glaucoma results in patients progressively losing their vision without being consciously aware of the changes. To diagnose POAG and determine its severity, patients must undergo a comprehensive dilated eye examina… ▽ More Primary open-angle glaucoma (POAG) is a chronic and progressive optic nerve condition that results in an acquired loss of optic nerve fibers and potential blindness. The gradual onset of glaucoma results in patients progressively losing their vision without being consciously aware of the changes. To diagnose POAG and determine its severity, patients must undergo a comprehensive dilated eye examination. In this work, we build a framework to rank, compare, and interpret the severity of glaucoma using fundus images. We introduce a siamese-based severity ranking using pairwise n-hidden comparisons. We additionally have a novel approach to explaining why a specific image is deemed more severe than others. Our findings indicate that the proposed severity ranking model surpasses traditional ones in terms of diagnostic accuracy and delivers improved saliency explanations. △ Less

Submitted 5 December, 2023; originally announced December 2023.

Comments: 4 pages

Simple Transferability Estimation for Regression Tasks

Authors: Cuong N. Nguyen, Phong Tran, Lam Si Tung Ho, Vu Dinh, Anh T. Tran, Tal Hassner, Cuong V. Nguyen

Abstract: We consider transferability estimation, the problem of estimating how well deep learning models transfer from a source to a target task. We focus on regression tasks, which received little previous attention, and propose two simple and computationally efficient approaches that estimate transferability based on the negative regularized mean squared error of a linear regression model. We prove novel… ▽ More We consider transferability estimation, the problem of estimating how well deep learning models transfer from a source to a target task. We focus on regression tasks, which received little previous attention, and propose two simple and computationally efficient approaches that estimate transferability based on the negative regularized mean squared error of a linear regression model. We prove novel theoretical results connecting our approaches to the actual transferability of the optimal target models obtained from the transfer learning process. Despite their simplicity, our approaches significantly outperform existing state-of-the-art regression transferability estimators in both accuracy and efficiency. On two large-scale keypoint regression benchmarks, our approaches yield 12% to 36% better results on average while being at least 27% faster than previous state-of-the-art methods. △ Less

Submitted 3 December, 2023; v1 submitted 1 December, 2023; originally announced December 2023.

Comments: Paper published at The 39th Conference on Uncertainty in Artificial Intelligence (UAI) 2023

MELEP: A Novel Predictive Measure of Transferability in Multi-Label ECG Diagnosis

Authors: Cuong V. Nguyen, Hieu Minh Duong, Cuong D. Do

Abstract: In practical electrocardiography (ECG) interpretation, the scarcity of well-annotated data is a common challenge. Transfer learning techniques are valuable in such situations, yet the assessment of transferability has received limited attention. To tackle this issue, we introduce MELEP, which stands for Muti-label Expected Log of Empirical Predictions, a measure designed to estimate the effectiven… ▽ More In practical electrocardiography (ECG) interpretation, the scarcity of well-annotated data is a common challenge. Transfer learning techniques are valuable in such situations, yet the assessment of transferability has received limited attention. To tackle this issue, we introduce MELEP, which stands for Muti-label Expected Log of Empirical Predictions, a measure designed to estimate the effectiveness of knowledge transfer from a pre-trained model to a downstream multi-label ECG diagnosis task. MELEP is generic, working with new target data with different label sets, and computationally efficient, requiring only a single forward pass through the pre-trained model. To the best of our knowledge, MELEP is the first transferability metric specifically designed for multi-label ECG classification problems. Our experiments show that MELEP can predict the performance of pre-trained convolutional and recurrent deep neural networks, on small and imbalanced ECG data. Specifically, we observed strong correlation coefficients (with absolute values exceeding 0.6 in most cases) between MELEP and the actual average F1 scores of the fine-tuned models. Our work highlights the potential of MELEP to expedite the selection of suitable pre-trained models for ECG diagnosis tasks, saving time and effort that would otherwise be spent on fine-tuning these models. △ Less

Submitted 12 June, 2024; v1 submitted 27 October, 2023; originally announced November 2023.

Comments: Accepted to the Journal of Healthcare Informatics Research

Hate Speech Detection in Limited Data Contexts using Synthetic Data Generation

Authors: Aman Khullar, Daniel Nkemelu, Cuong V. Nguyen, Michael L. Best

Abstract: A growing body of work has focused on text classification methods for detecting the increasing amount of hate speech posted online. This progress has been limited to only a select number of highly-resourced languages causing detection systems to either under-perform or not exist in limited data contexts. This is majorly caused by a lack of training data which is expensive to collect and curate in… ▽ More A growing body of work has focused on text classification methods for detecting the increasing amount of hate speech posted online. This progress has been limited to only a select number of highly-resourced languages causing detection systems to either under-perform or not exist in limited data contexts. This is majorly caused by a lack of training data which is expensive to collect and curate in these settings. In this work, we propose a data augmentation approach that addresses the problem of lack of data for online hate speech detection in limited data contexts using synthetic data generation techniques. Given a handful of hate speech examples in a high-resource language such as English, we present three methods to synthesize new examples of hate speech data in a target language that retains the hate sentiment in the original examples but transfers the hate targets. We apply our approach to generate training data for hate speech classification tasks in Hindi and Vietnamese. Our findings show that a model trained on synthetic data performs comparably to, and in some cases outperforms, a model trained only on the samples available in the target domain. This method can be adopted to bootstrap hate speech detection models from scratch in limited data contexts. As the growth of social media within these contexts continues to outstrip response efforts, this work furthers our capacities for detection, understanding, and response to hate speech. △ Less

Submitted 4 October, 2023; originally announced October 2023.

Comments: Accepted at ACM Journal on Computing and Sustainable Societies

EnSolver: Uncertainty-Aware Ensemble CAPTCHA Solvers with Theoretical Guarantees

Authors: Duc C. Hoang, Behzad Ousat, Amin Kharraz, Cuong V. Nguyen

Abstract: The popularity of text-based CAPTCHA as a security mechanism to protect websites from automated bots has prompted researches in CAPTCHA solvers, with the aim of understanding its failure cases and subsequently making CAPTCHAs more secure. Recently proposed solvers, built on advances in deep learning, are able to crack even the very challenging CAPTCHAs with high accuracy. However, these solvers of… ▽ More The popularity of text-based CAPTCHA as a security mechanism to protect websites from automated bots has prompted researches in CAPTCHA solvers, with the aim of understanding its failure cases and subsequently making CAPTCHAs more secure. Recently proposed solvers, built on advances in deep learning, are able to crack even the very challenging CAPTCHAs with high accuracy. However, these solvers often perform poorly on out-of-distribution samples that contain visual features different from those in the training set. Furthermore, they lack the ability to detect and avoid such samples, making them susceptible to being locked out by defense systems after a certain number of failed attempts. In this paper, we propose EnSolver, a family of CAPTCHA solvers that use deep ensemble uncertainty to detect and skip out-of-distribution CAPTCHAs, making it harder to be detected. We prove novel theoretical bounds on the effectiveness of our solvers and demonstrate their use with state-of-the-art CAPTCHA solvers. Our experiments show that the proposed approaches perform well when cracking CAPTCHA datasets that contain both in-distribution and out-of-distribution samples. △ Less

Submitted 28 June, 2024; v1 submitted 27 July, 2023; originally announced July 2023.

Comments: A previous version of this paper was presented at the Epistemic Uncertainty - E-pi UAI 2023 Workshop

Learning for Amalgamation: A Multi-Source Transfer Learning Framework For Sentiment Classification

Authors: Cuong V. Nguyen, Khiem H. Le, Anh M. Tran, Quang H. Pham, Binh T. Nguyen

Abstract: Transfer learning plays an essential role in Deep Learning, which can remarkably improve the performance of the target domain, whose training data is not sufficient. Our work explores beyond the common practice of transfer learning with a single pre-trained model. We focus on the task of Vietnamese sentiment classification and propose LIFA, a framework to learn a unified embedding from several pre… ▽ More Transfer learning plays an essential role in Deep Learning, which can remarkably improve the performance of the target domain, whose training data is not sufficient. Our work explores beyond the common practice of transfer learning with a single pre-trained model. We focus on the task of Vietnamese sentiment classification and propose LIFA, a framework to learn a unified embedding from several pre-trained models. We further propose two more LIFA variants that encourage the pre-trained models to either cooperate or compete with one another. Studying these variants sheds light on the success of LIFA by showing that sharing knowledge among the models is more beneficial for transfer learning. Moreover, we construct the AISIA-VN-Review-F dataset, the first large-scale Vietnamese sentiment classification database. We conduct extensive experiments on the AISIA-VN-Review-F and existing benchmarks to demonstrate the efficacy of LIFA compared to other techniques. To contribute to the Vietnamese NLP research, we publish our source code and datasets to the research community upon acceptance. △ Less

Submitted 16 March, 2023; originally announced March 2023.

Comments: Information Sciences

Simple photochemical modelling of NOX pollution in a street canyon

Authors: Lionel Soulhac, Sofia Fellini, Chi Vuong Nguyen, Pietro Salizzoni

Abstract: To predict pollutant concentration in urban areas, it is crucial to take into account the chemical transformations of reactive pollutants in operational dispersion models. In this work, we derive and discuss different NO-NO2-O3 chemical street canyon models with increasing complexity and we analytically evaluate their applicability in different urban contexts. We then evaluate the performance of t… ▽ More To predict pollutant concentration in urban areas, it is crucial to take into account the chemical transformations of reactive pollutants in operational dispersion models. In this work, we derive and discuss different NO-NO2-O3 chemical street canyon models with increasing complexity and we analytically evaluate their applicability in different urban contexts. We then evaluate the performance of the models in predicting NO2 concentration at different locations within an urban district by comparing their predictions with measurements acquired in a field campaign. The results are in line with analytical speculations and give indications as to which model to use according to the conditions of the urban street canyon. In courtyards with limited ventilation and without direct emissions, the performance of the photostationary model is satisfactory. On the other hand, the application of a non-photostationary model significantly improves the predictions in urban canyons with direct vehicular emissions. The applicability of the proposed models in operational tools at the city scale is finally discussed. △ Less

Submitted 21 October, 2022; originally announced October 2022.

Generalization Bounds for Deep Transfer Learning Using Majority Predictor Accuracy

Authors: Cuong N. Nguyen, Lam Si Tung Ho, Vu Dinh, Tal Hassner, Cuong V. Nguyen

Abstract: We analyze new generalization bounds for deep learning models trained by transfer learning from a source to a target task. Our bounds utilize a quantity called the majority predictor accuracy, which can be computed efficiently from data. We show that our theory is useful in practice since it implies that the majority predictor accuracy can be used as a transferability measure, a fact that is also… ▽ More We analyze new generalization bounds for deep learning models trained by transfer learning from a source to a target task. Our bounds utilize a quantity called the majority predictor accuracy, which can be computed efficiently from data. We show that our theory is useful in practice since it implies that the majority predictor accuracy can be used as a transferability measure, a fact that is also validated by our experiments. △ Less

Submitted 12 September, 2022; originally announced September 2022.

Comments: 5 pages, Paper published at the International Symposium on Information Theory and Its Applications (ISITA 2022)

Cataloguing MoSi$_2$N$_4$ and WSi$_2$N$_4$ van der Waals Heterostructures: An Exceptional Material Platform for Excitonic Solar Cell Applications

Authors: Che Chen Tho, Chenjiang Yu, Qin Tang, Qianqian Wang, Tong Su, Zhuoer Feng, Qingyun Wu, C. V. Nguyen, Wee-Liat Ong, Shi-Jun Liang, San-Dong Guo, Liemao Cao, Shengli Zhang, Shengyuan A. Yang, Lay Kee Ang, Guangzhao Wang, Yee Sin Ang

Abstract: Two-dimensional (2D) materials van der Waals heterostructures (vdWHs) provides a revolutionary route towards high-performance solar energy conversion devices beyond the conventional silicon-based pn junction solar cells. Despite tremendous research progress accomplished in recent years, the searches of vdWHs with exceptional excitonic solar cell conversion efficiency and optical properties remain… ▽ More Two-dimensional (2D) materials van der Waals heterostructures (vdWHs) provides a revolutionary route towards high-performance solar energy conversion devices beyond the conventional silicon-based pn junction solar cells. Despite tremendous research progress accomplished in recent years, the searches of vdWHs with exceptional excitonic solar cell conversion efficiency and optical properties remain an open theoretical and experimental quest. Here we show that the vdWH family composed of MoSi$_2$N$_4$ and WSi$_2$N$_4$ monolayers provides a compelling material platform for develo** high-performance ultrathin excitonic solar cells and photonics devices. Using first-principle calculations, we construct and classify 51 types of MoSi$_2$N$_4$ and WSi$_2$N$_4$-based [(Mo,W)Si$_2$N$_4$] vdWHs composed of various metallic, semimetallic, semiconducting, insulating and topological 2D materials. Intriguingly, MoSi$_2$N$_4$/(InSe, WSe$_2$) are identified as Type-II vdWHs with exceptional excitonic solar cell power conversion efficiency reaching well over 20%, which are competitive to state-of-art silicon solar cells. The (Mo,W)Si$_2$N$_4$ vdWH family exhibits strong optical absorption in both the visible and ultraviolet regimes. Exceedingly large peak ultraviolet absorptions over 40%, approaching the maximum absorption limit of a free-standing 2D material, can be achieved in (Mo,W)Si$_2$N$_4$/$α_2$-(Mo,W)Ge$_2$P$_4$ vdWHs. Our findings unravel the enormous potential of (Mo,W)Si$_2$N$_4$ vdWHs in designing ultimately compact excitonic solar cell device technology. △ Less

Submitted 4 July, 2022; v1 submitted 23 June, 2022; originally announced June 2022.

Comments: 30 pages, 7 figures

Multiferroic van der Waals heterostructure FeCl$_2$/Sc$_2$CO$_2$: Nonvolatile electrically switchable electronic and spintronic properties

Authors: Liemao Cao, Xiaohui Deng, Guanghui Zhou, Shi-Jun Liang, Chuong V. Nguyen, L. K. Ang, Yee Sin Ang

Abstract: Multiferroic van der Waals (vdW) heterostrucutres offers an exciting route towards novel nanoelectronics and spintronics device technology. Here we investigate the electronic and transport properties of multiferroic vdW heterostructure composed of ferromagnetic FeCl$_2$ monolayer and ferroelectric Sc$_2$CO$_2$ monolayer using first-principles density functional theory and quantum transport simulat… ▽ More Multiferroic van der Waals (vdW) heterostrucutres offers an exciting route towards novel nanoelectronics and spintronics device technology. Here we investigate the electronic and transport properties of multiferroic vdW heterostructure composed of ferromagnetic FeCl$_2$ monolayer and ferroelectric Sc$_2$CO$_2$ monolayer using first-principles density functional theory and quantum transport simulations. We show that FeCl$_2$/Sc$_2$CO$_2$ heterostructure can be reversibly switched from semiconducting to half-metallic behavior by electrically modulating the ferroelectric polarization states of Sc$_2$CO$_2$. Intriguingly, the half-metallic phase exhibits a Type-III broken gap band alignment, which can be beneficial for tunnelling field-effect transistor application. We perform a quantum transport simulation, based on a \emph{proof-of-concept} two-terminal nanodevice, to demonstrate all-electric-controlled valving effects uniquely enabled by the nonvolatile ferroelectric switching of the heterostructure. These findings unravels the potential of FeCl$_2$/Sc$_2$CO$_2$ vdW heterostructures as a building block for designing a next generation of ultimately compact information processing, data storage and spintronics devices. △ Less

Submitted 29 March, 2022; originally announced March 2022.

Comments: 9 pages, 5 figures, accepted for publication in Physical Review B (2022)

Partitioned Variational Inference: A Framework for Probabilistic Federated Learning

Authors: Matthew Ashman, Thang D. Bui, Cuong V. Nguyen, Stratis Markou, Adrian Weller, Siddharth Swaroop, Richard E. Turner

Abstract: The proliferation of computing devices has brought about an opportunity to deploy machine learning models on new problem domains using previously inaccessible data. Traditional algorithms for training such models often require data to be stored on a single machine with compute performed by a single node, making them unsuitable for decentralised training on multiple devices. This deficiency has mot… ▽ More The proliferation of computing devices has brought about an opportunity to deploy machine learning models on new problem domains using previously inaccessible data. Traditional algorithms for training such models often require data to be stored on a single machine with compute performed by a single node, making them unsuitable for decentralised training on multiple devices. This deficiency has motivated the development of federated learning algorithms, which allow multiple data owners to train collaboratively and use a shared model whilst kee** local data private. However, many of these algorithms focus on obtaining point estimates of model parameters, rather than probabilistic estimates capable of capturing model uncertainty, which is essential in many applications. Variational inference (VI) has become the method of choice for fitting many modern probabilistic models. In this paper we introduce partitioned variational inference (PVI), a general framework for performing VI in the federated setting. We develop new supporting theory for PVI, demonstrating a number of properties that make it an attractive choice for practitioners; use PVI to unify a wealth of fragmented, yet related literature; and provide empirical results that showcase the effectiveness of PVI in a variety of federated settings. △ Less

Submitted 28 April, 2022; v1 submitted 24 February, 2022; originally announced February 2022.

Comments: arXiv admin note: substantial text overlap with arXiv:1811.11206

An Empirical Study on GANs with Margin Cosine Loss and Relativistic Discriminator

Authors: Cuong V. Nguyen, Tien-Dung Cao, Tram Truong-Huu, Khanh N. Pham, Binh T. Nguyen

Abstract: Generative Adversarial Networks (GANs) have emerged as useful generative models, which are capable of implicitly learning data distributions of arbitrarily complex dimensions. However, the training of GANs is empirically well-known for being highly unstable and sensitive. The loss functions of both the discriminator and generator concerning their parameters tend to oscillate wildly during training… ▽ More Generative Adversarial Networks (GANs) have emerged as useful generative models, which are capable of implicitly learning data distributions of arbitrarily complex dimensions. However, the training of GANs is empirically well-known for being highly unstable and sensitive. The loss functions of both the discriminator and generator concerning their parameters tend to oscillate wildly during training. Different loss functions have been proposed to stabilize the training and improve the quality of images generated. In this paper, we perform an empirical study on the impact of several loss functions on the performance of standard GAN models, Deep Convolutional Generative Adversarial Networks (DCGANs). We introduce a new improvement that employs a relativistic discriminator to replace the classical deterministic discriminator in DCGANs and implement a margin cosine loss function for both the generator and discriminator. This results in a novel loss function, namely Relativistic Margin Cosine Loss (RMCosGAN). We carry out extensive experiments with four datasets: CIFAR-$10$, MNIST, STL-$10$, and CAT. We compare RMCosGAN performance with existing loss functions based on two metrics: Frechet inception distance and inception score. The experimental results show that RMCosGAN outperforms the existing ones and significantly improves the quality of images generated. △ Less

Submitted 21 October, 2021; v1 submitted 21 October, 2021; originally announced October 2021.

Comments: 16 pages, 5 figures

LEEP: A New Measure to Evaluate Transferability of Learned Representations

Authors: Cuong V. Nguyen, Tal Hassner, Matthias Seeger, Cedric Archambeau

Abstract: We introduce a new measure to evaluate the transferability of representations learned by classifiers. Our measure, the Log Expected Empirical Prediction (LEEP), is simple and easy to compute: when given a classifier trained on a source data set, it only requires running the target data set through this classifier once. We analyze the properties of LEEP theoretically and demonstrate its effectivene… ▽ More We introduce a new measure to evaluate the transferability of representations learned by classifiers. Our measure, the Log Expected Empirical Prediction (LEEP), is simple and easy to compute: when given a classifier trained on a source data set, it only requires running the target data set through this classifier once. We analyze the properties of LEEP theoretically and demonstrate its effectiveness empirically. Our analysis shows that LEEP can predict the performance and convergence speed of both transfer and meta-transfer learning methods, even for small or imbalanced data. Moreover, LEEP outperforms recently proposed transferability measures such as negative conditional entropy and H scores. Notably, when transferring from ImageNet to CIFAR100, LEEP can achieve up to 30% improvement compared to the best competing method in terms of the correlations with actual transfer accuracy. △ Less

Submitted 13 August, 2020; v1 submitted 27 February, 2020; originally announced February 2020.

Comments: Published at the International Conference on Machine Learning (ICML) 2020

Deep Learning for The Inverse Design of Mid-infrared Graphene Plasmons

Authors: Anh D. Phan, Cuong V. Nguyen, Pham T. Linh, Tran V. Huynh, Vu D. Lam, Anh-Tuan Le

Abstract: We theoretically investigate the plasmonic properties of mid-infrared graphene-based metamaterials and apply deep learning of a neural network for the inverse design. These artificial structures have square periodic arrays of graphene plasmonic resonators deposited on dielectric thin films. Optical spectra vary significantly with changes in structural parameters. Our numerical results are in accor… ▽ More We theoretically investigate the plasmonic properties of mid-infrared graphene-based metamaterials and apply deep learning of a neural network for the inverse design. These artificial structures have square periodic arrays of graphene plasmonic resonators deposited on dielectric thin films. Optical spectra vary significantly with changes in structural parameters. Our numerical results are in accordance with previous experiments. Then, the theoretical approach is employed to generate data for training and testing deep neural networks. By merging the pre-trained neural network with the inverse network, we implement calculations for inverse design of the graphene-based metameterials. We also discuss the limitation of the data-driven approach. △ Less

Submitted 19 February, 2020; v1 submitted 28 November, 2019; originally announced November 2019.

Comments: 6 pages, 4 figures, accepted for publication on Crystals

Transferability and Hardness of Supervised Classification Tasks

Authors: Anh T. Tran, Cuong V. Nguyen, Tal Hassner

Abstract: We propose a novel approach for estimating the difficulty and transferability of supervised classification tasks. Unlike previous work, our approach is solution agnostic and does not require or assume trained models. Instead, we estimate these values using an information theoretic approach: treating training labels as random variables and exploring their statistics. When transferring from a source… ▽ More We propose a novel approach for estimating the difficulty and transferability of supervised classification tasks. Unlike previous work, our approach is solution agnostic and does not require or assume trained models. Instead, we estimate these values using an information theoretic approach: treating training labels as random variables and exploring their statistics. When transferring from a source to a target task, we consider the conditional entropy between two such variables (i.e., label assignments of the two tasks). We show analytically and empirically that this value is related to the loss of the transferred model. We further show how to use this value to estimate task hardness. We test our claims extensively on three large scale data sets -- CelebA (40 tasks), Animals with Attributes 2 (85 tasks), and Caltech-UCSD Birds 200 (312 tasks) -- together representing 437 classification tasks. We provide results showing that our hardness and transferability estimates are strongly correlated with empirical hardness and transferability. As a case study, we transfer a learned face recognition model to CelebA attribute classification tasks, showing state of the art accuracy for tasks estimated to be highly transferable. △ Less

Submitted 21 August, 2019; originally announced August 2019.

Comments: This paper is published at the International Conference on Computer Vision (ICCV) 2019

Toward Understanding Catastrophic Forgetting in Continual Learning

Authors: Cuong V. Nguyen, Alessandro Achille, Michael Lam, Tal Hassner, Vijay Mahadevan, Stefano Soatto

Abstract: We study the relationship between catastrophic forgetting and properties of task sequences. In particular, given a sequence of tasks, we would like to understand which properties of this sequence influence the error rates of continual learning algorithms trained on the sequence. To this end, we propose a new procedure that makes use of recent developments in task space modeling as well as correlat… ▽ More We study the relationship between catastrophic forgetting and properties of task sequences. In particular, given a sequence of tasks, we would like to understand which properties of this sequence influence the error rates of continual learning algorithms trained on the sequence. To this end, we propose a new procedure that makes use of recent developments in task space modeling as well as correlation analysis to specify and analyze the properties we are interested in. As an application, we apply our procedure to study two properties of a task sequence: (1) total complexity and (2) sequential heterogeneity. We show that error rates are strongly and positively correlated to a task sequence's total complexity for some state-of-the-art algorithms. We also show that, surprisingly, the error rates have no or even negative correlations in some cases to sequential heterogeneity. Our findings suggest directions for improving continual learning benchmarks and methods. △ Less

Submitted 2 August, 2019; originally announced August 2019.

Bayesian Active Learning With Abstention Feedbacks

Authors: Cuong V. Nguyen, Lam Si Tung Ho, Huan Xu, Vu Dinh, Binh Nguyen

Abstract: We study pool-based active learning with abstention feedbacks where a labeler can abstain from labeling a queried example with some unknown abstention rate. This is an important problem with many useful applications. We take a Bayesian approach to the problem and develop two new greedy algorithms that learn both the classification problem and the unknown abstention rate at the same time. These are… ▽ More We study pool-based active learning with abstention feedbacks where a labeler can abstain from labeling a queried example with some unknown abstention rate. This is an important problem with many useful applications. We take a Bayesian approach to the problem and develop two new greedy algorithms that learn both the classification problem and the unknown abstention rate at the same time. These are achieved by simply incorporating the estimated average abstention rate into the greedy criteria. We prove that both algorithms have near-optimality guarantees: they respectively achieve a ${(1-\frac{1}{e})}$ constant factor approximation of the optimal expected or worst-case value of a useful utility function. Our experiments show the algorithms perform well in various practical scenarios. △ Less

Submitted 30 December, 2020; v1 submitted 4 June, 2019; originally announced June 2019.

Comments: Poster presented at 2019 ICML Workshop on Human in the Loop Learning 2019 (non-archival). arXiv admin note: substantial text overlap with arXiv:1705.08481

Improving and Understanding Variational Continual Learning

Authors: Siddharth Swaroop, Cuong V. Nguyen, Thang D. Bui, Richard E. Turner

Abstract: In the continual learning setting, tasks are encountered sequentially. The goal is to learn whilst i) avoiding catastrophic forgetting, ii) efficiently using model capacity, and iii) employing forward and backward transfer learning. In this paper, we explore how the Variational Continual Learning (VCL) framework achieves these desiderata on two benchmarks in continual learning: split MNIST and per… ▽ More In the continual learning setting, tasks are encountered sequentially. The goal is to learn whilst i) avoiding catastrophic forgetting, ii) efficiently using model capacity, and iii) employing forward and backward transfer learning. In this paper, we explore how the Variational Continual Learning (VCL) framework achieves these desiderata on two benchmarks in continual learning: split MNIST and permuted MNIST. We first report significantly improved results on what was already a competitive approach. The improvements are achieved by establishing a new best practice approach to mean-field variational Bayesian neural networks. We then look at the solutions in detail. This allows us to obtain an understanding of why VCL performs as it does, and we compare the solution to what an `ideal' continual learning solution might be. △ Less

Submitted 6 May, 2019; originally announced May 2019.

Partitioned Variational Inference: A unified framework encompassing federated and continual learning

Authors: Thang D. Bui, Cuong V. Nguyen, Siddharth Swaroop, Richard E. Turner

Abstract: Variational inference (VI) has become the method of choice for fitting many modern probabilistic models. However, practitioners are faced with a fragmented literature that offers a bewildering array of algorithmic options. First, the variational family. Second, the granularity of the updates e.g. whether the updates are local to each data point and employ message passing or global. Third, the meth… ▽ More Variational inference (VI) has become the method of choice for fitting many modern probabilistic models. However, practitioners are faced with a fragmented literature that offers a bewildering array of algorithmic options. First, the variational family. Second, the granularity of the updates e.g. whether the updates are local to each data point and employ message passing or global. Third, the method of optimization (bespoke or blackbox, closed-form or stochastic updates, etc.). This paper presents a new framework, termed Partitioned Variational Inference (PVI), that explicitly acknowledges these algorithmic dimensions of VI, unifies disparate literature, and provides guidance on usage. Crucially, the proposed PVI framework allows us to identify new ways of performing VI that are ideally suited to challenging learning scenarios including federated learning (where distributed computing is leveraged to process non-centralized data) and continual learning (where new data and tasks arrive over time and must be accommodated quickly). We showcase these new capabilities by develo** communication-efficient federated training of Bayesian neural networks and continual learning for Gaussian process models with private pseudo-points. The new methods significantly outperform the state-of-the-art, whilst being almost as straightforward to implement as standard VI. △ Less

Submitted 27 November, 2018; originally announced November 2018.

Variational Continual Learning

Authors: Cuong V. Nguyen, Yingzhen Li, Thang D. Bui, Richard E. Turner

Abstract: This paper develops variational continual learning (VCL), a simple but general framework for continual learning that fuses online variational inference (VI) and recent advances in Monte Carlo VI for neural networks. The framework can successfully train both deep discriminative models and deep generative models in complex continual learning settings where existing tasks evolve over time and entirel… ▽ More This paper develops variational continual learning (VCL), a simple but general framework for continual learning that fuses online variational inference (VI) and recent advances in Monte Carlo VI for neural networks. The framework can successfully train both deep discriminative models and deep generative models in complex continual learning settings where existing tasks evolve over time and entirely new tasks emerge. Experimental results show that VCL outperforms state-of-the-art continual learning methods on a variety of tasks, avoiding catastrophic forgetting in a fully automatic way. △ Less

Submitted 20 May, 2018; v1 submitted 29 October, 2017; originally announced October 2017.

Comments: Published at International Conference on Learning Representations (ICLR) 2018

Capturing natural-colour 3D models of insects for species discovery

Authors: Chuong V. Nguyen, David R. Lovell, Matt Adcock, John La Salle

Abstract: Collections of biological specimens are fundamental to scientific understanding and characterization of natural diversity. This paper presents a system for liberating useful information from physical collections by bringing specimens into the digital domain so they can be more readily shared, analyzed, annotated and compared. It focuses on insects and is strongly motivated by the desire to acceler… ▽ More Collections of biological specimens are fundamental to scientific understanding and characterization of natural diversity. This paper presents a system for liberating useful information from physical collections by bringing specimens into the digital domain so they can be more readily shared, analyzed, annotated and compared. It focuses on insects and is strongly motivated by the desire to accelerate and augment current practices in insect taxonomy which predominantly use text, 2D diagrams and images to describe and characterize species. While these traditional kinds of descriptions are informative and useful, they cannot cover insect specimens "from all angles" and precious specimens are still exchanged between researchers and collections for this reason. Furthermore, insects can be complex in structure and pose many challenges to computer vision systems. We present a new prototype for a practical, cost-effective system of off-the-shelf components to acquire natural-colour 3D models of insects from around 3mm to 30mm in length. Colour images are captured from different angles and focal depths using a digital single lens reflex (DSLR) camera rig and two-axis turntable. These 2D images are processed into 3D reconstructions using software based on a visual hull algorithm. The resulting models are compact (around 10 megabytes), afford excellent optical resolution, and can be readily embedded into documents and web pages, as well as viewed on mobile devices. The system is portable, safe, relatively affordable, and complements the sort of volumetric data that can be acquired by computed tomography. This system provides a new way to augment the description and documentation of insect species holotypes, reducing the need to handle or ship specimens. It opens up new opportunities to collect data for research, education, art, entertainment, biodiversity assessment and biosecurity control. △ Less

Submitted 6 September, 2017; originally announced September 2017.

Comments: 24 pages, 17 figures, PLOS ONE journal

Journal ref: published 2014

Bayesian Pool-based Active Learning With Abstention Feedbacks

Authors: Cuong V. Nguyen, Lam Si Tung Ho, Huan Xu, Vu Dinh, Binh Nguyen

Abstract: We study pool-based active learning with abstention feedbacks, where a labeler can abstain from labeling a queried example with some unknown abstention rate. This is an important problem with many useful applications. We take a Bayesian approach to the problem and develop two new greedy algorithms that learn both the classification problem and the unknown abstention rate at the same time. These ar… ▽ More We study pool-based active learning with abstention feedbacks, where a labeler can abstain from labeling a queried example with some unknown abstention rate. This is an important problem with many useful applications. We take a Bayesian approach to the problem and develop two new greedy algorithms that learn both the classification problem and the unknown abstention rate at the same time. These are achieved by simply incorporating the estimated abstention rate into the greedy criteria. We prove that both of our algorithms have near-optimality guarantees: they respectively achieve a ${(1-\frac{1}{e})}$ constant factor approximation of the optimal expected or worst-case value of a useful utility function. Our experiments show the algorithms perform well in various practical scenarios. △ Less

Submitted 2 January, 2021; v1 submitted 23 May, 2017; originally announced May 2017.

Comments: There is a new version at arXiv:1906.02179

Streaming Sparse Gaussian Process Approximations

Authors: Thang D. Bui, Cuong V. Nguyen, Richard E. Turner

Abstract: Sparse pseudo-point approximations for Gaussian process (GP) models provide a suite of methods that support deployment of GPs in the large data regime and enable analytic intractabilities to be sidestepped. However, the field lacks a principled method to handle streaming data in which both the posterior distribution over function values and the hyperparameter estimates are updated in an online fas… ▽ More Sparse pseudo-point approximations for Gaussian process (GP) models provide a suite of methods that support deployment of GPs in the large data regime and enable analytic intractabilities to be sidestepped. However, the field lacks a principled method to handle streaming data in which both the posterior distribution over function values and the hyperparameter estimates are updated in an online fashion. The small number of existing approaches either use suboptimal hand-crafted heuristics for hyperparameter learning, or suffer from catastrophic forgetting or slow updating when new data arrive. This paper develops a new principled framework for deploying Gaussian process probabilistic models in the streaming setting, providing methods for learning hyperparameters and optimising pseudo-input locations. The proposed framework is assessed using synthetic and real-world datasets. △ Less

Submitted 12 November, 2017; v1 submitted 19 May, 2017; originally announced May 2017.

Comments: To appear at the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA. The first two authors contributed equally to this work

3D Scanning System for Automatic High-Resolution Plant Phenoty**

Authors: Chuong V Nguyen, Jurgen Fripp, David R Lovell, Robert Furbank, Peter Kuffner, Helen Daily, Xavier Sirault

Abstract: Thin leaves, fine stems, self-occlusion, non-rigid and slowly changing structures make plants difficult for three-dimensional (3D) scanning and reconstruction -- two critical steps in automated visual phenoty**. Many current solutions such as laser scanning, structured light, and multiview stereo can struggle to acquire usable 3D models because of limitations in scanning resolution and calibrati… ▽ More Thin leaves, fine stems, self-occlusion, non-rigid and slowly changing structures make plants difficult for three-dimensional (3D) scanning and reconstruction -- two critical steps in automated visual phenoty**. Many current solutions such as laser scanning, structured light, and multiview stereo can struggle to acquire usable 3D models because of limitations in scanning resolution and calibration accuracy. In response, we have developed a fast, low-cost, 3D scanning platform to image plants on a rotating stage with two tilting DSLR cameras centred on the plant. This uses new methods of camera calibration and background removal to achieve high-accuracy 3D reconstruction. We assessed the system's accuracy using a 3D visual hull reconstruction algorithm applied on 2 plastic models of dicotyledonous plants, 2 sorghum plants and 2 wheat plants across different sets of tilt angles. Scan times ranged from 3 minutes (to capture 72 images using 2 tilt angles), to 30 minutes (to capture 360 images using 10 tilt angles). The leaf lengths, widths, areas and perimeters of the plastic models were measured manually and compared to measurements from the scanning system: results were within 3-4% of each other. The 3D reconstructions obtained with the scanning system show excellent geometric agreement with all six plant specimens, even plants with thin leaves and fine stems. △ Less

Submitted 26 February, 2017; originally announced February 2017.

Comments: 8 papes, DICTA 2016

Journal ref: In Digital Image Computing: Techniques and Applications (DICTA), 2016 International Conference on, pp. 1-8. IEEE, 2016

3D tracking of water hazards with polarized stereo cameras

Authors: Chuong V. Nguyen, Michael Milford, Robert Mahony

Abstract: Current self-driving car systems operate well in sunny weather but struggle in adverse conditions. One of the most commonly encountered adverse conditions involves water on the road caused by rain, sleet, melting snow or flooding. While some advances have been made in using conventional RGB camera and LIDAR technology for detecting water hazards, other sources of information such as polarization o… ▽ More Current self-driving car systems operate well in sunny weather but struggle in adverse conditions. One of the most commonly encountered adverse conditions involves water on the road caused by rain, sleet, melting snow or flooding. While some advances have been made in using conventional RGB camera and LIDAR technology for detecting water hazards, other sources of information such as polarization offer a promising and potentially superior approach to this problem in terms of performance and cost. In this paper, we present a novel stereo-polarization system for detecting and tracking water hazards based on polarization and color variation of reflected light, with consideration of the effect of polarized light from sky as function of reflection and azimuth angles. To evaluate this system, we present a new large `water on road' datasets spanning approximately 2 km of driving in various on-road and off-road conditions and demonstrate for the first time reliable water detection and tracking over a wide range of realistic car driving water conditions using polarized vision as the primary sensing modality. Our system successfully detects water hazards up to more than 100m. Finally, we discuss several interesting challenges and propose future research directions for further improving robust autonomous car perception in hazardous wet conditions using polarization sensors. △ Less

Submitted 26 February, 2017; v1 submitted 16 January, 2017; originally announced January 2017.

Comments: 7 pages, ICRA 2017

Automated Fourier space region-recognition filtering for off-axis digital holographic microscopy

Authors: Xuefei He, Chuong Vinh Nguyen, Mrinalini Pratap, Yujie Zheng, Yi Wang, David R. Nisbet, Richard J Williams, Melanie Rug, Alexander G. Maier, Woei Ming Lee

Abstract: Automated label-free quantitative imaging of biological samples can greatly benefit high throughput diseases diagnosis. Digital holographic microscopy (DHM) is a powerful quantitative label-free imaging tool that retrieves structural details of cellular samples non-invasively. In off-axis DHM, a proper spatial filtering window in Fourier space is crucial to the quality of reconstructed phase image… ▽ More Automated label-free quantitative imaging of biological samples can greatly benefit high throughput diseases diagnosis. Digital holographic microscopy (DHM) is a powerful quantitative label-free imaging tool that retrieves structural details of cellular samples non-invasively. In off-axis DHM, a proper spatial filtering window in Fourier space is crucial to the quality of reconstructed phase image. Here we describe a region-recognition approach that combines shape recognition with an iterative thresholding to extracts the optimal shape of frequency components. The region recognition technique offers fully automated adaptive filtering that can operate with a variety of samples and imaging conditions. When imaging through optically scattering biological hydrogel matrix, the technique surpasses previous histogram thresholding techniques without requiring any manual intervention. Finally, we automate the extraction of the statistical difference of optical height between malaria parasite infected and uninfected red blood cells. The method described here pave way to greater autonomy in automated DHM imaging for imaging live cell in thick cell cultures. △ Less

Submitted 15 July, 2016; originally announced July 2016.

Journal ref: Biomedical Optics Express Vol. 7, Issue 8, pp. 3111-3123 (2016)

Accelerated Randomized Mirror Descent Algorithms For Composite Non-strongly Convex Optimization

Authors: Le Thi Khanh Hien, Cuong V. Nguyen, Huan Xu, Canyi Lu, Jiashi Feng

Abstract: We consider the problem of minimizing the sum of an average function of a large number of smooth convex components and a general, possibly non-differentiable, convex function. Although many methods have been proposed to solve this problem with the assumption that the sum is strongly convex, few methods support the non-strongly convex case. Adding a small quadratic regularization is a common devise… ▽ More We consider the problem of minimizing the sum of an average function of a large number of smooth convex components and a general, possibly non-differentiable, convex function. Although many methods have been proposed to solve this problem with the assumption that the sum is strongly convex, few methods support the non-strongly convex case. Adding a small quadratic regularization is a common devise used to tackle non-strongly convex problems; however, it may cause loss of sparsity of solutions or weaken the performance of the algorithms. Avoiding this devise, we propose an accelerated randomized mirror descent method for solving this problem without the strongly convex assumption. Our method extends the deterministic accelerated proximal gradient methods of Paul Tseng and can be applied even when proximal points are computed inexactly. We also propose a scheme for solving the problem when the component functions are non-smooth. △ Less

Submitted 31 December, 2018; v1 submitted 23 May, 2016; originally announced May 2016.

MSC Class: 65K05; 90C06; 90C30

Experimental study of hard X-rays emitted from meter-scale positive discharges in air

Authors: P. O. Kochkin, C. V. Nguyen, A. P. J. van Deursen, U. Ebert

Abstract: We investigate structure and evolution of long positive spark breakdown; and we study at which stage pulses of hard X-rays are emitted. Positive high-voltage pulses of standardized lightning impulse wave form of about 1 MV were applied to about 1 meter of ambient air. The discharge evolution was imaged with a resolution of tens of nanoseconds with an intensified CCD camera. LaBr3(Ce+) scintillatio… ▽ More We investigate structure and evolution of long positive spark breakdown; and we study at which stage pulses of hard X-rays are emitted. Positive high-voltage pulses of standardized lightning impulse wave form of about 1 MV were applied to about 1 meter of ambient air. The discharge evolution was imaged with a resolution of tens of nanoseconds with an intensified CCD camera. LaBr3(Ce+) scintillation detectors recorded the X-rays emitted during the process. The voltage and the currents on both electrodes were measured synchronously. All measurements indicate that first a large and dense corona of positive streamers emerges from the high voltage electrode. When they approach the grounded electrode, negative counter-streamers emerge there, and the emission of hard X-rays coincides with the connection of the positive streamers with the negative counter-streamers. △ Less

Submitted 20 January, 2015; v1 submitted 29 August, 2012; originally announced August 2012.

Comments: 19 pages, 11 figures in Journal of Physics D: Applied Physics 2012

Report number: Number 42

Multiple X-ray bursts from long discharges in air

Authors: C. V. Nguyen, A. P. J. van Deursen, U. Ebert

Abstract: A lightning surge generator generates a high voltage surge with 1.2 microsec. rise time. The generator fed a spark gap of two pointed electrodes at 0.7 to 1.2 m distances. Gap breakdown occurred between 0.1 and 3 microsec. after the maximum generator voltage of approximately 850 kV. Various scintillator detectors with different response time recorded bursts of hard radiation in nearly all surges… ▽ More A lightning surge generator generates a high voltage surge with 1.2 microsec. rise time. The generator fed a spark gap of two pointed electrodes at 0.7 to 1.2 m distances. Gap breakdown occurred between 0.1 and 3 microsec. after the maximum generator voltage of approximately 850 kV. Various scintillator detectors with different response time recorded bursts of hard radiation in nearly all surges. The bursts were detected over the time span between approximately half of the maximum surge voltage and full gap breakdown. The consistent timing of the bursts with the high-voltage surge excluded background radiation as source for the high intensity pulses. In spite of the symmetry of the gap, negative surges produced more intense radiation than positive. This has been attributed to additional positive discharges from the measurement cabinet which occurred for negative surges. Some hard radiation signals were equivalent to several MeV. Pile-up occurs of lesser energy X-ray quanta, but still with a large fraction of these with an energy of the order of 100 keV. The bursts occurred within the 4 nanosec. time resolution of the fastest detector. The relation between the energy of the X-ray quanta and the signal from the scintillation detector is quite complicated, as shown by the measurements. △ Less

Submitted 19 August, 2008; v1 submitted 30 April, 2008; originally announced April 2008.

Comments: 7 pages, 7 figures

Journal ref: J. Phys. D: Appl. Phys. 41 (2008) 234012