Showing 1–14 of 14 results for author: Dinh, K

Approximate Bayesian Computation sequential Monte Carlo via random forests

Authors: Khanh N. Dinh, Zi** Xiang, Zhihan Liu, Simon Tavaré

Abstract: Approximate Bayesian Computation (ABC) is a popular inference method when likelihoods are hard to come by. Practical bottlenecks of ABC applications include selecting statistics that summarize the data without losing too much information or introducing uncertainty, and choosing distance functions and tolerance thresholds that balance accuracy and computational efficiency. Recent studies have shown… ▽ More Approximate Bayesian Computation (ABC) is a popular inference method when likelihoods are hard to come by. Practical bottlenecks of ABC applications include selecting statistics that summarize the data without losing too much information or introducing uncertainty, and choosing distance functions and tolerance thresholds that balance accuracy and computational efficiency. Recent studies have shown that ABC methods using random forest (RF) methodology perform well while circumventing many of ABC's drawbacks. However, RF construction is computationally expensive for large numbers of trees and model simulations, and there can be high uncertainty in the posterior if the prior distribution is uninformative. Here we adapt distributional random forests to the ABC setting, and introduce Approximate Bayesian Computation sequential Monte Carlo with random forests (ABC-SMC-(D)RF). This updates the prior distribution iteratively to focus on the most likely regions in the parameter space. We show that ABC-SMC-(D)RF can accurately infer posterior distributions for a wide range of deterministic and stochastic models in different scientific areas. △ Less

Submitted 22 June, 2024; originally announced June 2024.

High-Resolution, Mid-Infrared Color Temperature Map** of the Central 10 Arcseconds of the Galaxy

Authors: Cuc K. Dinh, Anna Cuirlo, Mark R. Morris, Rainer Schödel, Andrea Ghez, Tuan Do

Abstract: The neighborhood of the Galactic black hole boasts a plethora of extended interstellar gas and dust features as well as populations of compact (unresolved, or marginally resolved) features such as the G objects. Most are well manifested in the infrared. To disentangle and characterize the infrared structure of extended features and identify compact sources, we used 3.8~$μ$m (L' filter) data from t… ▽ More The neighborhood of the Galactic black hole boasts a plethora of extended interstellar gas and dust features as well as populations of compact (unresolved, or marginally resolved) features such as the G objects. Most are well manifested in the infrared. To disentangle and characterize the infrared structure of extended features and identify compact sources, we used 3.8~$μ$m (L' filter) data from the NIRC2 imager at the Keck Observatory and 8.6~$μ$m (PAH1 filter) data from the VISIR imager at the Very Large Telescope (VLT) to produce the highest-resolution mid-IR color-temperature map of the inner half-parsec of the Galactic Center to date. From this map, we compile a catalog of features that stand out from their background. In particular, we identify 33 compact sources that stand out against the local background temperature, 11 of which are newly identified and are candidates for being members of the G objects population. Additionally, we resolve and newly characterize the morphology of several known extended features. These results prepare the way for ongoing and future JWST studies that have access to a greater range of mid-infrared wavelengths, and thus will allow for refined estimation of the trends of dust temperatures. △ Less

Submitted 27 November, 2023; originally announced November 2023.

Comments: 22 pages, 14 figures

Vision Transformer Visualization: What Neurons Tell and How Neurons Behave?

Authors: Van-Anh Nguyen, Khanh Pham Dinh, Long Tung Vuong, Thanh-Toan Do, Quan Hung Tran, Dinh Phung, Trung Le

Abstract: Recently vision transformers (ViT) have been applied successfully for various tasks in computer vision. However, important questions such as why they work or how they behave still remain largely unknown. In this paper, we propose an effective visualization technique, to assist us in exposing the information carried in neurons and feature embeddings across the ViT's layers. Our approach departs fro… ▽ More Recently vision transformers (ViT) have been applied successfully for various tasks in computer vision. However, important questions such as why they work or how they behave still remain largely unknown. In this paper, we propose an effective visualization technique, to assist us in exposing the information carried in neurons and feature embeddings across the ViT's layers. Our approach departs from the computational process of ViTs with a focus on visualizing the local and global information in input images and the latent feature embeddings at multiple levels. Visualizations at the input and embeddings at level 0 reveal interesting findings such as providing support as to why ViTs are rather generally robust to image occlusions and patch shuffling; or unlike CNNs, level 0 embeddings already carry rich semantic details. Next, we develop a rigorous framework to perform effective visualizations across layers, exposing the effects of ViTs filters and grou**/clustering behaviors to object patches. Finally, we provide comprehensive experiments on real datasets to qualitatively and quantitatively demonstrate the merit of our proposed methods as well as our findings. https://github.com/byM1902/ViT_visualization △ Less

Submitted 17 October, 2022; v1 submitted 14 October, 2022; originally announced October 2022.

Comments: The first two authors contributed equally to this work. Our code is available at https://github.com/byM1902/ViT_visualization

On global solvability and regularity for generalized Rayleigh-Stokes equations with history-dependent nonlinearities

Authors: Ke Tran Dinh, Thang Nguyen Nhu

Abstract: We are concerned with the initial value problem governed by generalized Rayleigh-Stokes equations, where the nonlinearity depends on history states and takes values in Hilbert scales of negative order. The solvability and Hölder regularity of solutions are proved by using fixed point arguments and embeddings of fractional Sobolev spaces. An application to a related inverse source problem is given. We are concerned with the initial value problem governed by generalized Rayleigh-Stokes equations, where the nonlinearity depends on history states and takes values in Hilbert scales of negative order. The solvability and Hölder regularity of solutions are proved by using fixed point arguments and embeddings of fractional Sobolev spaces. An application to a related inverse source problem is given. △ Less

Submitted 11 June, 2022; v1 submitted 9 June, 2022; originally announced June 2022.

MSC Class: 35B40; 35R11; 35C15; 45D05; 45K05

Wider or Deeper Neural Network Architecture for Acoustic Scene Classification with Mismatched Recording Devices

Authors: Lam Pham, Khoa Dinh, Dat Ngo, Hieu Tang, Alexander Schindler

Abstract: In this paper, we present a robust and low complexity system for Acoustic Scene Classification (ASC), the task of identifying the scene of an audio recording. We first construct an ASC baseline system in which a novel inception-residual-based network architecture is proposed to deal with the mismatched recording device issue. To further improve the performance but still satisfy the low complexity… ▽ More In this paper, we present a robust and low complexity system for Acoustic Scene Classification (ASC), the task of identifying the scene of an audio recording. We first construct an ASC baseline system in which a novel inception-residual-based network architecture is proposed to deal with the mismatched recording device issue. To further improve the performance but still satisfy the low complexity model, we apply two techniques: ensemble of multiple spectrograms and channel reduction on the ASC baseline system. By conducting extensive experiments on the benchmark DCASE 2020 Task 1A Development dataset, we achieve the best model performing an accuracy of 69.9% and a low complexity of 2.4M trainable parameters, which is competitive to the state-of-the-art ASC systems and potential for real-life applications on edge devices. △ Less

Submitted 23 March, 2022; originally announced March 2022.

Comments: This paper was submitted to INTERSPEECH 2022

Effects of turbulence in the Circumnuclear Disk

Authors: Cuc K. Dinh, Jesus M. Salas, Mark R. Morris, Smadar Naoz

Abstract: A Circumnuclear Disk (CND) of molecular gas occupies the central few parsecs of the Galactic Center. It is likely subject to turbulent disruptions from violent events in its surrounding environment, but the effect of such perturbations has not yet been investigated in detail. Here we perform 3D, N-body/smoothed particle hydrodynamic (SPH) simulations with an adapted general turbulence driving meth… ▽ More A Circumnuclear Disk (CND) of molecular gas occupies the central few parsecs of the Galactic Center. It is likely subject to turbulent disruptions from violent events in its surrounding environment, but the effect of such perturbations has not yet been investigated in detail. Here we perform 3D, N-body/smoothed particle hydrodynamic (SPH) simulations with an adapted general turbulence driving method to investigate the CND's structural evolution, in particular its reaction to varied scales of injected turbulence. We find that, because of shear flow in the disk, transient arcs of gas (streams) naturally arise when turbulence is driven on large scales (up to ~4 pc), as might occur when a supernova blast wave encounters the CND. Because energetic events arise naturally and often in the central parsecs of our Galaxy, this result suggests that the transient structures that characterize the CND do not imply that the CND itself is a transient structure. We also note that features similar to the density concentrations, or "clumps", detailed in literature emerge when we account for the observed orientation of the disk and for the spatial resolution of observations. As such, clumps could be an artifact of observational limitations. △ Less

Submitted 22 September, 2021; v1 submitted 18 February, 2021; originally announced February 2021.

Comments: 19 pages, 9 figures. Accepted for publication by ApJ

Improving Multilingual Neural Machine Translation For Low-Resource Languages: French,English - Vietnamese

Authors: Thi-Vinh Ngo, Phuong-Thai Nguyen, Thanh-Le Ha, Khac-Quy Dinh, Le-Minh Nguyen

Abstract: Prior works have demonstrated that a low-resource language pair can benefit from multilingual machine translation (MT) systems, which rely on many language pairs' joint training. This paper proposes two simple strategies to address the rare word issue in multilingual MT systems for two low-resource language pairs: French-Vietnamese and English-Vietnamese. The first strategy is about dynamical lear… ▽ More Prior works have demonstrated that a low-resource language pair can benefit from multilingual machine translation (MT) systems, which rely on many language pairs' joint training. This paper proposes two simple strategies to address the rare word issue in multilingual MT systems for two low-resource language pairs: French-Vietnamese and English-Vietnamese. The first strategy is about dynamical learning word similarity of tokens in the shared space among source languages while another one attempts to augment the translation ability of rare words through updating their embeddings during the training. Besides, we leverage monolingual data for multilingual MT systems to increase the amount of synthetic parallel corpora while dealing with the data sparsity problem. We have shown significant improvements of up to +1.62 and +2.54 BLEU points over the bilingual baseline systems for both language pairs and released our datasets for the research community. △ Less

Submitted 10 July, 2021; v1 submitted 15 December, 2020; originally announced December 2020.

Comments: The 3rd Workshop on Technologies for MT of Low Resource Languages (LoResMT 2020)

On stability for semilinear generalized Rayleigh-Stokes equation involving delays

Authors: Ke Tran Dinh, Lan Do, Tuan Pham Thanh

Abstract: We consider a functional semilinear Rayleigh-Stokes equation involving fractional derivative. Our aim is to analyze some circumstances, in those the global solvability and some results on asymptotic behavior of solutions take place. By establishing a new Halanay type inequality, we show the dissipativity and asymptotic stability of solutions to our problem. In addition, we prove the existence of a… ▽ More We consider a functional semilinear Rayleigh-Stokes equation involving fractional derivative. Our aim is to analyze some circumstances, in those the global solvability and some results on asymptotic behavior of solutions take place. By establishing a new Halanay type inequality, we show the dissipativity and asymptotic stability of solutions to our problem. In addition, we prove the existence of a compact set of decay solutions by using local estimates and fixed point arguments. △ Less

Submitted 27 March, 2021; v1 submitted 1 November, 2020; originally announced November 2020.

MSC Class: 35B40; 35R11; 35C15; 45D05; 45K05

A language score based output selection method for multilingual speech recognition

Authors: Van Huy Nguyen, Thi Quynh Khanh Dinh, Truong Thinh Nguyen, Dang Khoa Mac

Abstract: The quality of a multilingual speech recognition system can be improved by adaptation methods if the input language is specified. For systems that can accept multilingual inputs, the popular approach is to apply a language identifier to the input then switch or configure decoders in the next step, or use one more subsequence model to select the output from a set of candidates. Motivated by the goa… ▽ More The quality of a multilingual speech recognition system can be improved by adaptation methods if the input language is specified. For systems that can accept multilingual inputs, the popular approach is to apply a language identifier to the input then switch or configure decoders in the next step, or use one more subsequence model to select the output from a set of candidates. Motivated by the goal of reducing the latency for real-time applications, in this paper, a language model rescoring method is firstly applied to produce all possible candidates for target languages, then a simple score is proposed to automatically select the output without any identifier model or language specification of the input language. The main point is that this score can be simply and automatically estimated on-the-fly so that the whole decoding pipeline is more simple and compact. Experimental results showed that this method can achieve the same quality as when the input language is specified. In addition, we present to design an English and Vietnamese End-to-End model to deal with not only the problem of cross-lingual speakers but also as a solution to improve the accuracy of borrowed words of English in Vietnamese. △ Less

Submitted 2 May, 2020; originally announced May 2020.

Phase-matched nonlinear wave-mixing processes in XUV region with multicolor lasers

Authors: Khoa Anh Tran, Khuong Ba Dinh, Peter Hannaford, Lap Van Dao

Abstract: We report here experimental results of perturbative nonlinear optical wave-mixing processes in the extreme ultraviolet region by using two-color and three-color laser fields. Besides the usual odd-harmonic spectrum of high harmonic generation, new spectral components are observed when multiple incommensurate lasers (one driving plus one or two control field) interact with neutral krypton gas. To d… ▽ More We report here experimental results of perturbative nonlinear optical wave-mixing processes in the extreme ultraviolet region by using two-color and three-color laser fields. Besides the usual odd-harmonic spectrum of high harmonic generation, new spectral components are observed when multiple incommensurate lasers (one driving plus one or two control field) interact with neutral krypton gas. To demonstrate the wave-mixing process underlying such an observation, we firstly couple the driving field with either the signal or the idler field of an optical parametric amplifier in the gaseous ensemble to generate certain mixing frequencies. The two control fields are then simultaneously combined with the driving field to produce broad and distinguishable mixing peaks that clearly reveal the contribution of each control laser. Finally, the variation of the intensity of the mixing waves with the intensity of each control field, the gas density, and the relative focus position is examined for signatures of phase-matched generation of the mixing fields in this spectral region. △ Less

Submitted 31 March, 2019; originally announced April 2019.

Comments: 12 pages, 4 figures

Journal ref: Appl. Opt. 58 2540-2545 (2019)

Phase-matched four-wave mixing in the extreme ultraviolet region

Authors: Khoa Anh Tran, Khuong Ba Dinh, Peter Hannaford, Lap Van Dao

Abstract: We report here a detailed study of the four-wave mixing process in the extreme ultraviolet (XUV) region around 30 nm by using two collinear incommensurate frequency laser pulses. The experimental results reveal evidence of the coherent accumulation of the wave-mixing fields and low-order (third-order and fifth-order) nonlinear response of an argon medium. The dependence of the intensities of the m… ▽ More We report here a detailed study of the four-wave mixing process in the extreme ultraviolet (XUV) region around 30 nm by using two collinear incommensurate frequency laser pulses. The experimental results reveal evidence of the coherent accumulation of the wave-mixing fields and low-order (third-order and fifth-order) nonlinear response of an argon medium. The dependence of the intensities of the mixing fields on the intensity of a weak control field, on the argon pressure and on the interaction length is analyzed to show that the four-wave mixing fields in this spectral range are generated under the phase-matched condition. △ Less

Submitted 23 June, 2018; originally announced June 2018.

Comments: 17 pages, 8 figures, accepted for Journal of Applied Physics

Journal ref: J. Appl. Phys. 124, 015901 (2018)

Compressive Sensing of Color Images Using Nonlocal Higher Order Dictionary

Authors: Khanh Quoc Dinh, Thuong Nguyen Canh, Byeungwoo Jeon

Abstract: This paper addresses an ill-posed problem of recovering a color image from its compressively sensed measurement data. Differently from the typical 1D vector-based approach of the state-of-the-art methods, we exploit the nonlocal similarities inherently existing in images by treating each patch of a color image as a 3D tensor consisting of not only horizontal and vertical but also spectral dimensio… ▽ More This paper addresses an ill-posed problem of recovering a color image from its compressively sensed measurement data. Differently from the typical 1D vector-based approach of the state-of-the-art methods, we exploit the nonlocal similarities inherently existing in images by treating each patch of a color image as a 3D tensor consisting of not only horizontal and vertical but also spectral dimensions. A group of nonlocal similar patches form a 4D tensor for which a nonlocal higher order dictionary is learned via higher order singular value decomposition. The multiple sub-dictionaries contained in the higher order dictionary decorrelate the group in each corresponding dimension, thus help the detail of color images to be reconstructed better. Furthermore, we promote sparsity of the final solution using a sparsity regularization based on a weight tensor. It can distinguish those coefficients of the sparse representation generated by the higher order dictionary which are expected to have large magnitude from the others in the optimization. Accordingly, in the iterative solution, it acts like a weighting process which is designed by approximating the minimum mean squared error filter for more faithful recovery. Experimental results confirm improvement by the proposed method over the state-of-the-art ones. △ Less

Submitted 26 November, 2017; originally announced November 2017.

Comments: 13 pages, 10 figures

Block Compressive Sensing of Image and Video with Nonlocal Lagrangian Multiplier and Patch-based Sparse Representation

Authors: Trinh Van Chien, Khanh Quoc Dinh, Byeungwoo Jeon, Martin Burger

Abstract: Although block compressive sensing (BCS) makes it tractable to sense large-sized images and video, its recovery performance has yet to be significantly improved because its recovered images or video usually suffer from blurred edges, loss of details, and high-frequency oscillatory artifacts, especially at a low subrate. This paper addresses these problems by designing a modified total variation te… ▽ More Although block compressive sensing (BCS) makes it tractable to sense large-sized images and video, its recovery performance has yet to be significantly improved because its recovered images or video usually suffer from blurred edges, loss of details, and high-frequency oscillatory artifacts, especially at a low subrate. This paper addresses these problems by designing a modified total variation technique that employs multi-block gradient processing, a denoised Lagrangian multiplier, and patch-based sparse representation. In the case of video, the proposed recovery method is able to exploit both spatial and temporal similarities. Simulation results confirm the improved performance of the proposed method for compressive sensing of images and video in terms of both objective and subjective qualities. △ Less

Submitted 15 March, 2017; originally announced March 2017.

Comments: 30 pages, 13 figures, 2 tables; Accepted by Elsevier Signal Processing:Image Communication

Total variation reconstruction for compressive sensing using nonlocal Lagrangian multiplier

Authors: Trinh Van Chien, Khanh Quoc Dinh, Viet Anh Nguyen, Byeungwoo Jeon

Abstract: Total variation has proved its effectiveness in solving inverse problems for compressive sensing. Besides, the nonlocal means filter used as regularization preserves texture better for recovered images, but it is quite complex to implement. In this paper, based on existence of both noise and image information in the Lagrangian multiplier, we propose a simple method in term of implementation called… ▽ More Total variation has proved its effectiveness in solving inverse problems for compressive sensing. Besides, the nonlocal means filter used as regularization preserves texture better for recovered images, but it is quite complex to implement. In this paper, based on existence of both noise and image information in the Lagrangian multiplier, we propose a simple method in term of implementation called nonlocal Lagrangian multiplier (NLLM) in order to reduce noise and boost useful image information. Experimental results show that the proposed NLLM is superior both in subjective and objective qualities of recovered image over other recovery algorithms. △ Less

Submitted 28 August, 2016; originally announced August 2016.

Comments: 5 pages, 3 figures, 3 tables. EUSIPCO2014. Matlab software: https://www.researchgate.net/profile/Trinh_Chien/publications