Showing 51–100 of 211 results for author: NGuyen, S

How many supercells are required to achieve unconventional light confinement effects in moiré photonic lattices?

Authors: Chirine Saadi, Hai Son Nguyen, Sébastien Cueff, Lydie Ferrier, Xavier Letartre, Ségolène Callard

Abstract: Moiré structures are receiving increasing attention in nanophotonics as they support intriguing optical phenomena. In the so-called "magic configuration", one-dimensional moirés give rise to fully dispersionless energy bands known as "flatbands", where the light is tightly localized within each supercell of the periodic moiré. The goal of this investigation is to determine to what extent the confi… ▽ More Moiré structures are receiving increasing attention in nanophotonics as they support intriguing optical phenomena. In the so-called "magic configuration", one-dimensional moirés give rise to fully dispersionless energy bands known as "flatbands", where the light is tightly localized within each supercell of the periodic moiré. The goal of this investigation is to determine to what extent the confinement of light, observed in periodic structures, is preserved in microcavities of finite size. Here we analyze the optical response of finite moiré structures consisting of one, two, or more supercells of 1D moiré. Our calculations reveal that for single-supercell cavity, the magic configuration does not impact the electric field confinement at the wavelength of the flat band modes. However, when three or more supercells are connected, we show that the coupling between supercells is canceled at the "magic configuration", resulting in highly confined modes with a quality factor greater than $10^6$ and exhibiting the characteristics of a quasi-bound state in the continuum where optical losses are eliminated through a destructive interference process. △ Less

Submitted 7 July, 2023; originally announced July 2023.

Can An Old Fashioned Feature Extraction and A Light-weight Model Improve Vulnerability Type Identification Performance?

Authors: Hieu Dinh Vo, Son Nguyen

Abstract: Recent advances in automated vulnerability detection have achieved potential results in hel** developers determine vulnerable components. However, after detecting vulnerabilities, investigating to fix vulnerable code is a non-trivial task. In fact, the types of vulnerability, such as buffer overflow or memory corruption, could help developers quickly understand the nature of the weaknesses and l… ▽ More Recent advances in automated vulnerability detection have achieved potential results in hel** developers determine vulnerable components. However, after detecting vulnerabilities, investigating to fix vulnerable code is a non-trivial task. In fact, the types of vulnerability, such as buffer overflow or memory corruption, could help developers quickly understand the nature of the weaknesses and localize vulnerabilities for security analysis. In this work, we investigate the problem of vulnerability type identification (VTI). The problem is modeled as the multi-label classification task, which could be effectively addressed by "pre-training, then fine-tuning" framework with deep pre-trained embedding models. We evaluate the performance of the well-known and advanced pre-trained models for VTI on a large set of vulnerabilities. Surprisingly, their performance is not much better than that of the classical baseline approach with an old-fashioned bag-of-word, TF-IDF. Meanwhile, these deep neural network approaches cost much more resources and require GPU. We also introduce a lightweight independent component to refine the predictions of the baseline approach. Our idea is that the types of vulnerabilities could strongly correlate to certain code tokens (distinguishing tokens) in several crucial parts of programs. The distinguishing tokens for each vulnerability type are statistically identified based on their prevalence in the type versus the others. Our results show that the baseline approach enhanced by our component can outperform the state-of-the-art deep pre-trained approaches while retaining very high efficiency. Furthermore, the proposed component could also improve the neural network approaches by up to 92.8% in macro-average F1. △ Less

Submitted 26 June, 2023; originally announced June 2023.

ARIST: An Effective API Argument Recommendation Approach

Authors: Son Nguyen, Cuong Tran Manh, Kien T. Tran, Tan M. Nguyen, Thu-Trang Nguyen, Kien-Tuan Ngo, Hieu Dinh Vo

Abstract: Learning and remembering to use APIs are difficult. Several techniques have been proposed to assist developers in using APIs. Most existing techniques focus on recommending the right API methods to call, but very few techniques focus on recommending API arguments. In this paper, we propose ARIST, a novel automated argument recommendation approach which suggests arguments by predicting developers'… ▽ More Learning and remembering to use APIs are difficult. Several techniques have been proposed to assist developers in using APIs. Most existing techniques focus on recommending the right API methods to call, but very few techniques focus on recommending API arguments. In this paper, we propose ARIST, a novel automated argument recommendation approach which suggests arguments by predicting developers' expectations when they define and use API methods. To implement this idea in the recommendation process, ARIST combines program analysis (PA), language models (LMs), and several features specialized for the recommendation task which consider the functionality of formal parameters and the positional information of code elements (e.g., variables or method calls) in the given context. In ARIST, the LMs and the recommending features are used to suggest the promising candidates identified by PA. Meanwhile, PA navigates the LMs and the features working on the set of the valid candidates which satisfy syntax, accessibility, and type-compatibility constraints defined by the programming language in use. Our evaluation on a large dataset of real-world projects shows that ARIST improves the state-of-the-art approach by 19% and 18% in top-1 precision and recall for recommending arguments of frequently-used libraries. For general argument recommendation task, i.e., recommending arguments for every method call, ARIST outperforms the baseline approaches by up to 125% top-1 accuracy. Moreover, for newly-encountered projects, ARIST achieves more than 60% top-3 accuracy when evaluating on a larger dataset. For working/maintaining projects, with a personalized LM to capture developers' coding practice, ARIST can productively rank the expected arguments at the top-1 position in 7/10 requests. △ Less

Submitted 11 June, 2023; originally announced June 2023.

StudentEval: A Benchmark of Student-Written Prompts for Large Language Models of Code

Authors: Hannah McLean Babe, Sydney Nguyen, Yangtian Zi, Arjun Guha, Molly Q Feldman, Carolyn Jane Anderson

Abstract: Code LLMs are being rapidly deployed and there is evidence that they can make professional programmers more productive. Current benchmarks for code generation measure whether models generate correct programs given an expert prompt. In this paper, we present a new benchmark containing multiple prompts per problem, written by a specific population of non-expert prompters: beginning programmers. Stud… ▽ More Code LLMs are being rapidly deployed and there is evidence that they can make professional programmers more productive. Current benchmarks for code generation measure whether models generate correct programs given an expert prompt. In this paper, we present a new benchmark containing multiple prompts per problem, written by a specific population of non-expert prompters: beginning programmers. StudentEval contains 1,749 prompts for 48 problems, written by 80 students who have only completed one semester of Python programming. Our students wrote these prompts while working interactively with a Code LLM, and we observed very mixed success rates. We use StudentEval to evaluate 5 Code LLMs and find that StudentEval is a better discriminator of model performance than existing benchmarks. We analyze the prompts and find significant variation in students' prompting techniques. We also find that nondeterministic LLM sampling could mislead students into thinking that their prompts are more (or less) effective than they actually are, which has implications for how to teach with Code LLMs. △ Less

Submitted 7 June, 2023; originally announced June 2023.

Building Neural Networks on Matrix Manifolds: A Gyrovector Space Approach

Authors: Xuan Son Nguyen, Shuo Yang

Abstract: Matrix manifolds, such as manifolds of Symmetric Positive Definite (SPD) matrices and Grassmann manifolds, appear in many applications. Recently, by applying the theory of gyrogroups and gyrovector spaces that is a powerful framework for studying hyperbolic geometry, some works have attempted to build principled generalizations of Euclidean neural networks on matrix manifolds. However, due to the… ▽ More Matrix manifolds, such as manifolds of Symmetric Positive Definite (SPD) matrices and Grassmann manifolds, appear in many applications. Recently, by applying the theory of gyrogroups and gyrovector spaces that is a powerful framework for studying hyperbolic geometry, some works have attempted to build principled generalizations of Euclidean neural networks on matrix manifolds. However, due to the lack of many concepts in gyrovector spaces for the considered manifolds, e.g., the inner product and gyroangles, techniques and mathematical tools provided by these works are still limited compared to those developed for studying hyperbolic geometry. In this paper, we generalize some notions in gyrovector spaces for SPD and Grassmann manifolds, and propose new models and layers for building neural networks on these manifolds. We show the effectiveness of our approach in two applications, i.e., human action recognition and knowledge graph completion. △ Less

Submitted 5 June, 2023; v1 submitted 8 May, 2023; originally announced May 2023.

Connector 0.5: A unified framework for graph representation learning

Authors: Thanh Sang Nguyen, Jooho Lee, Van Thuy Hoang, O-Joun Lee

Abstract: Graph representation learning models aim to represent the graph structure and its features into low-dimensional vectors in a latent space, which can benefit various downstream tasks, such as node classification and link prediction. Due to its powerful graph data modelling capabilities, various graph embedding models and libraries have been proposed to learn embeddings and help researchers ease con… ▽ More Graph representation learning models aim to represent the graph structure and its features into low-dimensional vectors in a latent space, which can benefit various downstream tasks, such as node classification and link prediction. Due to its powerful graph data modelling capabilities, various graph embedding models and libraries have been proposed to learn embeddings and help researchers ease conducting experiments. In this paper, we introduce a novel graph representation framework covering various graph embedding models, ranging from shallow to state-of-the-art models, namely Connector. First, we consider graph generation by constructing various types of graphs with different structural relations, including homogeneous, signed, heterogeneous, and knowledge graphs. Second, we introduce various graph representation learning models, ranging from shallow to deep graph embedding models. Finally, we plan to build an efficient open-source framework that can provide deep graph embedding models to represent structural relations in graphs. The framework is available at https://github.com/NSLab-CUK/Connector. △ Less

Submitted 25 April, 2023; originally announced April 2023.

Comments: An unified framework for graph representation learning

Code-centric Learning-based Just-In-Time Vulnerability Detection

Authors: Son Nguyen, Thu-Trang Nguyen, Thanh Trong Vu, Thanh-Dat Do, Kien-Tuan Ngo, Hieu Dinh Vo

Abstract: Attacks against computer systems exploiting software vulnerabilities can cause substantial damage to the cyber-infrastructure of our modern society and economy. To minimize the consequences, it is vital to detect and fix vulnerabilities as soon as possible. Just-in-time vulnerability detection (JIT-VD) discovers vulnerability-prone ("dangerous") commits to prevent them from being merged into sourc… ▽ More Attacks against computer systems exploiting software vulnerabilities can cause substantial damage to the cyber-infrastructure of our modern society and economy. To minimize the consequences, it is vital to detect and fix vulnerabilities as soon as possible. Just-in-time vulnerability detection (JIT-VD) discovers vulnerability-prone ("dangerous") commits to prevent them from being merged into source code and causing vulnerabilities. By JIT-VD, the commits' authors, who understand the commits properly, can review these dangerous commits and fix them if necessary while the relevant modifications are still fresh in their minds. In this paper, we propose CodeJIT, a novel code-centric learning-based approach for just-in-time vulnerability detection. The key idea of CodeJIT is that the meaning of the code changes of a commit is the direct and deciding factor for determining if the commit is dangerous for the code. Based on that idea, we design a novel graph-based representation to represent the semantics of code changes in terms of both code structures and program dependencies. A graph neural network model is developed to capture the meaning of the code changes represented by our graph-based representation and learn to discriminate between dangerous and safe commits. We conducted experiments to evaluate the JIT-VD performance of CodeJIT on a dataset of 20K+ dangerous and safe commits in 506 real-world projects from 1998 to 2022. Our results show that CodeJIT significantly improves the state-of-the-art JIT-VD methods by up to 66% in Recall, 136% in Precision, and 68% in F1. Moreover, CodeJIT correctly classifies nearly 9/10 of dangerous/safe (benign) commits and even detects 69 commits that fix a vulnerability yet produce other issues in source code △ Less

Submitted 17 April, 2023; originally announced April 2023.

Femtosecond laser induced creation of G and W-centers in silicon-on-insulator substrates

Authors: Hugo Quard, Mario Khoury, Andong Wang, Tobias Herzig, Jan Meijer, Sebastian Pezzagna, Sébastien Cueff, David Grojo, Marco Abbarchi, Hai Son Nguyen, Nicolas Chauvin, Thomas Wood

Abstract: The creation of fluorescent defects in silicon is a key step** stone towards assuring the integration perspectives of quantum photonic devices into existing technologies. Here we demonstrate the creation, by femtosecond laser annealing, of W and G-centers in commercial silicon on insulator (SOI) previously implanted with 12C+ ions. Their quality is comparable to that found for the same emitters… ▽ More The creation of fluorescent defects in silicon is a key step** stone towards assuring the integration perspectives of quantum photonic devices into existing technologies. Here we demonstrate the creation, by femtosecond laser annealing, of W and G-centers in commercial silicon on insulator (SOI) previously implanted with 12C+ ions. Their quality is comparable to that found for the same emitters obtained with conventional implant processes; as quantified by the photoluminescence radiative lifetime, the broadening of their zero-phonon line (ZPL) and the evolution of these quantities with temperature. In addition to this, we show that both defects can be created without carbon implantation and that we can erase the G-centers by annealing while enhancing the W-centers' emission. These demonstrations are relevant to the deterministic and operando generation of quantum emitters in silicon. △ Less

Submitted 7 April, 2023; originally announced April 2023.

Comments: 8 pages, 4 figures

FerroHEMTs: High-Current and High-Speed All-Epitaxial AlScN/GaN Ferroelectric Transistors

Authors: J. Casamento, K. Nomoto, T. S. Nguyen, H. Lee, C. Savant, L. Li, A. Hickman, T. Maeda, J. Encomendero, V. Gund, A. Lal, J. C. M. Hwang, H. G. Xing, D. Jena

Abstract: We report the first observation of ferroelectric gating in AlScN barrier wide-bandgap nitride transistors. These FerroHEMT devices realized by direct epitaxial growth represent a new class of ferroelectric transistors in which the semiconductor is itself polar, and the crystalline ferroelectric barrier is lattice-matched to the substrate. The FerroHEMTs reported here use the thinnest nitride high… ▽ More We report the first observation of ferroelectric gating in AlScN barrier wide-bandgap nitride transistors. These FerroHEMT devices realized by direct epitaxial growth represent a new class of ferroelectric transistors in which the semiconductor is itself polar, and the crystalline ferroelectric barrier is lattice-matched to the substrate. The FerroHEMTs reported here use the thinnest nitride high K and ferroelectric barriers to date to deliver the highest on currents at 4 A/mm, and highest speed AlScN transistors with fmax larger than 150 GHz observed in any ferroelectric transistor. The FerroHEMTs exhibit hysteretic Id Vgs loops with subthreshold slopes below the Boltzmann limit. A control AlN barrier HEMT exhibits neither hysteretic, nor sub Boltzmann behavior. While these results introduce the first epitaxial high K and ferroelectric barrier technology to RF and mm wave electronics, they are also of interest as a new material platform for combining memory and logic functionalities in digital electronics. △ Less

Submitted 27 February, 2023; originally announced February 2023.

Comments: 4 pages, 8 figures, appeared in IEEE IEDM, December 2022

Journal ref: IEEE IEDM Technical Digest, December 2022

Bender-Knuth involutions on linear extensions of posets

Authors: Judy Hsin-Hui Chiang, Anh Trong Nam Hoang, Matthew Kendall, Ryan Lynch, Son Nguyen, Benjamin Przybocki, Janabel Xia

Abstract: We study the permutation group $\mathcal{BK}_P$ generated by Bender-Knuth moves on linear extensions of a poset $P$, an analog of the Berenstein-Kirillov group on column-strict tableaux. We explore the group relations, with an emphasis on identifying posets $P$ for which the cactus relations hold in $\mathcal{BK}_P$. We also examine $\mathcal{BK}_P$ as a subgroup of the symmetric group… ▽ More We study the permutation group $\mathcal{BK}_P$ generated by Bender-Knuth moves on linear extensions of a poset $P$, an analog of the Berenstein-Kirillov group on column-strict tableaux. We explore the group relations, with an emphasis on identifying posets $P$ for which the cactus relations hold in $\mathcal{BK}_P$. We also examine $\mathcal{BK}_P$ as a subgroup of the symmetric group $\mathfrak{S}_{\mathcal{L}(P)}$ on the set of linear extensions of $P$ with the focus on analyzing posets $P$ for which $\mathcal{BK}_P = \mathfrak{S}_{\mathcal{L}(P)}$. △ Less

Submitted 24 March, 2024; v1 submitted 23 February, 2023; originally announced February 2023.

Comments: 27 pages. v2: Major revision with streamlined terminology. Comments very welcome

MSC Class: 06A07; 20B25

Optically reconfigurable molecules of topological bound states in the continuum

Authors: Antonio Gianfrate, Helgi Sigurdsson, Vincenzo Ardizzone, Hai Chau Nguyen, Fabrizio Riminucci, Maria Efthymiou-Tsironi, Kirk W. Baldwin, Loren N. Pfeiffer, Dimitrios Trypogeorgos, Milena De Giorgi, Dario Ballarini, Hai Son Nguyen, Daniele Sanvitto

Abstract: Symmetry protected optical bound states in the continuum (BICs) are charming wave-mechanical objects that provide new and exciting ways to enhance light-matter interactions in compact photonic devices. These ultrahigh quality factor states have quickly transcended from passive structures, and lasing devices in the weak-coupling regime, towards nonequilibrium Bose-Einstein condensates of BIC polari… ▽ More Symmetry protected optical bound states in the continuum (BICs) are charming wave-mechanical objects that provide new and exciting ways to enhance light-matter interactions in compact photonic devices. These ultrahigh quality factor states have quickly transcended from passive structures, and lasing devices in the weak-coupling regime, towards nonequilibrium Bose-Einstein condensates of BIC polaritons in the strong-coupling regime. Here, we show that the large interaction strength of exciton-polaritons in subwavelength quantum-well waveguide gratings in conjunction with their topologically protected BIC nature opens unexplored opportunities in low-threshold optically reprogrammable quantum fluids. The BIC causes polaritons to -- almost counterintuitively -- condense in the extremum of a negative mass dispersion which leads to strong interaction-induced trap** at their respective pump spot and gain region. We exploit this optical trap** mechanism to demonstrate macroscopic mode-hybridization, the hallmark of coherent quantum systems, enabling construction of never-seen-before artificial BIC molecules with unusual topological charge mutliplicity. We underpin the optical write-in aspect of our technique by constructing, on the same sample, artificial mono-atomic and dimerized BIC chains of polariton fluids displaying non-Hermitian quasicrystalline band formation and gap opening. Our findings open new perspectives on large-scale reprogrammable driven dissipative many-body systems in the strong-coupling regime. △ Less

Submitted 20 January, 2023; originally announced January 2023.

Multisensor Data Fusion for Reliable Obstacle Avoidance

Authors: Thanh Nguyen Canh, Truong Son Nguyen, Cong Hoang Quach, Xiem HoangVan, Manh Duong Phung

Abstract: In this work, we propose a new approach that combines data from multiple sensors for reliable obstacle avoidance. The sensors include two depth cameras and a LiDAR arranged so that they can capture the whole 3D area in front of the robot and a 2D slide around it. To fuse the data from these sensors, we first use an external camera as a reference to combine data from two depth cameras. A projection… ▽ More In this work, we propose a new approach that combines data from multiple sensors for reliable obstacle avoidance. The sensors include two depth cameras and a LiDAR arranged so that they can capture the whole 3D area in front of the robot and a 2D slide around it. To fuse the data from these sensors, we first use an external camera as a reference to combine data from two depth cameras. A projection technique is then introduced to convert the 3D point cloud data of the cameras to its 2D correspondence. An obstacle avoidance algorithm is then developed based on the dynamic window approach. A number of experiments have been conducted to evaluate our proposed approach. The results show that the robot can effectively avoid static and dynamic obstacles of different shapes and sizes in different environments. △ Less

Submitted 26 December, 2022; originally announced December 2022.

Comments: In the 11th International Conference on Control, Automation and Information Sciences (ICCAIS 2022), Hanoi, Vietnam

Design of a room-temperature topological exciton-polariton laser in a ZnO/TiO$_2$-photonic crystal slab

Authors: I. Septembre, C. Leblanc, L. Hermet, H. S. Nguyen, X. Letartre, D. D. Solnyshkov, G. Malpuech

Abstract: We propose theoretically a scheme to get a room-temperature 2D topological exciton-polariton laser with propagating topological lasing modes. The structure uses guided modes in a photonic crystal slab. A ZnO layer provides strong excitonic resonances stable at room temperature. It is capped by a TiO$_2$ layer pierced by a triangular lattice. The exciton-polariton modes of the 3D structure are comp… ▽ More We propose theoretically a scheme to get a room-temperature 2D topological exciton-polariton laser with propagating topological lasing modes. The structure uses guided modes in a photonic crystal slab. A ZnO layer provides strong excitonic resonances stable at room temperature. It is capped by a TiO$_2$ layer pierced by a triangular lattice. The exciton-polariton modes of the 3D structure are computed by solving numerically Maxwell's equations including the excitonic response. The designed triangular lattice shows a transverse electric gap. The triangular lattice is shown to be the limit of a staggered honeycomb lattice when one of the sub-lattices vanishes. Its topology can be characterized by symmetry indicators. The interface between two shifted triangular lattices supports two counter-propagating modes lying in the gap of the bulk modes. The interface states are analogous to quantum pseudospin Hall interface states. These modes show orthogonal polarizations. They can be selectively excited using polarized excitation and are well-protected from back-scattering. These modes can benefit from the exciton-polariton gain at room temperature because of their sufficiently large exciton fraction and favorable position in energy. The strong localization of these propagating modes makes them suitable to host topological lasing triggered by a non-resonant pump localized on the interface. △ Less

Submitted 22 December, 2022; originally announced December 2022.

Taming Friedrich-Wintgen interference in resonant metasurface: vortex laser emitting at on-demand tilted-angle

Authors: Raphael Mermet-Lyaudoz, Clémentine Symond, Florian Berry, Emmanuel Drouard, Céline Chevalier, Gaëlle Trippé-Allard, Emmanuelle Deleporte, Joel Bellessa, Christian Seassal, Hai Son Nguyen

Abstract: Friedrich-Wintgen (FW) interference is an atypical coupling mechanism that grants loss exchange between leaky resonances in non-Hermitian classical and quantum systems. Intriguingly, such an mechanism makes it possible for destructive interference scenario in which a radiating wave becomes a bound state in the continuum (BIC) by giving away all of its losses. Here we propose and demonstrate experi… ▽ More Friedrich-Wintgen (FW) interference is an atypical coupling mechanism that grants loss exchange between leaky resonances in non-Hermitian classical and quantum systems. Intriguingly, such an mechanism makes it possible for destructive interference scenario in which a radiating wave becomes a bound state in the continuum (BIC) by giving away all of its losses. Here we propose and demonstrate experimentally an original concept to tailor FW-BICs as polarization singularity at on-demand wavevectors in optical metasurface. As a proof-of-concept, using hybrid organic-inorganic halide perovskite as active material, we empower this novel polarization singularity to obtain lasing emission exhibiting both highly directional emission at oblique angles and polarization vortex in momentum space. Our results pave the way to steerable coherent emission with tailored polarization pattern for applications in optical communication/manipulation in free-space, high-resolution imaging /focusing and data storage. △ Less

Submitted 20 December, 2022; originally announced December 2022.

Room-temperature strong coupling in a single photon emitter-dielectric metasurface system

Authors: T. Thu Ha Do, Milad Nonahal, Chi Li, Vytautas Valuckas, Arseniy I. Kuznetsov, Hai Son Nguyen, Igor Aharonovich, Son Tung Ha

Abstract: Single-photon sources with high brightness and long coherence time are promising qubit candidates for quantum technology. To this end, interfacing emitters with high-finesse cavities is required, especially in the strong coupling regime, which so far has only been limited to cryogenic temperatures. Here, we experimentally demonstrate, at room temperature, strong coupling between a single photon em… ▽ More Single-photon sources with high brightness and long coherence time are promising qubit candidates for quantum technology. To this end, interfacing emitters with high-finesse cavities is required, especially in the strong coupling regime, which so far has only been limited to cryogenic temperatures. Here, we experimentally demonstrate, at room temperature, strong coupling between a single photon emitter and a novel cavity based on optical bound states in the continuum. A remarkably large Rabi splitting of ~4 meV is achieved thanks to the combination of the narrow linewidth and large oscillator strength of emitters in hexagonal boron nitride and the efficient photon trap** of the cavity. Our findings unveil new opportunities to realise scalable quantum devices and explore fundamentally new regimes of strong coupling in quantum systems at room-temperature. △ Less

Submitted 13 December, 2022; originally announced December 2022.

GONG third generation camera: Detector selection and feasibility study

Authors: Sanjay Gosain, Jack Harvey, Detrick Branson, Steve Bounds, Tim Purdy, Sang Nguyen, Greg Card

Abstract: Aging GONG second generation cameras (Silicon Mountain Design(TM) cameras) were planned to be replaced after their long service of more than a decade. This prompted a market-wide search for a potential replacement detector to meet the GONG science requirements. This report provides some history of the search process, a comparison between CMOS and CCD type sensors and then a quantitative evaluation… ▽ More Aging GONG second generation cameras (Silicon Mountain Design(TM) cameras) were planned to be replaced after their long service of more than a decade. This prompted a market-wide search for a potential replacement detector to meet the GONG science requirements. This report provides some history of the search process, a comparison between CMOS and CCD type sensors and then a quantitative evaluation of potential candidates to arrive at final selection. Further, a feasibility study of the selected sensor for adaptation to GONG optical system was done and sensor characteristics were independently verified in the laboratory. This technical report gives description of these studies and tests. △ Less

Submitted 25 October, 2023; v1 submitted 7 December, 2022; originally announced December 2022.

Comments: 13 pages, 12 figures

Report number: NSO/NISP-2022-003

Enhancing Constraint Programming via Supervised Learning for Job Shop Scheduling

Authors: Yuan Sun, Su Nguyen, Dhananjay Thiruvady, Xiaodong Li, Andreas T. Ernst, Uwe Aickelin

Abstract: Constraint programming (CP) is a powerful technique for solving constraint satisfaction and optimization problems. In CP solvers, the variable ordering strategy used to select which variable to explore first in the solving process has a significant impact on solver effectiveness. To address this issue, we propose a novel variable ordering strategy based on supervised learning, which we evaluate in… ▽ More Constraint programming (CP) is a powerful technique for solving constraint satisfaction and optimization problems. In CP solvers, the variable ordering strategy used to select which variable to explore first in the solving process has a significant impact on solver effectiveness. To address this issue, we propose a novel variable ordering strategy based on supervised learning, which we evaluate in the context of job shop scheduling problems. Our learning-based methods predict the optimal solution of a problem instance and use the predicted solution to order variables for CP solvers. \added[]{Unlike traditional variable ordering methods, our methods can learn from the characteristics of each problem instance and customize the variable ordering strategy accordingly, leading to improved solver performance.} Our experiments demonstrate that training machine learning models is highly efficient and can achieve high accuracy. Furthermore, our learned variable ordering methods perform competitively when compared to four existing methods. Finally, we demonstrate that hybridising the machine learning-based variable ordering methods with traditional domain-based methods is beneficial. △ Less

Submitted 12 April, 2023; v1 submitted 26 November, 2022; originally announced November 2022.

Non-Hermitian topological invariant of photonic band structures undergoing inversion

Authors: Paul Bouteyre, Dung Xuan Nguyen, Guillaume Gachon, Taha Benyattou, Xavier Letartre, Pierre Viktorovitch, Ségolène Callard, Lydie Ferrier, Hai Son Nguyen

Abstract: The interplay between symmetry and topology led to the discovery of symmetry-protected topological phases in Hermitian systems, including topological insulators and topological superconductors. However, the intrinsic symmetry-protected topological characteristics of non-Hermitian systems still await exploration. Here, we investigate experimentally the topological transition associated with the inv… ▽ More The interplay between symmetry and topology led to the discovery of symmetry-protected topological phases in Hermitian systems, including topological insulators and topological superconductors. However, the intrinsic symmetry-protected topological characteristics of non-Hermitian systems still await exploration. Here, we investigate experimentally the topological transition associated with the inversion of non-Hermitian band structures in an optical lattice. Intriguingly, we demonstrate that the winding number associated with the symmetry-protected bound state in the continuum is not a conserved quantity after band inversion. To define a topological invariant, we propose the skyrmion number given by spawning in momentum space a pseudo-spin with the polarisation vortex as the in-plane component and the band-index as the pseudo-spin direction at the origin. This leads to a topological transition from an antimeron to an meron-like texture through band inversion, while always conserving the half-charge skyrmion number. We foresee the use of skyrmion number to explore exotic singularities in various non-Hermitian physical system. △ Less

Submitted 17 November, 2022; originally announced November 2022.

Speeding Up Recommender Systems Using Association Rules

Authors: Eyad Kannout, Hung Son Nguyen, Marek Grzegorowski

Abstract: Recommender systems are considered one of the most rapidly growing branches of Artificial Intelligence. The demand for finding more efficient techniques to generate recommendations becomes urgent. However, many recommendations become useless if there is a delay in generating and showing them to the user. Therefore, we focus on improving the speed of recommendation systems without impacting the acc… ▽ More Recommender systems are considered one of the most rapidly growing branches of Artificial Intelligence. The demand for finding more efficient techniques to generate recommendations becomes urgent. However, many recommendations become useless if there is a delay in generating and showing them to the user. Therefore, we focus on improving the speed of recommendation systems without impacting the accuracy. In this paper, we suggest a novel recommender system based on Factorization Machines and Association Rules (FMAR). We introduce an approach to generate association rules using two algorithms: (i) apriori and (ii) frequent pattern (FP) growth. These association rules will be utilized to reduce the number of items passed to the factorization machines recommendation model. We show that FMAR has significantly decreased the number of new items that the recommender system has to predict and hence, decreased the required time for generating the recommendations. On the other hand, while building the FMAR tool, we concentrate on making a balance between prediction time and accuracy of generated recommendations to ensure that the accuracy is not significantly impacted compared to the accuracy of using factorization machines without association rules. △ Less

Submitted 16 November, 2022; originally announced November 2022.

Comments: 13 pages, 3 figures, 1 table, 14th Asian Conference on Intelligent Information and Database Systems (ACIIDS)

Fermi arc reconstruction in synthetic photonic lattice

Authors: D. -H. -Minh Nguyen, Chiara Devescovi, Dung Xuan Nguyen, Hai Son Nguyen, Dario Bercioux

Abstract: The chiral surface states of Weyl semimetals have an open Fermi surface called Fermi arc. At the interface between two Weyl semimetals, these Fermi arcs are predicted to hybridize and alter their connectivity. In this letter, we numerically study a one-dimensional (1D) dielectric trilayer grating where the relative displacements between adjacent layers play the role of two synthetic momenta. The l… ▽ More The chiral surface states of Weyl semimetals have an open Fermi surface called Fermi arc. At the interface between two Weyl semimetals, these Fermi arcs are predicted to hybridize and alter their connectivity. In this letter, we numerically study a one-dimensional (1D) dielectric trilayer grating where the relative displacements between adjacent layers play the role of two synthetic momenta. The lattice emulates 3D crystals without time-reversal symmetry, including Weyl semimetal, nodal line semimetal, and Chern insulator. Besides showing the phase transition between Weyl semimetal and Chern insulator at telecom wavelength, this system allows us to observe the Fermi arc reconstruction between two Weyl semimetals, confirming the theoretical predictions. △ Less

Submitted 2 July, 2023; v1 submitted 14 November, 2022; originally announced November 2022.

Comments: Main text: 4 pages, 4 figures. Supplemental materials: 19 pages, 18 figures

Journal ref: Phys. Rev. Lett. 131, 053602 (2023)

Adaptive Population-based Simulated Annealing for Uncertain Resource Constrained Job Scheduling

Authors: Dhananjay Thiruvady, Su Nguyen, Yuan Sun, Fatemeh Shiri, Nayyar Zaidi, Xiaodong Li

Abstract: Transporting ore from mines to ports is of significant interest in mining supply chains. These operations are commonly associated with growing costs and a lack of resources. Large mining companies are interested in optimally allocating their resources to reduce operational costs. This problem has been previously investigated in the literature as resource constrained job scheduling (RCJS). While a… ▽ More Transporting ore from mines to ports is of significant interest in mining supply chains. These operations are commonly associated with growing costs and a lack of resources. Large mining companies are interested in optimally allocating their resources to reduce operational costs. This problem has been previously investigated in the literature as resource constrained job scheduling (RCJS). While a number of optimisation methods have been proposed to tackle the deterministic problem, the uncertainty associated with resource availability, an inevitable challenge in mining operations, has received less attention. RCJS with uncertainty is a hard combinatorial optimisation problem that cannot be solved efficiently with existing optimisation methods. This study proposes an adaptive population-based simulated annealing algorithm that can overcome the limitations of existing methods for RCJS with uncertainty including the premature convergence, the excessive number of hyper-parameters, and the inefficiency in co** with different uncertainty levels. This new algorithm is designed to effectively balance exploration and exploitation, by using a population, modifying the cooling schedule in the Metropolis-Hastings algorithm, and using an adaptive mechanism to select perturbation operators. The results show that the proposed algorithm outperforms existing methods across a wide range of benchmark RCJS instances and uncertainty levels. Moreover, new best known solutions are discovered for all but one problem instance across all uncertainty levels. △ Less

Submitted 30 October, 2022; originally announced October 2022.

Journal ref: International Journal of Production Research, 1 - 24 (2024)

Pedestrian Emergency Braking in Ten Weeks

Authors: Steven Nguyen, Zillur Rahman, Brendan Tan Morris

Abstract: In the last decade, research in the field of autonomous vehicles has grown immensely, and there is a wealth of information available for researchers to rapidly establish an autonomous vehicle platform for basic maneuvers. In this paper, we design, implement, and test, in ten weeks, a PD approach to longitudinal control for pedestrian emergency braking. We also propose a lateral controller with a s… ▽ More In the last decade, research in the field of autonomous vehicles has grown immensely, and there is a wealth of information available for researchers to rapidly establish an autonomous vehicle platform for basic maneuvers. In this paper, we design, implement, and test, in ten weeks, a PD approach to longitudinal control for pedestrian emergency braking. We also propose a lateral controller with a similar design for future testing in lane following. Using widely available tools, we demonstrate the safety of the vehicle in pedestrian emergency braking scenarios. △ Less

Submitted 21 October, 2022; originally announced October 2022.

Comments: Accepted for publication, 6 pages

Journal ref: 2022 IEEE International Conference on Vehicular Electronics and Safety (ICVES)

An Efficient Merge Search Matheuristic for Maximising the Net Present Value of Project Schedules

Authors: Dhananjay R. Thiruvady, Su Nguyen, Christian Blum, Andreas T. Ernst

Abstract: Resource constrained project scheduling is an important combinatorial optimisation problem with many practical applications. With complex requirements such as precedence constraints, limited resources, and finance-based objectives, finding optimal solutions for large problem instances is very challenging even with well-customised meta-heuristics and matheuristics. To address this challenge, we pro… ▽ More Resource constrained project scheduling is an important combinatorial optimisation problem with many practical applications. With complex requirements such as precedence constraints, limited resources, and finance-based objectives, finding optimal solutions for large problem instances is very challenging even with well-customised meta-heuristics and matheuristics. To address this challenge, we propose a new math-heuristic algorithm based on Merge Search and parallel computing to solve the resource constrained project scheduling with the aim of maximising the net present value. This paper presents a novel matheuristic framework designed for resource constrained project scheduling, Merge search, which is a variable partitioning and merging mechanism to formulate restricted mixed integer programs with the aim of improving an existing pool of solutions. The solution pool is obtained via a customised parallel ant colony optimisation algorithm, which is also capable of generating high quality solutions on its own. The experimental results show that the proposed method outperforms the current state-of-the-art algorithms on known benchmark problem instances. Further analyses also demonstrate that the proposed algorithm is substantially more efficient compared to its counterparts in respect to its convergence properties when considering multiple cores. △ Less

Submitted 20 October, 2022; originally announced October 2022.

Broad-persistent Advice for Interactive Reinforcement Learning Scenarios

Authors: Francisco Cruz, Adam Bignold, Hung Son Nguyen, Richard Dazeley, Peter Vamplew

Abstract: The use of interactive advice in reinforcement learning scenarios allows for speeding up the learning process for autonomous agents. Current interactive reinforcement learning research has been limited to real-time interactions that offer relevant user advice to the current state only. Moreover, the information provided by each interaction is not retained and instead discarded by the agent after a… ▽ More The use of interactive advice in reinforcement learning scenarios allows for speeding up the learning process for autonomous agents. Current interactive reinforcement learning research has been limited to real-time interactions that offer relevant user advice to the current state only. Moreover, the information provided by each interaction is not retained and instead discarded by the agent after a single use. In this paper, we present a method for retaining and reusing provided knowledge, allowing trainers to give general advice relevant to more than just the current state. Results obtained show that the use of broad-persistent advice substantially improves the performance of the agent while reducing the number of interactions required for the trainer. △ Less

Submitted 11 October, 2022; originally announced October 2022.

Comments: Extended abstract accepted at the 2nd RL-CONFORM Workshop at IEEE/RSJ IROS'22 Conference. 5 pages, 7 figures. arXiv admin note: substantial text overlap with arXiv:2102.02441, arXiv:2110.08003

Theory of photonic crystal polaritons in periodically patterned multilayer waveguides

Authors: Simone Zanotti, Hai Son Nguyen, Momchil Minkov, Lucio Claudio Andreani, Dario Gerace

Abstract: We present a formalism for studying the radiation-matter interaction in multilayered dielectric structures with active semiconductor quantum wells patterned with an in-plane periodic lattice. The theory is based on the diagonalization of the generalized Hopfield matrix, and it includes loss channels in a non-Hermitian formulation. Hybrid elementary excitations named photonic crystal polaritons ari… ▽ More We present a formalism for studying the radiation-matter interaction in multilayered dielectric structures with active semiconductor quantum wells patterned with an in-plane periodic lattice. The theory is based on the diagonalization of the generalized Hopfield matrix, and it includes loss channels in a non-Hermitian formulation. Hybrid elementary excitations named photonic crystal polaritons arise in these systems, whose detailed dispersion and loss characteristics are shown to depend on material composition as well as on symmetry properties of the lattice. We show the generality of the approach by calculating polariton dispersions in very diverse material platforms, such as multilayered perovskite-based lattices or inorganic semiconductor heterostructures. As an application of the method, we show how to engineer lossless polariton modes through excitonic coupling to bound states in the continuum at either zero or finite in-plane wavevector, and discuss their topological properties. Detailed comparison with a semiclassical approach based on the scattering matrix method is provided, which allows to interpret the optical spectra in terms of polarization-dependent excitation of the different polariton branches. This work introduces an efficient and invaluably versatile numerical approach to engineer photonic crystal polaritons, with potential applications ranging from low-threshold lasers to symmetry-protected propagating modes of hybrid radiation-matter states. △ Less

Submitted 30 August, 2022; originally announced August 2022.

Comments: 13 pages, 9 figures, submitted to PRB

Journal ref: Phys. Rev. B 106, 115424 (2022)

MultiPL-E: A Scalable and Extensible Approach to Benchmarking Neural Code Generation

Authors: Federico Cassano, John Gouwar, Daniel Nguyen, Sydney Nguyen, Luna Phipps-Costin, Donald Pinckney, Ming-Ho Yee, Yangtian Zi, Carolyn Jane Anderson, Molly Q Feldman, Arjun Guha, Michael Greenberg, Abhinav Jangda

Abstract: Large language models have demonstrated the ability to generate both natural language and programming language text. Such models open up the possibility of multi-language code generation: could code generation models generalize knowledge from one language to another? Although contemporary code generation models can generate semantically correct Python code, little is known about their abilities wi… ▽ More Large language models have demonstrated the ability to generate both natural language and programming language text. Such models open up the possibility of multi-language code generation: could code generation models generalize knowledge from one language to another? Although contemporary code generation models can generate semantically correct Python code, little is known about their abilities with other languages. We propose MultiPL-E, a system for translating unit test-driven code generation benchmarks to new languages. We create the first massively multilingual code generation benchmark by using MultiPL-E to translate two popular Python code generation benchmarks to 18 additional programming languages. We use MultiPL-E to extend the HumanEval benchmark and MBPP benchmark to 18 languages that encompass a range of programming paradigms and popularity. Using these new parallel benchmarks, we evaluate the multi-language performance of three state-of-the-art code generation models: Codex, CodeGen, and InCoder. We find that Codex matches or even exceeds its performance on Python for several other languages. The range of programming languages represented in MultiPL-E allow us to explore the impact of language frequency and language features on model performance. Finally, the MultiPL-E approach of compiling code generation benchmarks to new programming languages is both scalable and extensible, making it straightforward to evaluate new models, benchmarks, and languages. △ Less

Submitted 19 December, 2022; v1 submitted 17 August, 2022; originally announced August 2022.

Improving Domain Generalization by Learning without Forgetting: Application in Retail Checkout

Authors: Thuy C. Nguyen, Nam LH. Phan, Son T. Nguyen

Abstract: Designing an automatic checkout system for retail stores at the human level accuracy is challenging due to similar appearance products and their various poses. This paper addresses the problem by proposing a method with a two-stage pipeline. The first stage detects class-agnostic items, and the second one is dedicated to classify product categories. We also track the objects across video frames to… ▽ More Designing an automatic checkout system for retail stores at the human level accuracy is challenging due to similar appearance products and their various poses. This paper addresses the problem by proposing a method with a two-stage pipeline. The first stage detects class-agnostic items, and the second one is dedicated to classify product categories. We also track the objects across video frames to avoid duplicated counting. One major challenge is the domain gap because the models are trained on synthetic data but tested on the real images. To reduce the error gap, we adopt domain generalization methods for the first-stage detector. In addition, model ensemble is used to enhance the robustness of the 2nd-stage classifier. The method is evaluated on the AI City challenge 2022 -- Track 4 and gets the F1 score $40\%$ on the test A set. Code is released at the link https://github.com/cybercore-co-ltd/aicity22-track4. △ Less

Submitted 12 July, 2022; originally announced July 2022.

TLETA: Deep Transfer Learning and Integrated Cellular Knowledge for Estimated Time of Arrival Prediction

Authors: Hieu Tran, Son Nguyen, I-Ling Yen, Farokh Bastani

Abstract: Vehicle arrival time prediction has been studied widely. With the emergence of IoT devices and deep learning techniques, estimated time of arrival (ETA) has become a critical component in intelligent transportation systems. Though many tools exist for ETA, ETA for special vehicles, such as ambulances, fire engines, etc., is still challenging due to the limited amount of traffic data for special ve… ▽ More Vehicle arrival time prediction has been studied widely. With the emergence of IoT devices and deep learning techniques, estimated time of arrival (ETA) has become a critical component in intelligent transportation systems. Though many tools exist for ETA, ETA for special vehicles, such as ambulances, fire engines, etc., is still challenging due to the limited amount of traffic data for special vehicles. Existing works use one model for all types of vehicles, which can lead to low accuracy. To tackle this, as the first in the field, we propose a deep transfer learning framework TLETA for the driving time prediction. TLETA constructs cellular spatial-temporal knowledge grids for extracting driving patterns, combined with the road network structure embedding to build a deep neural network for ETA. TLETA contains transferable layers to support knowledge transfer between different categories of vehicles. Importantly, our transfer models only train the last layers to map the transferred knowledge, that reduces the training time significantly. The experimental studies show that our model predicts travel time with high accuracy and outperforms many state-of-the-art approaches. △ Less

Submitted 16 June, 2022; originally announced June 2022.

Comments: 8 pages, 3 figures, 3 tables. The 25th IEEE International Conference on Intelligent Transportation Systems (IEEE ITSC 2022)

Labeled Chip-firing on Binary Trees with $2^n-1$ Chips

Authors: Gregg Musiker, Son Nguyen

Abstract: We study labeled chip-firing on binary trees and some of its modifications. We prove a sorting property of terminal configurations of the process. We also analyze the endgame moves poset and prove that this poset is a modular lattice. We study labeled chip-firing on binary trees and some of its modifications. We prove a sorting property of terminal configurations of the process. We also analyze the endgame moves poset and prove that this poset is a modular lattice. △ Less

Submitted 13 November, 2023; v1 submitted 4 June, 2022; originally announced June 2022.

Comments: Updated version to appear in Annals of Combinatorics

Estimating the Personality of White-Box Language Models

Authors: Saketh Reddy Karra, Son The Nguyen, Theja Tulabandhula

Abstract: Technology for open-ended language generation, a key application of artificial intelligence, has advanced to a great extent in recent years. Large-scale language models, which are trained on large corpora of text, are being used in a wide range of applications everywhere, from virtual assistants to conversational bots. While these language models output fluent text, existing research shows that th… ▽ More Technology for open-ended language generation, a key application of artificial intelligence, has advanced to a great extent in recent years. Large-scale language models, which are trained on large corpora of text, are being used in a wide range of applications everywhere, from virtual assistants to conversational bots. While these language models output fluent text, existing research shows that these models can and do capture human biases. Many of these biases, especially those that could potentially cause harm, are being well-investigated. On the other hand, studies that infer and change human personality traits inherited by these models have been scarce or non-existent. Our work seeks to address this gap by exploring the personality traits of several large-scale language models designed for open-ended text generation and the datasets used for training them. We build on the popular Big Five factors and develop robust methods that quantify the personality traits of these models and their underlying datasets. In particular, we trigger the models with a questionnaire designed for personality assessment and subsequently classify the text responses into quantifiable traits using a Zero-shot classifier. Our estimation scheme sheds light on an important anthropomorphic element found in such AI models and can help stakeholders decide how they should be applied as well as how society could perceive them. Additionally, we examined approaches to alter these personalities, adding to our understanding of how AI models can be adapted to specific contexts. △ Less

Submitted 10 May, 2023; v1 submitted 25 April, 2022; originally announced April 2022.

Coexistence of Surface Lattice Resonances and Bound states In the Continuum in a Plasmonic Lattice

Authors: Quoc Trung Trinh, Sy Khiem Nguyen, Dinh Hai Nguyen, Gia Khanh Tran, Viet Hoang Le, Hai Son Nguyen, Quynh Le-Van

Abstract: We present a numerical study on a 2D array of plasmonic structures covered by a subwavelength film. We explain the origin of surface lattice resonances (SLRs) using coupled dipole approximation and show that the diffraction-assisted plasmonic resonances and formation of bound states in the continuum (BICs) can be controlled by altering the optical environment. Our study shows that when the refract… ▽ More We present a numerical study on a 2D array of plasmonic structures covered by a subwavelength film. We explain the origin of surface lattice resonances (SLRs) using coupled dipole approximation and show that the diffraction-assisted plasmonic resonances and formation of bound states in the continuum (BICs) can be controlled by altering the optical environment. Our study shows that when the refractive index contrast is small ( $Δ$n < -0.1), the SLR cannot be excited, while a significant contrast ($Δ$n > 0.3) not only sustains plasmonic-induced resonances but also forms both symmetry-protected and accidental BICs. The results can aid the streamlined design of plasmonic lattices in studies on light-matter interaction and applications in biosensors and optoelectronic devices. △ Less

Submitted 28 March, 2022; originally announced March 2022.

Journal ref: Optics Letters Vol. 47, Issue 6, pp. 1510-1513 (2022)

Light Management in Perovskite Photovoltaic Solar Cells: a perspective

Authors: Florian Berry, Raphaël Mermet-Lyaudoz, Jose Maria Cuevas Davila, Djihad Amina Djemmah, Hai Son Nguyen, Christian Seassal, Erwann Fourmond, Céline Chevalier, Mohamed Amara, Emmanuel Drouard

Abstract: Light Management (LM) is essential for metal-halide perovskite solar cells in their race for record performance. In this review, criteria on materials, processes and photonic engineering are established such as to enhance mainly the short circuit current density, towards high energy yields. These criteria are used to analyse a large panel of solutions envisaged in the literature for single junctio… ▽ More Light Management (LM) is essential for metal-halide perovskite solar cells in their race for record performance. In this review, criteria on materials, processes and photonic engineering are established such as to enhance mainly the short circuit current density, towards high energy yields. These criteria are used to analyse a large panel of solutions envisaged in the literature for single junction cells. Moreover, a perspective based on rigorous electromagnetic simulations performed on various comparable structures is proposed in order to clarify the conclusions, and to pave the way to further performance enhancement in the case of all-perovskite, two-terminal tandem cells. △ Less

Submitted 25 March, 2022; originally announced March 2022.

IoT Data Discovery: Routing Table and Summarization Techniques

Authors: Hieu Tran, Son Nguyen, I-Ling Yen, Farokh Bastani

Abstract: In this paper, we consider the IoT data discovery problem in very large and growing scale networks. Through analysis, examples, and experimental studies, we show the importance of peer-to-peer, unstructured routing for IoT data discovery and point out the space efficiency issue that has been overlooked in keyword-based routing algorithms in unstructured networks. Specifically, as the first in the… ▽ More In this paper, we consider the IoT data discovery problem in very large and growing scale networks. Through analysis, examples, and experimental studies, we show the importance of peer-to-peer, unstructured routing for IoT data discovery and point out the space efficiency issue that has been overlooked in keyword-based routing algorithms in unstructured networks. Specifically, as the first in the field, this paper investigates routing table designs and various compression techniques to support effective and space-efficient IoT data discovery routing. Novel summarization algorithms, including alphabetical, hash, and meaning-based summarization and their corresponding coding schemes, are proposed. We also consider routing table design to support summarization without degrading lookup efficiency for discovery query routing. The issue of potentially misleading routing due to summarization is also investigated. Subsequently, we analyze the strategy of when to summarize to balance the tradeoff between the routing table compression rate and the chance of causing misleading routing. For the experimental study, we have collected 100K IoT data streams from various IoT databases as the input dataset. Experimental results show that our summarization solution can reduce the routing table size by 20 to 30 folds with a 2-5% increase in latency compared with similar peer-to-peer discovery routing algorithms without summarization. Also, our approach outperforms DHT-based approaches by 2 to 6 folds in terms of latency and traffic. △ Less

Submitted 6 May, 2022; v1 submitted 21 March, 2022; originally announced March 2022.

Comments: 18 pages, 23 figures, 1 table, 3 algorithms. arXiv admin note: substantial text overlap with arXiv:2107.09558

Analytical non-Hermitian description of Photonic Crystals with arbitrary Lateral and Transverse symmetry

Authors: X. Letartre, S. Mazauric, S. Cueff, T. Benyattou, H S. Nguyen, P. Viktorovitch

Abstract: In this work we propose a general theoretical approach to the modelling of complex dispersion characteristics of leaky optical modes operating in photonic crystal slab composed of two high-index contrast gratings, beyond the protection of the light cone. Opening access of wave-guided resonances to free space continuum provides large amount of extra degrees of freedom for mode coupling engineering.… ▽ More In this work we propose a general theoretical approach to the modelling of complex dispersion characteristics of leaky optical modes operating in photonic crystal slab composed of two high-index contrast gratings, beyond the protection of the light cone. Opening access of wave-guided resonances to free space continuum provides large amount of extra degrees of freedom for mode coupling engineering. Not only can the two gratings communicate via near field coupling, but they are also allowed to couple via the propagating radiated field. Our analytical model, based on a non-Hermitian Hamiltonian, including both coupling schemes, allows for a unified description of the wide family of optical modes which may be generated within uni-dimensional photonic crystal. Through a variety of illustrative examples, we show that our theoretical approach provide a simplified categorization of these modes, but it is also a powerful enabler for the discovery of novel photonic species. Finally, as proof-of-concept, we demonstrate experimentally the formation of a Dirac point at the merging of three bound states in the continuum that is the most achieved photonic specie discussed in this work. △ Less

Submitted 6 September, 2022; v1 submitted 10 March, 2022; originally announced March 2022.

Comments: 34 pages, 23 figures

Robots Learn Increasingly Complex Tasks with Intrinsic Motivation and Automatic Curriculum Learning

Authors: Sao Mai Nguyen, Nicolas Duminy, Alexandre Manoury, Dominique Duhaut, Cédric Buche

Abstract: Multi-task learning by robots poses the challenge of the domain knowledge: complexity of tasks, complexity of the actions required, relationship between tasks for transfer learning. We demonstrate that this domain knowledge can be learned to address the challenges in life-long learning. Specifically, the hierarchy between tasks of various complexities is key to infer a curriculum from simple to… ▽ More Multi-task learning by robots poses the challenge of the domain knowledge: complexity of tasks, complexity of the actions required, relationship between tasks for transfer learning. We demonstrate that this domain knowledge can be learned to address the challenges in life-long learning. Specifically, the hierarchy between tasks of various complexities is key to infer a curriculum from simple to composite tasks. We propose a framework for robots to learn sequences of actions of unbounded complexity in order to achieve multiple control tasks of various complexity. Our hierarchical reinforcement learning framework, named SGIM-SAHT, offers a new direction of research, and tries to unify partial implementations on robot arms and mobile robots. We outline our contributions to enable robots to map multiple control tasks to sequences of actions: representations of task dependencies, an intrinsically motivated exploration to learn task hierarchies, and active imitation learning. While learning the hierarchy of tasks, it infers its curriculum by deciding which tasks to explore first, how to transfer knowledge, and when, how and whom to imitate. △ Less

Submitted 11 February, 2022; originally announced February 2022.

Journal ref: KI - K{ü}nstliche Intelligenz, Springer Nature, 2021, 35 (81-90)

Deep Feature Rotation for Multimodal Image Style Transfer

Authors: Son Truong Nguyen, Nguyen Quang Tuyen, Nguyen Hong Phuc

Abstract: Recently, style transfer is a research area that attracts a lot of attention, which transfers the style of an image onto a content target. Extensive research on style transfer has aimed at speeding up processing or generating high-quality stylized images. Most approaches only produce an output from a content and style image pair, while a few others use complex architectures and can only produce a… ▽ More Recently, style transfer is a research area that attracts a lot of attention, which transfers the style of an image onto a content target. Extensive research on style transfer has aimed at speeding up processing or generating high-quality stylized images. Most approaches only produce an output from a content and style image pair, while a few others use complex architectures and can only produce a certain number of outputs. In this paper, we propose a simple method for representing style features in many ways called Deep Feature Rotation (DFR), while not only producing diverse outputs but also still achieving effective stylization compared to more complex methods. Our approach is representative of the many ways of augmentation for intermediate feature embedding without consuming too much computational expense. We also analyze our method by visualizing output in different rotation weights. Our code is available at https://github.com/sonnguyen129/deep-feature-rotation. △ Less

Submitted 9 February, 2022; originally announced February 2022.

Comments: Accepted to NICS'21

Latent Space Simulation for Carbon Capture Design Optimization

Authors: Brian Bartoldson, Rui Wang, Yucheng Fu, David Widemann, Sam Nguyen, Jie Bao, Zhijie Xu, Brenda Ng

Abstract: The CO2 capture efficiency in solvent-based carbon capture systems (CCSs) critically depends on the gas-solvent interfacial area (IA), making maximization of IA a foundational challenge in CCS design. While the IA associated with a particular CCS design can be estimated via a computational fluid dynamics (CFD) simulation, using CFD to derive the IAs associated with numerous CCS designs is prohibit… ▽ More The CO2 capture efficiency in solvent-based carbon capture systems (CCSs) critically depends on the gas-solvent interfacial area (IA), making maximization of IA a foundational challenge in CCS design. While the IA associated with a particular CCS design can be estimated via a computational fluid dynamics (CFD) simulation, using CFD to derive the IAs associated with numerous CCS designs is prohibitively costly. Fortunately, previous works such as Deep Fluids (DF) (Kim et al., 2019) show that large simulation speedups are achievable by replacing CFD simulators with neural network (NN) surrogates that faithfully mimic the CFD simulation process. This raises the possibility of a fast, accurate replacement for a CFD simulator and therefore efficient approximation of the IAs required by CCS design optimization. Thus, here, we build on the DF approach to develop surrogates that can successfully be applied to our complex carbon-capture CFD simulations. Our optimized DF-style surrogates produce large speedups (4000x) while obtaining IA relative errors as low as 4% on unseen CCS configurations that lie within the range of training configurations. This hints at the promise of NN surrogates for our CCS design optimization problem. Nonetheless, DF has inherent limitations with respect to CCS design (e.g., limited transferability of trained models to new CCS packings). We conclude with ideas to address these challenges. △ Less

Submitted 21 December, 2021; originally announced December 2021.

Comments: Extended version of a paper appearing in the Proceedings of the 34th Annual Conference on Innovative Applications of Artificial Intelligence (IAAI-22)

Human Activity Recognition (HAR) in Smart Homes

Authors: Damien Bouchabou, Christophe Lohr, Ioannis Kanellos, Sao Mai Nguyen

Abstract: Generally, Human Activity Recognition (HAR) consists of monitoring and analyzing the behavior of one or more persons in order to deduce their activity. In a smart home context, the HAR consists of monitoring daily activities of the residents. Thanks to this monitoring, a smart home can offer home assistance services to improve quality of life, autonomy and health of their residents, especially for… ▽ More Generally, Human Activity Recognition (HAR) consists of monitoring and analyzing the behavior of one or more persons in order to deduce their activity. In a smart home context, the HAR consists of monitoring daily activities of the residents. Thanks to this monitoring, a smart home can offer home assistance services to improve quality of life, autonomy and health of their residents, especially for elderly and dependent people. △ Less

Submitted 20 December, 2021; originally announced December 2021.

Comments: arXiv admin note: substantial text overlap with arXiv:2111.04418

GeomNet: A Neural Network Based on Riemannian Geometries of SPD Matrix Space and Cholesky Space for 3D Skeleton-Based Interaction Recognition

Authors: Xuan Son Nguyen

Abstract: In this paper, we propose a novel method for representation and classification of two-person interactions from 3D skeleton sequences. The key idea of our approach is to use Gaussian distributions to capture statistics on R n and those on the space of symmetric positive definite (SPD) matrices. The main challenge is how to parametrize those distributions. Towards this end, we develop methods for em… ▽ More In this paper, we propose a novel method for representation and classification of two-person interactions from 3D skeleton sequences. The key idea of our approach is to use Gaussian distributions to capture statistics on R n and those on the space of symmetric positive definite (SPD) matrices. The main challenge is how to parametrize those distributions. Towards this end, we develop methods for embedding Gaussian distributions in matrix groups based on the theory of Lie groups and Riemannian symmetric spaces. Our method relies on the Riemannian geometry of the underlying manifolds and has the advantage of encoding high-order statistics from 3D joint positions. We show that the proposed method achieves competitive results in two-person interaction recognition on three benchmarks for 3D human activity understanding. △ Less

Submitted 25 November, 2021; originally announced November 2021.

Comments: Accepted in ICCV 2021

Three-Way Deep Neural Network for Radio Frequency Map Generation and Source Localization

Authors: Kuldeep S. Gill, Son Nguyen, Myo M. Thein, Alexander M. Wyglinski

Abstract: In this paper, we present a Generative Adversarial Network (GAN) machine learning model to interpolate irregularly distributed measurements across the spatial domain to construct a smooth radio frequency map (RFMap) and then perform localization using a deep neural network. Monitoring wireless spectrum over spatial, temporal, and frequency domains will become a critical feature in facilitating dyn… ▽ More In this paper, we present a Generative Adversarial Network (GAN) machine learning model to interpolate irregularly distributed measurements across the spatial domain to construct a smooth radio frequency map (RFMap) and then perform localization using a deep neural network. Monitoring wireless spectrum over spatial, temporal, and frequency domains will become a critical feature in facilitating dynamic spectrum access (DSA) in beyond-5G and 6G communication technologies. Localization, wireless signal detection, and spectrum policy-making are several of the applications where distributed spectrum sensing will play a significant role. Detection and positioning of wireless emitters is a very challenging task in a large spectral and spatial area. In order to construct a smooth RFMap database, a large number of measurements are required which can be very expensive and time consuming. One approach to help realize these systems is to collect finite localized measurements across a given area and then interpolate the measurement values to construct the database. Current methods in the literature employ channel modeling to construct the radio frequency map, which lacks the granularity for accurate localization whereas our proposed approach reconstructs a new generalized RFMap. Localization results are presented and compared with conventional channel models. △ Less

Submitted 23 November, 2021; originally announced November 2021.

Comments: 5 pages, 5 figures

Using Language Model to Bootstrap Human Activity Recognition Ambient Sensors Based in Smart Homes

Authors: Damien Bouchabou, Sao Mai Nguyen, Christophe Lohr, Benoit Leduc, Ioannis Kanellos

Abstract: Long Short Term Memory LSTM-based structures have demonstrated their efficiency for daily living recognition activities in smart homes by capturing the order of sensor activations and their temporal dependencies. Nevertheless, they still fail in dealing with the semantics and the context of the sensors. More than isolated id and their ordered activation values, sensors also carry meaning. Indeed,… ▽ More Long Short Term Memory LSTM-based structures have demonstrated their efficiency for daily living recognition activities in smart homes by capturing the order of sensor activations and their temporal dependencies. Nevertheless, they still fail in dealing with the semantics and the context of the sensors. More than isolated id and their ordered activation values, sensors also carry meaning. Indeed, their nature and type of activation can translate various activities. Their logs are correlated with each other, creating a global context. We propose to use and compare two Natural Language Processing embedding methods to enhance LSTM-based structures in activity-sequences classification tasks: Word2Vec, a static semantic embedding, and ELMo, a contextualized embedding. Results, on real smart homes datasets, indicate that this approach provides useful information, such as a sensor organization map, and makes less confusion between daily activity classes. It helps to better perform on datasets with competing activities of other residents or pets. Our tests show also that the embeddings can be pretrained on different datasets than the target one, enabling transfer learning. We thus demonstrate that taking into account the context of the sensors and their semantics increases the classification performances and enables transfer learning. △ Less

Submitted 23 November, 2021; originally announced November 2021.

ACM Class: I.5.4; I.2

Journal ref: Electronics, MDPI, 2021, 10 (20), pp.2498

An application of reinforcement learning to residential energy storage under real-time pricing

Authors: Eli Brock, Lauren Bruckstein, Patrick Connor, Sabrina Nguyen, Robert Kerestes, Mai Abdelhakim

Abstract: With the proliferation of advanced metering infrastructure (AMI), more real-time data is available to electric utilities and consumers. Such high volumes of data facilitate innovative electricity rate structures beyond flat-rate and time-of-use (TOU) tariffs. One such innovation is real-time pricing (RTP), in which the wholesale market-clearing price is passed directly to the consumer on an hour-b… ▽ More With the proliferation of advanced metering infrastructure (AMI), more real-time data is available to electric utilities and consumers. Such high volumes of data facilitate innovative electricity rate structures beyond flat-rate and time-of-use (TOU) tariffs. One such innovation is real-time pricing (RTP), in which the wholesale market-clearing price is passed directly to the consumer on an hour-by-hour basis. While rare, RTP exists in parts of the United States and has been observed to reduce electric bills. Although these reductions are largely incidental, RTP may represent an opportunity for large-scale peak shaving, demand response, and economic efficiency when paired with intelligent control systems. Algorithms controlling flexible loads and energy storage have been deployed for demand response elsewhere in the literature, but few studies have investigated these algorithms in an RTP environment. If properly optimized, the dynamic between RTP and intelligent control has the potential to counteract the unwelcome spikes and dips of demand driven by growing penetration of distributed renewable generation and electric vehicles (EV). This paper presents a simple reinforcement learning (RL) application for optimal battery control subject to an RTP signal. △ Less

Submitted 22 November, 2021; originally announced November 2021.

Comments: To be published in the proceedings of the IEEE Power and Energy Society Innovative Smart Grid Technologies (ISGT) Asia Conference

A co-design approach for a rehabilitation robot coach for physical rehabilitation based on the error classification of motion errors

Authors: Maxime Devanne, Sao Mai Nguyen, Olivier Rémy-Néris, Beatrice Le Gales-Garnett, Gilles Kermarrec, André Thépaut

Abstract: The rising number of the elderly incurs growing concern about healthcare, and in particular rehabilitation healthcare. Assistive technology and assistive robotics in particular may help to improve this process. We develop a robot coach capable of demonstrating rehabilitation exercises to patients, watch a patient carry out the exercises and give him feedback so as to improve his performance and en… ▽ More The rising number of the elderly incurs growing concern about healthcare, and in particular rehabilitation healthcare. Assistive technology and assistive robotics in particular may help to improve this process. We develop a robot coach capable of demonstrating rehabilitation exercises to patients, watch a patient carry out the exercises and give him feedback so as to improve his performance and encourage him. The HRI of the system is based on our study with a team of rehabilitation therapists and with the target population.The system relies on human motion analysis. We develop a method for learning a probabilistic representation of ideal movements from expert demonstrations. A Gaussian Mixture Model is employed from position and orientation features captured using a Microsoft Kinect v2. For assessing patients' movements, we propose a real-time multi-level analysis to both temporally and spatially identify and explain body part errors. This analysis combined with a classification algorithm allows the robot to provide coaching advice to make the patient improve his movements. The evaluation on three rehabilitation exercises shows the potential of the proposed approach for learning and assessing kinaesthetic movements. △ Less

Submitted 18 November, 2021; originally announced November 2021.

Comments: IRC 2018 : Second IEEE International Conference on Robotic Computing, Jan 2018, Laguna Hills, CA,, United States

A Survey of Human Activity Recognition in Smart Homes Based on IoT Sensors Algorithms: Taxonomies, Challenges, and Opportunities with Deep Learning

Authors: Damien Bouchabou, Sao Mai Nguyen, Christophe Lohr, Benoit Leduc, Ioannis Kanellos

Abstract: Recent advances in Internet of Things (IoT) technologies and the reduction in the cost of sensors have encouraged the development of smart environments, such as smart homes. Smart homes can offer home assistance services to improve the quality of life, autonomy and health of their residents, especially for the elderly and dependent. To provide such services, a smart home must be able to understand… ▽ More Recent advances in Internet of Things (IoT) technologies and the reduction in the cost of sensors have encouraged the development of smart environments, such as smart homes. Smart homes can offer home assistance services to improve the quality of life, autonomy and health of their residents, especially for the elderly and dependent. To provide such services, a smart home must be able to understand the daily activities of its residents. Techniques for recognizing human activity in smart homes are advancing daily. But new challenges are emerging every day. In this paper, we present recent algorithms, works, challenges and taxonomy of the field of human activity recognition in a smart home through ambient sensors. Moreover, since activity recognition in smart homes is a young field, we raise specific problems, missing and needed contributions. But also propose directions, research opportunities and solutions to accelerate advances in this field. △ Less

Submitted 18 October, 2021; originally announced November 2021.

Journal ref: Sensors, MDPI, 2021, 21

Topological Properties of Photonic Bands with Synthetic Momentum

Authors: H. C. Nguyen, Dung Xuan Nguyen, Thibaud Louvet, Xavier Letartre, Pierre Viktorovitch, Hai Son Nguyen

Abstract: We investigate topological aspects of photonic crystal bands in a hybrid momentum space consisting of a genuine momentum and a synthetic one. The system is realised by a one-dimensional system of bilayer photonic grating, with the translational displacement between the two layers naturally taking the role of the synthetic momentum. Remarkably, the unconventional behaviour of the synthetic momentum… ▽ More We investigate topological aspects of photonic crystal bands in a hybrid momentum space consisting of a genuine momentum and a synthetic one. The system is realised by a one-dimensional system of bilayer photonic grating, with the translational displacement between the two layers naturally taking the role of the synthetic momentum. Remarkably, the unconventional behaviour of the synthetic momentum allows for the existence of non-trivial topological phases of the system associated with a non-zero total Berry flux without breaking the time-reversal symmetry. Moreover, the resulting band structure in the hybrid momentum space realises the interesting dynamics of merging and splitting of twin Dirac points, as well as gap opening as the system parameters vary. Introducing a simple topological argument, we explain all the changes of the total Berry flux associated with the topological phase transitions. As a signature of different topological phases, edge states at their interface are calculated and analysed in detail. The optomechanical nature of the system also allows for the investigation of the adiabatic evolution of the edge states. Our results pave the way to the paradigm of rich topological phenomena of photonic systems with hybrid momentum space. △ Less

Submitted 25 November, 2021; v1 submitted 4 November, 2021; originally announced November 2021.

Comments: 6+18 Pages 14 Figs. Fixed typos

Large-$N_c$ constraints for elastic dark matter-light nucleus scattering in pionless effective field theory

Authors: Thomas R. Richardson, Xincheng Lin, Son T. Nguyen

Abstract: Recent proposals for the use of light nuclei as dark matter direct detection targets necessitate a strong theoretical understanding of the nuclear physics involved. We perform relevant calculations for dark matter-light nucleus scattering in a combined pionless effective field theory and large-$N_c$ expansion, where $N_c$ is the number of quark colors. We include a general set of one-nucleon curre… ▽ More Recent proposals for the use of light nuclei as dark matter direct detection targets necessitate a strong theoretical understanding of the nuclear physics involved. We perform relevant calculations for dark matter-light nucleus scattering in a combined pionless effective field theory and large-$N_c$ expansion, where $N_c$ is the number of quark colors. We include a general set of one-nucleon currents that have been used in other effective theories, as well as novel two-nucleon contact currents. First, we obtain constraints for the relative sizes of the dark matter couplings to the one- and two-nucleon currents through the large-$N_c$ expansion. Then, we use these constraints to make predictions for the relative sizes of spin-dependent and spin-independent cross sections for dark matter scattering off of a nucleon, a deuteron, a triton, and helium-3. △ Less

Submitted 26 October, 2022; v1 submitted 29 October, 2021; originally announced October 2021.

Comments: 27 pages, 9 figures, version accepted for publication in Physical Review C, substantial revisions and additions compared to version 1

Report number: MITP-22-089

Journal ref: Phys. Rev. C 106, 044003 (2022)

Realization of room temperature polaritonic vortex in momentum space with hybrid Perovskite metasurface

Authors: Nguyen Ha My Dang, Simone Zanotti, Céline Chevalier, Gaëlle Trippé-Allard, Emmanuelle Deleporte, Mohamed Amara, Vincenzo Ardizzone, Daniele Sanvitto, Lucio Claudio Andreani, Christian Seassal, Dario Gerace, Hai Son Nguyen

Abstract: Exciton-polaritons are mixed light-matter excitations that result from the strong coupling regime between an active excitonic material and photonic resonances. Harnessing these hybrid excitations provides a rich playground to explore fascinating fundamental features, such as out-of-equilibrium Bose-Einstein condensation and quantum fluids of light, as well as novel mechanisms to be exploited in op… ▽ More Exciton-polaritons are mixed light-matter excitations that result from the strong coupling regime between an active excitonic material and photonic resonances. Harnessing these hybrid excitations provides a rich playground to explore fascinating fundamental features, such as out-of-equilibrium Bose-Einstein condensation and quantum fluids of light, as well as novel mechanisms to be exploited in optoelectronic devices. Here, we investigate experimentally the formation of exciton-polaritons arising from the mixing between hybrid inorganic-organic perovskite excitons and an optical Bound state In a Continuum (BIC) of a subwavelength-scale metasurface, at room temperature. These polaritonic eigenmodes, hereby called polariton BICs (pol-BICs) are revealed in both reflectivity, resonant scattering, and photoluminescence measurements. Although pol-BICs only exhibit a finite quality factor that is bounded by the non-radiative losses of the excitonic component, they fully inherit BIC peculiar features: a full uncoupling from the radiative continuum in the vertical direction, which is associated to a locally vanishing farfield radiation in momentum space. Most importantly, our experimental results confirm that the topological nature of the photonic BIC is perfectly transferred to the pol-BIC. This is evidenced with the observation of a polarization vortex in the farfield of polaritonic emission. Our results pave the way to engineer BIC physics of interacting bosons, as well as novel room temperature polaritonic devices. △ Less

Submitted 29 October, 2021; originally announced October 2021.

A Broad-persistent Advising Approach for Deep Interactive Reinforcement Learning in Robotic Environments

Authors: Hung Son Nguyen, Francisco Cruz, Richard Dazeley

Abstract: Deep Reinforcement Learning (DeepRL) methods have been widely used in robotics to learn about the environment and acquire behaviors autonomously. Deep Interactive Reinforcement Learning (DeepIRL) includes interactive feedback from an external trainer or expert giving advice to help learners choosing actions to speed up the learning process. However, current research has been limited to interaction… ▽ More Deep Reinforcement Learning (DeepRL) methods have been widely used in robotics to learn about the environment and acquire behaviors autonomously. Deep Interactive Reinforcement Learning (DeepIRL) includes interactive feedback from an external trainer or expert giving advice to help learners choosing actions to speed up the learning process. However, current research has been limited to interactions that offer actionable advice to only the current state of the agent. Additionally, the information is discarded by the agent after a single use that causes a duplicate process at the same state for a revisit. In this paper, we present Broad-persistent Advising (BPA), a broad-persistent advising approach that retains and reuses the processed information. It not only helps trainers to give more general advice relevant to similar states instead of only the current state but also allows the agent to speed up the learning process. We test the proposed approach in two continuous robotic scenarios, namely, a cart pole balancing task and a simulated robot navigation task. The obtained results show that the performance of the agent using BPA improves while kee** the number of interactions required for the trainer in comparison to the DeepIRL approach. △ Less

Submitted 18 November, 2021; v1 submitted 15 October, 2021; originally announced October 2021.

Comments: 10 pages

MSC Class: 68T40 ACM Class: I.2.9

A Variability Fault Localization Approach for Software Product Lines

Authors: Thu-Trang Nguyen, Kien-Tuan Ngo, Son Nguyen, Hieu Dinh Vo

Abstract: Software fault localization is one of the most expensive, tedious, and time-consuming activities in program debugging. This activity becomes even much more challenging in Software Product Line (SPL) systems due to variability of failures. These unexpected behaviors are induced by variability faults which can only be exposed under some combinations of system features. The interaction among these fe… ▽ More Software fault localization is one of the most expensive, tedious, and time-consuming activities in program debugging. This activity becomes even much more challenging in Software Product Line (SPL) systems due to variability of failures. These unexpected behaviors are induced by variability faults which can only be exposed under some combinations of system features. The interaction among these features causes the failures of the system. Although localizing bugs in single-system engineering has been studied in-depth, variability fault localization in SPL systems still remains mostly unexplored. In this article, we present VarCop, a novel and effective variability fault localization approach. For an SPL system failed by variability bugs, VarCop isolates suspicious code statements by analyzing the overall test results of the sampled products and their source code. The isolated suspicious statements are the statements related to the interaction among the features which are necessary for the visibility of the bugs in the system. The suspiciousness of each isolated statement is assessed based on both the overall test results of the products containing the statement as well as the detailed results of the test cases executed by the statement in these products. On a large dataset of buggy SPL systems, empirical evaluation shows that VarCop significantly improves two state-of-the-art fault localization techniques by 33% and 50% in ranking the incorrect statements in the systems containing a single bug each. In about two-thirds of the cases, VarCop ranks the buggy statements at the top-3 positions in the resulting lists. For multiple-bug cases, VarCop outperforms the state-of-the-art approaches 2 times and 10 times in the proportion of bugs localized at the top-1 positions. In 22% and 65% of the buggy versions, VarCop correctly ranks at least one bug in a system at the top-1 and top-5 positions. △ Less

Submitted 21 September, 2021; originally announced September 2021.

Comments: Published in IEEE Transactions on Software Engineering (Early Access)

Hybrid Data Augmentation and Deep Attention-based Dilated Convolutional-Recurrent Neural Networks for Speech Emotion Recognition

Authors: Nhat Truong Pham, Duc Ngoc Minh Dang, Sy Dzung Nguyen

Abstract: Speech emotion recognition (SER) has been one of the significant tasks in Human-Computer Interaction (HCI) applications. However, it is hard to choose the optimal features and deal with imbalance labeled data. In this article, we investigate hybrid data augmentation (HDA) methods to generate and balance data based on traditional and generative adversarial networks (GAN) methods. To evaluate the ef… ▽ More Speech emotion recognition (SER) has been one of the significant tasks in Human-Computer Interaction (HCI) applications. However, it is hard to choose the optimal features and deal with imbalance labeled data. In this article, we investigate hybrid data augmentation (HDA) methods to generate and balance data based on traditional and generative adversarial networks (GAN) methods. To evaluate the effectiveness of HDA methods, a deep learning framework namely (ADCRNN) is designed by integrating deep dilated convolutional-recurrent neural networks with an attention mechanism. Besides, we choose 3D log Mel-spectrogram (MelSpec) features as the inputs for the deep learning framework. Furthermore, we reconfigure a loss function by combining a softmax loss and a center loss to classify the emotions. For validating our proposed methods, we use the EmoDB dataset that consists of several emotions with imbalanced samples. Experimental results prove that the proposed methods achieve better accuracy than the state-of-the-art methods on the EmoDB with 87.12% and 88.47% for the traditional and GAN-based methods, respectively. △ Less

Submitted 18 September, 2021; originally announced September 2021.

Comments: 12 pages, 16 figures, 6 tables