Showing 1–50 of 92 results for author: Hoang, L

Mobility and Threshold Voltage Extraction in Transistors with Gate-Voltage-Dependent Contact Resistance

Authors: Robert K. A. Bennett, Lauren Hoang, Connor Cremers, Andrew J. Mannix, Eric Pop

Abstract: The mobility of emerging (e.g., two-dimensional, oxide, organic) semiconductors is commonly estimated from transistor current-voltage measurements. However, such devices often experience contact gating, i.e., electric fields from the gate modulate the contact resistance during measurements, which can lead conventional extraction techniques to estimate mobility incorrectly even by a factor >2. This… ▽ More The mobility of emerging (e.g., two-dimensional, oxide, organic) semiconductors is commonly estimated from transistor current-voltage measurements. However, such devices often experience contact gating, i.e., electric fields from the gate modulate the contact resistance during measurements, which can lead conventional extraction techniques to estimate mobility incorrectly even by a factor >2. This error can be minimized by measuring transistors at high gate-source bias, |$V_\mathrm{gs}$|, but this regime is often inaccessible in emerging devices that suffer from high contact resistance or early gate dielectric breakdown. Here, we propose a method of extracting mobility in transistors with gate-dependent contact resistance that does not require operation at high |$V_\mathrm{gs}$|, enabling accurate mobility extraction even in emerging transistors with strong contact gating. Our approach relies on updating the transfer length method (TLM) and can achieve <10% error even in regimes where conventional techniques overestimate mobility by >2$\times$. △ Less

Submitted 19 June, 2024; v1 submitted 29 April, 2024; originally announced April 2024.

Comments: Corrected values tabulated in Figure 2d (surrounding discussion/conclusions unchanged); updated discussion surrounding Monte Carlo approach for error propagation; corrected typos

The Heisenberg-RIXS instrument at the European XFEL

Authors: Justine Schlappa, Giacomo Ghiringhelli, Benjamin E. Van Kuiken, Martin Teichmann, Piter S. Miedema, Jan Torben Delitz, Natalia Gerasimova, Serguei Molodtsov, Luigi Adriano, Bernard Baranasic, Carsten Broers, Robert Carley, Patrick Gessler, Nahid Ghodrati, David Hickin, Le Phuong Hoang, Manuel Izquierdo, Laurent Mercadier, Giuseppe Mercurio, Sergii Parchenko, Marijan Stupar, Zhong Yin, Leonardo Martinelli, Giacomo Merzoni, Ying Ying Peng , et al. (22 additional authors not shown)

Abstract: Resonant Inelastic X-ray Scattering (RIXS) is an ideal X-ray spectroscopy method to push the combination of energy and time resolutions to the Fourier transform ultimate limit, because it is unaffected by the core-hole lifetime energy broadening. And in pump-probe experiments the interaction time is made very short by the same core-hole lifetime. RIXS is very photon hungry so it takes great advant… ▽ More Resonant Inelastic X-ray Scattering (RIXS) is an ideal X-ray spectroscopy method to push the combination of energy and time resolutions to the Fourier transform ultimate limit, because it is unaffected by the core-hole lifetime energy broadening. And in pump-probe experiments the interaction time is made very short by the same core-hole lifetime. RIXS is very photon hungry so it takes great advantage from high repetition rate pulsed X-ray sources like the European XFEL. The hRIXS instrument is designed for RIXS experiments in the soft X-ray range with energy resolution approaching the Fourier and the Heisenberg limits. It is based on a spherical grating with variable line spacing (VLS) and a position-sensitive 2D detector. Initially, two gratings are installed to adequately cover the whole photon energy range. With optimized spot size on the sample and small pixel detector the energy resolution can be better than 40 meV at any photon energy below 1000 eV. At the SCS instrument of the European XFEL the spectrometer can be easily positioned thanks to air-pads on a high-quality floor, allowing the scattering angle to be continuously adjusted over the 65-145 deg range. It can be coupled to two different sample interaction chamber, one for liquid jets and one for solids, each equipped at the state-of-the-art and compatible for optical laser pum** in collinear geometry. The measured performances, in terms of energy resolution and count rate on the detector, closely match design expectations. hRIXS is open to public users since the summer of 2022. △ Less

Submitted 13 March, 2024; originally announced March 2024.

Comments: 43 pages, 12 figures, Supplemental Material

Chemically Tailored Growth of 2D Semiconductors via Hybrid Metal-Organic Chemical Vapor Deposition

Authors: Zhepeng Zhang, Lauren Hoang, Marisa Hocking, Jenny Hu, Gregory Zaborski Jr., Pooja Reddy, Johnny Dollard, David Goldhaber-Gordon, Tony F. Heinz, Eric Pop, Andrew J. Mannix

Abstract: Two-dimensional (2D) semiconducting transition-metal dichalcogenides (TMDCs) are an exciting platform for new excitonic physics and next-generation electronics, creating a strong demand to understand their growth, do**, and heterostructures. Despite significant progress in solid-source (SS-) and metal-organic chemical vapor deposition (MOCVD), further optimization is necessary to grow highly cry… ▽ More Two-dimensional (2D) semiconducting transition-metal dichalcogenides (TMDCs) are an exciting platform for new excitonic physics and next-generation electronics, creating a strong demand to understand their growth, do**, and heterostructures. Despite significant progress in solid-source (SS-) and metal-organic chemical vapor deposition (MOCVD), further optimization is necessary to grow highly crystalline 2D TMDCs with controlled do**. Here, we report a hybrid MOCVD growth method that combines liquid-phase metal precursor deposition and vapor-phase organo-chalcogen delivery to leverage the advantages of both MOCVD and SS-CVD. Using our hybrid approach, we demonstrate WS$_2$ growth with tunable morphologies - from separated single-crystal domains to continuous monolayer films - on a variety of substrates, including sapphire, SiO$_2$, and Au. These WS$_2$ films exhibit narrow neutral exciton photoluminescence linewidths down to 33 meV and room-temperature mobility up to 34 - 36 cm$^2$V$^-$$^1$s$^-$$^1$). Through simple modifications to the liquid precursor composition, we demonstrate the growth of V-doped WS$_2$, MoxW$_1$$_-$$_x$S$_2$ alloys, and in-plane WS$_2$-MoS$_2$ heterostructures. This work presents an efficient approach for addressing a variety of TMDC synthesis needs on a laboratory scale. △ Less

Submitted 6 March, 2024; originally announced March 2024.

Asymptotic expansions with subordinate variables for solutions of the Navier-Stokes equations

Authors: Luan Hoang

Abstract: We study the three-dimensional Navier-Stokes equations in a periodic domain with the force decaying in time. Although the force has a certain coherent decay, as time tends to infinity, it can be too complicated for the previous theory of asymptotic expansions to be applicable. To deal with this issue, we systematically develop a new theory of asymptotic expansions containing the so-called subordin… ▽ More We study the three-dimensional Navier-Stokes equations in a periodic domain with the force decaying in time. Although the force has a certain coherent decay, as time tends to infinity, it can be too complicated for the previous theory of asymptotic expansions to be applicable. To deal with this issue, we systematically develop a new theory of asymptotic expansions containing the so-called subordinate variables which can be defined recursively. We apply it to obtain an asymptotic expansion for any Leray-Hopf weak solutions. The expansion, in fact, is constructed explicitly and the impact of the subordinate variables can be clearly specified. The complexifications of the Gevrey-Sobolev spaces, and of the Stokes and bilinear operators of the Navier-Stokes equations are utilized to facilitate such a construction. △ Less

Submitted 5 March, 2024; originally announced March 2024.

Comments: 40 pp, submitted for publication. arXiv admin note: text overlap with arXiv:2204.05247

MSC Class: 35Q30; 76D05; 35C20; 41A60

Intrinsic expansions in large Grashof numbers for the steady states of the {N}avier--{S}tokes equations

Authors: Luan Hoang, Michael S. Jolly

Abstract: We enable a theory of intrinsic asymptotic expansions for the steady state solutions of the full Navier--Stokes equations. Such a theory was first developed in \cite{FHJ} for Galerkin approximations. To overcome the lack of local compactness in infinite dimensional spaces, we introduce the notion of asymptotic expansions in nested spaces. When the inclusion maps between these spaces are compact, w… ▽ More We enable a theory of intrinsic asymptotic expansions for the steady state solutions of the full Navier--Stokes equations. Such a theory was first developed in \cite{FHJ} for Galerkin approximations. To overcome the lack of local compactness in infinite dimensional spaces, we introduce the notion of asymptotic expansions in nested spaces. When the inclusion maps between these spaces are compact, we establish the existence of such an asymptotic expansion for a subsequence of any bounded sequence. This consequently yields an intrinsic asymptotic expansion in a single normed space. We apply this result to the steady states of the Navier--Stokes equations by utilizing the spectral fractional Sobolev spaces. In the case of 2D periodic boundary conditions, more properties relating the terms of the asymptotic expansion are obtained. △ Less

Submitted 20 February, 2024; originally announced February 2024.

Comments: 25 pp, submitted for publication

MSC Class: 35Q30; 35C20; 76D05

Adaptive Primal-Dual Method for Safe Reinforcement Learning

Authors: Weiqin Chen, James Onyejizu, Long Vu, Lan Hoang, Dharmashankar Subramanian, Koushik Kar, Sandipan Mishra, Santiago Paternain

Abstract: Primal-dual methods have a natural application in Safe Reinforcement Learning (SRL), posed as a constrained policy optimization problem. In practice however, applying primal-dual methods to SRL is challenging, due to the inter-dependency of the learning rate (LR) and Lagrangian multipliers (dual variables) each time an embedded unconstrained RL problem is solved. In this paper, we propose, analyze… ▽ More Primal-dual methods have a natural application in Safe Reinforcement Learning (SRL), posed as a constrained policy optimization problem. In practice however, applying primal-dual methods to SRL is challenging, due to the inter-dependency of the learning rate (LR) and Lagrangian multipliers (dual variables) each time an embedded unconstrained RL problem is solved. In this paper, we propose, analyze and evaluate adaptive primal-dual (APD) methods for SRL, where two adaptive LRs are adjusted to the Lagrangian multipliers so as to optimize the policy in each iteration. We theoretically establish the convergence, optimality and feasibility of the APD algorithm. Finally, we conduct numerical evaluation of the practical APD algorithm with four well-known environments in Bullet-Safey-Gym employing two state-of-the-art SRL algorithms: PPO-Lagrangian and DDPG-Lagrangian. All experiments show that the practical APD algorithm outperforms (or achieves comparable performance) and attains more stable training than the constant LR cases. Additionally, we substantiate the robustness of selecting the two adaptive LRs by empirical evidence. △ Less

Submitted 1 February, 2024; originally announced February 2024.

Noncollinear electric dipoles in a polar, chiral phase of CsSnBr$_3$ perovskite

Authors: Douglas H. Fabini, Kedar Honasoge, Adi Cohen, Sebastian Bette, Kyle M. McCall, Constantinos C. Stoumpos, Steffen Klenner, Mirjam Zipkat, Le Phuong Hoang, Jürgen Nuss, Reinhard K. Kremer, Mercouri G. Kanatzidis, Omer Yaffe, Stefan Kaiser, Bettina V. Lotsch

Abstract: Polar and chiral crystal symmetries confer a variety of potentially useful functionalities upon solids by coupling otherwise noninteracting mechanical, electronic, optical, and magnetic degrees of freedom. We describe two unstudied phases of the 3D perovskite, CsSnBr$_3$, which emerge below 85 K due to the formation of Sn(II) lone pairs and their interaction with extant octahedral tilts. Phase II… ▽ More Polar and chiral crystal symmetries confer a variety of potentially useful functionalities upon solids by coupling otherwise noninteracting mechanical, electronic, optical, and magnetic degrees of freedom. We describe two unstudied phases of the 3D perovskite, CsSnBr$_3$, which emerge below 85 K due to the formation of Sn(II) lone pairs and their interaction with extant octahedral tilts. Phase II (77 K<$T$<85 K, space group $P2_1/m$) exhibits ferroaxial order driven by a noncollinear pattern of lone pair-driven distortions within the plane normal to the unique octahedral tilt axis, preserving the inversion symmetry observed at higher temperatures. Phase I ($T$<77 K, space group $P2_1$) additionally exhibits ferroelectric order due to distortions along the unique tilt axis, breaking both inversion and mirror symmetries. This polar and chiral phase exhibits second harmonic generation from the bulk and a large, intrinsic polarization$-$electrostriction coefficient along the polar axis ($Q_{22}\approx$1.1 m$^4$ C$^{-2}$), resulting in acute negative thermal expansion ($α_V=-9\times10^{-5}$ K$^{-1}$) through the onset of spontaneous polarization. The unprecedented structures of phases I and II were predicted by recursively following harmonic phonon instabilities to generate a tree of candidate structures and subsequently corroborated by synchrotron X-ray powder diffraction and polarized Raman and $^{81}$Br nuclear quadrupole resonance spectroscopies. Relativistic electronic structure scenarios compatible with reported photoluminescence measurements are discussed. Together, the polar symmetry, small bandgap, large spin-orbit splitting of Sn 5$p$ orbitals, and predicted strain sensitivity of the symmetry-breaking distortions suggest bulk samples and epitaxial films of CsSnBr$_3$ or its neighboring solid solutions as strong candidates for bulk Rashba effects. △ Less

Submitted 25 April, 2024; v1 submitted 15 January, 2024; originally announced January 2024.

Improving Graph Convolutional Networks with Transformer Layer in social-based items recommendation

Authors: Thi Linh Hoang, Tuan Dung Pham, Viet Cuong Ta

Abstract: In this work, we have proposed an approach for improving the GCN for predicting ratings in social networks. Our model is expanded from the standard model with several layers of transformer architecture. The main focus of the paper is on the encoder architecture for node embedding in the network. Using the embedding layer from the graph-based convolution layer, the attention mechanism could rearran… ▽ More In this work, we have proposed an approach for improving the GCN for predicting ratings in social networks. Our model is expanded from the standard model with several layers of transformer architecture. The main focus of the paper is on the encoder architecture for node embedding in the network. Using the embedding layer from the graph-based convolution layer, the attention mechanism could rearrange the feature space to get a more efficient embedding for the downstream task. The experiments showed that our proposed architecture achieves better performance than GCN on the traditional link prediction task. △ Less

Submitted 12 January, 2024; originally announced January 2024.

Controllable Expensive Multi-objective Learning with Warm-starting Bayesian Optimization

Authors: Quang-Huy Nguyen, Long P. Hoang, Hoang V. Viet, Dung D. Le

Abstract: Pareto Set Learning (PSL) is a promising approach for approximating the entire Pareto front in multi-objective optimization (MOO) problems. However, existing derivative-free PSL methods are often unstable and inefficient, especially for expensive black-box MOO problems where objective function evaluations are costly. In this work, we propose to address the instability and inefficiency of existing… ▽ More Pareto Set Learning (PSL) is a promising approach for approximating the entire Pareto front in multi-objective optimization (MOO) problems. However, existing derivative-free PSL methods are often unstable and inefficient, especially for expensive black-box MOO problems where objective function evaluations are costly. In this work, we propose to address the instability and inefficiency of existing PSL methods with a novel controllable PSL method, called Co-PSL. Particularly, Co-PSL consists of two stages: (1) warm-starting Bayesian optimization to obtain quality Gaussian Processes priors and (2) controllable Pareto set learning to accurately acquire a parametric map** from preferences to the corresponding Pareto solutions. The former is to help stabilize the PSL process and reduce the number of expensive function evaluations. The latter is to support real-time trade-off control between conflicting objectives. Performances across synthesis and real-world MOO problems showcase the effectiveness of our Co-PSL for expensive multi-objective optimization tasks. △ Less

Submitted 9 February, 2024; v1 submitted 26 November, 2023; originally announced November 2023.

A new form of asymptotic expansion for non-smooth differential equations with time-decaying forcing functions

Authors: Luan Hoang

Abstract: This article is focused on the asymptotic expansions, as time tends to infinity, of decaying solutions of a system of nonlinear ordinary differential equations. The nonlinear terms in the system may not be smooth in a small neighborhood of the origin. The forcing function decays to zero in a very complicated but coherent way. We prove that, under suitable conditions on the forcing function, every… ▽ More This article is focused on the asymptotic expansions, as time tends to infinity, of decaying solutions of a system of nonlinear ordinary differential equations. The nonlinear terms in the system may not be smooth in a small neighborhood of the origin. The forcing function decays to zero in a very complicated but coherent way. We prove that, under suitable conditions on the forcing function, every decaying solution admits the same asymptotic expansion of a new type. This expansion contains a new variable that allows it to be established in a closed-form, but does not affect the meaning and precision of the expansion. The new variable is introduced to overcome the unsuitability of certain terms resulted from the scaling and shifting method, which is used to deal with the lack of smoothness of the nonlinear terms, and the general form of the forcing function. Moreover, the expansion is constructed explicitly with the use of the complexification method. △ Less

Submitted 28 March, 2024; v1 submitted 19 September, 2023; originally announced September 2023.

Comments: 39 pp, with minor corrections

MSC Class: 34D05; 34E05; 41A60

Biaxial Tensile Strain Enhances Electron Mobility of Monolayer Transition Metal Dichalcogenides

Authors: Jerry A. Yang, Robert K. A. Bennett, Lauren Hoang, Zhepeng Zhang, Kamila J. Thompson, Antonios Michail, John Parthenios, Konstantinos Papagelis, Andrew J. Mannix, Eric Pop

Abstract: Strain engineering can modulate the material properties of two-dimensional (2D) semiconductors for electronic and optoelectronic applications. Recent theory and experiments have found that uniaxial tensile strain can improve the electron mobility of monolayer MoS$_2$, a 2D semiconductor, but the effects of biaxial strain on charge transport are not well-understood in 2D semiconductors. Here, we us… ▽ More Strain engineering can modulate the material properties of two-dimensional (2D) semiconductors for electronic and optoelectronic applications. Recent theory and experiments have found that uniaxial tensile strain can improve the electron mobility of monolayer MoS$_2$, a 2D semiconductor, but the effects of biaxial strain on charge transport are not well-understood in 2D semiconductors. Here, we use biaxial tensile strain on flexible substrates to probe the electron mobility in monolayer WS$_2$ and MoS$_2$ transistors. This approach experimentally achieves ~2x higher on-state current and mobility with ~0.3% applied biaxial strain in WS$_2$, the highest mobility improvement at the lowest strain reported to date. We also examine the mechanisms behind this improvement through density functional theory simulations, concluding that the enhancement is primarily due to reduced intervalley electron-phonon scattering. These results underscore the role of strain engineering 2D semiconductors for flexible electronics, sensors, integrated circuits, and other optoelectronic applications. △ Less

Submitted 28 November, 2023; v1 submitted 19 September, 2023; originally announced September 2023.

Comments: Corrected author list

Probing the Surface Polarization of Ferroelectric Thin Films by X-ray Standing Waves

Authors: Le Phuong Hoang, Irena Spasojevic, Tien-Lin Lee, David Pesquera, Kai Rossnagel, Jörg Zegenhagen, Gustau Catalan, Ivan A. Vartanyants, Andreas Scherz, Giuseppe Mercurio

Abstract: Understanding the mechanisms underlying a stable polarization at the surface of ferroelectric thin films is of particular importance both from a fundamental point of view and to achieve control of the surface polarization itself. In this study, it is demonstrated that the X-ray standing wave technique allows the polarization near the surface of a ferroelectric thin film to be probed directly. The… ▽ More Understanding the mechanisms underlying a stable polarization at the surface of ferroelectric thin films is of particular importance both from a fundamental point of view and to achieve control of the surface polarization itself. In this study, it is demonstrated that the X-ray standing wave technique allows the polarization near the surface of a ferroelectric thin film to be probed directly. The X-ray standing wave technique is employed to determine, with picometer accuracy, Ti and Ba atomic positions near the surface of three differently strained $\mathrm{BaTiO_3}$ thin films grown on scandate substrates, with a $\mathrm{SrRuO_3}$ film as bottom electrode. This technique gives direct access to atomic positions, and thus to the local ferroelectric polarization, within the first 3 unit cells below the surface. By employing X-ray photoelectron spectroscopy, a detailed overview of the oxygen-containing species adsorbed on the surface, upon exposure to ambient conditions, is obtained. The combination of structural and spectroscopic information allows us to conclude on the most plausible mechanisms that stabilize the surface polarization in the three samples under study. The different amplitude and orientation of the local ferroelectric polarizations are associated with surface charges attributed to the type, amount and spatial distribution of the oxygen-containing adsorbates. △ Less

Submitted 4 September, 2023; originally announced September 2023.

On Galerkin approximations of the Navier-Stokes equations in the limit of large Grashof numbers

Authors: Ciprian Foias, Luan Hoang, Michael S. Jolly

Abstract: We examine how stationary solutions to Galerkin approximations of the Navier--Stokes equations behave in the limit as the Grashof number $G$ tends to $\infty$. An appropriate scaling is used to place the Grashof number as a new coefficient of the nonlinear term, while the body force is fixed. A new type of asymptotic expansion, as $G\to\infty$, for a family of solutions is introduced. Relations am… ▽ More We examine how stationary solutions to Galerkin approximations of the Navier--Stokes equations behave in the limit as the Grashof number $G$ tends to $\infty$. An appropriate scaling is used to place the Grashof number as a new coefficient of the nonlinear term, while the body force is fixed. A new type of asymptotic expansion, as $G\to\infty$, for a family of solutions is introduced. Relations among the terms in the expansion are obtained by following a procedure that compares and totally orders positive sequences generated by the expansion. The same methodology applies to the case of perturbed body forces and similar results are obtained. We demonstrate with a class of forces and solutions that have convergent asymptotic expansions in $G$. All the results hold in both two and three dimensions, as well as for both no-slip and periodic boundary conditions. △ Less

Submitted 31 January, 2024; v1 submitted 29 August, 2023; originally announced August 2023.

Comments: 36 pp., corrections, accepted for publication

MSC Class: 35Q30; 76D05; 76F02; 35C20; 41A60

Generalized Bradley-Terry Models for Score Estimation from Paired Comparisons

Authors: Julien Fageot, Sadegh Farhadkhani, Lê Nguyên Hoang, Oscar Villemaud

Abstract: Many applications, e.g. in content recommendation, sports, or recruitment, leverage the comparisons of alternatives to score those alternatives. The classical Bradley-Terry model and its variants have been widely used to do so. The historical model considers binary comparisons (victory or defeat) between alternatives, while more recent developments allow finer comparisons to be taken into account.… ▽ More Many applications, e.g. in content recommendation, sports, or recruitment, leverage the comparisons of alternatives to score those alternatives. The classical Bradley-Terry model and its variants have been widely used to do so. The historical model considers binary comparisons (victory or defeat) between alternatives, while more recent developments allow finer comparisons to be taken into account. In this article, we introduce a probabilistic model encompassing a broad variety of paired comparisons that can take discrete or continuous values. We do so by considering a well-behaved subset of the exponential family, which we call the family of generalized Bradley-Terry (GBT) models, as it includes the classical Bradley-Terry model and many of its variants. Remarkably, we prove that all GBT models are guaranteed to yield a strictly convex negative log-likelihood. Moreover, assuming a Gaussian prior on alternatives' scores, we prove that the maximum a posteriori (MAP) of GBT models, whose existence, uniqueness and fast computation are thus guaranteed, varies monotonically with respect to comparisons (the more A beats B, the better the score of A) and is Lipschitz-resilient with respect to each new comparison (a single new comparison can only have a bounded effect on all the estimated scores). These desirable properties make GBT models appealing for practical use. We illustrate some features of GBT models on simulations. △ Less

Submitted 21 February, 2024; v1 submitted 16 August, 2023; originally announced August 2023.

BatchGNN: Efficient CPU-Based Distributed GNN Training on Very Large Graphs

Authors: Loc Hoang, Rita Brugarolas Brufau, Ke Ding, Bo Wu

Abstract: We present BatchGNN, a distributed CPU system that showcases techniques that can be used to efficiently train GNNs on terabyte-sized graphs. It reduces communication overhead with macrobatching in which multiple minibatches' subgraph sampling and feature fetching are batched into one communication relay to reduce redundant feature fetches when input features are static. BatchGNN provides integrate… ▽ More We present BatchGNN, a distributed CPU system that showcases techniques that can be used to efficiently train GNNs on terabyte-sized graphs. It reduces communication overhead with macrobatching in which multiple minibatches' subgraph sampling and feature fetching are batched into one communication relay to reduce redundant feature fetches when input features are static. BatchGNN provides integrated graph partitioning and native GNN layer implementations to improve runtime, and it can cache aggregated input features to further reduce sampling overhead. BatchGNN achieves an average $3\times$ speedup over DistDGL on three GNN models trained on OGBN graphs, outperforms the runtimes reported by distributed GPU systems $P^3$ and DistDGLv2, and scales to a terabyte-sized graph. △ Less

Submitted 23 June, 2023; originally announced June 2023.

Comments: Edited preprint of a conference submission

Anisotropic flows of Forchheimer-type in porous media and their steady states

Authors: Luan Hoang, Thinh Kieu

Abstract: We study the anisotropic Forchheimer-typed flows for compressible fluids in porous media. The first half of the paper is devoted to understanding the nonlinear structure of the anisotropic momentum equations. Unlike the isotropic flows, the important monotonicity properties are not automatically satisfied in this case. Therefore, various sufficient conditions for them are derived and applied to th… ▽ More We study the anisotropic Forchheimer-typed flows for compressible fluids in porous media. The first half of the paper is devoted to understanding the nonlinear structure of the anisotropic momentum equations. Unlike the isotropic flows, the important monotonicity properties are not automatically satisfied in this case. Therefore, various sufficient conditions for them are derived and applied to the experimental data. In the second half of the paper, we prove the existence and uniqueness of the steady state flows subject to a nonhomogeneous Dirichlet boundary condition. It is also established that these steady states, in appropriate functional spaces, have local Hölder continuous dependence on the forcing function and the boundary data. △ Less

Submitted 8 June, 2023; originally announced June 2023.

Comments: 35 pp, submitted for publication

MSC Class: 76S05; 76N10; 35F60

Professional Basketball Player Behavior Synthesis via Planning with Diffusion

Authors: Xiusi Chen, Wei-Yao Wang, Ziniu Hu, Curtis Chou, Lam Hoang, Kun **, Mingyan Liu, P. Jeffrey Brantingham, Wei Wang

Abstract: Dynamically planning in multi-agent systems has been explored to improve decision-making in various domains. Professional basketball serves as a compelling example of a dynamic spatio-temporal game, encompassing both concealed strategic policies and decision-making. However, processing the diverse on-court signals and navigating the vast space of potential actions and outcomes makes it difficult f… ▽ More Dynamically planning in multi-agent systems has been explored to improve decision-making in various domains. Professional basketball serves as a compelling example of a dynamic spatio-temporal game, encompassing both concealed strategic policies and decision-making. However, processing the diverse on-court signals and navigating the vast space of potential actions and outcomes makes it difficult for existing approaches to swiftly identify optimal strategies in response to evolving circumstances. In this study, we first formulate the sequential decision-making process as a conditional trajectory generation process. We further introduce PLAYBEST (PLAYer BEhavior SynThesis), a method for enhancing player decision-making. We extend the state-of-the-art generative model, diffusion probabilistic model, to learn challenging multi-agent environmental dynamics from historical National Basketball Association (NBA) player motion tracking data. To incorporate data-driven strategies, an auxiliary value function is trained using the play-by-play data with corresponding rewards acting as the plan guidance. To accomplish reward-guided trajectory generation, conditional sampling is introduced to condition the diffusion model on the value function and conduct classifier-guided sampling. We validate the effectiveness of PLAYBEST via comprehensive simulation studies from real-world data, contrasting the generated trajectories and play strategies with those employed by professional basketball teams. Our results reveal that the model excels at generating high-quality basketball trajectories that yield efficient plays, surpassing conventional planning techniques in terms of adaptability, flexibility, and overall performance. Moreover, the synthesized play strategies exhibit a remarkable alignment with professional tactics, highlighting the model's capacity to capture the intricate dynamics of basketball games. △ Less

Submitted 9 June, 2023; v1 submitted 6 June, 2023; originally announced June 2023.

Correlation between Macroscopic and Microscopic Relaxation Dynamics of Water: Evidence for Two Liquid Forms

Authors: Nguyen Q. Vinh, Luan C. Doan, Ngoc L. H. Hoang, Jiarong R. Cui, Ben Sindle

Abstract: Water is vital for life, and without it biomolecules and cells cannot maintain their structures and functions. The remarkable properties of water originate from its ability to form hydrogen-bonding networks and dynamics, which the connectivity constantly alters because of the orientation rotation of individual water molecules. Experimental investigation of the dynamics of water, however, has prove… ▽ More Water is vital for life, and without it biomolecules and cells cannot maintain their structures and functions. The remarkable properties of water originate from its ability to form hydrogen-bonding networks and dynamics, which the connectivity constantly alters because of the orientation rotation of individual water molecules. Experimental investigation of the dynamics of water, however, has proven challenging due to the strong absorption of water at terahertz frequencies. In response, by employing a high-precision terahertz spectrometer, we have measured and characterized the terahertz dielectric response of water from supercooled liquid to near the boiling point to explore the motions. The response reveals dynamic relaxation processes corresponding to the collective orientation, single-molecule rotation, and structural rearrangements resulting from breaking and reforming hydrogen bonds in water. We have observed the direct relationship between the macroscopic and microscopic relaxation dynamics of water, and the results have provided evidence of two liquid forms in water with different transition temperatures and thermal activation energies. The results reported here thus provide an unprecedented opportunity to directly test microscopic computational models of water dynamics. △ Less

Submitted 31 May, 2023; originally announced May 2023.

Journal ref: Journal of Chemical Physics 158, 204507 (2023)

On the finite time blow-ups for solutions of nonlinear differential equations

Authors: Luan Hoang

Abstract: We study systems of nonlinear ordinary differential equations where the dominant term, with respect to large spatial variables, causes blow-ups and is positively homogeneous of a degree $1+α$ for some $α>0$. We prove that the asymptotic behavior of a solution $y(t)$ near a finite blow-up time $T_*$ is $(T_*-t)^{-1/α}ξ_*$ for some nonzero vector $ξ_*$. Specific error estimates for… ▽ More We study systems of nonlinear ordinary differential equations where the dominant term, with respect to large spatial variables, causes blow-ups and is positively homogeneous of a degree $1+α$ for some $α>0$. We prove that the asymptotic behavior of a solution $y(t)$ near a finite blow-up time $T_*$ is $(T_*-t)^{-1/α}ξ_*$ for some nonzero vector $ξ_*$. Specific error estimates for $|(T_*-t)^{1/α}y(t)-ξ_*|$ are provided. In some typical cases, they can be a positive power of $(T_*-t)$ or $1/|\ln(T_*-t)|$. This depends on whether the decaying rate of the lower order term, relative to the size of the dominant term, is of a power or logarithmic form. Similar results are obtained for a class of nonlinear differential inequalities with finite time blow-up solutions. Our results cover larger classes of nonlinear equations, differential inequalities and error estimates than those in the previous work. △ Less

Submitted 15 March, 2023; originally announced March 2023.

Comments: 29 pages, submitted for publication

MSC Class: 34D05; 41A60

A Framework for Controllable Pareto Front Learning with Completed Scalarization Functions and its Applications

Authors: Tran Anh Tuan, Long P. Hoang, Dung D. Le, Tran Ngoc Thang

Abstract: Pareto Front Learning (PFL) was recently introduced as an efficient method for approximating the entire Pareto front, the set of all optimal solutions to a Multi-Objective Optimization (MOO) problem. In the previous work, the map** between a preference vector and a Pareto optimal solution is still ambiguous, rendering its results. This study demonstrates the convergence and completion aspects of… ▽ More Pareto Front Learning (PFL) was recently introduced as an efficient method for approximating the entire Pareto front, the set of all optimal solutions to a Multi-Objective Optimization (MOO) problem. In the previous work, the map** between a preference vector and a Pareto optimal solution is still ambiguous, rendering its results. This study demonstrates the convergence and completion aspects of solving MOO with pseudoconvex scalarization functions and combines them into Hypernetwork in order to offer a comprehensive framework for PFL, called Controllable Pareto Front Learning. Extensive experiments demonstrate that our approach is highly accurate and significantly less computationally expensive than prior methods in term of inference time. △ Less

Submitted 13 August, 2023; v1 submitted 24 February, 2023; originally announced February 2023.

Comments: Under Review at Neural Networks Journal

Envisioning a Human-AI collaborative system to transform policies into decision models

Authors: Vanessa Lopez, Gabriele Picco, Inge Vejsbjerg, Thanh Lam Hoang, Yufang Hou, Marco Luca Sbodio, John Segrave-Daly, Denisa Moga, Sean Swords, Miao Wei, Eoin Carroll

Abstract: Regulations govern many aspects of citizens' daily lives. Governments and businesses routinely automate these in the form of coded rules (e.g., to check a citizen's eligibility for specific benefits). However, the path to automation is long and challenging. To address this, recent global initiatives for digital government, proposing to simultaneously express policy in natural language for human co… ▽ More Regulations govern many aspects of citizens' daily lives. Governments and businesses routinely automate these in the form of coded rules (e.g., to check a citizen's eligibility for specific benefits). However, the path to automation is long and challenging. To address this, recent global initiatives for digital government, proposing to simultaneously express policy in natural language for human consumption as well as computationally amenable rules or code, are gathering broad public-sector interest. We introduce the problem of semi-automatically building decision models from eligibility policies for social services, and present an initial emerging approach to shorten the route from policy documents to executable, interpretable and standardised decision models using AI, NLP and Knowledge Graphs. Despite the many open domain challenges, in this position paper we explore the enormous potential of AI to assist government agencies and policy experts in scaling the production of both human-readable and machine executable policy rules, while improving transparency, interpretability, traceability and accountability of the decision making. △ Less

Submitted 1 November, 2022; originally announced December 2022.

Comments: 9 pages, 7 figures

MSC Class: 68T30 ACM Class: H.4

Improving Pareto Front Learning via Multi-Sample Hypernetworks

Authors: Long P. Hoang, Dung D. Le, Tran Anh Tuan, Tran Ngoc Thang

Abstract: Pareto Front Learning (PFL) was recently introduced as an effective approach to obtain a map** function from a given trade-off vector to a solution on the Pareto front, which solves the multi-objective optimization (MOO) problem. Due to the inherent trade-off between conflicting objectives, PFL offers a flexible approach in many scenarios in which the decision makers can not specify the preferen… ▽ More Pareto Front Learning (PFL) was recently introduced as an effective approach to obtain a map** function from a given trade-off vector to a solution on the Pareto front, which solves the multi-objective optimization (MOO) problem. Due to the inherent trade-off between conflicting objectives, PFL offers a flexible approach in many scenarios in which the decision makers can not specify the preference of one Pareto solution over another, and must switch between them depending on the situation. However, existing PFL methods ignore the relationship between the solutions during the optimization process, which hinders the quality of the obtained front. To overcome this issue, we propose a novel PFL framework namely PHN-HVI, which employs a hypernetwork to generate multiple solutions from a set of diverse trade-off preferences and enhance the quality of the Pareto front by maximizing the Hypervolume indicator defined by these solutions. The experimental results on several MOO machine learning tasks show that the proposed framework significantly outperforms the baselines in producing the trade-off Pareto front. △ Less

Submitted 28 April, 2023; v1 submitted 2 December, 2022; originally announced December 2022.

Comments: Accepted to AAAI-23

Behavior near the extinction time for systems of differential equations with sublinear dissipation terms

Authors: Luan Hoang

Abstract: This paper is focused on the the behavior near the extinction time of solutions of systems of ordinary differential equations with a sublinear dissipation term. Suppose the dissipation tern is a product of a linear operator $A$ and a positively homogeneous scalar function $H$ of a negative degree $-α$. Then any solution with an extinction time $T_*$ behaves like $(T_*-t)^{1/α}ξ_*$ as time… ▽ More This paper is focused on the the behavior near the extinction time of solutions of systems of ordinary differential equations with a sublinear dissipation term. Suppose the dissipation tern is a product of a linear operator $A$ and a positively homogeneous scalar function $H$ of a negative degree $-α$. Then any solution with an extinction time $T_*$ behaves like $(T_*-t)^{1/α}ξ_*$ as time $t\to T_*^-$, where $ξ_*$ is an eigenvector of $A$. The proof first establishes the asymptotic behaviors of the "Dirichlet" quotient and the normalized solution. They are then combined with a perturbation technique that requires the function $H$ to satisfy some pointwise Hölder-like condition. The result allows the higher order terms to be general and the nonlinear function $H$ to take very complicated forms. △ Less

Submitted 30 November, 2022; originally announced November 2022.

Comments: 22 pages, submitted for publication

MSC Class: 34D05; 41A60

Tournesol: Permissionless Collaborative Algorithmic Governance with Security Guarantees

Authors: Lê Nguyên Hoang, Romain Beylerian, Bérangère Colbois, Julien Fageot, Louis Faucon, Aidan Jungo, Alain Le Noac'h, Adrien Matissart, Oscar Villemaud

Abstract: Recommendation algorithms play an increasingly central role in our information ecosystem. Yet, so far, they are mostly designed, parameterized and updated unilaterally by private groups or governmental authorities, based on insecure data from increasingly many fake accounts. In this paper, we present an end-to-end permissionless collaborative algorithmic governance pipeline with security guarantee… ▽ More Recommendation algorithms play an increasingly central role in our information ecosystem. Yet, so far, they are mostly designed, parameterized and updated unilaterally by private groups or governmental authorities, based on insecure data from increasingly many fake accounts. In this paper, we present an end-to-end permissionless collaborative algorithmic governance pipeline with security guarantees, which is deployed on the open-source platform https://tournesol.app. Our pipeline has essentially four steps. First, voting rights are assigned to the contributors, based on Sybil-resilient email domains and on a novel secure trust propagation algorithm. Second, a generalized Bradley-Terry model turns contributors' pairwise alternative comparisons into scores. Third, contributors' scores are collaboratively scaled, by an adaptation of the robust sparse voting solution Mehestan. Finally, scaled scores are post-processed and securely aggregated into human-readable global scores, which are used for recommendation and display. We believe that our pipeline lays an appealing foundation for any collaborative, effective, scalable, fair, interpretable and secure algorithmic governance. △ Less

Submitted 15 August, 2023; v1 submitted 30 October, 2022; originally announced November 2022.

Comments: 33 pages, 8 figures

Long-time behavior of solutions of superlinear systems of differential equations

Authors: Luan Hoang

Abstract: This paper establishes the precise asymptotic behavior, as time $t$ tends to infinity, for nontrivial, decaying solutions of genuinely nonlinear systems of ordinary differential equations. The lowest order term in these systems, when the spatial variables are small, is not linear, but rather positively homogeneous of a degree greater than one. We prove that the solution behaves like $ξt^{-p}$, as… ▽ More This paper establishes the precise asymptotic behavior, as time $t$ tends to infinity, for nontrivial, decaying solutions of genuinely nonlinear systems of ordinary differential equations. The lowest order term in these systems, when the spatial variables are small, is not linear, but rather positively homogeneous of a degree greater than one. We prove that the solution behaves like $ξt^{-p}$, as $t\to\infty$, for a nonzero vector $ξ$ and an explicit number $p>0$. △ Less

Submitted 5 December, 2022; v1 submitted 31 October, 2022; originally announced November 2022.

Comments: 25 pp

MSC Class: 34D05; 41A60

On the Impossible Safety of Large AI Models

Authors: El-Mahdi El-Mhamdi, Sadegh Farhadkhani, Rachid Guerraoui, Nirupam Gupta, Lê-Nguyên Hoang, Rafael Pinot, Sébastien Rouault, John Stephan

Abstract: Large AI Models (LAIMs), of which large language models are the most prominent recent example, showcase some impressive performance. However they have been empirically found to pose serious security issues. This paper systematizes our knowledge about the fundamental impossibility of building arbitrarily accurate and secure machine learning models. More precisely, we identify key challenging featur… ▽ More Large AI Models (LAIMs), of which large language models are the most prominent recent example, showcase some impressive performance. However they have been empirically found to pose serious security issues. This paper systematizes our knowledge about the fundamental impossibility of building arbitrarily accurate and secure machine learning models. More precisely, we identify key challenging features of many of today's machine learning settings. Namely, high accuracy seems to require memorizing large training datasets, which are often user-generated and highly heterogeneous, with both sensitive information and fake users. We then survey statistical lower bounds that, we argue, constitute a compelling case against the possibility of designing high-accuracy LAIMs with strong security guarantees. △ Less

Submitted 9 May, 2023; v1 submitted 30 September, 2022; originally announced September 2022.

Comments: 40 pages

Robust Collaborative Learning with Linear Gradient Overhead

Authors: Sadegh Farhadkhani, Rachid Guerraoui, Nirupam Gupta, Lê Nguyên Hoang, Rafael Pinot, John Stephan

Abstract: Collaborative learning algorithms, such as distributed SGD (or D-SGD), are prone to faulty machines that may deviate from their prescribed algorithm because of software or hardware bugs, poisoned data or malicious behaviors. While many solutions have been proposed to enhance the robustness of D-SGD to such machines, previous works either resort to strong assumptions (trusted server, homogeneous da… ▽ More Collaborative learning algorithms, such as distributed SGD (or D-SGD), are prone to faulty machines that may deviate from their prescribed algorithm because of software or hardware bugs, poisoned data or malicious behaviors. While many solutions have been proposed to enhance the robustness of D-SGD to such machines, previous works either resort to strong assumptions (trusted server, homogeneous data, specific noise model) or impose a gradient computational cost that is several orders of magnitude higher than that of D-SGD. We present MoNNA, a new algorithm that (a) is provably robust under standard assumptions and (b) has a gradient computation overhead that is linear in the fraction of faulty machines, which is conjectured to be tight. Essentially, MoNNA uses Polyak's momentum of local gradients for local updates and nearest-neighbor averaging (NNA) for global mixing, respectively. While MoNNA is rather simple to implement, its analysis has been more challenging and relies on two key elements that may be of independent interest. Specifically, we introduce the mixing criterion of $(α, λ)$-reduction to analyze the non-linear mixing of non-faulty machines, and present a way to control the tension between the momentum and the model drifts. We validate our theory by experiments on image classification and make our code available at https://github.com/LPD-EPFL/robust-collaborative-learning. △ Less

Submitted 3 June, 2023; v1 submitted 22 September, 2022; originally announced September 2022.

Comments: Accepted paper at ICML 2023

Non-ergodic statistics and spectral density estimation for stationary real harmonizable symmetric $α$-stable processes

Authors: Ly Viet Hoang, Evgeny Spodarev

Abstract: We consider non-ergodic class of stationary real harmonizable symmetric $α$-stable processes $X=\left\{X(t):t\in\mathbb{R}\right\}$ with a finite symmetric and absolutely continuous control measure. We refer to its density function as the spectral density of $X$. These processes admit a LePage series representation and are conditionally Gaussian, which allows us to derive the non-ergodic limit of… ▽ More We consider non-ergodic class of stationary real harmonizable symmetric $α$-stable processes $X=\left\{X(t):t\in\mathbb{R}\right\}$ with a finite symmetric and absolutely continuous control measure. We refer to its density function as the spectral density of $X$. These processes admit a LePage series representation and are conditionally Gaussian, which allows us to derive the non-ergodic limit of sample functions on $X$. In particular, we give an explicit expression for the non-ergodic limits of the empirical characteristic function of $X$ and the lag process $\left\{X(t+h)-X(t):t\in\mathbb{R}\right\}$ with $h>0$, respectively. The process admits an equivalent representation as a series of sinusoidal waves with random frequencies which are i.i.d. with the (normalized) spectral density of $X$ as their probability density function. Based on strongly consistent frequency estimation using the periodogram we present a strongly consistent estimator of the spectral density. The periodogram's computation is fast and efficient, and our method is not affected by the non-ergodicity of $X$. △ Less

Submitted 11 December, 2023; v1 submitted 9 September, 2022; originally announced September 2022.

Frequency Hop** Joint Radar-Communications with Hybrid Sub-pulse Frequency and Duration

Authors: Linh Manh Hoang, J. Andrew Zhang, Diep N. Nguyen, Dinh Thai Hoang

Abstract: Frequency-hop** (FH) joint radar-communications (JRC) can offer excellent security for integrated sensing and communication systems. However, existing JRC schemes mainly embed information using only the sub-pulse frequencies and hence the data rate is limited. In this paper, we propose to use both sub-pulse frequencies and durations for information modulation, leading to higher communication dat… ▽ More Frequency-hop** (FH) joint radar-communications (JRC) can offer excellent security for integrated sensing and communication systems. However, existing JRC schemes mainly embed information using only the sub-pulse frequencies and hence the data rate is limited. In this paper, we propose to use both sub-pulse frequencies and durations for information modulation, leading to higher communication data rates. For information demodulation, we propose a novel scheme by using the time-frequency analysis (TFA) technique and a "you only look once" (YOLO)-based detection system. As such, our system does not require channel estimation, simplifying the transmission signal frame design. Simulation results demonstrate the effectiveness of our scheme, and show that it is robust against the Doppler shift and timing offset between the transceiver and the communication receiver. △ Less

Submitted 26 April, 2022; originally announced April 2022.

Comments: 5 pages

The Navier-Stokes equations with body forces decaying coherently in time

Authors: Luan Hoang

Abstract: The long-time behavior of solutions of the three-dimensional Navier--Stokes equations in a periodic domain is studied. The time-dependent body force decays, as time $t$ tends to infinity, in a coherent manner. In fact, it is assumed to have a general and complicated asymptotic expansion which involves complex powers of $e^t$, $t$, $\ln t$, or other iterated logarithmic functions of $t$. We prove t… ▽ More The long-time behavior of solutions of the three-dimensional Navier--Stokes equations in a periodic domain is studied. The time-dependent body force decays, as time $t$ tends to infinity, in a coherent manner. In fact, it is assumed to have a general and complicated asymptotic expansion which involves complex powers of $e^t$, $t$, $\ln t$, or other iterated logarithmic functions of $t$. We prove that all Leray-Hopf weak solutions admit an asymptotic expansion which is independent of the solutions and is uniquely determined by the asymptotic expansion of the body force. The proof makes use of the complexifications of the Gevrey-Sobolev spaces together with those of the Stokes operator and the bilinear form of the Navier-Stokes equations. △ Less

Submitted 11 April, 2022; originally announced April 2022.

Comments: 36 pages, submitted for publication

MSC Class: 35Q30; 76D05; 35C20; 41A60

Robust Sparse Voting

Authors: Youssef Allouah, Rachid Guerraoui, Lê-Nguyên Hoang, Oscar Villemaud

Abstract: Many applications, such as content moderation and recommendation, require reviewing and scoring a large number of alternatives. Doing so robustly is however very challenging. Indeed, voters' inputs are inevitably sparse: most alternatives are only scored by a small fraction of voters. This sparsity amplifies the effects of biased voters introducing unfairness, and of malicious voters seeking to ha… ▽ More Many applications, such as content moderation and recommendation, require reviewing and scoring a large number of alternatives. Doing so robustly is however very challenging. Indeed, voters' inputs are inevitably sparse: most alternatives are only scored by a small fraction of voters. This sparsity amplifies the effects of biased voters introducing unfairness, and of malicious voters seeking to hack the voting process by reporting dishonest scores. We give a precise definition of the problem of robust sparse voting, highlight its underlying technical challenges, and present a novel voting mechanism addressing the problem. We prove that, using this mechanism, no voter can have more than a small parameterizable effect on each alternative's score; a property we call Lipschitz resilience. We also identify conditions of voters comparability under which any unanimous preferences can be recovered, even when each voter provides sparse scores, on a scale that is potentially very different from any other voter's score scale. Proving these properties required us to introduce, analyze and carefully compose novel aggregation primitives which could be of independent interest. △ Less

Submitted 25 January, 2024; v1 submitted 17 February, 2022; originally announced February 2022.

Comments: Accepted at AISTATS 2024

An Equivalence Between Data Poisoning and Byzantine Gradient Attacks

Authors: Sadegh Farhadkhani, Rachid Guerraoui, Lê-Nguyên Hoang, Oscar Villemaud

Abstract: To study the resilience of distributed learning, the "Byzantine" literature considers a strong threat model where workers can report arbitrary gradients to the parameter server. Whereas this model helped obtain several fundamental results, it has sometimes been considered unrealistic, when the workers are mostly trustworthy machines. In this paper, we show a surprising equivalence between this mod… ▽ More To study the resilience of distributed learning, the "Byzantine" literature considers a strong threat model where workers can report arbitrary gradients to the parameter server. Whereas this model helped obtain several fundamental results, it has sometimes been considered unrealistic, when the workers are mostly trustworthy machines. In this paper, we show a surprising equivalence between this model and data poisoning, a threat considered much more realistic. More specifically, we prove that every gradient attack can be reduced to data poisoning, in any personalized federated learning system with PAC guarantees (which we show are both desirable and realistic). This equivalence makes it possible to obtain new impossibility results on the resilience of any "robust" learning algorithm to data poisoning in highly heterogeneous applications, as corollaries of existing impossibility theorems on Byzantine machine learning. Moreover, using our equivalence, we derive a practical attack that we show (theoretically and empirically) can be very effective against classical personalized federated learning models. △ Less

Submitted 20 July, 2022; v1 submitted 17 February, 2022; originally announced February 2022.

Comments: arXiv admin note: text overlap with arXiv:2106.02398

Journal ref: ICML 2022

Multiple Correlated Jammers Nullification using LSTM-based Deep Dueling Neural Network

Authors: Linh Manh Hoang, Diep N. Nguyen, J. Andrew Zhang, Dinh Thai Hoang

Abstract: Suppressing the deliberate interference for wireless networks is critical to guarantee a reliable communication link. However, nullifying the jamming signals can be problematic when the correlations between transmitted jamming signals are deliberately varied over time. Specifically, recent studies reveal that by deliberately varying the correlations among jamming signals, attackers can effectively… ▽ More Suppressing the deliberate interference for wireless networks is critical to guarantee a reliable communication link. However, nullifying the jamming signals can be problematic when the correlations between transmitted jamming signals are deliberately varied over time. Specifically, recent studies reveal that by deliberately varying the correlations among jamming signals, attackers can effectively vary the jamming channels and thus their nullspace, even when the physical channels remain unchanged. That makes the beam-forming matrix derived from the nullspace of the jamming channels unable to suppress the jamming signals. Most existing solutions only consider unchanged correlations or heuristically adapt to the time-varying correlation problem by continuously monitoring the residual jamming signals before updating the beam-forming matrix. In this paper, we systematically formulate the optimization problem of the nullspace estimation and data transmission phases. Even ignoring the unknown strategy of the jammers and the challenging nullspace estimation process, the resulting problem is an integer programming problem, hence intractable to obtain its optimal solution. To tackle it and address the unknown strategy of the jammer, we reformulate the problem using a partially observable semi-Markov decision process (POSMDP) and then design a deep dueling Q-learning based framework to tune the duration of the nullspace estimation and data transmission phases. Extensive simulations demonstrate that the proposed techniques effectively deal with jamming signals whose correlations vary over time, and the range of correlations is unknown. Especially, our techniques do not require continuous monitoring of the residual jamming signals (after the nullification process) before updating the beam-forming matrix. As such, the system is more spectral-efficient and has a lower outage probability. △ Less

Submitted 7 February, 2022; originally announced February 2022.

Comments: The paper is 30 pages long and contains 10 figures

MSC Class: 68M12 ACM Class: H.4.3

Maximum Bayes Smatch Ensemble Distillation for AMR Parsing

Authors: Young-Suk Lee, Ramon Fernandez Astudillo, Thanh Lam Hoang, Tahira Naseem, Radu Florian, Salim Roukos

Abstract: AMR parsing has experienced an unprecendented increase in performance in the last three years, due to a mixture of effects including architecture improvements and transfer learning. Self-learning techniques have also played a role in pushing performance forward. However, for most recent high performant parsers, the effect of self-learning and silver data augmentation seems to be fading. In this pa… ▽ More AMR parsing has experienced an unprecendented increase in performance in the last three years, due to a mixture of effects including architecture improvements and transfer learning. Self-learning techniques have also played a role in pushing performance forward. However, for most recent high performant parsers, the effect of self-learning and silver data augmentation seems to be fading. In this paper we propose to overcome this diminishing returns of silver data by combining Smatch-based ensembling techniques with ensemble distillation. In an extensive experimental setup, we push single model English parser performance to a new state-of-the-art, 85.9 (AMR2.0) and 84.3 (AMR3.0), and return to substantial gains from silver data augmentation. We also attain a new state-of-the-art for cross-lingual AMR parsing for Chinese, German, Italian and Spanish. Finally we explore the impact of the proposed technique on domain adaptation, and show that it can produce gains rivaling those of human annotated data for QALD-9 and achieve a new state-of-the-art for BioAMR. △ Less

Submitted 2 May, 2022; v1 submitted 14 December, 2021; originally announced December 2021.

Journal ref: NAACL-HLT 2022

Asymptotic expansions about infinity for solutions of nonlinear differential equations with coherently decaying forcing functions

Authors: Luan Hoang

Abstract: This paper studies, in fine details, the long-time asymptotic behavior of decaying solutions of a general class of dissipative systems of nonlinear differential equations in complex Euclidean spaces. The forcing functions decay, as time tends to infinity, in a coherent way expressed by combinations of the exponential, power, logarithmic and iterated logarithmic functions. The decay may contain sin… ▽ More This paper studies, in fine details, the long-time asymptotic behavior of decaying solutions of a general class of dissipative systems of nonlinear differential equations in complex Euclidean spaces. The forcing functions decay, as time tends to infinity, in a coherent way expressed by combinations of the exponential, power, logarithmic and iterated logarithmic functions. The decay may contain sinusoidal oscillations not only in time but also in the logarithm and iterated logarithm of time. It is proved that the decaying solutions admit corresponding asymptotic expansions, which can be constructed concretely. In the case of the real Euclidean spaces, the real-valued decaying solutions are proved to admit real-valued asymptotic expansions. Our results unite and extend the theory investigated in many previous works. △ Less

Submitted 29 December, 2021; v1 submitted 8 August, 2021; originally announced August 2021.

Comments: 47 pages, submitted. With corrections

MSC Class: 34E05; 34E10; 41A60

Tournesol: A quest for a large, secure and trustworthy database of reliable human judgments

Authors: Lê-Nguyên Hoang, Louis Faucon, Aidan Jungo, Sergei Volodin, Dalia Papuc, Orfeas Liossatos, Ben Crulis, Mariame Tighanimine, Isabela Constantin, Anastasiia Kucherenko, Alexandre Maurer, Felix Grimberg, Vlad Nitu, Chris Vossen, Sébastien Rouault, El-Mahdi El-Mhamdi

Abstract: Today's large-scale algorithms have become immensely influential, as they recommend and moderate the content that billions of humans are exposed to on a daily basis. They are the de-facto regulators of our societies' information diet, from sha** opinions on public health to organizing groups for social movements. This creates serious concerns, but also great opportunities to promote quality info… ▽ More Today's large-scale algorithms have become immensely influential, as they recommend and moderate the content that billions of humans are exposed to on a daily basis. They are the de-facto regulators of our societies' information diet, from sha** opinions on public health to organizing groups for social movements. This creates serious concerns, but also great opportunities to promote quality information. Addressing the concerns and seizing the opportunities is a challenging, enormous and fabulous endeavor, as intuitively appealing ideas often come with unwanted {\it side effects}, and as it requires us to think about what we deeply prefer. Understanding how today's large-scale algorithms are built is critical to determine what interventions will be most effective. Given that these algorithms rely heavily on {\it machine learning}, we make the following key observation: \emph{any algorithm trained on uncontrolled data must not be trusted}. Indeed, a malicious entity could take control over the data, poison it with dangerously manipulative fabricated inputs, and thereby make the trained algorithm extremely unsafe. We thus argue that the first step towards safe and ethical large-scale algorithms must be the collection of a large, secure and trustworthy dataset of reliable human judgments. To achieve this, we introduce \emph{Tournesol}, an open source platform available at \url{https://tournesol.app}. Tournesol aims to collect a large database of human judgments on what algorithms ought to widely recommend (and what they ought to stop widely recommending). We outline the structure of the Tournesol database, the key features of the Tournesol platform and the main hurdles that must be overcome to make it a successful project. Most importantly, we argue that, if successful, Tournesol may then serve as the essential foundation for any safe and ethical large-scale algorithm. △ Less

Submitted 29 May, 2021; originally announced July 2021.

Comments: 27 pages, 13 figures

Duality-symmetric axion electrodynamics and haloscopes of various geometries

Authors: Dai-Nam Le, Le Phuong Hoang, Binh Xuan Cao

Abstract: Within the dual symmetric point of view, the theory for seeking axion dark matter via haloscope experiments is derived by exactly solving the dual symmetric axion electrodynamics equation. Notwithstanding that the conventional theory of axion electrodynamics presented in [Phys. Rev. Lett. 51, 1415 (1983) and J. Phys. A: Math. Gen. 19, L33 (1986)] is more commonly used in haloscope theory, we show… ▽ More Within the dual symmetric point of view, the theory for seeking axion dark matter via haloscope experiments is derived by exactly solving the dual symmetric axion electrodynamics equation. Notwithstanding that the conventional theory of axion electrodynamics presented in [Phys. Rev. Lett. 51, 1415 (1983) and J. Phys. A: Math. Gen. 19, L33 (1986)] is more commonly used in haloscope theory, we show that the dual symmetric axion electrodynamics has more advantages to apply to haloscope theory. First, the dual symmetric and conventional perspectives of axion electrodynamics coincide under long-wavelength approximation. Moreover, dual symmetric theory can obtain an exact analytical expression of the axion-induced electromagnetic field for any state of axion. This solution has been used in conventional theory for long-wavelength approximation. The difference between two theories can occur in directional axion detection or electric sensing haloscopes. For illustrative purposes, we consider the various type of resonant cavities: cylindrical solenoid, spherical solenoid, two-parallel-sheet cavity, toroidal solenoid with a rectangular cross-section, and with a circular cross-section. The resonance of the axion-induced signal, as well as the ratio of the energy difference over the stored energy inside the cavity, are investigated in these types of cavity. △ Less

Submitted 20 August, 2022; v1 submitted 9 July, 2021; originally announced July 2021.

Comments: 19 pages, 18 figures. Published on Journal of Cosmology and Astroparticle Physics

Journal ref: Journal of Cosmology and Astroparticle Physics 2022, 039 (2022)

Studying a doubly nonlinear model of slightly compressible Forchheimer flows in rotating porous media

Authors: Emine Celik, Luan Hoang, Thinh Kieu

Abstract: We study the generalized Forchheimer flows of slightly compressible fluids in rotating porous media. In the problem's model, the varying density in the Coriolis force is fully accounted for without any simplifications. It results in a doubly nonlinear parabolic equation for the density. We derive a priori estimates for the solutions in terms of the initial, boundary data and physical parameters, e… ▽ More We study the generalized Forchheimer flows of slightly compressible fluids in rotating porous media. In the problem's model, the varying density in the Coriolis force is fully accounted for without any simplifications. It results in a doubly nonlinear parabolic equation for the density. We derive a priori estimates for the solutions in terms of the initial, boundary data and physical parameters, emphasizing on the case of unbounded data. Weighted Poincaré-Sobolev inequalities suitable to the equation's nonlinearity, adapted Moser's iteration and maximum principle are used and combined to obtain different types of estimates. △ Less

Submitted 22 June, 2021; originally announced June 2021.

Comments: 35 pages

MSC Class: 76S05; 76U60; 86A05; 35K20; 35K65

Optimizing Graph Transformer Networks with Graph-based Techniques

Authors: Loc Hoang, Udit Agarwal, Gurbinder Gill, Roshan Dathathri, Abhik Seal, Brian Martin, Keshav **ali

Abstract: Graph transformer networks (GTN) are a variant of graph convolutional networks (GCN) that are targeted to heterogeneous graphs in which nodes and edges have associated type information that can be exploited to improve inference accuracy. GTNs learn important metapaths in the graph, create weighted edges for these metapaths, and use the resulting graph in a GCN. Currently, the only available implem… ▽ More Graph transformer networks (GTN) are a variant of graph convolutional networks (GCN) that are targeted to heterogeneous graphs in which nodes and edges have associated type information that can be exploited to improve inference accuracy. GTNs learn important metapaths in the graph, create weighted edges for these metapaths, and use the resulting graph in a GCN. Currently, the only available implementation of GTNs uses dense matrix multiplication to find metapaths. Unfortunately, the space overhead of this approach can be large, so in practice it is used only for small graphs. In addition, the matrix-based implementation is not fine-grained enough to use random-walk based methods to optimize metapath finding. In this paper, we present a graph-based formulation and implementation of the GTN metapath finding problem. This graph-based formulation has two advantages over the matrix-based approach. First, it is more space efficient than the original GTN implementation and more compute-efficient for metapath sizes of practical interest. Second, it permits us to implement a sampling method that reduces the number of metapaths that must be enumerated, allowing the implementation to be used for larger graphs and larger metapath sizes. Experimental results show that our implementation is $6.5\times$ faster than the original GTN implementation on average for a metapath length of 4, and our sampling implementation is $155\times$ faster on average than this implementation without compromising on the accuracy of the GTN. △ Less

Submitted 15 June, 2021; originally announced June 2021.

Strategyproof Learning: Building Trustworthy User-Generated Datasets

Authors: Sadegh Farhadkhani, Rachid Guerraoui, Lê-Nguyên Hoang

Abstract: We prove in this paper that, perhaps surprisingly, incentivizing data misreporting is not a fatality. By leveraging a careful design of the loss function, we propose Licchavi, a global and personalized learning framework with provable strategyproofness guarantees. Essentially, we prove that no user can gain much by replying to Licchavi's queries with answers that deviate from their true preference… ▽ More We prove in this paper that, perhaps surprisingly, incentivizing data misreporting is not a fatality. By leveraging a careful design of the loss function, we propose Licchavi, a global and personalized learning framework with provable strategyproofness guarantees. Essentially, we prove that no user can gain much by replying to Licchavi's queries with answers that deviate from their true preferences. Interestingly, Licchavi also promotes the desirable "one person, one unit-force vote" fairness principle. Furthermore, our empirical evaluation of its performance showcases Licchavi's real-world applicability. We believe that our results are critical for the safety of any learning scheme that leverages user-generated data. △ Less

Submitted 18 February, 2022; v1 submitted 4 June, 2021; originally announced June 2021.

Comments: 31 pages

On the Strategyproofness of the Geometric Median

Authors: El-Mahdi El-Mhamdi, Sadegh Farhadkhani, Rachid Guerraoui, Lê-Nguyên Hoang

Abstract: The geometric median, an instrumental component of the secure machine learning toolbox, is known to be effective when robustly aggregating models (or gradients), gathered from potentially malicious (or strategic) users. What is less known is the extent to which the geometric median incentivizes dishonest behaviors. This paper addresses this fundamental question by quantifying its strategyproofness… ▽ More The geometric median, an instrumental component of the secure machine learning toolbox, is known to be effective when robustly aggregating models (or gradients), gathered from potentially malicious (or strategic) users. What is less known is the extent to which the geometric median incentivizes dishonest behaviors. This paper addresses this fundamental question by quantifying its strategyproofness. While we observe that the geometric median is not even approximately strategyproof, we prove that it is asymptotically $α$-strategyproof: when the number of users is large enough, a user that misbehaves can gain at most a multiplicative factor $α$, which we compute as a function of the distribution followed by the users. We then generalize our results to the case where users actually care more about specific dimensions, determining how this impacts $α$. We also show how the skewed geometric medians can be used to improve strategyproofness. △ Less

Submitted 2 June, 2023; v1 submitted 4 June, 2021; originally announced June 2021.

Comments: Accepted paper at AISTATS 2023

Inversion of $α$-sine and $α$-cosine transforms on $\mathbb{R}$

Authors: Ly Viet Hoang, Evgeny Spodarev

Abstract: We consider the $α$-sine transform of the form $T_αf(y)=\int_0^\infty\vert\sin(xy)\vert^αf(x)dx$ for $α>-1$, where $f$ is an integrable function on $\mathbb{R}_+$. First, the inversion of this transform for $α>1$ is discussed in the context of a more general family of integral transforms on the space of weighted, square-integrable functions on the positive real line. In an alternative approach, we… ▽ More We consider the $α$-sine transform of the form $T_αf(y)=\int_0^\infty\vert\sin(xy)\vert^αf(x)dx$ for $α>-1$, where $f$ is an integrable function on $\mathbb{R}_+$. First, the inversion of this transform for $α>1$ is discussed in the context of a more general family of integral transforms on the space of weighted, square-integrable functions on the positive real line. In an alternative approach, we show that the $α$-sine transform of a function $f$ admits a series representation for all $α>-1$, which involves the Fourier transform of $f$ and coefficients which can all be explicitly computed with the Gauss hypergeometric theorem. Based on this series representation we construct a system of linear equations whose solution is an approximation of the Fourier transform of $f$ at equidistant points. Sampling theory and Fourier inversion allow us to compute an estimate of $f$ from its $α$-sine transform. The same approach can be extended to a similar $α$-cosine transform on $\mathbb{R}_+$ for $α>-1$, and the two-dimensional spherical $α$-sine and cosine transforms for $α>-1$, $α\neq 0,2,4,\dots$. In an extensive numerical analysis, we consider a number of examples, and compare the inversion results of both methods presented. △ Less

Submitted 11 June, 2021; v1 submitted 31 March, 2021; originally announced March 2021.

TSEC: a framework for online experimentation under experimental constraints

Authors: Simon Mak, Yuanshuo Zhou, Lavonne Hoang, C. F. Jeff Wu

Abstract: Thompson sampling is a popular algorithm for solving multi-armed bandit problems, and has been applied in a wide range of applications, from website design to portfolio optimization. In such applications, however, the number of choices (or arms) $N$ can be large, and the data needed to make adaptive decisions require expensive experimentation. One is then faced with the constraint of experimenting… ▽ More Thompson sampling is a popular algorithm for solving multi-armed bandit problems, and has been applied in a wide range of applications, from website design to portfolio optimization. In such applications, however, the number of choices (or arms) $N$ can be large, and the data needed to make adaptive decisions require expensive experimentation. One is then faced with the constraint of experimenting on only a small subset of $K \ll N$ arms within each time period, which poses a problem for traditional Thompson sampling. We propose a new Thompson Sampling under Experimental Constraints (TSEC) method, which addresses this so-called "arm budget constraint". TSEC makes use of a Bayesian interaction model with effect hierarchy priors, to model correlations between rewards on different arms. This fitted model is then integrated within Thompson sampling, to jointly identify a good subset of arms for experimentation and to allocate resources over these arms. We demonstrate the effectiveness of TSEC in two problems with arm budget constraints. The first is a simulated website optimization study, where TSEC shows noticeable improvements over industry benchmarks. The second is a portfolio optimization application on industry-based exchange-traded funds, where TSEC provides more consistent and greater wealth accumulation over standard investment strategies. △ Less

Submitted 17 January, 2021; originally announced January 2021.

On cylindrical smooth rational Fano fourfolds

Authors: Hang Thi Anh Nguyen, Michael Hoff, Truong Le Hoang

Abstract: We construct new families of smooth Fano fourfolds with Picard rank $1$ which contain open $\Bbb A^1$-cylinders, that is, Zariski open subsets of the form $Z \times \Bbb A^1$, where $Z$ is a quasiprojective variety. In particular, we show that every Mukai fourfold of genus $8$ is cylindrical and there exists a family of cylindrical Gushel-Mukai fourfolds. We construct new families of smooth Fano fourfolds with Picard rank $1$ which contain open $\Bbb A^1$-cylinders, that is, Zariski open subsets of the form $Z \times \Bbb A^1$, where $Z$ is a quasiprojective variety. In particular, we show that every Mukai fourfold of genus $8$ is cylindrical and there exists a family of cylindrical Gushel-Mukai fourfolds. △ Less

Submitted 24 September, 2021; v1 submitted 12 January, 2021; originally announced January 2021.

Comments: revised version, accepted in the Journal of the Korean Mathematical Society. arXiv admin note: text overlap with arXiv:1406.6339 by other authors

Sandslash: A Two-Level Framework for Efficient Graph Pattern Mining

Authors: Xuhao Chen, Roshan Dathathri, Gurbinder Gill, Loc Hoang, Keshav **ali

Abstract: Graph pattern mining (GPM) is used in diverse application areas including social network analysis, bioinformatics, and chemical engineering. Existing GPM frameworks either provide high-level interfaces for productivity at the cost of expressiveness or provide low-level interfaces that can express a wide variety of GPM algorithms at the cost of increased programming complexity. Moreover, existing s… ▽ More Graph pattern mining (GPM) is used in diverse application areas including social network analysis, bioinformatics, and chemical engineering. Existing GPM frameworks either provide high-level interfaces for productivity at the cost of expressiveness or provide low-level interfaces that can express a wide variety of GPM algorithms at the cost of increased programming complexity. Moreover, existing systems lack the flexibility to explore combinations of optimizations to achieve performance competitive with hand-optimized applications. We present Sandslash, an in-memory Graph Pattern Mining (GPM) framework that uses a novel programming interface to support productive, expressive, and efficient GPM on large graphs. Sandslash provides a high-level API that needs only a specification of the GPM problem, and it implements fast subgraph enumeration, provides efficient data structures, and applies high-level optimizations automatically. To achieve performance competitive with expert-optimized implementations, Sandslash also provides a low-level API that allows users to express algorithm-specific optimizations. This enables Sandslash to support both high-productivity and high-efficiency without losing expressiveness. We evaluate Sandslash on shared-memory machines using five GPM applications and a wide range of large real-world graphs. Experimental results demonstrate that applications written using Sandslash high-level or low-level API outperforms state-of-the-art GPM systems AutoMine, Pangolin, and Peregrine on average by 13.8x, 7.9x, and 5.4x, respectively. We also show that these Sandslash applications outperform expert-optimized GPM implementations by 2.3x on average with less programming effort. △ Less

Submitted 5 November, 2020; originally announced November 2020.

Infinite series asymptotic expansions for decaying solutions of dissipative differential equations with non-smooth nonlinearity

Authors: Dat Cao, Luan Hoang, Thinh Kieu

Abstract: We study the precise asymptotic behavior of a non-trivial solution that converges to zero, as time tends to infinity, of dissipative systems of nonlinear ordinary differential equations. The nonlinear term of the equations may not possess a Taylor series expansion about the origin. This absence technically cripples previous proofs in establishing an asymptotic expansion, as an infinite series, for… ▽ More We study the precise asymptotic behavior of a non-trivial solution that converges to zero, as time tends to infinity, of dissipative systems of nonlinear ordinary differential equations. The nonlinear term of the equations may not possess a Taylor series expansion about the origin. This absence technically cripples previous proofs in establishing an asymptotic expansion, as an infinite series, for such a decaying solution. In the current paper, we overcome this limitation and obtain an infinite series asymptotic expansion, as time goes to infinity. This series expansion provides large time approximations for the solution with the errors decaying exponentially at any given rates. The main idea is to shift the center of the Taylor expansions for the nonlinear term to a non-zero point. Such a point turns out to come from the non-trivial asymptotic behavior of the solution, which we prove by a new and simple method. Our result applies to different classes of non-linear equations that have not been dealt with previously. △ Less

Submitted 2 July, 2021; v1 submitted 14 September, 2020; originally announced September 2020.

Comments: In press

MSC Class: 34E05; 41A60

Journal ref: Qualitative Theory of Dynamical Systems, 2021

Purely Bayesian counterfactuals versus Newcomb's paradox

Authors: Lê Nguyên Hoang

Abstract: This paper proposes a careful separation between an entity's epistemic system and their decision system. Crucially, Bayesian counterfactuals are estimated by the epistemic system; not by the decision system. Based on this remark, I prove the existence of Newcomb-like problems for which an epistemic system necessarily expects the entity to make a counterfactually bad decision. I then address (a sli… ▽ More This paper proposes a careful separation between an entity's epistemic system and their decision system. Crucially, Bayesian counterfactuals are estimated by the epistemic system; not by the decision system. Based on this remark, I prove the existence of Newcomb-like problems for which an epistemic system necessarily expects the entity to make a counterfactually bad decision. I then address (a slight generalization of) Newcomb's paradox. I solve the specific case where the player believes that the predictor applies Bayes rule with a supset of all the data available to the player. I prove that the counterfactual optimality of the 1-Box strategy depends on the player's prior on the predictor's additional data. If these additional data are not expected to reduce sufficiently the predictor's uncertainty on the player's decision, then the player's epistemic system will counterfactually prefer to 2-Box. But if the predictor's data is believed to make them quasi-omniscient, then 1-Box will be counterfactually preferred. Implications of the analysis are then discussed. More generally, I argue that, to better understand or design an entity, it is useful to clearly separate the entity's epistemic, decision, but also data collection, reward and maintenance systems, whether the entity is human, algorithmic or institutional. △ Less

Submitted 10 August, 2020; originally announced August 2020.

Collaborative Learning in the Jungle (Decentralized, Byzantine, Heterogeneous, Asynchronous and Nonconvex Learning)

Authors: El-Mahdi El-Mhamdi, Sadegh Farhadkhani, Rachid Guerraoui, Arsany Guirguis, Lê Nguyên Hoang, Sébastien Rouault

Abstract: We study Byzantine collaborative learning, where $n$ nodes seek to collectively learn from each others' local data. The data distribution may vary from one node to another. No node is trusted, and $f < n$ nodes can behave arbitrarily. We prove that collaborative learning is equivalent to a new form of agreement, which we call averaging agreement. In this problem, nodes start each with an initial v… ▽ More We study Byzantine collaborative learning, where $n$ nodes seek to collectively learn from each others' local data. The data distribution may vary from one node to another. No node is trusted, and $f < n$ nodes can behave arbitrarily. We prove that collaborative learning is equivalent to a new form of agreement, which we call averaging agreement. In this problem, nodes start each with an initial vector and seek to approximately agree on a common vector, which is close to the average of honest nodes' initial vectors. We present two asynchronous solutions to averaging agreement, each we prove optimal according to some dimension. The first, based on the minimum-diameter averaging, requires $ n \geq 6f+1$, but achieves asymptotically the best-possible averaging constant up to a multiplicative constant. The second, based on reliable broadcast and coordinate-wise trimmed mean, achieves optimal Byzantine resilience, i.e., $n \geq 3f+1$. Each of these algorithms induces an optimal Byzantine collaborative learning protocol. In particular, our equivalence yields new impossibility theorems on what any collaborative learning algorithm can achieve in adversarial and heterogeneous environments. △ Less

Submitted 1 December, 2021; v1 submitted 3 August, 2020; originally announced August 2020.

Comments: 34 pages, 1 figure

Journal ref: NeurIPS 2021

Asymptotic expansions for the Lagrangian trajectories from solutions of the Navier-Stokes equations

Authors: Luan Hoang

Abstract: Consider any Leray-Hopf weak solution of the three-dimensional Navier-Stokes equations for incompressible, viscous fluid flows. We prove that any Lagrangian trajectory associated with such a velocity field has an asymptotic expansion, as time tends to infinity, which describes its long-time behavior very precisely. Consider any Leray-Hopf weak solution of the three-dimensional Navier-Stokes equations for incompressible, viscous fluid flows. We prove that any Lagrangian trajectory associated with such a velocity field has an asymptotic expansion, as time tends to infinity, which describes its long-time behavior very precisely. △ Less

Submitted 9 September, 2020; v1 submitted 21 March, 2020; originally announced March 2020.

Comments: 15 pages, in press

Journal ref: Communications in Mathematical Physics (2020)

Subreddit R/unpopularopinion: Against the Spiral of Silence

Authors: Linh Hoang, Gerry Oei, Dasom Eom

Abstract: As a social animal, human conforms to the customs of society, and their behavior and opinions are greatly influenced by social norms [5]. Accordingly, people choose to hide their opinion in front of others when they feel their idea is against majority opinion. This social phenomenon is called the spiral of silence [4]. Recently, the advent of internet technology and online communication has made p… ▽ More As a social animal, human conforms to the customs of society, and their behavior and opinions are greatly influenced by social norms [5]. Accordingly, people choose to hide their opinion in front of others when they feel their idea is against majority opinion. This social phenomenon is called the spiral of silence [4]. Recently, the advent of internet technology and online communication has made people to stand up and express their opinion openly in online space and to break the wall of the spiral of silence [12]. The subreddit r/unpopularopinion has been designed to allow users to share and discuss socially unpopular thought frankly. In this study, we introduce a descriptive study to show how the subreddit r/unpopularopinion helps its users to get over the spiral of silence. The r/unpopularopinion was analyzed based on the findings from community observation and participant interviews. Even though the environment of r/unpopularopinion encourages the users to freely express their opinion, the dominant population of this community is young white males, and the opinions representing their group are supported by general users and come up to the front page. Consequently, the minority opinions are neglected, and it results in another spiral of silence phenomenon. In future research, △ Less

Submitted 9 December, 2019; originally announced December 2019.