Showing 301–350 of 671 results for author: Xiali

Forming Real-World Human-Robot Cooperation for Tasks With General Goal

Authors: Lingfeng Tao, Michael Bowman, Jiucai Zhang, Xiaoli Zhang

Abstract: In human-robot cooperation, the robot cooperates with humans to accomplish the task together. Existing approaches assume the human has a specific goal during the cooperation, and the robot infers and acts toward it. However, in real-world environments, a human usually only has a general goal (e.g., general direction or area in motion planning) at the beginning of the cooperation, which needs to be… ▽ More In human-robot cooperation, the robot cooperates with humans to accomplish the task together. Existing approaches assume the human has a specific goal during the cooperation, and the robot infers and acts toward it. However, in real-world environments, a human usually only has a general goal (e.g., general direction or area in motion planning) at the beginning of the cooperation, which needs to be clarified to a specific goal (i.e., an exact position) during cooperation. The specification process is interactive and dynamic, which depends on the environment and the partner's behavior. The robot that does not consider the goal specification process may cause frustration to the human partner, elongate the time to come to an agreement, and compromise team performance. This work presents the Evolutionary Value Learning approach to model the dynamics of the goal specification process with State-based Multivariate Bayesian Inference and goal specificity-related features. This model enables the robot to enhance the process of the human's goal specification actively and find a cooperative policy in a Deep Reinforcement Learning manner. Our method outperforms existing methods with faster goal specification processes and better team performance in a dynamic ball balancing task with real human subjects. △ Less

Submitted 1 July, 2022; v1 submitted 19 December, 2020; originally announced December 2020.

Comments: Published on RAL

Journal ref: in IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 762-769, April 2022

Microfluidic device coupled with total internal reflection microscopy for in situ observation of precipitation

Authors: Jia Meng, Jae Bem You, Gilmar F. Arends, Hao Hao, Xiaoli Tan, Xuehua Zhang

Abstract: In situ observation of precipitation or phase separation induced by solvent addition is important in studying its dynamics. Combined with optical and fluorescence microscopy, microfluidic devices have been leveraged in studying the phase separation in various materials including biominerals, nanoparticles, and inorganic crystals. However, strong scattering from the subphases in the mixture is prob… ▽ More In situ observation of precipitation or phase separation induced by solvent addition is important in studying its dynamics. Combined with optical and fluorescence microscopy, microfluidic devices have been leveraged in studying the phase separation in various materials including biominerals, nanoparticles, and inorganic crystals. However, strong scattering from the subphases in the mixture is problematic for in situ study of phase separation with high temporal and spatial resolution. In this work, we present a quasi-2D microfluidic device combined with total internal reflection microscopy as an approach for in situ observation of phase separation. The quasi-2D microfluidic device comprises of a shallow main channel and a deep side channel. Mixing between a solution in the main channel (solution A) and another solution (solution B) in the side channel is predominantly driven by diffusion due to high fluid resistance from the shallow height of the main channel, which is confirmed using fluorescence microscopy. Moreover, relying on diffusive mixing, we can control the composition of the mixture in the main channel by tuning the composition of solution B. We demonstrate the application of our method for in situ observation of asphaltene precipitation and beta-alanine crystallization. △ Less

Submitted 13 December, 2020; originally announced December 2020.

Comments: Preprint submitted to The European Physical Journal E

Novel Strongly Correlated Europium Superhydrides

Authors: Dmitrii V. Semenok, Di Zhou, Alexander G. Kvashnin, Xiaoli Huang, Michele Galasso, Ivan A. Kruglov, Anna G. Ivanova, Alexander G. Gavrilyuk, Wuhao Chen, Nikolay V. Tkachenko, Alexander I. Boldyrev, Ivan Troyan, Artem R. Oganov, Tian Cui

Abstract: We conducted a joint experimental-theoretical investigation of the high-pressure chemistry of europium polyhydrides at pressures of 86-130 GPa. We discovered several novel magnetic Eu superhydrides stabilized by anharmonic effects: cubic $EuH_{9}$, hexagonal $EuH_{9}$, and an unexpected cubic (Pm-3n) clathrate phase, $Eu_{8}H_{46}$. Monte Carlo simulations indicate that cubic $EuH_{9}$ has antifer… ▽ More We conducted a joint experimental-theoretical investigation of the high-pressure chemistry of europium polyhydrides at pressures of 86-130 GPa. We discovered several novel magnetic Eu superhydrides stabilized by anharmonic effects: cubic $EuH_{9}$, hexagonal $EuH_{9}$, and an unexpected cubic (Pm-3n) clathrate phase, $Eu_{8}H_{46}$. Monte Carlo simulations indicate that cubic $EuH_{9}$ has antiferromagnetic ordering with T(Neel) up to 24 K, whereas hexagonal $EuH_{9}$ and Pm-3n-$Eu_{8}H_{46}$ possess ferromagnetic ordering with T(Curie) = 137 and 336 K, respectively. The electron-phonon interaction is weak in all studied europium hydrides, and their magnetic ordering excludes s-wave superconductivity, except, perhaps, for distorted pseudohexagonal $EuH_{9}$. The equations of state predicted within the DFT+U approach (the Hubbard corrections were found within linear response theory) are in close agreement with the experimental data. This work shows the great influence of the atomic radius on symmetry-breaking distortions of the crystal structures of superhydrides and on their thermodynamic stability. △ Less

Submitted 10 December, 2020; originally announced December 2020.

Journal ref: J. Phys. Chem. Lett. 2021, 12, XXX, 32-40

Towards explainable message passing networks for predicting carbon dioxide adsorption in metal-organic frameworks

Authors: Ali Raza, Faaiq Waqar, Arni Sturluson, Cory Simon, Xiaoli Fern

Abstract: Metal-organic framework (MOFs) are nanoporous materials that could be used to capture carbon dioxide from the exhaust gas of fossil fuel power plants to mitigate climate change. In this work, we design and train a message passing neural network (MPNN) to predict simulated CO$_2$ adsorption in MOFs. Towards providing insights into what substructures of the MOFs are important for the prediction, we… ▽ More Metal-organic framework (MOFs) are nanoporous materials that could be used to capture carbon dioxide from the exhaust gas of fossil fuel power plants to mitigate climate change. In this work, we design and train a message passing neural network (MPNN) to predict simulated CO$_2$ adsorption in MOFs. Towards providing insights into what substructures of the MOFs are important for the prediction, we introduce a soft attention mechanism into the readout function that quantifies the contributions of the node representations towards the graph representations. We investigate different mechanisms for sparse attention to ensure only the most relevant substructures are identified. △ Less

Submitted 2 December, 2020; originally announced December 2020.

Comments: accepted paper at the Machine Learning for Molecules Workshop - NeurIPS 2020 conference

A Stability Theorem for Maximal $C_{2k+1}$-free Graphs

Authors: Jian Wang, Shipeng Wang, Weihua Yang, Xiaoli Yuan

Abstract: For any positive integer $k$, we show that every maximal $C_{2k+1}$-free graph with at least $n^2/4-o(n^{3/2})$ edges contains an induced complete bipartite subgraph on $(1-o(1))n$ vertices. We also show that this is best possible. For any positive integer $k$, we show that every maximal $C_{2k+1}$-free graph with at least $n^2/4-o(n^{3/2})$ edges contains an induced complete bipartite subgraph on $(1-o(1))n$ vertices. We also show that this is best possible. △ Less

Submitted 8 June, 2021; v1 submitted 23 November, 2020; originally announced November 2020.

Comments: 12 pages

Raman Study of Cooper Pairing Instabilities in (Li$_{1-x}$Fe$_x$)OHFeSe

Authors: Ge He, Dong Li, Daniel Jost, Andi Baum, Peipei Shen, Xiaoli Dong, Zhongxian Zhao, Rudi Hackl

Abstract: We studied the electronic Raman spectra of (Li$_{1-x}$Fe$_x$)OHFeSe as a function of light polarization and temperature. In the B$_{1g}$ spectra alone we observe the redistribution of spectral weight expected for a superconductor and two well-resolved peaks below T$_c$. The nearly resolution-limited peak at 110 cm$^{-1}$ (13.6 meV) is identified as a collective mode. The peak at 190 cm$^{-1}$ (23.… ▽ More We studied the electronic Raman spectra of (Li$_{1-x}$Fe$_x$)OHFeSe as a function of light polarization and temperature. In the B$_{1g}$ spectra alone we observe the redistribution of spectral weight expected for a superconductor and two well-resolved peaks below T$_c$. The nearly resolution-limited peak at 110 cm$^{-1}$ (13.6 meV) is identified as a collective mode. The peak at 190 cm$^{-1}$ (23.6 meV) is presumably another collective mode since the line is symmetric and its energy is significantly below the gap energy observed by single-particle spectroscopies. Given the experimental band structure of (Li$_{1-x}$Fe$_x$)OHFeSe, the most plausible explanations include conventional spin-fluctuation pairing between the electron bands and the incipient hole band and pairing between the hybridized electron bands. The absence of gap features in A$_{1g}$ and B$_{2g}$ symmetry favors the second case. Thus, in spite of various differences between the pnictides and chalcogenides, this Letter demonstrates the proximity of pairing states and the importance of band structure effects in the Fe-based compounds. △ Less

Submitted 19 November, 2020; originally announced November 2020.

Comments: 9 pages, 12 figures

Journal ref: Phys. Rev. Lett. 125, 217002(2020)

Sea-Net: Squeeze-And-Excitation Attention Net For Diabetic Retinopathy Grading

Authors: Ziyuan Zhao, Kartik Chopra, Zeng Zeng, Xiaoli Li

Abstract: Diabetes is one of the most common disease in individuals. \textit{Diabetic retinopathy} (DR) is a complication of diabetes, which could lead to blindness. Automatic DR grading based on retinal images provides a great diagnostic and prognostic value for treatment planning. However, the subtle differences among severity levels make it difficult to capture important features using conventional metho… ▽ More Diabetes is one of the most common disease in individuals. \textit{Diabetic retinopathy} (DR) is a complication of diabetes, which could lead to blindness. Automatic DR grading based on retinal images provides a great diagnostic and prognostic value for treatment planning. However, the subtle differences among severity levels make it difficult to capture important features using conventional methods. To alleviate the problems, a new deep learning architecture for robust DR grading is proposed, referred to as SEA-Net, in which, spatial attention and channel attention are alternatively carried out and boosted with each other, improving the classification performance. In addition, a hybrid loss function is proposed to further maximize the inter-class distance and reduce the intra-class variability. Experimental results have shown the effectiveness of the proposed architecture. △ Less

Submitted 28 October, 2020; originally announced October 2020.

Comments: Accepted to ICIP 2020

Journal ref: 2020 IEEE International Conference on Image Processing (ICIP), pp. 2496-2500

A robust low data solution: dimension prediction of semiconductor nanorods

Authors: Xiaoli Liu, Yang Xu, Jiali Li, Xuanwei Ong, Salwa Ali Ibrahim, Tonio Buonassisi, Xiaonan Wang

Abstract: Precise control over dimension of nanocrystals is critical to tune the properties for various applications. However, the traditional control through experimental optimization is slow, tedious and time consuming. Herein a robust deep neural network-based regression algorithm has been developed for precise prediction of length, width, and aspect ratios of semiconductor nanorods (NRs). Given there is… ▽ More Precise control over dimension of nanocrystals is critical to tune the properties for various applications. However, the traditional control through experimental optimization is slow, tedious and time consuming. Herein a robust deep neural network-based regression algorithm has been developed for precise prediction of length, width, and aspect ratios of semiconductor nanorods (NRs). Given there is limited experimental data available (28 samples), a Synthetic Minority Oversampling Technique for regression (SMOTE-REG) has been employed for the first time for data generation. Deep neural network is further applied to develop regression model which demonstrated the well performed prediction on both the original and generated data with a similar distribution. The prediction model is further validated with additional experimental data, showing accurate prediction results. Additionally, Local Interpretable Model-Agnostic Explanations (LIME) is used to interpret the weight for each variable, which corresponds to its importance towards the target dimension, which is approved to be well correlated well with experimental observations. △ Less

Submitted 27 October, 2020; originally announced October 2020.

Decentralizing Feature Extraction with Quantum Convolutional Neural Network for Automatic Speech Recognition

Authors: Chao-Han Huck Yang, Jun Qi, Samuel Yen-Chi Chen, Pin-Yu Chen, Sabato Marco Siniscalchi, Xiaoli Ma, Chin-Hui Lee

Abstract: We propose a novel decentralized feature extraction approach in federated learning to address privacy-preservation issues for speech recognition. It is built upon a quantum convolutional neural network (QCNN) composed of a quantum circuit encoder for feature extraction, and a recurrent neural network (RNN) based end-to-end acoustic model (AM). To enhance model parameter protection in a decentraliz… ▽ More We propose a novel decentralized feature extraction approach in federated learning to address privacy-preservation issues for speech recognition. It is built upon a quantum convolutional neural network (QCNN) composed of a quantum circuit encoder for feature extraction, and a recurrent neural network (RNN) based end-to-end acoustic model (AM). To enhance model parameter protection in a decentralized architecture, an input speech is first up-streamed to a quantum computing server to extract Mel-spectrogram, and the corresponding convolutional features are encoded using a quantum circuit algorithm with random parameters. The encoded features are then down-streamed to the local RNN model for the final recognition. The proposed decentralized framework takes advantage of the quantum learning progress to secure models and to avoid privacy leakage attacks. Testing on the Google Speech Commands Dataset, the proposed QCNN encoder attains a competitive accuracy of 95.12% in a decentralized model, which is better than the previous architectures using centralized RNN models with convolutional features. We also conduct an in-depth study of different quantum circuit encoder architectures to provide insights into designing QCNN-based feature extractors. Neural saliency analyses demonstrate a correlation between the proposed QCNN features, class activation maps, and input spectrograms. We provide an implementation for future studies. △ Less

Submitted 12 February, 2021; v1 submitted 25 October, 2020; originally announced October 2020.

Comments: Accepted to IEEE ICASSP 2021. Code is available: https://github.com/huckiyang/QuantumSpeech-QCNN

Journal ref: 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

A highly efficient and accurate exponential semi-implicit scalar auxiliary variable (ESI-SAV) approach for dissipative system

Authors: Zhengguang Liu, Xiaoli Li

Abstract: The scalar auxiliary variable (SAV) approach is a very popular and efficient method to simulate various phase field models. To save the computational cost, a new SAV approach is given by introducing a new variable $θ$. The new SAV approach can be proved to save nearly half CPU time of the original SAV approach while kee** all its other advantages. In this paper, we propose a novel technique to c… ▽ More The scalar auxiliary variable (SAV) approach is a very popular and efficient method to simulate various phase field models. To save the computational cost, a new SAV approach is given by introducing a new variable $θ$. The new SAV approach can be proved to save nearly half CPU time of the original SAV approach while kee** all its other advantages. In this paper, we propose a novel technique to construct an exponential semi-implicit scalar auxiliary variable (ESI-SAV) approach without introducing any extra variables. The new proposed method also only needs to solve one linear equation with constant coefficients at each time step. Furthermore, the constructed ESI-SAV method does not need the bounded below restriction of nonlinear free energy potential which is more reasonable and effective for various phase field models. Meanwhile it is easy to construct first-order, second-order and higher-order unconditionally energy stable time-step** schemes. Other than that, the ESI-SAV approach can be proved to be effective to solve the non-gradient but dissipative system such as Navier-Stokes equations. Several numerical examples are provided to demonstrate the improved efficiency and accuracy of the proposed method. △ Less

Submitted 18 October, 2020; originally announced October 2020.

Comments: arXiv admin note: text overlap with arXiv:1912.09263, arXiv:2001.00812

Itô's formula for flows of measures on semimartingales

Authors: Xin Guo, Huyên Pham, Xiaoli Wei

Abstract: We establish Itô's formula along flows of probability measures associated with general semimartingales; this generalizes existing results for flows of measures on Itô processes. Our approach is to first establish Itô's formula for cylindrical functions and then extend it to the general case via function approximation and localization techniques. This general form of Itô's formula enables the der… ▽ More We establish Itô's formula along flows of probability measures associated with general semimartingales; this generalizes existing results for flows of measures on Itô processes. Our approach is to first establish Itô's formula for cylindrical functions and then extend it to the general case via function approximation and localization techniques. This general form of Itô's formula enables the derivation of dynamic programming equations and verification theorems for McKean--Vlasov controls with jump diffusions and for McKean--Vlasov mixed regular-singular control problems. It also allows for generalizing the classical relationship between the maximum principle and the dynamic programming principle to the McKean--Vlasov singular control setting, where the adjoint process is expressed in terms of the derivative of the value function with respect to the probability measures. △ Less

Submitted 17 September, 2022; v1 submitted 11 October, 2020; originally announced October 2020.

MSC Class: 60H30; 60K35; 93E20

SDMTL: Semi-Decoupled Multi-grained Trajectory Learning for 3D human motion prediction

Authors: Xiaoli Liu, Jianqin Yin

Abstract: Predicting future human motion is critical for intelligent robots to interact with humans in the real world, and human motion has the nature of multi-granularity. However, most of the existing work either implicitly modeled multi-granularity information via fixed modes or focused on modeling a single granularity, making it hard to well capture this nature for accurate predictions. In contrast, we… ▽ More Predicting future human motion is critical for intelligent robots to interact with humans in the real world, and human motion has the nature of multi-granularity. However, most of the existing work either implicitly modeled multi-granularity information via fixed modes or focused on modeling a single granularity, making it hard to well capture this nature for accurate predictions. In contrast, we propose a novel end-to-end network, Semi-Decoupled Multi-grained Trajectory Learning network (SDMTL), to predict future poses, which not only flexibly captures rich multi-grained trajectory information but also aggregates multi-granularity information for predictions. Specifically, we first introduce a Brain-inspired Semi-decoupled Motion-sensitive Encoding module (BSME), effectively capturing spatiotemporal features in a semi-decoupled manner. Then, we capture the temporal dynamics of motion trajectory at multi-granularity, including fine granularity and coarse granularity. We learn multi-grained trajectory information using BSMEs hierarchically and further capture the information of temporal evolutional directions at each granularity by gathering the outputs of BSMEs at each granularity and applying temporal convolutions along the motion trajectory. Next, the captured motion dynamics can be further enhanced by aggregating the information of multi-granularity with a weighted summation scheme. Finally, experimental results on two benchmarks, including Human3.6M and CMU-Mocap, show that our method achieves state-of-the-art performance, demonstrating the effectiveness of our proposed method. The code will be available if the paper is accepted. △ Less

Submitted 10 October, 2020; originally announced October 2020.

Dimensional Crossover Tuned by Pressure in Layered Magnetic NiPS3

Authors: Xiaoli Ma, Yimeng Wang, Yunyu Yin, Binbin Yue, Jianhong Dai, Jianting Ji, Feng **, Fang Hong, Jian-Tao Wang, Qingming Zhang, Xiaohui Yu

Abstract: Layered magnetic transition-metal thiophosphate NiPS3 has unique two-dimensional (2D) magnetic properties and electronic behavior. The electronic band structure and corresponding magnetic state are expected to sensitive to the interlayer interaction, which can be tuned by external pressure. Here, we report an insulator-metal transition accompanied with magnetism collapse during the 2D-3D crossover… ▽ More Layered magnetic transition-metal thiophosphate NiPS3 has unique two-dimensional (2D) magnetic properties and electronic behavior. The electronic band structure and corresponding magnetic state are expected to sensitive to the interlayer interaction, which can be tuned by external pressure. Here, we report an insulator-metal transition accompanied with magnetism collapse during the 2D-3D crossover in structure induced by hydrostatic pressure. A two-stage phase transition from monoclinic (C2=m) to trigonal (P-31m) lattice is identified by ab initio simulation and confirmed by high-pressure XRD and Raman data, corresponding to a layer by layer slip mechanism along the a-axis. Temperature dependence resistance measurements and room temperature infrared spectroscopy show that the insulator-metal transition occurs near 20 GPa as well as magnetism collapse, which is further confirmed by low temperature Raman measurement and theoretical calculation. These results establish a strong correlation among the structural change, electric transport, and magnetic phase transition and expand our understandings about the layered magnetic materials. △ Less

Submitted 29 September, 2020; originally announced September 2020.

Comments: 8 pages, 5 figures

Electronic phase diagram of iron chalcogenide superconductors FeSe1-xSx and FeSe1-yTey

Authors: Shaobo Liu, Jie Yuan, Soonsang Huh, Hanyoung Ryu, Mingwei Ma, Wei Hu, Dong Li, Sheng Ma, Shunli Ni, Peipei Shen, Kui **, Li Yu, Changyoung Kim, Fang Zhou, Xiaoli Dong, Zhongxian Zhao

Abstract: Here we establish a combined electronic phase diagram of isoelectronic FeSe1-xSx (0.19 > x > 0.0) and FeSe1-yTey (0.04 < y < 1.0) single crystals. The FeSe1-yTey crystals with y = 0.04 - 0.30 are grown by a hydrothermal ion-deintercalation (HID) method. Based on combined experiments of the specific heat, electrical transport, and angle-resolved photoemission spectroscopy, no signature of the tetra… ▽ More Here we establish a combined electronic phase diagram of isoelectronic FeSe1-xSx (0.19 > x > 0.0) and FeSe1-yTey (0.04 < y < 1.0) single crystals. The FeSe1-yTey crystals with y = 0.04 - 0.30 are grown by a hydrothermal ion-deintercalation (HID) method. Based on combined experiments of the specific heat, electrical transport, and angle-resolved photoemission spectroscopy, no signature of the tetragonal-symmetry-broken transition to orthorhombic (nematic) phase is observed in the HID FeSe1-yTey samples, as compared with the FeSe1-xSx samples showing this transition at Ts. A ubiquitous dip-like temperature dependence of the Hall coefficient is observed around a characteristic temperature T* in the tetragonal regimes, which is well above the superconducting transition. More importantly, we find that the superconducting transition temperature Tc is positively correlated with the Hall-dip temperature T* across the FeSe1-xSx and FeSe1-yTey systems, suggesting that the tetragonal background is a fundamental host for the superconductivity. △ Less

Submitted 28 September, 2020; originally announced September 2020.

Comments: 18 pages, 5 figures

Computation Bits Maximization in a Backscatter Assisted Wirelessly Powered MEC Network

Authors: Liqin Shi, Yinghui Ye, Xiaoli Chu, Guangyue Lu

Abstract: In this paper, we introduce a backscatter assisted wirelessly powered mobile edge computing (MEC) network, where each edge user (EU) can offload task bits to the MEC server via hybrid harvest-then-transmit (HTT) and backscatter communications. In particular, considering a practical non-linear energy harvesting (EH) model and a partial offloading scheme at each EU, we propose a scheme to maximize t… ▽ More In this paper, we introduce a backscatter assisted wirelessly powered mobile edge computing (MEC) network, where each edge user (EU) can offload task bits to the MEC server via hybrid harvest-then-transmit (HTT) and backscatter communications. In particular, considering a practical non-linear energy harvesting (EH) model and a partial offloading scheme at each EU, we propose a scheme to maximize the weighted sum computation bits of all the EUs by jointly optimizing the backscatter reflection coefficient and time, active transmission power and time, local computing frequency and execution time of each EU. By introducing a series of auxiliary variables and using the properties of the non-linear EH model, we transform the original non-convex problem into a convex one and derive closedform expressions for parts of the optimal solutions. Simulation results demonstrate the advantage of the proposed scheme over benchmark schemes in terms of weighted sum computation bits. △ Less

Submitted 25 September, 2020; originally announced September 2020.

Comments: This paper has been accepted by IEEE Communications Letters

Journal ref: IEEE Communications Letters, 2020

Dynamics evolution of a solar active-region filament from quasi-static state to eruption: rolling motion, untwisting motion, material transfer, and chirality

Authors: X. L. Yan, Q. L. Li, G. R. Chen, Z. K. Xue, L. Feng, J. C. Wang, L. H. Yang, Y. Zhang

Abstract: To better understand magnetic structure and eruptive process of solar filaments, a solar active-region filament (labeled F2) eruption associated with a B-class flare was investigated by using high-resolution H$α$ data from the 1 m New Vacuum Solar Telescope (NVST), combined with EUV observations of the Solar Dynamical Observatory (SDO). The filament F2 was disturbed by another filament (labeled F1… ▽ More To better understand magnetic structure and eruptive process of solar filaments, a solar active-region filament (labeled F2) eruption associated with a B-class flare was investigated by using high-resolution H$α$ data from the 1 m New Vacuum Solar Telescope (NVST), combined with EUV observations of the Solar Dynamical Observatory (SDO). The filament F2 was disturbed by another filament (labeled F1) eruption that experienced a whip-like motion. Before the filament F2 eruption, the Dopplergrams show that the southern and the northern parts of the filament F2 body exhibit blueshift and redshift along the filament spine, simultaneously. It implies that the filament F2 was rolling from one side to the other. During the filament F2 eruption, the Doppler velocity shifts of the filament body are opposite to that before its eruption. It demonstrates that the filament body exhibits an untwisting motion, which can be also identified by tracing the movement of the eruptive filament threads. Moreover, it is found that the material of the filament F2 was transferred to the surrounding magnetic field loops, which is caused by magnetic reconnection between the filament F2 and the surrounding magnetic loops. According to the right-bearing threads of the filament F2 before its eruption, it can be deduced that the filament F2 is initially supported by a sheared arcade. The following observations reveal that the twisted magnetic structure of the filament F2 formed in the eruption phase. △ Less

Submitted 22 September, 2020; originally announced September 2020.

Comments: 16 pages, 7 figures, accepted for publication in ApJ

On fully decoupled MSAV schemes for the Cahn-Hilliard-Navier-Stokes model of Two-Phase Incompressible Flows

Authors: Xiaoli Li, Jie Shen

Abstract: We construct first- and second-order time discretization schemes for the Cahn-Hilliard-Navier-Stokes system based on the multiple scalar auxiliary variables approach (MSAV) approach for gradient systems and (rotational) pressure-correction for Navier-Stokes equations. These schemes are linear, fully decoupled, unconditionally energy stable, and only require solving a sequence of elliptic equations… ▽ More We construct first- and second-order time discretization schemes for the Cahn-Hilliard-Navier-Stokes system based on the multiple scalar auxiliary variables approach (MSAV) approach for gradient systems and (rotational) pressure-correction for Navier-Stokes equations. These schemes are linear, fully decoupled, unconditionally energy stable, and only require solving a sequence of elliptic equations with constant coefficients at each time step. We carry out a rigorous error analysis for the first-order scheme, establishing optimal convergence rate for all relevant functions in different norms. We also provide numerical experiments to verify our theoretical results. △ Less

Submitted 20 September, 2020; originally announced September 2020.

Braiding and all quantum operations with Majorana modes in 1D

Authors: Viktoriia Kornich, Xiaoli Huang, Evgeny Repin, Yuli V. Nazarov

Abstract: We propose a scheme to perform braiding and all other unitary operations with Majorana modes in 1D that, in contrast to previous proposals, is solely based on resonant manipulation involving the first excited state extended over the modes. The detection of the population of the excited state also enables initialization and read-out. We provide an elaborated illustration of the scheme with a concre… ▽ More We propose a scheme to perform braiding and all other unitary operations with Majorana modes in 1D that, in contrast to previous proposals, is solely based on resonant manipulation involving the first excited state extended over the modes. The detection of the population of the excited state also enables initialization and read-out. We provide an elaborated illustration of the scheme with a concrete device. △ Less

Submitted 23 March, 2021; v1 submitted 14 September, 2020; originally announced September 2020.

Journal ref: Phys. Rev. Lett. 126, 117701 (2021)

Electronic and Superconducting Properties of Some FeSe-based Single Crystals and Films Grown Hydrothermally

Authors: Xiaoli Dong, Fang Zhou, Zhongxian Zhao

Abstract: Our recent year's studies of the prototypal FeSe and molecule-intercalated (Li,Fe)OHFeSe superconductor systems are briefly reviewed here, with emphasis on experimental observations of the link between the superconductivity and normal-state electronic property in the single crystals and films. These samples were successfully synthesized by our recently developed soft-chemical hydrothermal methods,… ▽ More Our recent year's studies of the prototypal FeSe and molecule-intercalated (Li,Fe)OHFeSe superconductor systems are briefly reviewed here, with emphasis on experimental observations of the link between the superconductivity and normal-state electronic property in the single crystals and films. These samples were successfully synthesized by our recently developed soft-chemical hydrothermal methods, which are also briefly described. Particularly in the Mn-doped high-Tc (Li,Fe)OHFeSe film, a strong enhancement of the superconducting critical current density was achieved, which is promising for practical application of the superconductivity. △ Less

Submitted 12 September, 2020; originally announced September 2020.

Comments: 28 pages, 12 figures

Journal ref: Front. Phys. 8:586182 (2020)

Next-Generation Geodesy at the Lunar South Pole: An Opportunity Enabled by the Artemis III Crew

Authors: Vishnu Viswanathan, Erwan Mazarico, Stephen Merkowitz, Xiaoli Sun, Thomas Marshall Eubanks, David Edmund Smith

Abstract: Lunar retro-reflector arrays (LRAs) consisting of corner-cube reflectors (CCRs) placed on the nearside of the Moon during the Apollo era have demonstrated their longevity, cost-effectiveness, ease of deployment, and most importantly their interdisciplinary scientific impact through the ongoing lunar laser ranging (LLR) experiment. The human exploration of the lunar south polar region provides a un… ▽ More Lunar retro-reflector arrays (LRAs) consisting of corner-cube reflectors (CCRs) placed on the nearside of the Moon during the Apollo era have demonstrated their longevity, cost-effectiveness, ease of deployment, and most importantly their interdisciplinary scientific impact through the ongoing lunar laser ranging (LLR) experiment. The human exploration of the lunar south polar region provides a unique opportunity to build on this legacy and contribute to the scientific return of the Artemis, for many decades to come. Here we outline the extended science objectives realizable with the deployment of geodetic tracking devices by the Artemis III crew. △ Less

Submitted 8 September, 2020; originally announced September 2020.

Comments: 2 pages, 1 figure, A white paper submitted to the Artemis III Science Definition Team of NASA's Science Mission Directorate

Solving Inverse Stochastic Problems from Discrete Particle Observations Using the Fokker-Planck Equation and Physics-informed Neural Networks

Authors: Xiaoli Chen, Liu Yang, **qiao Duan, George Em Karniadakis

Abstract: The Fokker-Planck (FP) equation governing the evolution of the probability density function (PDF) is applicable to many disciplines but it requires specification of the coefficients for each case, which can be functions of space-time and not just constants, hence requiring the development of a data-driven modeling approach. When the data available is directly on the PDF, then there exist methods f… ▽ More The Fokker-Planck (FP) equation governing the evolution of the probability density function (PDF) is applicable to many disciplines but it requires specification of the coefficients for each case, which can be functions of space-time and not just constants, hence requiring the development of a data-driven modeling approach. When the data available is directly on the PDF, then there exist methods for inverse problems that can be employed to infer the coefficients and thus determine the FP equation and subsequently obtain its solution. Herein, we address a more realistic scenario, where only sparse data are given on the particles' positions at a few time instants, which are not sufficient to accurately construct directly the PDF even at those times from existing methods, e.g., kernel estimation algorithms. To this end, we develop a general framework based on physics-informed neural networks (PINNs) that introduces a new loss function using the Kullback-Leibler divergence to connect the stochastic samples with the FP equation, to simultaneously learn the equation and infer the multi-dimensional PDF at all times. In particular, we consider two types of inverse problems, type I where the FP equation is known but the initial PDF is unknown, and type II in which, in addition to unknown initial PDF, the drift and diffusion terms are also unknown. In both cases, we investigate problems with either Brownian or Levy noise or a combination of both. We demonstrate the new PINN framework in detail in the one-dimensional case (1D) but we also provide results for up to 5D demonstrating that we can infer both the FP equation and} dynamics simultaneously at all times with high accuracy using only very few discrete observations of the particles. △ Less

Submitted 24 August, 2020; originally announced August 2020.

Comments: The first two authors contributed equally to this paper. Corresponding author: George Em Karniadakis

On Mean Absolute Error for Deep Neural Network Based Vector-to-Vector Regression

Authors: Jun Qi, Jun Du, Sabato Marco Siniscalchi, Xiaoli Ma, Chin-Hui Lee

Abstract: In this paper, we exploit the properties of mean absolute error (MAE) as a loss function for the deep neural network (DNN) based vector-to-vector regression. The goal of this work is two-fold: (i) presenting performance bounds of MAE, and (ii) demonstrating new properties of MAE that make it more appropriate than mean squared error (MSE) as a loss function for DNN based vector-to-vector regression… ▽ More In this paper, we exploit the properties of mean absolute error (MAE) as a loss function for the deep neural network (DNN) based vector-to-vector regression. The goal of this work is two-fold: (i) presenting performance bounds of MAE, and (ii) demonstrating new properties of MAE that make it more appropriate than mean squared error (MSE) as a loss function for DNN based vector-to-vector regression. First, we show that a generalized upper-bound for DNN-based vector- to-vector regression can be ensured by leveraging the known Lipschitz continuity property of MAE. Next, we derive a new generalized upper bound in the presence of additive noise. Finally, in contrast to conventional MSE commonly adopted to approximate Gaussian errors for regression, we show that MAE can be interpreted as an error modeled by Laplacian distribution. Speech enhancement experiments are conducted to corroborate our proposed theorems and validate the performance advantages of MAE over MSE for DNN based regression. △ Less

Submitted 12 August, 2020; originally announced August 2020.

Journal ref: IEEE Signal Processing Letters, 2020

Chern number inequalities of deformed Hermitian-Yang-Mills metrics on four dimensional Kaehler manifolds

Authors: Xiaoli Han, Xishen **

Abstract: In this paper, we investigate the Chern number inequalities on $4$-dimensional Kähler manifolds admitting the deformed Hermitian-Yang-Mills metrics under the assumption $\hatθ\in (π,2π)$. In this paper, we investigate the Chern number inequalities on $4$-dimensional Kähler manifolds admitting the deformed Hermitian-Yang-Mills metrics under the assumption $\hatθ\in (π,2π)$. △ Less

Submitted 16 August, 2020; originally announced August 2020.

Comments: All commments are welcome!

Analyzing Upper Bounds on Mean Absolute Errors for Deep Neural Network Based Vector-to-Vector Regression

Authors: Jun Qi, Jun Du, Sabato Marco Siniscalchi, Xiaoli Ma, Chin-Hui Lee

Abstract: In this paper, we show that, in vector-to-vector regression utilizing deep neural networks (DNNs), a generalized loss of mean absolute error (MAE) between the predicted and expected feature vectors is upper bounded by the sum of an approximation error, an estimation error, and an optimization error. Leveraging upon error decomposition techniques in statistical learning theory and non-convex optimi… ▽ More In this paper, we show that, in vector-to-vector regression utilizing deep neural networks (DNNs), a generalized loss of mean absolute error (MAE) between the predicted and expected feature vectors is upper bounded by the sum of an approximation error, an estimation error, and an optimization error. Leveraging upon error decomposition techniques in statistical learning theory and non-convex optimization theory, we derive upper bounds for each of the three aforementioned errors and impose necessary constraints on DNN models. Moreover, we assess our theoretical results through a set of image de-noising and speech enhancement experiments. Our proposed upper bounds of MAE for DNN based vector-to-vector regression are corroborated by the experimental results and the upper bounds are valid with and without the "over-parametrization" technique. △ Less

Submitted 4 August, 2020; originally announced August 2020.

Journal ref: IEEE Transactions on Signal Processing, Vol 68, pp. 3411-3422, 2020

GmFace: A Mathematical Model for Face Image Representation Using Multi-Gaussian

Authors: Li** Zhang, Weijun Li, Lina Yu, Xiaoli Dong, Linjun Sun, Xin Ning, Jian Xu, Hong Qin

Abstract: Establishing mathematical models is a ubiquitous and effective method to understand the objective world. Due to complex physiological structures and dynamic behaviors, mathematical representation of the human face is an especially challenging task. A mathematical model for face image representation called GmFace is proposed in the form of a multi-Gaussian function in this paper. The model utilizes… ▽ More Establishing mathematical models is a ubiquitous and effective method to understand the objective world. Due to complex physiological structures and dynamic behaviors, mathematical representation of the human face is an especially challenging task. A mathematical model for face image representation called GmFace is proposed in the form of a multi-Gaussian function in this paper. The model utilizes the advantages of two-dimensional Gaussian function which provides a symmetric bell surface with a shape that can be controlled by parameters. The GmNet is then designed using Gaussian functions as neurons, with parameters that correspond to each of the parameters of GmFace in order to transform the problem of GmFace parameter solving into a network optimization problem of GmNet. The face modeling process can be described by the following steps: (1) GmNet initialization; (2) feeding GmNet with face image(s); (3) training GmNet until convergence; (4) drawing out the parameters of GmNet (as the same as GmFace); (5) recording the face model GmFace. Furthermore, using GmFace, several face image transformation operations can be realized mathematically through simple parameter computation. △ Less

Submitted 3 August, 2020; originally announced August 2020.

Comments: 12 pages, 12 figures, 4 tables

Attention Sequence to Sequence Model for Machine Remaining Useful Life Prediction

Authors: Mohamed Ragab, Zhenghua Chen, Min Wu, Chee-Keong Kwoh, Ruqiang Yan, Xiaoli Li

Abstract: Accurate estimation of remaining useful life (RUL) of industrial equipment can enable advanced maintenance schedules, increase equipment availability and reduce operational costs. However, existing deep learning methods for RUL prediction are not completely successful due to the following two reasons. First, relying on a single objective function to estimate the RUL will limit the learned represen… ▽ More Accurate estimation of remaining useful life (RUL) of industrial equipment can enable advanced maintenance schedules, increase equipment availability and reduce operational costs. However, existing deep learning methods for RUL prediction are not completely successful due to the following two reasons. First, relying on a single objective function to estimate the RUL will limit the learned representations and thus affect the prediction accuracy. Second, while longer sequences are more informative for modelling the sensor dynamics of equipment, existing methods are less effective to deal with very long sequences, as they mainly focus on the latest information. To address these two problems, we develop a novel attention-based sequence to sequence with auxiliary task (ATS2S) model. In particular, our model jointly optimizes both reconstruction loss to empower our model with predictive capabilities (by predicting next input sequence given current input sequence) and RUL prediction loss to minimize the difference between the predicted RUL and actual RUL. Furthermore, to better handle longer sequence, we employ the attention mechanism to focus on all the important input information during training process. Finally, we propose a new dual-latent feature representation to integrate the encoder features and decoder hidden states, to capture rich semantic information in data. We conduct extensive experiments on four real datasets to evaluate the efficacy of the proposed method. Experimental results show that our proposed method can achieve superior performance over 13 state-of-the-art methods consistently. △ Less

Submitted 19 July, 2020; originally announced July 2020.

Towards Environment-Aware 6G Communications via Channel Knowledge Map

Authors: Yong Zeng, Xiaoli Xu

Abstract: This article proposes the concept of channel knowledge map (CKM) as an enabler towards environment-aware wireless communications. CKM is a site-specific database, tagged with the locations of the transmitters and/or receivers, that contains whatever channel-related information useful to enhance environmental-awareness and facilitate or even obviate sophisticated real-time channel state information… ▽ More This article proposes the concept of channel knowledge map (CKM) as an enabler towards environment-aware wireless communications. CKM is a site-specific database, tagged with the locations of the transmitters and/or receivers, that contains whatever channel-related information useful to enhance environmental-awareness and facilitate or even obviate sophisticated real-time channel state information (CSI) acquisition. Therefore, CKM is expected to play an important role for 6G networks targeting for super high capacity, extremely low latency, and ultra-massive connectivity, by offering potential solutions to practical challenges brought by the drastically increased channel dimensions and training overhead. In this article, the motivations of environmental-awareness enabled by CKM are firstly discussed, followed by the key techniques to build and utilize CKM. In particular, it is highlighted that CKM is especially appealing for four channel types: channels for yet-to-reach locations, channels for non-cooperative nodes, channels with large dimensions, and channels with severe hardware/processing limitations. Two case studies with extensive numerical results are presented to demonstrate the great potential of environment-aware communications enabled by CKM. △ Less

Submitted 18 July, 2020; originally announced July 2020.

A Monte Carlo Implementation of Galactic Free-Free Emission for the EoR Foreground Models

Authors: Xiaoli Lian, Haiguang Xu, Dongchao Zheng, Zhenghao Zhu, Dan Hu

Abstract: The overwhelming foreground causes severe contamination on the detection of 21-cm signal during the Epoch of Reionization (EoR). Among various foreground components, the Galactic free-free emission is less studied, so that its impact on the EoR observation remains unclear. To better constrain this emission, we perform the Monte Carlo simulation of H$α$ emission, which comprises direct and scattere… ▽ More The overwhelming foreground causes severe contamination on the detection of 21-cm signal during the Epoch of Reionization (EoR). Among various foreground components, the Galactic free-free emission is less studied, so that its impact on the EoR observation remains unclear. To better constrain this emission, we perform the Monte Carlo simulation of H$α$ emission, which comprises direct and scattered H$α$ radiation from HII regions and warm ionized medium (WIM). The positions and radii of HII regions are quoted from the WISE HII catalog, and the WIM is described by an axisymmetric model. The scattering is off dust and free electrons that are realized by applying an exponential fitting to the HI4PI HI map and an exponential disk model, respectively. The simulated H$α$ intensity, the Simfast21 software, and the latest SKA1-Low layout configuration are employed to simulate the SKA "observed" images of Galactic free-free emission and the EoR signal. By analyzing the one-dimensional power spectra, we find that the Galactic free-free emission can be about $10^{5.4}$-$10^{2.1}$, $10^{5.0}$-$10^{1.7}$, and $10^{4.3}$-$10^{1.1}$ times more luminous than the EoR signal on scales of $0.1~{\rm Mpc^{-1}} < k < 2~{\rm Mpc^{-1}}$ in the 116-124, 146-154, and 186-194 MHz frequency bands, respectively. We further calculate the two-dimensional power spectra inside the EoR window and show that the power leaked by Galactic free-free emission can still be significant, as the power ratios can reach about $110\%$-$8000\%$, $30\%$-$2400\%$, and $10\%$-$250\%$ on scales of $0.5~{\rm Mpc^{-1}} \lesssim k \lesssim 1~{\rm Mpc^{-1}}$ in three frequency bands. Therefore, we indicate that the Galactic free-free emission should be carefully treated in future EoR detections. △ Less

Submitted 1 July, 2020; originally announced July 2020.

Comments: 19 pages,17figures, the ApJS published version. arXiv admin note: text overlap with arXiv:2005.04196

Journal ref: 2020,ApJS,249:2

Fault Diagnosis of the 10MW Floating Offshore Wind Turbine Benchmark: a Mixed Model and Signal-based Approach

Authors: Yichao Liu, Riccardo Ferrari, ** Wu, Xiaoli Jiang, Sunwei Li, Jan-Willem van Wingerden

Abstract: Floating Offshore Wind Turbines (FOWTs) operate in the harsh marine environment with limited accessibility and maintainability. Not only failures are more likely to occur than in land-based turbines, but also corrective maintenance is more expensive. In the present study, a mixed model and signal-based Fault Diagnosis (FD) architecture is developed to detect and isolate critical faults in FOWTs. M… ▽ More Floating Offshore Wind Turbines (FOWTs) operate in the harsh marine environment with limited accessibility and maintainability. Not only failures are more likely to occur than in land-based turbines, but also corrective maintenance is more expensive. In the present study, a mixed model and signal-based Fault Diagnosis (FD) architecture is developed to detect and isolate critical faults in FOWTs. More specifically, a model-based scheme is developed to detect and isolate the faults associated with the turbine system. It is based on a fault detection and approximation estimator and fault isolation estimators, with time-varying adaptive thresholds to guarantee against false-alarms. In addition, a signal-based scheme is established, within the proposed architecture, for detecting and isolating two representative mooring lines faults. For the purpose of verification, a 10MW FOWT benchmark is developed and its operating conditions, which contains predefined faults, are simulated by extending the high-fidelity simulator. Based on it, the effectiveness of the proposed architecture is illustrated. In addition, the advantages and limitations are discussed by comparing its fault detection to the results delivered by other approaches. Results show that the proposed architecture has the best performance in detecting and isolating the critical faults in FOWTs under diverse operating conditions. △ Less

Submitted 3 July, 2020; originally announced July 2020.

Differentiable Window for Dynamic Local Attention

Authors: Thanh-Tung Nguyen, Xuan-Phi Nguyen, Shafiq Joty, Xiaoli Li

Abstract: We propose Differentiable Window, a new neural module and general purpose component for dynamic window selection. While universally applicable, we demonstrate a compelling use case of utilizing Differentiable Window to improve standard attention modules by enabling more focused attentions over the input regions. We propose two variants of Differentiable Window, and integrate them within the Transf… ▽ More We propose Differentiable Window, a new neural module and general purpose component for dynamic window selection. While universally applicable, we demonstrate a compelling use case of utilizing Differentiable Window to improve standard attention modules by enabling more focused attentions over the input regions. We propose two variants of Differentiable Window, and integrate them within the Transformer architecture in two novel ways. We evaluate our proposed approach on a myriad of NLP tasks, including machine translation, sentiment analysis, subject-verb agreement and language modeling. Our experimental results demonstrate consistent and sizable improvements across all tasks. △ Less

Submitted 24 June, 2020; originally announced June 2020.

Comments: Accepted at ACL 2020

Efficient Constituency Parsing by Pointing

Authors: Thanh-Tung Nguyen, Xuan-Phi Nguyen, Shafiq Joty, Xiaoli Li

Abstract: We propose a novel constituency parsing model that casts the parsing problem into a series of pointing tasks. Specifically, our model estimates the likelihood of a span being a legitimate tree constituent via the pointing score corresponding to the boundary words of the span. Our parsing model supports efficient top-down decoding and our learning objective is able to enforce structural consistency… ▽ More We propose a novel constituency parsing model that casts the parsing problem into a series of pointing tasks. Specifically, our model estimates the likelihood of a span being a legitimate tree constituent via the pointing score corresponding to the boundary words of the span. Our parsing model supports efficient top-down decoding and our learning objective is able to enforce structural consistency without resorting to the expensive CKY inference. The experiments on the standard English Penn Treebank parsing task show that our method achieves 92.78 F1 without using pre-trained models, which is higher than all the existing methods with similar time complexity. Using pre-trained BERT, our model achieves 95.48 F1, which is competitive with the state-of-the-art while being faster. Our approach also establishes new state-of-the-art in Basque and Swedish in the SPMRL shared tasks on multilingual constituency parsing. △ Less

Submitted 24 June, 2020; originally announced June 2020.

Comments: Accepted at ACL 2020

Machine Learning in Heliophysics and Space Weather Forecasting: A White Paper of Findings and Recommendations

Authors: Gelu Nita, Manolis Georgoulis, Irina Kitiashvili, Viacheslav Sadykov, Enrico Camporeale, Alexander Kosovichev, Haimin Wang, Vincent Oria, Jason Wang, Rafal Angryk, Berkay Aydin, Azim Ahmadzadeh, Xiaoli Bai, Timothy Bastian, Soukaina Filali Boubrahimi, Bin Chen, Alisdair Davey, Sheldon Fereira, Gregory Fleishman, Dale Gary, Andrew Gerrard, Gregory Hellbourg, Katherine Herbert, Jack Ireland, Egor Illarionov , et al. (16 additional authors not shown)

Abstract: The authors of this white paper met on 16-17 January 2020 at the New Jersey Institute of Technology, Newark, NJ, for a 2-day workshop that brought together a group of heliophysicists, data providers, expert modelers, and computer/data scientists. Their objective was to discuss critical developments and prospects of the application of machine and/or deep learning techniques for data analysis, model… ▽ More The authors of this white paper met on 16-17 January 2020 at the New Jersey Institute of Technology, Newark, NJ, for a 2-day workshop that brought together a group of heliophysicists, data providers, expert modelers, and computer/data scientists. Their objective was to discuss critical developments and prospects of the application of machine and/or deep learning techniques for data analysis, modeling and forecasting in Heliophysics, and to shape a strategy for further developments in the field. The workshop combined a set of plenary sessions featuring invited introductory talks interleaved with a set of open discussion sessions. The outcome of the discussion is encapsulated in this white paper that also features a top-level list of recommendations agreed by participants. △ Less

Submitted 22 June, 2020; originally announced June 2020.

Comments: Workshop Report

System Outage Probability of PS-SWIPT Enabled Two-Way AF Relaying with Hardware Impairments

Authors: Zhipeng Liu, Guangyue Lu, Yinghui Ye, Xiaoli Chu

Abstract: In this paper, we investigate the system outage probability of a simultaneous wireless information and power transfer (SWIPT) based two-way amplify-and-forward (AF) relay network considering transceiver hardware impairments (HIs), where the energy-constrained relay node processes the received signals based on a power splitting protocol and the two terminals employ a selection combining (SC) scheme… ▽ More In this paper, we investigate the system outage probability of a simultaneous wireless information and power transfer (SWIPT) based two-way amplify-and-forward (AF) relay network considering transceiver hardware impairments (HIs), where the energy-constrained relay node processes the received signals based on a power splitting protocol and the two terminals employ a selection combining (SC) scheme to exploit the signals from the direct and relaying links. Assuming independent but non-identically distributed Nakagami-m fading channels, we derive the system outage probability in a closed-form, which enables us to identify two crucial ceiling effects on the system outage probability caused by HIs in the high data rate regions, i.e., relay cooperation ceiling (RCC) and overall system ceiling (OSC). Specifically, the RCC prevents the relaying link from participating in cooperative communications, while the OSC leaves the overall system in outage. Furthermore, we derive the achievable diversity gain of the considered network, which shows that the diversity gain equals either the shape parameter of the direct link or zero. Computer simulations are provided to validate the correctness of our analytical results, and study the effects of various system parameters on the system outage performance and the optimal power splitting ratio, as well as the energy efficiency. △ Less

Submitted 30 September, 2020; v1 submitted 14 June, 2020; originally announced June 2020.

Comments: This paper has been submitted for potential journal publication

Journal ref: IEEE Transactions on Vehicular Technology, 2020

Relation Extraction with Explanation

Authors: Hamed Shahbazi, Xiaoli Z. Fern, Reza Ghaeini, Prasad Tadepalli

Abstract: Recent neural models for relation extraction with distant supervision alleviate the impact of irrelevant sentences in a bag by learning importance weights for the sentences. Efforts thus far have focused on improving extraction accuracy but little is known about their explainability. In this work we annotate a test set with ground-truth sentence-level explanations to evaluate the quality of explan… ▽ More Recent neural models for relation extraction with distant supervision alleviate the impact of irrelevant sentences in a bag by learning importance weights for the sentences. Efforts thus far have focused on improving extraction accuracy but little is known about their explainability. In this work we annotate a test set with ground-truth sentence-level explanations to evaluate the quality of explanations afforded by the relation extraction models. We demonstrate that replacing the entity mentions in the sentences with their fine-grained entity types not only enhances extraction accuracy but also improves explanation. We also propose to automatically generate "distractor" sentences to augment the bags and train the model to ignore the distractors. Evaluations on the widely used FB-NYT dataset show that our methods achieve new state-of-the-art accuracy while improving model explainability. △ Less

Submitted 28 May, 2020; originally announced May 2020.

Comments: accepted by ACL 2020

Journal ref: ACL.2020

Existence and Spatio-Temporal Patterns of Periodic Solutions to Second Order Non-Autonomous Equivariant Delayed Systems

Authors: Zalman Balanov, Wieslaw Krawcewicz, Norimichi Hirano, Xiaoli Ye

Abstract: Existence and spatio-temporal symmetric patterns of periodic solutions to second order reversible equivariant non-autonomous periodic systems with multiple delays are studied under the Hartman-Nagumo growth conditions. The method is based on using the Brouwer $D_1 \times \mathbb Z_2\times Γ$-equivariant degree theory, where $D_1$ is related to the reversing symmetry, $\mathbb Z_2$ is related to th… ▽ More Existence and spatio-temporal symmetric patterns of periodic solutions to second order reversible equivariant non-autonomous periodic systems with multiple delays are studied under the Hartman-Nagumo growth conditions. The method is based on using the Brouwer $D_1 \times \mathbb Z_2\times Γ$-equivariant degree theory, where $D_1$ is related to the reversing symmetry, $\mathbb Z_2$ is related to the oddness of the right-hand-side and $Γ$ reflects the symmetric character of the coupling in the corresponding network. Abstract results are supported by a concrete example with $Γ= D_n$ -- the dihedral group of order $2n$. △ Less

Submitted 26 May, 2020; originally announced May 2020.

Comments: 23pages

DeepSSM: Deep State-Space Model for 3D Human Motion Prediction

Authors: Xiaoli Liu, Jianqin Yin, Hua** Liu, Jun Liu

Abstract: Predicting future human motion plays a significant role in human-machine interactions for various real-life applications. A unified formulation and multi-order modeling are two critical perspectives for analyzing and representing human motion. In contrast to prior works, we improve the multi-order modeling ability of human motion systems for more accurate predictions by building a deep state-space… ▽ More Predicting future human motion plays a significant role in human-machine interactions for various real-life applications. A unified formulation and multi-order modeling are two critical perspectives for analyzing and representing human motion. In contrast to prior works, we improve the multi-order modeling ability of human motion systems for more accurate predictions by building a deep state-space model (DeepSSM). The DeepSSM utilizes the advantages of both the state-space theory and the deep network. Specifically, we formulate the human motion system as the state-space model of a dynamic system and model the motion system by the state-space theory, offering a unified formulation for diverse human motion systems. Moreover, a novel deep network is designed to parameterize this system, which jointly models the state-state transition and state-observation transition processes. In this way, the state of a system is updated by the multi-order information of a time-varying human motion sequence. Multiple future poses are recursively predicted via the state-observation transition. To further improve the model ability of the system, a novel loss, WT-MPJPE (Weighted Temporal Mean Per Joint Position Error), is introduced to optimize the model. The proposed loss encourages the system to achieve more accurate predictions by increasing weights to the early time steps. The experiments on two benchmark datasets (i.e., Human3.6M and 3DPW) confirm that our method achieves state-of-the-art performance with improved accuracy of at least 2.2mm per joint. The code will be available at: \url{https://github.com/lily2lab/DeepSSM.git}. △ Less

Submitted 28 December, 2021; v1 submitted 25 May, 2020; originally announced May 2020.

Comments: submitted to IEEE Transactions on Systems Man Cybernetics-Systems

Robust Robot-assisted Tele-gras** Through Intent-Uncertainty-Aware Planning

Authors: Michael Bowman, Songpo Li, Xiaoli Zhang

Abstract: In teleoperation, research has mainly focused on target approaching, where we deal with the more challenging object manipulation task by advancing the shared control technique. Appropriately manipulating an object is challenging due to the fine motion constraint requirements for a specific manipulation task. Although these motion constraints are critical for task success, they often are subtle whe… ▽ More In teleoperation, research has mainly focused on target approaching, where we deal with the more challenging object manipulation task by advancing the shared control technique. Appropriately manipulating an object is challenging due to the fine motion constraint requirements for a specific manipulation task. Although these motion constraints are critical for task success, they often are subtle when observing ambiguous human motion. The disembodiment problem and physical discrepancy between the human and robot hands bring additional uncertainty, further exaggerating the complications of the object manipulation task. Moreover, there is a lack of planning and modeling techniques that can effectively combine the human and robot agents' motion input while considering the ambiguity of the human intent. To overcome this challenge, we built a multi-task robot gras** model and developed an intent-uncertainty-aware grasp planner to generate robust grasp poses given the ambiguous human intent inference inputs. With these validated modeling and planning techniques, it is expected to extend teleoperated robots' functionality and adoption in practical telemanipulation scenarios. △ Less

Submitted 19 May, 2020; originally announced May 2020.

Comments: 12 pages, 6 figures, journal paper

Multi-View Collaborative Network Embedding

Authors: Sezin Kircali Ata, Yuan Fang, Min Wu, Jiaqi Shi, Chee Keong Kwoh, Xiaoli Li

Abstract: Real-world networks often exist with multiple views, where each view describes one type of interaction among a common set of nodes. For example, on a video-sharing network, while two user nodes are linked if they have common favorite videos in one view, they can also be linked in another view if they share common subscribers. Unlike traditional single-view networks, multiple views maintain differe… ▽ More Real-world networks often exist with multiple views, where each view describes one type of interaction among a common set of nodes. For example, on a video-sharing network, while two user nodes are linked if they have common favorite videos in one view, they can also be linked in another view if they share common subscribers. Unlike traditional single-view networks, multiple views maintain different semantics to complement each other. In this paper, we propose MANE, a multi-view network embedding approach to learn low-dimensional representations. Similar to existing studies, MANE hinges on diversity and collaboration - while diversity enables views to maintain their individual semantics, collaboration enables views to work together. However, we also discover a novel form of second-order collaboration that has not been explored previously, and further unify it into our framework to attain superior node representations. Furthermore, as each view often has varying importance w.r.t. different nodes, we propose MANE+, an attention-based extension of MANE to model node-wise view importance. Finally, we conduct comprehensive experiments on three public, real-world multi-view networks, and the results demonstrate that our models consistently outperform state-of-the-art approaches. △ Less

Submitted 17 December, 2020; v1 submitted 17 May, 2020; originally announced May 2020.

Comments: Accepted for publication in the ACM Transactions on Knowledge Discovery from Data, TKDD

Journal ref: ACM Trans. Knowl. Discov. Data 15, 3, Article 39 (April 2021), 18 pages

On the Outage Performance of Ambient Backscatter Communications

Authors: Yinghui Ye, Liqin Shi, Xiaoli Chu, Guangyue Lu

Abstract: Ambient backscatter communications (AmBackComs) have been recognized as a spectrum- and energy-efficient technology for Internet of Things, as it allows passive backscatter devices (BDs) to modulate their information into the legacy signals, e.g., cellular signals, and reflect them to their associated receivers while harvesting energy from the legacy signals to power their circuit operation. {\col… ▽ More Ambient backscatter communications (AmBackComs) have been recognized as a spectrum- and energy-efficient technology for Internet of Things, as it allows passive backscatter devices (BDs) to modulate their information into the legacy signals, e.g., cellular signals, and reflect them to their associated receivers while harvesting energy from the legacy signals to power their circuit operation. {\color{black} However, the co-channel interference between the backscatter link and the legacy link and the non-linear behavior of energy harvesters at the BDs have largely been ignored in the performance analysis of AmBackComs. Taking these two aspects, this paper provides a comprehensive outage performance analysis for an AmBackCom system with multiple backscatter links}, where one of the backscatter links is opportunistically selected to leverage the legacy signals transmitted in a given resource block. For any selected backscatter link, we propose an adaptive reflection coefficient (RC), which is adapted to the non-linear energy harvesting (EH) model and the location of the selected backscatter link, to minimize the outage probability of the backscatter link. In order to study the impact of co-channel interference on both backscatter and legacy links, for a selected backscatter link, we derive the outage probabilities for the legacy link and the backscatter link. Furthermore, we study the best and worst outage performances for the backscatter system where the selected backscatter link maximizes or minimizes the signal-to-interference-plus noise ratio (SINR) at the backscatter receiver. We also study the best and worst outage performances for the legacy link where the selected backscatter link results in the lowest and highest co-channel interference to the legacy receiver, respectively. △ Less

Submitted 14 May, 2020; originally announced May 2020.

Journal ref: IEEE Internet of Things Journal, 2020

Contribution of Galactic free-free emission to the foreground for EoR signal in SKA experiments

Authors: Xiaoli Lian, Haiguang Xu, Zhenghao Zhu, Dan Hu

Abstract: The overwhelming foreground contamination hinders the accurate detection of the 21-cm signal of neutral hydrogen during the Epoch of Reionization (EoR). Among various foreground components, the Galactic free-free emission is less studied, so that its impact on the EoR observations remains unclear. In this work, we employ the observed $\rm Hα$ intensity map with the correction of dust absorption an… ▽ More The overwhelming foreground contamination hinders the accurate detection of the 21-cm signal of neutral hydrogen during the Epoch of Reionization (EoR). Among various foreground components, the Galactic free-free emission is less studied, so that its impact on the EoR observations remains unclear. In this work, we employ the observed $\rm Hα$ intensity map with the correction of dust absorption and scattering, the Simfast21 software, and the latest SKA1-Low layout configuration to simulate the SKA "observed" images of Galactic free-free emission and the EoR signal. By calculating the one-dimensional power spectra from the simulated image cubes, we find that the Galactic free-free emission is about $10^{3.5}$-$10^{2.0}$, $10^{3.0}$-$10^{1.3}$, and $10^{2.5}$-$10^{1.0}$ times more luminous than the EoR signal on scales of $0.1~\rm Mpc^{-1} < k < 2~\rm Mpc^{-1}$ in the $116$-$124$, $146$-$154$, and $186$-$194$ ${\rm MHz}$ frequency bands. We further analyse the two-dimensional power spectra inside the properly defined EoR window and find that the leaked Galactic free-free emission can still cause non-negligible contamination, as the ratios of its power (amplitude squared) to the EoR signal power can reach about $200\%$, $60\%$, and $15\%$ on scales of $1.2~\rm Mpc^{-1}$ in three frequency bands, respectively. Therefore, we conclude that the Galactic free-free emission, as a severe contaminating foreground component, needs to be carefully treated in the forthcoming deep EoR observations. △ Less

Submitted 8 May, 2020; originally announced May 2020.

Comments: 15 pages, 10 figures, the MNRAS published version

AIBench Scenario: Scenario-distilling AI Benchmarking

Authors: Wanling Gao, Fei Tang, Jianfeng Zhan, Xu Wen, Lei Wang, Zheng Cao, Chuanxin Lan, Chunjie Luo, Xiaoli Liu, Zihan Jiang

Abstract: Modern real-world application scenarios like Internet services consist of a diversity of AI and non-AI modules with huge code sizes and long and complicated execution paths, which raises serious benchmarking or evaluating challenges. Using AI components or micro benchmarks alone can lead to error-prone conclusions. This paper presents a methodology to attack the above challenge. We formalize a rea… ▽ More Modern real-world application scenarios like Internet services consist of a diversity of AI and non-AI modules with huge code sizes and long and complicated execution paths, which raises serious benchmarking or evaluating challenges. Using AI components or micro benchmarks alone can lead to error-prone conclusions. This paper presents a methodology to attack the above challenge. We formalize a real-world application scenario as a Directed Acyclic Graph-based model and propose the rules to distill it into a permutation of essential AI and non-AI tasks, which we call a scenario benchmark. Together with seventeen industry partners, we extract nine typical scenario benchmarks. We design and implement an extensible, configurable, and flexible benchmark framework. We implement two Internet service AI scenario benchmarks based on the framework as proxies to two real-world application scenarios. We consider scenario, component, and micro benchmarks as three indispensable parts for evaluating. Our evaluation shows the advantage of our methodology against using component or micro AI benchmarks alone. The specifications, source code, testbed, and results are publicly available from \url{https://www.benchcouncil.org/aibench/scenario/}. △ Less

Submitted 5 September, 2021; v1 submitted 5 May, 2020; originally announced May 2020.

Comments: This paper has been accepted by The 30th International Conference on Parallel Architectures and Compilation Techniques (PACT 2021)

High-Pressure Synthesis of Barium Superhydrides: Pseudocubic BaH12

Authors: Wuhao Chen, Dmitrii V. Semenok, Alexander G. Kvashnin, Ivan A. Kruglov, Michele Galasso, Hao Song, Xiaoli Huang, Defang Duan, Alexander F. Goncharov, Vitali B. Prakapenka, Artem R. Oganov, Tian Cui

Abstract: Following the discovery of high-temperature superconductivity in the La-H system, where for the recently discovered fcc-LaH10 a record critical temperature Tc = 250 K was achieved [Drozdov et al., Nature, 569, 528 (2019) and Somayazulu et al., Phys. Rev. Lett. 122, 027001 (2019)], we studied the formation of new chemical compounds in the barium-hydrogen system at pressures up to 173 GPa. Using in… ▽ More Following the discovery of high-temperature superconductivity in the La-H system, where for the recently discovered fcc-LaH10 a record critical temperature Tc = 250 K was achieved [Drozdov et al., Nature, 569, 528 (2019) and Somayazulu et al., Phys. Rev. Lett. 122, 027001 (2019)], we studied the formation of new chemical compounds in the barium-hydrogen system at pressures up to 173 GPa. Using in situ generation of hydrogen from NH3BH3, we synthesized previously unknown superhydride BaH12 with a pseudocubic (fcc) Ba sublattice, which was observed in a wide range of pressures from 75 to 173 GPa in four independent experiments. DFT calculations indicate a close agreement between the theoretical and experimental equations of state. In addition to BaH12, we identified previously known P6/mmm BaH2 and possibly BaH10 and BaH6 as impurities in the samples. Ab initio calculations show that newly discovered semimetallic BaH12 contains H2, H3 molecular units and detached H12 chains. Barium dodecahydride is a unique molecular hydride with metallic conductivity which demonstrates a superconducting transition around 20 K at 140 GPa in agreement with calculations (19-32 K). The interpretation of the multiphase XRD data was possible thanks to the development of new Python scripts for postprocessing the results of evolutionary searches. These scripts help quickly identify the theoretical structures that explain the experimental data in the best way, among thousands of candidates. △ Less

Submitted 26 April, 2020; originally announced April 2020.

Comments: Due to file size restrictions the supporting information file was uploaded to the Researchgate website

Journal ref: Nat Commun 12, 273 (2021)

Quantum discord of certain two-qubit states

Authors: Jianming Zhou, Xiaoli Hu, Naihuan **g

Abstract: Quantum discord is an effective measure of quantum correlation introduced by Olliver and Zurek. We evaluate analytically the quantum discord for a large family of non-X-states. Exact solutions of the quantum discord are obtained of the four parametric space for non-X-states. Dynamic behavior of the quantum discord is also explored under the action of the Kraus operator. Quantum discord is an effective measure of quantum correlation introduced by Olliver and Zurek. We evaluate analytically the quantum discord for a large family of non-X-states. Exact solutions of the quantum discord are obtained of the four parametric space for non-X-states. Dynamic behavior of the quantum discord is also explored under the action of the Kraus operator. △ Less

Submitted 24 April, 2020; originally announced April 2020.

Comments: 13 pages

Journal ref: Int. J. Theo. Phys. 59 (2020), no.2, 415-425

A General Difficulty Control Algorithm for Proof-of-Work Based Blockchains

Authors: Shulai Zhang, Xiaoli Ma

Abstract: Designing an efficient difficulty control algorithm is an essential problem in Proof-of-Work (PoW) based blockchains because the network hash rate is randomly changing. This paper proposes a general difficulty control algorithm and provides insights for difficulty adjustment rules for PoW based blockchains. The proposed algorithm consists a two-layer neural network. It has low memory cost, meanwhi… ▽ More Designing an efficient difficulty control algorithm is an essential problem in Proof-of-Work (PoW) based blockchains because the network hash rate is randomly changing. This paper proposes a general difficulty control algorithm and provides insights for difficulty adjustment rules for PoW based blockchains. The proposed algorithm consists a two-layer neural network. It has low memory cost, meanwhile satisfying the fast-updating and low volatility requirements for difficulty adjustment. Real data from Ethereum are used in the simulations to prove that the proposed algorithm has better performance for the control of the block difficulty. △ Less

Submitted 22 April, 2020; originally announced April 2020.

Comments: 5 pages, to be published in ICASSP 2020

A small-scale filament eruption inducing Moreton Wave, EUV Wave and Coronal Mass Ejection

Authors: **cheng Wang, Xiaoli Yan, Defang Kong, Zhike Xue, Liheng Yang, Qiaoling Li

Abstract: With the launch of SDO, many EUV waves were observed during solar eruptions. However, the joint observations of Moreton and EUV waves are still relatively rare. We present an event that a small-scale filament eruption simultaneously results in a Moreton wave, an EUV wave and a Coronal Mass Ejection in active region NOAA 12740. Firstly, we find that some dark elongate lanes or filamentary structure… ▽ More With the launch of SDO, many EUV waves were observed during solar eruptions. However, the joint observations of Moreton and EUV waves are still relatively rare. We present an event that a small-scale filament eruption simultaneously results in a Moreton wave, an EUV wave and a Coronal Mass Ejection in active region NOAA 12740. Firstly, we find that some dark elongate lanes or filamentary structures in the photosphere existed under the small-scale filament and drifted downward, which manifests that the small-scale filament was emerging and lifting from subsurface. Secondly, combining the simultaneous observations in different Extreme UltraViolet (EUV) and H$α$ passbands, we study the kinematic characteristics of the Moreton and EUV waves. The comparable propagating velocities and the similar morphology of Moreton and different passbands EUV wavefronts were obtained. We deduce that Moreton and different passbands EUV waves were the perturbations in different temperature-associated layers induced by the coronal magneto-hydrodynamic shock wave. We also find the refracted, reflected and diffracted phenomena during the propagation of the EUV wave. By using power-law fittings, the kinematic characteristics of unaffected, refracted and diffracted waves were obtained. The extrapolation field derived by the potential field source surface (PFSS) model manifests that the existence of an interface of different magnetic system (magnetic separatrix) result in refraction, reflection and deviation of the EUV wave. △ Less

Submitted 16 April, 2020; originally announced April 2020.

Comments: 18 pages, 12 figures, 2 tables; Accepted for publication in ApJ

Continuous learning of face attribute synthesis

Authors: Xin Ning, Shaohui Xu, Xiaoli Dong, Weijun Li, Fangzhe Nan, Yuanzhou Yao

Abstract: The generative adversarial network (GAN) exhibits great superiority in the face attribute synthesis task. However, existing methods have very limited effects on the expansion of new attributes. To overcome the limitations of a single network in new attribute synthesis, a continuous learning method for face attribute synthesis is proposed in this work. First, the feature vector of the input image i… ▽ More The generative adversarial network (GAN) exhibits great superiority in the face attribute synthesis task. However, existing methods have very limited effects on the expansion of new attributes. To overcome the limitations of a single network in new attribute synthesis, a continuous learning method for face attribute synthesis is proposed in this work. First, the feature vector of the input image is extracted and attribute direction regression is performed in the feature space to obtain the axes of different attributes. The feature vector is then linearly guided along the axis so that images with target attributes can be synthesized by the decoder. Finally, to make the network capable of continuous learning, the orthogonal direction modification module is used to extend the newly-added attributes. Experimental results show that the proposed method can endow a single network with the ability to learn attributes continuously, and, as compared to those produced by the current state-of-the-art methods, the synthetic attributes have higher accuracy. △ Less

Submitted 15 April, 2020; originally announced April 2020.

Multi-modal Datasets for Super-resolution

Authors: Haoran Li, Weihong Quan, Meijun Yan, ** zhang, Xiaoli Gong, ** Zhou

Abstract: Nowdays, most datasets used to train and evaluate super-resolution models are single-modal simulation datasets. However, due to the variety of image degradation types in the real world, models trained on single-modal simulation datasets do not always have good robustness and generalization ability in different degradation scenarios. Previous work tended to focus only on true-color images. In contr… ▽ More Nowdays, most datasets used to train and evaluate super-resolution models are single-modal simulation datasets. However, due to the variety of image degradation types in the real world, models trained on single-modal simulation datasets do not always have good robustness and generalization ability in different degradation scenarios. Previous work tended to focus only on true-color images. In contrast, we first proposed real-world black-and-white old photo datasets for super-resolution (OID-RW), which is constructed using two methods of manually filling pixels and shooting with different cameras. The dataset contains 82 groups of images, including 22 groups of character type and 60 groups of landscape and architecture. At the same time, we also propose a multi-modal degradation dataset (MDD400) to solve the super-resolution reconstruction in real-life image degradation scenarios. We managed to simulate the process of generating degraded images by the following four methods: interpolation algorithm, CNN network, GAN network and capturing videos with different bit rates. Our experiments demonstrate that not only the models trained on our dataset have better generalization capability and robustness, but also the trained images can maintain better edge contours and texture features. △ Less

Submitted 13 April, 2020; originally announced April 2020.

Reinforced Curriculum Learning on Pre-trained Neural Machine Translation Models

Authors: Mingjun Zhao, Haijiang Wu, Di Niu, Xiaoli Wang

Abstract: The competitive performance of neural machine translation (NMT) critically relies on large amounts of training data. However, acquiring high-quality translation pairs requires expert knowledge and is costly. Therefore, how to best utilize a given dataset of samples with diverse quality and characteristics becomes an important yet understudied question in NMT. Curriculum learning methods have been… ▽ More The competitive performance of neural machine translation (NMT) critically relies on large amounts of training data. However, acquiring high-quality translation pairs requires expert knowledge and is costly. Therefore, how to best utilize a given dataset of samples with diverse quality and characteristics becomes an important yet understudied question in NMT. Curriculum learning methods have been introduced to NMT to optimize a model's performance by prescribing the data input order, based on heuristics such as the assessment of noise and difficulty levels. However, existing methods require training from scratch, while in practice most NMT models are pre-trained on big data already. Moreover, as heuristics, they do not generalize well. In this paper, we aim to learn a curriculum for improving a pre-trained NMT model by re-selecting influential data samples from the original training set and formulate this task as a reinforcement learning problem. Specifically, we propose a data selection framework based on Deterministic Actor-Critic, in which a critic network predicts the expected change of model performance due to a certain sample, while an actor network learns to select the best sample out of a random batch of samples presented to it. Experiments on several translation datasets show that our method can further improve the performance of NMT when original batch training reaches its ceiling, without using additional new training data, and significantly outperforms several strong baseline methods. △ Less

Submitted 12 April, 2020; originally announced April 2020.

Comments: Accepted as full paper by AAAI-2020 (oral presentation)

Efficient Linear and Unconditionally Energy Stable Schemes for the Modified Phase Field Crystal Equation

Authors: Xiaoli Li, Jie Shen

Abstract: In this paper, we construct efficient schemes based on the scalar auxiliary variable (SAV) block-centered finite difference method for the modified phase field crystal (MPFC) equation, which is a sixth-order nonlinear damped wave equation. The schemes are linear, conserve mass and unconditionally dissipate a pseudo energy. We prove rigorously second-order error estimates in both time and space for… ▽ More In this paper, we construct efficient schemes based on the scalar auxiliary variable (SAV) block-centered finite difference method for the modified phase field crystal (MPFC) equation, which is a sixth-order nonlinear damped wave equation. The schemes are linear, conserve mass and unconditionally dissipate a pseudo energy. We prove rigorously second-order error estimates in both time and space for the phase field variable in discrete norms. We also present some numerical experiments to verify our theoretical results and demonstrate the robustness and accuracy. △ Less

Submitted 8 April, 2020; originally announced April 2020.

Characterizing Speech Adversarial Examples Using Self-Attention U-Net Enhancement

Authors: Chao-Han Huck Yang, Jun Qi, Pin-Yu Chen, Xiaoli Ma, Chin-Hui Lee

Abstract: Recent studies have highlighted adversarial examples as ubiquitous threats to the deep neural network (DNN) based speech recognition systems. In this work, we present a U-Net based attention model, U-Net$_{At}$, to enhance adversarial speech signals. Specifically, we evaluate the model performance by interpretable speech recognition metrics and discuss the model performance by the augmented advers… ▽ More Recent studies have highlighted adversarial examples as ubiquitous threats to the deep neural network (DNN) based speech recognition systems. In this work, we present a U-Net based attention model, U-Net$_{At}$, to enhance adversarial speech signals. Specifically, we evaluate the model performance by interpretable speech recognition metrics and discuss the model performance by the augmented adversarial training. Our experiments show that our proposed U-Net$_{At}$ improves the perceptual evaluation of speech quality (PESQ) from 1.13 to 2.78, speech transmission index (STI) from 0.65 to 0.75, short-term objective intelligibility (STOI) from 0.83 to 0.96 on the task of speech enhancement with adversarial speech examples. We conduct experiments on the automatic speech recognition (ASR) task with adversarial audio attacks. We find that (i) temporal features learned by the attention network are capable of enhancing the robustness of DNN based ASR models; (ii) the generalization power of DNN based ASR model could be enhanced by applying adversarial training with an additive adversarial data augmentation. The ASR metric on word-error-rates (WERs) shows that there is an absolute 2.22 $\%$ decrease under gradient-based perturbation, and an absolute 2.03 $\%$ decrease, under evolutionary-optimized perturbation, which suggests that our enhancement models with adversarial training can further secure a resilient ASR system. △ Less

Submitted 31 December, 2021; v1 submitted 30 March, 2020; originally announced March 2020.

Comments: The authors have revised some annotations in Table 4 to improve the clarity. The authors thank reading feedbacks from Jonathan Le Roux. The first draft was finished in August 2019. Accepted to IEEE ICASSP 2020

Journal ref: 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)