Showing 201–250 of 671 results for author: Xiali

Physics-Guided Hierarchical Reward Mechanism for Learning-Based Robotic Gras**

Authors: Yunsik Jung, Lingfeng Tao, Michael Bowman, Jiucai Zhang, Xiaoli Zhang

Abstract: Learning-based gras** can afford real-time grasp motion planning of multi-fingered robotics hands thanks to its high computational efficiency. However, learning-based methods are required to explore large search spaces during the learning process. The search space causes low learning efficiency, which has been the main barrier to its practical adoption. In addition, the trained policy lacks a ge… ▽ More Learning-based gras** can afford real-time grasp motion planning of multi-fingered robotics hands thanks to its high computational efficiency. However, learning-based methods are required to explore large search spaces during the learning process. The search space causes low learning efficiency, which has been the main barrier to its practical adoption. In addition, the trained policy lacks a generalizable outcome unless objects are identical to the trained objects. In this work, we develop a novel Physics-Guided Deep Reinforcement Learning with a Hierarchical Reward Mechanism to improve learning efficiency and generalizability for learning-based autonomous gras**. Unlike conventional observation-based grasp learning, physics-informed metrics are utilized to convey correlations between features associated with hand structures and objects to improve learning efficiency and outcomes. Further, the hierarchical reward mechanism enables the robot to learn prioritized components of the gras** tasks. Our method is validated in robotic gras** tasks with a 3-finger MICO robot arm. The results show that our method outperformed the standard Deep Reinforcement Learning methods in various robotic gras** tasks. △ Less

Submitted 23 July, 2023; v1 submitted 26 May, 2022; originally announced May 2022.

Multi-Phase Multi-Objective Dexterous Manipulation with Adaptive Hierarchical Curriculum

Authors: Lingfeng Tao, Jiucai Zhang, Xiaoli Zhang

Abstract: Dexterous manipulation tasks usually have multiple objectives, and the priorities of these objectives may vary at different phases of a manipulation task. Varying priority makes a robot hardly or even failed to learn an optimal policy with a deep reinforcement learning (DRL) method. To solve this problem, we develop a novel Adaptive Hierarchical Reward Mechanism (AHRM) to guide the DRL agent to le… ▽ More Dexterous manipulation tasks usually have multiple objectives, and the priorities of these objectives may vary at different phases of a manipulation task. Varying priority makes a robot hardly or even failed to learn an optimal policy with a deep reinforcement learning (DRL) method. To solve this problem, we develop a novel Adaptive Hierarchical Reward Mechanism (AHRM) to guide the DRL agent to learn manipulation tasks with multiple prioritized objectives. The AHRM can determine the objective priorities during the learning process and update the reward hierarchy to adapt to the changing objective priorities at different phases. The proposed method is validated in a multi-objective manipulation task with a JACO robot arm in which the robot needs to manipulate a target with obstacles surrounded. The simulation and physical experiment results show that the proposed method improved robot learning in task performance and learning efficiency. △ Less

Submitted 28 July, 2022; v1 submitted 26 May, 2022; originally announced May 2022.

Comments: Accepted by the Journal of Intelligent & Robotic Systems

Accelerating Chemical Exchange Saturation Transfer Imaging Using a Model-based Deep Neural Network With Synthetic Training Data

Authors: Jian** Xu, Tao Zu, Yi-Cheng Hsu, Xiaoli Wang, Kannie W. Y. Chan, Yi Zhang

Abstract: Purpose: To develop a model-based deep neural network for high-quality image reconstruction of undersampled multi-coil chemical exchange saturation transfer (CEST) data. Theory and Methods: Inspired by the variational network, the CEST image reconstruction equation is unrolled into a deep neural network (CEST-VN) with a k-space data-sharing block that takes advantage of the inherent redundancy in… ▽ More Purpose: To develop a model-based deep neural network for high-quality image reconstruction of undersampled multi-coil chemical exchange saturation transfer (CEST) data. Theory and Methods: Inspired by the variational network, the CEST image reconstruction equation is unrolled into a deep neural network (CEST-VN) with a k-space data-sharing block that takes advantage of the inherent redundancy in adjacent CEST frames and 3D spatial-frequential convolution kernels that exploit correlations in the x-ω domain. Additionally, a new pipeline based on multiple-pool Bloch-McConnell simulations is devised to synthesize multi-coil CEST data from publicly available anatomical MRI data. The proposed neural network is trained on simulated data with a CEST-specific loss function that jointly measures the structural and CEST contrast. The performance of CEST-VN was evaluated on three healthy volunteers and five brain tumor patients using retrospectively undersampled data with various acceleration factors, and compared with other state-of-the-art reconstruction methods. Results: The proposed CEST-VN method generated high-quality CEST source images and APT-weighted (APTw) maps in healthy and brain tumor subjects, consistently outperforming GRAPPA, blind compressed sensing, and the original variational network. With the acceleration factors increasing from 3 to 6, CEST-VN with the same hyperparameters yielded similar and accurate reconstruction without apparent loss of details or increase of artifacts. The ablation studies confirmed the effectiveness of the joint CEST-specific loss function and data-sharing block used. Conclusions: The proposed CEST-VN method can offer high-quality CEST source images and APTw maps from highly undersampled multi-coil data by integrating the deep-learning prior and multi-coil sensitivity encoding model. △ Less

Submitted 25 May, 2023; v1 submitted 20 May, 2022; originally announced May 2022.

Comments: 31 pages, 12 figures, 3 tables

Quantum discords of tripartite quantum systems

Authors: Jianming Zhou, Xiaoli Hu, Naihuan **g

Abstract: The quantum discord of bipartite systems is one of the best-known measures of non-classical correlations and an important quantum resource. In the recent work appeared in [Phys. Rev. Lett 2020, 124:110401], the quantum discord has been generalized to multipartite systems. In this paper, we give analytic solutions of the quantum discord for tripartite states with fourteen parameters. The quantum discord of bipartite systems is one of the best-known measures of non-classical correlations and an important quantum resource. In the recent work appeared in [Phys. Rev. Lett 2020, 124:110401], the quantum discord has been generalized to multipartite systems. In this paper, we give analytic solutions of the quantum discord for tripartite states with fourteen parameters. △ Less

Submitted 12 May, 2022; originally announced May 2022.

Comments: 14 pages, 4 figures

Journal ref: Quant. Inf. Process. (2022) 21:147, (17pp)

A Survey on AI Sustainability: Emerging Trends on Learning Algorithms and Research Challenges

Authors: Zhenghua Chen, Min Wu, Alvin Chan, Xiaoli Li, Yew-Soon Ong

Abstract: Artificial Intelligence (AI) is a fast-growing research and development (R&D) discipline which is attracting increasing attention because of its promises to bring vast benefits for consumers and businesses, with considerable benefits promised in productivity growth and innovation. To date it has reported significant accomplishments in many areas that have been deemed as challenging for machines, r… ▽ More Artificial Intelligence (AI) is a fast-growing research and development (R&D) discipline which is attracting increasing attention because of its promises to bring vast benefits for consumers and businesses, with considerable benefits promised in productivity growth and innovation. To date it has reported significant accomplishments in many areas that have been deemed as challenging for machines, ranging from computer vision, natural language processing, audio analysis to smart sensing and many others. The technical trend in realizing the successes has been towards increasing complex and large size AI models so as to solve more complex problems at superior performance and robustness. This rapid progress, however, has taken place at the expense of substantial environmental costs and resources. Besides, debates on the societal impacts of AI, such as fairness, safety and privacy, have continued to grow in intensity. These issues have presented major concerns pertaining to the sustainable development of AI. In this work, we review major trends in machine learning approaches that can address the sustainability problem of AI. Specifically, we examine emerging AI methodologies and algorithms for addressing the sustainability issue of AI in two major aspects, i.e., environmental sustainability and social sustainability of AI. We will also highlight the major limitations of existing studies and propose potential research challenges and directions for the development of next generation of sustainable AI techniques. We believe that this technical review can help to promote a sustainable development of AI R&D activities for the research community. △ Less

Submitted 8 May, 2022; originally announced May 2022.

A disorder-sensitive emergent vortex phase identified in high-Tc superconductor (Li,Fe)OHFeSe

Authors: Dong Li, Peipei Shen, **peng Tian, Ge He, Shunli Ni, Zhaosheng Wang, Chuanying Xi, Li Pi, Hua Zhang, Jie Yuan, Kui **, Evgeny F. Talantsev, Li Yu, Fang Zhou, Jens Hänisch, Xiaoli Dong, Zhongxian Zhao

Abstract: The magneto-transport properties are systematically measured under c-direction fields up to 33 T for a series of single-crystal films of intercalated iron-selenide superconductor (Li,Fe)OHFeSe. The film samples with varying degree of disorder are grown hydrothermally. We observe a magnetic-field-enhanced shoulder-like feature in the mixed state of the high-Tc (Li,Fe)OHFeSe films with weak disorder… ▽ More The magneto-transport properties are systematically measured under c-direction fields up to 33 T for a series of single-crystal films of intercalated iron-selenide superconductor (Li,Fe)OHFeSe. The film samples with varying degree of disorder are grown hydrothermally. We observe a magnetic-field-enhanced shoulder-like feature in the mixed state of the high-Tc (Li,Fe)OHFeSe films with weak disorder, while the feature fades away in the films with enhanced disorder. The irreversibility field is significantly suppressed to lower temperatures with the appearance of the shoulder feature. Based on the experiment and model analysis, we establish a new vortex phase diagram for the weakly disordered high-Tc (Li,Fe)OHFeSe, which features an emergent dissipative vortex phase intermediate between the common vortex glass and liquid phases. The reason for the emergence of this intermediate vortex state is further discussed based on related experiments and models. △ Less

Submitted 6 May, 2022; originally announced May 2022.

Comments: 15 pages, 4 figures

Journal ref: Supercond. Sci. Technol. 35 (2022) 064007

Type-aware Embeddings for Multi-Hop Reasoning over Knowledge Graphs

Authors: Zhiwei Hu, Víctor Gutiérrez-Basulto, Zhiliang Xiang, Xiaoli Li, Ru Li, Jeff Z. Pan

Abstract: Multi-hop reasoning over real-life knowledge graphs (KGs) is a highly challenging problem as traditional subgraph matching methods are not capable to deal with noise and missing information. To address this problem, it has been recently introduced a promising approach based on jointly embedding logical queries and KGs into a low-dimensional space to identify answer entities. However, existing prop… ▽ More Multi-hop reasoning over real-life knowledge graphs (KGs) is a highly challenging problem as traditional subgraph matching methods are not capable to deal with noise and missing information. To address this problem, it has been recently introduced a promising approach based on jointly embedding logical queries and KGs into a low-dimensional space to identify answer entities. However, existing proposals ignore critical semantic knowledge inherently available in KGs, such as type information. To leverage type information, we propose a novel TypE-aware Message Passing (TEMP) model, which enhances the entity and relation representations in queries, and simultaneously improves generalization, deductive and inductive reasoning. Remarkably, TEMP is a plug-and-play model that can be easily incorporated into existing embedding-based models to improve their performance. Extensive experiments on three real-world datasets demonstrate TEMP's effectiveness. △ Less

Submitted 4 July, 2022; v1 submitted 2 May, 2022; originally announced May 2022.

Comments: Accepted to IJCAI-ECAI 2022

An Interactive Polymer Building Toolkit for Molecular Dynamics Simulations: PolyMAPS

Authors: Xiaoli Yan, Santanu Chaudhuri

Abstract: PolyMAPS is an open-source library that helps researchers to initialize LAMMPS molecular dynamics simulations. It introduces an integrated workflow by combining preparation, launching, visualization, and analysis into a single Jupyter notebook. PolyMAPS enables users to build small or polymeric molecules in a user-friendly interactive 3D plotting system that supports reading and writing systems in… ▽ More PolyMAPS is an open-source library that helps researchers to initialize LAMMPS molecular dynamics simulations. It introduces an integrated workflow by combining preparation, launching, visualization, and analysis into a single Jupyter notebook. PolyMAPS enables users to build small or polymeric molecules in a user-friendly interactive 3D plotting system that supports reading and writing systems in LAMMPS data file format. Hence, PolyMAPS demonstrates the potential of reducing the learning difficulties of new users of the LAMMPS software. △ Less

Submitted 10 November, 2023; v1 submitted 28 April, 2022; originally announced April 2022.

Adaptive Modulation for Wobbling UAV Air-to-Ground Links in Millimeter-wave Bands

Authors: Songjiang Yang, Zitian Zhang, Jiliang Zhang, Xiaoli Chu, Jie Zhang

Abstract: The emerging millimeter-wave (mm-wave) unmanned aerial vehicle (UAV) air-to-ground (A2G) communications are facing the Doppler effect problem that arises from the inevitable wobbling of the UAV. The fast time-varying channel for UAV A2G communications may lead to the outdated channel state information (CSI) from the channel estimation. In this paper, we introduce two detectors to demodulate the re… ▽ More The emerging millimeter-wave (mm-wave) unmanned aerial vehicle (UAV) air-to-ground (A2G) communications are facing the Doppler effect problem that arises from the inevitable wobbling of the UAV. The fast time-varying channel for UAV A2G communications may lead to the outdated channel state information (CSI) from the channel estimation. In this paper, we introduce two detectors to demodulate the received signal and get the instantaneous bit error probability (BEP) of a mm-wave UAV A2G link under imperfect CSI. Based on the designed detectors, we propose an adaptive modulation scheme to maximize the average transmission rate under imperfect CSI by optimizing the data transmission time subject to the maximum tolerable BEP. A power control policy is in conjunction with adaptive modulation to minimize the transmission power while maintaining both the BEP under the threshold and the maximized average transmission rate. Numerical results show that the proposed adaptive modulation scheme in conjunction with the power control policy could maximize the temporally averaged transmission rate, while saves as much as 50\% energy. △ Less

Submitted 13 April, 2022; originally announced April 2022.

Highly efficient exponential scalar auxiliary variable approaches with relaxation (RE-SAV) for gradient flows

Authors: Zhengguang Liu, Xiaoli Li

Abstract: For the past few years, scalar auxiliary variable (SAV) and SAV-type approaches became very hot and efficient methods to simulate various gradient flows. Inspired by the new SAV approach in \cite{huang2020highly}, we propose a novel technique to construct a new exponential scalar auxiliary variable (E-SAV) approach to construct high-order numerical energy stable schemes for gradient flows. To impr… ▽ More For the past few years, scalar auxiliary variable (SAV) and SAV-type approaches became very hot and efficient methods to simulate various gradient flows. Inspired by the new SAV approach in \cite{huang2020highly}, we propose a novel technique to construct a new exponential scalar auxiliary variable (E-SAV) approach to construct high-order numerical energy stable schemes for gradient flows. To improve its accuracy and consistency noticeably, we propose an E-SAV approach with relaxation, which we named the relaxed E-SAV (RE-SAV) method for gradient flows. The RE-SAV approach preserves all the advantages of the traditional SAV approach. In addition, we do not need any the bounded-from-below assumptions for the free energy potential or nonlinear term. Besides, the first-order, second-order and higher-order unconditionally energy stable time-step** schemes are easy to construct. Several numerical examples are provided to demonstrate the improved efficiency and accuracy of the proposed method. △ Less

Submitted 13 April, 2022; originally announced April 2022.

Comments: arXiv admin note: substantial text overlap with arXiv:2010.11728, arXiv:2001.00812

Learning Constrained Dynamic Correlations in Spatiotemporal Graphs for Motion Prediction

Authors: Jiajun Fu, Fuxing Yang, Yonghao Dang, Xiaoli Liu, Jianqin Yin

Abstract: Human motion prediction is challenging due to the complex spatiotemporal feature modeling. Among all methods, graph convolution networks (GCNs) are extensively utilized because of their superiority in explicit connection modeling. Within a GCN, the graph correlation adjacency matrix drives feature aggregation and is the key to extracting predictive motion features. State-of-the-art methods decompo… ▽ More Human motion prediction is challenging due to the complex spatiotemporal feature modeling. Among all methods, graph convolution networks (GCNs) are extensively utilized because of their superiority in explicit connection modeling. Within a GCN, the graph correlation adjacency matrix drives feature aggregation and is the key to extracting predictive motion features. State-of-the-art methods decompose the spatiotemporal correlation into spatial correlations for each frame and temporal correlations for each joint. Directly parameterizing these correlations introduces redundant parameters to represent common relations shared by all frames and all joints. Besides, the spatiotemporal graph adjacency matrix is the same for different motion samples and cannot reflect sample-wise correspondence variances. To overcome these two bottlenecks, we propose dynamic spatiotemporal decompose GC (DSTD-GC), which only takes 28.6% parameters of the state-of-the-art GC. The key of DSTD-GC is constrained dynamic correlation modeling, which explicitly parameterizes the common static constraints as a spatial/temporal vanilla adjacency matrix shared by all frames/joints and dynamically extracts correspondence variances for each frame/joint with an adjustment modeling function. For each sample, the common constrained adjacency matrices are fixed to represent generic motion patterns, while the extracted variances complete the matrices with specific pattern adjustments. Meanwhile, we mathematically reformulate GCs on spatiotemporal graphs into a unified form and find that DSTD-GC relaxes certain constraints of other GC, which contributes to a better representation capability. By combining DSTD-GC with prior knowledge, we propose a powerful spatiotemporal GCN called DSTD-GCN, which outperforms SOTA methods by $3.9\% \sim 8.7\%$ in prediction accuracy with $55.0\% \sim 96.9\%$ fewer parameters. △ Less

Submitted 3 June, 2023; v1 submitted 4 April, 2022; originally announced April 2022.

Comments: Accepted by TNNLS. Codes are available at https://github.com/Jaakk0F/DSTD-GCN

Size distribution of primary submicron particles and larger aggregates in solvent induced asphaltene precipitation

Authors: Jia Meng, Somasekhara Goud Sontti, Mohsen Sadeghi, Gilmar F. Arends, Petr Nikrityuk, Xiaoli Tan, Xuehua Zhang

Abstract: Asphaltene precipitation is a crucial phase separation phenomenon in the oil industry, especially in paraffinic froth treatment to extract bitumen from oil sands ores. This work reveals the formation of particles at 0.2 to 0.4 um in radius, defined as a primary sub-micron particle (PSMP), which is ubiquitous from diffusive mixing between asphaltene solution and any of 23 types of precipitants exam… ▽ More Asphaltene precipitation is a crucial phase separation phenomenon in the oil industry, especially in paraffinic froth treatment to extract bitumen from oil sands ores. This work reveals the formation of particles at 0.2 to 0.4 um in radius, defined as a primary sub-micron particle (PSMP), which is ubiquitous from diffusive mixing between asphaltene solution and any of 23 types of precipitants examined in our experiments. The yield and quantity of asphaltene particles are affected not only by the Hildebrand solubility parameter of the precipitants but also by the diffusion coefficients of the asphaltene solution and the precipitant. The Population Balance Model (PBM) with the Hildebrand solubility parameter has been used to model particle size distribution. Good agreement has been achieved between numerical predictions and the experimental data. It indicates that the colloid theory can describe the size distribution of PSMP and larger aggregates. Therefore, this study provides new insight into the mechanism for the dependence of yield and size distribution of the precipitated asphaltene particles on the composition of precipitants and adding inhibitors. Controlling of asphaltene yield and size distribution may be applied to the process of hydrocarbon separation or asphaltene precipitation prevention. △ Less

Submitted 1 April, 2022; originally announced April 2022.

Comments: Preprint submitted to Fuel

An Optimal Control Method to Compute the Most Likely Transition Path for Stochastic Dynamical Systems with Jumps

Authors: Wei Wei, Ting Gao, **qiao Duan, Xiaoli Chen

Abstract: Many complex real world phenomena exhibit abrupt, intermittent or jum** behaviors, which are more suitable to be described by stochastic differential equations under non-Gaussian Lévy noise. Among these complex phenomena, the most likely transition paths between metastable states are important since these rare events may have a high impact in certain scenarios. Based on the large deviation princ… ▽ More Many complex real world phenomena exhibit abrupt, intermittent or jum** behaviors, which are more suitable to be described by stochastic differential equations under non-Gaussian Lévy noise. Among these complex phenomena, the most likely transition paths between metastable states are important since these rare events may have a high impact in certain scenarios. Based on the large deviation principle, the most likely transition path could be treated as the minimizer of the rate function upon paths that connect two points. One of the challenges to calculate the most likely transition path for stochastic dynamical systems under non-Gaussian Lévy noise is that the associated rate function can not be explicitly expressed by paths. For this reason, we formulate an optimal control problem to obtain the optimal state as the most likely transition path. We then develop a neural network method to solve this issue. Several experiments are investigated for both Gaussian and non-Gaussian cases. △ Less

Submitted 14 September, 2023; v1 submitted 31 March, 2022; originally announced March 2022.

Comments: 17 pages, 12 figures

Slow-varying Dynamics Assisted Temporal Capsule Network for Machinery Remaining Useful Life Estimation

Authors: Yan Qin, Chau Yuen, Yimin Shao, Bo Qin, Xiaoli Li

Abstract: Capsule network (CapsNet) acts as a promising alternative to the typical convolutional neural network, which is the dominant network to develop the remaining useful life (RUL) estimation models for mechanical equipment. Although CapsNet comes with an impressive ability to represent the entities' hierarchical relationships through a high-dimensional vector embedding, it fails to capture the long-te… ▽ More Capsule network (CapsNet) acts as a promising alternative to the typical convolutional neural network, which is the dominant network to develop the remaining useful life (RUL) estimation models for mechanical equipment. Although CapsNet comes with an impressive ability to represent the entities' hierarchical relationships through a high-dimensional vector embedding, it fails to capture the long-term temporal correlation of run-to-failure time series measured from degraded mechanical equipment. On the other hand, the slow-varying dynamics, which reveals the low-frequency information hidden in mechanical dynamical behaviour, is overlooked in the existing RUL estimation models, limiting the utmost ability of advanced networks. To address the aforementioned concerns, we propose a Slow-varying Dynamics assisted Temporal CapsNet (SD-TemCapsNet) to simultaneously learn the slow-varying dynamics and temporal dynamics from measurements for accurate RUL estimation. First, in light of the sensitivity of fault evolution, slow-varying features are decomposed from normal raw data to convey the low-frequency components corresponding to the system dynamics. Next, the long short-term memory (LSTM) mechanism is introduced into CapsNet to capture the temporal correlation of time series. To this end, experiments conducted on an aircraft engine and a milling machine verify that the proposed SD-TemCapsNet outperforms the mainstream methods. In comparison with CapsNet, the estimation accuracy of the aircraft engine with four different scenarios has been improved by 10.17%, 24.97%, 3.25%, and 13.03% concerning the index root mean squared error, respectively. Similarly, the estimation accuracy of the milling machine has been improved by 23.57% compared to LSTM and 19.54% compared to CapsNet. △ Less

Submitted 30 March, 2022; originally announced March 2022.

Comments: This paper has been accepted by IEEE Transactions on Cybernetics

Enhancement of the superconducting critical temperature realized in the La-Ce-H system at moderate pressures

Authors: Wuhao Chen, Xiaoli Huang, Dmitrii V. Semenok, Su Chen, Kexin Zhang, Artem R. Oganov, Tian Cui

Abstract: Covalent and ionic polyhydrides have become the two main camps in searching for the high-temperature superconductors under pressure. They have been considered as important platforms for exploring ternary or multiple hydrides in order to further increase the Tc or decrease the stabilization pressure. In this work, we successfully synthesized ternary hexagonal La-Ce polyhydrides stable in the pressu… ▽ More Covalent and ionic polyhydrides have become the two main camps in searching for the high-temperature superconductors under pressure. They have been considered as important platforms for exploring ternary or multiple hydrides in order to further increase the Tc or decrease the stabilization pressure. In this work, we successfully synthesized ternary hexagonal La-Ce polyhydrides stable in the pressure range of 95-130 GPa by laser-heating the La-Ce alloy (initial ratio La:Ce=2.5-3.5) in ammonia borane. Superconductivity at 176 K was strikingly preserved to about 100 GPa. The extrapolated upper critical field Hc2(0) reached 216 T at 100 GPa, the highest value among the synthesized polyhydrides. We also performed the contrast experiments and stabilized binary high-temperature superconducting LaHx with Tc-103 K at 78 GPa. In the pressure range of 95-130 GPa, the ternary hexagonal La-Ce-H system exhibits higher Tc than the binary La-H system, with the maximum difference of 100 K, and the compounds of both systems were synthesized at the same pressure and temperature conditions. These results clearly indicate that the discovered La-Ce-H system not only enriches the high-temperature superconducting hydrides but also realizes high-Tc at moderate pressures. △ Less

Submitted 12 April, 2022; v1 submitted 27 March, 2022; originally announced March 2022.

Depth Estimation by Combining Binocular Stereo and Monocular Structured-Light

Authors: Yuhua Xu, Xiaoli Yang, Yushan Yu, Wei Jia, Zhaobi Chu, Yulan Guo

Abstract: It is well known that the passive stereo system cannot adapt well to weak texture objects, e.g., white walls. However, these weak texture targets are very common in indoor environments. In this paper, we present a novel stereo system, which consists of two cameras (an RGB camera and an IR camera) and an IR speckle projector. The RGB camera is used both for depth estimation and texture acquisition.… ▽ More It is well known that the passive stereo system cannot adapt well to weak texture objects, e.g., white walls. However, these weak texture targets are very common in indoor environments. In this paper, we present a novel stereo system, which consists of two cameras (an RGB camera and an IR camera) and an IR speckle projector. The RGB camera is used both for depth estimation and texture acquisition. The IR camera and the speckle projector can form a monocular structured-light (MSL) subsystem, while the two cameras can form a binocular stereo subsystem. The depth map generated by the MSL subsystem can provide external guidance for the stereo matching networks, which can improve the matching accuracy significantly. In order to verify the effectiveness of the proposed system, we build a prototype and collect a test dataset in indoor scenes. The evaluation results show that the Bad 2.0 error of the proposed system is 28.2% of the passive stereo system when the network RAFT is used. The dataset and trained models are available at https://github.com/YuhuaXu/MonoStereoFusion. △ Less

Submitted 20 March, 2022; originally announced March 2022.

Comments: CVPR 2022

Thompson Sampling on Asymmetric $α$-Stable Bandits

Authors: Zhendong Shi, Ercan E. Kuruoglu, Xiaoli Wei

Abstract: In algorithm optimization in reinforcement learning, how to deal with the exploration-exploitation dilemma is particularly important. Multi-armed bandit problem can optimize the proposed solutions by changing the reward distribution to realize the dynamic balance between exploration and exploitation. Thompson Sampling is a common method for solving multi-armed bandit problem and has been used to e… ▽ More In algorithm optimization in reinforcement learning, how to deal with the exploration-exploitation dilemma is particularly important. Multi-armed bandit problem can optimize the proposed solutions by changing the reward distribution to realize the dynamic balance between exploration and exploitation. Thompson Sampling is a common method for solving multi-armed bandit problem and has been used to explore data that conform to various laws. In this paper, we consider the Thompson Sampling approach for multi-armed bandit problem, in which rewards conform to unknown asymmetric $α$-stable distributions and explore their applications in modelling financial and wireless data. △ Less

Submitted 25 March, 2022; v1 submitted 18 March, 2022; originally announced March 2022.

Comments: 8 pages, 4 figures

ADATIME: A Benchmarking Suite for Domain Adaptation on Time Series Data

Authors: Mohamed Ragab, Emadeldeen Eldele, Wee Ling Tan, Chuan-Sheng Foo, Zhenghua Chen, Min Wu, Chee-Keong Kwoh, Xiaoli Li

Abstract: Unsupervised domain adaptation methods aim to generalize well on unlabeled test data that may have a different (shifted) distribution from the training data. Such methods are typically developed on image data, and their application to time series data is less explored. Existing works on time series domain adaptation suffer from inconsistencies in evaluation schemes, datasets, and backbone neural n… ▽ More Unsupervised domain adaptation methods aim to generalize well on unlabeled test data that may have a different (shifted) distribution from the training data. Such methods are typically developed on image data, and their application to time series data is less explored. Existing works on time series domain adaptation suffer from inconsistencies in evaluation schemes, datasets, and backbone neural network architectures. Moreover, labeled target data are often used for model selection, which violates the fundamental assumption of unsupervised domain adaptation. To address these issues, we develop a benchmarking evaluation suite (AdaTime) to systematically and fairly evaluate different domain adaptation methods on time series data. Specifically, we standardize the backbone neural network architectures and benchmarking datasets, while also exploring more realistic model selection approaches that can work with no labeled data or just a few labeled samples. Our evaluation includes adapting state-of-the-art visual domain adaptation methods to time series data as well as the recent methods specifically developed for time series data. We conduct extensive experiments to evaluate 11 state-of-the-art methods on five representative datasets spanning 50 cross-domain scenarios. Our results suggest that with careful selection of hyper-parameters, visual domain adaptation methods are competitive with methods proposed for time series domain adaptation. In addition, we find that hyper-parameters could be selected based on realistic model selection approaches. Our work unveils practical insights for applying domain adaptation methods on time series data and builds a solid foundation for future works in the field. The code is available at \href{https://github.com/emadeldeen24/AdaTime}{github.com/emadeldeen24/AdaTime}. △ Less

Submitted 5 May, 2023; v1 submitted 15 March, 2022; originally announced March 2022.

Comments: Accepted in the ACM Transactions on Knowledge Discovery from Data (TKDD)

Towards Adversarial Control Loops in Sensor Attacks: A Case Study to Control the Kinematics and Actuation of Embedded Systems

Authors: Yazhou Tu, Sara Rampazzi, Xiali Hei

Abstract: Recent works investigated attacks on sensors by influencing analog sensor components with acoustic, light, and electromagnetic signals. Such attacks can have extensive security, reliability, and safety implications since many types of the targeted sensors are also widely used in critical process control, robotics, automation, and industrial control systems. While existing works advanced our unders… ▽ More Recent works investigated attacks on sensors by influencing analog sensor components with acoustic, light, and electromagnetic signals. Such attacks can have extensive security, reliability, and safety implications since many types of the targeted sensors are also widely used in critical process control, robotics, automation, and industrial control systems. While existing works advanced our understanding of the physical-level risks that are hidden from a digital-domain perspective, gaps exist in how the attack can be guided to achieve system-level control in real-time, continuous processes. This paper proposes an adversarial control loop-based approach for real-time attacks on control systems relying on sensors. We study how to utilize the system feedback extracted from physical-domain signals to guide the attacks. In the attack process, injection signals are adjusted in real time based on the extracted feedback to exert targeted influence on a victim control system that is continuously affected by the injected perturbations and applying changes to the physical environment. In our case study, we investigate how an external adversarial control system can be constructed over sensor-actuator systems and demonstrate the attacks with program-controlled processes to manipulate the victim system without accessing its internal statuses. △ Less

Submitted 15 March, 2022; originally announced March 2022.

Non-equilibrium molecular geometries in graph neural networks

Authors: Ali Raza, E. Adrian Henle, Xiaoli Fern

Abstract: Graph neural networks have become a powerful framework for learning complex structure-property relationships and fast screening of chemical compounds. Recently proposed methods have demonstrated that using 3D geometry information of the molecule along with the bonding structure can lead to more accurate prediction on a wide range of properties. A common practice is to use 3D geometries computed th… ▽ More Graph neural networks have become a powerful framework for learning complex structure-property relationships and fast screening of chemical compounds. Recently proposed methods have demonstrated that using 3D geometry information of the molecule along with the bonding structure can lead to more accurate prediction on a wide range of properties. A common practice is to use 3D geometries computed through density functional theory (DFT) for both training and testing of models. However, the computational time needed for DFT calculations can be prohibitively large. Moreover, many of the properties that we aim to predict can often be obtained with little or no overhead on top of the DFT calculations used to produce the 3D geometry information, voiding the need for a predictive model. To be practically useful for high-throughput chemical screening and drug discovery, it is desirable to work with 3D geometries obtained using less-accurate but much more efficient non-DFT methods. In this work we investigate the impact of using non-DFT conformations in the training and the testing of existing models and propose a data augmentation method for improving the prediction accuracy of classical forcefield-derived geometries. △ Less

Submitted 7 March, 2022; originally announced March 2022.

Comments: accepted paper at the ELLIS Machine Learning for Molecule Discovery Workshop

aaeCAPTCHA: The Design and Implementation of Audio Adversarial CAPTCHA

Authors: Md Imran Hossen, Xiali Hei

Abstract: CAPTCHAs are designed to prevent malicious bot programs from abusing websites. Most online service providers deploy audio CAPTCHAs as an alternative to text and image CAPTCHAs for visually impaired users. However, prior research investigating the security of audio CAPTCHAs found them highly vulnerable to automated attacks using Automatic Speech Recognition (ASR) systems. To improve the robustness… ▽ More CAPTCHAs are designed to prevent malicious bot programs from abusing websites. Most online service providers deploy audio CAPTCHAs as an alternative to text and image CAPTCHAs for visually impaired users. However, prior research investigating the security of audio CAPTCHAs found them highly vulnerable to automated attacks using Automatic Speech Recognition (ASR) systems. To improve the robustness of audio CAPTCHAs against automated abuses, we present the design and implementation of an audio adversarial CAPTCHA (aaeCAPTCHA) system in this paper. The aaeCAPTCHA system exploits audio adversarial examples as CAPTCHAs to prevent the ASR systems from automatically solving them. Furthermore, we conducted a rigorous security evaluation of our new audio CAPTCHA design against five state-of-the-art DNN-based ASR systems and three commercial Speech-to-Text (STT) services. Our experimental evaluations demonstrate that aaeCAPTCHA is highly secure against these speech recognition technologies, even when the attacker has complete knowledge of the current attacks against audio adversarial examples. We also conducted a usability evaluation of the proof-of-concept implementation of the aaeCAPTCHA scheme. Our results show that it achieves high robustness at a moderate usability cost compared to normal audio CAPTCHAs. Finally, our extensive analysis highlights that aaeCAPTCHA can significantly enhance the security and robustness of traditional audio CAPTCHA systems while maintaining similar usability. △ Less

Submitted 5 March, 2022; originally announced March 2022.

Comments: Accepted at 7th IEEE European Symposium on Security and Privacy (EuroS&P 2022)

An Onsager-Machlup approach to the most probable transition pathway for a genetic regulatory network

Authors: Jianyu Hu, Xiaoli Chen, **qiao Duan

Abstract: We investigate a quantitative network of gene expression dynamics describing the competence development in Bacillus subtilis. First, we introduce an Onsager-Machlup approach to quantify the most probable transition pathway for both excitable and bistable dynamics. Then, we apply a machine learning method to calculate the most probable transition pathway via the Euler-Lagrangian equation. Finally,… ▽ More We investigate a quantitative network of gene expression dynamics describing the competence development in Bacillus subtilis. First, we introduce an Onsager-Machlup approach to quantify the most probable transition pathway for both excitable and bistable dynamics. Then, we apply a machine learning method to calculate the most probable transition pathway via the Euler-Lagrangian equation. Finally, we analyze how the noise intensity affects the transition phenomena. △ Less

Submitted 1 March, 2022; originally announced March 2022.

Going Deeper into Recognizing Actions in Dark Environments: A Comprehensive Benchmark Study

Authors: Yuecong Xu, Jianfei Yang, Haozhi Cao, Jianxiong Yin, Zhenghua Chen, Xiaoli Li, Zhengguo Li, Qianwen Xu

Abstract: While action recognition (AR) has gained large improvements with the introduction of large-scale video datasets and the development of deep neural networks, AR models robust to challenging environments in real-world scenarios are still under-explored. We focus on the task of action recognition in dark environments, which can be applied to fields such as surveillance and autonomous driving at night… ▽ More While action recognition (AR) has gained large improvements with the introduction of large-scale video datasets and the development of deep neural networks, AR models robust to challenging environments in real-world scenarios are still under-explored. We focus on the task of action recognition in dark environments, which can be applied to fields such as surveillance and autonomous driving at night. Intuitively, current deep networks along with visual enhancement techniques should be able to handle AR in dark environments, however, it is observed that this is not always the case in practice. To dive deeper into exploring solutions for AR in dark environments, we launched the UG2+ Challenge Track 2 (UG2-2) in IEEE CVPR 2021, with a goal of evaluating and advancing the robustness of AR models in dark environments. The challenge builds and expands on top of a novel ARID dataset, the first dataset for the task of dark video AR, and guides models to tackle such a task in both fully and semi-supervised manners. Baseline results utilizing current AR models and enhancement methods are reported, justifying the challenging nature of this task with substantial room for improvements. Thanks to the active participation from the research community, notable advances have been made in participants' solutions, while analysis of these solutions helped better identify possible directions to tackle the challenge of AR in dark environments. △ Less

Submitted 30 October, 2023; v1 submitted 19 February, 2022; originally announced February 2022.

Comments: Accepted by IJCV. Summary of UG2 2021 Track 2, 22 pages, 5 figures, 3 tables

A formation mechanism for the large plumes in the prominence

Authors: **cheng Wang, Xiaoli Yan, Zhike Xue, Liheng Yang, Qiaoling Li, Hechao Chen, Chun Xia, Zhong Liu

Abstract: To understand the formation mechanism of large plumes in solar prominences, we investigate the formation process of two such phenomena. We studied the dynamic and thermal properties of two large plumes using observations from New Vacuum Solar Telescope, the Solar Dynamic Observatory, and the Solar Terrestrial Relations Observatory-Ahead. We find that two large plumes observed with high-resolution… ▽ More To understand the formation mechanism of large plumes in solar prominences, we investigate the formation process of two such phenomena. We studied the dynamic and thermal properties of two large plumes using observations from New Vacuum Solar Telescope, the Solar Dynamic Observatory, and the Solar Terrestrial Relations Observatory-Ahead. We find that two large plumes observed with high-resolution data are quite different from previously studied small-scale plumes. They are born at the top of a prominence bubble with a large projected area of 10-20 Mm^2 . Before the occurrence of each large plume, the bubble expands and takes on a quasi-semicircular appearance. Meanwhile, the emission intensity of extreme-ultra-violet (EUV) bands increases in the bubble. A small-scale filament is found to erupt in the bubble during the second large plume. At the point at which the height of the bubble is comparable with half the width of the bubble, the bubble becomes unstable and generates the plumes. During the formation of plumes, two side edges of the top of the bubble, which are dominated by opposite Doppler signals, approach each other. The large plume then emerges and keeps rising up with a constant speed of about 13-15 km/s. These two large plumes have temperatures of 1.3 x 10^6 Kelvin and densities of 2.0 x 10^9 cm^-3, two orders hotter and one order less dense than the typical prominence. We also find that the bubble is a hot, low-density volume instead of a void region beneath the cold and dense prominence. Therefore, we conclude that these two large plumes are the result of the breakup of the prominence bubble triggered by an enhancement of thermal pressure; they separate from the bubble, most likely by magnetic reconnection. △ Less

Submitted 17 February, 2022; originally announced February 2022.

Comments: 14 pages, 7 figures, accepted for publication in A&A

Surface engineering for cellulose as a boosted Layer-by-Layer assembly: excellent flame retardancy and improved durability with introduction of bio-based "molecular glue"

Authors: Can Fu, Xiaoli Xu, Guang-Zhong Yin, Baoyun Xu, **yang Li, Bo Ai, Zhongjie Zhai, Fei GaO, **guo Zhai, De-Yi Wang

Abstract: Layer-by-Layer (LbL) assembly was attractive as a versatile tool to address the flammability of cotton, while the washing fastness of LbL coating stayed an issue. Aiming to tackle this issue, LbL layers consisted of phenylphosphonic acid (PHA) and 3-aminopropyltriethoxysilane (APTES) was deposited on polydopamine (PDA)-coated cotton. The prepared cotton reached 31.4% of limiting oxygen index (LOI)… ▽ More Layer-by-Layer (LbL) assembly was attractive as a versatile tool to address the flammability of cotton, while the washing fastness of LbL coating stayed an issue. Aiming to tackle this issue, LbL layers consisted of phenylphosphonic acid (PHA) and 3-aminopropyltriethoxysilane (APTES) was deposited on polydopamine (PDA)-coated cotton. The prepared cotton reached 31.4% of limiting oxygen index (LOI), and extinguished immediately after removing the ignitor. Peak of heat release rate (pHRR) attenuated around 36 % compared with pure cotton. A combined barrier and quenching mechanisms were proposed. Moreover, enhanced washing durability (24.1% of LOI) was achieved even after 50 detergent laundering cycles. A facile, boosted LbL approach with proposed π-π stacking interactions between PDA abundant aromatic structures and benzene ring in PHA from LbL layers, is first to put forward to construct durable efficient flame retardant (FR) cotton. This work attempted to enlighten more thoughts and design for durable FR cotton fabrics. △ Less

Submitted 22 January, 2022; originally announced February 2022.

A Unified Training Process for Fake News Detection based on Fine-Tuned BERT Model

Authors: Vijay Srinivas Tida, Dr. Sonya Hsu, Dr. Xiali Hei

Abstract: An efficient fake news detector becomes essential as the accessibility of social media platforms increases rapidly. An efficient fake news detector becomes essential as the accessibility of social media platforms increases rapidly. △ Less

Submitted 6 September, 2022; v1 submitted 3 February, 2022; originally announced February 2022.

Comments: 11 pages, 10 figures

Impacts of Hardware Impairments on Mutualistic Cooperative Ambient Backscatter Communications

Authors: Yinghui Ye, Liqin Shi, Xiaoli Chu, Guangyue Lu, Sumei Sun

Abstract: In mutualistic cooperative ambient backscatter communications (AmBC), Internet-of-Things (IoT) device sends its information to a desired receiver by modulating and backscattering the primary signal, while providing beneficial multipath diversity to the primary receiver in return, thus forming a mutualism relationship between the AmBC and primary links. We note that the hardware impairments (HIs),… ▽ More In mutualistic cooperative ambient backscatter communications (AmBC), Internet-of-Things (IoT) device sends its information to a desired receiver by modulating and backscattering the primary signal, while providing beneficial multipath diversity to the primary receiver in return, thus forming a mutualism relationship between the AmBC and primary links. We note that the hardware impairments (HIs), which are unavoidable in practical systems and may significantly affect the transmission rates of the primary and AmBC links and their mutualism relationships, have been largely ignored in the study of mutualistic cooperative AmBC networks. In this paper, we consider a mutualistic cooperative AmBC network under HIs, and study the impacts of HIs on the achievable rates of the primary link and the AmBC link. In particular, we theoretically prove that although HIs degrades the rate of each link, the mutualism relationship between the AmBC and primary links is maintained, i.e., the rate of the primary link in the mutualistic cooperative AmBC network is still higher than that without the AmBC link. The closed-form rate expressions of both the AmBC and primary links are derived. Computer simulations are provided to validate our theoretical analysis. △ Less

Submitted 25 January, 2022; originally announced January 2022.

Comments: This paper has been accepted by the IEEE ICC 2022

Journal ref: IEEE ICC, 2022

Rich Action-semantic Consistent Knowledge for Early Action Prediction

Authors: Xiaoli Liu, Jianqin Yin, Di Guo, Hua** Liu

Abstract: Early action prediction (EAP) aims to recognize human actions from a part of action execution in ongoing videos, which is an important task for many practical applications. Most prior works treat partial or full videos as a whole, ignoring rich action knowledge hidden in videos, i.e., semantic consistencies among different partial videos. In contrast, we partition original partial or full videos t… ▽ More Early action prediction (EAP) aims to recognize human actions from a part of action execution in ongoing videos, which is an important task for many practical applications. Most prior works treat partial or full videos as a whole, ignoring rich action knowledge hidden in videos, i.e., semantic consistencies among different partial videos. In contrast, we partition original partial or full videos to form a new series of partial videos and mine the Action-Semantic Consistent Knowledge (ASCK) among these new partial videos evolving in arbitrary progress levels. Moreover, a novel Rich Action-semantic Consistent Knowledge network (RACK) under the teacher-student framework is proposed for EAP. Firstly, we use a two-stream pre-trained model to extract features of videos. Secondly, we treat the RGB or flow features of the partial videos as nodes and their action semantic consistencies as edges. Next, we build a bi-directional semantic graph for the teacher network and a single-directional semantic graph for the student network to model rich ASCK among partial videos. The MSE and MMD losses are incorporated as our distillation loss to enrich the ASCK of partial videos from the teacher to the student network. Finally, we obtain the final prediction by summering the logits of different subnetworks and applying a softmax layer. Extensive experiments and ablative studies have been conducted, demonstrating the effectiveness of modeling rich ASCK for EAP. With the proposed RACK, we have achieved state-of-the-art performance on three benchmarks. The code is available at https://github.com/lily2lab/RACK.git. △ Less

Submitted 20 December, 2023; v1 submitted 22 January, 2022; originally announced January 2022.

Comments: Accepted by IEEE TIP,15pages

Improved unitary uncertainty relations

Authors: Xiaoli Hu, Naihuan **g

Abstract: We derive strong variance-based uncertainty relations for arbitrary two and more unitary operators by re-examining the mathematical foundation of the uncertainty relation. This is achieved by strengthening the celebrated Cauchy-Schwarz inequality using a method of brackets and convex functions. The unitary uncertainty relations outperform several strong unitary uncertainty relations, notably bette… ▽ More We derive strong variance-based uncertainty relations for arbitrary two and more unitary operators by re-examining the mathematical foundation of the uncertainty relation. This is achieved by strengthening the celebrated Cauchy-Schwarz inequality using a method of brackets and convex functions. The unitary uncertainty relations outperform several strong unitary uncertainty relations, notably better than some recent best lower bounds such as [Phys. Rev. Lett. 120, 230402 (2018)] and [Phys. Rev. A. 100, 022116 (2019)]. △ Less

Submitted 21 January, 2022; originally announced January 2022.

Journal ref: Quant. Info. Process. 21:52 (2022), 18pp

TeV and keV-MeV Excesses as Probes for Hadronic Process in BL Lacertaes

Authors: Ji-Gui Cheng, Xiao-Li Huang, Ze-Rui Wang, Jian-Kun Huang, En-Wei Liang

Abstract: A hard TeV $γ$-ray component excess over the single-zone leptonic model prediction (TeV excess) is observed in the spectral energy distributions (SEDs) of some BL Lacs. Its origin is uncertain. We revisit this issue with four BL Lacs (1ES 0229+200, 1ES 0347--121, 1ES 1101--232, and H2356--309), in which the TeV excess is detected in their intrinsic SEDs. We represent their SEDs with a single-zone… ▽ More A hard TeV $γ$-ray component excess over the single-zone leptonic model prediction (TeV excess) is observed in the spectral energy distributions (SEDs) of some BL Lacs. Its origin is uncertain. We revisit this issue with four BL Lacs (1ES 0229+200, 1ES 0347--121, 1ES 1101--232, and H2356--309), in which the TeV excess is detected in their intrinsic SEDs. We represent their SEDs with a single-zone leptohadronic model, where radiations of the electrons and protons as well as the cascade electrons produced by the $γγ$ and p$γ$ interactions within their jets are considered. We show that the observed SEDs below the GeV gamma-ray band are attributed to the synchrotron radiations and self-Compton process of the primary electrons, and the TeV excess is explained with the $γ$-ray emission from the p$γ$ process via the $π^{0}$ decay. The cascade emission of the electrons produced via the $γγ$ and p$γ$ interactions results in a keV-MeV excess in the SEDs, illustrated as a bump or plateau. This extra photon field enhances the production of TeV photons from the $pγ$ process, resulting in a reduction of the proton power by about one order of magnitude. However, the derived powers are still 3--4 orders of magnitude larger than the Eddington limit, being challenged by the current black hole accretion physics. Applying our model to Mrk 421, we propose that synergic observations with current and upcoming TeV and keV-MeV telescopes for its tentative TeV and MeV excesses can give insights to the hadronic process in its jet. △ Less

Submitted 20 January, 2022; originally announced January 2022.

Comments: 9 pages, 4 Figures, 1 table. Accepted for Publication in ApJ Letters

Epitaxial stabilization of an orthorhombic Mg-Ti-O superconductor

Authors: Zhuang Ni, Wei Hu, Qinghua Zhang, Yanmin Zhang, Peiyu Xiong, Qian Li, Jie Yuan, Qihong Chen, Beiyi Zhu, Hua Zhang, Xiaoli Dong, Lin Gu, Kui **

Abstract: The family of titanium oxide superconductors exhibits many intriguing phenomena comparable to cuprates and iron pnictides/chalcogenides, and thus provides an ideal platform to contrastively study the unconventional pairing mechanism of high-temperature superconductors. Here, we successfully deposit superconducting Mg-Ti-O films on MgAl$_2$O$_4$ substrates with three principal orientations by ablat… ▽ More The family of titanium oxide superconductors exhibits many intriguing phenomena comparable to cuprates and iron pnictides/chalcogenides, and thus provides an ideal platform to contrastively study the unconventional pairing mechanism of high-temperature superconductors. Here, we successfully deposit superconducting Mg-Ti-O films on MgAl$_2$O$_4$ substrates with three principal orientations by ablating a MgTi$_2$O$_4$ target. Particularly, it is striking to observed that a single-crystalline film of an unintended structure has been grown on the (011)-oriented substrate, with the highest zero resistance transition temperature ($T_{\mathrm{c}0}$) of 5.0 K among them. The film has a highly reduced Mg/Ti ratio and an orthorhombic Ti$_9$O$_{10}$-like structure (denoted as Mg: Ti$_9$O$_{10}$), demonstrated by further characterizations of chemical composition and structure. Such a structure is unstable in bulk but favorable to be epitaxially stabilized on the (011)-surface of MgAl$_2$O$_4$ due to a relatively small strain at the formed interface. An isotropic upper critical field ($B_{\mathrm{c}2}$) up to 13.7 T that breaks the Pauli limit is observed in the Mg: Ti$_9$O$_{10}$ film, analogous to other superconducting titanium oxides. The similarity points to a common origin for the superconductivity in the family, which will provide valuable opinions for the mechanism of unconventional superconductivity in transition metal compounds. △ Less

Submitted 20 January, 2022; v1 submitted 17 January, 2022; originally announced January 2022.

Comments: 6 pages, 4 figures

Self-supervised Autoregressive Domain Adaptation for Time Series Data

Authors: Mohamed Ragab, Emadeldeen Eldele, Zhenghua Chen, Min Wu, Chee-Keong Kwoh, Xiaoli Li

Abstract: Unsupervised domain adaptation (UDA) has successfully addressed the domain shift problem for visual applications. Yet, these approaches may have limited performance for time series data due to the following reasons. First, they mainly rely on large-scale dataset (i.e., ImageNet) for the source pretraining, which is not applicable for time-series data. Second, they ignore the temporal dimension on… ▽ More Unsupervised domain adaptation (UDA) has successfully addressed the domain shift problem for visual applications. Yet, these approaches may have limited performance for time series data due to the following reasons. First, they mainly rely on large-scale dataset (i.e., ImageNet) for the source pretraining, which is not applicable for time-series data. Second, they ignore the temporal dimension on the feature space of the source and target domains during the domain alignment step. Last, most of prior UDA methods can only align the global features without considering the fine-grained class distribution of the target domain. To address these limitations, we propose a Self-supervised Autoregressive Domain Adaptation (SLARDA) framework. In particular, we first design a self-supervised learning module that utilizes forecasting as an auxiliary task to improve the transferability of the source features. Second, we propose a novel autoregressive domain adaptation technique that incorporates temporal dependency of both source and target features during domain alignment. Finally, we develop an ensemble teacher model to align the class-wise distribution in the target domain via a confident pseudo labeling approach. Extensive experiments have been conducted on three real-world time series applications with 30 cross-domain scenarios. Results demonstrate that our proposed SLARDA method significantly outperforms the state-of-the-art approaches for time series domain adaptation. △ Less

Submitted 16 July, 2022; v1 submitted 29 November, 2021; originally announced November 2021.

Comments: Accepted for publication in IEEE Transactions on Neural Networks and Learning Systems

Directed exfoliating and ordered stacking of transition-metal-dichalcogenides

Authors: Yanshuang Li, Xiuhua Xie, Binghui Li, Xiaoli Sun, Yichen Yang, Jishan Liu, Jiying Feng, Ying Zhou, Yuanzheng Li, Weizhen Liu, Shuangpeng Wang, Wei Wang, Huan Zeng, Zhenzhong Zhang, Dawei Shen, Dezhen Shen

Abstract: Two-dimensional van der Waals crystals arise limitless scope for designing novel combinations of physical properties via controlling the stacking order or twist angle of individual layers. Lattice orientation between stacked monolayers is significant not only for the engineering symmetry breaking but also for the study of many-body quantum phases and band topology. So far the state-of-art exfoliat… ▽ More Two-dimensional van der Waals crystals arise limitless scope for designing novel combinations of physical properties via controlling the stacking order or twist angle of individual layers. Lattice orientation between stacked monolayers is significant not only for the engineering symmetry breaking but also for the study of many-body quantum phases and band topology. So far the state-of-art exfoliation approaches focusing on achievements of quality, size, yield, and scalability while lacking sufficient information on lattice orientation. Consequently, interlayer alignment is usually determined by later experiments, such as second harmonic generation spectroscopy, which increased the number of trials and errors for a designed artificial ordering and hampered the efficiency of systematic study. Herein, we report a lattice orientation distinguishable exfoliation method via gold favor epitaxy along the specific atomic step edges, meanwhile, fulfill requirements of high-quality, large-size, and high-yield of monolayers. Hexagonal- and rhombohedral-stacking configurations of bilayer transition metal dichalcogenides are built directly at once result of foreseeing the lattice orientation. Optical spectroscopy, electron diffraction, and angle-resolved photoemission spectroscopy are used to study crystals quality, symmetric breaking, and band tuning, which supports the exfoliating mechanism we proposed. This strategy shows the ability for facilitates the development of ordering stacking especially for multilayers assembling in the future. △ Less

Submitted 21 November, 2021; originally announced November 2021.

Comments: 29 pages, 7 figures

Defeating Catastrophic Forgetting via Enhanced Orthogonal Weights Modification

Authors: Yanni Li, Bing Liu, Kaicheng Yao, Xiaoli Kou, Pengfan Lv, Yueshen Xu, Jiangtao Cui

Abstract: The ability of neural networks (NNs) to learn and remember multiple tasks sequentially is facing tough challenges in achieving general artificial intelligence due to their catastrophic forgetting (CF) issues. Fortunately, the latest OWM Orthogonal Weights Modification) and other several continual learning (CL) methods suggest some promising ways to overcome the CF issue. However, none of existing… ▽ More The ability of neural networks (NNs) to learn and remember multiple tasks sequentially is facing tough challenges in achieving general artificial intelligence due to their catastrophic forgetting (CF) issues. Fortunately, the latest OWM Orthogonal Weights Modification) and other several continual learning (CL) methods suggest some promising ways to overcome the CF issue. However, none of existing CL methods explores the following three crucial questions for effectively overcoming the CF issue: that is, what knowledge does it contribute to the effective weights modification of the NN during its sequential tasks learning? When the data distribution of a new learning task changes corresponding to the previous learned tasks, should a uniform/specific weight modification strategy be adopted or not? what is the upper bound of the learningable tasks sequentially for a given CL method? ect. To achieve this, in this paper, we first reveals the fact that of the weight gradient of a new learning task is determined by both the input space of the new task and the weight space of the previous learned tasks sequentially. On this observation and the recursive least square optimal method, we propose a new efficient and effective continual learning method EOWM via enhanced OWM. And we have theoretically and definitively given the upper bound of the learningable tasks sequentially of our EOWM. Extensive experiments conducted on the benchmarks demonstrate that our EOWM is effectiveness and outperform all of the state-of-the-art CL baselines. △ Less

Submitted 19 November, 2021; originally announced November 2021.

Enhanced countering adversarial attacks via input denoising and feature restoring

Authors: Yanni Li, Wenhui Zhang, Jiawei Liu, Xiaoli Kou, Hui Li, Jiangtao Cui

Abstract: Despite the fact that deep neural networks (DNNs) have achieved prominent performance in various applications, it is well known that DNNs are vulnerable to adversarial examples/samples (AEs) with imperceptible perturbations in clean/original samples. To overcome the weakness of the existing defense methods against adversarial attacks, which damages the information on the original samples, leading… ▽ More Despite the fact that deep neural networks (DNNs) have achieved prominent performance in various applications, it is well known that DNNs are vulnerable to adversarial examples/samples (AEs) with imperceptible perturbations in clean/original samples. To overcome the weakness of the existing defense methods against adversarial attacks, which damages the information on the original samples, leading to the decrease of the target classifier accuracy, this paper presents an enhanced countering adversarial attack method IDFR (via Input Denoising and Feature Restoring). The proposed IDFR is made up of an enhanced input denoiser (ID) and a hidden lossy feature restorer (FR) based on the convex hull optimization. Extensive experiments conducted on benchmark datasets show that the proposed IDFR outperforms the various state-of-the-art defense methods, and is highly effective for protecting target models against various adversarial black-box or white-box attacks. \footnote{Souce code is released at: \href{https://github.com/ID-FR/IDFR}{https://github.com/ID-FR/IDFR}} △ Less

Submitted 19 November, 2021; originally announced November 2021.

Data-driven method to learn the most probable transition pathway and stochastic differential equations

Authors: Jianyu Hu, Dongfang Li, **qiao Duan, Xiaoli Chen

Abstract: Transition phenomena between metastable states play an important role in complex systems due to noisy fluctuations. In this paper, the physics informed neural networks (PINNs) are presented to compute the most probable transition pathway. It is shown that the expected loss is bounded by the empirical loss. And the convergence result for the empirical loss is obtained. Then, a sampling method of ra… ▽ More Transition phenomena between metastable states play an important role in complex systems due to noisy fluctuations. In this paper, the physics informed neural networks (PINNs) are presented to compute the most probable transition pathway. It is shown that the expected loss is bounded by the empirical loss. And the convergence result for the empirical loss is obtained. Then, a sampling method of rare events is presented to simulate the transition path by the Markovian bridge process. And we investigate the inverse problem to extract the stochastic differential equation from the most probable transition pathway data and the Markovian bridge process data, respectively. Finally, several numerical experiments are presented to verify the effectiveness of our methods. △ Less

Submitted 11 July, 2022; v1 submitted 17 November, 2021; originally announced November 2021.

Rethinking the Image Feature Biases Exhibited by Deep CNN Models

Authors: Dawei Dai, Yutang Li, Huanan Bao, Sy Xia, Guoyin Wang, Xiaoli Ma

Abstract: In recent years, convolutional neural networks (CNNs) have been applied successfully in many fields. However, such deep neural models are still regarded as black box in most tasks. One of the fundamental issues underlying this problem is understanding which features are most influential in image recognition tasks and how they are processed by CNNs. It is widely accepted that CNN models combine low… ▽ More In recent years, convolutional neural networks (CNNs) have been applied successfully in many fields. However, such deep neural models are still regarded as black box in most tasks. One of the fundamental issues underlying this problem is understanding which features are most influential in image recognition tasks and how they are processed by CNNs. It is widely accepted that CNN models combine low-level features to form complex shapes until the object can be readily classified, however, several recent studies have argued that texture features are more important than other features. In this paper, we assume that the importance of certain features varies depending on specific tasks, i.e., specific tasks exhibit a feature bias. We designed two classification tasks based on human intuition to train deep neural models to identify anticipated biases. We devised experiments comprising many tasks to test these biases for the ResNet and DenseNet models. From the results, we conclude that (1) the combined effect of certain features is typically far more influential than any single feature; (2) in different tasks, neural models can perform different biases, that is, we can design a specific task to make a neural model biased toward a specific anticipated feature. △ Less

Submitted 3 November, 2021; originally announced November 2021.

Comments: 15 pages, 15 figures

Sr-Doped Molecular Hydrogen: Synthesis and Properties of SrH$_{22}$

Authors: Dmitrii V. Semenok, Wuhao Chen, Xiaoli Huang, Di Zhou, Ivan A. Kruglov, Arslan B. Mazitov, Michele Galasso, Christian Tantardini, Xavier Gonze, Alexander G. Kvashnin, Artem R. Oganov, Tian Cui

Abstract: Recently, several research groups announced reaching the point of metallization of hydrogen above 400 GPa. Following the mainstream of extensive investigations of compressed polyhydrides, in this work we demonstrate that small (4 atom %) do** of molecular hydrogen by strontium leads to a dramatic reduction in the metallization pressure to about 200 GPa. Studying the high-pressure chemistry of th… ▽ More Recently, several research groups announced reaching the point of metallization of hydrogen above 400 GPa. Following the mainstream of extensive investigations of compressed polyhydrides, in this work we demonstrate that small (4 atom %) do** of molecular hydrogen by strontium leads to a dramatic reduction in the metallization pressure to about 200 GPa. Studying the high-pressure chemistry of the Sr-H system at 56-180 GPa, we observed the formation of several previously unknown compounds: C2/m-Sr$_3$H$_{13}$, pseudocubic SrH$_6$, SrH$_9$ with cubic F-43m Sr sublattice, and pseudotetragonal P1-SrH$_{22}$, the metal hydride with the highest hydrogen content discovered so far. Unlike Ca and Y, strontium forms molecular semiconducting polyhydrides, whereas calcium and yttrium polyhydrides are high-Tc superconductors with an atomic H sublattice. The latter phase, SrH$_{22}$ or Sr$_{0.04}$H$_{0.96}$, may be considered as a convenient model of the consistent bandgap closure and metallization of hydrogen. Using the impedance measurements in diamond anvil cells at 300-440 K, we estimated the direct bandgap of the Pm-3n-like compound P1-SrH$_6$ to be 0.44-0.51 eV at 150 GPa, and its metallization pressure to be 220 GPa. Together with the machine learning interatomic potentials, the impedance spectroscopy allowed us to estimate the diffusion coefficients of hydrogen D$_H$ = 1.0-2.8 E-10 m$^2$/s in SrH$_6$ and 1.2-2.1 E-9 m$^2$/s in P1-SrH$_{22}$ at 500-600 K. △ Less

Submitted 5 November, 2021; v1 submitted 29 October, 2021; originally announced October 2021.

Comments: Supporting information was compressed and reduced by 2 times to 36 figures

Journal ref: Adv Mater . 2022 Apr 21; e2200924

Learning Continuous Face Representation with Explicit Functions

Authors: Li** Zhang, Weijun Li, Linjun Sun, Lina Yu, Xin Ning, Xiaoli Dong, Jian Xu, Hong Qin

Abstract: How to represent a face pattern? While it is presented in a continuous way in our visual system, computers often store and process the face image in a discrete manner with 2D arrays of pixels. In this study, we attempt to learn a continuous representation for face images with explicit functions. First, we propose an explicit model (EmFace) for human face representation in the form of a finite sum… ▽ More How to represent a face pattern? While it is presented in a continuous way in our visual system, computers often store and process the face image in a discrete manner with 2D arrays of pixels. In this study, we attempt to learn a continuous representation for face images with explicit functions. First, we propose an explicit model (EmFace) for human face representation in the form of a finite sum of mathematical terms, where each term is an analytic function element. Further, to estimate the unknown parameters of EmFace, a novel neural network, EmNet, is designed with an encoder-decoder structure and trained using the backpropagation algorithm, where the encoder is defined by a deep convolutional neural network and the decoder is an explicit mathematical expression of EmFace. Experimental results show that EmFace has a higher representation performance on faces with various expressions, postures, and other factors, compared to that of other methods. Furthermore, EmFace achieves reasonable performance on several face image processing tasks, including face image restoration, denoising, and transformation. △ Less

Submitted 24 October, 2021; originally announced October 2021.

Journal ref: CAAI Trans.Intell.Technol. 9(1) (2004) 54-68

Cu do** effects on the electronic structure of Fe1-xCuxSe

Authors: Soonsang Huh, Zouyouwei Lu, Youn Sik Kim, Donghan Kim, Shaobo Liu, Mingwei Ma, Li Yu, Fang Zhou, Xiaoli Dong, Changyoung Kim, Zhongxian Zhao

Abstract: Using angle-resolved photoemission spectroscopy (ARPES), we studied the evolution of the electronic structure of Fe1-xCuxSe from x = 0 to 0.10. We found that the Cu dopant introduces extra electron carriers. The hole bands near the gamma point are observed to steadily shift downward with increasing do** and completely sink down below the Fermi level (EF) for x > 0.05. Meanwhile, the electron poc… ▽ More Using angle-resolved photoemission spectroscopy (ARPES), we studied the evolution of the electronic structure of Fe1-xCuxSe from x = 0 to 0.10. We found that the Cu dopant introduces extra electron carriers. The hole bands near the gamma point are observed to steadily shift downward with increasing do** and completely sink down below the Fermi level (EF) for x > 0.05. Meanwhile, the electron pocket near the M point becomes larger but loses the spectral weight near EF. We also observed that effective mass of the electron band near the M point increases with do**. Our result explains why superconductivity disappears and metal insulator transition (MIT) like behavior occurs upon Cu do** in terms of electronic structure, and provide insight into emergent magnetic fluctuation in Fe1-xCuxSe. △ Less

Submitted 27 October, 2021; originally announced October 2021.

Text Counterfactuals via Latent Optimization and Shapley-Guided Search

Authors: Quintin Pope, Xiaoli Z. Fern

Abstract: We study the problem of generating counterfactual text for a classifier as a means for understanding and debugging classification. Given a textual input and a classification model, we aim to minimally alter the text to change the model's prediction. White-box approaches have been successfully applied to similar problems in vision where one can directly optimize the continuous input. Optimization-b… ▽ More We study the problem of generating counterfactual text for a classifier as a means for understanding and debugging classification. Given a textual input and a classification model, we aim to minimally alter the text to change the model's prediction. White-box approaches have been successfully applied to similar problems in vision where one can directly optimize the continuous input. Optimization-based approaches become difficult in the language domain due to the discrete nature of text. We bypass this issue by directly optimizing in the latent space and leveraging a language model to generate candidate modifications from optimized latent representations. We additionally use Shapley values to estimate the combinatoric effect of multiple changes. We then use these estimates to guide a beam search for the final counterfactual text. We achieve favorable performance compared to recent white-box and black-box baselines using human and automatic evaluations. Ablation studies show that both latent optimization and the use of Shapley values improve success rate and the quality of the generated counterfactuals. △ Less

Submitted 22 October, 2021; originally announced October 2021.

Comments: 9 pages, 2 figures, 3 tables. Accepted at EMNLP 2021

Titanium doped kagome superconductor CsV3-xTixSb5 and two distinct phases

Authors: Haitao Yang, Zihao Huang, Yuhang Zhang, Zhen Zhao, **an Shi, Hailan Luo, Lin Zhao, Guojian Qian, Hengxin Tan, Bin Hu, Ke Zhu, Zouyouwei Lu, Hua Zhang, Jian** Sun, **gguagn Cheng, Chengmin Shen, Xiao Lin, Binghai Yan, Xingjiang Zhou, Ziqiang Wang, Stephen J. Pennycook, Hui Chen, Xiaoli Dong, Wu Zhou, Hong-Jun Gao

Abstract: The vanadium-based kagome superconductor CsV3Sb5 has attracted tremendous attention due to its unexcepted anomalous Hall effect (AHE), charge density waves (CDWs), nematicity, and a pseudogap pair density wave (PDW) coexisting with unconventional strong-coupling superconductivity (SC). The origins of CDWs, unconventional SC, and their correlation with different electronic states in this kagome sys… ▽ More The vanadium-based kagome superconductor CsV3Sb5 has attracted tremendous attention due to its unexcepted anomalous Hall effect (AHE), charge density waves (CDWs), nematicity, and a pseudogap pair density wave (PDW) coexisting with unconventional strong-coupling superconductivity (SC). The origins of CDWs, unconventional SC, and their correlation with different electronic states in this kagome system are of great significance, but so far, are still under debate. Chemical do** in the kagome layer provides one of the most direct ways to reveal the intrinsic physics, but remains unexplored. Here, we report, for the first time, the synthesis of Ti-substituted CsV3Sb5 single crystals and its rich phase diagram map** the evolution of intertwining electronic states. The Ti atoms directly substitute for V in the kagome layers. CsV3-xTixSb5 shows two distinct SC phases upon substitution. The Ti slightly-substituted phase displays an unconventional V-shaped SC gap, coexisting with weakening CDW, PDW, AHE, and nematicity. The Ti highly-substituted phase has a U-shaped SC gap concomitant with a short-range rotation symmetry breaking CDW, while long-range CDW, twofold symmetry of in-plane resistivity, AHE, and PDW are absent. Furthermore, we also demonstrate the chemical substitution of V atoms with other elements such as Cr and Nb, showing a different modulation on the SC phase and CDWs. These findings open up a way to synthesise a new family of doped CsV3Sb5 materials, and further representing a new platform for tuning the different correlated electronic states and superconducting pairing in kagome superconductors. △ Less

Submitted 17 October, 2022; v1 submitted 21 October, 2021; originally announced October 2021.

Comments: Science Bulletin (2022,in press)

System Outage Probability and Diversity Analysis of SWIPT Enabled Two-Way DF Relaying under Hardware Impairments

Authors: Guangyue Lu, Zhipeng Liu, Yinghui Ye, Xiaoli Chu

Abstract: This paper investigates the system outage performance of a simultaneous wireless information and power transfer (SWIPT) based two-way decode-and-forward (DF) relay network, where potential hardware impairments (HIs) in all transceivers are considered. After harvesting energy and decoding messages simultaneously via a power splitting scheme, the energy-limited relay node forwards the decoded inform… ▽ More This paper investigates the system outage performance of a simultaneous wireless information and power transfer (SWIPT) based two-way decode-and-forward (DF) relay network, where potential hardware impairments (HIs) in all transceivers are considered. After harvesting energy and decoding messages simultaneously via a power splitting scheme, the energy-limited relay node forwards the decoded information to both terminals. Each terminal combines the signals from the direct and relaying links via selection combining. We derive the system outage probability under independent but non-identically distributed Nakagami-m fading channels. It reveals an overall system ceiling (OSC) effect, i.e., the system falls in outage if the target rate exceeds an OSC threshold that is determined by the levels of HIs. Furthermore, we derive the diversity gain of the considered network. The result reveals that when the transmission rate is below the OSC threshold, the achieved diversity gain equals the sum of the shape parameter of the direct link and the smaller shape parameter of the terminal-to-relay links; otherwise, the diversity gain is zero. This is different from the amplify-and-forward (AF) strategy, under which the relaying links have no contribution to the diversity gain. Simulation results validate the analytical results and reveal that compared with the AF strategy, the SWIPT based two-way relaying links under the DF strategy are more robust to HIs and achieve a lower system outage probability. △ Less

Submitted 17 October, 2021; originally announced October 2021.

Comments: This paper has been accepted by China Communications

Dispersionless orbital excitations in (Li,Fe)OHFeSe superconductors

Authors: Qian Xiao, Wenliang Zhang, Teguh Citra Asmara, Dong Li, Qizhi Li, Shilong Zhang, Yi Tseng, Xiaoli Dong, Yao Wang, Cheng-Chien Chen, Thorsten Schmitt, Yingying Peng

Abstract: The superconducting critical temperature $T_{\mathrm{c}}$ of intercalated iron-selenide superconductor (Li,Fe)OHFeSe (FeSe11111) can be increased to 42 K from 8 K of bulk FeSe. It shows remarkably similar electronic properties as the high-$T_{\mathrm{c}}$ monolayer FeSe and provides a bulk counterpart to investigate the origin of enhanced superconductivity. Unraveling the nature of excitations is… ▽ More The superconducting critical temperature $T_{\mathrm{c}}$ of intercalated iron-selenide superconductor (Li,Fe)OHFeSe (FeSe11111) can be increased to 42 K from 8 K of bulk FeSe. It shows remarkably similar electronic properties as the high-$T_{\mathrm{c}}$ monolayer FeSe and provides a bulk counterpart to investigate the origin of enhanced superconductivity. Unraveling the nature of excitations is crucial for understanding the pairing mechanism in high-$T_{\mathrm{c}}$ iron selenides. Here we use resonant inelastic x-ray scattering (RIXS) to investigate the excitations in FeSe11111. Our high-quality data exhibit several Raman-like excitations, which are dispersionless and isotropic in momentum transfer and robust against varying $T_{\mathrm{c}}$. Using atomic multiplet calculations, we assign the low-energy $\sim 0.3$ and 0.7 eV Raman peaks as local $e_g-e_g$ and $e_g-t_{2g}$ orbital excitations. The intensity of these two features decreases with increasing temperature, suggesting a primary contribution of the orbital fluctuations. Our results highlight the importance of orbital degree of freedom for high-$T_{\mathrm{c}}$ iron selenides. △ Less

Submitted 23 December, 2021; v1 submitted 11 October, 2021; originally announced October 2021.

Comments: 11 pages, 4 figures

Journal ref: npj Quantum Materials 7, 80 (2022)

Bounding-box deep calibration for high performance face detection

Authors: Shi Luo, Xiongfei Li, Xiaoli Zhang

Abstract: Modern convolutional neural networks (CNNs)-based face detectors have achieved tremendous strides due to large annotated datasets. However, misaligned results with high detection confidence but low localization accuracy restrict the further improvement of detection performance. In this paper, the authors first predict high confidence detection results on the training set itself. Surprisingly, a co… ▽ More Modern convolutional neural networks (CNNs)-based face detectors have achieved tremendous strides due to large annotated datasets. However, misaligned results with high detection confidence but low localization accuracy restrict the further improvement of detection performance. In this paper, the authors first predict high confidence detection results on the training set itself. Surprisingly, a considerable part of them exist in the same misalignment problem. Then, the authors carefully examine these cases and point out that annotation misalignment is the main reason. Later, a comprehensive discussion is given for the replacement rationality between predicted and annotated bounding-boxes. Finally, the authors propose a novel Bounding-Box Deep Calibration (BDC) method to reasonably replace misaligned annotations with model predicted bounding-boxes and offer calibrated annotations for the training set. Extensive experiments on multiple detectors and two popular benchmark datasets show the effectiveness of BDC on improving models' precision and recall rate, without adding extra inference time and memory consumption. Our simple and effective method provides a general strategy for improving face detection, especially for light-weight detectors in real-time situations. △ Less

Submitted 22 July, 2022; v1 submitted 8 October, 2021; originally announced October 2021.

Comments: 12 pages, 7 figures, 5 tables, 1 algorithm, 9 equation, 2 definition

Journal ref: IET Computer Vision 2022

Spin wave propagation in uniform waveguide: effects, modulation and its application

Authors: Lei Zheng, Lichuan **, Tianlong Wen, Yulong Liao, Xiaoli Tang, Huaiwu Zhang, Zhiyong Zhong

Abstract: With the advent of the post-Moore era, researches on beyond-Complementary Metal Oxide Semiconductor (CMOS) approaches have been attracted more and more attention. Magnonics, or spin wave is one of the most promising technology beyond CMOS, which magnons-quanta for spin waves-process the information analogous to electronic charges in electronics. Information transmission by spin waves, which uses t… ▽ More With the advent of the post-Moore era, researches on beyond-Complementary Metal Oxide Semiconductor (CMOS) approaches have been attracted more and more attention. Magnonics, or spin wave is one of the most promising technology beyond CMOS, which magnons-quanta for spin waves-process the information analogous to electronic charges in electronics. Information transmission by spin waves, which uses the frequency, amplitude and (or) phase to encode information, has a great many of advantages such as extremely low energy loss and wide-band frequency. Moreover, using the nonlinear characteristics of spin waves for information transmission can increase the extra degree of freedom of information. This review provides a tutorial overview over the effects of spin wave propagation and recent research progress in uniform spin wave waveguide. The propagation characteristics of spin waves in uniform waveguides and some special propagation phenomena such as spin wave beam splitting and self-focusing are described by combining experimental phenomena and theoretical formulas. Furthermore, we summarize methods for modulating propagation of spin wave in uniform waveguide, and comment on the advantages and limitations of these methods. The review may promote the development of information transmission technology based on spin waves. △ Less

Submitted 27 September, 2021; originally announced September 2021.

Security analysis method for practical quantum key distribution with arbitrary encoding schemes

Authors: Zehong Chang, Fumin Wang, Xiaoli Wang, Xiaofei Liu, Rongqian Wu, Yi lv, Pei Zhang

Abstract: Quantum key distribution (QKD) gradually has become a crucial element of practical secure communication. In different scenarios, the security analysis of genuine QKD systems is complicated. A universal secret key rate calculation method, used for realistic factors such as multiple degrees of freedom encoding, asymmetric protocol structures, equipment flaws, environmental noise, and so on, is still… ▽ More Quantum key distribution (QKD) gradually has become a crucial element of practical secure communication. In different scenarios, the security analysis of genuine QKD systems is complicated. A universal secret key rate calculation method, used for realistic factors such as multiple degrees of freedom encoding, asymmetric protocol structures, equipment flaws, environmental noise, and so on, is still lacking. Based on the correlations of statistical data, we propose a security analysis method without restriction on encoding schemes. This method makes a trade-off between applicability and accuracy, which can effectively analyze various existing QKD systems. We illustrate its ability by analyzing source flaws and a high-dimensional asymmetric protocol. Results imply that our method can give tighter bounds than the Gottesman-Lo-Lütkenhaus-Preskill (GLLP) analysis and is beneficial to analyze protocols with complex encoding structures. Our work has the potential to become a reference standard for the security analysis of practical QKD. △ Less

Submitted 10 September, 2021; originally announced September 2021.

A P2P Network Topology for Optimizing Partition Tolerance to Reach the CAP Guarantee Bound in Consortium Blockchains

Authors: Han Wang, Hui Li, Zixian Wang, Baofu Han, Minglong Zhang, Peter Han Joo Chong, Xiaoli Chu, Yang Liu, Soung-Yue Liew, Lunchakorn Wuttisittikulkij

Abstract: Decentralized cryptocurrency systems, known as blockchains, have shown promise as infrastructure for mutually distrustful parties to agree on transactions safely. However, Bitcoin-derived blockchains and their variants suffer from the limitations of the CAP Trilemma, which is difficult to be solved through optimizing consensus protocols. Moreover, the P2P network of blockchains have problems in ef… ▽ More Decentralized cryptocurrency systems, known as blockchains, have shown promise as infrastructure for mutually distrustful parties to agree on transactions safely. However, Bitcoin-derived blockchains and their variants suffer from the limitations of the CAP Trilemma, which is difficult to be solved through optimizing consensus protocols. Moreover, the P2P network of blockchains have problems in efficiency and reliability without considering the matching of physical and logical topologies. For the CAP Trilemma in consortium blockchains, we propose a physical topology based on the multi-dimensional hypercube with excellent partition tolerance in probability. On the other hand, the general hypercube has advantages in solving the mismatch problems in P2P networks. The general topology is further extended to a hierarchical recursive topology with more medium links or short links to balance the reliability requirements and the costs of physical network. We prove that the hypercube topology has better partition tolerance than the regular rooted tree topology and the ring lattice topology, and effectively fits the upper-layer protocols. As a result, blockchains constructed by the proposed topology can reach the CAP guarantee bound through adopting the proper transmission and the consensus protocols protocols that have strong consistency and availability. △ Less

Submitted 7 September, 2021; originally announced September 2021.

Comments: 13 pages, 11 figures

Generating Cyber Threat Intelligence to Discover Potential Security Threats Using Classification and Topic Modeling

Authors: Md Imran Hossen, Ashraful Islam, Farzana Anowar, Eshtiak Ahmed, Mohammad Masudur Rahman, Xiali, Hei

Abstract: Due to the variety of cyber-attacks or threats, the cybersecurity community enhances the traditional security control mechanisms to an advanced level so that automated tools can encounter potential security threats. Very recently, Cyber Threat Intelligence (CTI) has been presented as one of the proactive and robust mechanisms because of its automated cybersecurity threat prediction. Generally, CTI… ▽ More Due to the variety of cyber-attacks or threats, the cybersecurity community enhances the traditional security control mechanisms to an advanced level so that automated tools can encounter potential security threats. Very recently, Cyber Threat Intelligence (CTI) has been presented as one of the proactive and robust mechanisms because of its automated cybersecurity threat prediction. Generally, CTI collects and analyses data from various sources e.g., online security forums, social media where cyber enthusiasts, analysts, even cybercriminals discuss cyber or computer security-related topics and discovers potential threats based on the analysis. As the manual analysis of every such discussion (posts on online platforms) is time-consuming, inefficient, and susceptible to errors, CTI as an automated tool can perform uniquely to detect cyber threats. In this paper, we identify and explore relevant CTI from hacker forums utilizing different supervised (classification) and unsupervised learning (topic modeling) techniques. To this end, we collect data from a real hacker forum and constructed two datasets: a binary dataset and a multi-class dataset. We then apply several classifiers along with deep neural network-based classifiers and use them on the datasets to compare their performances. We also employ the classifiers on a labeled leaked dataset as our ground truth. We further explore the datasets using unsupervised techniques. For this purpose, we leverage two topic modeling algorithms namely Latent Dirichlet Allocation (LDA) and Non-negative Matrix Factorization (NMF). △ Less

Submitted 14 November, 2022; v1 submitted 15 August, 2021; originally announced August 2021.

Two Eyes Are Better Than One: Exploiting Binocular Correlation for Diabetic Retinopathy Severity Grading

Authors: Peisheng Qian, Ziyuan Zhao, Cong Chen, Zeng Zeng, Xiaoli Li

Abstract: Diabetic retinopathy (DR) is one of the most common eye conditions among diabetic patients. However, vision loss occurs primarily in the late stages of DR, and the symptoms of visual impairment, ranging from mild to severe, can vary greatly, adding to the burden of diagnosis and treatment in clinical practice. Deep learning methods based on retinal images have achieved remarkable success in automa… ▽ More Diabetic retinopathy (DR) is one of the most common eye conditions among diabetic patients. However, vision loss occurs primarily in the late stages of DR, and the symptoms of visual impairment, ranging from mild to severe, can vary greatly, adding to the burden of diagnosis and treatment in clinical practice. Deep learning methods based on retinal images have achieved remarkable success in automatic DR grading, but most of them neglect that the presence of diabetes usually affects both eyes, and ophthalmologists usually compare both eyes concurrently for DR diagnosis, leaving correlations between left and right eyes unexploited. In this study, simulating the diagnostic process, we propose a two-stream binocular network to capture the subtle correlations between left and right eyes, in which, paired images of eyes are fed into two identical subnetworks separately during training. We design a contrastive grading loss to learn binocular correlation for five-class DR detection, which maximizes inter-class dissimilarity while minimizing the intra-class difference. Experimental results on the EyePACS dataset show the superiority of the proposed binocular model, outperforming monocular methods by a large margin. △ Less

Submitted 15 August, 2021; originally announced August 2021.

Comments: Accepted in 43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, IEEE EMBC 2021

Journal ref: 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)