Showing 101–150 of 531 results for author: Fu, Z

Energy-efficient Task Adaptation for NLP Edge Inference Leveraging Heterogeneous Memory Architectures

Authors: Zirui Fu, Aleksandre Avaliani, Marco Donato

Abstract: Executing machine learning inference tasks on resource-constrained edge devices requires careful hardware-software co-design optimizations. Recent examples have shown how transformer-based deep neural network models such as ALBERT can be used to enable the execution of natural language processing (NLP) inference on mobile systems-on-chip housing custom hardware accelerators. However, while these e… ▽ More Executing machine learning inference tasks on resource-constrained edge devices requires careful hardware-software co-design optimizations. Recent examples have shown how transformer-based deep neural network models such as ALBERT can be used to enable the execution of natural language processing (NLP) inference on mobile systems-on-chip housing custom hardware accelerators. However, while these existing solutions are effective in alleviating the latency, energy, and area costs of running single NLP tasks, achieving multi-task inference requires running computations over multiple variants of the model parameters, which are tailored to each of the targeted tasks. This approach leads to either prohibitive on-chip memory requirements or paying the cost of off-chip memory access. This paper proposes adapter-ALBERT, an efficient model optimization for maximal data reuse across different tasks. The proposed model's performance and robustness to data compression methods are evaluated across several language tasks from the GLUE benchmark. Additionally, we demonstrate the advantage of map** the model to a heterogeneous on-chip memory architecture by performing simulations on a validated NLP edge accelerator to extrapolate performance, power, and area improvements over the execution of a traditional ALBERT model on the same hardware platform. △ Less

Submitted 12 April, 2023; v1 submitted 25 March, 2023; originally announced March 2023.

Comments: 10 pages, 6 figures, 3 tables

COFFEE: A Contrastive Oracle-Free Framework for Event Extraction

Authors: Meiru Zhang, Yixuan Su, Zaiqiao Meng, Zihao Fu, Nigel Collier

Abstract: Event extraction is a complex information extraction task that involves extracting events from unstructured text. Prior classification-based methods require comprehensive entity annotations for joint training, while newer generation-based methods rely on heuristic templates containing oracle information such as event type, which is often unavailable in real-world scenarios. In this study, we consi… ▽ More Event extraction is a complex information extraction task that involves extracting events from unstructured text. Prior classification-based methods require comprehensive entity annotations for joint training, while newer generation-based methods rely on heuristic templates containing oracle information such as event type, which is often unavailable in real-world scenarios. In this study, we consider a more realistic setting of this task, namely the Oracle-Free Event Extraction (OFEE) task, where only the input context is given without any oracle information, including event type, event ontology and trigger word. To solve this task, we propose a new framework, called COFFEE, which extracts the events solely based on the document context without referring to any oracle information. In particular, a contrastive selection model is introduced in COFFEE to rectify the generated triggers and handle multi-event instances. The proposed COFFEE outperforms state-of-the-art approaches under the oracle-free setting of the event extraction task, as evaluated on a public event extraction benchmark ACE05. △ Less

Submitted 24 June, 2024; v1 submitted 25 March, 2023; originally announced March 2023.

Homography matrix based trajectory planning method for robot uncalibrated visual servoing

Authors: Zhongtao Fu, Xiaoyu Lei, Xubing Chen, Mohamed Ibrahim Ahmed, Cong Zhang, Miao Li, Tao Huang

Abstract: In view of the classical visual servoing trajectory planning method which only considers the camera trajectory, this paper proposes one homography matrix based trajectory planning method for robot uncalibrated visual servoing. Taking the robot-end-effector frame as one generic case, eigenvalue decomposition is utilized to calculate the infinite homography matrix of the robot-end-effector trajector… ▽ More In view of the classical visual servoing trajectory planning method which only considers the camera trajectory, this paper proposes one homography matrix based trajectory planning method for robot uncalibrated visual servoing. Taking the robot-end-effector frame as one generic case, eigenvalue decomposition is utilized to calculate the infinite homography matrix of the robot-end-effector trajectory, and then the image feature-point trajectories corresponding to the camera rotation is obtained, while the image feature-point trajectories corresponding to the camera translation is obtained by the homography matrix. According to the additional image corresponding to the robot-end-effector rotation, the relationship between the robot-end-effector rotation and the variation of the image feature-points is obtained, and then the expression of the image trajectories corresponding to the optimal robot-end-effector trajectories (the rotation trajectory of the minimum geodesic and the linear translation trajectory) are obtained. Finally, the optimal image trajectories of the uncalibrated visual servoing controller is modified to track the image trajectories. Simulation experiments show that, compared with the classical IBUVS method, the proposed trajectory planning method can obtain the shortest path of any frame and complete the robot visual servoing task with large initial pose deviation. △ Less

Submitted 30 August, 2023; v1 submitted 15 March, 2023; originally announced March 2023.

Fractional Fourier Transforms Meet Riesz Potentials and Image Processing

Authors: Zunwei Fu, Yan Lin, Dachun Yang, Shuhui Yang

Abstract: Via chirp functions from fractional Fourier transforms, the authors introduce fractional Riesz potentials related to chirp functions, establish their relations with fractional Fourier transforms, fractional Laplace operators related to chirp functions, and fractional Riesz transforms related to chirp functions, and obtain their boundedness on rotation invariant spaces related to chirp functions. F… ▽ More Via chirp functions from fractional Fourier transforms, the authors introduce fractional Riesz potentials related to chirp functions, establish their relations with fractional Fourier transforms, fractional Laplace operators related to chirp functions, and fractional Riesz transforms related to chirp functions, and obtain their boundedness on rotation invariant spaces related to chirp functions. Finally, the authors give the numerical image simulation of fractional Riesz potentials related to chirp functions and their applications in image processing. The main novelty of this article is to propose a new image encryption method for the double phase coding based on the fractional Riesz potential related to chirp functions. The symbol of fractional Riesz potentials related to chirp functions essentially provides greater degrees of freedom and greatly makes the information more secure. △ Less

Submitted 25 February, 2023; originally announced February 2023.

Comments: 20 pages, 35 figures

MSC Class: Primary 26A33; Secondary 42B35; 42A38; 94A08

Approximability of the Four-Vertex Model

Authors: Zhiguo Fu, Tianyu Liu, Xiongxin Yang

Abstract: We study the approximability of the four-vertex model, a special case of the six-vertex model.We prove that, despite being NP-hard to approximate in the worst case, the four-vertex model admits a fully polynomial randomized approximation scheme (FPRAS) when the input satisfies certain linear equation system over GF(2).The FPRAS is given by a Markov chain known as the worm process, whose state spac… ▽ More We study the approximability of the four-vertex model, a special case of the six-vertex model.We prove that, despite being NP-hard to approximate in the worst case, the four-vertex model admits a fully polynomial randomized approximation scheme (FPRAS) when the input satisfies certain linear equation system over GF(2).The FPRAS is given by a Markov chain known as the worm process, whose state space and rapid mixing rely on the solution of the linear equation system. This is the first attempt to design an FPRAS for the six-vertex model with unwindable constraint functions.Additionally, we explore the applications of this technique on planar graphs, providing efficient sampling algorithms. △ Less

Submitted 3 May, 2023; v1 submitted 22 February, 2023; originally announced February 2023.

Comments: 15 pages, 4 figures

Artificial Intelligence System for Detection and Screening of Cardiac Abnormalities using Electrocardiogram Images

Authors: Deyun Zhang, Shijia Geng, Yang Zhou, Weilun Xu, Guodong Wei, Kai Wang, Jie Yu, Qiang Zhu, Yongkui Li, Yonghong Zhao, Xingyue Chen, Rui Zhang, Zhaoji Fu, Rongbo Zhou, Yanqi E, Sumei Fan, Qinghao Zhao, Chuandong Cheng, Nan Peng, Liang Zhang, Linlin Zheng, Jianjun Chu, Hongbin Xu, Chen Tan, Jian Liu , et al. (6 additional authors not shown)

Abstract: The artificial intelligence (AI) system has achieved expert-level performance in electrocardiogram (ECG) signal analysis. However, in underdeveloped countries or regions where the healthcare information system is imperfect, only paper ECGs can be provided. Analysis of real-world ECG images (photos or scans of paper ECGs) remains challenging due to complex environments or interference. In this stud… ▽ More The artificial intelligence (AI) system has achieved expert-level performance in electrocardiogram (ECG) signal analysis. However, in underdeveloped countries or regions where the healthcare information system is imperfect, only paper ECGs can be provided. Analysis of real-world ECG images (photos or scans of paper ECGs) remains challenging due to complex environments or interference. In this study, we present an AI system developed to detect and screen cardiac abnormalities (CAs) from real-world ECG images. The system was evaluated on a large dataset of 52,357 patients from multiple regions and populations across the world. On the detection task, the AI system obtained area under the receiver operating curve (AUC) of 0.996 (hold-out test), 0.994 (external test 1), 0.984 (external test 2), and 0.979 (external test 3), respectively. Meanwhile, the detection results of AI system showed a strong correlation with the diagnosis of cardiologists (cardiologist 1 (R=0.794, p<1e-3), cardiologist 2 (R=0.812, p<1e-3)). On the screening task, the AI system achieved AUCs of 0.894 (hold-out test) and 0.850 (external test). The screening performance of the AI system was better than that of the cardiologists (AI system (0.846) vs. cardiologist 1 (0.520) vs. cardiologist 2 (0.480)). Our study demonstrates the feasibility of an accurate, objective, easy-to-use, fast, and low-cost AI system for CA detection and screening. The system has the potential to be used by healthcare professionals, caregivers, and general users to assess CAs based on real-world ECG images. △ Less

Submitted 10 February, 2023; originally announced February 2023.

Comments: 47 pages, 29 figures

Cooperative Driving for Speed Harmonization in Mixed-Traffic Environments

Authors: Zhe Fu, Abdul Rahman Kreidieh, Han Wang, Jonathan W. Lee, Maria Laura Delle Monache, Alexandre M. Bayen

Abstract: Autonomous driving systems present promising methods for congestion mitigation in mixed autonomy traffic control settings. In particular, when coupled with even modest traffic state estimates, such systems can plan and coordinate the behaviors of automated vehicles (AVs) in response to observed downstream events, thereby inhibiting the continued propagation of congestion. In this paper, we present… ▽ More Autonomous driving systems present promising methods for congestion mitigation in mixed autonomy traffic control settings. In particular, when coupled with even modest traffic state estimates, such systems can plan and coordinate the behaviors of automated vehicles (AVs) in response to observed downstream events, thereby inhibiting the continued propagation of congestion. In this paper, we present a two-layer control strategy in which the upper layer proposes the desired speeds that predictively react to the downstream state of traffic, and the lower layer maintains safe and reasonable headways with leading vehicles. This method is demonstrated to achieve an average of over 15% energy savings within simulations of congested events observed in Interstate 24 with only 4% AV penetration, while restricting negative externalities imposed on traveling times and mobility. The proposed strategy that served as part of the "speed planner" was deployed on 100 AVs in a massive traffic experiment conducted on Nashville's I-24 in November 2022. △ Less

Submitted 3 June, 2023; v1 submitted 14 February, 2023; originally announced February 2023.

Comments: Accepted by IEEE IV 2023

TWIN: TWo-stage Interest Network for Lifelong User Behavior Modeling in CTR Prediction at Kuaishou

Authors: Jianxin Chang, Chenbin Zhang, Zhiyi Fu, Xiaoxue Zang, Lin Guan, **g Lu, Yiqun Hui, Dewei Leng, Yanan Niu, Yang Song, Kun Gai

Abstract: Life-long user behavior modeling, i.e., extracting a user's hidden interests from rich historical behaviors in months or even years, plays a central role in modern CTR prediction systems. Conventional algorithms mostly follow two cascading stages: a simple General Search Unit (GSU) for fast and coarse search over tens of thousands of long-term behaviors and an Exact Search Unit (ESU) for effective… ▽ More Life-long user behavior modeling, i.e., extracting a user's hidden interests from rich historical behaviors in months or even years, plays a central role in modern CTR prediction systems. Conventional algorithms mostly follow two cascading stages: a simple General Search Unit (GSU) for fast and coarse search over tens of thousands of long-term behaviors and an Exact Search Unit (ESU) for effective Target Attention (TA) over the small number of finalists from GSU. Although efficient, existing algorithms mostly suffer from a crucial limitation: the \textit{inconsistent} target-behavior relevance metrics between GSU and ESU. As a result, their GSU usually misses highly relevant behaviors but retrieves ones considered irrelevant by ESU. In such case, the TA in ESU, no matter how attention is allocated, mostly deviates from the real user interests and thus degrades the overall CTR prediction accuracy. To address such inconsistency, we propose \textbf{TWo-stage Interest Network (TWIN)}, where our Consistency-Preserved GSU (CP-GSU) adopts the identical target-behavior relevance metric as the TA in ESU, making the two stages twins. Specifically, to break TA's computational bottleneck and extend it from ESU to GSU, or namely from behavior length $10^2$ to length $10^4-10^5$, we build a novel attention mechanism by behavior feature splitting. For the video inherent features of a behavior, we calculate their linear projection by efficient pre-computing \& caching strategies. And for the user-item cross features, we compress each into a one-dimentional bias term in the attention score calculation to save the computational cost. The consistency between two stages, together with the effective TA-based relevance metric in CP-GSU, contributes to significant performance gain in CTR prediction. △ Less

Submitted 26 June, 2023; v1 submitted 5 February, 2023; originally announced February 2023.

Comments: Accepted by KDD 2023

Suppression of the antiferromagnetic order by Zn do** in a possible Kitaev material Na$_2$Co$_2$TeO$_6$

Authors: Zhongtuo Fu, Ruokai Xu, Song Bao, Yanyan Shangguan, Xin Liu, Zijuan Lu, Yingqi Chen, Shuhan Zheng, Yongjun Zhang, Meifeng Liu, Xiuzhang Wang, Hong Li, Huiqian Luo, Jun-Ming Liu, Zhen Ma, **sheng Wen

Abstract: Very recently, a 3$d$ based honeycomb cobaltate Na$_2$Co$_2$TeO$_6$ has garnered tremendous attention due to the proposed proximity to the Kitaev spin-liquid state as its 4$d$/5$d$ counterparts. Here, we use Zn to substitute Co in a broad range and perform systematic studies on Na$_2$Co$_{2-x}$Zn$_x$TeO$_6$ by structural, magnetic, and thermodynamic measurements, and track the do** evolution of… ▽ More Very recently, a 3$d$ based honeycomb cobaltate Na$_2$Co$_2$TeO$_6$ has garnered tremendous attention due to the proposed proximity to the Kitaev spin-liquid state as its 4$d$/5$d$ counterparts. Here, we use Zn to substitute Co in a broad range and perform systematic studies on Na$_2$Co$_{2-x}$Zn$_x$TeO$_6$ by structural, magnetic, and thermodynamic measurements, and track the do** evolution of its magnetic ground states. Due to the extremely close radii of Zn$^{2+}$ and high-spin Co$^{2+}$ ions, the substitution can be easily achieved. X-ray diffractions reveal no structural transition but only minor changes on the lattice parameter $c$ over a wide substitution range $0 \leq x \leq 1.5$. Magnetic susceptibility and specific heat measurements both suggest an antiferromagnetic ground state which is gradually suppressed with do**. It can survive with $x$ up to $\sim1.0$. Then it evolves into a spin-glass phase with short-range order that is rapidly supplanted by a magnetically disordered state when $x \geq 1.3$. By summarizing all these data, we construct a magnetic phase diagram of Na$_2$Co$_{2-x}$Zn$_x$TeO$_6$. Our results demonstrate that the Zn do** can effectively suppress the magnetic order and induce a possibe quantum paramagnetic state. These may serve as a platform to investigate the Kitaev physics in this system. △ Less

Submitted 1 February, 2023; originally announced February 2023.

Comments: 9 pages, 5 figures

Journal ref: Phys. Rev. Mater. 7, 014407 (2023)

The Hidden Power of Pure 16-bit Floating-Point Neural Networks

Authors: Juyoung Yun, Byungkon Kang, Zhoulai Fu

Abstract: Lowering the precision of neural networks from the prevalent 32-bit precision has long been considered harmful to performance, despite the gain in space and time. Many works propose various techniques to implement half-precision neural networks, but none study pure 16-bit settings. This paper investigates the unexpected performance gain of pure 16-bit neural networks over the 32-bit networks in cl… ▽ More Lowering the precision of neural networks from the prevalent 32-bit precision has long been considered harmful to performance, despite the gain in space and time. Many works propose various techniques to implement half-precision neural networks, but none study pure 16-bit settings. This paper investigates the unexpected performance gain of pure 16-bit neural networks over the 32-bit networks in classification tasks. We present extensive experimental results that favorably compare various 16-bit neural networks' performance to those of the 32-bit models. In addition, a theoretical analysis of the efficiency of 16-bit models is provided, which is coupled with empirical evidence to back it up. Finally, we discuss situations in which low-precision training is indeed detrimental. △ Less

Submitted 2 May, 2024; v1 submitted 30 January, 2023; originally announced January 2023.

A Stability Analysis of Fine-Tuning a Pre-Trained Model

Authors: Zihao Fu, Anthony Man-Cho So, Nigel Collier

Abstract: Fine-tuning a pre-trained model (such as BERT, ALBERT, RoBERTa, T5, GPT, etc.) has proven to be one of the most promising paradigms in recent NLP research. However, numerous recent works indicate that fine-tuning suffers from the instability problem, i.e., tuning the same model under the same setting results in significantly different performance. Many recent works have proposed different methods… ▽ More Fine-tuning a pre-trained model (such as BERT, ALBERT, RoBERTa, T5, GPT, etc.) has proven to be one of the most promising paradigms in recent NLP research. However, numerous recent works indicate that fine-tuning suffers from the instability problem, i.e., tuning the same model under the same setting results in significantly different performance. Many recent works have proposed different methods to solve this problem, but there is no theoretical understanding of why and how these methods work. In this paper, we propose a novel theoretical stability analysis of fine-tuning that focuses on two commonly used settings, namely, full fine-tuning and head tuning. We define the stability under each setting and prove the corresponding stability bounds. The theoretical bounds explain why and how several existing methods can stabilize the fine-tuning procedure. In addition to being able to explain most of the observed empirical discoveries, our proposed theoretical analysis framework can also help in the design of effective and provable methods. Based on our theory, we propose three novel strategies to stabilize the fine-tuning procedure, namely, Maximal Margin Regularizer (MMR), Multi-Head Loss (MHLoss), and Self Unsupervised Re-Training (SURT). We extensively evaluate our proposed approaches on 11 widely used real-world benchmark datasets, as well as hundreds of synthetic classification datasets. The experiment results show that our proposed methods significantly stabilize the fine-tuning procedure and also corroborate our theoretical analysis. △ Less

Submitted 7 December, 2023; v1 submitted 24 January, 2023; originally announced January 2023.

Measurement of cosmic-ray muon spallation products in a xenon-loaded liquid scintillator with KamLAND

Authors: KamLAND-Zen Collaboration, :, S. Abe, S. Asami, M. Eizuka, S. Futagi, A. Gando, Y. Gando, T. Gima, A. Goto, T. Hachiya, K. Hata, K. Hosokawa, K. Ichimura, S. Ieki, H. Ikeda, K. Inoue, K. Ishidoshiro, Y. Kamei, N. Kawada, Y. Kishimoto, M. Koga, M. Kurasawa, T. Mitsui, H. Miyake , et al. (42 additional authors not shown)

Abstract: Cosmic-ray muons produce various radioisotopes when passing through material. These spallation products can be backgrounds for rare event searches such as in solar neutrino, double-beta decay, and dark matter search experiments. The KamLAND-Zen experiment searches for neutrinoless double-beta decay in 745kg of xenon dissolved in liquid scintillator. The experiment includes dead-time-free electroni… ▽ More Cosmic-ray muons produce various radioisotopes when passing through material. These spallation products can be backgrounds for rare event searches such as in solar neutrino, double-beta decay, and dark matter search experiments. The KamLAND-Zen experiment searches for neutrinoless double-beta decay in 745kg of xenon dissolved in liquid scintillator. The experiment includes dead-time-free electronics with a high efficiency for detecting muon-induced neutrons. The production yields of different radioisotopes are measured with a combination of delayed coincidence techniques, newly developed muon reconstruction and xenon spallation identification methods. The observed xenon spallation products are consistent with results from the FLUKA and Geant4 simulation codes. △ Less

Submitted 23 January, 2023; originally announced January 2023.

Dipolar Spin Liquid Ending with Quantum Critical Point in a Gd-based Triangular Magnet

Authors: Junsen Xiang, Cheng Su, Ning Xi, Zhendong Fu, Zhuo Chen, Hai **, Ziyu Chen, Zhao-Jun Mo, Yang Qi, Jun Shen, Long Zhang, Wentao **, Wei Li, Peijie Sun, Gang Su

Abstract: By performing experiment and model studies on a triangular-lattice dipolar magnet KBaGd(BO$_3$)$_2$ (KBGB), we find the highly frustrated magnet with a planar anisotropy hosts a strongly fluctuating dipolar spin liquid (DSL), which originates from the intriguing interplay between dipolar and Heisenberg interactions. The DSL constitutes an extended regime in the field-temperature phase diagram, whi… ▽ More By performing experiment and model studies on a triangular-lattice dipolar magnet KBaGd(BO$_3$)$_2$ (KBGB), we find the highly frustrated magnet with a planar anisotropy hosts a strongly fluctuating dipolar spin liquid (DSL), which originates from the intriguing interplay between dipolar and Heisenberg interactions. The DSL constitutes an extended regime in the field-temperature phase diagram, which gets lowered in temperature as field increases and eventually ends with an unconventional quantum critical point (QCP) at $B_c\simeq 0.75$~T. Based on dipolar Heisenberg model calculations, we identify the DSL as a Berezinskii-Kosterlitz-Thouless (BKT) phase with emergent U(1) symmetry. Due to the tremendous entropy accumulation that can be related to the strong BKT and quantum fluctuations, unprecedented magnetic cooling effects are observed in the DSL regime and particularly near the QCP, making KBGB a superior dipolar coolant to commercial Gd-based refrigerants. We establish the phase diagram for triangular-lattice dipolar quantum magnets where emergent symmetry plays an essential role, and provide a basis and opens an avenue for their applications in sub-Kelvin refrigeration. △ Less

Submitted 16 January, 2023; v1 submitted 9 January, 2023; originally announced January 2023.

Comments: 7 pages and 4 figures in main text, 5 pages and 4 figures in Supplementary Materials

SoC-Cluster as an Edge Server: an Application-driven Measurement Study

Authors: Li Zhang, Zhe Fu, Boqing Shi, Xiang Li, Ru** Lai, Chenyang Chen, Ao Zhou, Xiao Ma, Shangguang Wang, Mengwei Xu

Abstract: Huge electricity consumption is a severe issue for edge data centers. To this end, we propose a new form of edge server, namely SoC-Cluster, that orchestrates many low-power mobile system-on-chips (SoCs) through an on-chip network. For the first time, we have developed a concrete SoC-Cluster server that consists of 60 Qualcomm Snapdragon 865 SoCs in a 2U rack. Such a server has been commercialized… ▽ More Huge electricity consumption is a severe issue for edge data centers. To this end, we propose a new form of edge server, namely SoC-Cluster, that orchestrates many low-power mobile system-on-chips (SoCs) through an on-chip network. For the first time, we have developed a concrete SoC-Cluster server that consists of 60 Qualcomm Snapdragon 865 SoCs in a 2U rack. Such a server has been commercialized successfully and deployed in large scale on edge clouds. The current dominant workload on those deployed SoC-Clusters is cloud gaming, as mobile SoCs can seamlessly run native mobile games. The primary goal of this work is to demystify whether SoC-Cluster can efficiently serve more general-purpose, edge-typical workloads. Therefore, we built a benchmark suite that leverages state-of-the-art libraries for two killer edge workloads, i.e., video transcoding and deep learning inference. The benchmark comprehensively reports the performance, power consumption, and other application-specific metrics. We then performed a thorough measurement study and directly compared SoC-Cluster with traditional edge servers (with Intel CPU and NVIDIA GPU) with respect to physical size, electricity, and billing. The results reveal the advantages of SoC-Cluster, especially its high energy efficiency and the ability to proportionally scale energy consumption with various incoming loads, as well as its limitations. The results also provide insightful implications and valuable guidance to further improve SoC-Cluster and land it in broader edge scenarios. △ Less

Submitted 24 December, 2022; originally announced December 2022.

Offline Reinforcement Learning for Human-Guided Human-Machine Interaction with Private Information

Authors: Zuyue Fu, Zhengling Qi, Zhuoran Yang, Zhaoran Wang, Lan Wang

Abstract: Motivated by the human-machine interaction such as training chatbots for improving customer satisfaction, we study human-guided human-machine interaction involving private information. We model this interaction as a two-player turn-based game, where one player (Alice, a human) guides the other player (Bob, a machine) towards a common goal. Specifically, we focus on offline reinforcement learning (… ▽ More Motivated by the human-machine interaction such as training chatbots for improving customer satisfaction, we study human-guided human-machine interaction involving private information. We model this interaction as a two-player turn-based game, where one player (Alice, a human) guides the other player (Bob, a machine) towards a common goal. Specifically, we focus on offline reinforcement learning (RL) in this game, where the goal is to find a policy pair for Alice and Bob that maximizes their expected total rewards based on an offline dataset collected a priori. The offline setting presents two challenges: (i) We cannot collect Bob's private information, leading to a confounding bias when using standard RL methods, and (ii) a distributional mismatch between the behavior policy used to collect data and the desired policy we aim to learn. To tackle the confounding bias, we treat Bob's previous action as an instrumental variable for Alice's current decision making so as to adjust for the unmeasured confounding. We develop a novel identification result and use it to propose a new off-policy evaluation (OPE) method for evaluating policy pairs in this two-player turn-based game. To tackle the distributional mismatch, we leverage the idea of pessimism and use our OPE method to develop an off-policy learning algorithm for finding a desirable policy pair for both Alice and Bob. Finally, we prove that under mild assumptions such as partial coverage of the offline data, the policy pair obtained through our method converges to the optimal one at a satisfactory rate. △ Less

Submitted 23 December, 2022; originally announced December 2022.

Boundary Layers of Circumplanetary Disks around Spinning Planets I. Effects of Rossby Waves

Authors: Zhihao Fu, Shunquan Huang, Cong Yu

Abstract: Gas giant planets are believed to accrete from their circumplanetary disks (CPDs). The CPDs usually involve accretion through the boundary layer (BL) in the vicinity of planets. Prior studies have concentrated on the BL of non-spinning planets. We investigate the influence of planetary spin on the wave behaviors within the BL. The rotation profile in such BLs would show sharp transition from the r… ▽ More Gas giant planets are believed to accrete from their circumplanetary disks (CPDs). The CPDs usually involve accretion through the boundary layer (BL) in the vicinity of planets. Prior studies have concentrated on the BL of non-spinning planets. We investigate the influence of planetary spin on the wave behaviors within the BL. The rotation profile in such BLs would show sharp transition from the rigid rotation to the Keplerian rotation. We examine the angular momentum transport in these BL in terms of linear perturbation analysis. We find that the global inertia-acoustic mode associated with spinning planets would give rise to the inflow of angular momentum and the accretion of gas. In this work, we identify a new kind of global mode, namely the Rossby mode. The Rossby mode can lead to the outflow of angular momentum and the decretion of gas from a spinning planet. The Rossby mode provide a negative feedback that regulates the planetary spin and mass. We compare the growth rate of the two modes as a function of the width of BL, the Mach number and the spin rate of planet. Our results reveal the underlying hydrodynamic mechanism of terminal spins and asymptotic mass of the giant planets. △ Less

Submitted 5 December, 2022; originally announced December 2022.

Comments: 13 pages, 11 figures, 1 table, with minor revision and resubmitted to ApJ

Dial-a-ride problem with modular platooning and en-route transfers

Authors: Zhexi Fu, Joseph Y. J. Chow

Abstract: Modular vehicles (MV) possess the ability to physically connect/disconnect with each other and travel in platoon with less energy consumption. A fleet of demand-responsive transit vehicles with such technology can serve passengers door to door or have vehicles deviate to platoon with each other to travel at lower cost and allow for en-route passenger transfers before splitting. A mixed integer lin… ▽ More Modular vehicles (MV) possess the ability to physically connect/disconnect with each other and travel in platoon with less energy consumption. A fleet of demand-responsive transit vehicles with such technology can serve passengers door to door or have vehicles deviate to platoon with each other to travel at lower cost and allow for en-route passenger transfers before splitting. A mixed integer linear programming (MILP) model is formulated to solve this "modular dial-a-ride problem" (MDARP). A heuristic algorithm based on Steiner-tree-inspired large neighborhood search is developed to solve the MDARP for practical scenarios. A set of small-scale synthetic numerical experiments are tested to evaluate the optimality gap and computation time between exact solutions of the MDARP using commercial software and the proposed heuristic. Large-scale experiments are conducted on the Anaheim network with 378 candidate join/split nodes to further explore the potentials and identify the ideal operation scenarios of MVs. The results show that MV technology can save up to 52.0% in vehicle travel cost, 35.6% in passenger service time, and 29.4% in total cost against existing on-demand mobility services in the scenarios tested. Results suggest that MVs best benefit from platooning by serving "enclave pairs" as a hub-and-spoke service. △ Less

Submitted 23 December, 2022; v1 submitted 1 December, 2022; originally announced December 2022.

Self-Supervised Mental Disorder Classifiers via Time Reversal

Authors: Zafar Iqbal, Usman Mahmood, Zening Fu, Sergey Plis

Abstract: Data scarcity is a notable problem, especially in the medical domain, due to patient data laws. Therefore, efficient Pre-Training techniques could help in combating this problem. In this paper, we demonstrate that a model trained on the time direction of functional neuro-imaging data could help in any downstream task, for example, classifying diseases from healthy controls in fMRI data. We train a… ▽ More Data scarcity is a notable problem, especially in the medical domain, due to patient data laws. Therefore, efficient Pre-Training techniques could help in combating this problem. In this paper, we demonstrate that a model trained on the time direction of functional neuro-imaging data could help in any downstream task, for example, classifying diseases from healthy controls in fMRI data. We train a Deep Neural Network on Independent components derived from fMRI data using the Independent component analysis (ICA) technique. It learns time direction in the ICA-based data. This pre-trained model is further trained to classify brain disorders in different datasets. Through various experiments, we have shown that learning time direction helps a model learn some causal relation in fMRI data that helps in faster convergence, and consequently, the model generalizes well in downstream classification tasks even with fewer data records. △ Less

Submitted 30 November, 2022; v1 submitted 29 November, 2022; originally announced November 2022.

Comments: 10 pages, 7 figures

Intra-class Adaptive Augmentation with Neighbor Correction for Deep Metric Learning

Authors: Zheren Fu, Zhendong Mao, Bo Hu, An-An Liu, Yongdong Zhang

Abstract: Deep metric learning aims to learn an embedding space, where semantically similar samples are close together and dissimilar ones are repelled against. To explore more hard and informative training signals for augmentation and generalization, recent methods focus on generating synthetic samples to boost metric learning losses. However, these methods just use the deterministic and class-independent… ▽ More Deep metric learning aims to learn an embedding space, where semantically similar samples are close together and dissimilar ones are repelled against. To explore more hard and informative training signals for augmentation and generalization, recent methods focus on generating synthetic samples to boost metric learning losses. However, these methods just use the deterministic and class-independent generations (e.g., simple linear interpolation), which only can cover the limited part of distribution spaces around original samples. They have overlooked the wide characteristic changes of different classes and can not model abundant intra-class variations for generations. Therefore, generated samples not only lack rich semantics within the certain class, but also might be noisy signals to disturb training. In this paper, we propose a novel intra-class adaptive augmentation (IAA) framework for deep metric learning. We reasonably estimate intra-class variations for every class and generate adaptive synthetic samples to support hard samples mining and boost metric learning losses. Further, for most datasets that have a few samples within the class, we propose the neighbor correction to revise the inaccurate estimations, according to our correlation discovery where similar classes generally have similar variation distributions. Extensive experiments on five benchmarks show our method significantly improves and outperforms the state-of-the-art methods on retrieval performances by 3%-6%. Our code is available at https://github.com/darkpromise98/IAA △ Less

Submitted 29 November, 2022; originally announced November 2022.

Comments: Accepted by IEEE Transactions on Multimedia

On the Effectiveness of Parameter-Efficient Fine-Tuning

Authors: Zihao Fu, Haoran Yang, Anthony Man-Cho So, Wai Lam, Lidong Bing, Nigel Collier

Abstract: Fine-tuning pre-trained models has been ubiquitously proven to be effective in a wide range of NLP tasks. However, fine-tuning the whole model is parameter inefficient as it always yields an entirely new model for each task. Currently, many research works propose to only fine-tune a small portion of the parameters while kee** most of the parameters shared across different tasks. These methods ac… ▽ More Fine-tuning pre-trained models has been ubiquitously proven to be effective in a wide range of NLP tasks. However, fine-tuning the whole model is parameter inefficient as it always yields an entirely new model for each task. Currently, many research works propose to only fine-tune a small portion of the parameters while kee** most of the parameters shared across different tasks. These methods achieve surprisingly good performance and are shown to be more stable than their corresponding fully fine-tuned counterparts. However, such kind of methods is still not well understood. Some natural questions arise: How does the parameter sparsity lead to promising performance? Why is the model more stable than the fully fine-tuned models? How to choose the tunable parameters? In this paper, we first categorize the existing methods into random approaches, rule-based approaches, and projection-based approaches based on how they choose which parameters to tune. Then, we show that all of the methods are actually sparse fine-tuned models and conduct a novel theoretical analysis of them. We indicate that the sparsity is actually imposing a regularization on the original model by controlling the upper bound of the stability. Such stability leads to better generalization capability which has been empirically observed in a lot of recent research works. Despite the effectiveness of sparsity grounded by our theory, it still remains an open problem of how to choose the tunable parameters. To better choose the tunable parameters, we propose a novel Second-order Approximation Method (SAM) which approximates the original problem with an analytically solvable optimization function. The tunable parameters are determined by directly optimizing the approximation function. The experimental results show that our proposed SAM model outperforms many strong baseline models and it also verifies our theoretical analysis. △ Less

Submitted 28 November, 2022; originally announced November 2022.

First measurement of the strange axial coupling constant using neutral-current quasielastic interactions of atmospheric neutrinos at KamLAND

Authors: KamLAND Collaboration, S. Abe, S. Asami, M. Eizuka, S. Futagi, A. Gando, Y. Gando, T. Gima, A. Goto, T. Hachiya, K. Hata, K. Ichimura, S. Ieki, H. Ikeda, K. Inoue, K. Ishidoshiro, Y. Kamei, N. Kawada, Y. Kishimoto, M. Koga, M. Kurasawa, T. Mitsui, H. Miyake, T. Nakahata, K. Nakamura , et al. (39 additional authors not shown)

Abstract: We report a measurement of the strange axial coupling constant $g_A^s$ using atmospheric neutrino data at KamLAND. This constant is a component of the axial form factor of the neutral-current quasielastic (NCQE) interaction. The value of $g_A^s$ significantly changes the ratio of proton and neutron NCQE cross sections. KamLAND is suitable for measuring NCQE interactions as it can detect nucleon re… ▽ More We report a measurement of the strange axial coupling constant $g_A^s$ using atmospheric neutrino data at KamLAND. This constant is a component of the axial form factor of the neutral-current quasielastic (NCQE) interaction. The value of $g_A^s$ significantly changes the ratio of proton and neutron NCQE cross sections. KamLAND is suitable for measuring NCQE interactions as it can detect nucleon recoils with low-energy thresholds and measure neutron multiplicity with high efficiency. KamLAND data, including the information on neutron multiplicity associated with the NCQE interactions, makes it possible to measure $g_A^s$ with a suppressed dependence on the axial mass $M_A$, which has not yet been determined. For a comprehensive prediction of the neutron emission associated with neutrino interactions, we establish a simulation of particle emission via nuclear deexcitation of $^{12}$C, a process not considered in existing neutrino Monte Carlo event generators. Energy spectrum fitting for each neutron multiplicity gives $g_A^s =-0.14^{+0.25}_{-0.26}$, which is the most stringent limit obtained using NCQE interactions without $M_A$ constraints. The two-body current contribution considered in this analysis relies on a theoretically effective model and electron scattering experiments and requires future verification by direct measurements and future model improvement. △ Less

Submitted 19 April, 2023; v1 submitted 25 November, 2022; originally announced November 2022.

Journal ref: Phys. Rev. D 107,072006 (2023)

Towards Understanding Omission in Dialogue Summarization

Authors: Yicheng Zou, Kaitao Song, Xu Tan, Zhongkai Fu, Qi Zhang, Dongsheng Li, Tao Gui

Abstract: Dialogue summarization aims to condense the lengthy dialogue into a concise summary, and has recently achieved significant progress. However, the result of existing methods is still far from satisfactory. Previous works indicated that omission is a major factor in affecting the quality of summarization, but few of them have further explored the omission problem, such as how omission affects summar… ▽ More Dialogue summarization aims to condense the lengthy dialogue into a concise summary, and has recently achieved significant progress. However, the result of existing methods is still far from satisfactory. Previous works indicated that omission is a major factor in affecting the quality of summarization, but few of them have further explored the omission problem, such as how omission affects summarization results and how to detect omission, which is critical for reducing omission and improving summarization quality. Moreover, analyzing and detecting omission relies on summarization datasets with omission labels (i.e., which dialogue utterances are omitted in the summarization), which are not available in the current literature. In this paper, we propose the OLDS dataset, which provides high-quality Omission Labels for Dialogue Summarization. By analyzing this dataset, we find that a large improvement in summarization quality can be achieved by providing ground-truth omission labels for the summarization model to recover omission information, which demonstrates the importance of omission detection for omission mitigation in dialogue summarization. Therefore, we formulate an omission detection task and demonstrate our proposed dataset can support the training and evaluation of this task well. We also call for research action on omission detection based on our proposed datasets. Our dataset and codes are publicly available. △ Less

Submitted 11 May, 2023; v1 submitted 14 November, 2022; originally announced November 2022.

Comments: ACL 2023

MultiCrossViT: Multimodal Vision Transformer for Schizophrenia Prediction using Structural MRI and Functional Network Connectivity Data

Authors: Yuda Bi, Anees Abrol, Zening Fu, Vince Calhoun

Abstract: Vision Transformer (ViT) is a pioneering deep learning framework that can address real-world computer vision issues, such as image classification and object recognition. Importantly, ViTs are proven to outperform traditional deep learning models, such as convolutional neural networks (CNNs). Relatively recently, a number of ViT mutations have been transplanted into the field of medical imaging, th… ▽ More Vision Transformer (ViT) is a pioneering deep learning framework that can address real-world computer vision issues, such as image classification and object recognition. Importantly, ViTs are proven to outperform traditional deep learning models, such as convolutional neural networks (CNNs). Relatively recently, a number of ViT mutations have been transplanted into the field of medical imaging, thereby resolving a variety of critical classification and segmentation challenges, especially in terms of brain imaging data. In this work, we provide a novel multimodal deep learning pipeline, MultiCrossViT, which is capable of analyzing both structural MRI (sMRI) and static functional network connectivity (sFNC) data for the prediction of schizophrenia disease. On a dataset with minimal training subjects, our novel model can achieve an AUC of 0.832. Finally, we visualize multiple brain regions and covariance patterns most relevant to schizophrenia based on the resulting ViT attention maps by extracting features from transformer encoders. △ Less

Submitted 5 March, 2023; v1 submitted 12 November, 2022; originally announced November 2022.

Comments: I submitted the wrong paper

Cross-view Graph Contrastive Representation Learning on Partially Aligned Multi-view Data

Authors: Yiming Wang, Dongxia Chang, Zhiqiang Fu, Jie Wen, Yao Zhao

Abstract: Multi-view representation learning has developed rapidly over the past decades and has been applied in many fields. However, most previous works assumed that each view is complete and aligned. This leads to an inevitable deterioration in their performance when encountering practical problems such as missing or unaligned views. To address the challenge of representation learning on partially aligne… ▽ More Multi-view representation learning has developed rapidly over the past decades and has been applied in many fields. However, most previous works assumed that each view is complete and aligned. This leads to an inevitable deterioration in their performance when encountering practical problems such as missing or unaligned views. To address the challenge of representation learning on partially aligned multi-view data, we propose a new cross-view graph contrastive learning framework, which integrates multi-view information to align data and learn latent representations. Compared with current approaches, the proposed method has the following merits: (1) our model is an end-to-end framework that simultaneously performs view-specific representation learning via view-specific autoencoders and cluster-level data aligning by combining multi-view information with the cross-view graph contrastive learning; (2) it is easy to apply our model to explore information from three or more modalities/sources as the cross-view graph contrastive learning is devised. Extensive experiments conducted on several real datasets demonstrate the effectiveness of the proposed method on the clustering and classification tasks. △ Less

Submitted 8 November, 2022; originally announced November 2022.

CodeEditor: Learning to Edit Source Code with Pre-trained Models

Authors: Jia Li, Ge Li, Zhuo Li, Zhi **, Xing Hu, Kechi Zhang, Zhiyi Fu

Abstract: Developers often perform repetitive code editing activities for various reasons (e.g., code refactoring) during software development. Pre-trained code editing models have achieved the state-of-the-art (SOTA) results. Pre-trained models are first pre-trained with pre-training tasks and fine-tuned with the code editing task. Existing pre-training tasks mainly are code infilling tasks (e.g., masked l… ▽ More Developers often perform repetitive code editing activities for various reasons (e.g., code refactoring) during software development. Pre-trained code editing models have achieved the state-of-the-art (SOTA) results. Pre-trained models are first pre-trained with pre-training tasks and fine-tuned with the code editing task. Existing pre-training tasks mainly are code infilling tasks (e.g., masked language modeling), which are derived from the natural language processing field and are not designed for automatic code editing. This paper proposes a novel pre-training task specialized in code editing and presents an effective pre-trained code editing model named CodeEditor. Our pre-training task further improves the performance and generalization ability of code editing models. Specifically, we collect lots of real-world code snippets as the ground truth and use a powerful generator to rewrite them into mutated versions. Then, we pre-train our CodeEditor to edit mutated versions into the corresponding ground truth, to learn edit patterns. We conduct experiments on four code editing datasets and evaluate the pre-trained CodeEditor in three settings. (1) In the fine-tuning setting, we train the pre-trained CodeEditor with four datasets and evaluate it on the test data. CodeEditor outperforms the SOTA baselines by 15%, 25.5%, and 9.4% and 26.6% on four datasets. (2) In the few-shot setting, we train the pre-trained CodeEditor with limited data and evaluate it on the test data. CodeEditor substantially performs better than all baselines. (3) In the zero-shot setting, CodeEditor correctly edits 1,113 programs while the SOTA baselines can not work. △ Less

Submitted 7 September, 2023; v1 submitted 30 October, 2022; originally announced October 2022.

Comments: Accepted by the ACM Transactions on Software Engineering and Methodology (TOSEM)

Convergence of fractional Fourier series on the torus and applications

Authors: Zunwei Fu, Xianming Hou, Qingyan Wu

Abstract: In this paper, we introduce the fractional Fourier series on the fractional torus and study some basic facts of fractional Fourier series, such as fractional convolution and fractional approximation. Meanwhile, fractional Fourier inversion and Poisson summation formula are also given. We further discuss the relationship between the decay of fractional Fourier coefficients and the smoothness of a f… ▽ More In this paper, we introduce the fractional Fourier series on the fractional torus and study some basic facts of fractional Fourier series, such as fractional convolution and fractional approximation. Meanwhile, fractional Fourier inversion and Poisson summation formula are also given. We further discuss the relationship between the decay of fractional Fourier coefficients and the smoothness of a function. Using the properties of fractional Fejer kernel, the pointwise convergence of fractional Fourier series can be established. Finally, we present the applications of fractional Fourier series to fractional partial differential equations with periodic boundary condition. Moreover, we apply approximation methods on the fractional torus to recover the non-stationary signals. △ Less

Submitted 28 October, 2022; v1 submitted 26 October, 2022; originally announced October 2022.

MSC Class: 42A20; 41A35

Understanding thermal induced escape mechanism of optically levitated sphere in vacuum

Authors: Mengzhu Hu, Nan Li, Zhenhai Fu, Yizhou Zhang, Wenqiang Li, Huizhu Hu

Abstract: The escape phenomenon, mainly caused by thermal effects, is known as an obstacle to the further practical application of optical levitation system in vacuum. Irregular photophoresis induced by thermal effects can act as an amplifier of Brownian motion. Studies on this topic provide interpretation for particle esca** phenomenon during the pressure decreasing process, as well as valuable insights… ▽ More The escape phenomenon, mainly caused by thermal effects, is known as an obstacle to the further practical application of optical levitation system in vacuum. Irregular photophoresis induced by thermal effects can act as an amplifier of Brownian motion. Studies on this topic provide interpretation for particle esca** phenomenon during the pressure decreasing process, as well as valuable insights into the micro- and nanoscale thermal effects in optical trap in vacuum. In this paper, we derive and test a dynamic model for the motion of an optically levitated particle in a non-equilibrium state and demonstrate the esca** mechanism of heated particles. The result of theoretical investigations is consistent with experimental escape at 0.1mbar. This work reveals and provides a theoretical basis for the stable operation of laser levitated oscillator in high vacuum and pave the way for the practicability of ultra-sensitive sensing devices. △ Less

Submitted 5 April, 2023; v1 submitted 24 October, 2022; originally announced October 2022.

Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotion

Authors: Zipeng Fu, Xuxin Cheng, Deepak Pathak

Abstract: An attached arm can significantly increase the applicability of legged robots to several mobile manipulation tasks that are not possible for the wheeled or tracked counterparts. The standard hierarchical control pipeline for such legged manipulators is to decouple the controller into that of manipulation and locomotion. However, this is ineffective. It requires immense engineering to support coord… ▽ More An attached arm can significantly increase the applicability of legged robots to several mobile manipulation tasks that are not possible for the wheeled or tracked counterparts. The standard hierarchical control pipeline for such legged manipulators is to decouple the controller into that of manipulation and locomotion. However, this is ineffective. It requires immense engineering to support coordination between the arm and legs, and error can propagate across modules causing non-smooth unnatural motions. It is also biological implausible given evidence for strong motor synergies across limbs. In this work, we propose to learn a unified policy for whole-body control of a legged manipulator using reinforcement learning. We propose Regularized Online Adaptation to bridge the Sim2Real gap for high-DoF control, and Advantage Mixing exploiting the causal dependency in the action space to overcome local minima during training the whole-body system. We also present a simple design for a low-cost legged manipulator, and find that our unified policy can demonstrate dynamic and agile behaviors across several task setups. Videos are at https://maniploco.github.io △ Less

Submitted 18 October, 2022; originally announced October 2022.

Comments: CoRL 2022 (Oral). Project website at https://maniploco.github.io

Informative Text Generation from Knowledge Triples

Authors: Zihao Fu, Yijiang River Dong, Lidong Bing, Wai Lam

Abstract: As the development of the encoder-decoder architecture, researchers are able to study the text generation tasks with broader types of data. Among them, KB-to-text aims at converting a set of knowledge triples into human readable sentences. In the original setting, the task assumes that the input triples and the text are exactly aligned in the perspective of the embodied knowledge/information. In t… ▽ More As the development of the encoder-decoder architecture, researchers are able to study the text generation tasks with broader types of data. Among them, KB-to-text aims at converting a set of knowledge triples into human readable sentences. In the original setting, the task assumes that the input triples and the text are exactly aligned in the perspective of the embodied knowledge/information. In this paper, we extend this setting and explore how to facilitate the trained model to generate more informative text, namely, containing more information about the triple entities but not conveyed by the input triples. To solve this problem, we propose a novel memory augmented generator that employs a memory network to memorize the useful knowledge learned during the training and utilizes such information together with the input triples to generate text in the operational or testing phase. We derive a dataset from WebNLG for our new setting and conduct extensive experiments to investigate the effectiveness of our model as well as uncover the intrinsic characteristics of the setting. △ Less

Submitted 26 September, 2022; originally announced September 2022.

D$^{\bf{3}}$: Duplicate Detection Decontaminator for Multi-Athlete Tracking in Sports Videos

Authors: Rui He, Zehua Fu, Qingjie Liu, Yunhong Wang, Xunxun Chen

Abstract: Tracking multiple athletes in sports videos is a very challenging Multi-Object Tracking (MOT) task, since athletes often have the same appearance and are intimately covered with each other, making a common occlusion problem becomes an abhorrent duplicate detection. In this paper, the duplicate detection is newly and precisely defined as occlusion misreporting on the same athlete by multiple detect… ▽ More Tracking multiple athletes in sports videos is a very challenging Multi-Object Tracking (MOT) task, since athletes often have the same appearance and are intimately covered with each other, making a common occlusion problem becomes an abhorrent duplicate detection. In this paper, the duplicate detection is newly and precisely defined as occlusion misreporting on the same athlete by multiple detection boxes in one frame. To address this problem, we meticulously design a novel transformer-based Duplicate Detection Decontaminator (D$^3$) for training, and a specific algorithm Rally-Hungarian (RH) for matching. Once duplicate detection occurs, D$^3$ immediately modifies the procedure by generating enhanced boxes losses. RH, triggered by the team sports substitution rules, is exceedingly suitable for sports videos. Moreover, to complement the tracking dataset that without shot changes, we release a new dataset based on sports video named RallyTrack. Extensive experiments on RallyTrack show that combining D$^3$ and RH can dramatically improve the tracking performance with 9.2 in MOTA and 4.5 in HOTA. Meanwhile, experiments on MOT-series and DanceTrack discover that D$^3$ can accelerate convergence during training, especially save up to 80 percent of the original training time on MOT17. Finally, our model, which is trained only with volleyball videos, can be applied directly to basketball and soccer videos for MAT, which shows priority of our method. Our dataset is available at https://github.com/heruihr/rallytrack. △ Less

Submitted 25 September, 2022; originally announced September 2022.

Weakly Supervised Two-Stage Training Scheme for Deep Video Fight Detection Model

Authors: Zhenting Qi, Ruike Zhu, Zheyu Fu, Wenhao Chai, Volodymyr Kindratenko

Abstract: Fight detection in videos is an emerging deep learning application with today's prevalence of surveillance systems and streaming media. Previous work has largely relied on action recognition techniques to tackle this problem. In this paper, we propose a simple but effective method that solves the task from a new perspective: we design the fight detection model as a composition of an action-aware f… ▽ More Fight detection in videos is an emerging deep learning application with today's prevalence of surveillance systems and streaming media. Previous work has largely relied on action recognition techniques to tackle this problem. In this paper, we propose a simple but effective method that solves the task from a new perspective: we design the fight detection model as a composition of an action-aware feature extractor and an anomaly score generator. Also, considering that collecting frame-level labels for videos is too laborious, we design a weakly supervised two-stage training scheme, where we utilize multiple-instance-learning loss calculated on video-level labels to train the score generator, and adopt the self-training technique to further improve its performance. Extensive experiments on a publicly available large-scale dataset, UBI-Fights, demonstrate the effectiveness of our method, and the performance on the dataset exceeds several previous state-of-the-art approaches. Furthermore, we collect a new dataset, VFD-2000, that specializes in video fight detection, with a larger scale and more scenarios than existing datasets. The implementation of our method and the proposed dataset will be publicly available at https://github.com/Hepta-Col/VideoFightDetection. △ Less

Submitted 23 September, 2022; originally announced September 2022.

Comments: Accepted by ICTAI 2022

Offline Reinforcement Learning with Instrumental Variables in Confounded Markov Decision Processes

Authors: Zuyue Fu, Zhengling Qi, Zhaoran Wang, Zhuoran Yang, Yanxun Xu, Michael R. Kosorok

Abstract: We study the offline reinforcement learning (RL) in the face of unmeasured confounders. Due to the lack of online interaction with the environment, offline RL is facing the following two significant challenges: (i) the agent may be confounded by the unobserved state variables; (ii) the offline data collected a prior does not provide sufficient coverage for the environment. To tackle the above chal… ▽ More We study the offline reinforcement learning (RL) in the face of unmeasured confounders. Due to the lack of online interaction with the environment, offline RL is facing the following two significant challenges: (i) the agent may be confounded by the unobserved state variables; (ii) the offline data collected a prior does not provide sufficient coverage for the environment. To tackle the above challenges, we study the policy learning in the confounded MDPs with the aid of instrumental variables. Specifically, we first establish value function (VF)-based and marginalized importance sampling (MIS)-based identification results for the expected total reward in the confounded MDPs. Then by leveraging pessimism and our identification results, we propose various policy learning methods with the finite-sample suboptimality guarantee of finding the optimal in-class policy under minimal data coverage and modeling assumptions. Lastly, our extensive theoretical investigations and one numerical study motivated by the kidney transplantation demonstrate the promising performance of the proposed methods. △ Less

Submitted 18 September, 2022; originally announced September 2022.

CurveFormer: 3D Lane Detection by Curve Propagation with Curve Queries and Attention

Authors: Yifeng Bai, Zhirong Chen, Zhangjie Fu, Lang Peng, Pengpeng Liang, Erkang Cheng

Abstract: 3D lane detection is an integral part of autonomous driving systems. Previous CNN and Transformer-based methods usually first generate a bird's-eye-view (BEV) feature map from the front view image, and then use a sub-network with BEV feature map as input to predict 3D lanes. Such approaches require an explicit view transformation between BEV and front view, which itself is still a challenging prob… ▽ More 3D lane detection is an integral part of autonomous driving systems. Previous CNN and Transformer-based methods usually first generate a bird's-eye-view (BEV) feature map from the front view image, and then use a sub-network with BEV feature map as input to predict 3D lanes. Such approaches require an explicit view transformation between BEV and front view, which itself is still a challenging problem. In this paper, we propose CurveFormer, a single-stage Transformer-based method that directly calculates 3D lane parameters and can circumvent the difficult view transformation step. Specifically, we formulate 3D lane detection as a curve propagation problem by using curve queries. A 3D lane query is represented by a dynamic and ordered anchor point set. In this way, queries with curve representation in Transformer decoder iteratively refine the 3D lane detection results. Moreover, a curve cross-attention module is introduced to compute the similarities between curve queries and image features. Additionally, a context sampling module that can capture more relative image features of a curve query is provided to further boost the 3D lane detection performance. We evaluate our method for 3D lane detection on both synthetic and real-world datasets, and the experimental results show that our method achieves promising performance compared with the state-of-the-art approaches. The effectiveness of each component is validated via ablation studies as well. △ Less

Submitted 17 January, 2023; v1 submitted 16 September, 2022; originally announced September 2022.

Comments: Accepted at the IEEE Conference on Robotics and Automation, ICRA 2023

Cerberus: Low-Drift Visual-Inertial-Leg Odometry For Agile Locomotion

Authors: Shuo Yang, Zixin Zhang, Zhengyu Fu, Zachary Manchester

Abstract: We present an open-source Visual-Inertial-Leg Odometry (VILO) state estimation solution, Cerberus, for legged robots that estimates position precisely on various terrains in real time using a set of standard sensors, including stereo cameras, IMU, joint encoders, and contact sensors. In addition to estimating robot states, we also perform online kinematic parameter calibration and contact outlier… ▽ More We present an open-source Visual-Inertial-Leg Odometry (VILO) state estimation solution, Cerberus, for legged robots that estimates position precisely on various terrains in real time using a set of standard sensors, including stereo cameras, IMU, joint encoders, and contact sensors. In addition to estimating robot states, we also perform online kinematic parameter calibration and contact outlier rejection to substantially reduce position drift. Hardware experiments in various indoor and outdoor environments validate that calibrating kinematic parameters within the Cerberus can reduce estimation drift to lower than 1% during long distance high speed locomotion. Our drift results are better than any other state estimation method using the same set of sensors reported in the literature. Moreover, our state estimator performs well even when the robot is experiencing large impacts and camera occlusion. The implementation of the state estimator, along with the datasets used to compute our results, are available at https://github.com/ShuoYangRobotics/Cerberus. △ Less

Submitted 15 September, 2022; originally announced September 2022.

Comments: 7 pages, 6 figures, submitted to IEEE ICRA 2023

Prediction of Gender from Longitudinal MRI data via Deep Learning on Adolescent Data Reveals Unique Patterns Associated with Brain Structure and Change over a Two-year Period

Authors: Yuda Bi, Anees Abrol, Zening Fu, Jiayu Chen, **gyu Liu, Vince Calhoun

Abstract: Deep learning algorithms for predicting neuroimaging data have shown considerable promise in various applications. Prior work has demonstrated that deep learning models that take advantage of the data's 3D structure can outperform standard machine learning on several learning tasks. However, most prior research in this area has focused on neuroimaging data from adults. Within the Adolescent Brain… ▽ More Deep learning algorithms for predicting neuroimaging data have shown considerable promise in various applications. Prior work has demonstrated that deep learning models that take advantage of the data's 3D structure can outperform standard machine learning on several learning tasks. However, most prior research in this area has focused on neuroimaging data from adults. Within the Adolescent Brain and Cognitive Development (ABCD) dataset, a large longitudinal development study, we examine structural MRI data to predict gender and identify gender-related changes in brain structure. Results demonstrate that gender prediction accuracy is exceptionally high (>97%) with training epochs >200 and that this accuracy increases with age. Brain regions identified as the most discriminative in the task under study include predominantly frontal areas and the temporal lobe. When evaluating gender predictive changes specific to a two-year increase in age, a broader set of visual, cingulate, and insular regions are revealed. Our findings show a robust gender-related structural brain change pattern, even over a small age range. This suggests that it might be possible to study how the brain changes during adolescence by looking at how these changes are related to different behavioral and environmental factors. △ Less

Submitted 5 March, 2023; v1 submitted 15 September, 2022; originally announced September 2022.

Comments: I submitted the wrong paper

Robust Implementation of Foreground Extraction and Vessel Segmentation for X-ray Coronary Angiography Image Sequence

Authors: Zeyu Fu, Zhuang Fu, Chenzhuo Lu, Jun Yan, Jian Fei, Hui Han

Abstract: The extraction of contrast-filled vessels from X-ray coronary angiography (XCA) image sequence has important clinical significance for intuitively diagnosis and therapy. In this study, the XCA image sequence is regarded as a 3D tensor input, the vessel layer is regarded as a sparse tensor, and the background layer is regarded as a low-rank tensor. Using tensor nuclear norm (TNN) minimization, a no… ▽ More The extraction of contrast-filled vessels from X-ray coronary angiography (XCA) image sequence has important clinical significance for intuitively diagnosis and therapy. In this study, the XCA image sequence is regarded as a 3D tensor input, the vessel layer is regarded as a sparse tensor, and the background layer is regarded as a low-rank tensor. Using tensor nuclear norm (TNN) minimization, a novel method for vessel layer extraction based on tensor robust principal component analysis (TRPCA) is proposed. Furthermore, considering the irregular movement of vessels and the low-frequency dynamic disturbance of surrounding irrelevant tissues, the total variation (TV) regularized spatial-temporal constraint is introduced to smooth the foreground layer. Subsequently, for vessel layer images with uneven contrast distribution, a two-stage region growing (TSRG) method is utilized for vessel enhancement and segmentation. A global threshold method is used as the preprocessing to obtain main branches, and the Radon-Like features (RLF) filter is used to enhance and connect broken minor segments, the final binary vessel mask is constructed by combining the two intermediate results. The visibility of TV-TRPCA algorithm for foreground extraction is evaluated on clinical XCA image sequences and third-party dataset, which can effectively improve the performance of commonly used vessel segmentation algorithms. Based on TV-TRPCA, the accuracy of TSRG algorithm for vessel segmentation is further evaluated. Both qualitative and quantitative results validate the superiority of the proposed method over existing state-of-the-art approaches. △ Less

Submitted 27 February, 2023; v1 submitted 15 September, 2022; originally announced September 2022.

Comments: 34pages, 14figures, 5tables

Learning from Future: A Novel Self-Training Framework for Semantic Segmentation

Authors: Ye Du, Yujun Shen, Haochen Wang, **g**g Fei, Wei Li, Liwei Wu, Rui Zhao, Zehua Fu, Qingjie Liu

Abstract: Self-training has shown great potential in semi-supervised learning. Its core idea is to use the model learned on labeled data to generate pseudo-labels for unlabeled samples, and in turn teach itself. To obtain valid supervision, active attempts typically employ a momentum teacher for pseudo-label prediction yet observe the confirmation bias issue, where the incorrect predictions may provide wron… ▽ More Self-training has shown great potential in semi-supervised learning. Its core idea is to use the model learned on labeled data to generate pseudo-labels for unlabeled samples, and in turn teach itself. To obtain valid supervision, active attempts typically employ a momentum teacher for pseudo-label prediction yet observe the confirmation bias issue, where the incorrect predictions may provide wrong supervision signals and get accumulated in the training process. The primary cause of such a drawback is that the prevailing self-training framework acts as guiding the current state with previous knowledge, because the teacher is updated with the past student only. To alleviate this problem, we propose a novel self-training strategy, which allows the model to learn from the future. Concretely, at each training step, we first virtually optimize the student (i.e., caching the gradients without applying them to the model weights), then update the teacher with the virtual future student, and finally ask the teacher to produce pseudo-labels for the current student as the guidance. In this way, we manage to improve the quality of pseudo-labels and thus boost the performance. We also develop two variants of our future-self-training (FST) framework through pee** at the future both deeply (FST-D) and widely (FST-W). Taking the tasks of unsupervised domain adaptive semantic segmentation and semi-supervised semantic segmentation as the instances, we experimentally demonstrate the effectiveness and superiority of our approach under a wide range of settings. Code will be made publicly available. △ Less

Submitted 18 September, 2022; v1 submitted 14 September, 2022; originally announced September 2022.

Comments: Accepted to NeurIPS 2022

Nanoscale Electric Field Sensing Using Levitated Nano-resonator with Net Charge

Authors: Shaocong Zhu, Zhenhai Fu, Xiaowen Gao, Cuihong Li, Zhiming Chen, Yingying Wang, Xingfan Chen, Huizhu Hu

Abstract: Nanomechanical resonator based on levitated particle exhibits unique advantages in the development of ultrasensitive electric field detector. We demonstrate a three-dimensional, high-sensitivity electric field measurement technology using the optically levitated nanoparticle with a known net charge. By changing the relative position between nanoparticle and parallel electrodes, the three-dimension… ▽ More Nanomechanical resonator based on levitated particle exhibits unique advantages in the development of ultrasensitive electric field detector. We demonstrate a three-dimensional, high-sensitivity electric field measurement technology using the optically levitated nanoparticle with a known net charge. By changing the relative position between nanoparticle and parallel electrodes, the three-dimensional electric field distribution is scanned. The measured noise equivalent electric intensity with charge amount of 100 reaches the order of {\rm{1μV/cm/H}}{\rm{z}^{\rm{1/2}}} at 1.4 \times {10^{ - 7}}mbar. Linearity analysis near resonance frequency shows a measured linear range over 91dB limited only by the maximum output voltage of the driving equipment. This work may provide avenue for develo** a high-sensitive electric field sensor based on optically levitated nano-resonator. △ Less

Submitted 27 August, 2022; originally announced August 2022.

Comments: 15 pages, 10 figures. arXiv admin note: text overlap with arXiv:2008.05871 by other authors

Learning energy-efficient driving behaviors by imitating experts

Authors: Abdul Rahman Kreidieh, Zhe Fu, Alexandre M. Bayen

Abstract: The rise of vehicle automation has generated significant interest in the potential role of future automated vehicles (AVs). In particular, in highly dense traffic settings, AVs are expected to serve as congestion-dampeners, mitigating the presence of instabilities that arise from various sources. However, in many applications, such maneuvers rely heavily on non-local sensing or coordination by int… ▽ More The rise of vehicle automation has generated significant interest in the potential role of future automated vehicles (AVs). In particular, in highly dense traffic settings, AVs are expected to serve as congestion-dampeners, mitigating the presence of instabilities that arise from various sources. However, in many applications, such maneuvers rely heavily on non-local sensing or coordination by interacting AVs, thereby rendering their adaptation to real-world settings a particularly difficult challenge. To address this challenge, this paper examines the role of imitation learning in bridging the gap between such control strategies and realistic limitations in communication and sensing. Treating one such controller as an "expert", we demonstrate that imitation learning can succeed in deriving policies that, if adopted by 5% of vehicles, may boost the energy-efficiency of networks with varying traffic conditions by 15% using only local observations. Results and code are available online at https://sites.google.com/view/il-traffic/home. △ Less

Submitted 28 June, 2022; originally announced August 2022.

Dynamic Causal Collaborative Filtering

Authors: Shuyuan Xu, Juntao Tan, Zuohui Fu, Jianchao Ji, Shelby Heinecke, Yongfeng Zhang

Abstract: Causal graph, as an effective and powerful tool for causal modeling, is usually assumed as a Directed Acyclic Graph (DAG). However, recommender systems usually involve feedback loops, defined as the cyclic process of recommending items, incorporating user feedback in model updates, and repeating the procedure. As a result, it is important to incorporate loops into the causal graphs to accurately m… ▽ More Causal graph, as an effective and powerful tool for causal modeling, is usually assumed as a Directed Acyclic Graph (DAG). However, recommender systems usually involve feedback loops, defined as the cyclic process of recommending items, incorporating user feedback in model updates, and repeating the procedure. As a result, it is important to incorporate loops into the causal graphs to accurately model the dynamic and iterative data generation process for recommender systems. However, feedback loops are not always beneficial since over time they may encourage more and more narrowed content exposure, which if left unattended, may results in echo chambers. As a result, it is important to understand when the recommendations will lead to echo chambers and how to mitigate echo chambers without hurting the recommendation performance. In this paper, we design a causal graph with loops to describe the dynamic process of recommendation. We then take Markov process to analyze the mathematical properties of echo chamber such as the conditions that lead to echo chambers. Inspired by the theoretical analysis, we propose a Dynamic Causal Collaborative Filtering ($\partial$CCF) model, which estimates users' post-intervention preference on items based on back-door adjustment and mitigates echo chamber with counterfactual reasoning. Multiple experiments are conducted on real-world datasets and results show that our framework can mitigate echo chambers better than other state-of-the-art frameworks while achieving comparable recommendation performance with the base recommendation models. △ Less

Submitted 23 August, 2022; originally announced August 2022.

Comments: In ACM CIKM 2022

Anatomy-Aware Contrastive Representation Learning for Fetal Ultrasound

Authors: Zeyu Fu, Jianbo Jiao, Robail Yasrab, Lior Drukker, Aris T. Papageorghiou, J. Alison Noble

Abstract: Self-supervised contrastive representation learning offers the advantage of learning meaningful visual representations from unlabeled medical datasets for transfer learning. However, applying current contrastive learning approaches to medical data without considering its domain-specific anatomical characteristics may lead to visual representations that are inconsistent in appearance and semantics.… ▽ More Self-supervised contrastive representation learning offers the advantage of learning meaningful visual representations from unlabeled medical datasets for transfer learning. However, applying current contrastive learning approaches to medical data without considering its domain-specific anatomical characteristics may lead to visual representations that are inconsistent in appearance and semantics. In this paper, we propose to improve visual representations of medical images via anatomy-aware contrastive learning (AWCL), which incorporates anatomy information to augment the positive/negative pair sampling in a contrastive learning manner. The proposed approach is demonstrated for automated fetal ultrasound imaging tasks, enabling the positive pairs from the same or different ultrasound scans that are anatomically similar to be pulled together and thus improving the representation learning. We empirically investigate the effect of inclusion of anatomy information with coarse- and fine-grained granularity, for contrastive learning and find that learning with fine-grained anatomy information which preserves intra-class difference is more effective than its counterpart. We also analyze the impact of anatomy ratio on our AWCL framework and find that using more distinct but anatomically similar samples to compose positive pairs results in better quality representations. Experiments on a large-scale fetal ultrasound dataset demonstrate that our approach is effective for learning representations that transfer well to three clinical downstream tasks, and achieves superior performance compared to ImageNet supervised and the current state-of-the-art contrastive learning methods. In particular, AWCL outperforms ImageNet supervised method by 13.8% and state-of-the-art contrastive-based method by 7.1% on a cross-domain segmentation task. △ Less

Submitted 22 August, 2022; originally announced August 2022.

Comments: ECCV-MCV 2022

Imperfect chirality at exceptional points in optical whispering-gallery microcavities

Authors: Junda Zhu, Changqing Wang, Can Tao, Zhoutian Fu, Haitao Liu, Fang Bo, Lan Yang, Guoquan Zhang, **gjun Xu

Abstract: Non-Hermitian systems have attracted considerable attention for their broad impacts on various physical platforms and peculiar applications. In non-Hermitian systems, both eigenvalues and eigenstates simultaneously coalesce at exceptional points (EPs). As one of the remarkable features of EPs, the field chirality is commonly considered perfect, which is utilized as an intriguing feature to control… ▽ More Non-Hermitian systems have attracted considerable attention for their broad impacts on various physical platforms and peculiar applications. In non-Hermitian systems, both eigenvalues and eigenstates simultaneously coalesce at exceptional points (EPs). As one of the remarkable features of EPs, the field chirality is commonly considered perfect, which is utilized as an intriguing feature to control wave propagation and regarded as a criterion of EP. However, in this work, we discover an imperfect chirality of eigenmodes at the EPs in an optical whispering gallery mode (WGM) microcavity perturbed by two strong nanoscatterers. This counterintuitive phenomenon originates from a strong frequency-dependence of the scattering between the counterpropagating waves at an "effective scatterer", which could be explained by a first-principle-based model considering a dynamic multiple-scattering process of the azimuthally propagating modes. We find that the generally imperfect chirality at the EP tends to be globally perfect with the decrease of the scattering effect induced by the nanoscatterers. Furthermore, the chirality also becomes locally perfect with the decrease of the relative azimuthal angle between the two strong nanoscatterers. This work provides a new understanding of the general properties of chirality at EPs. It will benefit the potential applications enabled by the chirality features of non-Hermitian systems at EPs. △ Less

Submitted 15 August, 2022; originally announced August 2022.

A Codebook Design for FD-MIMO Systems with Multi-Panel Array

Authors: Zhilin Fu, Sangwon Hwang, Jihwan Moon, Haibao Ren, Inkyu Lee

Abstract: In this work, we study codebook designs for full-dimension multiple-input multiple-output (FD-MIMO) systems with a multi-panel array (MPA). We propose novel codebooks which allow precise beam structures for MPA FD-MIMO systems by investigating the physical properties and alignments of the panels. We specifically exploit the characteristic that a group of antennas in a vertical direction exhibit mo… ▽ More In this work, we study codebook designs for full-dimension multiple-input multiple-output (FD-MIMO) systems with a multi-panel array (MPA). We propose novel codebooks which allow precise beam structures for MPA FD-MIMO systems by investigating the physical properties and alignments of the panels. We specifically exploit the characteristic that a group of antennas in a vertical direction exhibit more correlation than those in a horizontal direction. This enables an economical use of feedback bits while constructing finer beams compared to conventional codebooks. The codebook is further improved by dynamically allocating the feedback bits on multiple parts such as beam amplitude and co-phasing coefficients using reinforcement learning. The numerical results confirm the effectiveness of the proposed approach in terms of both performance and computational complexity. △ Less

Submitted 9 August, 2022; originally announced August 2022.

Gapless triangular-lattice spin-liquid candidate in PrZnAl$_{11}$O$_{19}$

Authors: Huanpeng Bu, Malik Ashtar, Toni Shiroka, Helen C. Walker, Zhendong Fu, **kui Zhao, Jason S. Gardner, Gang Chen, Zhaoming Tian, Hanjie Guo

Abstract: A quantum spin liquid (QSL) is an exotic state in which electron spins are highly entangled, yet keep fluctuating even at zero temperature. Experimental realization of model QSLs has been challenging due to imperfections, such as antisite disorder, strain, and extra or a lack of interactions in real materials compared to the model Hamiltonian. Here we report the magnetic susceptibility, thermodyna… ▽ More A quantum spin liquid (QSL) is an exotic state in which electron spins are highly entangled, yet keep fluctuating even at zero temperature. Experimental realization of model QSLs has been challenging due to imperfections, such as antisite disorder, strain, and extra or a lack of interactions in real materials compared to the model Hamiltonian. Here we report the magnetic susceptibility, thermodynamic, inelastic neutron scattering (INS), and muon-spin relaxation studies on a polycrystalline sample of PrZnAl$_{11}$O$_{19}$, where the Pr$^{3+}$ ions form an ideal two-dimensional triangular lattice. Our results demonstrate that this system does not order nor freeze, but keep fluctuating down to 50 mK despite large antiferromagnetic couplings ($\sim$ -10 K). Furthermore, the INS and specific-heat data suggest that PrZnAl$_{11}$O$_{19}$ is best described as a gapless QSL. △ Less

Submitted 5 September, 2022; v1 submitted 26 July, 2022; originally announced July 2022.

Comments: 8 pages, 6 figures

Journal ref: Phys. Rev. B 106, 134428 (2022)

A Survey on Trustworthy Recommender Systems

Authors: Yingqiang Ge, Shuchang Liu, Zuohui Fu, Juntao Tan, Zelong Li, Shuyuan Xu, Yunqi Li, Yikun Xian, Yongfeng Zhang

Abstract: Recommender systems (RS), serving at the forefront of Human-centered AI, are widely deployed in almost every corner of the web and facilitate the human decision-making process. However, despite their enormous capabilities and potential, RS may also lead to undesired effects on users, items, producers, platforms, or even the society at large, such as compromised user trust due to non-transparency,… ▽ More Recommender systems (RS), serving at the forefront of Human-centered AI, are widely deployed in almost every corner of the web and facilitate the human decision-making process. However, despite their enormous capabilities and potential, RS may also lead to undesired effects on users, items, producers, platforms, or even the society at large, such as compromised user trust due to non-transparency, unfair treatment of different consumers, or producers, privacy concerns due to extensive use of user's private data for personalization, just to name a few. All of these create an urgent need for Trustworthy Recommender Systems (TRS) so as to mitigate or avoid such adverse impacts and risks. In this survey, we will introduce techniques related to trustworthy recommendation, including but not limited to explainable recommendation, fairness in recommendation, privacy-aware recommendation, robustness in recommendation, user-controllable recommendation, as well as the relationship between these different perspectives in terms of trustworthy recommendation. Through this survey, we hope to deliver readers with a comprehensive view of the research area and raise attention to the community about the importance, existing research achievements, and future research directions on trustworthy recommendation. △ Less

Submitted 21 February, 2024; v1 submitted 25 July, 2022; originally announced July 2022.

Comments: Accepted by ACM Transactions on Recommender Systems (TORS)

Uncertainty Inspired Underwater Image Enhancement

Authors: Zhenqi Fu, Wu Wang, Yue Huang, Xinghao Ding, Kai-Kuang Ma

Abstract: A main challenge faced in the deep learning-based Underwater Image Enhancement (UIE) is that the ground truth high-quality image is unavailable. Most of the existing methods first generate approximate reference maps and then train an enhancement network with certainty. This kind of method fails to handle the ambiguity of the reference map. In this paper, we resolve UIE into distribution estimation… ▽ More A main challenge faced in the deep learning-based Underwater Image Enhancement (UIE) is that the ground truth high-quality image is unavailable. Most of the existing methods first generate approximate reference maps and then train an enhancement network with certainty. This kind of method fails to handle the ambiguity of the reference map. In this paper, we resolve UIE into distribution estimation and consensus process. We present a novel probabilistic network to learn the enhancement distribution of degraded underwater images. Specifically, we combine conditional variational autoencoder with adaptive instance normalization to construct the enhancement distribution. After that, we adopt a consensus process to predict a deterministic result based on a set of samples from the distribution. By learning the enhancement distribution, our method can cope with the bias introduced in the reference map labeling to some extent. Additionally, the consensus process is useful to capture a robust and stable result. We examined the proposed method on two widely used real-world underwater image enhancement datasets. Experimental results demonstrate that our approach enables sampling possible enhancement predictions. Meanwhile, the consensus estimate yields competitive performance compared with state-of-the-art UIE methods. Code available at https://github.com/zhenqifu/PUIE-Net. △ Less

Submitted 20 July, 2022; originally announced July 2022.

Improving Robotic Gras** Ability Through Deep Shape Generation

Authors: Junnan Jiang, Yuyang Tu, Xiaohui Xiao, Zhongtao Fu, Jianwei Zhang, Fei Chen, Miao Li

Abstract: Data-driven approaches have become a dominant paradigm for robotic grasp planning. However, the performance of these approaches is enormously influenced by the quality of the available training data. In this paper, we propose a framework to generate object shapes to improve the gras** dataset quality, thus enhancing the gras** ability of a pre-designed learning-based grasp planning network. In… ▽ More Data-driven approaches have become a dominant paradigm for robotic grasp planning. However, the performance of these approaches is enormously influenced by the quality of the available training data. In this paper, we propose a framework to generate object shapes to improve the gras** dataset quality, thus enhancing the gras** ability of a pre-designed learning-based grasp planning network. In this framework, the object shapes are embedded into a low-dimensional feature space using an AutoEncoder (encoder-decoder) based structure network. The rarity and graspness scores are defined for each object shape using outlier detection and grasp-quality criteria. Subsequently, new object shapes are generated in feature space that leverages the original high rarity and graspness score objects' features, which can be employed to augment the gras** dataset. Finally, the results obtained from the simulation and real-world experiments demonstrate that the gras** ability of the learning-based grasp planning network can be effectively improved with the generated object shapes. △ Less

Submitted 6 September, 2022; v1 submitted 19 June, 2022; originally announced June 2022.

Large non-reciprocal charge transport in Pt2MnGe up to room temperature

Authors: K. K. Meng, K. Wang, N. N. Zhang, Z. G. Fu, J. K. Chen, Y. Wu, X. G. Xu, J. Miao, Y. Jiang

Abstract: Non-reciprocal charge transport that is strongly associated with the structural or magnetic chirality of the quantum materials system is one of the most exotic properties of condensed matter physics. Here, using magnetic alloys film Pt2MnGe, we have realized the large non-reciprocal charge transport up to room temperature, which roots in the organic combination of chirality dependent carrier scatt… ▽ More Non-reciprocal charge transport that is strongly associated with the structural or magnetic chirality of the quantum materials system is one of the most exotic properties of condensed matter physics. Here, using magnetic alloys film Pt2MnGe, we have realized the large non-reciprocal charge transport up to room temperature, which roots in the organic combination of chirality dependent carrier scattering and special magnetic configurations. In this framework, the conduction electrons are scattered asymmetrically by the emerging non-zero vector spin chirality under in-plane magnetic field, resulting in robust non-reciprocal response. More astonishingly, the vector spin chirality in Pt2MnGe film can be reversed by a spin-polarized current through spin Hall effect in a junction with Pt layer. Our work resolves the general limitation of non-reciprocal charge transport to cryogenic temperatures, and paves the way for extending its applications in the emerging field of chiral spintronics. △ Less

Submitted 16 June, 2022; originally announced June 2022.

Extension of the bright high-harmonic photon energy range via nonadiabatic critical phase matching

Authors: Zongyuan Fu, Yudong Chen, Sainan Peng, Bingbing Zhu, Baochang Li, Rodrigo Martín-Hernández, Guangyu Fan, Yihua Wang, Carlos Hernández-García, Cheng **, Margaret Murnane, Henry Kapteyn, Zhensheng Tao

Abstract: Extending the photon energy range of bright high-harmonic generation to cover the entire soft X-ray region is important for many applications in science and technology. The concept of critical ionization fraction has been essential, because it dictates the maximum driving laser intensity that can be used while preserving bright harmonic emission. In this work, we reveal a second, nonadiabatic crit… ▽ More Extending the photon energy range of bright high-harmonic generation to cover the entire soft X-ray region is important for many applications in science and technology. The concept of critical ionization fraction has been essential, because it dictates the maximum driving laser intensity that can be used while preserving bright harmonic emission. In this work, we reveal a second, nonadiabatic critical ionization fraction that substantially extends the maximum phase-matched high-harmonic photon energy, that arises due to strong resha** of the intense driving laser field. We validate this understanding through a systematic comparison between experiment and theory, for a wide range of pulse durations and driving laser wavelengths. In particular, high harmonics driven by intense few-cycle pulses experience the most pronounced spectral resha**, significantly extending the bright photon energy range. We also present an analytical model that predicts the spectral extension that can be achieved for different driving lasers. This reveals an increasing role of nonadiabatic critical phase matching when driven by few-cycle mid-infrared lasers. These findings are important for the development of high-brightness soft X-ray sources for applications in spectroscopy and imaging. △ Less

Submitted 14 June, 2022; originally announced June 2022.

Comments: 18 pages, 4 figures

Journal ref: Science Advances (2022)

Abundances of uranium and thorium elements in Earth estimated by geoneutrino spectroscopy

Authors: S. Abe, S. Asami, M. Eizuka, S. Futagi, A. Gando, Y. Gando, T. Gima, A. Goto, T. Hachiya, K. Hata, K. Hosokawa, K. Ichimura, S. Ieki, H. Ikeda, K. Inoue, K. Ishidoshiro, Y. Kamei, N. Kawada, Y. Kishimoto, M. Koga, M. Kurasawa, N. Maemura, T. Mitsui, H. Miyake, T. Nakahata , et al. (43 additional authors not shown)

Abstract: The decay of the primordial isotopes $^{238}\mathrm{U}$, $^{235}\mathrm{U}$, $^{232}\mathrm{Th}$, and $^{40}\mathrm{K}$ have contributed to the terrestrial heat budget throughout the Earth's history. Hence the individual abundance of those isotopes are key parameters in reconstructing contemporary Earth model. The geoneutrinos produced by the radioactive decays of uranium and thorium have been obs… ▽ More The decay of the primordial isotopes $^{238}\mathrm{U}$, $^{235}\mathrm{U}$, $^{232}\mathrm{Th}$, and $^{40}\mathrm{K}$ have contributed to the terrestrial heat budget throughout the Earth's history. Hence the individual abundance of those isotopes are key parameters in reconstructing contemporary Earth model. The geoneutrinos produced by the radioactive decays of uranium and thorium have been observed with the Kamioka Liquid-Scintillator Antineutrino Detector (KamLAND). Those measurements have been improved with more than 18-year observation time, and improvements in detector background levels mainly by an 8-year almost rector-free period now permit spectroscopy with geoneutrinos. Our results yield the first constraint on both uranium and thorium heat contributions. Herein the KamLAND result is consistent with geochemical estimations based on elemental abundances of chondritic meteorites and mantle peridotites. The High-Q model is disfavored at 99.76% C.L. and a fully radiogenic model is excluded at 5.2$σ$ assuming a homogeneous heat producing element distribution in the mantle. △ Less

Submitted 13 August, 2022; v1 submitted 30 May, 2022; originally announced May 2022.

Comments: 13 pages, 2 figures, accepted for publication in Geophysical Research Letters on Aug 4th, 2022

Journal ref: Geophysical Research Letters, Volume 49, Issue 16, e2022GL099566 (2022)