Showing 1–50 of 203 results for author: An, Z

MARLP: Time-series Forecasting Control for Agricultural Managed Aquifer Recharge

Authors: Yuning Chen, Kang Yang, Zhiyu An, Brady Holder, Luke Paloutzian, Khaled Bali, Wan Du

Abstract: The rapid decline in groundwater around the world poses a significant challenge to sustainable agriculture. To address this issue, agricultural managed aquifer recharge (Ag-MAR) is proposed to recharge the aquifer by artificially flooding agricultural lands using surface water. Ag-MAR requires a carefully selected flooding schedule to avoid affecting the oxygen absorption of crop roots. However, c… ▽ More The rapid decline in groundwater around the world poses a significant challenge to sustainable agriculture. To address this issue, agricultural managed aquifer recharge (Ag-MAR) is proposed to recharge the aquifer by artificially flooding agricultural lands using surface water. Ag-MAR requires a carefully selected flooding schedule to avoid affecting the oxygen absorption of crop roots. However, current Ag-MAR scheduling does not take into account complex environmental factors such as weather and soil oxygen, resulting in crop damage and insufficient recharging amounts. This paper proposes MARLP, the first end-to-end data-driven control system for Ag-MAR. We first formulate Ag-MAR as an optimization problem. To that end, we analyze four-year in-field datasets, which reveal the multi-periodicity feature of the soil oxygen level trends and the opportunity to use external weather forecasts and flooding proposals as exogenous clues for soil oxygen prediction. Then, we design a two-stage forecasting framework. In the first stage, it extracts both the cross-variate dependency and the periodic patterns from historical data to conduct preliminary forecasting. In the second stage, it uses weather-soil and flooding-soil causality to facilitate an accurate prediction of soil oxygen levels. Finally, we conduct model predictive control (MPC) for Ag-MAR flooding. To address the challenge of large action spaces, we devise a heuristic planning module to reduce the number of flooding proposals to enable the search for optimal solutions. Real-world experiments show that MARLP reduces the oxygen deficit ratio by 86.8% while improving the recharging amount in unit time by 35.8%, compared with the previous four years. △ Less

Submitted 1 July, 2024; originally announced July 2024.

Comments: Accepted by KDD 2024

Unified Dual-Intent Translation for Joint Modeling of Search and Recommendation

Authors: Yuting Zhang, Yiqing Wu, Ruidong Han, Ying Sun, Yongchun Zhu, Xiang Li, Wei Lin, Fuzhen Zhuang, Zhulin An, Yongjun Xu

Abstract: Recommendation systems, which assist users in discovering their preferred items among numerous options, have served billions of users across various online platforms. Intuitively, users' interactions with items are highly driven by their unchanging inherent intents (e.g., always preferring high-quality items) and changing demand intents (e.g., wanting a T-shirt in summer but a down jacket in winte… ▽ More Recommendation systems, which assist users in discovering their preferred items among numerous options, have served billions of users across various online platforms. Intuitively, users' interactions with items are highly driven by their unchanging inherent intents (e.g., always preferring high-quality items) and changing demand intents (e.g., wanting a T-shirt in summer but a down jacket in winter). However, both types of intents are implicitly expressed in recommendation scenario, posing challenges in leveraging them for accurate intent-aware recommendations. Fortunately, in search scenario, often found alongside recommendation on the same online platform, users express their demand intents explicitly through their query words. Intuitively, in both scenarios, a user shares the same inherent intent and the interactions may be influenced by the same demand intent. It is therefore feasible to utilize the interaction data from both scenarios to reinforce the dual intents for joint intent-aware modeling. But the joint modeling should deal with two problems: 1) accurately modeling users' implicit demand intents in recommendation; 2) modeling the relation between the dual intents and the interactive items. To address these problems, we propose a novel model named Unified Dual-Intents Translation for joint modeling of Search and Recommendation (UDITSR). To accurately simulate users' demand intents in recommendation, we utilize real queries from search data as supervision information to guide its generation. To explicitly model the relation among the triplet <inherent intent, demand intent, interactive item>, we propose a dual-intent translation propagation mechanism to learn the triplet in the same semantic space via embedding translations. Extensive experiments demonstrate that UDITSR outperforms SOTA baselines both in search and recommendation tasks. △ Less

Submitted 30 June, 2024; originally announced July 2024.

Unified Framework for Calculating Convex Roof Resource Measures

Authors: Xuanran Zhu, Chao Zhang, Zheng An, Bei Zeng

Abstract: Quantum resource theories (QRTs) provide a comprehensive and practical framework for the analysis of diverse quantum phenomena. A fundamental task within QRTs is the quantification of resources inherent in a given quantum state. In this letter, we introduce a unified computational framework for a class of widely utilized quantum resource measures, derived from convex roof extensions. We establish… ▽ More Quantum resource theories (QRTs) provide a comprehensive and practical framework for the analysis of diverse quantum phenomena. A fundamental task within QRTs is the quantification of resources inherent in a given quantum state. In this letter, we introduce a unified computational framework for a class of widely utilized quantum resource measures, derived from convex roof extensions. We establish that the computation of these convex roof resource measures can be reformulated as an optimization problem over a Stiefel manifold, which can be further unconstrained through polar projection. Compared to existing methods employing semi-definite programming (SDP), gradient-based techniques or seesaw strategy, our approach not only demonstrates superior computational efficiency but also maintains applicability across various scenarios within a streamlined workflow. We substantiate the efficacy of our method by applying it to several key quantum resources, including entanglement, coherence, and magic states. Moreover, our methodology can be readily extended to other convex roof quantities beyond the domain of resource theories, suggesting broad applicability in the realm of quantum information theory. △ Less

Submitted 28 June, 2024; originally announced June 2024.

Comments: 13 pages, 5 figures, 2 tables

Technique Report of CVPR 2024 PBDL Challenges

Authors: Ying Fu, Yu Li, Shaodi You, Boxin Shi, Jose Alvarez, Coert van Gemeren, Linwei Chen, Yunhao Zou, Zichun Wang, Yichen Li, Yuze Han, Yingkai Zhang, Jianan Wang, Qinglin Liu, Wei Yu, Xiaoqian Lv, Jianing Li, Sheng** Zhang, Xiangyang Ji, Yuanpei Chen, Yuhan Zhang, Weihang Peng, Liwen Zhang, Zhe Xu, Dingyong Gou , et al. (77 additional authors not shown)

Abstract: The intersection of physics-based vision and deep learning presents an exciting frontier for advancing computer vision technologies. By leveraging the principles of physics to inform and enhance deep learning models, we can develop more robust and accurate vision systems. Physics-based vision aims to invert the processes to recover scene properties such as shape, reflectance, light distribution, a… ▽ More The intersection of physics-based vision and deep learning presents an exciting frontier for advancing computer vision technologies. By leveraging the principles of physics to inform and enhance deep learning models, we can develop more robust and accurate vision systems. Physics-based vision aims to invert the processes to recover scene properties such as shape, reflectance, light distribution, and medium properties from images. In recent years, deep learning has shown promising improvements for various vision tasks, and when combined with physics-based vision, these approaches can enhance the robustness and accuracy of vision systems. This technical report summarizes the outcomes of the Physics-Based Vision Meets Deep Learning (PBDL) 2024 challenge, held in CVPR 2024 workshop. The challenge consisted of eight tracks, focusing on Low-Light Enhancement and Detection as well as High Dynamic Range (HDR) Imaging. This report details the objectives, methodologies, and results of each track, highlighting the top-performing solutions and their innovative approaches. △ Less

Submitted 27 June, 2024; v1 submitted 15 June, 2024; originally announced June 2024.

Comments: The author list and contents need to be verified by all authors

Online Policy Distillation with Decision-Attention

Authors: Xinqiang Yu, Chuanguang Yang, Chengqing Yu, Libo Huang, Zhulin An, Yongjun Xu

Abstract: Policy Distillation (PD) has become an effective method to improve deep reinforcement learning tasks. The core idea of PD is to distill policy knowledge from a teacher agent to a student agent. However, the teacher-student framework requires a well-trained teacher model which is computationally expensive.In the light of online knowledge distillation, we study the knowledge transfer between differe… ▽ More Policy Distillation (PD) has become an effective method to improve deep reinforcement learning tasks. The core idea of PD is to distill policy knowledge from a teacher agent to a student agent. However, the teacher-student framework requires a well-trained teacher model which is computationally expensive.In the light of online knowledge distillation, we study the knowledge transfer between different policies that can learn diverse knowledge from the same environment.In this work, we propose Online Policy Distillation (OPD) with Decision-Attention (DA), an online learning framework in which different policies operate in the same environment to learn different perspectives of the environment and transfer knowledge to each other to obtain better performance together. With the absence of a well-performance teacher policy, the group-derived targets play a key role in transferring group knowledge to each student policy. However, naive aggregation functions tend to cause student policies quickly homogenize. To address the challenge, we introduce the Decision-Attention module to the online policies distillation framework. The Decision-Attention module can generate a distinct set of weights for each policy to measure the importance of group members. We use the Atari platform for experiments with various reinforcement learning algorithms, including PPO and DQN. In different tasks, our method can perform better than an independent training policy on both PPO and DQN algorithms. This suggests that our OPD-DA can transfer knowledge between different policies well and help agents obtain more rewards. △ Less

Submitted 8 June, 2024; originally announced June 2024.

EGOR: Efficient Generated Objects Replay for incremental object detection

Authors: Zijia An, Boyu Diao, Libo Huang, Ruiqi Liu, Zhulin An, Yongjun Xu

Abstract: Incremental object detection aims to simultaneously maintain old-class accuracy and detect emerging new-class objects in incremental data. Most existing distillation-based methods underperform when unlabeled old-class objects are absent in the incremental dataset. While the absence can be mitigated by generating old-class samples, it also incurs high computational costs. In this paper, we argue th… ▽ More Incremental object detection aims to simultaneously maintain old-class accuracy and detect emerging new-class objects in incremental data. Most existing distillation-based methods underperform when unlabeled old-class objects are absent in the incremental dataset. While the absence can be mitigated by generating old-class samples, it also incurs high computational costs. In this paper, we argue that the extra computational cost stems from the inconsistency between the detector and the generative model, along with redundant generation. To overcome this problem, we propose Efficient Generated Object Replay (EGOR). Specifically, we generate old-class samples by inversing the original detectors, thus eliminating the necessity of training and storing additional generative models. We also propose augmented replay to reuse the objects in generated samples, thereby reducing the redundant generation. In addition, we propose high-response knowledge distillation focusing on the knowledge related to the old class, which transfers the knowledge in generated objects to the incremental detector. With the addition of the generated objects and losses, we observe a bias towards old classes in the detector. We balance the losses for old and new classes to alleviate the bias, thereby increasing the overall detection accuracy. Extensive experiments conducted on MS COCO 2017 demonstrate that our method can efficiently improve detection performance in the absence of old-class objects. △ Less

Submitted 7 June, 2024; originally announced June 2024.

Local structure theory of Einstein manifolds with boundary

Authors: Zhongshan An, Lan-Hsuan Huang

Abstract: We study local structure of the moduli space of compact Einstein metrics with respect to the boundary conformal metric and mean curvature. In dimension three, we confirm M. Anderson's conjecture in a strong sense, showing that the map from Einstein metrics to such boundary data is generically a local diffeomorphism. In dimensions greater than three, we obtain similar results for Ricci flat metrics… ▽ More We study local structure of the moduli space of compact Einstein metrics with respect to the boundary conformal metric and mean curvature. In dimension three, we confirm M. Anderson's conjecture in a strong sense, showing that the map from Einstein metrics to such boundary data is generically a local diffeomorphism. In dimensions greater than three, we obtain similar results for Ricci flat metrics and negative Einstein metrics under new non-degenerate boundary conditions. △ Less

Submitted 27 May, 2024; originally announced May 2024.

Dual-Capability Machine Learning Models for Quantum Hamiltonian Parameter Estimation and Dynamics Prediction

Authors: Zheng An, Jiahui Wu, Zidong Lin, Xiaobo Yang, Keren Li, Bei Zeng

Abstract: Recent advancements in quantum hardware and classical computing simulations have significantly enhanced the accessibility of quantum system data, leading to an increased demand for precise descriptions and predictions of these systems. Accurate prediction of quantum Hamiltonian dynamics and identification of Hamiltonian parameters are crucial for advancements in quantum simulations, error correcti… ▽ More Recent advancements in quantum hardware and classical computing simulations have significantly enhanced the accessibility of quantum system data, leading to an increased demand for precise descriptions and predictions of these systems. Accurate prediction of quantum Hamiltonian dynamics and identification of Hamiltonian parameters are crucial for advancements in quantum simulations, error correction, and control protocols. This study introduces a machine learning model with dual capabilities: it can deduce time-dependent Hamiltonian parameters from observed changes in local observables within quantum many-body systems, and it can predict the evolution of these observables based on Hamiltonian parameters. Our model's validity was confirmed through theoretical simulations across various scenarios and further validated by two experiments. Initially, the model was applied to a Nuclear Magnetic Resonance quantum computer, where it accurately predicted the dynamics of local observables. The model was then tested on a superconducting quantum computer with initially unknown Hamiltonian parameters, successfully inferring them. Our approach aims to enhance various quantum computing tasks, including parameter estimation, noise characterization, feedback processes, and quantum control optimization. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: 19 pages, 14 figures

Exciton polariton critical non-Hermitian skin effect with spin-momentum-locked gains

Authors: Xingran Xu, Lingyu Tian, Zhiyuan An, Qihua Xiong, Sanjib Ghosh

Abstract: The critical skin effect, an intriguing phenomenon in non-Hermitian systems, displays sensitivity to system size and manifests distinct dynamical behaviors. In this work, we propose a novel scheme to achieve the critical non-Hermitian skin effect of exciton polaritons in an elongated microcavity system. We show that by utilising longitudinal-transverse spin splitting and spin-momentum-locked gain,… ▽ More The critical skin effect, an intriguing phenomenon in non-Hermitian systems, displays sensitivity to system size and manifests distinct dynamical behaviors. In this work, we propose a novel scheme to achieve the critical non-Hermitian skin effect of exciton polaritons in an elongated microcavity system. We show that by utilising longitudinal-transverse spin splitting and spin-momentum-locked gain, a critical non-Hermitian skin effect can be achieved in a continuous system without the need of an underlying lattice. We find that a phase transition can be induced by changing the cavity detuning with respect to the exciton energy. We identify a measurable order parameter associated with this phase transition and demonstrate the corresponding critical behavior. Our work offers a flexible approach to manipulate non-Hermitian phases of exciton polaritons, thereby expanding the potential applications of polaritonic devices. △ Less

Submitted 19 May, 2024; originally announced May 2024.

Bremsstrahlung of 5-25 keV electrons incident on MoSi$_2$, TiB$_2$ and ZrB$_2$ thick solid conductive compounds

Authors: Heng Zhang, Zhu An, **gjun Zhu, Hong Huang

Abstract: Absolute measurements were conducted to study the bremsstrahlung emission from ~5-25 keV electrons incident on three thick solid conductive compounds of MoSi$_2$, TiB$_2$ and ZrB$_2$. The additivity approximation was applied in the Monte Carlo PENELOPE simulations for compounds and mixtures. The results showed that in general the experimental bremsstrahlung spectra were in good agreement with the… ▽ More Absolute measurements were conducted to study the bremsstrahlung emission from ~5-25 keV electrons incident on three thick solid conductive compounds of MoSi$_2$, TiB$_2$ and ZrB$_2$. The additivity approximation was applied in the Monte Carlo PENELOPE simulations for compounds and mixtures. The results showed that in general the experimental bremsstrahlung spectra were in good agreement with the Monte Carlo simulation results, suggesting the feasibility of the additivity approximation in Monte Carlo simulations for the studied cases even in the absolute measurements and that the significant differences between experiments and Monte Carlo simulations near the Duane-Hunt limit for insulating targets in previous studies do not appear in the present studies. △ Less

Submitted 12 May, 2024; originally announced May 2024.

Offset of M54 from the Sagittarius Dwarf Spheroidal Galaxy

Authors: Zhaozhou An, Matthew G. Walker, Andrew B. Pace

Abstract: We present results from simultaneous modeling of 2D (projected along the line of sight) position, proper motion and line-of-sight velocity for \textit{Gaia}- and APOGEE-observed stars near the centre of the Sagittarius (Sgr) dwarf spheroidal galaxy. We use a mixture model that allows for independent sub-populations contributed by the Sgr galaxy, its nuclear star cluster M54, and the Milky Way fore… ▽ More We present results from simultaneous modeling of 2D (projected along the line of sight) position, proper motion and line-of-sight velocity for \textit{Gaia}- and APOGEE-observed stars near the centre of the Sagittarius (Sgr) dwarf spheroidal galaxy. We use a mixture model that allows for independent sub-populations contributed by the Sgr galaxy, its nuclear star cluster M54, and the Milky Way foreground. We find an offset of $0.295\pm 0.029$ degrees between the inferred centroids of Sgr and M54, corresponding to a (projected) physical separation of $0.135\pm 0.013$ kpc. The detected offset might plausibly be driven by unmodelled asymmetry in Sgr's stellar configuration; however, standard criteria for model selection favour our symmetric model over an alternative that allows for bilateral asymmetry. We infer an offset between the proper motion centres of Sgr and M54 of $[Δμ_α\cosδ,Δμ_δ]=[4.9, -19.7] \pm [6.8, 6.2]$ $μ$as yr$^{-1}$, with magnitude similar to the covariance expected due to spatially-correlated systematic error. We infer an offset of $4.1\pm 1.2$ km s$^{-1}$ in line-of-sight velocity. Using inferred values for the systemic positions and motions of Sgr and M54 as initial conditions, we calculate the recent orbital history of a simplified Sgr/M54 system, which we demonstrate to be sensitive to any line-of-sight distance offset between M54 and Sgr, and to the distribution of dark matter within Sgr. △ Less

Submitted 24 April, 2024; originally announced April 2024.

Non-hermitian magnonic knobbing between electromagnetically induced reflection and transparancy

Authors: Youcai Han, Changhao Meng, Ze** Rao, Jie Qian, Yiming Lv, Li** Zhu, CanMing Hu, Zhenghua An

Abstract: Manipulation of wave propagation through open resonant systems has attracted tremendous interest. When accessible to the open system, the system under study is prone to tempering to out of equilibrium, and a lack of reciprocity is the rule rather than the exception. Open systems correspond to non-hermitian Hamiltonians with very unique properties such as resulting exceptional points and ideal isol… ▽ More Manipulation of wave propagation through open resonant systems has attracted tremendous interest. When accessible to the open system, the system under study is prone to tempering to out of equilibrium, and a lack of reciprocity is the rule rather than the exception. Open systems correspond to non-hermitian Hamiltonians with very unique properties such as resulting exceptional points and ideal isolation. Here, we have found a highly sensitive modulation for the intersection of resonant patch antennas with respect to cavity magnonic coupling by means of an open coupling system of three resonant modes. Two types of crossings are implemented in this study: the first type of crossing remotely controls the sharp switching of the transmission line 's transmittance, while regulating the repulsive behavior of its zero-reflection states. The second type of crossing corresponds to the modulation of non-reciprocal phase transitions, which enables a more desirable isolation effect. Three different coupling models are realized by a non-Hermitian scattering Hamiltonian, revealing distinct spatial overlaps between modes. This elucidates that dissipative coupling of at least two modes to the environment is crucial for non-reciprocal transport. Our work not only reveals the versatility of cavity magnonic systems but also provides a way to design functional devices for general wave optics using patch antenna crossings. △ Less

Submitted 17 April, 2024; originally announced April 2024.

kNN-CLIP: Retrieval Enables Training-Free Segmentation on Continually Expanding Large Vocabularies

Authors: Zhongrui Gui, Shuyang Sun, Runjia Li, Jianhao Yuan, Zhaochong An, Karsten Roth, Ameya Prabhu, Philip Torr

Abstract: Rapid advancements in continual segmentation have yet to bridge the gap of scaling to large continually expanding vocabularies under compute-constrained scenarios. We discover that traditional continual training leads to catastrophic forgetting under compute constraints, unable to outperform zero-shot segmentation methods. We introduce a novel strategy for semantic and panoptic segmentation with z… ▽ More Rapid advancements in continual segmentation have yet to bridge the gap of scaling to large continually expanding vocabularies under compute-constrained scenarios. We discover that traditional continual training leads to catastrophic forgetting under compute constraints, unable to outperform zero-shot segmentation methods. We introduce a novel strategy for semantic and panoptic segmentation with zero forgetting, capable of adapting to continually growing vocabularies without the need for retraining or large memory costs. Our training-free approach, kNN-CLIP, leverages a database of instance embeddings to enable open-vocabulary segmentation approaches to continually expand their vocabulary on any given domain with a single-pass through data, while only storing embeddings minimizing both compute and memory costs. This method achieves state-of-the-art mIoU performance across large-vocabulary semantic and panoptic segmentation datasets. We hope kNN-CLIP represents a step forward in enabling more efficient and adaptable continual segmentation, paving the way for advances in real-world large-vocabulary continual segmentation methods. △ Less

Submitted 15 April, 2024; originally announced April 2024.

Comments: 10 pages, 3 figures

D2SL: Decouple Defogging and Semantic Learning for Foggy Domain-Adaptive Segmentation

Authors: Xuan Sun, Zhanfu An, Yuyu Liu

Abstract: We investigated domain adaptive semantic segmentation in foggy weather scenarios, which aims to enhance the utilization of unlabeled foggy data and improve the model's adaptability to foggy conditions. Current methods rely on clear images as references, jointly learning defogging and segmentation for foggy images. Despite making some progress, there are still two main drawbacks: (1) the coupling o… ▽ More We investigated domain adaptive semantic segmentation in foggy weather scenarios, which aims to enhance the utilization of unlabeled foggy data and improve the model's adaptability to foggy conditions. Current methods rely on clear images as references, jointly learning defogging and segmentation for foggy images. Despite making some progress, there are still two main drawbacks: (1) the coupling of segmentation and defogging feature representations, resulting in a decrease in semantic representation capability, and (2) the failure to leverage real fog priors in unlabeled foggy data, leading to insufficient model generalization ability. To address these issues, we propose a novel training framework, Decouple Defogging and Semantic learning, called D2SL, aiming to alleviate the adverse impact of defogging tasks on the final segmentation task. In this framework, we introduce a domain-consistent transfer strategy to establish a connection between defogging and segmentation tasks. Furthermore, we design a real fog transfer strategy to improve defogging effects by fully leveraging the fog priors from real foggy images. Our approach enhances the semantic representations required for segmentation during the defogging learning process and maximizes the representation capability of fog invariance by effectively utilizing real fog data. Comprehensive experiments validate the effectiveness of the proposed method. △ Less

Submitted 7 April, 2024; originally announced April 2024.

Measurement of three-body recombination coefficient of ultracold lithium and strontium atoms

Authors: Bo-Yang Wang, Yi-Fan Wang, Zi-He An, Li-Yang Xie, Zhu-Xiong Ye, Yi Zhang, Meng Khoon Tey

Abstract: We report on the observation of a conspicuous loss in an ultracold mixture of $^{7}$Li and $^{88}$Sr atoms confined in a far-off-resonance optical dipole trap. We attribute the trap loss to the three-body inelastic Li-Sr-Sr collision and extract the corresponding three-body recombination coefficient $K_3$ at $T\sim 18.5,45,70,600$ $μK$. The measured three-body recombination coefficient is about tw… ▽ More We report on the observation of a conspicuous loss in an ultracold mixture of $^{7}$Li and $^{88}$Sr atoms confined in a far-off-resonance optical dipole trap. We attribute the trap loss to the three-body inelastic Li-Sr-Sr collision and extract the corresponding three-body recombination coefficient $K_3$ at $T\sim 18.5,45,70,600$ $μK$. The measured three-body recombination coefficient is about two to three orders of magnitude larger than the typical values convenient for realizing quantum degenerate gases. It also indicates a potentially large $s$-wave scattering length between the bosonic $^{7}$Li and $^{88}$Sr atoms, and essentially rules out the prospect of realizing $^7$Li and $^{88}$Sr mixtures of high phase space density. △ Less

Submitted 1 April, 2024; originally announced April 2024.

Comments: 6 pages

Exemplar-Free Class Incremental Learning via Incremental Representation

Authors: Libo Huang, Zhulin An, Yan Zeng, Chuanguang Yang, Xinqiang Yu, Yongjun Xu

Abstract: Exemplar-Free Class Incremental Learning (efCIL) aims to continuously incorporate the knowledge from new classes while retaining previously learned information, without storing any old-class exemplars (i.e., samples). For this purpose, various efCIL methods have been proposed over the past few years, generally with elaborately constructed old pseudo-features, increasing the difficulty of model dev… ▽ More Exemplar-Free Class Incremental Learning (efCIL) aims to continuously incorporate the knowledge from new classes while retaining previously learned information, without storing any old-class exemplars (i.e., samples). For this purpose, various efCIL methods have been proposed over the past few years, generally with elaborately constructed old pseudo-features, increasing the difficulty of model development and interpretation. In contrast, we propose a \textbf{simple Incremental Representation (IR) framework} for efCIL without constructing old pseudo-features. IR utilizes dataset augmentation to cover a suitable feature space and prevents the model from forgetting by using a single L2 space maintenance loss. We discard the transient classifier trained on each one of the sequence tasks and instead replace it with a 1-near-neighbor classifier for inference, ensuring the representation is incrementally updated during CIL. Extensive experiments demonstrate that our proposed IR achieves comparable performance while significantly preventing the model from forgetting on CIFAR100, TinyImageNet, and ImageNetSubset datasets. △ Less

Submitted 24 March, 2024; originally announced March 2024.

Observation of spectral lines in the exceptional GRB 221009A

Authors: Yan-Qiu Zhang, Shao-Lin Xiong, Ji-Rong Mao, Shuang-Nan Zhang, Wang-Chen Xue, Chao Zheng, Jia-Cong Liu, Zhen Zhang, Xi-Lu Wang, Ming-Yu Ge, Shu-Xu Yi, Li-Ming Song, Zheng-Hua An, Ce Cai, Xin-Qiao Li, Wen-Xi Peng, Wen-Jun Tan, Chen-Wei Wang, Xiang-Yang Wen, Yue Wang, Shuo Xiao, Fan Zhang, Peng Zhang, Shi-Jie Zheng

Abstract: As the brightest gamma-ray burst ever observed, GRB 221009A provided a precious opportunity to explore spectral line features. In this paper, we performed a comprehensive spectroscopy analysis of GRB 221009A jointly with GECAM-C and Fermi/GBM data to search for emission and absorption lines. For the first time we investigated the line feature throughout this GRB including the most bright part wher… ▽ More As the brightest gamma-ray burst ever observed, GRB 221009A provided a precious opportunity to explore spectral line features. In this paper, we performed a comprehensive spectroscopy analysis of GRB 221009A jointly with GECAM-C and Fermi/GBM data to search for emission and absorption lines. For the first time we investigated the line feature throughout this GRB including the most bright part where many instruments suffered problems, and identified prominent emission lines in multiple time intervals. The central energy of the Gaussian emission line evolves from about 37 MeV to 6 MeV, with a nearly constant ratio (about 10\%) between the line width and central energy. Particularly, we find that both the central energy and the energy flux of the emission line evolve with time as a power law decay with power law index of -1 and -2 respectively. We suggest that the observed emission lines most likely originate from the blue-shifted electron positron pair annihilation 511 keV line. We find that a standard high latitude emission scenario cannot fully interpret the observation, thus we propose that the emission line comes from some dense clumps with electron positron pairs traveling together with the jet. In this scenario, we can use the emission line to directly, for the first time, measure the bulk Lorentz factor of the jet ($Γ$) and reveal its time evolution (i.e. $Γ\sim t^{-1}$) during the prompt emission. Interestingly, we find that the flux of the annihilation line in the co-moving frame keeps constant. These discoveries of the spectral line features shed new and important lights on the physics of GRB and relativistic jet. △ Less

Submitted 28 May, 2024; v1 submitted 19 March, 2024; originally announced March 2024.

Comments: Accepted by SCIENCE CHINA Physics, Mechanics & Astronomy (SCPMA)

Journal ref: Observation of spectral lines in the exceptional GRB 221009A. Sci. China-Phys. Mech. Astron. 67, 289511 (2024)

Harder Tasks Need More Experts: Dynamic Routing in MoE Models

Authors: Quzhe Huang, Zhenwei An, Nan Zhuang, Mingxu Tao, Chen Zhang, Yang **, Kun Xu, Kun Xu, Liwei Chen, Songfang Huang, Yansong Feng

Abstract: In this paper, we introduce a novel dynamic expert selection framework for Mixture of Experts (MoE) models, aiming to enhance computational efficiency and model performance by adjusting the number of activated experts based on input difficulty. Unlike traditional MoE approaches that rely on fixed Top-K routing, which activates a predetermined number of experts regardless of the input's complexity,… ▽ More In this paper, we introduce a novel dynamic expert selection framework for Mixture of Experts (MoE) models, aiming to enhance computational efficiency and model performance by adjusting the number of activated experts based on input difficulty. Unlike traditional MoE approaches that rely on fixed Top-K routing, which activates a predetermined number of experts regardless of the input's complexity, our method dynamically selects experts based on the confidence level in expert selection for each input. This allows for a more efficient utilization of computational resources, activating more experts for complex tasks requiring advanced reasoning and fewer for simpler tasks. Through extensive evaluations, our dynamic routing method demonstrates substantial improvements over conventional Top-2 routing across various benchmarks, achieving an average improvement of 0.7% with less than 90% activated parameters. Further analysis shows our model dispatches more experts to tasks requiring complex reasoning skills, like BBH, confirming its ability to dynamically allocate computational resources in alignment with the input's complexity. Our findings also highlight a variation in the number of experts needed across different layers of the transformer model, offering insights into the potential for designing heterogeneous MoE frameworks. The code and models are available at https://github.com/ZhenweiAn/Dynamic_MoE. △ Less

Submitted 12 March, 2024; originally announced March 2024.

Cuprate-like Electronic Structures in Infinite-Layer Nickelates with Substantial Hole Do**s

Authors: X. Ding, Y. Fan, X. X. Wang, C. H. Li, Z. T. An, J. H. Ye, S. L. Tang, M. Y. N. Lei, X. T. Sun, N. Guo, Z. H. Chen, S. Sangphet, Y. L. Wang, H. C. Xu, R. Peng, D. L. Feng

Abstract: The superconducting infinite-layer (IL) nickelates offer a new platform for investigating the long-standing problem of high-temperature superconductivity. Many models were proposed to understand its superconducting mechanisms based on the calculated electronic structure, and the multiple Fermi surfaces and multiple orbitals involved create complications and controversial conclusions. Over the past… ▽ More The superconducting infinite-layer (IL) nickelates offer a new platform for investigating the long-standing problem of high-temperature superconductivity. Many models were proposed to understand its superconducting mechanisms based on the calculated electronic structure, and the multiple Fermi surfaces and multiple orbitals involved create complications and controversial conclusions. Over the past 5 years, the lack of direct measurements of the electronic structure has hindered the understanding of nickelate superconductors. Here we fill this gap by directly resolving the electronic structures of the parent compound LaNiO$_2$ and superconducting La$_{0.8}$Ca$_{0.2}$NiO$_2$ using angle-resolved photoemission spectroscopy (ARPES). We find that their Fermi surfaces consist of a quasi-two-dimensional (quasi-2D) hole pocket and a three-dimensional (3D) electron pocket at the Brillouin zone corner, whose volumes change upon Ca do**. The Fermi surface topology and band dispersion of the hole pocket closely resemble those observed in hole-doped cuprates. However, the cuprate-like band exhibits significantly higher hole do** in superconducting La$_{0.8}$Ca$_{0.2}$NiO$_2$ compared to superconducting cuprates, highlighting the disparities in the electronic states of the superconducting phase. Our observations highlight the novel aspects of the IL nickelates, and pave the way toward the microscopic understanding of the IL nickelate family and its superconductivity. △ Less

Submitted 5 June, 2024; v1 submitted 12 March, 2024; originally announced March 2024.

Comments: 12 pages, 4 figures

Journal ref: National Science Review, nwae194 (2024)

Rethinking Few-shot 3D Point Cloud Semantic Segmentation

Authors: Zhaochong An, Guolei Sun, Yun Liu, Fayao Liu, Zongwei Wu, Dan Wang, Luc Van Gool, Serge Belongie

Abstract: This paper revisits few-shot 3D point cloud semantic segmentation (FS-PCS), with a focus on two significant issues in the state-of-the-art: foreground leakage and sparse point distribution. The former arises from non-uniform point sampling, allowing models to distinguish the density disparities between foreground and background for easier segmentation. The latter results from sampling only 2,048 p… ▽ More This paper revisits few-shot 3D point cloud semantic segmentation (FS-PCS), with a focus on two significant issues in the state-of-the-art: foreground leakage and sparse point distribution. The former arises from non-uniform point sampling, allowing models to distinguish the density disparities between foreground and background for easier segmentation. The latter results from sampling only 2,048 points, limiting semantic information and deviating from the real-world practice. To address these issues, we introduce a standardized FS-PCS setting, upon which a new benchmark is built. Moreover, we propose a novel FS-PCS model. While previous methods are based on feature optimization by mainly refining support features to enhance prototypes, our method is based on correlation optimization, referred to as Correlation Optimization Segmentation (COSeg). Specifically, we compute Class-specific Multi-prototypical Correlation (CMC) for each query point, representing its correlations to category prototypes. Then, we propose the Hyper Correlation Augmentation (HCA) module to enhance CMC. Furthermore, tackling the inherent property of few-shot training to incur base susceptibility for models, we propose to learn non-parametric prototypes for the base classes during training. The learned base prototypes are used to calibrate correlations for the background class through a Base Prototypes Calibration (BPC) module. Experiments on popular datasets demonstrate the superiority of COSeg over existing methods. The code is available at: https://github.com/ZhaochongAn/COSeg △ Less

Submitted 1 March, 2024; originally announced March 2024.

Comments: Accepted to CVPR 2024

Go Beyond Black-box Policies: Rethinking the Design of Learning Agent for Interpretable and Verifiable HVAC Control

Authors: Zhiyu An, Xianzhong Ding, Wan Du

Abstract: Recent research has shown the potential of Model-based Reinforcement Learning (MBRL) to enhance energy efficiency of Heating, Ventilation, and Air Conditioning (HVAC) systems. However, existing methods rely on black-box thermal dynamics models and stochastic optimizers, lacking reliability guarantees and posing risks to occupant health. In this work, we overcome the reliability bottleneck by redes… ▽ More Recent research has shown the potential of Model-based Reinforcement Learning (MBRL) to enhance energy efficiency of Heating, Ventilation, and Air Conditioning (HVAC) systems. However, existing methods rely on black-box thermal dynamics models and stochastic optimizers, lacking reliability guarantees and posing risks to occupant health. In this work, we overcome the reliability bottleneck by redesigning HVAC controllers using decision trees extracted from existing thermal dynamics models and historical data. Our decision tree-based policies are deterministic, verifiable, interpretable, and more energy-efficient than current MBRL methods. First, we introduce a novel verification criterion for RL agents in HVAC control based on domain knowledge. Second, we develop a policy extraction procedure that produces a verifiable decision tree policy. We found that the high dimensionality of the thermal dynamics model input hinders the efficiency of policy extraction. To tackle the dimensionality challenge, we leverage importance sampling conditioned on historical data distributions, significantly improving policy extraction efficiency. Lastly, we present an offline verification algorithm that guarantees the reliability of a control policy. Extensive experiments show that our method saves 68.4% more energy and increases human comfort gain by 14.8% compared to the state-of-the-art method, in addition to an 1127x reduction in computation overhead. Our code and data are available at https://github.com/ryeii/Veri_HVAC △ Less

Submitted 29 February, 2024; originally announced March 2024.

Comments: Accepted for the 61st Design Automation Conference (DAC)

Graphics Processing Unit/Artificial Neural Network-accelerated large-eddy simulation of turbulent combustion: Application to swirling premixed flames

Authors: Min Zhang, Runze Mao, Han Li, Zhenhua An, Zhi X. Chen

Abstract: Within the scope of reacting flow simulations, the real-time direct integration (DI) of stiff ordinary differential equations (ODE) for the computation of chemical kinetics stands as the primary demand on computational resources. Meanwhile, as the number of transport equations that need to be solved increases, the computational cost grows more substantially, particularly for those combustion model… ▽ More Within the scope of reacting flow simulations, the real-time direct integration (DI) of stiff ordinary differential equations (ODE) for the computation of chemical kinetics stands as the primary demand on computational resources. Meanwhile, as the number of transport equations that need to be solved increases, the computational cost grows more substantially, particularly for those combustion models involving direct coupling of chemistry and flow such as the transported probability density function model. In the current study, an integrated Graphics Processing Unit-Artificial Neural Network (GPU-ANN) framework is introduced to comply with heavy computational costs while maintaining high fidelity. Within this framework, a GPU-based solver is employed to solve partial differential equations and compute thermal and transport properties, and an ANN is utilized to replace the calculation of reaction rates. Large eddy simulations of two swirling flames provide a robust validation, affirming and extending the GPU-ANN approach's applicability to challenging scenarios. The simulation results demonstrate a strong correlation in the macro flame structure and statistical characteristics between the GPU-ANN approach and the traditional Central Processing Unit (CPU)-based solver with DI. This comparison indicates that the GPU-ANN approach is capable of attaining the same degree of precision as the conventional CPU-DI solver, even in more complex scenarios. In addition, the overall speed-up factor for the GPU-ANN approach is over two orders of magnitude. This study establishes the potential groundwork for widespread application of the proposed GPU-ANN approach in combustion simulations, addressing various and complex scenarios based on detailed chemistry, while significantly reducing computational costs. △ Less

Submitted 29 February, 2024; originally announced February 2024.

Reward Bound for Behavioral Guarantee of Model-based Planning Agents

Authors: Zhiyu An, Xianzhong Ding, Wan Du

Abstract: Recent years have seen an emerging interest in the trustworthiness of machine learning-based agents in the wild, especially in robotics, to provide safety assurance for the industry. Obtaining behavioral guarantees for these agents remains an important problem. In this work, we focus on guaranteeing a model-based planning agent reaches a goal state within a specific future time step. We show that… ▽ More Recent years have seen an emerging interest in the trustworthiness of machine learning-based agents in the wild, especially in robotics, to provide safety assurance for the industry. Obtaining behavioral guarantees for these agents remains an important problem. In this work, we focus on guaranteeing a model-based planning agent reaches a goal state within a specific future time step. We show that there exists a lower bound for the reward at the goal state, such that if the said reward is below that bound, it is impossible to obtain such a guarantee. By extension, we show how to enforce preferences over multiple goals. △ Less

Submitted 20 February, 2024; originally announced February 2024.

Comments: To be published in ICLR 24 tiny paper track

Detector performance of the Gamma-ray Transient Monitor onboard DRO-A Satellite

Authors: Pei-Yi Feng, Zheng-Hua An, Da-Li Zhang, Chen-Wei Wang, Chao Zheng, Sheng Yang, Shao-Lin Xiong, Jia-Cong Liu, Xin-Qiao Li, Ke Gong, Xiao-**g Liu, Min Gao, Xiang-Yang Wen, Ya-Qing liu, Xiao-Yun Zhao, Fan Zhang, Xi-Lei Sun, Hong Lu

Abstract: Gamma-ray Transient Monitor (GTM) is an all-sky monitor onboard the Distant Retrograde Orbit-A (DRO-A) satellite with the scientific objective of detecting gamma-ray transients ranging from 20 keV to 1 MeV. GTM is equipped with 5 Gamma-ray Transient Probe (GTP) detector modules, utilizing the NaI(Tl) scintillator coupled with a SiPM array. To reduce the SiPM noise, GTP makes use of a dedicated dua… ▽ More Gamma-ray Transient Monitor (GTM) is an all-sky monitor onboard the Distant Retrograde Orbit-A (DRO-A) satellite with the scientific objective of detecting gamma-ray transients ranging from 20 keV to 1 MeV. GTM is equipped with 5 Gamma-ray Transient Probe (GTP) detector modules, utilizing the NaI(Tl) scintillator coupled with a SiPM array. To reduce the SiPM noise, GTP makes use of a dedicated dual-channel coincident readout design. In this work, we firstly studied the impact of different coincidence times on detection efficiency and ultimately selected the 500 ns time coincidence window for offline data processing. To test the performance of GTPs and validate the Monte Carlo simulated energy response, we conducted comprehensive ground calibration tests using Hard X-ray Calibration Facility (HXCF) and radioactive sources, including energy response, detection efficiency, spatial response, bias-voltage response, and temperature dependence. We extensively presented the ground calibration results, and validated the design and mass model of GTP detector. These work paved the road for the in-flight observation and science data analysis. △ Less

Submitted 15 January, 2024; originally announced January 2024.

Comments: 13 pages, 25 figures

Formal Logic Enabled Personalized Federated Learning Through Property Inference

Authors: Ziyan An, Taylor T. Johnson, Meiyi Ma

Abstract: Recent advancements in federated learning (FL) have greatly facilitated the development of decentralized collaborative applications, particularly in the domain of Artificial Intelligence of Things (AIoT). However, a critical aspect missing from the current research landscape is the ability to enable data-driven client models with symbolic reasoning capabilities. Specifically, the inherent heteroge… ▽ More Recent advancements in federated learning (FL) have greatly facilitated the development of decentralized collaborative applications, particularly in the domain of Artificial Intelligence of Things (AIoT). However, a critical aspect missing from the current research landscape is the ability to enable data-driven client models with symbolic reasoning capabilities. Specifically, the inherent heterogeneity of participating client devices poses a significant challenge, as each client exhibits unique logic reasoning properties. Failing to consider these device-specific specifications can result in critical properties being missed in the client predictions, leading to suboptimal performance. In this work, we propose a new training paradigm that leverages temporal logic reasoning to address this issue. Our approach involves enhancing the training process by incorporating mechanically generated logic expressions for each FL client. Additionally, we introduce the concept of aggregation clusters and develop a partitioning algorithm to effectively group clients based on the alignment of their temporal reasoning properties. We evaluate the proposed method on two tasks: a real-world traffic volume prediction task consisting of sensory data from fifteen states and a smart city multi-task prediction utilizing synthetic data. The evaluation results exhibit clear improvements, with performance accuracy improved by up to 54% across all sequential prediction models. △ Less

Submitted 23 January, 2024; v1 submitted 14 January, 2024; originally announced January 2024.

Machine Learning Insides OptVerse AI Solver: Design Principles and Applications

Authors: Xijun Li, Fangzhou Zhu, Hui-Ling Zhen, Weilin Luo, Meng Lu, Yimin Huang, Zhenan Fan, Zirui Zhou, Yufei Kuang, Zhihai Wang, Zijie Geng, Yang Li, Haoyang Liu, Zhiwu An, Muming Yang, Jianshu Li, Jie Wang, Junchi Yan, Defeng Sun, Tao Zhong, Yong Zhang, Jia Zeng, Mingxuan Yuan, Jianye Hao, Jun Yao , et al. (1 additional authors not shown)

Abstract: In an era of digital ubiquity, efficient resource management and decision-making are paramount across numerous industries. To this end, we present a comprehensive study on the integration of machine learning (ML) techniques into Huawei Cloud's OptVerse AI Solver, which aims to mitigate the scarcity of real-world mathematical programming instances, and to surpass the capabilities of traditional opt… ▽ More In an era of digital ubiquity, efficient resource management and decision-making are paramount across numerous industries. To this end, we present a comprehensive study on the integration of machine learning (ML) techniques into Huawei Cloud's OptVerse AI Solver, which aims to mitigate the scarcity of real-world mathematical programming instances, and to surpass the capabilities of traditional optimization techniques. We showcase our methods for generating complex SAT and MILP instances utilizing generative models that mirror multifaceted structures of real-world problem. Furthermore, we introduce a training framework leveraging augmentation policies to maintain solvers' utility in dynamic environments. Besides the data generation and augmentation, our proposed approaches also include novel ML-driven policies for personalized solver strategies, with an emphasis on applications like graph convolutional networks for initial basis selection and reinforcement learning for advanced presolving and cut selection. Additionally, we detail the incorporation of state-of-the-art parameter tuning algorithms which markedly elevate solver performance. Compared with traditional solvers such as Cplex and SCIP, our ML-augmented OptVerse AI Solver demonstrates superior speed and precision across both established benchmarks and real-world scenarios, reinforcing the practical imperative and effectiveness of machine learning techniques in mathematical programming solvers. △ Less

Submitted 17 January, 2024; v1 submitted 11 January, 2024; originally announced January 2024.

The Intrinsic Energy Resolution of LaBr$_3$(Ce) Crystal for GECAM

Authors: Pei-Yi Feng, Xi-Lei Sun, Cheng-Er Wang, Yong Deng, Zheng-Hua An, Da-Li Zhang, Chao Zheng, Xin-Qiao Li, Shao-Lin Xiong, Hong Lu

Abstract: The intrinsic resolution is the primary limitation on the total energy resolution of LaBr$_3$(Ce) crystal. This intrinsic resolution arises from two effects: fluctuations occurring in the process of energy transfer to luminescent centers within the LaBr$_3$(Ce) crystal and the LaBr$_3$(Ce) crystal's non-proportional luminescence. Presently, experimental measurements regarding the intrinsic resolut… ▽ More The intrinsic resolution is the primary limitation on the total energy resolution of LaBr$_3$(Ce) crystal. This intrinsic resolution arises from two effects: fluctuations occurring in the process of energy transfer to luminescent centers within the LaBr$_3$(Ce) crystal and the LaBr$_3$(Ce) crystal's non-proportional luminescence. Presently, experimental measurements regarding the intrinsic resolution of LaBr$_3$(Ce) crystal are scarce, and the underlying physical mechanisms remain incompletely understood. In this paper, we aim to elucidate the concept of intrinsic resolution. We investigated the entire physical process of luminescence following energy deposition in the LaBr$_3$(Ce) crystal, quantifying the various components in the total energy resolution. We conducted a series of experimental measurements and Geant4 simulations, determining the intrinsic resolution of LaBr$_3$(Ce) crystal to 100 keV electrons as 2.12%. The non-proportionality contributes significantly at 1.43%, while fluctuations in the energy transfer process accounted for 0.27%. It is evident that non-proportionality in light output constitutes the primary source of intrinsic resolution. Horizontal and vertical unevenness in light collection contributed 0.25% and 0.07%, respectively. Statistical fluctuations showed the largest impact on the total energy resolution, at 2.86%. The contribution from fluctuations in single-photoelectron events was 0.77%. Furthermore, we reconstructed the photon response using Geant4, and the consistency between the simulated relative light yield and the experimentally measured one confirmed the reliability of the LaBr$_3$(Ce) detector mass model employed in the simulation. △ Less

Submitted 30 December, 2023; originally announced January 2024.

Comments: 11 pages, 16 figures

The Energy Response of LaBr3(Ce), LaBr3(Ce,Sr) and NaI(Tl) Crystals for GECAM

Authors: Pei-Yi Feng, Xi-Lei Sun, Zheng-Hua An, Yong Deng, Cheng-Er Wang, Huang Jiang, Jun-Jie Li, Da-Li Zhang, Xin-Qiao Li, Shao-Lin Xiong, Chao Zheng, Ke Gong, Sheng Yang, Xiao-**g Liu, Min Gao, Xiang-Yang Wen, Ya-Qing Liu, Yan-Bing Xu, Xiao-Yun Zhao, Jia-Cong Liu, Fan Zhang, Hong Lu

Abstract: The GECAM series of satellites utilize LaBr3(Ce), LaBr3(Ce,Sr), and NaI(Tl) crystals as sensitive materials for gamma-ray detectors (GRDs). To investigate the non-linearity in the detection of low-energy gamma rays and address errors in the E-C relationship calibration, comprehensive tests and comparative studies of the non-linearity of these three crystals were conducted using Compton electrons,… ▽ More The GECAM series of satellites utilize LaBr3(Ce), LaBr3(Ce,Sr), and NaI(Tl) crystals as sensitive materials for gamma-ray detectors (GRDs). To investigate the non-linearity in the detection of low-energy gamma rays and address errors in the E-C relationship calibration, comprehensive tests and comparative studies of the non-linearity of these three crystals were conducted using Compton electrons, radioactive sources, and mono-energetic X-rays. The non-linearity test results for Compton electrons and X-rays displayed substantial differences, with all three crystals showing higher non-linearity for X-rays and gamma-rays than for Compton electrons. Despite LaBr3(Ce) and LaBr3(Ce,Sr) crystals having higher absolute light yields, they exhibited a noticeable non-linear decrease in light yield, especially at energies below 400 keV. The NaI(Tl) crystal demonstrated excess light output in the 6~200 keV range, reaching a maximum excess of 9.2% at 30 keV in X-ray testing and up to 15.5% at 14 keV during Compton electron testing, indicating a significant advantage in the detection of low-energy gamma rays. Furthermore, this paper explores the underlying causes of the observed non-linearity in these crystals. This study not only elucidates the detector responses of GECAM, but also marks the inaugural comprehensive investigation into the non-linearity of domestically produced lanthanum bromide and sodium iodide crystals. △ Less

Submitted 27 December, 2023; originally announced December 2023.

Comments: 12pages, 16 figures

Double Oracle Algorithm for Game-Theoretic Robot Allocation on Graphs

Authors: Zijian An, Lifeng Zhou

Abstract: We study the problem of game-theoretic robot allocation where two players strategically allocate robots to compete for multiple sites of interest. Robots possess offensive or defensive capabilities to interfere and weaken their opponents to take over a competing site. This problem belongs to the conventional Colonel Blotto Game. Considering the robots' heterogeneous capabilities and environmental… ▽ More We study the problem of game-theoretic robot allocation where two players strategically allocate robots to compete for multiple sites of interest. Robots possess offensive or defensive capabilities to interfere and weaken their opponents to take over a competing site. This problem belongs to the conventional Colonel Blotto Game. Considering the robots' heterogeneous capabilities and environmental factors, we generalize the conventional Blotto game by incorporating heterogeneous robot types and graph constraints that capture the robot transitions between sites. Then we employ the Double Oracle Algorithm (DOA) to solve for the Nash equilibrium of the generalized Blotto game. Particularly, for cyclic-dominance-heterogeneous (CDH) robots that inhibit each other, we define a new transformation rule between any two robot types. Building on the transformation, we design a novel utility function to measure the game's outcome quantitatively. Moreover, we rigorously prove the correctness of the designed utility function. Finally, we conduct extensive simulations to demonstrate the effectiveness of DOA on computing Nash equilibrium for homogeneous, linear heterogeneous, and CDH robot allocation on graphs. △ Less

Submitted 18 December, 2023; originally announced December 2023.

Fine-Tuning InstructPix2Pix for Advanced Image Colorization

Authors: Zifeng An, Zi**g Xu, Eric Fan, Qi Cao

Abstract: This paper presents a novel approach to human image colorization by fine-tuning the InstructPix2Pix model, which integrates a language model (GPT-3) with a text-to-image model (Stable Diffusion). Despite the original InstructPix2Pix model's proficiency in editing images based on textual instructions, it exhibits limitations in the focused domain of colorization. To address this, we fine-tuned the… ▽ More This paper presents a novel approach to human image colorization by fine-tuning the InstructPix2Pix model, which integrates a language model (GPT-3) with a text-to-image model (Stable Diffusion). Despite the original InstructPix2Pix model's proficiency in editing images based on textual instructions, it exhibits limitations in the focused domain of colorization. To address this, we fine-tuned the model using the IMDB-WIKI dataset, pairing black-and-white images with a diverse set of colorization prompts generated by ChatGPT. This paper contributes by (1) applying fine-tuning techniques to stable diffusion models specifically for colorization tasks, and (2) employing generative models to create varied conditioning prompts. After finetuning, our model outperforms the original InstructPix2Pix model on multiple metrics quantitatively, and we produce more realistically colored images qualitatively. The code for this project is provided on the GitHub Repository https://github.com/AllenAnZifeng/DeepLearning282. △ Less

Submitted 7 December, 2023; originally announced December 2023.

Evaluation of flamelet-based models for liquid ammonia combustion in a temporally evolving mixing layer

Authors: Zhenhua An, Jiangkuan Xing, Abhishek Lakshman Pillai, Ryoichi Kurose

Abstract: Liquid ammonia combustion can be enhanced by co-firing with small molecular fuels such as methane, and liquid ammonia will undergo flash evaporation due to its relatively low saturation pressure. These characteristics, involving the presence of multiple fuel streams, a rapid phase change process, and strong heat loss, pose challenges for flamelet modeling of liquid ammonia combustion. To address t… ▽ More Liquid ammonia combustion can be enhanced by co-firing with small molecular fuels such as methane, and liquid ammonia will undergo flash evaporation due to its relatively low saturation pressure. These characteristics, involving the presence of multiple fuel streams, a rapid phase change process, and strong heat loss, pose challenges for flamelet modeling of liquid ammonia combustion. To address these issues, this study aims to evaluate the effectiveness of flamelet-based models for liquid ammonia combustion in a turbulent mixing layer. Specifically, the extended flamelet/progress variable (E-FPV), extended flamelet-generated manifolds (E-FGM), and extended hybrid (E-Hybrid) models are developed and assessed. Firstly, a three-dimensional Point-Particle Direct Numerical Simulation (PP-DNS) with detailed chemistry is performed, where the turbulent flow is fully resolved, and the ammonia droplets are described by the Lagrangian method, to investigate the combustion characteristics of a liquid ammonia/methane co-fired flame and to provide state-of-the-art validation data for flamelet modeling. The PP-DNS results reveal distinct stages in the liquid ammonia/methane co-fired flame. The phase change process introduces significant heat loss due to the high latent heat of liquid ammonia. Subsequently, flamelet-based models are developed to account for the complex fuel streams, rapid phase change process, and strong local heat loss. The performance of these models is evaluated through a priori analysis by comparing the predictions with the PP-DNS results. The a priori results show that the E-FGM model outperforms the E-FPV and E-Hybrid models. This superior performance can be attributed to the rapid flash evaporation and sufficient mixing of the superheated ammonia, resulting in the dominance of the premixed combustion mode in liquid ammonia combustion. △ Less

Submitted 4 December, 2023; originally announced December 2023.

A Step Closer to Comprehensive Answers: Constrained Multi-Stage Question Decomposition with Large Language Models

Authors: He**g Cao, Zhenwei An, Jiazhan Feng, Kun Xu, Liwei Chen, Dongyan Zhao

Abstract: While large language models exhibit remarkable performance in the Question Answering task, they are susceptible to hallucinations. Challenges arise when these models grapple with understanding multi-hop relations in complex questions or lack the necessary knowledge for a comprehensive response. To address this issue, we introduce the "Decompose-and-Query" framework (D&Q). This framework guides the… ▽ More While large language models exhibit remarkable performance in the Question Answering task, they are susceptible to hallucinations. Challenges arise when these models grapple with understanding multi-hop relations in complex questions or lack the necessary knowledge for a comprehensive response. To address this issue, we introduce the "Decompose-and-Query" framework (D&Q). This framework guides the model to think and utilize external knowledge similar to ReAct, while also restricting its thinking to reliable information, effectively mitigating the risk of hallucinations. Experiments confirm the effectiveness of D&Q: On our ChitChatQA dataset, D&Q does not lose to ChatGPT in 67% of cases; on the HotPotQA question-only setting, D&Q achieved an F1 score of 59.6%. Our code is available at https://github.com/alkaidpku/DQ-ToolQA. △ Less

Submitted 13 November, 2023; originally announced November 2023.

Observation of GRB 221009A early afterglow in X/$γ$-ray energy band

Authors: Chao Zheng, Yan-Qiu Zhang, Shao-Lin Xiong, Cheng-Kui Li, He Gao, Wang-Chen Xue, Jia-Cong Liu, Chen-Wei Wang, Wen-Jun Tan, Wen-Xi Peng, Zheng-Hua An, Ce Cai, Ming-Yu Ge, Dong-Ya Guo, Yue Huang, Bing Li, Ti-Pei Li, Xiao-Bo Li, Xin-Qiao Li, Xu-Fang Li, **-Yuan Liao, Cong-Zhan Liu, Fang-Jun Lu, Xiang Ma, Rui Qiao , et al. (23 additional authors not shown)

Abstract: The early afterglow of a Gamma-ray burst (GRB) can provide critical information on the jet and progenitor of the GRB. The extreme brightness of GRB 221009A allows us to probe its early afterglow in unprecedented detail. In this letter, we report comprehensive observation results of the early afterglow of GRB 221009A (from $T_0$+660 s to $T_0$+1860 s, where $T_0$ is the \textit{Insight}-HXMT/HE tri… ▽ More The early afterglow of a Gamma-ray burst (GRB) can provide critical information on the jet and progenitor of the GRB. The extreme brightness of GRB 221009A allows us to probe its early afterglow in unprecedented detail. In this letter, we report comprehensive observation results of the early afterglow of GRB 221009A (from $T_0$+660 s to $T_0$+1860 s, where $T_0$ is the \textit{Insight}-HXMT/HE trigger time) in X/$γ$-ray energy band (from 20 keV to 20 MeV) by \textit{Insight}-HXMT/HE, GECAM-C and \textit{Fermi}/GBM. We find that the spectrum of the early afterglow in 20 keV-20 MeV could be well described by a cutoff power-law with an extra power-law which dominates the low and high energy bands respectively. The cutoff power-law $E_{\rm peak}$ is $\sim$ 30 keV and the power-law photon index is $\sim$ 1.8 throughout the early afterglow phase. By fitting the light curves in different energy bands, we find that a significant achromatic break (from keV to TeV) is required at $T_0$ + 1246$^{+27}_{-26}$ s (i.e. 1021 s since the afterglow starting time $T_{\rm AG}$=$T_0$+225 s), providing compelling evidence of a jet break. Interestingly, both the pre-break and post-break decay slopes vary with energy, and these two slopes become closer in the lower energy band, making the break less identifiable. Intriguingly, the spectrum of the early afterglow experienced a slight hardening before the break and a softening after the break. These results provide new insights into the understanding of this remarkable GRB. △ Less

Submitted 19 January, 2024; v1 submitted 16 October, 2023; originally announced October 2023.

Comments: Accepted for publication in ApJ Letters on 19-Jan-2024, 11 pages, 7 figures and 2 tables

Evidence of mini-jet emission in a large emission zone from a magnetically-dominated gamma-ray burst jet

Authors: S. -X. Yi, C. -W. Wang, X. -Y. Shao, R. Moradi, H. Gao, B. Zhang, S. -L. Xiong, S. -N. Zhang, W. -J. Tan, J. -C. Liu, W. -C. Xue, Y. -Q. Zhang, C. Zheng, Y. Wang, P. Zhang, Z. -H. An, C. Cai, P. -Y. Feng, K. Gong, D. -Y. Guo, Y. Huang, B. Li, X. -B. Li, X. -Q. Li, X. -J. Liu , et al. (21 additional authors not shown)

Abstract: The second brightest GRB in history, GRB230307A provides an ideal laboratory to study the details of GRB prompt emission thanks to its extraordinarily high photon statistics and its single broad pulse overall shape characterized by an energy-dependent fast-rise-exponential-decay (FRED) profile. Here we demonstrate that its broad pulse is composed of many rapidly variable short pulses, rather than… ▽ More The second brightest GRB in history, GRB230307A provides an ideal laboratory to study the details of GRB prompt emission thanks to its extraordinarily high photon statistics and its single broad pulse overall shape characterized by an energy-dependent fast-rise-exponential-decay (FRED) profile. Here we demonstrate that its broad pulse is composed of many rapidly variable short pulses, rather than being the superposition of many short pulses on top of a slow component. Such a feature is consistent with the picture of many mini-jets due to local magnetic reconnection events in a large emission zone far from the GRB central engine, as envisaged in the internal-collision-induced magnetic reconnection and turbulence (ICMART) model, but raises a great challenge to the internal shock models that attribute all variability components to collisions among different shells. Since relativistic mini-jets demand strong magnetization in the outflow, this work provides strong evidence for a Poynting-flux-dominated jet composition of this bright GRB. △ Less

Submitted 16 March, 2024; v1 submitted 11 October, 2023; originally announced October 2023.

Comments: 7 pages and 2 figures in the main text. 27 pages and 9 figures in total

E2Net: Resource-Efficient Continual Learning with Elastic Expansion Network

Authors: RuiQi Liu, Boyu Diao, Libo Huang, Zhulin An, Yongjun Xu

Abstract: Continual Learning methods are designed to learn new tasks without erasing previous knowledge. However, Continual Learning often requires massive computational power and storage capacity for satisfactory performance. In this paper, we propose a resource-efficient continual learning method called the Elastic Expansion Network (E2Net). Leveraging core subnet distillation and precise replay sample se… ▽ More Continual Learning methods are designed to learn new tasks without erasing previous knowledge. However, Continual Learning often requires massive computational power and storage capacity for satisfactory performance. In this paper, we propose a resource-efficient continual learning method called the Elastic Expansion Network (E2Net). Leveraging core subnet distillation and precise replay sample selection, E2Net achieves superior average accuracy and diminished forgetting within the same computational and storage constraints, all while minimizing processing time. In E2Net, we propose Representative Network Distillation to identify the representative core subnet by assessing parameter quantity and output similarity with the working network, distilling analogous subnets within the working network to mitigate reliance on rehearsal buffers and facilitating knowledge transfer across previous tasks. To enhance storage resource utilization, we then propose Subnet Constraint Experience Replay to optimize rehearsal efficiency through a sample storage strategy based on the structures of representative networks. Extensive experiments conducted predominantly on cloud environments with diverse datasets and also spanning the edge environment demonstrate that E2Net consistently outperforms state-of-the-art methods. In addition, our method outperforms competitors in terms of both storage and computational requirements. △ Less

Submitted 27 September, 2023; originally announced September 2023.

Temporal-aware Hierarchical Mask Classification for Video Semantic Segmentation

Authors: Zhaochong An, Guolei Sun, Zongwei Wu, Hao Tang, Luc Van Gool

Abstract: Modern approaches have proved the huge potential of addressing semantic segmentation as a mask classification task which is widely used in instance-level segmentation. This paradigm trains models by assigning part of object queries to ground truths via conventional one-to-one matching. However, we observe that the popular video semantic segmentation (VSS) dataset has limited categories per video,… ▽ More Modern approaches have proved the huge potential of addressing semantic segmentation as a mask classification task which is widely used in instance-level segmentation. This paradigm trains models by assigning part of object queries to ground truths via conventional one-to-one matching. However, we observe that the popular video semantic segmentation (VSS) dataset has limited categories per video, meaning less than 10% of queries could be matched to receive meaningful gradient updates during VSS training. This inefficiency limits the full expressive potential of all queries.Thus, we present a novel solution THE-Mask for VSS, which introduces temporal-aware hierarchical object queries for the first time. Specifically, we propose to use a simple two-round matching mechanism to involve more queries matched with minimal cost during training while without any extra cost during inference. To support our more-to-one assignment, in terms of the matching results, we further design a hierarchical loss to train queries with their corresponding hierarchy of primary or secondary. Moreover, to effectively capture temporal information across frames, we propose a temporal aggregation decoder that fits seamlessly into the mask-classification paradigm for VSS. Utilizing temporal-sensitive multi-level queries, our method achieves state-of-the-art performance on the latest challenging VSS benchmark VSPW without bells and whistles. △ Less

Submitted 14 September, 2023; originally announced September 2023.

Comments: BMVC 2023

Calibration of the Timing Performance of GECAM-C

Authors: Shuo Xiao, Ya-Qing Liu, Ke Gong, Zheng-Hua An, Shao-Lin Xiong, Xin-Qiao Li, Xiang-Yang Wen, Wen-Xi Peng, Da-Li Zhang, You-Li Tuo, Shi-Jie Zheng, Li-Ming Song, ** Wang, Xiao-Yun Zhao, Yue Huang, Xiang Ma, Xiao-**g Liu, Rui Qiao, Yan-Bing Xu, Sheng Yang, Fan Zhang, Yue Wang, Yan-Qiu Zhang, Wang-Chen Xue, Jia-Cong Liu , et al. (13 additional authors not shown)

Abstract: As a new member of the Gravitational wave high-energy Electromagnetic Counterpart All-sky Monitor (GECAM) after GECAM-A and GECAM-B, GECAM-C (originally called HEBS), which was launched on board the SATech-01 satellite on July 27, 2022, aims to monitor and localize X-ray and gamma-ray transients from $\sim$ 6 keV to 6 MeV. GECAM-C utilizes a similar design to GECAM but operates in a more complex o… ▽ More As a new member of the Gravitational wave high-energy Electromagnetic Counterpart All-sky Monitor (GECAM) after GECAM-A and GECAM-B, GECAM-C (originally called HEBS), which was launched on board the SATech-01 satellite on July 27, 2022, aims to monitor and localize X-ray and gamma-ray transients from $\sim$ 6 keV to 6 MeV. GECAM-C utilizes a similar design to GECAM but operates in a more complex orbital environment. In this work, we utilize the secondary particles simultaneously produced by the cosmic-ray events on orbit and recorded by multiple detectors, to calibrate the relative timing accuracy between all detectors of GECAM-C. We find the result is 0.1 $μ\rm s$, which is the highest time resolution among all GRB detectors ever flown and very helpful in timing analyses such as minimum variable timescale and spectral lags, as well as in time delay localization. Besides, we calibrate the absolute time accuracy using the one-year Crab pulsar data observed by GECAM-C and Fermi/GBM, as well as GECAM-C and GECAM-B. The results are $2.02\pm 2.26\ μ\rm s$ and $5.82\pm 3.59\ μ\rm s$, respectively. Finally, we investigate the spectral lag between the different energy bands of Crab pulsar observed by GECAM and GBM, which is $\sim -0.2\ {\rm μs\ keV^{-1}}$. △ Less

Submitted 22 August, 2023; originally announced August 2023.

Comments: submitted

EduSAT: A Pedagogical Tool for Theory and Applications of Boolean Satisfiability

Authors: Yiqi Zhao, Ziyan An, Meiyi Ma, Taylor Johnson

Abstract: Boolean Satisfiability (SAT) and Satisfiability Modulo Theories (SMT) are widely used in automated verification, but there is a lack of interactive tools designed for educational purposes in this field. To address this gap, we present EduSAT, a pedagogical tool specifically developed to support learning and understanding of SAT and SMT solving. EduSAT offers implementations of key algorithms such… ▽ More Boolean Satisfiability (SAT) and Satisfiability Modulo Theories (SMT) are widely used in automated verification, but there is a lack of interactive tools designed for educational purposes in this field. To address this gap, we present EduSAT, a pedagogical tool specifically developed to support learning and understanding of SAT and SMT solving. EduSAT offers implementations of key algorithms such as the Davis-Putnam-Logemann-Loveland (DPLL) algorithm and the Reduced Order Binary Decision Diagram (ROBDD) for SAT solving. Additionally, EduSAT provides solver abstractions for five NP-complete problems beyond SAT and SMT. Users can benefit from EduSAT by experimenting, analyzing, and validating their understanding of SAT and SMT solving techniques. Our tool is accompanied by comprehensive documentation and tutorials, extensive testing, and practical features such as a natural language interface and SAT and SMT formula generators, which also serve as a valuable opportunity for learners to deepen their understanding. Our evaluation of EduSAT demonstrates its high accuracy, achieving 100% correctness across all the implemented SAT and SMT solvers. We release EduSAT as a python package in .whl file, and the source can be identified at https://github.com/zhaoy37/SAT_Solver. △ Less

Submitted 15 August, 2023; originally announced August 2023.

Recent developments in comprehensive analytical instruments for the culture heritage objects-A review

Authors: Yuanjun Xu, Zhu An, Ning Huang, Peng Wang, Ze He, Zihan Chen

Abstract: This paper introduces the necessity and significance of the investigation of cultural heritage objects. The multi-technique method is useful for the study of cultural heritage objects, but a comprehensive analytical instrument is a better choice since it can guarantee that different types of information are always obtained from the same analytical point on the surface of cultural heritage objects,… ▽ More This paper introduces the necessity and significance of the investigation of cultural heritage objects. The multi-technique method is useful for the study of cultural heritage objects, but a comprehensive analytical instrument is a better choice since it can guarantee that different types of information are always obtained from the same analytical point on the surface of cultural heritage objects, which may be crucial for some situations. Thus, the X-ray fluorescence (XRF)/X-ray diffraction (XRD) and X-ray fluorescence (XRF)/Raman spectroscopy (RS) comprehensive analytical instruments are more and more widely used to study cultural heritage objects. The two types of comprehensive analytical instruments are discussed in detail and the XRF/XRD instruments are further classified into different types on the basis of structure, type and number of detectors. A new comprehensive analytical instrument prototype that can perform XRF, XRD and RS measurements simultaneously has been successfully developed by our team and the preliminary application has shown the analysis performance and application potential. This overview contributes to better understand the research progress and development tendency of comprehensive analytical instruments for the study of cultural heritage objects. The new comprehensive instruments will make researchers obtain more valuable information on cultural heritage objects and further promote the study on cultural heritage objects. △ Less

Submitted 13 August, 2023; originally announced August 2023.

Local density of states above a disk -- geometrical vs. thermal boundary conditions

Authors: Svend-Age Biehs, Achim Kittel, Zhenghua An

Abstract: We analytically calculate the contribution to the local density of states due to thermal sources in a disk-like patch within the framework of fluctuational electrodynamics. We further introduce a wavevector cutoff method to approximate this contribution. We compare the results obtained with the source and cutoff method with the numerical exact LDOS above a metal disk attained by SCUFF-EM calculati… ▽ More We analytically calculate the contribution to the local density of states due to thermal sources in a disk-like patch within the framework of fluctuational electrodynamics. We further introduce a wavevector cutoff method to approximate this contribution. We compare the results obtained with the source and cutoff method with the numerical exact LDOS above a metal disk attained by SCUFF-EM calculations. By this comparison we highlight the difference and resemblance of thermal and geometrical boundary conditions which are both relevant for near-field scanning microscope measurements. Finally, we give an outlook to general lateral temperature profiles and compare it with surface profiles. △ Less

Submitted 25 July, 2023; originally announced July 2023.

Journal ref: J. Appl. Phys. 134, 043102(2023)

CLIP-KD: An Empirical Study of CLIP Model Distillation

Authors: Chuanguang Yang, Zhulin An, Libo Huang, Junyu Bi, Xinqiang Yu, Han Yang, Boyu Diao, Yongjun Xu

Abstract: Contrastive Language-Image Pre-training (CLIP) has become a promising language-supervised visual pre-training framework. This paper aims to distill small CLIP models supervised by a large teacher CLIP model. We propose several distillation strategies, including relation, feature, gradient and contrastive paradigms, to examine the effectiveness of CLIP-Knowledge Distillation (KD). We show that a si… ▽ More Contrastive Language-Image Pre-training (CLIP) has become a promising language-supervised visual pre-training framework. This paper aims to distill small CLIP models supervised by a large teacher CLIP model. We propose several distillation strategies, including relation, feature, gradient and contrastive paradigms, to examine the effectiveness of CLIP-Knowledge Distillation (KD). We show that a simple feature mimicry with Mean Squared Error loss works surprisingly well. Moreover, interactive contrastive learning across teacher and student encoders is also effective in performance improvement. We explain that the success of CLIP-KD can be attributed to maximizing the feature similarity between teacher and student. The unified method is applied to distill several student models trained on CC3M+12M. CLIP-KD improves student CLIP models consistently over zero-shot ImageNet classification and cross-modal retrieval benchmarks. When using ViT-L/14 pretrained on Laion-400M as the teacher, CLIP-KD achieves 57.5\% and 55.4\% zero-shot top-1 ImageNet accuracy over ViT-B/16 and ResNet-50, surpassing the original CLIP without KD by 20.5\% and 20.1\% margins, respectively. Our code is released on https://github.com/winycg/CLIP-KD. △ Less

Submitted 7 May, 2024; v1 submitted 24 July, 2023; originally announced July 2023.

Comments: CVPR-2024

The Minimum Variation Timescales of X-ray bursts from SGR J1935+2154

Authors: Shuo Xiao, Jiao-Jiao Yang, Xi-Hong Luo, Shao-Lin Xiong, Yuan-Hong Qu, Shuang-Nan Zhang, Wang-Chen Xue, Xiao-Bo Li, You-Li Tuo, Ai-Jun Dong, Ru-Shuang Zhao, Shi-Jun Dang, Lun-Hua Shang, Qing-Bo Ma, Ce Cai, ** Wang, ** Wang, Cheng-Kui Li, Shu-Xu Yi, Zhen Zhang, Ming-Yu Ge, Shi-Jie Zheng, Li-Ming Song, Wen-Xi Peng, Xiang-Yang Wen , et al. (12 additional authors not shown)

Abstract: The minimum variation timescale (MVT) of soft gamma-ray repeaters can be an important probe to estimate the emission region in pulsar-like models, as well as the Lorentz factor and radius of the possible relativistic jet in gamma-ray burst (GRB)-like models, thus revealing their progenitors and physical mechanisms. In this work, we systematically study the MVTs of hundreds of X-ray bursts (XRBs) f… ▽ More The minimum variation timescale (MVT) of soft gamma-ray repeaters can be an important probe to estimate the emission region in pulsar-like models, as well as the Lorentz factor and radius of the possible relativistic jet in gamma-ray burst (GRB)-like models, thus revealing their progenitors and physical mechanisms. In this work, we systematically study the MVTs of hundreds of X-ray bursts (XRBs) from SGR J1935+2154 observed by {\it Insight}-HXMT, GECAM and Fermi/GBM from July 2014 to Jan 2022 through the Bayesian Block algorithm. We find that the MVTs peak at $\sim$ 2 ms, corresponding to a light travel time size of about 600 km, which supports the magnetospheric origin in pulsar-like models. The shock radius and the Lorentz factor of the jet are also constrained in GRB-like models. Interestingly, the MVT of the XRB associated with FRB 200428 is $\sim$ 70 ms, which is longer than that of most bursts and implies its special radiation mechanism. Besides, the median of MVTs is 7 ms, shorter than the median MVTs of 40 ms and 480 ms for short GRBs or long GRBs, respectively. However, the MVT is independent of duration, similar to GRBs. Finally, we investigate the energy dependence of MVT and suggest that there is a marginal evidence for a power-law relationship like GRBs but the rate of variation is at least about an order of magnitude smaller. These features may provide an approach to identify bursts with a magnetar origin. △ Less

Submitted 13 July, 2023; originally announced July 2023.

Comments: accepted for publication in ApJS

Magnetar emergence in a peculiar gamma-ray burst from a compact star merger

Authors: H. Sun, C. -W. Wang, J. Yang, B. -B. Zhang, S. -L. Xiong, Y. -H. I. Yin, Y. Liu, Y. Li, W. -C. Xue, Z. Yan, C. Zhang, W. -J. Tan, H. -W. Pan, J. -C. Liu, H. -Q. Cheng, Y. -Q. Zhang, J. -W. Hu, C. Zheng, Z. -H. An, C. Cai, L. Hu, C. **, D. -Y. Li, X. -Q. Li, H. -Y. Liu , et al. (19 additional authors not shown)

Abstract: The central engine that powers gamma-ray bursts (GRBs), the most powerful explosions in the universe, is still not identified. Besides hyper-accreting black holes, rapidly spinning and highly magnetized neutron stars, known as millisecond magnetars, have been suggested to power both long and short GRBs. The presence of a magnetar engine following compact star mergers is of particular interest as i… ▽ More The central engine that powers gamma-ray bursts (GRBs), the most powerful explosions in the universe, is still not identified. Besides hyper-accreting black holes, rapidly spinning and highly magnetized neutron stars, known as millisecond magnetars, have been suggested to power both long and short GRBs. The presence of a magnetar engine following compact star mergers is of particular interest as it would provide essential constraints on the poorly understood equation of state for neutron stars. Indirect indications of a magnetar engine in these merger sources have been observed in the form of plateau features present in the X-ray afterglow light curves of some short GRBs. Additionally, some X-ray transients lacking gamma-ray bursts (GRB-less) have been identified as potential magnetar candidates originating from compact star mergers. Nevertheless, smoking gun evidence is still lacking for a magnetar engine in short GRBs, and the associated theoretical challenges have been addressed. Here we present a comprehensive analysis of the broad-band prompt emission data of a peculiar, very bright GRB 230307A. Despite its apparently long duration, the prompt emission and host galaxy properties point toward a compact star merger origin, being consistent with its association with a kilonova. More intriguingly, an extended X-ray emission component emerges as the $γ$-ray emission dies out, signifying the emergence of a magnetar central engine. We also identify an achromatic temporal break in the high-energy band during the prompt emission phase, which was never observed in previous bursts and reveals a narrow jet with half opening angle of approximately $3.4^\circ$. △ Less

Submitted 11 July, 2023; originally announced July 2023.

Comments: 44 pages, 10 figures, 5 tables

Categories of Response-Based, Feature-Based, and Relation-Based Knowledge Distillation

Authors: Chuanguang Yang, Xinqiang Yu, Zhulin An, Yongjun Xu

Abstract: Deep neural networks have achieved remarkable performance for artificial intelligence tasks. The success behind intelligent systems often relies on large-scale models with high computational complexity and storage costs. The over-parameterized networks are often easy to optimize and can achieve better performance. However, it is challenging to deploy them over resource-limited edge-devices. Knowle… ▽ More Deep neural networks have achieved remarkable performance for artificial intelligence tasks. The success behind intelligent systems often relies on large-scale models with high computational complexity and storage costs. The over-parameterized networks are often easy to optimize and can achieve better performance. However, it is challenging to deploy them over resource-limited edge-devices. Knowledge Distillation (KD) aims to optimize a lightweight network from the perspective of over-parameterized training. The traditional offline KD transfers knowledge from a cumbersome teacher to a small and fast student network. When a sizeable pre-trained teacher network is unavailable, online KD can improve a group of models by collaborative or mutual learning. Without needing extra models, Self-KD boosts the network itself using attached auxiliary architectures. KD mainly involves knowledge extraction and distillation strategies these two aspects. Beyond KD schemes, various KD algorithms are widely used in practical applications, such as multi-teacher KD, cross-modal KD, attention-based KD, data-free KD and adversarial KD. This paper provides a comprehensive KD survey, including knowledge categories, distillation schemes and algorithms, as well as some empirical studies on performance comparison. Finally, we discuss the open challenges of existing KD works and prospect the future directions. △ Less

Submitted 18 June, 2023; originally announced June 2023.

Comments: Published at Springer book "Advancements in Knowledge Distillation: Towards New Horizons of Intelligent Systems"

The First GECAM Observation Results on Terrestrial Gamma-ray Flashes and Terrestrial Electron Beams

Authors: Y. Zhao, J. C. Liu, S. L. Xiong, W. C. Xue, Q. B. Yi, G. P. Lu, W. Xu, F. C. Lyu, J. C. Sun, W. X. Peng, C. Zheng, Y. Q. Zhang, C. Cai, S. Xiao, S. L. Xie, C. W. Wang, W. J. Tan, Z. H. An, G. Chen, Y. Q. Du, Y. Huang, M. Gao, K. Gong, D. Y. Guo, J. J. He , et al. (37 additional authors not shown)

Abstract: Gravitational-wave high-energy Electromagnetic Counterpart All-sky Monitor (GECAM) is a space-borne instrument dedicated to monitoring high-energy transients, including Terrestrial Gamma-ray Flashes (TGFs) and Terrestrial Electron Beams (TEBs). We implemented a TGF/TEB search algorithm for GECAM, with which 147 bright TGFs, 2 typical TEBs and 2 special TEB-like events are identified during an effe… ▽ More Gravitational-wave high-energy Electromagnetic Counterpart All-sky Monitor (GECAM) is a space-borne instrument dedicated to monitoring high-energy transients, including Terrestrial Gamma-ray Flashes (TGFs) and Terrestrial Electron Beams (TEBs). We implemented a TGF/TEB search algorithm for GECAM, with which 147 bright TGFs, 2 typical TEBs and 2 special TEB-like events are identified during an effective observation time of $\sim$9 months. We show that, with gamma-ray and charged particle detectors, GECAM can effectively identify and distinguish TGFs and TEBs, and measure their temporal and spectral properties in detail. A very high TGF-lightning association rate of $\sim$80\% is obtained between GECAM and GLD360 in east Asia region. △ Less

Submitted 17 June, 2023; originally announced June 2023.

Comments: The paper was accepted by Geophysical Research Letters on June 16th, 2023

Team AcieLee: Technical Report for EPIC-SOUNDS Audio-Based Interaction Recognition Challenge 2023

Authors: Yuqi Li, Yizhi Luo, Xiaoshuai Hao, Chuanguang Yang, Zhulin An, Dantong Song, Wei Yi

Abstract: In this report, we describe the technical details of our submission to the EPIC-SOUNDS Audio-Based Interaction Recognition Challenge 2023, by Team "AcieLee" (username: Yuqi\_Li). The task is to classify the audio caused by interactions between objects, or from events of the camera wearer. We conducted exhaustive experiments and found learning rate step decay, backbone frozen, label smoothing and f… ▽ More In this report, we describe the technical details of our submission to the EPIC-SOUNDS Audio-Based Interaction Recognition Challenge 2023, by Team "AcieLee" (username: Yuqi\_Li). The task is to classify the audio caused by interactions between objects, or from events of the camera wearer. We conducted exhaustive experiments and found learning rate step decay, backbone frozen, label smoothing and focal loss contribute most to the performance improvement. After training, we combined multiple models from different stages and integrated them into a single model by assigning fusion weights. This proposed method allowed us to achieve 3rd place in the CVPR 2023 workshop of EPIC-SOUNDS Audio-Based Interaction Recognition Challenge. △ Less

Submitted 15 June, 2023; originally announced June 2023.

Multi-Agent Reinforcement Learning Guided by Signal Temporal Logic Specifications

Authors: Jiangwei Wang, Shuo Yang, Ziyan An, Songyang Han, Zhili Zhang, Rahul Mangharam, Meiyi Ma, Fei Miao

Abstract: Reward design is a key component of deep reinforcement learning, yet some tasks and designer's objectives may be unnatural to define as a scalar cost function. Among the various techniques, formal methods integrated with DRL have garnered considerable attention due to their expressiveness and flexibility to define the reward and requirements for different states and actions of the agent. However,… ▽ More Reward design is a key component of deep reinforcement learning, yet some tasks and designer's objectives may be unnatural to define as a scalar cost function. Among the various techniques, formal methods integrated with DRL have garnered considerable attention due to their expressiveness and flexibility to define the reward and requirements for different states and actions of the agent. However, how to leverage Signal Temporal Logic (STL) to guide multi-agent reinforcement learning reward design remains unexplored. Complex interactions, heterogeneous goals and critical safety requirements in multi-agent systems make this problem even more challenging. In this paper, we propose a novel STL-guided multi-agent reinforcement learning framework. The STL requirements are designed to include both task specifications according to the objective of each agent and safety specifications, and the robustness values of the STL specifications are leveraged to generate rewards. We validate the advantages of our method through empirical studies. The experimental results demonstrate significant reward performance improvements compared to MARL without STL guidance, along with a remarkable increase in the overall safety rate of the multi-agent systems. △ Less

Submitted 22 October, 2023; v1 submitted 11 June, 2023; originally announced June 2023.

Modeling Dual Period-Varying Preferences for Takeaway Recommendation

Authors: Yuting Zhang, Yiqing Wu, Ran Le, Yongchun Zhu, Fuzhen Zhuang, Ruidong Han, Xiang Li, Wei Lin, Zhulin An, Yongjun Xu

Abstract: Takeaway recommender systems, which aim to accurately provide stores that offer foods meeting users' interests, have served billions of users in our daily life. Different from traditional recommendation, takeaway recommendation faces two main challenges: (1) Dual Interaction-Aware Preference Modeling. Traditional recommendation commonly focuses on users' single preferences for items while takeaway… ▽ More Takeaway recommender systems, which aim to accurately provide stores that offer foods meeting users' interests, have served billions of users in our daily life. Different from traditional recommendation, takeaway recommendation faces two main challenges: (1) Dual Interaction-Aware Preference Modeling. Traditional recommendation commonly focuses on users' single preferences for items while takeaway recommendation needs to comprehensively consider users' dual preferences for stores and foods. (2) Period-Varying Preference Modeling. Conventional recommendation generally models continuous changes in users' preferences from a session-level or day-level perspective. However, in practical takeaway systems, users' preferences vary significantly during the morning, noon, night, and late night periods of the day. To address these challenges, we propose a Dual Period-Varying Preference modeling (DPVP) for takeaway recommendation. Specifically, we design a dual interaction-aware module, aiming to capture users' dual preferences based on their interactions with stores and foods. Moreover, to model various preferences in different time periods of the day, we propose a time-based decomposition module as well as a time-aware gating mechanism. Extensive offline and online experiments demonstrate that our model outperforms state-of-the-art methods on real-world datasets and it is capable of modeling the dual period-varying preferences. Moreover, our model has been deployed online on Meituan Takeaway platform, leading to an average improvement in GMV (Gross Merchandise Value) of 0.70%. △ Less

Submitted 16 June, 2023; v1 submitted 7 June, 2023; originally announced June 2023.

Comments: accepted by KDD (The 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining) 2023 Applied Data Science (ADS) track

BEDRF: Bidirectional Edge Diffraction Response Function for Interactive Sound Propagation

Authors: Chunxiao Cao, Zili An, Zhong Ren, Dinesh Manocha, Kun Zhou

Abstract: We introduce bidirectional edge diffraction response function (BEDRF), a new approach to model wave diffraction around edges with path tracing. The diffraction part of the wave is expressed as an integration on path space, and the wave-edge interaction is expressed using only the localized information around points on the edge similar to a bidirectional scattering distribution function (BSDF) for… ▽ More We introduce bidirectional edge diffraction response function (BEDRF), a new approach to model wave diffraction around edges with path tracing. The diffraction part of the wave is expressed as an integration on path space, and the wave-edge interaction is expressed using only the localized information around points on the edge similar to a bidirectional scattering distribution function (BSDF) for visual rendering. For an infinite single wedge, our model generates the same result as the analytic solution. Our approach can be easily integrated into interactive geometric sound propagation algorithms that use path tracing to compute specular and diffuse reflections. Our resulting propagation algorithm can approximate complex wave propagation phenomena involving high-order diffraction, and is able to handle dynamic, deformable objects and moving sources and listeners. We highlight the performance of our approach in different scenarios to generate smooth auralization. △ Less

Submitted 2 June, 2023; originally announced June 2023.

CIF-PT: Bridging Speech and Text Representations for Spoken Language Understanding via Continuous Integrate-and-Fire Pre-Training

Authors: Linhao Dong, Zhecheng An, Peihao Wu, Jun Zhang, Lu Lu, Zejun Ma

Abstract: Speech or text representation generated by pre-trained models contains modal-specific information that could be combined for benefiting spoken language understanding (SLU) tasks. In this work, we propose a novel pre-training paradigm termed Continuous Integrate-and-Fire Pre-Training (CIF-PT). It relies on a simple but effective frame-to-token alignment: continuous integrate-and-fire (CIF) to bridg… ▽ More Speech or text representation generated by pre-trained models contains modal-specific information that could be combined for benefiting spoken language understanding (SLU) tasks. In this work, we propose a novel pre-training paradigm termed Continuous Integrate-and-Fire Pre-Training (CIF-PT). It relies on a simple but effective frame-to-token alignment: continuous integrate-and-fire (CIF) to bridge the representations between speech and text. It jointly performs speech-to-text training and language model distillation through CIF as the pre-training (PT). Evaluated on SLU benchmark SLURP dataset, CIF-PT outperforms the state-of-the-art model by 1.94% of accuracy and 2.71% of SLU-F1 on the tasks of intent classification and slot filling, respectively. We also observe the cross-modal representation extracted by CIF-PT obtains better performance than other neural interfaces for the tasks of SLU, including the dominant speech representation learned from self-supervised pre-training. △ Less

Submitted 27 May, 2023; originally announced May 2023.

Comments: Accepted by ACL 2023 Findings