Showing 1–7 of 7 results for author: Huo, G

G-SAP: Graph-based Structure-Aware Prompt Learning over Heterogeneous Knowledge for Commonsense Reasoning

Authors: Ruiting Dai, Yuqiao Tan, Lisi Mo, Shuang Liang, Guohao Huo, Jiayi Luo, Yao Cheng

Abstract: Commonsense question answering has demonstrated considerable potential across various applications like assistants and social robots. Although fully fine-tuned pre-trained Language Models(LM) have achieved remarkable performance in commonsense reasoning, their tendency to excessively prioritize textual information hampers the precise transfer of structural knowledge and undermines interpretability… ▽ More Commonsense question answering has demonstrated considerable potential across various applications like assistants and social robots. Although fully fine-tuned pre-trained Language Models(LM) have achieved remarkable performance in commonsense reasoning, their tendency to excessively prioritize textual information hampers the precise transfer of structural knowledge and undermines interpretability. Some studies have explored combining LMs with Knowledge Graphs(KGs) by coarsely fusing the two modalities to perform Graph Neural Network(GNN)-based reasoning that lacks a profound interaction between heterogeneous modalities. In this paper, we propose a novel Graph-based Structure-Aware Prompt Learning Model for commonsense reasoning, named G-SAP, aiming to maintain a balance between heterogeneous knowledge and enhance the cross-modal interaction within the LM+GNNs model. In particular, an evidence graph is constructed by integrating multiple knowledge sources, i.e. ConceptNet, Wikipedia, and Cambridge Dictionary to boost the performance. Afterward, a structure-aware frozen PLM is employed to fully incorporate the structured and textual information from the evidence graph, where the generation of prompts is driven by graph entities and relations. Finally, a heterogeneous message-passing reasoning module is used to facilitate deep interaction of knowledge between the LM and graph-based networks. Empirical validation, conducted through extensive experiments on three benchmark datasets, demonstrates the notable performance of the proposed model. The results reveal a significant advancement over the existing models, especially, with 6.12% improvement over the SoTA LM+GNNs model on the OpenbookQA dataset. △ Less

Submitted 9 May, 2024; originally announced May 2024.

Data-driven discovery and extrapolation of parameterized pattern-forming dynamics

Authors: Zachary G. Nicolaou, Guanyu Huo, Yihui Chen, Steven L. Brunton, J. Nathan Kutz

Abstract: Pattern-forming systems can exhibit a diverse array of complex behaviors as external parameters are varied, enabling a variety of useful functions in biological and engineered systems. First-principles derivations of the underlying transitions can be characterized using bifurcation theory on model systems whose governing equations are known. In contrast, data-driven methods for more complicated an… ▽ More Pattern-forming systems can exhibit a diverse array of complex behaviors as external parameters are varied, enabling a variety of useful functions in biological and engineered systems. First-principles derivations of the underlying transitions can be characterized using bifurcation theory on model systems whose governing equations are known. In contrast, data-driven methods for more complicated and realistic systems whose governing evolution dynamics are unknown have only recently been developed. Here we develop a data-driven approach, the {\em sparse identification for nonlinear dynamics with control parameters} (SINDyCP), to discover dynamics for systems with adjustable control parameters, such as an external driving strength. We demonstrate the method on systems of varying complexity, ranging from discrete maps to systems of partial differential equations. To mitigate the impact of measurement noise, we also develop a weak formulation of SINDyCP and assess its performance on noisy data. We demonstrate applications including the discovery of universal pattern-formation equations, and their bifurcation dependencies, directly from data accessible from experiments and the extrapolation of predictions beyond the weakly nonlinear regime near the onset of an instability. △ Less

Submitted 16 November, 2023; v1 submitted 6 January, 2023; originally announced January 2023.

Comments: 6 pages, 4 figures, plus supplement

Journal ref: Phys. Rev. Research 5, L042017 (2023)

A novel feed rate scheduling method based on Sigmoid function with chord error and kinematics constraints

Authors: Hexiong Li, Xin Jiang, Guanying Huo, Cheng Su, Bolun Wang, Yifei Hu, Zhiming Zheng

Abstract: In high speed CNC (Compute Numerical Control) machining, the feed rate scheduling has played an important role to ensure machining quality and machining efficiency. In this paper, a novel feed rate scheduling method is proposed for generating smooth feed rate profile conveniently with the consideration of both geometric error and kinematic error. First, a relationship between feed rate value and c… ▽ More In high speed CNC (Compute Numerical Control) machining, the feed rate scheduling has played an important role to ensure machining quality and machining efficiency. In this paper, a novel feed rate scheduling method is proposed for generating smooth feed rate profile conveniently with the consideration of both geometric error and kinematic error. First, a relationship between feed rate value and chord error is applied to determine the feed rate curve. Then, breaking points, which can split whole curve into several blocks, can be found out using proposed two step screening method. For every block, a feed rate profile based on the Sigmoid function is generated. With the consideration of kinematic limitation and machining efficiency, a time-optimal feed rate adjustment algorithm is proposed to further adjust feed rate value at breaking points. After planning feed rate profile for each block, all blocks feed rate profile will be connected smoothly. The resulting feed rate profile is more concise compared with the polynomial profile and more efficient compared with the trigonometric profile. Finally, simulations with two free-form NURBS curves are conducted and comparison with the sine-curve method are carried out to verify the feasibility and applicability of the proposed method. △ Less

Submitted 12 May, 2021; originally announced May 2021.

A novel S-shape based NURBS interpolation with acc-jerk- Continuity and round-off error elimination

Authors: Yifei Hu, Xin Jiang, Guanying Huo, Cheng Su, Bolun Wang, Hexiong Li, Zhiming Zheng

Abstract: Feedrate scheduling is a key step in computer numerical control (CNC) machining, as it has a close relationship with machining time and surface quality, and has now become a hot issue in industry and academia. To reduce high chord errors and round-off errors, and generate continuous velocity, acceleration, and jerk profile of parametric interpolation, a novel and complete S-shape based feedrate sc… ▽ More Feedrate scheduling is a key step in computer numerical control (CNC) machining, as it has a close relationship with machining time and surface quality, and has now become a hot issue in industry and academia. To reduce high chord errors and round-off errors, and generate continuous velocity, acceleration, and jerk profile of parametric interpolation, a novel and complete S-shape based feedrate scheduling algorithm is presented in this paper. The algorithm consists of three modules: bidirectional scanning module, velocity scheduling module and round-off error elimination module. The bidirectional scanning module with the limitations of chord error, normal acceleration/jerk and command feedrate aims to guarantee the continuity of the feed rate at the junctions between successive NURBS sub-curves. After the NURBS sub-curves have been classified into two cases, the velocity scheduling module firstly calculates the actual maximum federate, and then generates the feed rate profiles of all NURBS sub-curves according to our velocity scheduling function. Later, the round-off error elimination module is proposed to make the total interpolating time become an integer multiple of the interpolation period, which leads to the elimination of round-off errors. Finally, benchmarks are conducted to verify the applicability of the proposed method compared with some other methods. △ Less

Submitted 26 March, 2021; originally announced March 2021.

Key-Point Interpolation: A Sparse Data Interpolation Algorithm based on B-splines

Authors: Bolun Wang, Xin Jiang, Guanying Huo, Cheng Su, Dongming Yan, Zhiming Zheng

Abstract: B-splines are widely used in the fields of reverse engineering and computer-aided design, due to their superior properties. Traditional B-spline surface interpolation algorithms usually assume regularity of the data distribution. In this paper, we introduce a novel B-spline surface interpolation algorithm: KPI, which can interpolate sparsely and non-uniformly distributed data points. As a two-stag… ▽ More B-splines are widely used in the fields of reverse engineering and computer-aided design, due to their superior properties. Traditional B-spline surface interpolation algorithms usually assume regularity of the data distribution. In this paper, we introduce a novel B-spline surface interpolation algorithm: KPI, which can interpolate sparsely and non-uniformly distributed data points. As a two-stage algorithm, our method generates the dataset out of the sparse data using Kriging, and uses the proposed KPI (Key-Point Interpolation) method to generate the control points. Our algorithm can be extended to higher dimensional data interpolation, such as reconstructing dynamic surfaces. We apply the method to interpolating the temperature of Shanxi Province. The generated dynamic surface accurately interpolates the temperature data provided by the weather stations, and the preserved dynamic characteristics can be useful for meteorology studies. △ Less

Submitted 10 November, 2021; v1 submitted 21 March, 2021; originally announced March 2021.

Journal ref: J. Phys.: Conf. Ser. 2068 012010 (2021)

CaEGCN: Cross-Attention Fusion based Enhanced Graph Convolutional Network for Clustering

Authors: Guangyu Huo, Yong Zhang, Junbin Gao, Boyue Wang, Yongli Hu, Baocai Yin

Abstract: With the powerful learning ability of deep convolutional networks, deep clustering methods can extract the most discriminative information from individual data and produce more satisfactory clustering results. However, existing deep clustering methods usually ignore the relationship between the data. Fortunately, the graph convolutional network can handle such relationship, opening up a new resear… ▽ More With the powerful learning ability of deep convolutional networks, deep clustering methods can extract the most discriminative information from individual data and produce more satisfactory clustering results. However, existing deep clustering methods usually ignore the relationship between the data. Fortunately, the graph convolutional network can handle such relationship, opening up a new research direction for deep clustering. In this paper, we propose a cross-attention based deep clustering framework, named Cross-Attention Fusion based Enhanced Graph Convolutional Network (CaEGCN), which contains four main modules: the cross-attention fusion module which innovatively concatenates the Content Auto-encoder module (CAE) relating to the individual data and Graph Convolutional Auto-encoder module (GAE) relating to the relationship between the data in a layer-by-layer manner, and the self-supervised model that highlights the discriminative information for clustering tasks. While the cross-attention fusion module fuses two kinds of heterogeneous representation, the CAE module supplements the content information for the GAE module, which avoids the over-smoothing problem of GCN. In the GAE module, two novel loss functions are proposed that reconstruct the content and relationship between the data, respectively. Finally, the self-supervised module constrains the distributions of the middle layer representations of CAE and GAE to be consistent. Experimental results on different types of datasets prove the superiority and robustness of the proposed CaEGCN. △ Less

Submitted 18 January, 2021; originally announced January 2021.

Journal ref: IEEE Transactions on Knowledge and Data Engineering 2021

High detection efficiency silicon single-photon detector with a monolithic integrated circuit of active quenching and active reset

Authors: Yu-Qiang Fang, Kai Luo, Xing-Guo Gao, Gai-Qing Huo, Ang Zhong, Peng-Fei Liao, Pu Pu, Xiao-Hui Bao, Yu-Ao Chen, Jun Zhang, Jian-Wei Pan

Abstract: Silicon single-photon detectors (SPDs) are key devices for detecting single photons in the visible wavelength range. Photon detection efficiency (PDE) is one of the most important parameters of silicon SPDs, and increasing PDE is highly required for many applications. Here, we present a practical approach to increase PDE of silicon SPD with a monolithic integrated circuit of active quenching and a… ▽ More Silicon single-photon detectors (SPDs) are key devices for detecting single photons in the visible wavelength range. Photon detection efficiency (PDE) is one of the most important parameters of silicon SPDs, and increasing PDE is highly required for many applications. Here, we present a practical approach to increase PDE of silicon SPD with a monolithic integrated circuit of active quenching and active reset (AQAR). The AQAR integrated circuit is specifically designed for thick silicon single-photon avalanche diode (SPAD) with high breakdown voltage (250-450 V), and then fabricated via the process of high-voltage 0.35-$μ$m bipolarCMOS-DMOS. The AQAR integrated circuit implements the maximum transition voltage of ~ 68 V with 30 ns quenching time and 10 ns reset time, which can easily boost PDE to the upper limit by regulating the excess bias up to a high enough level. By using the AQAR integrated circuit, we design and characterize two SPDs with the SPADs disassembled from commercial products of single-photon counting modules (SPCMs). Compared with the original SPCMs, the PDE values are increased from 68.3% to 73.7% and 69.5% to 75.1% at 785 nm, respectively, with moderate increases of dark count rate and afterpulse probability. Our approach can effectively improve the performance of the practical applications requiring silicon SPDs. △ Less

Submitted 18 November, 2020; originally announced November 2020.

Comments: 6 pages, 4 figures, accepted for publication in Review of Scientific Instruments

Journal ref: Rev. Sci. Instrum. 91, 123106 (2020)