-
What is Learned in Knowledge Graph Embeddings?
Authors:
Michael R. Douglas,
Michael Simkin,
Omri Ben-Eliezer,
Tianqi Wu,
Peter Chin,
Trung V. Dang,
Andrew Wood
Abstract:
A knowledge graph (KG) is a data structure which represents entities and relations as the vertices and edges of a directed graph with edge types. KGs are an important primitive in modern machine learning and artificial intelligence. Embedding-based models, such as the seminal TransE [Bordes et al., 2013] and the recent PairRE [Chao et al., 2020] are among the most popular and successful approaches…
▽ More
A knowledge graph (KG) is a data structure which represents entities and relations as the vertices and edges of a directed graph with edge types. KGs are an important primitive in modern machine learning and artificial intelligence. Embedding-based models, such as the seminal TransE [Bordes et al., 2013] and the recent PairRE [Chao et al., 2020] are among the most popular and successful approaches for representing KGs and inferring missing edges (link completion). Their relative success is often credited in the literature to their ability to learn logical rules between the relations.
In this work, we investigate whether learning rules between relations is indeed what drives the performance of embedding-based methods. We define motif learning and two alternative mechanisms, network learning (based only on the connectivity of the KG, ignoring the relation types), and unstructured statistical learning (ignoring the connectivity of the graph). Using experiments on synthetic KGs, we show that KG models can learn motifs and how this ability is degraded by non-motif (noise) edges. We propose tests to distinguish the contributions of the three mechanisms to performance, and apply them to popular KG benchmarks. We also discuss an issue with the standard performance testing protocol and suggest an improvement.
To appear in the proceedings of Complex Networks 2021.
△ Less
Submitted 19 October, 2021;
originally announced October 2021.
-
Noise-robust classification with hypergraph neural network
Authors:
Nguyen Trinh Vu Dang,
Loc Tran,
Linh Tran
Abstract:
This paper presents a novel version of the hypergraph neural network method. This method is utilized to solve the noisy label learning problem. First, we apply the PCA dimensional reduction technique to the feature matrices of the image datasets in order to reduce the "noise" and the redundant features in the feature matrices of the image datasets and to reduce the runtime constructing the hypergr…
▽ More
This paper presents a novel version of the hypergraph neural network method. This method is utilized to solve the noisy label learning problem. First, we apply the PCA dimensional reduction technique to the feature matrices of the image datasets in order to reduce the "noise" and the redundant features in the feature matrices of the image datasets and to reduce the runtime constructing the hypergraph of the hypergraph neural network method. Then, the classic graph-based semi-supervised learning method, the classic hypergraph based semi-supervised learning method, the graph neural network, the hypergraph neural network, and our proposed hypergraph neural network are employed to solve the noisy label learning problem. The accuracies of these five methods are evaluated and compared. Experimental results show that the hypergraph neural network methods achieve the best performance when the noise level increases. Moreover, the hypergraph neural network methods are at least as good as the graph neural network.
△ Less
Submitted 3 September, 2022; v1 submitted 3 February, 2021;
originally announced February 2021.
-
Stability analysis of event-triggered anytime control with multiple control laws
Authors:
Thuy V. Dang,
K. V. Ling,
D. E. Quevedo
Abstract:
To deal with time-varying processor availability and lossy communication channels in embedded and networked control systems, one can employ an event-triggered sequence-based anytime control (E-SAC) algorithm. The main idea of E-SAC is, when computing resources and measurements are available, to compute a sequence of tentative control inputs and store them in a buffer for potential future use. Stat…
▽ More
To deal with time-varying processor availability and lossy communication channels in embedded and networked control systems, one can employ an event-triggered sequence-based anytime control (E-SAC) algorithm. The main idea of E-SAC is, when computing resources and measurements are available, to compute a sequence of tentative control inputs and store them in a buffer for potential future use. State-dependent Random-time Drift (SRD) approach is often used to analyse and establish stability properties of such E-SAC algorithms. However, using SRD, the analysis quickly becomes combinatoric and hence difficult to extend to more sophisticated E-SAC. In this technical note, we develop a general model and a new stability analysis for E-SAC based on Markov jump systems. Using the new stability analysis, stochastic stability conditions of existing E-SAC are also recovered. In addition, the proposed technique systematically extends to a more sophisticated E-SAC scheme for which, until now, no analytical expression had been obtained.
△ Less
Submitted 20 April, 2018;
originally announced April 2018.
