-
Do Similar Entities have Similar Embeddings?
Authors:
Nicolas Hubert,
Heiko Paulheim,
Armelle Brun,
Davy Monticolo
Abstract:
Knowledge graph embedding models (KGEMs) developed for link prediction learn vector representations for entities in a knowledge graph, known as embeddings. A common tacit assumption is the KGE entity similarity assumption, which states that these KGEMs retain the graph's structure within their embedding space, \textit{i.e.}, position similar entities within the graph close to one another. This des…
▽ More
Knowledge graph embedding models (KGEMs) developed for link prediction learn vector representations for entities in a knowledge graph, known as embeddings. A common tacit assumption is the KGE entity similarity assumption, which states that these KGEMs retain the graph's structure within their embedding space, \textit{i.e.}, position similar entities within the graph close to one another. This desirable property make KGEMs widely used in downstream tasks such as recommender systems or drug repurposing. Yet, the relation of entity similarity and similarity in the embedding space has rarely been formally evaluated. Typically, KGEMs are assessed based on their sole link prediction capabilities, using ranked-based metrics such as Hits@K or Mean Rank. This paper challenges the prevailing assumption that entity similarity in the graph is inherently mirrored in the embedding space. Therefore, we conduct extensive experiments to measure the capability of KGEMs to cluster similar entities together, and investigate the nature of the underlying factors. Moreover, we study if different KGEMs expose a different notion of similarity. Datasets, pre-trained embeddings and code are available at: https://github.com/nicolas-hbt/similar-embeddings/.
△ Less
Submitted 28 March, 2024; v1 submitted 16 December, 2023;
originally announced December 2023.
-
Beyond Transduction: A Survey on Inductive, Few Shot, and Zero Shot Link Prediction in Knowledge Graphs
Authors:
Nicolas Hubert,
Pierre Monnin,
Heiko Paulheim
Abstract:
Knowledge graphs (KGs) comprise entities interconnected by relations of different semantic meanings. KGs are being used in a wide range of applications. However, they inherently suffer from incompleteness, i.e. entities or facts about entities are missing. Consequently, a larger body of works focuses on the completion of missing information in KGs, which is commonly referred to as link prediction…
▽ More
Knowledge graphs (KGs) comprise entities interconnected by relations of different semantic meanings. KGs are being used in a wide range of applications. However, they inherently suffer from incompleteness, i.e. entities or facts about entities are missing. Consequently, a larger body of works focuses on the completion of missing information in KGs, which is commonly referred to as link prediction (LP). This task has traditionally and extensively been studied in the transductive setting, where all entities and relations in the testing set are observed during training. Recently, several works have tackled the LP task under more challenging settings, where entities and relations in the test set may be unobserved during training, or appear in only a few facts. These works are known as inductive, few-shot, and zero-shot link prediction. In this work, we conduct a systematic review of existing works in this area. A thorough analysis leads us to point out the undesirable existence of diverging terminologies and task definitions for the aforementioned settings, which further limits the possibility of comparison between recent works. We consequently aim at dissecting each setting thoroughly, attempting to reveal its intrinsic characteristics. A unifying nomenclature is ultimately proposed to refer to each of them in a simple and consistent manner.
△ Less
Submitted 8 December, 2023;
originally announced December 2023.
-
PyGraft: Configurable Generation of Synthetic Schemas and Knowledge Graphs at Your Fingertips
Authors:
Nicolas Hubert,
Pierre Monnin,
Mathieu d'Aquin,
Davy Monticolo,
Armelle Brun
Abstract:
Knowledge graphs (KGs) have emerged as a prominent data representation and management paradigm. Being usually underpinned by a schema (e.g., an ontology), KGs capture not only factual information but also contextual knowledge. In some tasks, a few KGs established themselves as standard benchmarks. However, recent works outline that relying on a limited collection of datasets is not sufficient to a…
▽ More
Knowledge graphs (KGs) have emerged as a prominent data representation and management paradigm. Being usually underpinned by a schema (e.g., an ontology), KGs capture not only factual information but also contextual knowledge. In some tasks, a few KGs established themselves as standard benchmarks. However, recent works outline that relying on a limited collection of datasets is not sufficient to assess the generalization capability of an approach. In some data-sensitive fields such as education or medicine, access to public datasets is even more limited. To remedy the aforementioned issues, we release PyGraft, a Python-based tool that generates highly customized, domain-agnostic schemas and KGs. The synthesized schemas encompass various RDFS and OWL constructs, while the synthesized KGs emulate the characteristics and scale of real-world KGs. Logical consistency of the generated resources is ultimately ensured by running a description logic (DL) reasoner. By providing a way of generating both a schema and KG in a single pipeline, PyGraft's aim is to empower the generation of a more diverse array of KGs for benchmarking novel approaches in areas such as graph-based machine learning (ML), or more generally KG processing. In graph-based ML in particular, this should foster a more holistic evaluation of model performance and generalization capability, thereby going beyond the limited collection of available benchmarks. PyGraft is available at: https://github.com/nicolas-hbt/pygraft.
△ Less
Submitted 5 March, 2024; v1 submitted 7 September, 2023;
originally announced September 2023.
-
Schema First! Learn Versatile Knowledge Graph Embeddings by Capturing Semantics with MASCHInE
Authors:
Nicolas Hubert,
Heiko Paulheim,
Pierre Monnin,
Armelle Brun,
Davy Monticolo
Abstract:
Knowledge graph embedding models (KGEMs) have gained considerable traction in recent years. These models learn a vector representation of knowledge graph entities and relations, a.k.a. knowledge graph embeddings (KGEs). Learning versatile KGEs is desirable as it makes them useful for a broad range of tasks. However, KGEMs are usually trained for a specific task, which makes their embeddings task-d…
▽ More
Knowledge graph embedding models (KGEMs) have gained considerable traction in recent years. These models learn a vector representation of knowledge graph entities and relations, a.k.a. knowledge graph embeddings (KGEs). Learning versatile KGEs is desirable as it makes them useful for a broad range of tasks. However, KGEMs are usually trained for a specific task, which makes their embeddings task-dependent. In parallel, the widespread assumption that KGEMs actually create a semantic representation of the underlying entities and relations (e.g., project similar entities closer than dissimilar ones) has been challenged. In this work, we design heuristics for generating protographs -- small, modified versions of a KG that leverage RDF/S information. The learnt protograph-based embeddings are meant to encapsulate the semantics of a KG, and can be leveraged in learning KGEs that, in turn, also better capture semantics. Extensive experiments on various evaluation benchmarks demonstrate the soundness of this approach, which we call Modular and Agnostic SCHema-based Integration of protograph Embeddings (MASCHInE). In particular, MASCHInE helps produce more versatile KGEs that yield substantially better performance for entity clustering and node classification tasks. For link prediction, using MASCHinE substantially increases the number of semantically valid predictions with equivalent rank-based performance.
△ Less
Submitted 19 October, 2023; v1 submitted 6 June, 2023;
originally announced June 2023.
-
Treat Different Negatives Differently: Enriching Loss Functions with Domain and Range Constraints for Link Prediction
Authors:
Nicolas Hubert,
Pierre Monnin,
Armelle Brun,
Davy Monticolo
Abstract:
Knowledge graph embedding models (KGEMs) are used for various tasks related to knowledge graphs (KGs), including link prediction. They are trained with loss functions that consider batches of true and false triples. However, different kinds of false triples exist and recent works suggest that they should not be valued equally, leading to specific negative sampling procedures. In line with this rec…
▽ More
Knowledge graph embedding models (KGEMs) are used for various tasks related to knowledge graphs (KGs), including link prediction. They are trained with loss functions that consider batches of true and false triples. However, different kinds of false triples exist and recent works suggest that they should not be valued equally, leading to specific negative sampling procedures. In line with this recent assumption, we posit that negative triples that are semantically valid w.r.t. signatures of relations (domain and range) are high-quality negatives. Hence, we enrich the three main loss functions for link prediction such that all kinds of negatives are sampled but treated differently based on their semantic validity. In an extensive and controlled experimental setting, we show that the proposed loss functions systematically provide satisfying results which demonstrates both the generality and superiority of our proposed approach. In fact, the proposed loss functions (1) lead to better MRR and Hits@10 values, and (2) drive KGEMs towards better semantic correctness as measured by the Sem@K metric. This highlights that relation signatures globally improve KGEMs, and thus should be incorporated into loss functions. Domains and ranges of relations being largely available in schema-defined KGs, this makes our approach both beneficial and widely usable in practice.
△ Less
Submitted 5 March, 2024; v1 submitted 1 March, 2023;
originally announced March 2023.
-
Sem@$K$: Is my knowledge graph embedding model semantic-aware?
Authors:
Nicolas Hubert,
Pierre Monnin,
Armelle Brun,
Davy Monticolo
Abstract:
Using knowledge graph embedding models (KGEMs) is a popular approach for predicting links in knowledge graphs (KGs). Traditionally, the performance of KGEMs for link prediction is assessed using rank-based metrics, which evaluate their ability to give high scores to ground-truth entities. However, the literature claims that the KGEM evaluation procedure would benefit from adding supplementary dime…
▽ More
Using knowledge graph embedding models (KGEMs) is a popular approach for predicting links in knowledge graphs (KGs). Traditionally, the performance of KGEMs for link prediction is assessed using rank-based metrics, which evaluate their ability to give high scores to ground-truth entities. However, the literature claims that the KGEM evaluation procedure would benefit from adding supplementary dimensions to assess. That is why, in this paper, we extend our previously introduced metric Sem@K that measures the capability of models to predict valid entities w.r.t. domain and range constraints. In particular, we consider a broad range of KGs and take their respective characteristics into account to propose different versions of Sem@K. We also perform an extensive study to qualify the abilities of KGEMs as measured by our metric. Our experiments show that Sem@K provides a new perspective on KGEM quality. Its joint analysis with rank-based metrics offers different conclusions on the predictive power of models. Regarding Sem@K, some KGEMs are inherently better than others, but this semantic superiority is not indicative of their performance w.r.t. rank-based metrics. In this work, we generalize conclusions about the relative performance of KGEMs w.r.t. rank-based and semantic-oriented metrics at the level of families of models. The joint analysis of the aforementioned metrics gives more insight into the peculiarities of each model. This work paves the way for a more comprehensive evaluation of KGEM adequacy for specific downstream tasks.
△ Less
Submitted 7 December, 2023; v1 submitted 13 January, 2023;
originally announced January 2023.
-
Coherent Terahertz synchrotron radiation mastered by controlling the irregular dynamics of relativistic electron bunches
Authors:
C. Evain,
C. Szwaj,
E. Roussel,
J. Rodriguez,
M. Le Parquier,
M. -A. Tordeux,
F. Ribeiro,
M. Labat,
N. Hubert,
J. -B. Brubach,
P. Roy,
S. Bielawski
Abstract:
Spontaneous formation of spatial structures (patterns) occurs in various contexts, ranging from sand dunes and rogue wave formation, to traffic jams. These last decades, very practical reasons also led to studies of pattern formation in relativistic electron bunches used in synchrotron radiation light sources. As the main motivation, the patterns which spontaneously appear during an instability in…
▽ More
Spontaneous formation of spatial structures (patterns) occurs in various contexts, ranging from sand dunes and rogue wave formation, to traffic jams. These last decades, very practical reasons also led to studies of pattern formation in relativistic electron bunches used in synchrotron radiation light sources. As the main motivation, the patterns which spontaneously appear during an instability increase the terahertz radiation power by factors exceeding 10000. However the irregularity of these patterns largely prevented applications of this powerful source. Here we show how to make the spatio-temporal patterns regular (and thus the emitted THz power) using a point of view borrowed from chaos control theory. Mathematically, regular unstable solutions are expected to coexist with the undesired irregular solutions, and may thus be controllable using feedback control. We demonstrate the stabilization of such regular solutions in the Synchrotron SOLEIL storage ring. Operation of these "controlled unstable solutions" enables new designs of high charge and stable synchrotron radiation sources.
△ Less
Submitted 28 October, 2018;
originally announced October 2018.
-
Electron and photon diagnostics for plasma acceleration based FELs
Authors:
Marie Labat,
Moussa El Ajjouri,
Nicolas Hubert,
Thomas Andre Thomas,
Alexandre Loulergue,
Marie-Emmanuelle Couprie
Abstract:
It is now well established that laser plasma acceleration (LPA) is an innovative and good candidate in the beam acceleration field. Relativistic beams are indeed produced up to several GeV but their quality remains to be demonstrated in the highly demanding case of Free Electron Lasers (FELs). Several experiments already showed the feasibility of synchrotron radiation delivery based on a LPA but f…
▽ More
It is now well established that laser plasma acceleration (LPA) is an innovative and good candidate in the beam acceleration field. Relativistic beams are indeed produced up to several GeV but their quality remains to be demonstrated in the highly demanding case of Free Electron Lasers (FELs). Several experiments already showed the feasibility of synchrotron radiation delivery based on a LPA but free electron lasing has still to be achieved. Since the quality of the LPA beam inside the undulator is the critical issue, any LPA based FEL experiment requires a refined characterization of the beam properties along the transport line and of the photon beam at the undulator exit. This characterization relies on diagnostics which must be adapted to the LPA specificities. We will review the electron and photon diagnostics already used on LPAs and required for LPA based FELs, and illustrate the critical points using recent experiments performed around the world.
△ Less
Submitted 15 June, 2017;
originally announced June 2017.
