-
Toxic Memes: A Survey of Computational Perspectives on the Detection and Explanation of Meme Toxicities
Authors:
Delfina Sol Martinez Pandiani,
Erik Tjong Kim Sang,
Davide Ceolin
Abstract:
Internet memes, channels for humor, social commentary, and cultural expression, are increasingly used to spread toxic messages. Studies on the computational analyses of toxic memes have significantly grown over the past five years, and the only three surveys on computational toxic meme analysis cover only work published until 2022, leading to inconsistent terminology and unexplored trends. Our wor…
▽ More
Internet memes, channels for humor, social commentary, and cultural expression, are increasingly used to spread toxic messages. Studies on the computational analyses of toxic memes have significantly grown over the past five years, and the only three surveys on computational toxic meme analysis cover only work published until 2022, leading to inconsistent terminology and unexplored trends. Our work fills this gap by surveying content-based computational perspectives on toxic memes, and reviewing key developments until early 2024. Employing the PRISMA methodology, we systematically extend the previously considered papers, achieving a threefold result. First, we survey 119 new papers, analyzing 158 computational works focused on content-based toxic meme analysis. We identify over 30 datasets used in toxic meme analysis and examine their labeling systems. Second, after observing the existence of unclear definitions of meme toxicity in computational works, we introduce a new taxonomy for categorizing meme toxicity types. We also note an expansion in computational tasks beyond the simple binary classification of memes as toxic or non-toxic, indicating a shift towards achieving a nuanced comprehension of toxicity. Third, we identify three content-based dimensions of meme toxicity under automatic study: target, intent, and conveyance tactics. We develop a framework illustrating the relationships between these dimensions and meme toxicities. The survey analyzes key challenges and recent trends, such as enhanced cross-modal reasoning, integrating expert and cultural knowledge, the demand for automatic toxicity explanations, and handling meme toxicity in low-resource languages. Also, it notes the rising use of Large Language Models (LLMs) and generative AI for detecting and generating toxic memes. Finally, it proposes pathways for advancing toxic meme detection and interpretation.
△ Less
Submitted 11 June, 2024;
originally announced June 2024.
-
Nanopublication-Based Semantic Publishing and Reviewing: A Field Study with Formalization Papers
Authors:
Cristina-Iulia Bucur,
Tobias Kuhn,
Davide Ceolin,
Jacco van Ossenbruggen
Abstract:
With the rapidly increasing amount of scientific literature,it is getting continuously more difficult for researchers in different disciplines to be updated with the recent findings in their field of study.Processing scientific articles in an automated fashion has been proposed as a solution to this problem,but the accuracy of such processing remains very poor for extraction tasks beyond the basic…
▽ More
With the rapidly increasing amount of scientific literature,it is getting continuously more difficult for researchers in different disciplines to be updated with the recent findings in their field of study.Processing scientific articles in an automated fashion has been proposed as a solution to this problem,but the accuracy of such processing remains very poor for extraction tasks beyond the basic ones.Few approaches have tried to change how we publish scientific results in the first place,by making articles machine-interpretable by expressing them with formal semantics from the start.In the work presented here,we set out to demonstrate that we can formally publish high-level scientific claims in formal logic,and publish the results in a special issue of an existing journal.We use the concept and technology of nanopublications for this endeavor,and represent not just the submissions and final papers in this RDF-based format,but also the whole process in between,including reviews,responses,and decisions.We do this by performing a field study with what we call formalization papers,which contribute a novel formalization of a previously published claim.We received 15 submissions from 18 authors,who then went through the whole publication process leading to the publication of their contributions in the special issue.Our evaluation shows the technical and practical feasibility of our approach.The participating authors mostly showed high levels of interest and confidence,and mostly experienced the process as not very difficult,despite the technical nature of the current user interfaces.We believe that these results indicate that it is possible to publish scientific results from different fields with machine-interpretable semantics from the start,which in turn opens countless possibilities to radically improve in the future the effectiveness and efficiency of the scientific endeavor as a whole.
△ Less
Submitted 3 March, 2022;
originally announced March 2022.
-
Expressing High-Level Scientific Claims with Formal Semantics
Authors:
Cristina-Iulia Bucur,
Tobias Kuhn,
Davide Ceolin,
Jacco van Ossenbruggen
Abstract:
The use of semantic technologies is gaining significant traction in science communication with a wide array of applications in disciplines including the Life Sciences, Computer Science, and the Social Sciences. Languages like RDF, OWL, and other formalisms based on formal logic are applied to make scientific knowledge accessible not only to human readers but also to automated systems. These approa…
▽ More
The use of semantic technologies is gaining significant traction in science communication with a wide array of applications in disciplines including the Life Sciences, Computer Science, and the Social Sciences. Languages like RDF, OWL, and other formalisms based on formal logic are applied to make scientific knowledge accessible not only to human readers but also to automated systems. These approaches have mostly focused on the structure of scientific publications themselves, on the used scientific methods and equipment, or on the structure of the used datasets. The core claims or hypotheses of scientific work have only been covered in a shallow manner, such as by linking mentioned entities to established identifiers. In this research, we therefore want to find out whether we can use existing semantic formalisms to fully express the content of high-level scientific claims using formal semantics in a systematic way. Analyzing the main claims from a sample of scientific articles from all disciplines, we find that their semantics are more complex than what a straight-forward application of formalisms like RDF or OWL account for, but we managed to elicit a clear semantic pattern which we call the 'super-pattern'. We show here how the instantiation of the five slots of this super-pattern leads to a strictly defined statement in higher-order logic. We successfully applied this super-pattern to an enlarged sample of scientific claims. We show that knowledge representation experts, when instructed to independently instantiate the super-pattern with given scientific claims, show a high degree of consistency and convergence given the complexity of the task and the subject. These results therefore open the door for expressing high-level scientific findings in a manner they can be automatically interpreted, which on the longer run can allow us to do automated consistency checking, and much more.
△ Less
Submitted 29 October, 2021; v1 submitted 27 September, 2021;
originally announced September 2021.
-
The Many Dimensions of Truthfulness: Crowdsourcing Misinformation Assessments on a Multidimensional Scale
Authors:
Michael Soprano,
Kevin Roitero,
David La Barbera,
Davide Ceolin,
Damiano Spina,
Stefano Mizzaro,
Gianluca Demartini
Abstract:
Recent work has demonstrated the viability of using crowdsourcing as a tool for evaluating the truthfulness of public statements. Under certain conditions such as: (1) having a balanced set of workers with different backgrounds and cognitive abilities; (2) using an adequate set of mechanisms to control the quality of the collected data; and (3) using a coarse grained assessment scale, the crowd ca…
▽ More
Recent work has demonstrated the viability of using crowdsourcing as a tool for evaluating the truthfulness of public statements. Under certain conditions such as: (1) having a balanced set of workers with different backgrounds and cognitive abilities; (2) using an adequate set of mechanisms to control the quality of the collected data; and (3) using a coarse grained assessment scale, the crowd can provide reliable identification of fake news. However, fake news are a subtle matter: statements can be just biased ("cherrypicked"), imprecise, wrong, etc. and the unidimensional truth scale used in existing work cannot account for such differences. In this paper we propose a multidimensional notion of truthfulness and we ask the crowd workers to assess seven different dimensions of truthfulness selected based on existing literature: Correctness, Neutrality, Comprehensibility, Precision, Completeness, Speaker's Trustworthiness, and Informativeness. We deploy a set of quality control mechanisms to ensure that the thousands of assessments collected on 180 publicly available fact-checked statements distributed over two datasets are of adequate quality, including a custom search engine used by the crowd workers to find web pages supporting their truthfulness assessments. A comprehensive analysis of crowdsourced judgments shows that: (1) the crowdsourced assessments are reliable when compared to an expert-provided gold standard; (2) the proposed dimensions of truthfulness capture independent pieces of information; (3) the crowdsourcing task can be easily learned by the workers; and (4) the resulting assessments provide a useful basis for a more complete estimation of statement truthfulness.
△ Less
Submitted 23 August, 2021; v1 submitted 2 August, 2021;
originally announced August 2021.
-
A Unified Nanopublication Model for Effective and User-Friendly Access to the Elements of Scientific Publishing
Authors:
Cristina-Iulia Bucur,
Tobias Kuhn,
Davide Ceolin
Abstract:
Scientific publishing is the means by which we communicate and share scientific knowledge, but this process currently often lacks transparency and machine-interpretable representations. Scientific articles are published in long coarse-grained text with complicated structures, and they are optimized for human readers and not for automated means of organization and access. Peer reviewing is the main…
▽ More
Scientific publishing is the means by which we communicate and share scientific knowledge, but this process currently often lacks transparency and machine-interpretable representations. Scientific articles are published in long coarse-grained text with complicated structures, and they are optimized for human readers and not for automated means of organization and access. Peer reviewing is the main method of quality assessment, but these peer reviews are nowadays rarely published and their own complicated structure and linking to the respective articles is not accessible. In order to address these problems and to better align scientific publishing with the principles of the Web and Linked Data, we propose here an approach to use nanopublications as a unifying model to represent in a semantic way the elements of publications, their assessments, as well as the involved processes, actors, and provenance in general. To evaluate our approach, we present a dataset of 627 nanopublications representing an interlinked network of the elements of articles (such as individual paragraphs) and their reviews (such as individual review comments). Focusing on the specific scenario of editors performing a meta-review, we introduce seven competency questions and show how they can be executed as SPARQL queries. We then present a prototype of a user interface for that scenario that shows different views on the set of review comments provided for a given manuscript, and we show in a user study that editors find the interface useful to answer their competency questions. In summary, we demonstrate that a unified and semantic publication model based on nanopublications can make scientific communication more effective and user-friendly.
△ Less
Submitted 11 June, 2020;
originally announced June 2020.
-
Peer Reviewing Revisited: Assessing Research with Interlinked Semantic Comments
Authors:
Cristina-Iulia Bucur,
Tobias Kuhn,
Davide Ceolin
Abstract:
Scientific publishing seems to be at a turning point. Its paradigm has stayed basically the same for 300 years but is now challenged by the increasing volume of articles that makes it very hard for scientists to stay up to date in their respective fields. In fact, many have pointed out serious flaws of current scientific publishing practices, including the lack of accuracy and efficiency of the re…
▽ More
Scientific publishing seems to be at a turning point. Its paradigm has stayed basically the same for 300 years but is now challenged by the increasing volume of articles that makes it very hard for scientists to stay up to date in their respective fields. In fact, many have pointed out serious flaws of current scientific publishing practices, including the lack of accuracy and efficiency of the reviewing process. To address some of these problems, we apply here the general principles of the Web and the Semantic Web to scientific publishing, focusing on the reviewing process. We want to determine if a fine-grained model of the scientific publishing workflow can help us make the reviewing processes better organized and more accurate, by ensuring that review comments are created with formal links and semantics from the start. Our contributions include a novel model called Linkflows that allows for such detailed and semantically rich representations of reviews and the reviewing processes. We evaluate our approach on a manually curated dataset from several recent Computer Science journals and conferences that come with open peer reviews. We gathered ground-truth data by contacting the original reviewers and asking them to categorize their own review comments according to our model. Comparing this ground truth to answers provided by model experts, peers, and automated techniques confirms that our approach of formally capturing the reviewers' intentions from the start prevents substantial discrepancies compared to when this information is later extracted from the plain-text comments. In general, our analysis shows that our model is well understood and easy to apply, and it revealed the semantic properties of such review comments.
△ Less
Submitted 8 October, 2019;
originally announced October 2019.
-
HAXPES for materials science at the GALAXIES beamline
Authors:
J. -P. Rueff,
J. E. Rault,
J. M. Ablett,
Y. Utsumi,
D. Céolin
Abstract:
In this article, we will discuss the recent developments of HAXPES at the GALAXIES beamline at the SOLEIL synchrotron for the study of advanced materials.
In this article, we will discuss the recent developments of HAXPES at the GALAXIES beamline at the SOLEIL synchrotron for the study of advanced materials.
△ Less
Submitted 19 July, 2018;
originally announced July 2018.
-
The Galaxies Beamline at SOLEIL Synchrotron: Inelastic X-ray Scattering and Photoelectron Spectroscopy in the Hard X-ray Range
Authors:
J. -P. Rueff,
J. M. Ablett,
D. Céolin,
D. Prieur,
Th. Moreno,
V. Balédent,
B. Lassalle,
J. E. Rault,
M. Simon,
A. Shukla
Abstract:
The GALAXIES beamline at the SOLEIL synchrotron is dedicated to inelastic x-ray scattering (IXS) and photoelectron spectroscopy (HAXPES) in the 2.3-12 keV hard x-ray range. These two techniques offer powerful, complementary methods of characterization of materials with bulk sensitivity, chemical and orbital selectivity, resonant enhancement and high resolving power. After a description of the beam…
▽ More
The GALAXIES beamline at the SOLEIL synchrotron is dedicated to inelastic x-ray scattering (IXS) and photoelectron spectroscopy (HAXPES) in the 2.3-12 keV hard x-ray range. These two techniques offer powerful, complementary methods of characterization of materials with bulk sensitivity, chemical and orbital selectivity, resonant enhancement and high resolving power. After a description of the beamline components and endstations, we address the beamline performances through a selection of recent works both in the solid and gas phases and using either IXS or HAXPES approaches. Prospects for studies on liquids are discussed.
△ Less
Submitted 7 June, 2018;
originally announced June 2018.
-
Revisiting the origin of satellites in core level photoemission of transparent conducting oxides: the case of $n$-doped SnO$_2$
Authors:
F. Borgatti,
J. A. Berger,
D. Céolin,
J. S. Zhou,
J. J. Kas,
M. Guzzo,
C. F. McConville,
F. Offi,
G. Panaccione,
A. Regoutz,
D. J. Payne,
J. -P. Rueff,
O. Bierwagen,
M. E. White,
J. S. Speck,
M. Gatti,
R. G. Egdell
Abstract:
The longstanding problem of interpretation of satellite structures in core level photoemission spectra of metallic systems with a low density of conduction electrons is addressed using the specific example of Sb-doped SnO$_2$. Comparison of {\it ab initio} many-body calculations with experimental hard X-ray photoemission spectra of the Sn 4$d$ states shows that strong satellites are produced by co…
▽ More
The longstanding problem of interpretation of satellite structures in core level photoemission spectra of metallic systems with a low density of conduction electrons is addressed using the specific example of Sb-doped SnO$_2$. Comparison of {\it ab initio} many-body calculations with experimental hard X-ray photoemission spectra of the Sn 4$d$ states shows that strong satellites are produced by coupling of the Sn core hole to the plasma oscillations of the free electrons introduced by do**. Within the same theoretical framework, spectral changes of the valence band spectra are also related to dynamical screening effects. These results demonstrate that, for the interpretation of electron correlation features in the core level photoelectron spectra of such narrow-band materials, going beyond the homogeneous electron gas electron-plasmon coupling model is essential.
△ Less
Submitted 24 October, 2017;
originally announced October 2017.
-
Ultrafast charge transfer processes accompanying KLL Auger decay in aqueous KCl solution
Authors:
D. Céolin,
N. V. Kryzhevoi,
Ch. Nicolas,
W. Pokapanich,
S. Choksakulporn,
P. Songsiriritthigul,
Th. Saisopa,
Y. Rattanachai,
Y. Utsumi,
J. Palaudoux,
G. Öhrwall,
J. P. Rueff
Abstract:
X-ray photoelectron spectroscopy (XPS) and KLL Auger spectra of aqueous KCl solution were measured for the K$^+$ and Cl$^-$ edges. While the XPS spectra of potassium and chloride have similar structures, both exhibiting only weak satellite structures near the main line, the Auger spectra of these isoelectronic ions differ dramatically. A very strong satellite peak was found in the K$^+$ KLL Auger…
▽ More
X-ray photoelectron spectroscopy (XPS) and KLL Auger spectra of aqueous KCl solution were measured for the K$^+$ and Cl$^-$ edges. While the XPS spectra of potassium and chloride have similar structures, both exhibiting only weak satellite structures near the main line, the Auger spectra of these isoelectronic ions differ dramatically. A very strong satellite peak was found in the K$^+$ KLL Auger spectrum at the low kinetic energy side of the $^1$D state. Using equivalent core models and ab initio calculations this spectral structure was assigned to electron transfer processes from solvent water molecules to the solvated K$^+$ cation. Contrary to the potassium case, no extra peak was found in the KLL Auger spectrum of solvated Cl$^-$ indicating on a strong dependence of the underlying processes on ionic charge. The observed charge transfer processes are suggested to play an important role in charge redistribution following single and multiple core-hole creation in atomic and molecular systems placed into an environment.
△ Less
Submitted 31 March, 2017;
originally announced April 2017.
-
Observation of Distinct Bulk and Surface Chemical Environments in a Topological Insulator under Magnetic do**
Authors:
Ivana Vobornik,
Giancarlo Panaccione,
Jun Fujii,
Zhi-Huai Zhu,
Francesco Offi,
Benjamin R. Salles,
Francesco Borgatti,
Piero Torelli,
Jean Pascal Rueff,
Denis Ceolin,
Alberto Artioli,
Manju Unnikrishnan,
Giorgio Levy,
Massimiliano Marangolo,
Mamhoud Eddrief,
Damjan Krizmancic,
Huiwen Ji,
Andrea Damascelli,
Gerrit van der Laan,
Russell G. Egdell,
Robert J. Cava
Abstract:
The influence of magnetic dopants on the electronic and chemical environments in topological insulators (TIs) is a key factor when considering possible spintronic applications based on topological surface state properties. Here we provide spectroscopic evidence for the presence of distinct chemical and electronic behavior for surface and bulk magnetic do** of Bi2Te3. The inclusion of Mn in the b…
▽ More
The influence of magnetic dopants on the electronic and chemical environments in topological insulators (TIs) is a key factor when considering possible spintronic applications based on topological surface state properties. Here we provide spectroscopic evidence for the presence of distinct chemical and electronic behavior for surface and bulk magnetic do** of Bi2Te3. The inclusion of Mn in the bulk of Bi2Te3 induces a genuine dilute ferromagnetic state, with reduction of the bulk band gap as the Mn content is increased. Deposition of Fe on the Bi2Te3 surface, on the other hand, favors the formation of iron telluride already at coverages as low as 0.07 monolayer, as a consequence of the reactivity of the Te-rich surface. Our results identify the factors that need to be controlled in the realization of magnetic nanosystems and interfaces based on TIs.
△ Less
Submitted 13 August, 2014;
originally announced August 2014.
-
K-edge X-ray absorption spectra in transition metal oxides beyond the single particle approximation: shake-up many body effects
Authors:
M. Calandra,
J. P. Rueff,
C. Gougoussis,
D. Ceolin,
M. Gorgoi,
S. Benedetti,
P. Torelli,
A. Shukla,
D. Chandesris,
Ch. Brouder
Abstract:
The near edge structure (XANES) in K-edge X-ray absorption spectroscopy (XAS) is a widely used tool for studying electronic and local structure in materials. The precise interpretation of these spectra with the help of calculations is hence of prime importance, especially for the study of correlated materials which have a complicated electronic structure per se. The single particle approach, for e…
▽ More
The near edge structure (XANES) in K-edge X-ray absorption spectroscopy (XAS) is a widely used tool for studying electronic and local structure in materials. The precise interpretation of these spectra with the help of calculations is hence of prime importance, especially for the study of correlated materials which have a complicated electronic structure per se. The single particle approach, for example, has generally limited itself to the dominant dipolar cross-section. It has long been known however that effects beyond this approach should be taken into account, both due to the inadequacy of such calculations when compared to experiment and the presence of shake-up many-body satellites in core-level photoemission spectra of correlated materials. This effect should manifest itself in XANES spectra and the question is firstly how to account for it theoretically and secondly how to verify it experimentally. By using state-of-the-art first principles electronic structure calculations and 1s photoemission measurements we demonstrate that shake-up many-body effects are present in K-edge XAS dipolar spectra of NiO, CoO and CuO at all energy scales. We show that shake-up effects can be included in K-edge XAS spectra in a simple way by convoluting the single-particle first-principles calculations including core-hole effects with the 1s photoemission spectra. We thus describe all features appearing in the XAS dipolar cross-section of NiO and CoO and obtain a dramatic improvement with respect to the single-particle calculation in CuO. These materials being prototype correlated magnetic oxides, our work points to the presence of shake-up effects in K-edge XANES of most correlated transition metal compounds and shows how to account for them, paving the way to a precise understanding of their electronic structure.
△ Less
Submitted 19 June, 2012;
originally announced June 2012.
