-
Deep learning empowered sensor fusion to improve infant movement classification
Authors:
Tomas Kulvicius,
Dajie Zhang,
Luise Poustka,
Sven Bölte,
Lennart Jahn,
Sarah Flügge,
Marc Kraft,
Markus Zweckstetter,
Karin Nielsen-Saines,
Florentin Wörgötter,
Peter B Marschik
Abstract:
There is a recent boom in the development of AI solutions to facilitate and enhance diagnostic procedures for established clinical tools. To assess the integrity of the develo** nervous system, the Prechtl general movement assessment (GMA) is recognized for its clinical value in diagnosing neurological impairments in early infancy. GMA has been increasingly augmented through machine learning app…
▽ More
There is a recent boom in the development of AI solutions to facilitate and enhance diagnostic procedures for established clinical tools. To assess the integrity of the develo** nervous system, the Prechtl general movement assessment (GMA) is recognized for its clinical value in diagnosing neurological impairments in early infancy. GMA has been increasingly augmented through machine learning approaches intending to scale-up its application, circumvent costs in the training of human assessors and further standardize classification of spontaneous motor patterns. Available deep learning tools, all of which are based on single sensor modalities, are however still considerably inferior to that of well-trained human assessors. These approaches are hardly comparable as all models are designed, trained and evaluated on proprietary/silo-data sets. With this study we propose a sensor fusion approach for assessing fidgety movements (FMs) comparing three different sensor modalities (pressure, inertial, and visual sensors). Various combinations and two sensor fusion approaches (late and early fusion) for infant movement classification were tested to evaluate whether a multi-sensor system outperforms single modality assessments. The performance of the three-sensor fusion (classification accuracy of 94.5\%) was significantly higher than that of any single modality evaluated, suggesting the sensor fusion approach is a promising avenue for automated classification of infant motor patterns. The development of a robust sensor fusion system may significantly enhance AI-based early recognition of neurofunctions, ultimately facilitating automated early detection of neurodevelopmental conditions.
△ Less
Submitted 21 June, 2024; v1 submitted 13 June, 2024;
originally announced June 2024.
-
Friction Interventions to Curb the Spread of Misinformation on Social Media
Authors:
Laura Jahn,
Rasmus K. Rendsvig,
Alessandro Flammini,
Filippo Menczer,
Vincent F. Hendricks
Abstract:
Social media has enabled the spread of information at unprecedented speeds and scales, and with it the proliferation of high-engagement, low-quality content. *Friction* -- behavioral design measures that make the sharing of content more cumbersome -- might be a way to raise the quality of what is spread online. Here, we study the effects of friction with and without quality-recognition learning. E…
▽ More
Social media has enabled the spread of information at unprecedented speeds and scales, and with it the proliferation of high-engagement, low-quality content. *Friction* -- behavioral design measures that make the sharing of content more cumbersome -- might be a way to raise the quality of what is spread online. Here, we study the effects of friction with and without quality-recognition learning. Experiments from an agent-based model suggest that friction alone decreases the number of posts without improving their quality. A small amount of friction combined with learning, however, increases the average quality of posts significantly. Based on this preliminary evidence, we propose a friction intervention with a learning component about the platform's community standards, to be tested via a field experiment. The proposed intervention would have minimal effects on engagement and may easily be deployed at scale.
△ Less
Submitted 21 July, 2023;
originally announced July 2023.
-
A Study on Quantifying Sim2Real Image Gap in Autonomous Driving Simulations Using Lane Segmentation Attention Map Similarity
Authors:
Seongjeong Park,
**u Pahk,
Lennart Lorenz Freimuth Jahn,
Yongseob Lim,
**ung An,
Gyeungho Choi
Abstract:
Autonomous driving simulations require highly realistic images. Our preliminary study found that when the CARLA Simulator image was made more like reality by using DCLGAN, the performance of the lane recognition model improved to levels comparable to real-world driving. It was also confirmed that the vehicle's ability to return to the center of the lane after deviating from it improved significant…
▽ More
Autonomous driving simulations require highly realistic images. Our preliminary study found that when the CARLA Simulator image was made more like reality by using DCLGAN, the performance of the lane recognition model improved to levels comparable to real-world driving. It was also confirmed that the vehicle's ability to return to the center of the lane after deviating from it improved significantly. However, there is currently no agreed-upon metric for quantitatively evaluating the realism of simulation images. To address this issue, based on the idea that FID (Fréchet Inception Distance) measures the feature vector distribution distance using a pre-trained model, this paper proposes a metric that measures the similarity of simulation road images using the attention map from the self-attention distillation process of ENet-SAD. Finally, this paper verified the suitability of the measurement method by applying it to the image of the CARLA map that implemented a realworld autonomous driving test road.
△ Less
Submitted 18 June, 2023;
originally announced June 2023.
-
Danish National Election 2022 Twitter Data on Likes, Retweets, and Botscores for the Purpose of Exploring Coordinated Inauthenthic Behavior
Authors:
Laura Jahn,
Rasmus K. Rendsvig
Abstract:
This note describes code and experiments related to a Twitter dataset on the Danish National Election 2022, available at Harvard Dataverse (doi.org/10.7910/DVN/RWPZUN). We cluster Twitter users into bins of users that showed exactly the same liking/retweeting behavior over a month-long period during which the Danish National Election took place. To investigate whether any of these bins exhibited c…
▽ More
This note describes code and experiments related to a Twitter dataset on the Danish National Election 2022, available at Harvard Dataverse (doi.org/10.7910/DVN/RWPZUN). We cluster Twitter users into bins of users that showed exactly the same liking/retweeting behavior over a month-long period during which the Danish National Election took place. To investigate whether any of these bins exhibited coordinated inauthentic behavior, we were interested in whether bin size correlated with user account deletions/suspensions and/or high bot scores from Botometer / Botometer Lite. We did not find significant correlations (also neither between Botometer and Botometer Lite scores). This note primarily contains the README.md from the GitHub repository LJ-9/Danish-Election-2022-Twitter-Likes-Retweets-Botscores-Inauthentic-Coordinated-Behavior of the same name, with a few additional comments and references. We upload the note for visibility, ho** that other researchers may find the data of use.
△ Less
Submitted 15 May, 2023;
originally announced May 2023.
-
Towards Detecting Inauthentic Coordination in Twitter Likes Data
Authors:
Laura Jahn,
Rasmus K. Rendsvig
Abstract:
Social media feeds typically favor posts according to user engagement. The most ubiquitous type of engagement (and the type we study) is *likes*. Users customarily take engagement metrics such as likes as a neutral proxy for quality and authority. This incentivizes like manipulation to influence public opinion through *coordinated inauthentic behavior* (CIB). CIB targeted at likes is largely unstu…
▽ More
Social media feeds typically favor posts according to user engagement. The most ubiquitous type of engagement (and the type we study) is *likes*. Users customarily take engagement metrics such as likes as a neutral proxy for quality and authority. This incentivizes like manipulation to influence public opinion through *coordinated inauthentic behavior* (CIB). CIB targeted at likes is largely unstudied as collecting suitable data about users' liking behavior is non-trivial. This paper contributes a scripted algorithm to collect suitable liking data from Twitter and a collected 30 day dataset of liking data from the Danish political Twittersphere #dkpol, over which we analyze the script's performance. Using only the binary matrix of users and the tweets they liked, we identify large clusters of perfectly correlated users, and discuss our findings in relation to CIB.
△ Less
Submitted 12 May, 2023;
originally announced May 2023.
-
Detecting Coordinated Inauthentic Behavior in Likes on Social Media: Proof of Concept
Authors:
Laura Jahn,
Rasmus K. Rendsvig,
Jacob Stærk-Østergaard
Abstract:
Coordinated inauthentic behavior is used as a tool on social media to shape public opinion by elevating or suppressing topics using systematic engagements -- e.g. through *likes* or similar reactions. In an honest world, reactions may be informative to users when selecting on what to spend their attention: through the wisdom of crowds, summed reactions may help identifying relevant and high-qualit…
▽ More
Coordinated inauthentic behavior is used as a tool on social media to shape public opinion by elevating or suppressing topics using systematic engagements -- e.g. through *likes* or similar reactions. In an honest world, reactions may be informative to users when selecting on what to spend their attention: through the wisdom of crowds, summed reactions may help identifying relevant and high-quality content. This is nullified by coordinated inauthentic liking. To restore wisdom-of-crowds effects, it is therefore desirable to separate the inauthentic agents from the wise crowd, and use only the latter as a voting *jury* on the relevance of a post. To this end, we design two *jury selection procedures* (JSPs) that discard agents classified as inauthentic. Using machine learning techniques, both cluster on binary vote data -- one using a Gaussian Mixture Model (GMM JSP), one the k-means algorithm (KM JSP) -- and label agents by logistic regression. We evaluate the jury selection procedures with an agent-based model, and show that the GMM JSP detects more inauthentic agents, but both JSPs select juries with vastly increased correctness of vote by majority. This proof of concept provides an argument for the release of reactions data from social media platforms through a direct use-case in the fight against online misinformation.
△ Less
Submitted 12 May, 2023;
originally announced May 2023.
-
Comparison of Motion Encoding Frameworks on Human Manipulation Actions
Authors:
Lennart Jahn,
Florentin Wörgötter,
Tomas Kulvicius
Abstract:
Movement generation, and especially generalisation to unseen situations, plays an important role in robotics. Different types of movement generation methods exist such as spline based methods, dynamical system based methods, and methods based on Gaussian mixture models (GMMs). Using a large, new dataset on human manipulations, in this paper we provide a highly detailed comparison of five fundament…
▽ More
Movement generation, and especially generalisation to unseen situations, plays an important role in robotics. Different types of movement generation methods exist such as spline based methods, dynamical system based methods, and methods based on Gaussian mixture models (GMMs). Using a large, new dataset on human manipulations, in this paper we provide a highly detailed comparison of five fundamentally different and widely used movement encoding and generation frameworks: dynamic movement primitives (DMPs), time based Gaussian mixture regression (tbGMR), stable estimator of dynamical systems (SEDS), Probabilistic Movement Primitives (ProMP) and Optimal Control Primitives (OCP). We compare these frameworks with respect to their movement encoding efficiency, reconstruction accuracy, and movement generalisation capabilities. The new dataset consists of nine object manipulation actions performed by 12 humans: pick and place, put on top/take down, put inside/take out, hide/uncover, and push/pull with a total of 7,652 movement examples. Our analysis shows that for movement encoding and reconstruction DMPs and OCPs are the most efficient with respect to the number of parameters and reconstruction accuracy, if a sufficient number of kernels is used. In case of movement generalisation to new start- and end-point situations, DMPs, OCPs and task parameterized GMM (TP-GMM, movement generalisation framework based on tbGMR) lead to similar performance, which ProMPs only achieve when using many demonstrations for learning. All models outperform SEDS, which additionally proves to be difficult to fit. Furthermore we observe that TP-GMM and SEDS suffer from problems reaching the end-points of generalizations.These different quantitative results will help selecting the most appropriate models and designing trajectory representations in an improved task-dependent way in future robotic applications.
△ Less
Submitted 18 March, 2024; v1 submitted 23 November, 2022;
originally announced November 2022.
-
Thermal Remagnetization in Polycrystalline Permanent Magnets
Authors:
R. Schumann,
L. Jahn
Abstract:
The thermal remagnetization (TR), i.e. the reentrance of magnetization upon heating in a steady-field demagnetized sample, is a common feature to the four types of polycrystalline permanent magnets, mainly utilized for practical purposes, i.e. barium ferrites, SmCo5, Sm2Co17 and NdFeB magnets. The effect is small for pinning controlled and large for nucleation controlled magnets. The effect is s…
▽ More
The thermal remagnetization (TR), i.e. the reentrance of magnetization upon heating in a steady-field demagnetized sample, is a common feature to the four types of polycrystalline permanent magnets, mainly utilized for practical purposes, i.e. barium ferrites, SmCo5, Sm2Co17 and NdFeB magnets. The effect is small for pinning controlled and large for nucleation controlled magnets. The effect is strongly dependent on the demagnetization factor and may reach nearly 100 per cent in SmCo5 samples measured in a closed circuit. The TR is very sensitive to a small superimposed steady field. The maximum effect and the position of the peak is dependent on the initial temperature. The direction of the TR is correlated with the temperature coefficient of the coercivity, resulting in a inverse TR in barium ferrite. The susceptibility of the thermally remagnetized samples is increased. Repeated cycles of steady-field demagnetization followed by heating result in the same TR. The phenomenology of TR and ITR is explained by means of a model taking into account both the internal field fluctuations due to grain interactions and the decay of single domain grains into multi-domain state. By taking the measured temperature dependencies of the coercivity and the saturation magnetization the theory is able to reproduce the experiments very well, allowing to determine the width of the field fluctuations, the width of the switching field distribution and an internal demagnetization factor as characteristics of the materials by fitting.
△ Less
Submitted 13 May, 2003;
originally announced May 2003.
-
Theory of Thermal Remagnetization of Permanent Magnets
Authors:
R. Schumann,
L. Jahn
Abstract:
A self-consistent mean-field theory explaining the thermal remagnetization (TR) of polycrystalline permanent magnets is given. The influence of the environment of a grain is treated by an inclusion approximation, relating the field inside the grain to the local field outside by means of an internal demagnetization factor $n$. For the switching fields and the fluctuations of the local fields arou…
▽ More
A self-consistent mean-field theory explaining the thermal remagnetization (TR) of polycrystalline permanent magnets is given. The influence of the environment of a grain is treated by an inclusion approximation, relating the field inside the grain to the local field outside by means of an internal demagnetization factor $n$. For the switching fields and the fluctuations of the local fields around the mean field Gaussian distributions of widths $\sigmas$ and $\sigmaf$ resp. are assumed. The isothermal hysteresis curve, the recoil curves, and the TR in dependence on the model parameters $n$, $\sigmas$, and $\sigmaf$ are calculated. Furthermore, the influence of the initial temperature and the strong dependence of the TR on the demagnetization factor of the sample are studied, and it is shown that for reasonable parameter sets TR effects up to 100 % are possible. The theoretical results correspond well with the experimental situation.
△ Less
Submitted 5 February, 2001;
originally announced February 2001.