-
On the Detection of Anomalous or Out-Of-Distribution Data in Vision Models Using Statistical Techniques
Authors:
Laura O'Mahony,
David JP O'Sullivan,
Nikola S. Nikolov
Abstract:
Out-of-distribution data and anomalous inputs are vulnerabilities of machine learning systems today, often causing systems to make incorrect predictions. The diverse range of data on which these models are used makes detecting atypical inputs a difficult and important task. We assess a tool, Benford's law, as a method used to quantify the difference between real and corrupted inputs. We believe th…
▽ More
Out-of-distribution data and anomalous inputs are vulnerabilities of machine learning systems today, often causing systems to make incorrect predictions. The diverse range of data on which these models are used makes detecting atypical inputs a difficult and important task. We assess a tool, Benford's law, as a method used to quantify the difference between real and corrupted inputs. We believe that in many settings, it could function as a filter for anomalous data points and for signalling out-of-distribution data. We hope to open a discussion on these applications and further areas where this technique is underexplored.
△ Less
Submitted 21 March, 2024;
originally announced March 2024.
-
Finding polarised communities and tracking information diffusion on Twitter: The Irish Abortion Referendum
Authors:
Caroline Pena,
Pádraig MacCarron,
David J. P. O'Sullivan
Abstract:
The analysis of social networks enables the understanding of social interactions, polarisation of ideas, and the spread of information and therefore plays an important role in society. We use Twitter data - as it is a popular venue for the expression of opinion and dissemination of information - to identify opposing sides of a debate and, importantly, to observe how information spreads between the…
▽ More
The analysis of social networks enables the understanding of social interactions, polarisation of ideas, and the spread of information and therefore plays an important role in society. We use Twitter data - as it is a popular venue for the expression of opinion and dissemination of information - to identify opposing sides of a debate and, importantly, to observe how information spreads between these groups in our current polarised climate.
To achieve this, we collected over 688,000 Tweets from the Irish Abortion Referendum of 2018 to build a conversation network from users mentions with sentiment-based homophily. From this network, community detection methods allow us to isolate yes- or no-aligned supporters with high accuracy (90.9%). We supplement this by tracking how information cascades spread via over 31,000 retweet-cascades. We found that very little information spread between polarised communities. This provides a valuable methodology for extracting and studying information diffusion on large networks by isolating ideologically polarised groups and exploring the propagation of information within and between these groups.
△ Less
Submitted 15 November, 2023;
originally announced November 2023.
-
Effectiveness of Contact Tracing on Networks with Cliques
Authors:
Abbas K. Rizi,
Leah A. Keating,
James P. Gleeson,
David J. P. O'Sullivan,
Mikko Kivelä
Abstract:
Contact tracing, the practice of isolating individuals who have been in contact with infected individuals, is an effective and practical way of containing disease spread. Here, we show that this strategy is particularly effective in the presence of social groups: Once the disease enters a group, contact tracing not only cuts direct infection paths but can also pre-emptively quarantine group member…
▽ More
Contact tracing, the practice of isolating individuals who have been in contact with infected individuals, is an effective and practical way of containing disease spread. Here, we show that this strategy is particularly effective in the presence of social groups: Once the disease enters a group, contact tracing not only cuts direct infection paths but can also pre-emptively quarantine group members such that it will cut indirect spreading routes. We show these results by using a deliberately stylized model that allows us to isolate the effect of contact tracing within the clique structure of the network where the contagion is spreading. This will enable us to derive mean-field approximations and epidemic thresholds to demonstrate the efficiency of contact tracing in social networks with small groups. This analysis shows that contact tracing in networks with groups is more efficient the larger the groups are. We show how these results can be understood by approximating the combination of disease spreading and contact tracing with a complex contagion process where every failed infection attempt will lead to a lower infection probability in the following attempts. Our results illustrate how contact tracing in real-world settings can be more efficient than predicted by models that treat the system as fully mixed or the network structure as locally tree-like.
△ Less
Submitted 19 December, 2023; v1 submitted 20 April, 2023;
originally announced April 2023.
-
A generating-function approach to modelling complex contagion on clustered networks with multi-type branching processes
Authors:
Leah A. Keating,
James P. Gleeson,
David J. P. O'Sullivan
Abstract:
Understanding cascading processes on complex network topologies is paramount for modelling how diseases, information, fake news and other media spread. In this paper, we extend the multi-type branching process method developed in Keating et al., 2022, which relies on homogenous network properties, to a more general class of clustered networks. Using a model of socially-inspired complex contagion w…
▽ More
Understanding cascading processes on complex network topologies is paramount for modelling how diseases, information, fake news and other media spread. In this paper, we extend the multi-type branching process method developed in Keating et al., 2022, which relies on homogenous network properties, to a more general class of clustered networks. Using a model of socially-inspired complex contagion we obtain results, not just for the average behaviour of the cascades but for full distributions of the cascade properties. We introduce a new method for the inversion of probability generating functions to recover their underlying probability distributions; this derivation naturally extends to higher dimensions. This inversion technique is used along with the multi-type branching process to obtain univariate and bivariate distributions of cascade properties. Finally, using clique cover methods, we apply the methodology to synthetic and real-world networks and compare the theoretical distribution of cascade sizes with the results of extensive numerical simulations.
△ Less
Submitted 1 December, 2022;
originally announced December 2022.
-
A multi-type branching process method for modelling complex contagion on clustered networks
Authors:
Leah A. Keating,
James P. Gleeson,
David J. P. O'Sullivan
Abstract:
Complex contagion adoption dynamics are characterised by a node being more likely to adopt after multiple network neighbours have adopted. We show how to construct multi-type branching processes to approximate complex contagion adoption dynamics on networks with clique-based clustering. This involves tracking the evolution of a cascade via different classes of clique motifs that account for the di…
▽ More
Complex contagion adoption dynamics are characterised by a node being more likely to adopt after multiple network neighbours have adopted. We show how to construct multi-type branching processes to approximate complex contagion adoption dynamics on networks with clique-based clustering. This involves tracking the evolution of a cascade via different classes of clique motifs that account for the different numbers of active, inactive and removed nodes. This discrete-time model assumes that active nodes become immediately and certainly removed in the next time step. This description allows for extensive Monte Carlo simulations (which are faster than network-based simulations), accurate analytical calculation of cascade sizes, determination of critical behaviour and other quantities of interest.
△ Less
Submitted 18 January, 2022; v1 submitted 21 July, 2021;
originally announced July 2021.
-
Calibrating COVID-19 SEIR models with time-varying effective contact rates
Authors:
James P. Gleeson,
Thomas Brendan Murphy,
Joseph D. O'Brien,
Nial Friel,
Norma Bargary,
David J. P. O'Sullivan
Abstract:
We describe the population-based SEIR (susceptible, exposed, infected, removed) model developed by the Irish Epidemiological Modelling Advisory Group (IEMAG), which advises the Irish government on COVID-19 responses. The model assumes a time-varying effective contact rate (equivalently, a time-varying reproduction number) to model the effect of non-pharmaceutical interventions. A crucial technical…
▽ More
We describe the population-based SEIR (susceptible, exposed, infected, removed) model developed by the Irish Epidemiological Modelling Advisory Group (IEMAG), which advises the Irish government on COVID-19 responses. The model assumes a time-varying effective contact rate (equivalently, a time-varying reproduction number) to model the effect of non-pharmaceutical interventions. A crucial technical challenge in applying such models is their accurate calibration to observed data, e.g., to the daily number of confirmed new cases, as the past history of the disease strongly affects predictions of future scenarios. We demonstrate an approach based on inversion of the SEIR equations in conjunction with statistical modelling and spline-fitting of the data, to produce a robust methodology for calibration of a wide class of models of this type.
△ Less
Submitted 8 June, 2021;
originally announced June 2021.
-
Detect opinion-based groups and reveal polarisation in survey data
Authors:
Alejandro Dinkelberg,
David JP O'Sullivan,
Michael Quayle,
Pádraig MacCarron
Abstract:
Networks, representing attitudinal survey data, expose the structure of opinion-based groups. We make use of these network projections to identify the groups reliably through community detection algorithms and to examine social-identity-based groups. Our goal is to present a method for revealing polarisation and opinion-based in attitudinal surveys. This method can be broken down into the followin…
▽ More
Networks, representing attitudinal survey data, expose the structure of opinion-based groups. We make use of these network projections to identify the groups reliably through community detection algorithms and to examine social-identity-based groups. Our goal is to present a method for revealing polarisation and opinion-based in attitudinal surveys. This method can be broken down into the following steps: data preparation, construction of similarity-based networks, algorithmic identification of opinion-based groups, and identification of important items for community structure. We assess the method's performance and possible scope for applying it to empirical data and to a broad range of synthetic data sets. The empirical data application points out possible conclusions (i.e. social-identity polarisation), whereas the synthetic data sets mark out the method's boundaries. Next to an application example on political attitude survey, our results suggest that the method works for various surveys but is also moderated by the efficacy of the community detection algorithms. Concerning the identification of opinion-based groups, we provide a solid method to rank the item's influence on group formation and as a group identifier. We discuss how this network approach for identifying polarisation can classify non-overlap** opinion-based groups even in the absence of extreme opinions.
△ Less
Submitted 13 October, 2021; v1 submitted 29 April, 2021;
originally announced April 2021.
-
Identification of skill in an online game: The case of Fantasy Premier League
Authors:
Joseph D. O'Brien,
James P. Gleeson,
David J. P. O'Sullivan
Abstract:
In all competitions where results are based upon an individual's performance the question of whether the outcome is a consequence of skill or luck arises. We explore this question through an analysis of a large dataset of approximately one million contestants playing Fantasy Premier League, an online fantasy sport where managers choose players from the English football (soccer) league. We show tha…
▽ More
In all competitions where results are based upon an individual's performance the question of whether the outcome is a consequence of skill or luck arises. We explore this question through an analysis of a large dataset of approximately one million contestants playing Fantasy Premier League, an online fantasy sport where managers choose players from the English football (soccer) league. We show that managers' ranks over multiple seasons are correlated and we analyse the actions taken by managers to increase their likelihood of success. The prime factors in determining a manager's success are found to be long-term planning and consistently good decision-making in the face of the noisy contests upon which this game is based. Similarities between managers' decisions over time that result in the emergence of 'template' teams, suggesting a form of herding dynamics taking place within the game, are also observed. Taken together, these findings indicate common strategic considerations and consensus among successful managers on crucial decision points over an extended temporal period.
△ Less
Submitted 2 September, 2020;
originally announced September 2020.
-
Branching process descriptions of information cascades on Twitter
Authors:
James P. Gleeson,
Tomokatsu Onaga,
Peter Fennell,
James Cotter,
Raymond Burke,
David J. P. O'Sullivan
Abstract:
A detailed analysis of Twitter-based information cascades is performed, and it is demonstrated that branching process hypotheses are approximately satisfied. Using a branching process framework, models of agent-to-agent transmission are compared to conclude that a limited attention model better reproduces the relevant characteristics of the data than the more common independent cascade model. Exis…
▽ More
A detailed analysis of Twitter-based information cascades is performed, and it is demonstrated that branching process hypotheses are approximately satisfied. Using a branching process framework, models of agent-to-agent transmission are compared to conclude that a limited attention model better reproduces the relevant characteristics of the data than the more common independent cascade model. Existing and new analytical results for branching processes are shown to match well to the important statistical characteristics of the empirical information cascades, thus demonstrating the power of branching process descriptions for understanding social information spreading.
△ Less
Submitted 17 July, 2020;
originally announced July 2020.
-
Integrating sentiment and social structure to determine preference alignments: The Irish Marriage Referendum
Authors:
David J. P. O'Sullivan,
Guillermo Garduño-Hernández,
James P. Gleeson,
Mariano Beguerisse-Díaz
Abstract:
We examine the relationship between social structure and sentiment through the analysis of a large collection of tweets about the Irish Marriage Referendum of 2015. We obtain the sentiment of every tweet with the hashtags #marref and #marriageref that was posted in the days leading to the referendum, and construct networks to aggregate sentiment and use it to study the interactions among users. Ou…
▽ More
We examine the relationship between social structure and sentiment through the analysis of a large collection of tweets about the Irish Marriage Referendum of 2015. We obtain the sentiment of every tweet with the hashtags #marref and #marriageref that was posted in the days leading to the referendum, and construct networks to aggregate sentiment and use it to study the interactions among users. Our results show that the sentiment of mention tweets posted by users is correlated with the sentiment of received mentions, and there are significantly more connections between users with similar sentiment scores than among users with opposite scores in the mention and follower networks. We combine the community structure of the two networks with the activity level of the users and sentiment scores to find groups of users who support voting `yes' or `no' in the referendum. There were numerous conversations between users on opposing sides of the debate in the absence of follower connections, which suggests that there were efforts by some users to establish dialogue and debate across ideological divisions. Our analysis shows that social structure can be integrated successfully with sentiment to analyse and understand the disposition of social media users. These results have potential applications in the integration of data and meta-data to study opinion dynamics, public opinion modelling, and polling.
△ Less
Submitted 18 February, 2017; v1 submitted 1 January, 2017;
originally announced January 2017.
