-
War Elephants: Rethinking Combat AI and Human Oversight
Authors:
Philip Feldman,
Aaron Dant,
Harry Dreany
Abstract:
This paper explores the changes that pervasive AI is having on the nature of combat. We look beyond the substitution of AI for experts to an approach where complementary human and machine abilities are blended. Using historical and modern examples, we show how autonomous weapons systems can be effectively managed by teams of human "AI Operators" combined with AI/ML "Proxy Operators." By basing our…
▽ More
This paper explores the changes that pervasive AI is having on the nature of combat. We look beyond the substitution of AI for experts to an approach where complementary human and machine abilities are blended. Using historical and modern examples, we show how autonomous weapons systems can be effectively managed by teams of human "AI Operators" combined with AI/ML "Proxy Operators." By basing our approach on the principles of complementation, we provide for a flexible and dynamic approach to managing lethal autonomous systems. We conclude by presenting a path to achieving an integrated vision of machine-speed combat where the battlefield AI is operated by AI Operators that watch for patterns of behavior within battlefield to assess the performance of lethal autonomous systems. This approach enables the development of combat systems that are likely to be more ethical, operate at machine speed, and are capable of responding to a broader range of dynamic battlefield conditions than any purely autonomous AI system could support.
△ Less
Submitted 30 April, 2024;
originally announced April 2024.
-
Killer Apps: Low-Speed, Large-Scale AI Weapons
Authors:
Philip Feldman,
Aaron Dant,
James R. Foulds
Abstract:
The accelerating advancements in Artificial Intelligence (AI) and Machine Learning (ML), highlighted by the development of cutting-edge Generative Pre-trained Transformer (GPT) models by organizations such as OpenAI, Meta, and Anthropic, present new challenges and opportunities in warfare and security. Much of the current focus is on AI's integration within weapons systems and its role in rapid de…
▽ More
The accelerating advancements in Artificial Intelligence (AI) and Machine Learning (ML), highlighted by the development of cutting-edge Generative Pre-trained Transformer (GPT) models by organizations such as OpenAI, Meta, and Anthropic, present new challenges and opportunities in warfare and security. Much of the current focus is on AI's integration within weapons systems and its role in rapid decision-making in kinetic conflict. However, an equally important but often overlooked aspect is the potential of AI-based psychological manipulation at internet scales within the information domain. These capabilities could pose significant threats to individuals, organizations, and societies globally. This paper explores the concept of AI weapons, their deployment, detection, and potential countermeasures.
△ Less
Submitted 17 June, 2024; v1 submitted 14 January, 2024;
originally announced February 2024.
-
Down the Rabbit Hole: Detecting Online Extremism, Radicalisation, and Politicised Hate Speech
Authors:
Jarod Govers,
Philip Feldman,
Aaron Dant,
Panos Patros
Abstract:
Social media is a modern person's digital voice to project and engage with new ideas and mobilise communities $\unicode{x2013}$ a power shared with extremists. Given the societal risks of unvetted content-moderating algorithms for Extremism, Radicalisation, and Hate speech (ERH) detection, responsible software engineering must understand the who, what, when, where, and why such models are necessar…
▽ More
Social media is a modern person's digital voice to project and engage with new ideas and mobilise communities $\unicode{x2013}$ a power shared with extremists. Given the societal risks of unvetted content-moderating algorithms for Extremism, Radicalisation, and Hate speech (ERH) detection, responsible software engineering must understand the who, what, when, where, and why such models are necessary to protect user safety and free expression. Hence, we propose and examine the unique research field of ERH context mining to unify disjoint studies. Specifically, we evaluate the start-to-finish design process from socio-technical definition-building and dataset collection strategies to technical algorithm design and performance. Our 2015-2021 51-study Systematic Literature Review (SLR) provides the first cross-examination of textual, network, and visual approaches to detecting extremist affiliation, hateful content, and radicalisation towards groups and movements. We identify consensus-driven ERH definitions and propose solutions to existing ideological and geographic biases, particularly due to the lack of research in Oceania/Australasia. Our hybridised investigation on Natural Language Processing, Community Detection, and visual-text models demonstrates the dominating performance of textual transformer-based algorithms. We conclude with vital recommendations for ERH context mining researchers and propose an uptake roadmap with guidelines for researchers, industries, and governments to enable a safer cyberspace.
△ Less
Submitted 27 January, 2023;
originally announced January 2023.
-
Polling Latent Opinions: A Method for Computational Sociolinguistics Using Transformer Language Models
Authors:
Philip Feldman,
Aaron Dant,
James R. Foulds,
Shemei Pan
Abstract:
Text analysis of social media for sentiment, topic analysis, and other analysis depends initially on the selection of keywords and phrases that will be used to create the research corpora. However, keywords that researchers choose may occur infrequently, leading to errors that arise from using small samples. In this paper, we use the capacity for memorization, interpolation, and extrapolation of T…
▽ More
Text analysis of social media for sentiment, topic analysis, and other analysis depends initially on the selection of keywords and phrases that will be used to create the research corpora. However, keywords that researchers choose may occur infrequently, leading to errors that arise from using small samples. In this paper, we use the capacity for memorization, interpolation, and extrapolation of Transformer Language Models such as the GPT series to learn the linguistic behaviors of a subgroup within larger corpora of Yelp reviews. We then use prompt-based queries to generate synthetic text that can be analyzed to produce insights into specific opinions held by the populations that the models were trained on. Once learned, more specific sentiment queries can be made of the model with high levels of accuracy when compared to traditional keyword searches. We show that even in cases where a specific keyphrase is limited or not present at all in the training corpora, the GPT is able to accurately generate large volumes of text that have the correct sentiment.
△ Less
Submitted 19 April, 2022; v1 submitted 15 April, 2022;
originally announced April 2022.
-
Ethics, Rules of Engagement, and AI: Neural Narrative Map** Using Large Transformer Language Models
Authors:
Philip Feldman,
Aaron Dant,
David Rosenbluth
Abstract:
The problem of determining if a military unit has correctly understood an order and is properly executing on it is one that has bedeviled military planners throughout history. The advent of advanced language models such as OpenAI's GPT-series offers new possibilities for addressing this problem. This paper presents a mechanism to harness the narrative output of large language models and produce di…
▽ More
The problem of determining if a military unit has correctly understood an order and is properly executing on it is one that has bedeviled military planners throughout history. The advent of advanced language models such as OpenAI's GPT-series offers new possibilities for addressing this problem. This paper presents a mechanism to harness the narrative output of large language models and produce diagrams or "maps" of the relationships that are latent in the weights of such models as the GPT-3. The resulting "Neural Narrative Maps" (NNMs), are intended to provide insight into the organization of information, opinion, and belief in the model, which in turn provide means to understand intent and response in the context of physical distance. This paper discusses the problem of map** information spaces in general, and then presents a concrete implementation of this concept in the context of OpenAI's GPT-3 language model for determining if a subordinate is following a commander's intent in a high-risk situation. The subordinate's locations within the NNM allow a novel capability to evaluate the intent of the subordinate with respect to the commander. We show that is is possible not only to determine if they are nearby in narrative space, but also how they are oriented, and what "trajectory" they are on. Our results show that our method is able to produce high-quality maps, and demonstrate new ways of evaluating intent more generally.
△ Less
Submitted 5 February, 2022;
originally announced February 2022.
-
Belief places and spaces: Map** cognitive environments
Authors:
Philip Feldman,
Aaron Dant,
Wayne Lutters
Abstract:
Beliefs are not facts, but they are factive - they feel like facts. This property is what can make misinformation dangerous. Being able to deliberately navigate through a landscape of often conflicting factive statements is difficult when there is no way to show the relationships between them without incorporating the information in linear, narrative forms. In this paper, we present a mechanism to…
▽ More
Beliefs are not facts, but they are factive - they feel like facts. This property is what can make misinformation dangerous. Being able to deliberately navigate through a landscape of often conflicting factive statements is difficult when there is no way to show the relationships between them without incorporating the information in linear, narrative forms. In this paper, we present a mechanism to produce maps of belief places, where populations agree on salient features of fictional environments, and belief spaces, where subgroups have related but distinct perspectives. Using a model developed using agent-based simulation, we show that by observing the repeated behaviors of human participants in the same social context, it is possible to build maps that show the shared narrative environment overlaid with traces that show unique, individual or subgroup perspectives. Our contribution is a proof-of-concept system, based on the affordances of fantasy tabletop role-playing games, which support multiple groups interacting with the same dungeon in a controlled, online environment. The techniques used in this process are mathematically straightforward, and should be generalizable to auto-generating larger-scale maps of belief spaces from other corpora, such as discussions on social media.
△ Less
Submitted 11 July, 2019; v1 submitted 8 July, 2019;
originally announced July 2019.
-
Integrating Artificial Intelligence into Weapon Systems
Authors:
Philip Feldman,
Aaron Dant,
Aaron Massey
Abstract:
The integration of Artificial Intelligence (AI) into weapon systems is one of the most consequential tactical and strategic decisions in the history of warfare. Current AI development is a remarkable combination of accelerating capability, hidden decision mechanisms, and decreasing costs. Implementation of these systems is in its infancy and exists on a spectrum from resilient and flexible to simp…
▽ More
The integration of Artificial Intelligence (AI) into weapon systems is one of the most consequential tactical and strategic decisions in the history of warfare. Current AI development is a remarkable combination of accelerating capability, hidden decision mechanisms, and decreasing costs. Implementation of these systems is in its infancy and exists on a spectrum from resilient and flexible to simplistic and brittle. Resilient systems should be able to effectively handle the complexities of a high-dimensional battlespace. Simplistic AI implementations could be manipulated by an adversarial AI that identifies and exploits their weaknesses.
In this paper, we present a framework for understanding the development of dynamic AI/ML systems that interactively and continuously adapt to their user's needs. We explore the implications of increasingly capable AI in the kill chain and how this will lead inevitably to a fully automated, always on system, barring regulation by treaty. We examine the potential of total integration of cyber and physical security and how this likelihood must inform the development of AI-enabled systems with respect to the "fog of war", human morals, and ethics.
△ Less
Submitted 9 May, 2019;
originally announced May 2019.
-
Dungeons for Science: Map** Belief Places and Spaces
Authors:
Aaron Dant,
Philip Feldman,
Wayne Lutters
Abstract:
Tabletop fantasy role-playing games (TFRPGs) have existed in offline and online contexts for many decades, yet are rarely featured in scientific literature. This paper presents a case study where TFRPGs were used to generate and collect data for maps of belief environments using fiction co-created by multiple small groups of online tabletop gamers. The affordances of TFRPGs allowed us to collect r…
▽ More
Tabletop fantasy role-playing games (TFRPGs) have existed in offline and online contexts for many decades, yet are rarely featured in scientific literature. This paper presents a case study where TFRPGs were used to generate and collect data for maps of belief environments using fiction co-created by multiple small groups of online tabletop gamers. The affordances of TFRPGs allowed us to collect repeatable, targeted data in online field conditions. These data not only included terms that allowed us to build our maps, but also to explore nuanced ethical problems from a situated, collaborative perspective.
△ Less
Submitted 9 July, 2019; v1 submitted 10 April, 2019;
originally announced April 2019.
-
Disrupting the Coming Robot Stampedes: Designing Resilient Information Ecologies
Authors:
Philip Feldman,
Aaron Dant,
Wayne Lutters
Abstract:
Machines are designed to communicate widely and efficiently. Humans, less so. We evolved social structures that function best as small subgroups interacting within larger populations. Technology changes this dynamic, by allowing all individuals to be connected at the speed of light. A dense, tightly connected population can behave like a single agent. In animals, this happens in constrained areas…
▽ More
Machines are designed to communicate widely and efficiently. Humans, less so. We evolved social structures that function best as small subgroups interacting within larger populations. Technology changes this dynamic, by allowing all individuals to be connected at the speed of light. A dense, tightly connected population can behave like a single agent. In animals, this happens in constrained areas where stampedes can easily form. Machines do not need these kinds of conditions. The very techniques used to design best-of-breed solutions may increase the risk of dangerous mass behaviors among homogeneous machines. In this paper we argue that ecologically-based design principles such as the presence of diversity are a broadly effective strategy to defend against unintended consequences at scale.
△ Less
Submitted 26 November, 2018; v1 submitted 2 October, 2018;
originally announced October 2018.
-
Simon's Anthill: Map** and Navigating Belief Spaces
Authors:
Philip Feldman,
Aaron Dant,
Wayne Lutters
Abstract:
In the parable of Simon's Ant, an ant follows a complex path along a beach on to reach its goal. The story shows how the interaction of simple rules and a complex environment result in complex behavior. But this relationship can be looked at in another way - given path and rules, we can infer the environment. With a large population of agents - human or animal - it should be possible to build a de…
▽ More
In the parable of Simon's Ant, an ant follows a complex path along a beach on to reach its goal. The story shows how the interaction of simple rules and a complex environment result in complex behavior. But this relationship can be looked at in another way - given path and rules, we can infer the environment. With a large population of agents - human or animal - it should be possible to build a detailed map of a population's social and physical environment. In this abstract, we describe the development of a framework to create such maps of human belief space. These maps are built from the combined trajectories of a large number of agents. Currently, these maps are built using multidimensional agent-based simulation, but the framework is designed to work using data from computer-mediated human communication. Maps incorporating human data should support visualization and navigation of the "plains of research", "fashionable foothills" and "conspiracy cliffs" of human belief spaces.
△ Less
Submitted 15 April, 2018;
originally announced April 2018.
-
This One Simple Trick Disrupts Digital Communities
Authors:
Philip Feldman,
Aaron Dant,
Wayne Lutters
Abstract:
This paper describes an agent based simulation used to model human actions in belief space, a high-dimensional subset of information space associated with opinions. Using insights from animal collective behavior, we are able to simulate and identify behavior patterns that are similar to nomadic, flocking and stampeding patterns of animal groups. These behaviors have analogous manifestations in hum…
▽ More
This paper describes an agent based simulation used to model human actions in belief space, a high-dimensional subset of information space associated with opinions. Using insights from animal collective behavior, we are able to simulate and identify behavior patterns that are similar to nomadic, flocking and stampeding patterns of animal groups. These behaviors have analogous manifestations in human interaction, emerging as solitary explorers, the fashion-conscious, and members of polarized echo chambers. We demonstrate that a small portion of nomadic agents that widely traverse belief space can disrupt a larger population of stampeding agents. Extending the model, we introduce the concept of Adversarial Herding, where bad actors can exploit properties of technologically mediated communication to artificially create self sustaining runaway polarization. We call this condition the Pishkin Effect as it recalls the large scale buffalo stampedes that could be created by native Americans hunters. We then discuss opportunities for system design that could leverage the ability to recognize these negative patterns, and discuss affordances that may disrupt the formation of natural and deliberate echo chambers.
△ Less
Submitted 26 June, 2018; v1 submitted 6 April, 2018;
originally announced April 2018.
