-
Towards Collective Superintelligence: Amplifying Group IQ using Conversational Swarms
Authors:
Louis Rosenberg,
Gregg Willcox,
Hans Schumann,
Ganesh Mani
Abstract:
Swarm Intelligence (SI) is a natural phenomenon that enables biological groups to amplify their combined intellect by forming real-time systems. Artificial Swarm Intelligence (or Swarm AI) is a technology that enables networked human groups to amplify their combined intelligence by forming similar systems. In the past, swarm-based methods were constrained to narrowly defined tasks like probabilist…
▽ More
Swarm Intelligence (SI) is a natural phenomenon that enables biological groups to amplify their combined intellect by forming real-time systems. Artificial Swarm Intelligence (or Swarm AI) is a technology that enables networked human groups to amplify their combined intelligence by forming similar systems. In the past, swarm-based methods were constrained to narrowly defined tasks like probabilistic forecasting and multiple-choice decision making. A new technology called Conversational Swarm Intelligence (CSI) was developed in 2023 that amplifies the decision-making accuracy of networked human groups through natural conversational deliberations. The current study evaluated the ability of real-time groups using a CSI platform to take a common IQ test known as Raven's Advanced Progressive Matrices (RAPM). First, a baseline group of participants took the Raven's IQ test by traditional survey. This group averaged 45.6% correct. Then, groups of approximately 35 individuals answered IQ test questions together using a CSI platform called Thinkscape. These groups averaged 80.5% correct. This places the CSI groups in the 97th percentile of IQ test-takers and corresponds to an effective IQ increase of 28 points (p<0.001). This is an encouraging result and suggests that CSI is a powerful method for enabling conversational collective intelligence in large, networked groups. In addition, because CSI is scalable across groups of potentially any size, this technology may provide a viable pathway to building a Collective Superintelligence.
△ Less
Submitted 25 January, 2024;
originally announced January 2024.
-
Conversational Swarm Intelligence amplifies the accuracy of networked groupwise deliberations
Authors:
Louis Rosenberg,
Gregg Willcox,
Hans Schumann,
Ganesh Mani
Abstract:
Conversational Swarm Intelligence (CSI) is a communication technology that enables large, networked groups (25 to 2500 people) to hold real-time conversational deliberations online. Modeled on the dynamics of biological swarms, CSI enables the reasoning benefits of small-groups with the collective intelligence benefits of large-groups. In this pilot study, groups of 25 to 30 participants were aske…
▽ More
Conversational Swarm Intelligence (CSI) is a communication technology that enables large, networked groups (25 to 2500 people) to hold real-time conversational deliberations online. Modeled on the dynamics of biological swarms, CSI enables the reasoning benefits of small-groups with the collective intelligence benefits of large-groups. In this pilot study, groups of 25 to 30 participants were asked to select players for a weekly Fantasy Football contest over an 11-week period. As a baseline, participants filled out a survey to record their player selections. As an experimental method, participants engaged in a real-time text-chat deliberation using a CSI platform called Thinkscape to collaboratively select sets of players. The results show that the real-time conversational group using CSI outperformed 66% of survey participants, demonstrating significant amplification of intelligence versus the median individual (p=0.020). The CSI method also significantly outperformed the most popular choices from the survey (the Wisdom of Crowd, p<0.001). These results suggest that CSI is an effective technology for amplifying the intelligence of groups engaged in real-time large-scale conversational deliberation and may offer a path to collective superintelligence.
△ Less
Submitted 19 December, 2023;
originally announced January 2024.
-
Towards Collective Superintelligence, a Pilot Study
Authors:
Louis Rosenberg,
Gregg Willcox,
Hans Schumann
Abstract:
Conversational Swarm Intelligence (CSI) is a new technology that enables human groups of potentially any size to hold real-time deliberative conversations online. Modeled on the dynamics of biological swarms, CSI aims to optimize group insights and amplify group intelligence. It uses Large Language Models (LLMs) in a novel framework to structure large-scale conversations, combining the benefits of…
▽ More
Conversational Swarm Intelligence (CSI) is a new technology that enables human groups of potentially any size to hold real-time deliberative conversations online. Modeled on the dynamics of biological swarms, CSI aims to optimize group insights and amplify group intelligence. It uses Large Language Models (LLMs) in a novel framework to structure large-scale conversations, combining the benefits of small-group deliberative reasoning and large-group collective intelligence. In this study, a group of 241 real-time participants were asked to estimate the number of gumballs in a jar by looking at a photo. In one test case, individual participants entered their estimation in a standard survey. In another test case, participants converged on groupwise estimates collaboratively using a prototype CSI text-chat platform called Thinkscape. The results show that when using CSI, the group of 241 participants estimated within 12% of the correct answer, which was significantly more accurate (p<0.001) than the average individual (mean error of 55%) and the survey-based Wisdom of Crowd (error of 25%). The group using CSI was also more accurate than an estimate generated by GPT 4 (error of 42%). This suggests that CSI is a viable method for enabling large, networked groups to hold coherent real-time deliberative conversations that amplify collective intelligence. Because this technology is scalable, it could provide a possible pathway towards building a general-purpose Collective Superintelligence (CSi).
△ Less
Submitted 31 October, 2023;
originally announced November 2023.
-
Conversational Swarm Intelligence (CSI) Enables Rapid Group Insights
Authors:
Louis Rosenberg,
Gregg Willcox,
Hans Schumann
Abstract:
When generating insights from human groups, conversational deliberation is a key method for exploring issues, surfacing ideas, debating options, and converging on solutions. Unfortunately, real-time conversations are difficult to scale, losing effectiveness in groups above 4 to 7 members. Conversational Swarm Intelligence (CSI) is a new technology that enables large human groups to hold real-time…
▽ More
When generating insights from human groups, conversational deliberation is a key method for exploring issues, surfacing ideas, debating options, and converging on solutions. Unfortunately, real-time conversations are difficult to scale, losing effectiveness in groups above 4 to 7 members. Conversational Swarm Intelligence (CSI) is a new technology that enables large human groups to hold real-time conversations using techniques modeled on the dynamics of biological swarms. Through a novel use of Large Language Models (LLMs), CSI enables real-time dialog among small groups while simultaneously fostering content propagation across a much larger group. This combines the benefits of small-scale deliberative reasoning and large-scale groupwise intelligence. In this study, we engage a group of 81 American voters from one political party in real-time deliberation using a CSI platform called Thinkscape. We then task the group with (a) forecasting which candidate from a set of options will achieve the most national support, and (b) indicating the specific reasons for this result. After only six minutes of deliberation, the group of 81 individuals converged on a selected candidate and surfaced over 400 reasons justifying various candidates, including 206 justifications that supported the selected candidate. We find that the selected candidate was significantly more supported by group members than the other options (p<0.001) and that this effect held even after six minutes of deliberation, demonstrating that CSI provides both the qualitative benefits of conversational focus groups and the quantitative benefits of largescale polling.
△ Less
Submitted 30 September, 2023;
originally announced October 2023.
-
Conversational Swarm Intelligence (CSI) Enhances Groupwise Deliberation
Authors:
Louis Rosenberg,
Gregg Willcox,
Hans Schumann,
Ganesh Mani
Abstract:
Real-time conversational deliberation is a critical groupwise method for reaching decisions, solving problems, evaluating priorities, generating ideas, and producing insights. Unfortunately, real-time conversations are difficult to scale, losing effectiveness as groups grow above 5 to 7 members. Conversational Swarm Intelligence (CSI) is a new technology modeled on the dynamics of biological swarm…
▽ More
Real-time conversational deliberation is a critical groupwise method for reaching decisions, solving problems, evaluating priorities, generating ideas, and producing insights. Unfortunately, real-time conversations are difficult to scale, losing effectiveness as groups grow above 5 to 7 members. Conversational Swarm Intelligence (CSI) is a new technology modeled on the dynamics of biological swarms. It aims to enable networked groups of any size to hold productive real-time deliberations that converge on unified solutions. CSI leverages the power of Large Language Models (LLMs) in a unique and powerful way, allowing real-time dialog among small local groups while simultaneously enabling efficient content propagation across much larger populations. In this way, CSI combines the benefits of small-scale deliberative reasoning and large-scale collective intelligence. In this study, we compare deliberative groups of 48 people using standard online chat to the same sized groups using a prototype chat-based CSI system called Thinkscape. Results show that participants using CSI contributed 51% more content (p<0.001) than those using standard chat, and the deliberations using CSI showed 37% less difference in contribution quantity between the most active vs least active members, indicating more balanced dialog. And finally, a large majority of participants preferred deliberating using the CSI system over standard chat (p<0.05) and re-ported feeling more impactful when doing so (p<0.01). These results suggest that Conversational Swarm Intelligence is a promising technology for enabling large-scale deliberation.
△ Less
Submitted 14 September, 2023;
originally announced September 2023.
-
Conversational Swarm Intelligence, a Pilot Study
Authors:
Louis Rosenberg,
Gregg Willcox,
Hans Schumann,
Miles Bader,
Ganesh Mani,
Kokoro Sagae,
Devang Acharya,
Yuxin Zheng,
Andrew Kim,
Jialing Deng
Abstract:
Conversational Swarm Intelligence (CSI) is a new method for enabling large human groups to hold real-time networked conversations using a technique modeled on the dynamics of biological swarms. Through the novel use of conversational agents powered by Large Language Models (LLMs), the CSI structure simultaneously enables local dialog among small deliberative groups and global propagation of conver…
▽ More
Conversational Swarm Intelligence (CSI) is a new method for enabling large human groups to hold real-time networked conversations using a technique modeled on the dynamics of biological swarms. Through the novel use of conversational agents powered by Large Language Models (LLMs), the CSI structure simultaneously enables local dialog among small deliberative groups and global propagation of conversational content across a larger population. In this way, CSI combines the benefits of small-group deliberative reasoning and large-scale collective intelligence. In this pilot study, participants deliberating in conversational swarms (via text chat) (a) produced 30% more contributions (p<0.05) than participants deliberating in a standard centralized chat room and (b) demonstrated 7.2% less variance in contribution quantity. These results indicate that users contributed more content and participated more evenly when using the CSI structure.
△ Less
Submitted 31 August, 2023;
originally announced September 2023.
-
DECISIVE Benchmarking Data Report: sUAS Performance Results from Phase I
Authors:
Adam Norton,
Reza Ahmadzadeh,
Kshitij Jerath,
Paul Robinette,
Jay Weitzen,
Thanuka Wickramarathne,
Holly Yanco,
Minseop Choi,
Ryan Donald,
Brendan Donoghue,
Christian Dumas,
Peter Gavriel,
Alden Giedraitis,
Brendan Hertel,
Jack Houle,
Nathan Letteri,
Edwin Meriaux,
Zahra Rezaei Khavas,
Rakshith Singh,
Gregg Willcox,
Naye Yoni
Abstract:
This report reviews all results derived from performance benchmarking conducted during Phase I of the Development and Execution of Comprehensive and Integrated Subterranean Intelligent Vehicle Evaluations (DECISIVE) project by the University of Massachusetts Lowell, using the test methods specified in the DECISIVE Test Methods Handbook v1.1 for evaluating small unmanned aerial systems (sUAS) perfo…
▽ More
This report reviews all results derived from performance benchmarking conducted during Phase I of the Development and Execution of Comprehensive and Integrated Subterranean Intelligent Vehicle Evaluations (DECISIVE) project by the University of Massachusetts Lowell, using the test methods specified in the DECISIVE Test Methods Handbook v1.1 for evaluating small unmanned aerial systems (sUAS) performance in subterranean and constrained indoor environments, spanning communications, field readiness, interface, obstacle avoidance, navigation, map**, autonomy, trust, and situation awareness. Using those 20 test methods, over 230 tests were conducted across 8 sUAS platforms: Cleo Robotics Dronut X1P (P = prototype), FLIR Black Hornet PRS, Flyability Elios 2 GOV, Lumenier Nighthawk V3, Parrot ANAFI USA GOV, Skydio X2D, Teal Golden Eagle, and Vantage Robotics Vesper. Best in class criteria is specified for each applicable test method and the sUAS that match this criteria are named for each test method, including a high-level executive summary of their performance.
△ Less
Submitted 20 January, 2023; v1 submitted 18 January, 2023;
originally announced January 2023.
-
DECISIVE Test Methods Handbook: Test Methods for Evaluating sUAS in Subterranean and Constrained Indoor Environments, Version 1.1
Authors:
Adam Norton,
Reza Ahmadzadeh,
Kshitij Jerath,
Paul Robinette,
Jay Weitzen,
Thanuka Wickramarathne,
Holly Yanco,
Minseop Choi,
Ryan Donald,
Brendan Donoghue,
Christian Dumas,
Peter Gavriel,
Alden Giedraitis,
Brendan Hertel,
Jack Houle,
Nathan Letteri,
Edwin Meriaux,
Zahra Rezaei Khavas,
Rakshith Singh,
Gregg Willcox,
Naye Yoni
Abstract:
This handbook outlines all test methods developed under the Development and Execution of Comprehensive and Integrated Subterranean Intelligent Vehicle Evaluations (DECISIVE) project by the University of Massachusetts Lowell for evaluating small unmanned aerial systems (sUAS) performance in subterranean and constrained indoor environments, spanning communications, field readiness, interface, obstac…
▽ More
This handbook outlines all test methods developed under the Development and Execution of Comprehensive and Integrated Subterranean Intelligent Vehicle Evaluations (DECISIVE) project by the University of Massachusetts Lowell for evaluating small unmanned aerial systems (sUAS) performance in subterranean and constrained indoor environments, spanning communications, field readiness, interface, obstacle avoidance, navigation, map**, autonomy, trust, and situation awareness. For sUAS deployment in subterranean and constrained indoor environments, this puts forth two assumptions about applicable sUAS to be evaluated using these test methods: (1) able to operate without access to GPS signal, and (2) width from prop top to prop tip does not exceed 91 cm (36 in) wide (i.e., can physically fit through a typical doorway, although successful navigation through is not guaranteed). All test methods are specified using a common format: Purpose, Summary of Test Method, Apparatus and Artifacts, Equipment, Metrics, Procedure, and Example Data. All test methods are designed to be run in real-world environments (e.g., MOUT sites) or using fabricated apparatuses (e.g., test bays built from wood, or contained inside of one or more ship** containers).
△ Less
Submitted 20 January, 2023; v1 submitted 1 November, 2022;
originally announced November 2022.
