Showing 1–3 of 3 results for author: Dover, Y

Systematic Biases in LLM Simulations of Debates

Authors: Amir Taubenfeld, Yaniv Dover, Roi Reichart, Ariel Goldstein

Abstract: Recent advancements in natural language processing, especially the emergence of Large Language Models (LLMs), have opened exciting possibilities for constructing computational simulations designed to replicate human behavior accurately. However, LLMs are complex statistical learners without straightforward deductive rules, making them prone to unexpected behaviors. In this study, we highlight the… ▽ More Recent advancements in natural language processing, especially the emergence of Large Language Models (LLMs), have opened exciting possibilities for constructing computational simulations designed to replicate human behavior accurately. However, LLMs are complex statistical learners without straightforward deductive rules, making them prone to unexpected behaviors. In this study, we highlight the limitations of LLMs in simulating human interactions, particularly focusing on LLMs' ability to simulate political debates. Our findings indicate a tendency for LLM agents to conform to the model's inherent social biases despite being directed to debate from certain political perspectives. This tendency results in behavioral patterns that seem to deviate from well-established social dynamics among humans. We reinforce these observations using an automatic self-fine-tuning method, which enables us to manipulate the biases within the LLM and demonstrate that agents subsequently align with the altered biases. These results underscore the need for further research to develop methods that help agents overcome these biases, a critical step toward creating more realistic simulations. △ Less

Submitted 6 February, 2024; originally announced February 2024.

Sustainable Online Communities Exhibit Distinct Hierarchical Structures Across Scales of Size

Authors: Yaniv Dover, Jacob Goldenberg, Daniel Shapira

Abstract: Online communities exist in many forms and sizes, and are a source of considerable influence for individuals and organizations. Yet, there is limited insight into why some online communities are sustainable, while others cease to exist. We find that communities that fail to maintain a typical hierarchical social structure which balances cohesiveness across size scales do not survive, and can be di… ▽ More Online communities exist in many forms and sizes, and are a source of considerable influence for individuals and organizations. Yet, there is limited insight into why some online communities are sustainable, while others cease to exist. We find that communities that fail to maintain a typical hierarchical social structure which balances cohesiveness across size scales do not survive, and can be distinguished from communities that exhibit such balance and prevail in the long term. Moreover, in an analysis of 10,122 real-life online communities with a total of 134,747 members over a period of more than a decade, we find that map** the community social circle structure in the first 30 days of its lifetime is sufficient to forecast the survival of the community up to ten years in the future. By varying calibration time frames, the aspects of the social structure that allows for predictive power emerge and fixate within the first couple of months in a community's lifetime. △ Less

Submitted 20 March, 2018; originally announced March 2018.

Emergence of online communities: Empirical evidence and theory

Authors: Yaniv Dover, Guy Kelman

Abstract: Online communities, which have become an integral part of the day-to-day life of people and organizations, exhibit much diversity in both size and activity level; some communities grow to a massive scale and thrive, whereas others remain small, and even wither. In spite of the important role of these proliferating communities, there is limited empirical evidence that identifies the dominant factor… ▽ More Online communities, which have become an integral part of the day-to-day life of people and organizations, exhibit much diversity in both size and activity level; some communities grow to a massive scale and thrive, whereas others remain small, and even wither. In spite of the important role of these proliferating communities, there is limited empirical evidence that identifies the dominant factors underlying their dynamics. Using data collected from seven large online platforms, we observe a universal relationship between online community size and its activity: First, three distinct activity regimes exist, one of low-activity and two of high-activity. Further, we find a sharp activity phase transition at a critical community size that marks the shift between the first and the second regime. Essentially, it is around this critical size that sustainable interactive communities emerge. Finally, above a higher characteristic size, community activity reaches and remains at a constant and high level to form the third regime. We propose that the sharp activity phase transition and the regime structure stem from the branching property of online interactions. Branching results in the emergence of multiplicative growth of the interactions above certain community sizes. △ Less

Submitted 9 November, 2017; originally announced November 2017.