Skip to main content

Showing 1–19 of 19 results for author: Cisneros-Velarde, P

.
  1. arXiv:2406.15492  [pdf

    physics.soc-ph cs.LG cs.MA

    On the Principles behind Opinion Dynamics in Multi-Agent Systems of Large Language Models

    Authors: Pedro Cisneros-Velarde

    Abstract: We study the evolution of opinions inside a population of interacting large language models (LLMs). Every LLM needs to decide how much funding to allocate to an item with three initial possibilities: full, partial, or no funding. We identify biases that drive the exchange of opinions based on the LLM's tendency to (i) find consensus with the other LLM's opinion, (ii) display caution when specifyin… ▽ More

    Submitted 18 June, 2024; originally announced June 2024.

  2. arXiv:2303.00177  [pdf, ps, other

    cs.LG cs.AI

    Finite-sample Guarantees for Nash Q-learning with Linear Function Approximation

    Authors: Pedro Cisneros-Velarde, Sanmi Koyejo

    Abstract: Nash Q-learning may be considered one of the first and most known algorithms in multi-agent reinforcement learning (MARL) for learning policies that constitute a Nash equilibrium of an underlying general-sum Markov game. Its original proof provided asymptotic guarantees and was for the tabular case. Recently, finite-sample guarantees have been provided using more modern RL techniques for the tabul… ▽ More

    Submitted 28 February, 2023; originally announced March 2023.

    Comments: 25 pages. arXiv admin note: text overlap with arXiv:2205.15891

  3. arXiv:2209.15106  [pdf, other

    cs.LG math.OC

    Restricted Strong Convexity of Deep Learning Models with Smooth Activations

    Authors: Arindam Banerjee, Pedro Cisneros-Velarde, Libin Zhu, Mikhail Belkin

    Abstract: We consider the problem of optimization of deep learning models with smooth activation functions. While there exist influential results on the problem from the ``near initialization'' perspective, we shed considerable new light on the problem. In particular, we make two key technical contributions for such models with $L$ layers, $m$ width, and $σ_0^2$ initialization variance. First, for suitable… ▽ More

    Submitted 29 September, 2022; originally announced September 2022.

  4. arXiv:2206.03467  [pdf, other

    cs.AI cs.LG cs.RO

    Discrete State-Action Abstraction via the Successor Representation

    Authors: Amnon Attali, Pedro Cisneros-Velarde, Marco Morales, Nancy M. Amato

    Abstract: While the difficulty of reinforcement learning problems is typically related to the complexity of their state spaces, Abstraction proposes that solutions often lie in simpler underlying latent spaces. Prior works have focused on learning either a continuous or dense abstraction, or require a human to provide one. Information-dense representations capture features irrelevant for solving tasks, and… ▽ More

    Submitted 18 October, 2022; v1 submitted 7 June, 2022; originally announced June 2022.

  5. arXiv:2205.15891  [pdf, ps, other

    cs.LG stat.ML

    One Policy is Enough: Parallel Exploration with a Single Policy is Near-Optimal for Reward-Free Reinforcement Learning

    Authors: Pedro Cisneros-Velarde, Boxiang Lyu, Sanmi Koyejo, Mladen Kolar

    Abstract: Although parallelism has been extensively used in reinforcement learning (RL), the quantitative effects of parallel exploration are not well understood theoretically. We study the benefits of simple parallel exploration for reward-free RL in linear Markov decision processes (MDPs) and two-player zero-sum Markov games (MGs). In contrast to the existing literature, which focuses on approaches that e… ▽ More

    Submitted 1 March, 2023; v1 submitted 31 May, 2022; originally announced May 2022.

    Comments: 50 pages

  6. arXiv:2201.12441  [pdf, other

    stat.ME stat.AP

    Family-wise error rate control in Gaussian graphical model selection via Distributionally Robust Optimization

    Authors: Chau Tran, Pedro Cisneros-Velarde, Sang-Yun Oh, Alexander Petersen

    Abstract: Recently, a special case of precision matrix estimation based on a distributionally robust optimization (DRO) framework has been shown to be equivalent to the graphical lasso. From this formulation, a method for choosing the regularization term, i.e., for graphical model selection, was proposed. In this work, we establish a theoretical connection between the confidence level of graphical model sel… ▽ More

    Submitted 28 January, 2022; originally announced January 2022.

  7. From Contraction Theory to Fixed Point Algorithms on Riemannian and Non-Euclidean Spaces

    Authors: Francesco Bullo, Pedro Cisneros-Velarde, Alexander Davydov, Saber Jafarpour

    Abstract: The design of fixed point algorithms is at the heart of monotone operator theory, convex analysis, and of many modern optimization problems arising in machine learning and control. This tutorial reviews recent advances in understanding the relationship between Demidovich conditions, one-sided Lipschitz conditions, and contractivity theorems. We review the standard contraction theory on Euclidean s… ▽ More

    Submitted 7 October, 2021; originally announced October 2021.

    Comments: Paper in the invited tutorial session "Contraction Theory for Machine Learning" at 60th IEEE Conference on Decision and Control, 2021

  8. arXiv:2105.08832  [pdf, ps, other

    math.OC cs.AI eess.SY

    A Contraction Theory Approach to Optimization Algorithms from Acceleration Flows

    Authors: Pedro Cisneros-Velarde, Francesco Bullo

    Abstract: Much recent interest has focused on the design of optimization algorithms from the discretization of an associated optimization flow, i.e., a system of differential equations (ODEs) whose trajectories solve an associated optimization problem. Such a design approach poses an important problem: how to find a principled methodology to design and discretize appropriate ODEs. This paper aims to provide… ▽ More

    Submitted 31 January, 2022; v1 submitted 18 May, 2021; originally announced May 2021.

    MSC Class: 34D05; 34D23; 34H15; 65L20; 65K05

  9. arXiv:2012.08610  [pdf, other

    eess.SY cs.MA

    Distributed Wasserstein Barycenters via Displacement Interpolation

    Authors: Pedro Cisneros-Velarde, Francesco Bullo

    Abstract: Consider a multi-agent system whereby each agent has an initial probability measure. In this paper, we propose a distributed algorithm based upon stochastic, asynchronous and pairwise exchange of information and displacement interpolation in the Wasserstein space. We characterize the evolution of this algorithm and prove it computes the Wasserstein barycenter of the initial measures under various… ▽ More

    Submitted 25 February, 2022; v1 submitted 15 December, 2020; originally announced December 2020.

    Comments: 25 pages, 4 figures

    MSC Class: 60J20 (Primary); 49N99; 46N10 (Secondary)

  10. arXiv:2010.01219  [pdf, other

    math.OC eess.SY

    Contraction Theory for Dynamical Systems on Hilbert Spaces

    Authors: Pedro Cisneros-Velarde, Saber Jafarpour, Francesco Bullo

    Abstract: Contraction theory for dynamical systems on Euclidean spaces is well-established. For contractive (resp. semi-contractive) systems, the distance (resp. semi-distance) between any two trajectories decreases exponentially fast. For partially contractive systems, each trajectory converges exponentially fast to an invariant subspace. In this note, we develop contraction theory on Hilbert spaces. Fir… ▽ More

    Submitted 4 June, 2021; v1 submitted 2 October, 2020; originally announced October 2020.

    MSC Class: 34G20; 93D23 (Primary) 93D23; 37N99; 93D20 (Secondary)

  11. arXiv:2005.11404  [pdf, other

    math.OC eess.SY physics.bio-ph

    Multi-group SIS Epidemics with Simplicial and Higher-Order Interactions

    Authors: Pedro Cisneros-Velarde, Francesco Bullo

    Abstract: This paper analyzes a Susceptible-Infected-Susceptible (SIS) model of epidemic propagation over hypergraphs and, motivated by an important special case, we refer to the model as to the simplicial SIS model. Classically, the multi-group SIS model has assumed pairwise interactions of contagion across groups and thus has been vastly studied in the literature. It is only recently that a renewed specia… ▽ More

    Submitted 3 October, 2021; v1 submitted 22 May, 2020; originally announced May 2020.

    MSC Class: 92B05; 37N25; 37N99

  12. arXiv:2005.09774  [pdf, other

    eess.SY math.OC

    Weak and Semi-Contraction for Network Systems and Diffusively-Coupled Oscillators

    Authors: Saber Jafarpour, Pedro Cisneros-Velarde, Francesco Bullo

    Abstract: We develop two generalizations of contraction theory, namely, semi-contraction and weak-contraction theory. First, using the notion of semi-norm, we propose a geometric framework for semi-contraction theory. We introduce matrix semi-measures and characterize their properties. We show that the spectral abscissa of a matrix is the infimum over weighted semi-measures. For dynamical systems, we use th… ▽ More

    Submitted 4 October, 2020; v1 submitted 19 May, 2020; originally announced May 2020.

  13. arXiv:2003.12665  [pdf, other

    eess.SY cs.MA

    Distributed and time-varying primal-dual dynamics via contraction analysis

    Authors: Pedro Cisneros-Velarde, Saber Jafarpour, Francesco Bullo

    Abstract: In this note, we provide an overarching analysis of primal-dual dynamics associated to linear equality-constrained optimization problems using contraction analysis. For the well-known standard version of the problem: we establish convergence under convexity and the contracting rate under strong convexity. Then, for a canonical distributed optimization problem, we use partial contractivity to estab… ▽ More

    Submitted 19 June, 2021; v1 submitted 27 March, 2020; originally announced March 2020.

    MSC Class: 34H05 (Primary); 34D23; 90C25; 93C95 (Secondary) ACM Class: G.1.7; G.1.6

  14. A Network Formation Game for the Emergence of Hierarchies

    Authors: Pedro Cisneros-Velarde, Francesco Bullo

    Abstract: We propose a novel network formation game that explains the emergence of various hierarchical structures in groups where self-interested or utility-maximizing individuals decide to establish or severe relationships of authority or collaboration among themselves. We consider two settings: we first consider individuals who do not seek the other party's consent when establishing a relationship and th… ▽ More

    Submitted 9 July, 2020; v1 submitted 14 January, 2020; originally announced January 2020.

    MSC Class: 05C57 (Primary); 91A43; 91A80; 91A50; 91A25 (Secondary)

  15. arXiv:1909.11281  [pdf, other

    eess.SY

    Structural Balance via Gradient Flows over Signed Graphs

    Authors: Pedro Cisneros-Velarde, Noah E. Friedkin, Anton V. Proskurnikov, Francesco Bullo

    Abstract: Structural balance is a classic property of signed graphs satisfying Heider's seminal axioms. Mathematical sociologists have studied balance theory since its inception in the 1040s. Recent research has focused on the development of dynamic models explaining the emergence of structural balance. In this paper, we introduce a novel class of parsimonious dynamic models for structural balance based on… ▽ More

    Submitted 20 September, 2019; originally announced September 2019.

  16. arXiv:1905.08975  [pdf, other

    stat.ML cs.LG math.ST

    Distributionally Robust Formulation and Model Selection for the Graphical Lasso

    Authors: Pedro Cisneros-Velarde, Sang-Yun Oh, Alexander Petersen

    Abstract: Building on a recent framework for distributionally robust optimization, we consider estimation of the inverse covariance matrix for multivariate data. We provide a novel notion of a Wasserstein ambiguity set specifically tailored to this estimation problem, leading to a tractable class of regularized estimators. Special cases include penalized likelihood estimators for Gaussian data, specifically… ▽ More

    Submitted 5 October, 2019; v1 submitted 22 May, 2019; originally announced May 2019.

    MSC Class: 62F35; 62F40; 90C90

  17. arXiv:1904.02902  [pdf, other

    cs.SI physics.soc-ph

    Signed Network Formation Games and Clustering Balance

    Authors: Pedro Cisneros-Velarde, Francesco Bullo

    Abstract: We propose a signed network formation game, in which pairs of individuals strategically change the signs of the edges in a complete network. These individuals are members of a social network who strategically reduce cognitive dissonances by changing their interpersonal appraisals. We characterize the best-response dynamics for this game and prove that its implementation \pc{can} dynamically drive… ▽ More

    Submitted 28 September, 2019; v1 submitted 5 April, 2019; originally announced April 2019.

    Comments: 15 pages, 3 figures

    MSC Class: 91A80

  18. arXiv:1902.00658  [pdf, other

    cs.SI physics.soc-ph

    Polarization and Fluctuations in Signed Social Networks

    Authors: Pedro Cisneros-Velarde, Kevin S. Chan, Francesco Bullo

    Abstract: Much recent research on social networks has focused on the modeling and analysis of how opinions evolve as a function of interpersonal relationships. It is also of great interest to model and understand the implications of friendly and antagonistic relationships. In this paper, we propose a new, simple and intuitive model that incorporates the socio-psychological phenomenon of the boomerang effect… ▽ More

    Submitted 3 October, 2019; v1 submitted 2 February, 2019; originally announced February 2019.

    Comments: 15 pages, 9 figures

  19. arXiv:1710.09498  [pdf, other

    cs.SI

    Dynamic Social Balance and Convergent Appraisals via Homophily and Influence Mechanisms

    Authors: Wenjun Mei, Pedro Cisneros-Velarde, Ge Chen, Noah E. Friedkin, Francesco Bullo

    Abstract: Social balance theory describes allowable and forbidden configurations of the topologies of signed directed social appraisal networks. In this paper, we propose two discrete-time dynamical systems that explain how an appraisal network \textcolor{blue}{converges to} social balance from an initially unbalanced configuration. These two models are based on two different socio-psychological mechanisms… ▽ More

    Submitted 13 September, 2019; v1 submitted 25 October, 2017; originally announced October 2017.

    MSC Class: 91D30; 37N99; 93A30