Showing 1–50 of 184 results for author: Dean, S

Singular viscoelastic perturbation to soft lubrication

Authors: Bharti Bharti, Quentin Ferreira, Aditya Jha, Andreas Carlson, David S. Dean, Yacine Amarouchene, Tak Shing Chan, Thomas Salez

Abstract: Soft lubrication has been shown to drastically affect the mobility of an object immersed in a viscous fluid in the vicinity of a purely elastic wall. In this theoretical study, we develop a minimal model incorporating viscoelasticity, carrying out a perturbation analysis in both the elastic deformation of the wall and its viscous dam**. Our approach reveals the singular-perturbation nature of… ▽ More Soft lubrication has been shown to drastically affect the mobility of an object immersed in a viscous fluid in the vicinity of a purely elastic wall. In this theoretical study, we develop a minimal model incorporating viscoelasticity, carrying out a perturbation analysis in both the elastic deformation of the wall and its viscous dam**. Our approach reveals the singular-perturbation nature of viscoelasticity to soft lubrication. Numerical resolution of the resulting non-linear, singular and coupled equations of motion reveals peculiar effects of viscoelasticity on confined colloidal mobility, opening the way towards the description of complex migration scenarios near realistic polymeric substrates and biological membranes. △ Less

Submitted 5 July, 2024; originally announced July 2024.

Harm Mitigation in Recommender Systems under User Preference Dynamics

Authors: Jerry Chee, Shankar Kalyanaraman, Sindhu Kiranmai Ernala, Udi Weinsberg, Sarah Dean, Stratis Ioannidis

Abstract: We consider a recommender system that takes into account the interplay between recommendations, the evolution of user interests, and harmful content. We model the impact of recommendations on user behavior, particularly the tendency to consume harmful content. We seek recommendation policies that establish a tradeoff between maximizing click-through rate (CTR) and mitigating harm. We establish con… ▽ More We consider a recommender system that takes into account the interplay between recommendations, the evolution of user interests, and harmful content. We model the impact of recommendations on user behavior, particularly the tendency to consume harmful content. We seek recommendation policies that establish a tradeoff between maximizing click-through rate (CTR) and mitigating harm. We establish conditions under which the user profile dynamics have a stationary point, and propose algorithms for finding an optimal recommendation policy at stationarity. We experiment on a semi-synthetic movie recommendation setting initialized with real data and observe that our policies outperform baselines at simultaneously maximizing CTR and mitigating harm. △ Less

Submitted 14 June, 2024; originally announced June 2024.

Comments: Recommender Systems; Harm Mitigation; Amplification; User Preference Modeling

Random Features Approximation for Control-Affine Systems

Authors: Kimia Kazemian, Yahya Sattar, Sarah Dean

Abstract: Modern data-driven control applications call for flexible nonlinear models that are amenable to principled controller synthesis and realtime feedback. Many nonlinear dynamical systems of interest are control affine. We propose two novel classes of nonlinear feature representations which capture control affine structure while allowing for arbitrary complexity in the state dependence. Our methods ma… ▽ More Modern data-driven control applications call for flexible nonlinear models that are amenable to principled controller synthesis and realtime feedback. Many nonlinear dynamical systems of interest are control affine. We propose two novel classes of nonlinear feature representations which capture control affine structure while allowing for arbitrary complexity in the state dependence. Our methods make use of random features (RF) approximations, inheriting the expressiveness of kernel methods at a lower computational cost. We formalize the representational capabilities of our methods by showing their relationship to the Affine Dot Product (ADP) kernel proposed by Castañeda et al. (2021) and a novel Affine Dense (AD) kernel that we introduce. We further illustrate the utility by presenting a case study of data-driven optimization-based control using control certificate functions (CCF). Simulation experiments on a double pendulum empirically demonstrate the advantages of our methods. △ Less

Submitted 10 June, 2024; v1 submitted 10 June, 2024; originally announced June 2024.

Comments: 25 pages, 3 figures

Learning from Streaming Data when Users Choose

Authors: **yan Su, Sarah Dean

Abstract: In digital markets comprised of many competing services, each user chooses between multiple service providers according to their preferences, and the chosen service makes use of the user data to incrementally improve its model. The service providers' models influence which service the user will choose at the next time step, and the user's choice, in return, influences the model update, leading to… ▽ More In digital markets comprised of many competing services, each user chooses between multiple service providers according to their preferences, and the chosen service makes use of the user data to incrementally improve its model. The service providers' models influence which service the user will choose at the next time step, and the user's choice, in return, influences the model update, leading to a feedback loop. In this paper, we formalize the above dynamics and develop a simple and efficient decentralized algorithm to locally minimize the overall user loss. Theoretically, we show that our algorithm asymptotically converges to stationary points of of the overall loss almost surely. We also experimentally demonstrate the utility of our algorithm with real world data. △ Less

Submitted 3 June, 2024; originally announced June 2024.

Comments: Accepted by ICML24

To Ask or Not To Ask: Human-in-the-loop Contextual Bandits with Applications in Robot-Assisted Feeding

Authors: Rohan Banerjee, Rajat Kumar Jenamani, Sidharth Vasudev, Amal Nanavati, Sarah Dean, Tapomayukh Bhattacharjee

Abstract: Robot-assisted bite acquisition involves picking up food items that vary in their shape, compliance, size, and texture. A fully autonomous strategy for bite acquisition is unlikely to efficiently generalize to this wide variety of food items. We propose to leverage the presence of the care recipient to provide feedback when the system encounters novel food items. However, repeatedly asking for hel… ▽ More Robot-assisted bite acquisition involves picking up food items that vary in their shape, compliance, size, and texture. A fully autonomous strategy for bite acquisition is unlikely to efficiently generalize to this wide variety of food items. We propose to leverage the presence of the care recipient to provide feedback when the system encounters novel food items. However, repeatedly asking for help imposes cognitive workload on the user. In this work, we formulate human-in-the-loop bite acquisition within a contextual bandit framework and propose a novel method, LinUCB-QG, that selectively asks for help. This method leverages a predictive model of cognitive workload in response to different types and timings of queries, learned using data from 89 participants collected in an online user study. We demonstrate that this method enhances the balance between task performance and cognitive workload compared to autonomous and querying baselines, through experiments in a food dataset-based simulator and a user study with 18 participants without mobility limitations. △ Less

Submitted 11 May, 2024; originally announced May 2024.

Comments: Under submission to IROS 2024. The second and third authors contributed equally. The last two authors advised equally

Metasurface-based Toroidal Lenslet Array Design for Addressing Laser Guide Star Elongation

Authors: Josephine Munro, Sarah E. Dean, Neuton Li, Israel J. Vaughn, Andrew W. Kruse, Tony Travouillon, Dragomir N. Neshev, Robert Sharp, Andrey A. Sukhorukov

Abstract: The Giant Magellan Telescope will use laser tomography adaptive optics to correct for atmospheric turbulence using artificial guide stars created in the sodium layer of the atmosphere (altitude ~95km). The sodium layer has appreciable thickness (~11km) and this results in the laser guide star being an elongated cylinder shape. Wavefront sensing with a Shack-Hartmann is challenging, as subapertures… ▽ More The Giant Magellan Telescope will use laser tomography adaptive optics to correct for atmospheric turbulence using artificial guide stars created in the sodium layer of the atmosphere (altitude ~95km). The sodium layer has appreciable thickness (~11km) and this results in the laser guide star being an elongated cylinder shape. Wavefront sensing with a Shack-Hartmann is challenging, as subapertures located further away from the laser launch position image an increasingly elongated perspective of the laser guide star. Large detectors can be used to adequately pack and sample the images on the detector, however, this increases readout noise and limits the design space available for the wavefront sensor. To tackle this challenge, we propose an original solution based on nano-engineered meta-optics tailored to produce a spatially varying anamorphic image scale compression. We present meta-lenslet array designs that can deliver ~100% of the full anamorphic image size reduction required for focal lengths down to 8mm, and greater than 50% image size reduction for focal lengths down to 2mm. This will allow greatly improved sampling of the available information across the whole wavefront sensor, while still being a viable design within the limits of current-generation fabrication facilities. △ Less

Submitted 29 April, 2024; originally announced April 2024.

Accounting for AI and Users Sha** One Another: The Role of Mathematical Models

Authors: Sarah Dean, Evan Dong, Meena Jagadeesan, Liu Leqi

Abstract: As AI systems enter into a growing number of societal domains, these systems increasingly shape and are shaped by user preferences, opinions, and behaviors. However, the design of AI systems rarely accounts for how AI and users shape one another. In this position paper, we argue for the development of formal interaction models which mathematically specify how AI and users shape one another. Formal… ▽ More As AI systems enter into a growing number of societal domains, these systems increasingly shape and are shaped by user preferences, opinions, and behaviors. However, the design of AI systems rarely accounts for how AI and users shape one another. In this position paper, we argue for the development of formal interaction models which mathematically specify how AI and users shape one another. Formal interaction models can be leveraged to (1) specify interactions for implementation, (2) monitor interactions through empirical analysis, (3) anticipate societal impacts via counterfactual analysis, and (4) control societal impacts via interventions. The design space of formal interaction models is vast, and model design requires careful consideration of factors such as style, granularity, mathematical complexity, and measurability. Using content recommender systems as a case study, we critically examine the nascent literature of formal interaction models with respect to these use-cases and design axes. More broadly, we call for the community to leverage formal interaction models when designing, evaluating, or auditing any AI system which interacts with users. △ Less

Submitted 18 April, 2024; originally announced April 2024.

Correlation decoupling of Casimir interaction in an electrolyte driven by external electric fields

Authors: Guangle Du, David S. Dean, Bing Miao, Rudolf Podgornik

Abstract: It has been established for a long time that the long range van der Waals or thermal Casimir interaction between two semi-infinite dielectrics separated by a distance $H$ is screened by an intervening electrolyte. Here we show how this interaction is modified when an electric field of strength $E$ is applied parallel to the dielectric boundaries, leading to a non-equilibrium steady state with a cu… ▽ More It has been established for a long time that the long range van der Waals or thermal Casimir interaction between two semi-infinite dielectrics separated by a distance $H$ is screened by an intervening electrolyte. Here we show how this interaction is modified when an electric field of strength $E$ is applied parallel to the dielectric boundaries, leading to a non-equilibrium steady state with a current. The presence of the field induces a long range thermal repulsive interaction, scaling just like the thermal Casimir interaction between dielectrics without the intervening electrolyte, {\em i.e.} as $1/H^3$. At small $E$ the effect is of order $E^2$ while at large fields it saturates to an $E$ independent value. We explain the results in terms of a decoupling mechanism between the charge density fluctuations of cations and anions at large applied fields. △ Less

Submitted 9 April, 2024; originally announced April 2024.

Comments: 6 pages, 2 figures

Uphill drift in the absence of current in single-file diffusion

Authors: Benjamin Sorkin, David S. Dean

Abstract: Single-file diffusion is a paradigmatic model for the transport of Brownian colloidal particles in narrow one-dimensional channels, such as those found in certain porous media, where the particles cannot cross each other. We consider a system where a different external uniform potential is present to the right and left of an origin. For example, this is the case when two channels meeting at the or… ▽ More Single-file diffusion is a paradigmatic model for the transport of Brownian colloidal particles in narrow one-dimensional channels, such as those found in certain porous media, where the particles cannot cross each other. We consider a system where a different external uniform potential is present to the right and left of an origin. For example, this is the case when two channels meeting at the origin have different radii. In equilibrium, the chemical potential of the particles are equal, the density is thus lower in the region with the higher potential, and by definition there is no net current in the system. Remarkably, a single-file tracer particle initially located at the origin, with position denoted by $Y(t)$, exhibits an average {\em up-hill} drift toward the region of {\em highest} potential. This drift has the late time behavior $\langle Y(t)\rangle= C t^{1/4}$, where the prefactor $C$ depends on the initial particle arrangement. This surprising result is shown analytically by computing the first two moments of $Y(t)$ through a simple and physically-illuminating method, and also via extensive numerical simulations. △ Less

Submitted 27 March, 2024; originally announced March 2024.

Comments: 17 pages, 10 figures

Self-phoretic oscillatory motion in a harmonic trap

Authors: A. Alexandre, L. Anderson, T. Collin-Dufresne, T. Guérin, D. S. Dean

Abstract: We consider the motion of a harmonically trapped overdamped particle, which is submitted to a self-phoretic force, that is proportional to the gradient of a diffusive field for which the particle itself is the source. In agreement with existing results for free particles or particles in a bounded domain, we find that the system exhibits a transition between an immobile phase, where the particle st… ▽ More We consider the motion of a harmonically trapped overdamped particle, which is submitted to a self-phoretic force, that is proportional to the gradient of a diffusive field for which the particle itself is the source. In agreement with existing results for free particles or particles in a bounded domain, we find that the system exhibits a transition between an immobile phase, where the particle stays at the center of the trap, and an oscillatory state. We perform an exact analysis giving access to the bifurcation threshold, as well as the frequency of oscillations and their amplitude near the threshold. Our analysis also characterizes the shape of two-dimensional oscillations, that take place along a circle or a straight line. Our results are confirmed by numerical simulations. △ Less

Submitted 12 March, 2024; originally announced March 2024.

Comments: 10 pages 8 figures

Strategic Usage in a Multi-Learner Setting

Authors: Eliot Shekhtman, Sarah Dean

Abstract: Real-world systems often involve some pool of users choosing between a set of services. With the increase in popularity of online learning algorithms, these services can now self-optimize, leveraging data collected on users to maximize some reward such as service quality. On the flipside, users may strategically choose which services to use in order to pursue their own reward functions, in the pro… ▽ More Real-world systems often involve some pool of users choosing between a set of services. With the increase in popularity of online learning algorithms, these services can now self-optimize, leveraging data collected on users to maximize some reward such as service quality. On the flipside, users may strategically choose which services to use in order to pursue their own reward functions, in the process wielding power over which services can see and use their data. Extensive prior research has been conducted on the effects of strategic users in single-service settings, with strategic behavior manifesting in the manipulation of observable features to achieve a desired classification; however, this can often be costly or unattainable for users and fails to capture the full behavior of multi-service dynamic systems. As such, we analyze a setting in which strategic users choose among several available services in order to pursue positive classifications, while services seek to minimize loss functions on their observations. We focus our analysis on realizable settings, and show that naive retraining can still lead to oscillation even if all users are observed at different times; however, if this retraining uses memory of past observations, convergent behavior can be guaranteed for certain loss function classes. We provide results obtained from synthetic and real-world data to empirically validate our theoretical findings. △ Less

Submitted 8 March, 2024; v1 submitted 29 January, 2024; originally announced January 2024.

Comments: 18 pages, 9 figures

MSC Class: 91A10

Initializing Services in Interactive ML Systems for Diverse Users

Authors: Avinandan Bose, Mihaela Curmei, Daniel L. Jiang, Jamie Morgenstern, Sarah Dean, Lillian J. Ratliff, Maryam Fazel

Abstract: This paper studies ML systems that interactively learn from users across multiple subpopulations with heterogeneous data distributions. The primary objective is to provide specialized services for different user groups while also predicting user preferences. Once the users select a service based on how well the service anticipated their preference, the services subsequently adapt and refine themse… ▽ More This paper studies ML systems that interactively learn from users across multiple subpopulations with heterogeneous data distributions. The primary objective is to provide specialized services for different user groups while also predicting user preferences. Once the users select a service based on how well the service anticipated their preference, the services subsequently adapt and refine themselves based on the user data they accumulate, resulting in an iterative, alternating minimization process between users and services (learning dynamics). Employing such tailored approaches has two main challenges: (i) Unknown user preferences: Typically, data on user preferences are unavailable without interaction, and uniform data collection across a large and diverse user base can be prohibitively expensive. (ii) Suboptimal Local Solutions: The total loss (sum of loss functions across all users and all services) landscape is not convex even if the individual losses on a single service are convex, making it likely for the learning dynamics to get stuck in local minima. The final outcome of the aforementioned learning dynamics is thus strongly influenced by the initial set of services offered to users, and is not guaranteed to be close to the globally optimal outcome. In this work, we propose a randomized algorithm to adaptively select very few users to collect preference data from, while simultaneously initializing a set of services. We prove that under mild assumptions on the loss functions, the expected total loss achieved by the algorithm right after initialization is within a factor of the globally optimal total loss with complete user preference data, and this factor scales only logarithmically in the number of services. Our theory is complemented by experiments on real as well as semi-synthetic datasets. △ Less

Submitted 18 December, 2023; originally announced December 2023.

Ranking with Long-Term Constraints

Authors: Kianté Brantley, Zhichong Fang, Sarah Dean, Thorsten Joachims

Abstract: The feedback that users provide through their choices (e.g., clicks, purchases) is one of the most common types of data readily available for training search and recommendation algorithms. However, myopically training systems based on choice data may only improve short-term engagement, but not the long-term sustainability of the platform and the long-term benefits to its users, content providers,… ▽ More The feedback that users provide through their choices (e.g., clicks, purchases) is one of the most common types of data readily available for training search and recommendation algorithms. However, myopically training systems based on choice data may only improve short-term engagement, but not the long-term sustainability of the platform and the long-term benefits to its users, content providers, and other stakeholders. In this paper, we thus develop a new framework in which decision makers (e.g., platform operators, regulators, users) can express long-term goals for the behavior of the platform (e.g., fairness, revenue distribution, legal requirements). These goals take the form of exposure or impact targets that go well beyond individual sessions, and we provide new control-based algorithms to achieve these goals. In particular, the controllers are designed to achieve the stated long-term goals with minimum impact on short-term engagement. Beyond the principled theoretical derivation of the controllers, we evaluate the algorithms on both synthetic and real-world data. While all controllers perform well, we find that they provide interesting trade-offs in efficiency, robustness, and the ability to plan ahead. △ Less

Submitted 7 January, 2024; v1 submitted 10 July, 2023; originally announced July 2023.

Single-file diffusion in spatially inhomogeneous systems

Authors: Benjamin Sorkin, David S. Dean

Abstract: We study the effect of spatially-varying potential and diffusivity on the dispersion of a tracer particle in single-file diffusion. Non-interacting particles in such a system exhibit normal diffusion at late times, which is characterised by an effective diffusion constant $D_\mathrm{eff}$. Here we demonstrate the physically appealing result that the dispersion of single-file tracers in this system… ▽ More We study the effect of spatially-varying potential and diffusivity on the dispersion of a tracer particle in single-file diffusion. Non-interacting particles in such a system exhibit normal diffusion at late times, which is characterised by an effective diffusion constant $D_\mathrm{eff}$. Here we demonstrate the physically appealing result that the dispersion of single-file tracers in this system has the same long-time behavior as that for Brownian particles in a spatially-homogeneous system with constant diffusivity $D_\mathrm{eff}$. Our results are based on a late-time analysis of the Fokker-Planck equation, motivated by the mathematical theory of homogenization. The findings are confirmed by numerical simulations for both annealed and quenched initial conditions. △ Less

Submitted 18 June, 2023; originally announced June 2023.

Comments: 14 pages, 5 figures

Interactions enhance dispersion in fluctuating channels via emergent flows

Authors: Yating Wang, David S. Dean, Sophie Marbach, Ruben Zakine

Abstract: Understanding particle motion in narrow channels is essential to guide progress in numerous applications, from filtration to vascular transport. Thermal or active fluctuations of channel walls for fluid-filled channels can slow down or increase the dispersion of tracer particles. Entropic trap** in the wall bulges slows dispersion, and hydrodynamic flows induced by wall fluctuations enhance disp… ▽ More Understanding particle motion in narrow channels is essential to guide progress in numerous applications, from filtration to vascular transport. Thermal or active fluctuations of channel walls for fluid-filled channels can slow down or increase the dispersion of tracer particles. Entropic trap** in the wall bulges slows dispersion, and hydrodynamic flows induced by wall fluctuations enhance dispersion. Previous studies primarily concentrated on the case of a single Brownian tracer either embedded in an incompressible fluid or in the ideal case where the presence of fluid is ignored. Here we address the question of what happens when there is a large ensemble of interacting Brownian tracers -- a common situation in applications. Introducing repulsive interactions between the tracer particles, while ignoring the presence of a background fluid, leads to an effective flow field. This flow field enhances tracer dispersion, a phenomenon strongly reminiscent of that seen in incompressible background fluid. We characterise the dispersion by the long-time diffusion coefficient of a single tracer, numerically and analytically with a mean-field density functional analysis. We find a surprising effect where an increased particle density enhances the diffusion coefficient, challenging the notion that crowding effects tend to reduce diffusion. Here, inter-particle interactions push particles closer to the fluctuating channel walls. Then, interactions between the fluctuating wall and the now-nearby particles drive particle mixing. Our mechanism is sufficiently general that we expect it to apply to various systems. In addition, the perturbation theory we derive quantifies dispersion in generic advection-diffusion systems with arbitrary spatiotemporal drift. △ Less

Submitted 6 May, 2023; originally announced May 2023.

Comments: 18 pages + Appendices + Supplemental Material

Decision-aid or Controller? Steering Human Decision Makers with Algorithms

Authors: Ruqing Xu, Sarah Dean

Abstract: Algorithms are used to aid human decision makers by making predictions and recommending decisions. Currently, these algorithms are trained to optimize prediction accuracy. What if they were optimized to control final decisions? In this paper, we study a decision-aid algorithm that learns about the human decision maker and provides ''personalized recommendations'' to influence final decisions. We f… ▽ More Algorithms are used to aid human decision makers by making predictions and recommending decisions. Currently, these algorithms are trained to optimize prediction accuracy. What if they were optimized to control final decisions? In this paper, we study a decision-aid algorithm that learns about the human decision maker and provides ''personalized recommendations'' to influence final decisions. We first consider fixed human decision functions which map observable features and the algorithm's recommendations to final decisions. We characterize the conditions under which perfect control over final decisions is attainable. Under fairly general assumptions, the parameters of the human decision function can be identified from past interactions between the algorithm and the human decision maker, even when the algorithm was constrained to make truthful recommendations. We then consider a decision maker who is aware of the algorithm's manipulation and responds strategically. By posing the setting as a variation of the cheap talk game [Crawford and Sobel, 1982], we show that all equilibria are partition equilibria where only coarse information is shared: the algorithm recommends an interval containing the ideal decision. We discuss the potential applications of such algorithms and their social implications. △ Less

Submitted 23 March, 2023; originally announced March 2023.

Effusion of stochastic processes on a line

Authors: David S. Dean, Satya N. Majumdar, Gregory Schehr

Abstract: We consider the problem of leakage or effusion of an ensemble of independent stochastic processes from a region where they are initially randomly distributed. The case of Brownian motion, initially confined to the left half line with uniform density and leaking into the positive half line is an example which has been extensively studied in the literature. Here we derive new results for the average… ▽ More We consider the problem of leakage or effusion of an ensemble of independent stochastic processes from a region where they are initially randomly distributed. The case of Brownian motion, initially confined to the left half line with uniform density and leaking into the positive half line is an example which has been extensively studied in the literature. Here we derive new results for the average number and variance of the number of leaked particles for arbitrary Gaussian processes initially confined to the negative half line and also derive its joint two-time probability distribution, both for the annealed and the quenched initial conditions. For the annealed case, we show that the two-time joint distribution is a bivariate Poisson distribution. We also discuss the role of correlations in the initial particle positions on the statistics of the number of particles on the positive half line. We show that the strong memory effects in the variance of the particle number on the positive real axis for Brownian particles, seen in recent studies, persist for arbitrary Gaussian processes and also at the level of two-time correlation functions. △ Less

Submitted 15 March, 2023; originally announced March 2023.

Comments: 19 pages, 2 figues

Journal ref: J. Stat. Mech. (2023) 063208

Cross-Dataset Propensity Estimation for Debiasing Recommender Systems

Authors: Fengyu Li, Sarah Dean

Abstract: Datasets for training recommender systems are often subject to distribution shift induced by users' and recommenders' selection biases. In this paper, we study the impact of selection bias on datasets with different quantization. We then leverage two differently quantized datasets from different source distributions to mitigate distribution shift by applying the inverse probability scoring method… ▽ More Datasets for training recommender systems are often subject to distribution shift induced by users' and recommenders' selection biases. In this paper, we study the impact of selection bias on datasets with different quantization. We then leverage two differently quantized datasets from different source distributions to mitigate distribution shift by applying the inverse probability scoring method from causal inference. Empirically, our approach gains significant performance improvement over single-dataset methods and alternative ways of combining two datasets. △ Less

Submitted 21 December, 2022; originally announced December 2022.

Comments: In Workshop on Distribution Shifts, 36th Conference on Neural Information Processing Systems (NeurIPS 2022)

Perception-Based Sampled-Data Optimization of Dynamical Systems

Authors: Liliaokeawawa Cothren, Gianluca Bianchin, Sarah Dean, Emiliano Dall'Anese

Abstract: Motivated by perception-based control problems in autonomous systems, this paper addresses the problem of develo** feedback controllers to regulate the inputs and the states of a dynamical system to optimal solutions of an optimization problem when one has no access to exact measurements of the system states. In particular, we consider the case where the states need to be estimated from high-dim… ▽ More Motivated by perception-based control problems in autonomous systems, this paper addresses the problem of develo** feedback controllers to regulate the inputs and the states of a dynamical system to optimal solutions of an optimization problem when one has no access to exact measurements of the system states. In particular, we consider the case where the states need to be estimated from high-dimensional sensory data received only at discrete time intervals. We develop a sampled-data feedback controller that is based on adaptations of a projected gradient descent method, and that includes neural networks as integral components to estimate the state of the system from perceptual information. We derive sufficient conditions to guarantee (local) input-to-state stability of the control loop. Moreover, we show that the interconnected system tracks the solution trajectory of the underlying optimization problem up to an error that depends on the approximation errors of the neural network and on the time-variability of the optimization problem; the latter originates from time-varying safety and performance objectives, input constraints, and unknown disturbances. As a representative application, we illustrate our results with numerical simulations for vision-based autonomous driving. △ Less

Submitted 13 October, 2023; v1 submitted 17 November, 2022; originally announced November 2022.

Comments: This is an extended version of the paper accepted to IFAC World Congress 2023 for publication, containing proofs, and recently updated to address a typo in Assumption 3

Online Convex Optimization with Unbounded Memory

Authors: Raunak Kumar, Sarah Dean, Robert Kleinberg

Abstract: Online convex optimization (OCO) is a widely used framework in online learning. In each round, the learner chooses a decision in a convex set and an adversary chooses a convex loss function, and then the learner suffers the loss associated with their current decision. However, in many applications the learner's loss depends not only on the current decision but on the entire history of decisions un… ▽ More Online convex optimization (OCO) is a widely used framework in online learning. In each round, the learner chooses a decision in a convex set and an adversary chooses a convex loss function, and then the learner suffers the loss associated with their current decision. However, in many applications the learner's loss depends not only on the current decision but on the entire history of decisions until that point. The OCO framework and its existing generalizations do not capture this, and they can only be applied to many settings of interest after a long series of approximation arguments. They also leave open the question of whether the dependence on memory is tight because there are no non-trivial lower bounds. In this work we introduce a generalization of the OCO framework, "Online Convex Optimization with Unbounded Memory", that captures long-term dependence on past decisions. We introduce the notion of $p$-effective memory capacity, $H_p$, that quantifies the maximum influence of past decisions on present losses. We prove an $O(\sqrt{H_p T})$ upper bound on the policy regret and a matching (worst-case) lower bound. As a special case, we prove the first non-trivial lower bound for OCO with finite memory \citep{anavaHM2015online}, which could be of independent interest, and also improve existing upper bounds. We demonstrate the broad applicability of our framework by using it to derive regret bounds, and to improve and simplify existing regret bound derivations, for a variety of online learning problems including online linear control and an online variant of performative prediction. △ Less

Submitted 29 March, 2024; v1 submitted 18 October, 2022; originally announced October 2022.

Comments: Proceedings of the 37th Conference on Neural Information Processing Systems (NeurIPS 2023)

Non-Gaussian diffusion near surfaces

Authors: Arthur Alexandre, Maxime Lavaud, Nicolas Fares, Elodie Millan, Yann Louyer, Thomas Salez, Yacine Amarouchene, Thomas Guérin, David S. Dean

Abstract: We study the diffusion of particles confined close to a single wall and in double-wall planar channel geometries where the local diffusivities depend on the distance to the boundaries. Displacement parallel to the walls is Brownian as characterized by its variance, but it is non-Gaussian having a non-zero fourth cumulant. Establishing a link with Taylor dispersion, we calculate the fourth cumul… ▽ More We study the diffusion of particles confined close to a single wall and in double-wall planar channel geometries where the local diffusivities depend on the distance to the boundaries. Displacement parallel to the walls is Brownian as characterized by its variance, but it is non-Gaussian having a non-zero fourth cumulant. Establishing a link with Taylor dispersion, we calculate the fourth cumulant and the tails of the displacement distribution for general diffusivity tensors along with potentials generated by either the walls or externally, for instance gravity. Experimental and numerical studies of the motion of a colloid in the direction parallel to the wall give measured fourth cumulants which are correctly predicted by our theory. Interestingly, contrary to models of Brownian-yet-non-Gaussian diffusion, the tails of the displacement distribution are shown to be Gaussian rather than exponential. All together, our results provide additional tests and constraints for the inference of force maps and local transport properties near surfaces. △ Less

Submitted 19 December, 2022; v1 submitted 5 July, 2022; originally announced July 2022.

Modeling Content Creator Incentives on Algorithm-Curated Platforms

Authors: Jiri Hron, Karl Krauth, Michael I. Jordan, Niki Kilbertus, Sarah Dean

Abstract: Content creators compete for user attention. Their reach crucially depends on algorithmic choices made by developers on online platforms. To maximize exposure, many creators adapt strategically, as evidenced by examples like the sprawling search engine optimization industry. This begets competition for the finite user attention pool. We formalize these dynamics in what we call an exposure game, a… ▽ More Content creators compete for user attention. Their reach crucially depends on algorithmic choices made by developers on online platforms. To maximize exposure, many creators adapt strategically, as evidenced by examples like the sprawling search engine optimization industry. This begets competition for the finite user attention pool. We formalize these dynamics in what we call an exposure game, a model of incentives induced by algorithms, including modern factorization and (deep) two-tower architectures. We prove that seemingly innocuous algorithmic choices, e.g., non-negative vs. unconstrained factorization, significantly affect the existence and character of (Nash) equilibria in exposure games. We proffer use of creator behavior models, like exposure games, for an (ex-ante) pre-deployment audit. Such an audit can identify misalignment between desirable and incentivized content, and thus complement post-hoc measures like content filtering and moderation. To this end, we propose tools for numerically finding equilibria in exposure games, and illustrate results of an audit on the MovieLens and LastFM datasets. Among else, we find that the strategically produced content exhibits strong dependence between algorithmic exploration and content diversity, and between model expressivity and bias towards gender-based user and creator groups. △ Less

Submitted 6 July, 2023; v1 submitted 27 June, 2022; originally announced June 2022.

Comments: presented at ICLR 2023 (top 5%)

Nanoparticle Taylor dispersion near charged surfaces with an open boundary

Authors: Alexandre Vilquin, Vincent Bertin, Elie Raphaël, David S Dean, Thomas Salez, Joshua D. McGraw

Abstract: The dispersive spreading of microscopic particles in shear flows is influenced both by advection and thermal motion. At the nanoscale, interactions between such particles and their confining boundaries become unavoidable. We address the roles of electrostatic repulsion and absorption on the spatial distribution and dispersion of charged nanoparticles in near-surface shear flows, observed under eva… ▽ More The dispersive spreading of microscopic particles in shear flows is influenced both by advection and thermal motion. At the nanoscale, interactions between such particles and their confining boundaries become unavoidable. We address the roles of electrostatic repulsion and absorption on the spatial distribution and dispersion of charged nanoparticles in near-surface shear flows, observed under evanescent illumination. The electrostatic repulsion between particles and the lower charged surface is tuned by varying electrolyte concentrations. Particles leaving the field of vision can be neglected from further analysis, such that the experimental ensemble is equivalent to that of Taylor dispersion with absorption. These two ingredients modify the particle distribution, deviating strongly from the Gibbs-Boltzmann one at the nanoscale studied here. The overall effect is to restrain the accessible space available to particles, leading to a striking, ten-fold reduction in the spreading dynamics as compared to the non-interacting case. △ Less

Submitted 6 January, 2023; v1 submitted 15 June, 2022; originally announced June 2022.

Emergent specialization from participation dynamics and multi-learner retraining

Authors: Sarah Dean, Mihaela Curmei, Lillian J. Ratliff, Jamie Morgenstern, Maryam Fazel

Abstract: Numerous online services are data-driven: the behavior of users affects the system's parameters, and the system's parameters affect the users' experience of the service, which in turn affects the way users may interact with the system. For example, people may choose to use a service only for tasks that already works well, or they may choose to switch to a different service. These adaptations influ… ▽ More Numerous online services are data-driven: the behavior of users affects the system's parameters, and the system's parameters affect the users' experience of the service, which in turn affects the way users may interact with the system. For example, people may choose to use a service only for tasks that already works well, or they may choose to switch to a different service. These adaptations influence the ability of a system to learn about a population of users and tasks in order to improve its performance broadly. In this work, we analyze a class of such dynamics -- where users allocate their participation amongst services to reduce the individual risk they experience, and services update their model parameters to reduce the service's risk on their current user population. We refer to these dynamics as \emph{risk-reducing}, which cover a broad class of common model updates including gradient descent and multiplicative weights. For this general class of dynamics, we show that asymptotically stable equilibria are always segmented, with sub-populations allocated to a single learner. Under mild assumptions, the utilitarian social optimum is a stable equilibrium. In contrast to previous work, which shows that repeated risk minimization can result in (Hashimoto et al., 2018; Miller et al., 2021), we find that repeated myopic updates with multiple learners lead to better outcomes. We illustrate the phenomena via a simulated example initialized from real data. △ Less

Submitted 29 April, 2024; v1 submitted 6 June, 2022; originally announced June 2022.

Comments: AISTATS 2024

Preference Dynamics Under Personalized Recommendations

Authors: Sarah Dean, Jamie Morgenstern

Abstract: Many projects (both practical and academic) have designed algorithms to match users to content they will enjoy under the assumption that user's preferences and opinions do not change with the content they see. Evidence suggests that individuals' preferences are directly shaped by what content they see -- radicalization, rabbit holes, polarization, and boredom are all example phenomena of preferenc… ▽ More Many projects (both practical and academic) have designed algorithms to match users to content they will enjoy under the assumption that user's preferences and opinions do not change with the content they see. Evidence suggests that individuals' preferences are directly shaped by what content they see -- radicalization, rabbit holes, polarization, and boredom are all example phenomena of preferences affected by content. Polarization in particular can occur even in ecosystems with "mass media," where no personalization takes place, as recently explored in a natural model of preference dynamics by~\citet{hkazla2019geometric} and~\citet{gaitonde2021polarization}. If all users' preferences are drawn towards content they already like, or are repelled from content they already dislike, uniform consumption of media leads to a population of heterogeneous preferences converging towards only two poles. In this work, we explore whether some phenomenon akin to polarization occurs when users receive \emph{personalized} content recommendations. We use a similar model of preference dynamics, where an individual's preferences move towards content the consume and enjoy, and away from content they consume and dislike. We show that standard user reward maximization is an almost trivial goal in such an environment (a large class of simple algorithms will achieve only constant regret). A more interesting objective, then, is to understand under what conditions a recommendation algorithm can ensure stationarity of user's preferences. We show how to design a content recommendations which can achieve approximate stationarity, under mild conditions on the set of available content, when a user's preferences are known, and how one can learn enough about a user's preferences to implement such a strategy even when user preferences are initially unknown. △ Less

Submitted 25 May, 2022; originally announced May 2022.

Comments: EC 2022

Reward Reports for Reinforcement Learning

Authors: Thomas Krendl Gilbert, Nathan Lambert, Sarah Dean, Tom Zick, Aaron Snoswell

Abstract: Building systems that are good for society in the face of complex societal effects requires a dynamic approach. Recent approaches to machine learning (ML) documentation have demonstrated the promise of discursive frameworks for deliberation about these complexities. However, these developments have been grounded in a static ML paradigm, leaving the role of feedback and post-deployment performance… ▽ More Building systems that are good for society in the face of complex societal effects requires a dynamic approach. Recent approaches to machine learning (ML) documentation have demonstrated the promise of discursive frameworks for deliberation about these complexities. However, these developments have been grounded in a static ML paradigm, leaving the role of feedback and post-deployment performance unexamined. Meanwhile, recent work in reinforcement learning has shown that the effects of feedback and optimization objectives on system behavior can be wide-ranging and unpredictable. In this paper we sketch a framework for documenting deployed and iteratively updated learning systems, which we call Reward Reports. Taking inspiration from various contributions to the technical literature on reinforcement learning, we outline Reward Reports as living documents that track updates to design choices and assumptions behind what a particular automated system is optimizing for. They are intended to track dynamic phenomena arising from system deployment, rather than merely static properties of models or data. After presenting the elements of a Reward Report, we discuss a concrete example: Meta's BlenderBot 3 chatbot. Several others for game-playing (DeepMind's MuZero), content recommendation (MovieLens), and traffic control (Project Flow) are included in the appendix. △ Less

Submitted 19 March, 2023; v1 submitted 22 April, 2022; originally announced April 2022.

Choices, Risks, and Reward Reports: Charting Public Policy for Reinforcement Learning Systems

Authors: Thomas Krendl Gilbert, Sarah Dean, Tom Zick, Nathan Lambert

Abstract: In the long term, reinforcement learning (RL) is considered by many AI theorists to be the most promising path to artificial general intelligence. This places RL practitioners in a position to design systems that have never existed before and lack prior documentation in law and policy. Public agencies could intervene on complex dynamics that were previously too opaque to deliberate about, and long… ▽ More In the long term, reinforcement learning (RL) is considered by many AI theorists to be the most promising path to artificial general intelligence. This places RL practitioners in a position to design systems that have never existed before and lack prior documentation in law and policy. Public agencies could intervene on complex dynamics that were previously too opaque to deliberate about, and long-held policy ambitions would finally be made tractable. In this whitepaper we illustrate this potential and how it might be technically enacted in the domains of energy infrastructure, social media recommender systems, and transportation. Alongside these unprecedented interventions come new forms of risk that exacerbate the harms already generated by standard machine learning tools. We correspondingly present a new typology of risks arising from RL design choices, falling under four categories: sco** the horizon, defining rewards, pruning information, and training multiple agents. Rather than allowing RL systems to unilaterally reshape human domains, policymakers need new mechanisms for the rule of reason, foreseeability, and interoperability that match the risks these systems pose. We argue that criteria for these choices may be drawn from emerging subfields within antitrust, tort, and administrative law. It will then be possible for courts, federal and state agencies, and non-governmental organizations to play more active roles in RL specification and evaluation. Building on the "model cards" and "datasheets" frameworks proposed by Mitchell et al. and Gebru et al., we argue the need for Reward Reports for AI systems. Reward Reports are living documents for proposed RL deployments that demarcate design choices. △ Less

Submitted 11 February, 2022; originally announced February 2022.

Comments: 60 pages

Journal ref: Center for Long Term Cybersecurity Whitepaper Series Feb. 2022; see release https://cltc.berkeley.edu/2022/02/08/reward-reports/

How stickiness can speed up diffusion in confined systems

Authors: Arthur Alexandre, Matthieu Mangeat, Thomas Guérin, David S. Dean

Abstract: The paradigmatic model for heterogeneous media used in diffusion studies is built from reflecting obstacles and surfaces. It is well known that the crowding effect produced by these reflecting surfaces slows the dispersion of Brownian tracers. Here, using a general adsorption desorption model with surface diffusion, we show analytically that making surfaces or obstacles attractive can accelerate d… ▽ More The paradigmatic model for heterogeneous media used in diffusion studies is built from reflecting obstacles and surfaces. It is well known that the crowding effect produced by these reflecting surfaces slows the dispersion of Brownian tracers. Here, using a general adsorption desorption model with surface diffusion, we show analytically that making surfaces or obstacles attractive can accelerate dispersion. In particular, we show that this enhancement of diffusion can exist even when the surface diffusion constant is smaller than that in the bulk. Even more remarkably, this enhancement effect occurs when the effective diffusion constant, when restricted to surfaces only, is lower than the effective diffusivity with purely reflecting boundaries. We give analytical formulas for this intriguing effect in periodic arrays of spheres as well as undulating micro-channels. Our results are confirmed by numerical calculations and Monte Carlo simulations. △ Less

Submitted 2 June, 2022; v1 submitted 10 December, 2021; originally announced December 2021.

Effective diffusivity of Brownian particles in a two dimensional square lattice of hard disks

Authors: M. Mangeat, T. Guérin, D. S. Dean

Abstract: We revisit the classic problem of the effective diffusion constant of a Brownian particle in a square lattice of reflecting impenetrable hard disks. This diffusion constant is also related to the effective conductivity of non-conducting and infinitely conductive disks in the same geometry. We show how a recently derived Green's function for the periodic lattice can be exploited to derive a series… ▽ More We revisit the classic problem of the effective diffusion constant of a Brownian particle in a square lattice of reflecting impenetrable hard disks. This diffusion constant is also related to the effective conductivity of non-conducting and infinitely conductive disks in the same geometry. We show how a recently derived Green's function for the periodic lattice can be exploited to derive a series expansion of the diffusion constant in terms of the disk's volume fraction $\varphi$. Secondly we propose a variant of the Fick-Jacobs approximation to study the large volume fraction limit. This combination of analytical results is shown to describe the behavior of the diffusion constant for all volume fractions. △ Less

Submitted 8 November, 2021; originally announced November 2021.

Journal ref: J. Chem. Phys. 152, 234109 (2020)

Steady state of overdamped particles in the non-conservative force field of a simple non-linear model of optical trap

Authors: M. Mangeat, T. Guérin, D. S. Dean

Abstract: Optically trapped particles are often subject to a non-conservative scattering force arising from radiation pressure. In this paper we present an exact solution for the steady state statistics of an overdamped Brownian particle subjected to a commonly used force field model for an optical trap. The model is the simplest of its kind that takes into account non-conservative forces. In particular, we… ▽ More Optically trapped particles are often subject to a non-conservative scattering force arising from radiation pressure. In this paper we present an exact solution for the steady state statistics of an overdamped Brownian particle subjected to a commonly used force field model for an optical trap. The model is the simplest of its kind that takes into account non-conservative forces. In particular, we present exact results for certain marginals of the full three dimensional steady state probability distribution as well as results for the toroidal probability currents which are present in the steady state, as well as for the circulation of theses currents. Our analytical results are confirmed by numerical solution of the steady state Fokker-Planck equation. △ Less

Submitted 8 October, 2021; originally announced October 2021.

Comments: 14 pages, 3 figures

Journal ref: Journal of Statistical Mechanics: Theory and Experiment (2021) 113205

Quantifying Availability and Discovery in Recommender Systems via Stochastic Reachability

Authors: Mihaela Curmei, Sarah Dean, Benjamin Recht

Abstract: In this work, we consider how preference models in interactive recommendation systems determine the availability of content and users' opportunities for discovery. We propose an evaluation procedure based on stochastic reachability to quantify the maximum probability of recommending a target piece of content to an user for a set of allowable strategic modifications. This framework allows us to com… ▽ More In this work, we consider how preference models in interactive recommendation systems determine the availability of content and users' opportunities for discovery. We propose an evaluation procedure based on stochastic reachability to quantify the maximum probability of recommending a target piece of content to an user for a set of allowable strategic modifications. This framework allows us to compute an upper bound on the likelihood of recommendation with minimal assumptions about user behavior. Stochastic reachability can be used to detect biases in the availability of content and diagnose limitations in the opportunities for discovery granted to users. We show that this metric can be computed efficiently as a convex program for a variety of practical settings, and further argue that reachability is not inherently at odds with accuracy. We demonstrate evaluations of recommendation algorithms trained on large datasets of explicit and implicit ratings. Our results illustrate how preference models, selection rules, and user interventions impact reachability and how these effects can be distributed unevenly. △ Less

Submitted 30 June, 2021; originally announced July 2021.

Comments: to appear ICML 2021

Axes for Sociotechnical Inquiry in AI Research

Authors: Sarah Dean, Thomas Krendl Gilbert, Nathan Lambert, Tom Zick

Abstract: The development of artificial intelligence (AI) technologies has far exceeded the investigation of their relationship with society. Sociotechnical inquiry is needed to mitigate the harms of new technologies whose potential impacts remain poorly understood. To date, subfields of AI research develop primarily individual views on their relationship with sociotechnics, while tools for external investi… ▽ More The development of artificial intelligence (AI) technologies has far exceeded the investigation of their relationship with society. Sociotechnical inquiry is needed to mitigate the harms of new technologies whose potential impacts remain poorly understood. To date, subfields of AI research develop primarily individual views on their relationship with sociotechnics, while tools for external investigation, comparison, and cross-pollination are lacking. In this paper, we propose four directions for inquiry into new and evolving areas of technological development: value--what progress and direction does a field promote, optimization--how the defined system within a problem formulation relates to broader dynamics, consensus--how agreement is achieved and who is included in building it, and failure--what methods are pursued when the problem specification is found wanting. The paper provides a lexicon for sociotechnical inquiry and illustrates it through the example of consumer drone technology. △ Less

Submitted 26 April, 2021; originally announced May 2021.

Comments: 9 pages, 1 figure

Generalized Taylor dispersion for translationally invariant microfluidic systems

Authors: Arthur Alexandre, Thomas Guérin, David S. Dean

Abstract: We consider Taylor dispersion for tracer particles in micro-fluidic planar channels with strong confinement. In this context, the channel walls modify the local diffusivity tensor and also interactions between the tracer particles and the walls become important. We provide a simple and general formula for the effective diffusion constant along the channel as well as the first non-trivial finite ti… ▽ More We consider Taylor dispersion for tracer particles in micro-fluidic planar channels with strong confinement. In this context, the channel walls modify the local diffusivity tensor and also interactions between the tracer particles and the walls become important. We provide a simple and general formula for the effective diffusion constant along the channel as well as the first non-trivial finite time correction for arbitrary flows along the channel, arbitrary interaction potentials with the walls and arbitrary expressions for the diffusion tensor. The formula are in particular amenable to a straightforward numerical implementation, rendering them extremely useful for comparison with experiments. We present a number of applications, notably for systems which have parabolically varying diffusivity profiles, to systems with attractive interactions with the walls as well as electroosmotic flows between plates with differing surface charges within the Debye-Hückel approximation. △ Less

Submitted 11 August, 2021; v1 submitted 13 May, 2021; originally announced May 2021.

Comments: 33 pages, 7 figures

Journal ref: Physics of Fluids 33, 082004 (2021)

Wigner function for noninteracting fermions in hard wall potentials

Authors: Benjamin De Bruyne, David S. Dean, Pierre Le Doussal, Satya N. Majumdar, Gregory Schehr

Abstract: The Wigner function $W_N({\bf x}, {\bf p})$ is a useful quantity to characterize the quantum fluctuations of an $N$-body system in its phase space. Here we study $W_N({\bf x}, {\bf p})$ for $N$ noninteracting spinless fermions in a $d$-dimensional spherical hard box of radius $R$ at temperature $T=0$. In the large $N$ limit, the local density approximation (LDA) predicts that… ▽ More The Wigner function $W_N({\bf x}, {\bf p})$ is a useful quantity to characterize the quantum fluctuations of an $N$-body system in its phase space. Here we study $W_N({\bf x}, {\bf p})$ for $N$ noninteracting spinless fermions in a $d$-dimensional spherical hard box of radius $R$ at temperature $T=0$. In the large $N$ limit, the local density approximation (LDA) predicts that $W_N({\bf x}, {\bf p}) \approx 1/(2 π\hbar)^d$ inside a finite region of the $({\bf x}, {\bf p})$ plane, namely for $|{\bf x}| < R$ and $|{\bf p}| < k_F$ where $k_F$ is the Fermi momentum, while $W_N({\bf x}, {\bf p})$ vanishes outside this region, or "droplet", on a scale determined by quantum fluctuations. In this paper we investigate systematically, in this quantum region, the structure of the Wigner function along the edge of this droplet, called the Fermi surf. In one dimension, we find that there are three distinct edge regions along the Fermi surf and we compute exactly the associated nontrivial scaling functions in each regime. We also study the momentum distribution $\hat ρ_N(p)$ and find a striking algebraic tail for very large momenta $\hat ρ_N(p) \propto 1/p^4$, well beyond $k_F$, reminiscent of a similar tail found in interacting quantum systems (discussed in the context of Tan's relation). We then generalize these results to higher $d$ and find, remarkably, that the scaling function close to the edge of the box is universal, i.e., independent of the dimension~$d$. △ Less

Submitted 30 April, 2021; v1 submitted 11 April, 2021; originally announced April 2021.

Comments: 31 pages, 14 figures

Journal ref: Phys. Rev. A 104, 013314 (2021)

AI Development for the Public Interest: From Abstraction Traps to Sociotechnical Risks

Authors: McKane Andrus, Sarah Dean, Thomas Krendl Gilbert, Nathan Lambert, Tom Zick

Abstract: Despite interest in communicating ethical problems and social contexts within the undergraduate curriculum to advance Public Interest Technology (PIT) goals, interventions at the graduate level remain largely unexplored. This may be due to the conflicting ways through which distinct Artificial Intelligence (AI) research tracks conceive of their interface with social contexts. In this paper we trac… ▽ More Despite interest in communicating ethical problems and social contexts within the undergraduate curriculum to advance Public Interest Technology (PIT) goals, interventions at the graduate level remain largely unexplored. This may be due to the conflicting ways through which distinct Artificial Intelligence (AI) research tracks conceive of their interface with social contexts. In this paper we track the historical emergence of sociotechnical inquiry in three distinct subfields of AI research: AI Safety, Fair Machine Learning (Fair ML) and Human-in-the-Loop (HIL) Autonomy. We show that for each subfield, perceptions of PIT stem from the particular dangers faced by past integration of technical systems within a normative social order. We further interrogate how these histories dictate the response of each subfield to conceptual traps, as defined in the Science and Technology Studies literature. Finally, through a comparative analysis of these currently siloed fields, we present a roadmap for a unified approach to sociotechnical graduate pedagogy in AI. △ Less

Submitted 4 February, 2021; originally announced February 2021.

Comments: 8 Pages

Impurities in systems of noninteracting trapped fermions

Authors: David S. Dean, Pierre Le Doussal, Satya N. Majumdar, Gregory Schehr

Abstract: We study the properties of spin-less non-interacting fermions trapped in a confining potential in one dimension but in the presence of one or more impurities which are modelled by delta function potentials. We use a method based on the single particle Green's function. For a single impurity placed in the bulk, we compute the density of the Fermi gas near the impurity. Our results, in addition to r… ▽ More We study the properties of spin-less non-interacting fermions trapped in a confining potential in one dimension but in the presence of one or more impurities which are modelled by delta function potentials. We use a method based on the single particle Green's function. For a single impurity placed in the bulk, we compute the density of the Fermi gas near the impurity. Our results, in addition to recovering the Friedel oscillations at large distance from the impurity, allow the exact computation of the density at short distances. We also show how the density of the Fermi gas is modified when the impurity is placed near the edge of the trap in the region where the unperturbed system is described by the Airy gas. Our method also allows us to compute the effective potential felt by the impurity both in the bulk and at the edge. In the bulk this effective potential is shown to be a universal function only of the local Fermi wave vector, or equivalently of the local fermion density. When the impurity is placed near the edge of the Fermi gas, the effective potential can be expressed in terms of Airy functions. For an attractive impurity placed far outside the support of the fermion density, we show that an interesting transition occurs where a single fermion is pulled out of the Fermi sea and forms a bound state with the impurity. This is a quantum analogue of the well-known Baik-Ben Arous-Péché (BBP) transition, known in the theory of spiked random matrices. The density at the location of the impurity plays the role of an order parameter. We also consider the case of two impurities in the bulk and compute exactly the effective force between them mediated by the background Fermi gas. △ Less

Submitted 24 February, 2021; v1 submitted 27 December, 2020; originally announced December 2020.

Comments: 35 pages, 8 figures. Revised version: references added and typos corrected

Journal ref: SciPost Phys. 10, 082 (2021)

Towards Robust Data-Driven Control Synthesis for Nonlinear Systems with Actuation Uncertainty

Authors: Andrew J. Taylor, Victor D. Dorobantu, Sarah Dean, Benjamin Recht, Yisong Yue, Aaron D. Ames

Abstract: Modern nonlinear control theory seeks to endow systems with properties such as stability and safety, and has been deployed successfully across various domains. Despite this success, model uncertainty remains a significant challenge in ensuring that model-based controllers transfer to real world systems. This paper develops a data-driven approach to robust control synthesis in the presence of model… ▽ More Modern nonlinear control theory seeks to endow systems with properties such as stability and safety, and has been deployed successfully across various domains. Despite this success, model uncertainty remains a significant challenge in ensuring that model-based controllers transfer to real world systems. This paper develops a data-driven approach to robust control synthesis in the presence of model uncertainty using Control Certificate Functions (CCFs), resulting in a convex optimization based controller for achieving properties like stability and safety. An important benefit of our framework is nuanced data-dependent guarantees, which in principle can yield sample-efficient data collection approaches that need not fully determine the input-to-state relationship. This work serves as a starting point for addressing important questions at the intersection of nonlinear control theory and non-parametric learning, both theoretical and in application. We validate the proposed method in simulation with an inverted pendulum in multiple experimental configurations. △ Less

Submitted 31 March, 2021; v1 submitted 21 November, 2020; originally announced November 2020.

Comments: 8 pages, 2 figures, submitted to Conference on Decision & Control (CDC) 2021

Do Offline Metrics Predict Online Performance in Recommender Systems?

Authors: Karl Krauth, Sarah Dean, Alex Zhao, Wenshuo Guo, Mihaela Curmei, Benjamin Recht, Michael I. Jordan

Abstract: Recommender systems operate in an inherently dynamical setting. Past recommendations influence future behavior, including which data points are observed and how user preferences change. However, experimenting in production systems with real user dynamics is often infeasible, and existing simulation-based approaches have limited scale. As a result, many state-of-the-art algorithms are designed to s… ▽ More Recommender systems operate in an inherently dynamical setting. Past recommendations influence future behavior, including which data points are observed and how user preferences change. However, experimenting in production systems with real user dynamics is often infeasible, and existing simulation-based approaches have limited scale. As a result, many state-of-the-art algorithms are designed to solve supervised learning problems, and progress is judged only by offline metrics. In this work we investigate the extent to which offline metrics predict online performance by evaluating eleven recommenders across six controlled simulated environments. We observe that offline metrics are correlated with online performance over a range of environments. However, improvements in offline metrics lead to diminishing returns in online performance. Furthermore, we observe that the ranking of recommenders varies depending on the amount of initial offline data available. We study the impact of adding exploration strategies, and observe that their effectiveness, when compared to greedy recommendation, is highly dependent on the recommendation algorithm. We provide the environments and recommenders described in this paper as Reclab: an extensible ready-to-use simulation framework at https://github.com/berkeley-reclab/RecLab. △ Less

Submitted 6 November, 2020; originally announced November 2020.

Guaranteeing Safety of Learned Perception Modules via Measurement-Robust Control Barrier Functions

Authors: Sarah Dean, Andrew J. Taylor, Ryan K. Cosner, Benjamin Recht, Aaron D. Ames

Abstract: Modern nonlinear control theory seeks to develop feedback controllers that endow systems with properties such as safety and stability. The guarantees ensured by these controllers often rely on accurate estimates of the system state for determining control actions. In practice, measurement model uncertainty can lead to error in state estimates that degrades these guarantees. In this paper, we seek… ▽ More Modern nonlinear control theory seeks to develop feedback controllers that endow systems with properties such as safety and stability. The guarantees ensured by these controllers often rely on accurate estimates of the system state for determining control actions. In practice, measurement model uncertainty can lead to error in state estimates that degrades these guarantees. In this paper, we seek to unify techniques from control theory and machine learning to synthesize controllers that achieve safety in the presence of measurement model uncertainty. We define the notion of a Measurement-Robust Control Barrier Function (MR-CBF) as a tool for determining safe control inputs when facing measurement model uncertainty. Furthermore, MR-CBFs are used to inform sampling methodologies for learning-based perception systems and quantify tolerable error in the resulting learned models. We demonstrate the efficacy of MR-CBFs in achieving safety with measurement model uncertainty on a simulated Segway system. △ Less

Submitted 29 October, 2020; originally announced October 2020.

Kernels for noninteracting fermions via a Green's function approach with applications to step potentials

Authors: David S. Dean, Pierre Le Doussal, Satya N. Majumdar, Gregory Schehr, Naftali R. Smith

Abstract: The quantum correlations of $N$ noninteracting spinless fermions in their ground state can be expressed in terms of a two-point function called the kernel. Here we develop a general and compact method for computing the kernel in a general trap** potential in terms of the Green's function for the corresponding single particle Schrödinger equation. For smooth potentials the method allows a simple… ▽ More The quantum correlations of $N$ noninteracting spinless fermions in their ground state can be expressed in terms of a two-point function called the kernel. Here we develop a general and compact method for computing the kernel in a general trap** potential in terms of the Green's function for the corresponding single particle Schrödinger equation. For smooth potentials the method allows a simple alternative derivation of the local density approximation for the density and of the sine kernel in the bulk part of the trap in the large $N$ limit. It also recovers the density and the kernel of the so-called {\em Airy gas} at the edge. This method allows to analyse the quantum correlations in the ground state when the potential has a singular part with a fast variation in space. For the square step barrier of height $V_0$, we derive explicit expressions for the density and for the kernel. For large Fermi energy $μ>V_0$ it describes the interpolation between two regions of different densities in a Fermi gas, each described by a different sine kernel. Of particular interest is the {\em critical point} of the square well potential when $μ=V_0$. In this critical case, while there is a macroscopic number of fermions in the lower part of the step potential, there is only a finite $O(1)$ number of fermions on the shoulder, and moreover this number is independent of $μ$. In particular, the density exhibits an algebraic decay $\sim 1/x^2$, where $x$ is the distance from the jump. Furthermore, we show that the critical behaviour around $μ= V_0$ exhibits universality with respect with the shape of the barrier. This is established (i) by an exact solution for a smooth barrier (the Woods-Saxon potential) and (ii) by establishing a general relation between the large distance behavior of the kernel and the scattering amplitudes of the single-particle wave-function. △ Less

Submitted 27 September, 2020; originally announced September 2020.

Comments: 35 pages, 9 figures

Journal ref: J. Phys. A: Math. Theor. 54 084001 (2021)

Position distribution in a generalised run and tumble process

Authors: David S. Dean, Satya N. Majumdar, Hendrik Schawe

Abstract: We study a class of stochastic processes of the type $\frac{d^n x}{dt^n}= v_0\, σ(t)$ where $n>0$ is a positive integer and $σ(t)=\pm 1$ represents an `active' telegraphic noise that flips from one state to the other with a constant rate $γ$. For $n=1$, it reduces to the standard run and tumble process for active particles in one dimension. This process can be analytically continued to any $n>0$ i… ▽ More We study a class of stochastic processes of the type $\frac{d^n x}{dt^n}= v_0\, σ(t)$ where $n>0$ is a positive integer and $σ(t)=\pm 1$ represents an `active' telegraphic noise that flips from one state to the other with a constant rate $γ$. For $n=1$, it reduces to the standard run and tumble process for active particles in one dimension. This process can be analytically continued to any $n>0$ including non-integer values. We compute exactly the mean squared displacement at time $t$ for all $n>0$ and show that at late times while it grows as $\sim t^{2n-1}$ for $n>1/2$, it approaches a constant for $n<1/2$. In the marginal case $n=1/2$, it grows very slowly with time as $\sim \ln t$. Thus the process undergoes a {\em localisation} transition at $n=1/2$. We also show that the position distribution $p_n(x,t)$ remains time-dependent even at late times for $n\ge 1/2$, but approaches a stationary time-independent form for $n<1/2$. The tails of the position distribution at late times exhibit a large deviation form, $p_n(x,t)\sim \exp\left[-γ\, t\, Φ_n\left(\frac{x}{x^*(t)}\right)\right]$, where $x^*(t)= v_0\, t^n/Γ(n+1)$. We compute the rate function $Φ_n(z)$ analytically for all $n>0$ and also numerically using importance sampling methods, finding excellent agreement between them. For three special values $n=1$, $n=2$ and $n=1/2$ we compute the exact cumulant generating function of the position distribution at all times $t$. △ Less

Submitted 3 September, 2020; originally announced September 2020.

Comments: 24 pages, 4 Figures

Journal ref: Phys. Rev. E 103, 012130 (2021)

Certainty Equivalent Perception-Based Control

Authors: Sarah Dean, Benjamin Recht

Abstract: In order to certify performance and safety, feedback control requires precise characterization of sensor errors. In this paper, we provide guarantees on such feedback systems when sensors are characterized by solving a supervised learning problem. We show a uniform error bound on nonparametric kernel regression under a dynamically-achievable dense sampling scheme. This allows for a finite-time con… ▽ More In order to certify performance and safety, feedback control requires precise characterization of sensor errors. In this paper, we provide guarantees on such feedback systems when sensors are characterized by solving a supervised learning problem. We show a uniform error bound on nonparametric kernel regression under a dynamically-achievable dense sampling scheme. This allows for a finite-time convergence rate on the sub-optimality of using the regressor in closed-loop for waypoint tracking. We demonstrate our results in simulation with simplified unmanned aerial vehicle and autonomous driving examples. △ Less

Submitted 16 April, 2021; v1 submitted 27 August, 2020; originally announced August 2020.

Comments: to appear at L4DC 2021

Balancing Competing Objectives with Noisy Data: Score-Based Classifiers for Welfare-Aware Machine Learning

Authors: Esther Rolf, Max Simchowitz, Sarah Dean, Lydia T. Liu, Daniel Björkegren, Moritz Hardt, Joshua Blumenstock

Abstract: While real-world decisions involve many competing objectives, algorithmic decisions are often evaluated with a single objective function. In this paper, we study algorithmic policies which explicitly trade off between a private objective (such as profit) and a public objective (such as social welfare). We analyze a natural class of policies which trace an empirical Pareto frontier based on learned… ▽ More While real-world decisions involve many competing objectives, algorithmic decisions are often evaluated with a single objective function. In this paper, we study algorithmic policies which explicitly trade off between a private objective (such as profit) and a public objective (such as social welfare). We analyze a natural class of policies which trace an empirical Pareto frontier based on learned scores, and focus on how such decisions can be made in noisy or data-limited regimes. Our theoretical results characterize the optimal strategies in this class, bound the Pareto errors due to inaccuracies in the scores, and show an equivalence between optimal strategies and a rich class of fairness-constrained profit-maximizing policies. We then present empirical results in two different contexts -- online content recommendation and sustainable abalone fisheries -- to underscore the applicability of our approach to a wide range of practical decisions. Taken together, these results shed light on inherent trade-offs in using machine learning for decisions that impact social welfare. △ Less

Submitted 15 July, 2020; v1 submitted 14 March, 2020; originally announced March 2020.

Thermal Casimir interactions for higher derivative field Lagrangians: generalized Brazovskii models

Authors: David S. Dean, Bing Miao, Rudolf Podgornik

Abstract: We examine the Casimir effect for free statistical field theories which have Hamiltonians with second order derivative terms. Examples of such Hamiltonians arise from models of non-local electrostatics, membranes with non-zero bending rigidities and field theories of the Brazovskii type that arise for polymer systems. The presence of a second derivative term means that new types of boundary condit… ▽ More We examine the Casimir effect for free statistical field theories which have Hamiltonians with second order derivative terms. Examples of such Hamiltonians arise from models of non-local electrostatics, membranes with non-zero bending rigidities and field theories of the Brazovskii type that arise for polymer systems. The presence of a second derivative term means that new types of boundary conditions can be imposed, leading to a richer phenomenology of interaction phenomena. In addition zero modes can be generated that are not present in standard first derivative models, and it is these zero modes which give rise to long range Casimir forces. Two physically distinct cases are considered: (i) unconfined fields, usually considered for finite size embedded inclusions in an infinite fluctuating medium, here in a two plate geometry the fluctuating field exists both inside and outside the plates, (ii) confined fields, where the field is absent outside the slab confined between the two plates. We show how these two physically distinct cases are mathematically related and discuss a wide range of commonly applied boundary conditions. We concentrate our analysis to the critical region where the underlying bulk Hamiltonian has zero modes and show that very exotic Casimir forces can arise, characterised by very long range effects and oscillatory behavior that can lead to strong metastability in the system. △ Less

Submitted 22 February, 2020; originally announced February 2020.

Comments: 18 pages, 6 figures

Noninteracting trapped Fermions in double-well potentials: inverted parabola kernel

Authors: Naftali R. Smith, David S. Dean, Pierre Le Doussal, Satya N. Majumdar, Gregory Schehr

Abstract: We study a system of $N$ noninteracting spinless fermions in a confining, double-well potential in one dimension. When the Fermi energy is close to the value of the potential at its local maximum we show that physical properties, such as the average density and the fermion position correlation functions, display a universal behavior that depends only on the local properties of the potential near i… ▽ More We study a system of $N$ noninteracting spinless fermions in a confining, double-well potential in one dimension. When the Fermi energy is close to the value of the potential at its local maximum we show that physical properties, such as the average density and the fermion position correlation functions, display a universal behavior that depends only on the local properties of the potential near its maximum. This behavior describes the merging of two Fermi gases, which are disjoint at sufficiently low Fermi energies. We describe this behavior in terms of a new correlation kernel that we compute analytically and we call it the inverted parabola kernel". As an application, we calculate the mean and variance of the number of particles in an interval of size $2L$ centered around the position of the local maximum, for sufficiently small $L$. Finally, we discuss the possibility of observing our results in experiments, as well as the extensions to nonzero temperature and to higher space dimensions. △ Less

Submitted 17 May, 2020; v1 submitted 31 January, 2020; originally announced January 2020.

Comments: 16 pages, 8 figures

Journal ref: Phys. Rev. A 101, 053602 (2020)

International observational campaign of the 2014 eclipse of EE Cep

Authors: D. Pieńkowski, C. Gałan, T. Tomov, K. Gazeas, P. Wychudzki, M. Mikołajewski, D. Kubicki, B. Staels, S. Zoła, P. Pakońska, B. Dȩbski, T. Kundera, W. Ogłoza, M. Dróżdż, A. Baran, M. Winiarski, M. Siwak, D. Dimitrov, D. Kjurkchieva, D. Marchev, A. Armiński, I. Miller, Z. Kołaczkowski, D. Moździerski, E. Zahajkiewicz , et al. (44 additional authors not shown)

Abstract: Context. EE Cep is one of few eclipsing binary systems with a dark, dusty disk around an invisible object similar to ε Aur. The system is characterized by grey and asymmetric eclipses every 5.6 yr, with a significant variation in their photometric depth, ranging from ~ 0 m .5 to ~ 2 m .0. Aims. The main aim of the observational campaign of the EE Cep eclipse in 2014 was to test the model of disk p… ▽ More Context. EE Cep is one of few eclipsing binary systems with a dark, dusty disk around an invisible object similar to ε Aur. The system is characterized by grey and asymmetric eclipses every 5.6 yr, with a significant variation in their photometric depth, ranging from ~ 0 m .5 to ~ 2 m .0. Aims. The main aim of the observational campaign of the EE Cep eclipse in 2014 was to test the model of disk precession (Galan et al. 2012). We expected that this eclipse would be one of the deepest with a depth of ~ 2 m .0. Methods. We collected multicolor observations from almost 30 instruments located in Europe and North America. This photometric data covers 243 nights during and around the eclipse. We also analyse the low- and high-resolution spectra from several instruments. Results. The eclipse was shallow with a depth of 0 m .71 in V-band. The multicolor photometry illustrates small color changes during the eclipse with a total amplitude of order ~ +0 m . 15 in B-I color index. The linear ephemeris for this system is updated by including new times of minima, measured from the three most recent eclipses at epochs E = 9, 10 and 11. New spectroscopic observations were acquired, covering orbital phases around the eclipse, which were not observed in the past and increased the data sample, filling some gaps and giving a better insight into the evolution of the H α and NaI spectral line profiles during the primary eclipse. Conclusions. The eclipse of EE Cep in 2014 was shallower than expected 0 m .71 instead of ~ 2 m . 0. This means that our model of disk precession needs revision. △ Less

Submitted 16 January, 2020; originally announced January 2020.

Comments: 10 pages, 13 figures, 29 tables in appendix, submited to Astronomy & Astrophysics

The effect of driving on model C interfaces

Authors: David S. Dean, Paul Gersberg, Peter C. W. Holdsworth

Abstract: We consider the effect of uniform driving on the interface between two phases which are described by model C dynamics. The non-driven system has a classical Gaussian interface described by capillary wave theory. The model under driving retains Gaussian statistics but the interface statistics are modified by driving, notably the height fluctuations are suppressed and the correlation length of the f… ▽ More We consider the effect of uniform driving on the interface between two phases which are described by model C dynamics. The non-driven system has a classical Gaussian interface described by capillary wave theory. The model under driving retains Gaussian statistics but the interface statistics are modified by driving, notably the height fluctuations are suppressed and the correlation length of the fluctuations is increased. The model we introduce can also be used as a model for the effect of activity on interface dynamics. △ Less

Submitted 13 January, 2020; originally announced January 2020.

Comments: 10 pages, Revtex

Recommendations and User Agency: The Reachability of Collaboratively-Filtered Information

Authors: Sarah Dean, Sarah Rich, Benjamin Recht

Abstract: Recommender systems often rely on models which are trained to maximize accuracy in predicting user preferences. When the systems are deployed, these models determine the availability of content and information to different users. The gap between these objectives gives rise to a potential for unintended consequences, contributing to phenomena such as filter bubbles and polarization. In this work, w… ▽ More Recommender systems often rely on models which are trained to maximize accuracy in predicting user preferences. When the systems are deployed, these models determine the availability of content and information to different users. The gap between these objectives gives rise to a potential for unintended consequences, contributing to phenomena such as filter bubbles and polarization. In this work, we consider directly the information availability problem through the lens of user recourse. Using ideas of reachability, we propose a computationally efficient audit for top-$N$ linear recommender models. Furthermore, we describe the relationship between model complexity and the effort necessary for users to exert control over their recommendations. We use this insight to provide a novel perspective on the user cold-start problem. Finally, we demonstrate these concepts with an empirical investigation of a state-of-the-art model trained on a widely used movie ratings dataset. △ Less

Submitted 31 January, 2021; v1 submitted 20 December, 2019; originally announced December 2019.

Comments: appeared at FAccT '20

Robust Guarantees for Perception-Based Control

Authors: Sarah Dean, Nikolai Matni, Benjamin Recht, Vickie Ye

Abstract: Motivated by vision-based control of autonomous vehicles, we consider the problem of controlling a known linear dynamical system for which partial state information, such as vehicle position, is extracted from complex and nonlinear data, such as a camera image. Our approach is to use a learned perception map that predicts some linear function of the state and to design a corresponding safe set and… ▽ More Motivated by vision-based control of autonomous vehicles, we consider the problem of controlling a known linear dynamical system for which partial state information, such as vehicle position, is extracted from complex and nonlinear data, such as a camera image. Our approach is to use a learned perception map that predicts some linear function of the state and to design a corresponding safe set and robust controller for the closed loop system with this sensing scheme. We show that under suitable smoothness assumptions on both the perception map and the generative model relating state to complex and nonlinear data, parameters of the safe set can be learned via appropriately dense sampling of the state space. We then prove that the resulting perception-control loop has favorable generalization properties. We illustrate the usefulness of our approach on a synthetic example and on the self-driving car simulation platform CARLA. △ Less

Submitted 23 December, 2019; v1 submitted 8 July, 2019; originally announced July 2019.

Comments: This revision includes reframing the local generalization problem, with relaxed the assumptions so that the robust problem depends on a local slope bound rather than a Lipschitz constant, and provide a method for learning the slope bound from data. We also include additional experiments with a CNN perception module

Path integrals for higher derivative actions

Authors: David S. Dean, Bing Miao, Rudi Podgornik

Abstract: We consider Euclidean path integrals with higher derivative actions, including those that depend quadratically on acceleration, velocity and position. Such path integrals arise naturally in the study of stiff polymers, membranes with bending rigidity as well as a number of models for electrolytes. The approach used is based on the relation between quadratic path integrals and Gaussian fields and w… ▽ More We consider Euclidean path integrals with higher derivative actions, including those that depend quadratically on acceleration, velocity and position. Such path integrals arise naturally in the study of stiff polymers, membranes with bending rigidity as well as a number of models for electrolytes. The approach used is based on the relation between quadratic path integrals and Gaussian fields and we also show how it can be extended to the evaluation of even higher order path integrals. △ Less

Submitted 1 November, 2019; v1 submitted 20 June, 2019; originally announced June 2019.

Comments: Revtex 12 pages