-
Solving High-dimensional Parametric Elliptic Equation Using Tensor Neural Network
Authors:
Hongtao Chen,
Rui Fu,
Yifan Wang,
Hehu Xie
Abstract:
In this paper, we introduce a tensor neural network based machine learning method for solving the elliptic partial differential equations with random coefficients in a bounded physical domain. With the help of tensor product structure, we can transform the high-dimensional integrations of tensor neural network functions to one-dimensional integrations which can be computed with the classical quadr…
▽ More
In this paper, we introduce a tensor neural network based machine learning method for solving the elliptic partial differential equations with random coefficients in a bounded physical domain. With the help of tensor product structure, we can transform the high-dimensional integrations of tensor neural network functions to one-dimensional integrations which can be computed with the classical quadrature schemes with high accuracy. The complexity of its calculation can be reduced from the exponential scale to a polynomial scale. The corresponding machine learning method is designed for solving high-dimensional parametric elliptic equations. Some numerical examples are provided to validate the accuracy and efficiency of the proposed algorithms.
△ Less
Submitted 14 January, 2024;
originally announced February 2024.
-
Model Mis-specification and Algorithmic Bias
Authors:
Runshan Fu,
Yangfan Liang,
Peter Zhang
Abstract:
Machine learning algorithms are increasingly used to inform critical decisions. There is a growing concern about bias, that algorithms may produce uneven outcomes for individuals in different demographic groups. In this work, we measure bias as the difference between mean prediction errors across groups. We show that even with unbiased input data, when a model is mis-specified: (1) population-leve…
▽ More
Machine learning algorithms are increasingly used to inform critical decisions. There is a growing concern about bias, that algorithms may produce uneven outcomes for individuals in different demographic groups. In this work, we measure bias as the difference between mean prediction errors across groups. We show that even with unbiased input data, when a model is mis-specified: (1) population-level mean prediction error can still be negligible, but group-level mean prediction errors can be large; (2) such errors are not equal across groups; and (3) the difference between errors, i.e., bias, can take the worst-case realization. That is, when there are two groups of the same size, mean prediction errors for these two groups have the same magnitude but opposite signs. In closed form, we show such errors and bias are functions of the first and second moments of the joint distribution of features (for linear and probit regressions). We also conduct numerical experiments to show similar results in more general settings. Our work provides a first step for decoupling the impact of different causes of bias.
△ Less
Submitted 31 May, 2021;
originally announced May 2021.
-
On the relation between information and power in stochastic thermodynamic engines
Authors:
Amirhossein Taghvaei,
Olga Movilla Miangolarra,
Rui Fu,
Yongxin Chen,
Tryphon T. Georgiou
Abstract:
The common saying, that information is power, takes a rigorous form in stochastic thermodynamics, where a quantitative equivalence between the two helps explain the paradox of Maxwell's demon in its ability to reduce entropy. In the present paper, we build on earlier work on the interplay between the relative cost and benefits of information in producing work in cyclic operation of thermodynamic e…
▽ More
The common saying, that information is power, takes a rigorous form in stochastic thermodynamics, where a quantitative equivalence between the two helps explain the paradox of Maxwell's demon in its ability to reduce entropy. In the present paper, we build on earlier work on the interplay between the relative cost and benefits of information in producing work in cyclic operation of thermodynamic engines (by Sandberg etal. 2014). Specifically, we study the general case of overdamped particles in a time-varying potential (control action) in feedback that utilizes continuous measurements (nonlinear filtering) of a thermodynamic ensemble, to produce suitable adaptations of the second law of thermodynamics that involve information.
△ Less
Submitted 5 March, 2021;
originally announced March 2021.
-
The Geometry of Optimal Gaits for Inertia-dominated Kinematic Systems
Authors:
Ross L. Hatton,
Zachary Brock,
Shuoqi Chen,
Howie Choset,
Hossein Faraji,
Ruijie Fu,
Nathan Justus,
Suresh Ramasamy
Abstract:
Isolated mechanical systems -- e.g., those floating in space, in free-fall, or on a frictionless surface -- are able to achieve net rotation by cyclically changing their shape, even if they have no net angular momentum. Similarly, swimmers immersed in "perfect fluids" are able to use cyclic shape changes to both translate and rotate even if the swimmer-fluid system has no net linear or angular mom…
▽ More
Isolated mechanical systems -- e.g., those floating in space, in free-fall, or on a frictionless surface -- are able to achieve net rotation by cyclically changing their shape, even if they have no net angular momentum. Similarly, swimmers immersed in "perfect fluids" are able to use cyclic shape changes to both translate and rotate even if the swimmer-fluid system has no net linear or angular momentum. Finally, systems fully constrained by direct nonholonomic constraints (e.g., passive wheels) can push against these constraints to move through the world. Previous work has demonstrated that the net displacement induced by these shape changes corresponds to the amount of *constraint curvature* that the gaits enclose.
To properly assess or optimize the utility of a gait, however, we must also consider the time or resources required to execute it: A gait that produces a small displacement per cycle, but that can be executed in a short time, may produce a faster average velocity than a gait that produces a large displacement per cycle, but takes much longer to complete a cycle at the same average instantaneous effort.
In this paper, we consider two effort-based cost functions for assessing the costs associated with executing these cycles. For each of these cost functions, we demonstrate that fixing the average instantaneous cost to a unit value allows us to transform the effort costs into time-to-execute costs for any given gait cycle. We then illustrate how the interaction between the constraint curvature and these costs leads to characteristic geometries for optimal cycles, in which the gait trajectories resemble elastic hoops distended from within by internal pressures.
△ Less
Submitted 29 September, 2021; v1 submitted 23 January, 2021;
originally announced February 2021.
-
Underdamped stochastic thermodynamic engines in contact with a heat bath with arbitrary temperature profile
Authors:
Olga Movilla Miangolarra,
Rui Fu,
Amirhossein Taghvaei,
Yongxin Chen,
Tryphon T. Georgiou
Abstract:
We study thermodynamic processes in contact with a heat bath that may have an arbitrary time-varying periodic temperature profile. Within the framework of stochastic thermodynamics, and for models of thermo-dynamic engines in the idealized case of underdamped particles in the low-friction regime, we derive explicit bounds as well as optimal control protocols that draw maximum power and achieve max…
▽ More
We study thermodynamic processes in contact with a heat bath that may have an arbitrary time-varying periodic temperature profile. Within the framework of stochastic thermodynamics, and for models of thermo-dynamic engines in the idealized case of underdamped particles in the low-friction regime, we derive explicit bounds as well as optimal control protocols that draw maximum power and achieve maximum efficiency at any specified level of power.
△ Less
Submitted 4 April, 2022; v1 submitted 13 January, 2021;
originally announced January 2021.
-
Maximal power output of a stochastic thermodynamic engine
Authors:
Rui Fu,
Amirhossein Taghvaei,
Yongxin Chen,
Tryphon T. Georgiou
Abstract:
Classical thermodynamics aimed to quantify the efficiency of thermodynamic engines by bounding the maximal amount of mechanical energy produced compared to the amount of heat required. While this was accomplished early on, by Carnot and Clausius, the more practical problem to quantify limits of power that can be delivered, remained elusive due to the fact that quasistatic processes require infinit…
▽ More
Classical thermodynamics aimed to quantify the efficiency of thermodynamic engines by bounding the maximal amount of mechanical energy produced compared to the amount of heat required. While this was accomplished early on, by Carnot and Clausius, the more practical problem to quantify limits of power that can be delivered, remained elusive due to the fact that quasistatic processes require infinitely slow cycling, resulting in a vanishing power output. Recent insights, drawn from stochastic models, appear to bridge the gap between theory and practice in that they lead to physically meaningful expressions for the dissipation cost in operating a thermodynamic engine over a finite time window. Building on this framework of {\em stochastic thermodynamics} we derive bounds on the maximal power that can be drawn by cycling an overdamped ensemble of particles via a time-varying potential while alternating contact with heat baths of different temperature ($T_c$ cold, and $T_h$ hot). Specifically, assuming a suitable bound $M$ on the spatial gradient of the controlling potential, we show that the maximal achievable power is bounded by $\frac{M}{8}(\frac{T_h}{T_c}-1)$. Moreover, we show that this bound can be reached to within a factor of $(\frac{T_h}{T_c}-1)/(\frac{T_h}{T_c}+1)$ by operating the cyclic thermodynamic process with a quadratic potential.
△ Less
Submitted 19 January, 2020; v1 submitted 3 January, 2020;
originally announced January 2020.
-
Stability Theory of Stochastic Models in Opinion Dynamics
Authors:
Zahra Askarzadeh,
Rui Fu,
Abhishek Halder,
Yongxin Chen,
Tryphon T. Georgiou
Abstract:
We consider a certain class of nonlinear maps that preserve the probability simplex, i.e., stochastic maps, that are inspired by the DeGroot-Friedkin model of belief/opinion propagation over influence networks. The corresponding dynamical models describe the evolution of the probability distribution of interacting species. Such models where the probability transition mechanism depends nonlinearly…
▽ More
We consider a certain class of nonlinear maps that preserve the probability simplex, i.e., stochastic maps, that are inspired by the DeGroot-Friedkin model of belief/opinion propagation over influence networks. The corresponding dynamical models describe the evolution of the probability distribution of interacting species. Such models where the probability transition mechanism depends nonlinearly on the current state are often referred to as {\em nonlinear Markov chains}. In this paper we develop stability results and study the behavior of representative opinion models. The stability certificates are based on the contractivity of the nonlinear evolution in the $\ell_1$-metric. We apply the theory to two types of opinion models where the adaptation of the transition probabilities to the current state is exponential and linear, respectively--both of these can display a wide range of behaviors. We discuss continuous-time and other generalizations.
△ Less
Submitted 10 October, 2018; v1 submitted 9 June, 2017;
originally announced June 2017.
