-
Brittleness of Bayesian inference and new Selberg formulas
Authors:
Houman Owhadi,
Clint Scovel
Abstract:
The incorporation of priors in the Optimal Uncertainty Quantification (OUQ) framework \cite{OSSMO:2011} reveals brittleness in Bayesian inference; a model may share an arbitrarily large number of finite-dimensional marginals with, or be arbitrarily close (in Prokhorov or total variation metrics) to, the data-generating distribution and still make the largest possible prediction error after conditi…
▽ More
The incorporation of priors in the Optimal Uncertainty Quantification (OUQ) framework \cite{OSSMO:2011} reveals brittleness in Bayesian inference; a model may share an arbitrarily large number of finite-dimensional marginals with, or be arbitrarily close (in Prokhorov or total variation metrics) to, the data-generating distribution and still make the largest possible prediction error after conditioning on an arbitrarily large number of samples. The initial purpose of this paper is to unwrap this brittleness mechanism by providing (i) a quantitative version of the Brittleness Theorem of \cite{BayesOUQ} and (ii) a detailed and comprehensive analysis of its application to the revealing example of estimating the mean of a random variable on the unit interval $[0,1]$ using priors that exactly capture the distribution of an arbitrarily large number of Hausdorff moments.
However, in doing so, we discovered that the free parameter associated with Markov and Kreĭn's canonical representations of truncated Hausdorff moments generates reproducing kernel identities corresponding to reproducing kernel Hilbert spaces of polynomials.
Furthermore, these reproducing identities lead to biorthogonal systems of Selberg integral formulas.
This process of discovery appears to be generic: whereas Karlin and Shapley used Selberg's integral formula to first compute the volume of the Hausdorff moment space (the polytope defined by the first $n$ moments of a probability measure on the interval $[0,1]$), we observe that the computation of that volume along with higher order moments of the uniform measure on the moment space, using different finite-dimensional representations of subsets of the infinite-dimensional set of probability measures on $[0,1]$ representing the first $n$ moments, leads to families of equalities corresponding to classical and new Selberg identities.
△ Less
Submitted 24 October, 2014; v1 submitted 25 April, 2013;
originally announced April 2013.
-
Brittleness of Bayesian Inference Under Finite Information in a Continuous World
Authors:
Houman Owhadi,
Clint Scovel,
Tim Sullivan
Abstract:
We derive, in the classical framework of Bayesian sensitivity analysis, optimal lower and upper bounds on posterior values obtained from Bayesian models that exactly capture an arbitrarily large number of finite-dimensional marginals of the data-generating distribution and/or that are as close as desired to the data-generating distribution in the Prokhorov or total variation metrics; these bounds…
▽ More
We derive, in the classical framework of Bayesian sensitivity analysis, optimal lower and upper bounds on posterior values obtained from Bayesian models that exactly capture an arbitrarily large number of finite-dimensional marginals of the data-generating distribution and/or that are as close as desired to the data-generating distribution in the Prokhorov or total variation metrics; these bounds show that such models may still make the largest possible prediction error after conditioning on an arbitrarily large number of sample data measured at finite precision. These results are obtained through the development of a reduction calculus for optimization problems over measures on spaces of measures. We use this calculus to investigate the mechanisms that generate brittleness/robustness and, in particular, we observe that learning and robustness are antagonistic properties. It is now well understood that the numerical resolution of PDEs requires the satisfaction of specific stability conditions. Is there a missing stability condition for using Bayesian inference in a continuous world under finite information?
△ Less
Submitted 20 January, 2015; v1 submitted 24 April, 2013;
originally announced April 2013.
-
Polyharmonic homogenization, rough polyharmonic splines and sparse super-localization
Authors:
Houman Owhadi,
Lei Zhang,
Leonid Berlyand
Abstract:
We introduce a new variational method for the numerical homogenization of divergence form elliptic, parabolic and hyperbolic equations with arbitrary rough ($L^\infty$) coefficients. Our method does not rely on concepts of ergodicity or scale-separation but on compactness properties of the solution space and a new variational approach to homogenization. The approximation space is generated by an i…
▽ More
We introduce a new variational method for the numerical homogenization of divergence form elliptic, parabolic and hyperbolic equations with arbitrary rough ($L^\infty$) coefficients. Our method does not rely on concepts of ergodicity or scale-separation but on compactness properties of the solution space and a new variational approach to homogenization. The approximation space is generated by an interpolation basis (over scattered points forming a mesh of resolution $H$) minimizing the $L^2$ norm of the source terms; its (pre-)computation involves minimizing $\mathcal{O}(H^{-d})$ quadratic (cell) problems on (super-)localized sub-domains of size $\mathcal{O}(H \ln (1/ H))$. The resulting localized linear systems remain sparse and banded. The resulting interpolation basis functions are biharmonic for $d\leq 3$, and polyharmonic for $d\geq 4$, for the operator $-\diiv(a\nabla \cdot)$ and can be seen as a generalization of polyharmonic splines to differential operators with arbitrary rough coefficients. The accuracy of the method ($\mathcal{O}(H)$ in energy norm and independent from aspect ratios of the mesh formed by the scattered points) is established via the introduction of a new class of higher-order Poincaré inequalities. The method bypasses (pre-)computations on the full domain and naturally generalizes to time dependent problems, it also provides a natural solution to the inverse problem of recovering the solution of a divergence form elliptic equation from a finite number of point measurements.
△ Less
Submitted 11 June, 2013; v1 submitted 4 December, 2012;
originally announced December 2012.
-
Control of a Model of DNA Division via Parametric Resonance
Authors:
Wang Sang Koon,
Houman Owhadi,
Molei Tao,
Tomohiro Yanao
Abstract:
We study the internal resonance, energy transfer, activation mechanism, and control of a model of DNA division via parametric resonance. While the system is robust to noise, this study shows that it is sensitive to specific fine scale modes and frequencies that could be targeted by low intensity electro-magnetic fields for triggering and controlling the division. The DNA model is a chain of pendul…
▽ More
We study the internal resonance, energy transfer, activation mechanism, and control of a model of DNA division via parametric resonance. While the system is robust to noise, this study shows that it is sensitive to specific fine scale modes and frequencies that could be targeted by low intensity electro-magnetic fields for triggering and controlling the division. The DNA model is a chain of pendula in a Morse potential. While the (possibly parametrically excited) system has a large number of degrees of freedom and a large number of intrinsic time scales, global and slow variables can be identified by (i) first reducing its dynamic to two modes exchanging energy between each other and (ii) averaging the dynamic of the reduced system with respect to the phase of the fastest mode. Surprisingly the global and slow dynamic of the system remains Hamiltonian (despite the parametric excitation) and the study of its associated effective potential shows how parametric excitation can turn the unstable open state into a stable one. Numerical experiments support the accuracy of the time-averaged reduced Hamiltonian in capturing the global and slow dynamic of the full system.
△ Less
Submitted 16 November, 2012;
originally announced November 2012.
-
Optimal uncertainty quantification for legacy data observations of Lipschitz functions
Authors:
T. J. Sullivan,
M. McKerns,
D. Meyer,
F. Theil,
H. Owhadi,
M. Ortiz
Abstract:
We consider the problem of providing optimal uncertainty quantification (UQ) --- and hence rigorous certification --- for partially-observed functions. We present a UQ framework within which the observations may be small or large in number, and need not carry information about the probability distribution of the system in operation. The UQ objectives are posed as optimization problems, the solutio…
▽ More
We consider the problem of providing optimal uncertainty quantification (UQ) --- and hence rigorous certification --- for partially-observed functions. We present a UQ framework within which the observations may be small or large in number, and need not carry information about the probability distribution of the system in operation. The UQ objectives are posed as optimization problems, the solutions of which are optimal bounds on the quantities of interest; we consider two typical settings, namely parameter sensitivities (McDiarmid diameters) and output deviation (or failure) probabilities. The solutions of these optimization problems depend non-trivially (even non-monotonically and discontinuously) upon the specified legacy data. Furthermore, the extreme values are often determined by only a few members of the data set; in our principal physically-motivated example, the bounds are determined by just 2 out of 32 data points, and the remainder carry no information and could be neglected without changing the final answer. We propose an analogue of the simplex algorithm from linear programming that uses these observations to offer efficient and rigorous UQ for high-dimensional systems with high-cardinality legacy data. These findings suggest natural methods for selecting optimal (maximally informative) next experiments.
△ Less
Submitted 13 April, 2013; v1 submitted 9 February, 2012;
originally announced February 2012.
-
The Optimal Uncertainty Algorithm in the Mystic Framework
Authors:
M. McKerns,
H. Owhadi,
C. Scovel,
T. J. Sullivan,
M. Ortiz
Abstract:
We have recently proposed a rigorous framework for Uncertainty Quantification (UQ) in which UQ objectives and assumption/information set are brought into the forefront, providing a framework for the communication and comparison of UQ results. In particular, this framework does not implicitly impose inappropriate assumptions nor does it repudiate relevant information. This framework, which we call…
▽ More
We have recently proposed a rigorous framework for Uncertainty Quantification (UQ) in which UQ objectives and assumption/information set are brought into the forefront, providing a framework for the communication and comparison of UQ results. In particular, this framework does not implicitly impose inappropriate assumptions nor does it repudiate relevant information. This framework, which we call Optimal Uncertainty Quantification (OUQ), is based on the observation that given a set of assumptions and information, there exist bounds on uncertainties obtained as values of optimization problems and that these bounds are optimal. It provides a uniform environment for the optimal solution of the problems of validation, certification, experimental design, reduced order modeling, prediction, extrapolation, all under aleatoric and epistemic uncertainties. OUQ optimization problems are extremely large, and even though under general conditions they have finite-dimensional reductions, they must often be solved numerically. This general algorithmic framework for OUQ has been implemented in the mystic optimization framework. We describe this implementation, and demonstrate its use in the context of the Caltech surrogate model for hypervelocity impact.
△ Less
Submitted 6 February, 2012;
originally announced February 2012.
-
Space-time FLAVORS: finite difference, multisymlectic, and pseudospectral integrators for multiscale PDEs
Authors:
Molei Tao,
Houman Owhadi,
Jerrold E. Marsden
Abstract:
We present a new class of integrators for stiff PDEs. These integrators are generalizations of FLow AVeraging integratORS (FLAVORS) for stiff ODEs and SDEs introduced in [Tao, Owhadi and Marsden 2010] with the following properties: (i) Multiscale: they are based on flow averaging and have a computational cost determined by mesoscopic steps in space and time instead of microscopic steps in space an…
▽ More
We present a new class of integrators for stiff PDEs. These integrators are generalizations of FLow AVeraging integratORS (FLAVORS) for stiff ODEs and SDEs introduced in [Tao, Owhadi and Marsden 2010] with the following properties: (i) Multiscale: they are based on flow averaging and have a computational cost determined by mesoscopic steps in space and time instead of microscopic steps in space and time; (ii) Versatile: the method is based on averaging the flows of the given PDEs (which may have hidden slow and fast processes). This bypasses the need for identifying explicitly (or numerically) the slow variables or reduced effective PDEs; (iii) Nonintrusive: A pre-existing numerical scheme resolving the microscopic time scale can be used as a black box and easily turned into one of the integrators in this paper by turning the large coefficients on over a microscopic timescale and off during a mesoscopic timescale; (iv) Convergent over two scales: strongly over slow processes and in the sense of measures over fast ones; (v) Structure-preserving: for stiff Hamiltonian PDEs (possibly on manifolds), they can be made to be multi-symplectic, symmetry-preserving (symmetries are group actions that leave the system invariant) in all variables and variational.
△ Less
Submitted 1 April, 2011;
originally announced April 2011.
-
Variational and linearly-implicit integrators, with applications
Authors:
Molei Tao,
Houman Owhadi
Abstract:
We show that symplectic and linearly-implicit integrators proposed by [Zhang and Skeel, 1997] are variational linearizations of Newmark methods. When used in conjunction with penalty methods (i.e., methods that replace constraints by stiff potentials), these integrators permit coarse time-step** of holonomically constrained mechanical systems and bypass the resolution of nonlinear systems. Altho…
▽ More
We show that symplectic and linearly-implicit integrators proposed by [Zhang and Skeel, 1997] are variational linearizations of Newmark methods. When used in conjunction with penalty methods (i.e., methods that replace constraints by stiff potentials), these integrators permit coarse time-step** of holonomically constrained mechanical systems and bypass the resolution of nonlinear systems. Although penalty methods are widely employed, an explicit link to Lagrange multiplier approaches appears to be lacking; such a link is now provided (in the context of two-scale flow convergence [Tao, Owhadi and Marsden, 2010]). The variational formulation also allows efficient simulations of mechanical systems on Lie groups.
△ Less
Submitted 4 December, 2014; v1 submitted 23 March, 2011;
originally announced March 2011.
-
Variational integrators for electric circuits
Authors:
Sina Ober-Blöbaum,
Molei Tao,
Mulin Cheng,
Houman Owhadi,
Jerrold E. Marsden
Abstract:
In this contribution, we develop a variational integrator for the simulation of (stochastic and multiscale) electric circuits. When considering the dynamics of an electrical circuit, one is faced with three special situations: 1. The system involves external (control) forcing through external (controlled) voltage sources and resistors. 2. The system is constrained via the Kirchhoff current (KCL) a…
▽ More
In this contribution, we develop a variational integrator for the simulation of (stochastic and multiscale) electric circuits. When considering the dynamics of an electrical circuit, one is faced with three special situations: 1. The system involves external (control) forcing through external (controlled) voltage sources and resistors. 2. The system is constrained via the Kirchhoff current (KCL) and voltage laws (KVL). 3. The Lagrangian is degenerate. Based on a geometric setting, an appropriate variational formulation is presented to model the circuit from which the equations of motion are derived. A time-discrete variational formulation provides an iteration scheme for the simulation of the electric circuit. Dependent on the discretization, the intrinsic degeneracy of the system can be canceled for the discrete variational scheme. In this way, a variational integrator is constructed that gains several advantages compared to standard integration tools for circuits; in particular, a comparison to BDF methods (which are usually the method of choice for the simulation of electric circuits) shows that even for simple LCR circuits, a better energy behavior and frequency spectrum preservation can be observed using the developed variational integrator.
△ Less
Submitted 8 March, 2011;
originally announced March 2011.
-
Localized bases for finite dimensional homogenization approximations with non-separated scales and high-contrast
Authors:
Houman Owhadi,
Lei Zhang
Abstract:
We construct finite-dimensional approximations of solution spaces of divergence form operators with $L^\infty$-coefficients. Our method does not rely on concepts of ergodicity or scale-separation, but on the property that the solution space of these operators is compactly embedded in $H^1$ if source terms are in the unit ball of $L^2$ instead of the unit ball of $H^{-1}$. Approximation spaces are…
▽ More
We construct finite-dimensional approximations of solution spaces of divergence form operators with $L^\infty$-coefficients. Our method does not rely on concepts of ergodicity or scale-separation, but on the property that the solution space of these operators is compactly embedded in $H^1$ if source terms are in the unit ball of $L^2$ instead of the unit ball of $H^{-1}$. Approximation spaces are generated by solving elliptic PDEs on localized sub-domains with source terms corresponding to approximation bases for $H^2$. The $H^1$-error estimates show that $\mathcal{O}(h^{-d})$-dimensional spaces with basis elements localized to sub-domains of diameter $\mathcal{O}(h^α\ln \frac{1}{h})$ (with $α\in [1/2,1)$) result in an $\mathcal{O}(h^{2-2α})$ accuracy for elliptic, parabolic and hyperbolic problems. For high-contrast media, the accuracy of the method is preserved provided that localized sub-domains contain buffer zones of width $\mathcal{O}(h^α\ln \frac{1}{h})$ where the contrast of the medium remains bounded. The proposed method can naturally be generalized to vectorial equations (such as elasto-dynamics).
△ Less
Submitted 4 August, 2011; v1 submitted 3 November, 2010;
originally announced November 2010.
-
Equivalence of concentration inequalities for linear and non-linear functions
Authors:
Timothy John Sullivan,
Houman Owhadi
Abstract:
We consider a random variable $X$ that takes values in a (possibly infinite-dimensional) topological vector space $\mathcal{X}$. We show that, with respect to an appropriate "normal distance" on $\mathcal{X}$, concentration inequalities for linear and non-linear functions of $X$ are equivalent. This normal distance corresponds naturally to the concentration rate in classical concentration results…
▽ More
We consider a random variable $X$ that takes values in a (possibly infinite-dimensional) topological vector space $\mathcal{X}$. We show that, with respect to an appropriate "normal distance" on $\mathcal{X}$, concentration inequalities for linear and non-linear functions of $X$ are equivalent. This normal distance corresponds naturally to the concentration rate in classical concentration results such as Gaussian concentration and concentration on the Euclidean and Hamming cubes. Under suitable assumptions on the roundness of the sets of interest, the concentration inequalities so obtained are asymptotically optimal in the high-dimensional limit.
△ Less
Submitted 24 September, 2010;
originally announced September 2010.
-
Optimal Uncertainty Quantification
Authors:
Houman Owhadi,
Clint Scovel,
Timothy John Sullivan,
Mike McKerns,
Michael Ortiz
Abstract:
We propose a rigorous framework for Uncertainty Quantification (UQ) in which the UQ objectives and the assumptions/information set are brought to the forefront. This framework, which we call \emph{Optimal Uncertainty Quantification} (OUQ), is based on the observation that, given a set of assumptions and information about the problem, there exist optimal bounds on uncertainties: these are obtained…
▽ More
We propose a rigorous framework for Uncertainty Quantification (UQ) in which the UQ objectives and the assumptions/information set are brought to the forefront. This framework, which we call \emph{Optimal Uncertainty Quantification} (OUQ), is based on the observation that, given a set of assumptions and information about the problem, there exist optimal bounds on uncertainties: these are obtained as values of well-defined optimization problems corresponding to extremizing probabilities of failure, or of deviations, subject to the constraints imposed by the scenarios compatible with the assumptions and information. In particular, this framework does not implicitly impose inappropriate assumptions, nor does it repudiate relevant information. Although OUQ optimization problems are extremely large, we show that under general conditions they have finite-dimensional reductions. As an application, we develop \emph{Optimal Concentration Inequalities} (OCI) of Hoeffding and McDiarmid type. Surprisingly, these results show that uncertainties in input parameters, which propagate to output uncertainties in the classical sensitivity analysis paradigm, may fail to do so if the transfer functions (or probability distributions) are imperfectly known. We show how, for hierarchical structures, this phenomenon may lead to the non-propagation of uncertainties or information across scales. In addition, a general algorithmic framework is developed for OUQ and is tested on the Caltech surrogate model for hypervelocity impact and on the seismic safety assessment of truss structures, suggesting the feasibility of the framework for important complex systems. The introduction of this paper provides both an overview of the paper and a self-contained mini-tutorial about basic concepts and issues of UQ.
△ Less
Submitted 23 May, 2012; v1 submitted 2 September, 2010;
originally announced September 2010.
-
Temperature and Friction Accelerated Sampling of Boltzmann-Gibbs Distribution
Authors:
Molei Tao,
Houman Owhadi,
Jerrold E. Marsden
Abstract:
This paper is concerned with tuning friction and temperature in Langevin dynamics for fast sampling from the canonical ensemble. We show that near-optimal acceleration is achieved by choosing friction so that the local quadratic approximation of the Hamiltonian is a critical damped oscillator. The system is also over-heated and cooled down to its final temperature. The performances of different co…
▽ More
This paper is concerned with tuning friction and temperature in Langevin dynamics for fast sampling from the canonical ensemble. We show that near-optimal acceleration is achieved by choosing friction so that the local quadratic approximation of the Hamiltonian is a critical damped oscillator. The system is also over-heated and cooled down to its final temperature. The performances of different cooling schedules are analyzed as functions of total simulation time.
△ Less
Submitted 6 July, 2010;
originally announced July 2010.
-
From efficient symplectic exponentiation of matrices to symplectic integration of high-dimensional Hamiltonian systems with slowly varying quadratic stiff potentials
Authors:
Molei Tao,
Houman Owhadi,
Jerrold E. Marsden
Abstract:
We present a multiscale integrator for Hamiltonian systems with slowly varying quadratic stiff potentials that uses coarse timesteps (analogous to what the impulse method uses for constant quadratic stiff potentials). This method is based on the highly-non-trivial introduction of two efficient symplectic schemes for exponentiations of matrices that only require O(n) matrix multiplications operatio…
▽ More
We present a multiscale integrator for Hamiltonian systems with slowly varying quadratic stiff potentials that uses coarse timesteps (analogous to what the impulse method uses for constant quadratic stiff potentials). This method is based on the highly-non-trivial introduction of two efficient symplectic schemes for exponentiations of matrices that only require O(n) matrix multiplications operations at each coarse time step for a preset small number n. The proposed integrator is shown to be (i) uniformly convergent on positions; (ii) symplectic in both slow and fast variables; (iii) well adapted to high dimensional systems. Our framework also provides a general method for iteratively exponentiating a slowly varying sequence of (possibly high dimensional) matrices in an efficient way.
△ Less
Submitted 13 April, 2011; v1 submitted 23 June, 2010;
originally announced June 2010.
-
Structure preserving Stochastic Impulse Methods for stiff Langevin systems with a uniform global error of order 1 or 1/2 on position
Authors:
Molei Tao,
Houman Owhadi,
Jerrold E. Marsden
Abstract:
Impulse methods are generalized to a family of integrators for Langevin systems with quadratic stiff potentials and arbitrary soft potentials. Uniform error bounds (independent from stiff parameters) are obtained on integrated positions allowing for coarse integration steps. The resulting integrators are explicit and structure preserving (quasi-symplectic for Langevin systems).
Impulse methods are generalized to a family of integrators for Langevin systems with quadratic stiff potentials and arbitrary soft potentials. Uniform error bounds (independent from stiff parameters) are obtained on integrated positions allowing for coarse integration steps. The resulting integrators are explicit and structure preserving (quasi-symplectic for Langevin systems).
△ Less
Submitted 23 June, 2010;
originally announced June 2010.
-
A non-adapted sparse approximation of PDEs with stochastic inputs
Authors:
Alireza Doostan,
Houman Owhadi
Abstract:
We propose a method for the approximation of solutions of PDEs with stochastic coefficients based on the direct, i.e., non-adapted, sampling of solutions. This sampling can be done by using any legacy code for the deterministic problem as a black box. The method converges in probability (with probabilistic error bounds) as a consequence of sparsity and a concentration of measure phenomenon on the…
▽ More
We propose a method for the approximation of solutions of PDEs with stochastic coefficients based on the direct, i.e., non-adapted, sampling of solutions. This sampling can be done by using any legacy code for the deterministic problem as a black box. The method converges in probability (with probabilistic error bounds) as a consequence of sparsity and a concentration of measure phenomenon on the empirical correlation between samples. We show that the method is well suited for truly high-dimensional problems (with slow decay in the spectrum).
△ Less
Submitted 10 June, 2010;
originally announced June 2010.
-
Non-intrusive and structure preserving multiscale integration of stiff ODEs, SDEs and Hamiltonian systems with hidden slow dynamics via flow averaging
Authors:
Molei Tao,
Houman Owhadi,
Jerrold E. Marsden
Abstract:
We introduce a new class of integrators for stiff ODEs as well as SDEs. These integrators are (i) {\it Multiscale}: they are based on flow averaging and so do not fully resolve the fast variables and have a computational cost determined by slow variables (ii) {\it Versatile}: the method is based on averaging the flows of the given dynamical system (which may have hidden slow and fast processes)…
▽ More
We introduce a new class of integrators for stiff ODEs as well as SDEs. These integrators are (i) {\it Multiscale}: they are based on flow averaging and so do not fully resolve the fast variables and have a computational cost determined by slow variables (ii) {\it Versatile}: the method is based on averaging the flows of the given dynamical system (which may have hidden slow and fast processes) instead of averaging the instantaneous drift of assumed separated slow and fast processes. This bypasses the need for identifying explicitly (or numerically) the slow or fast variables (iii) {\it Nonintrusive}: A pre-existing numerical scheme resolving the microscopic time scale can be used as a black box and easily turned into one of the integrators in this paper by turning the large coefficients on over a microscopic timescale and off during a mesoscopic timescale (iv) {\it Convergent over two scales}: strongly over slow processes and in the sense of measures over fast ones. We introduce the related notion of two-scale flow convergence and analyze the convergence of these integrators under the induced topology (v) {\it Structure preserving}: for stiff Hamiltonian systems (possibly on manifolds), they can be made to be symplectic, time-reversible, and symmetry preserving (symmetries are group actions that leave the system invariant) in all variables. They are explicit and applicable to arbitrary stiff potentials (that need not be quadratic). Their application to the Fermi-Pasta-Ulam problems shows accuracy and stability over four orders of magnitude of time scales. For stiff Langevin equations, they are symmetry preserving, time-reversible and Boltzmann-Gibbs reversible, quasi-symplectic on all variables and conformally symplectic with isotropic friction.
△ Less
Submitted 13 April, 2010; v1 submitted 9 August, 2009;
originally announced August 2009.
-
Discrete Geometric Structures in Homogenization and Inverse Homogenization with application to EIT
Authors:
Mathieu Desbrun,
Roger D. Donaldson,
Houman Owhadi
Abstract:
We introduce a new geometric approach for the homogenization and inverse homogenization of the divergence form elliptic operator with rough conductivity coefficients $σ(x)$ in dimension two. We show that conductivity coefficients are in one-to-one correspondence with divergence-free matrices and convex functions $s(x)$ over the domain $Ω$. Although homogenization is a non-linear and non-injectiv…
▽ More
We introduce a new geometric approach for the homogenization and inverse homogenization of the divergence form elliptic operator with rough conductivity coefficients $σ(x)$ in dimension two. We show that conductivity coefficients are in one-to-one correspondence with divergence-free matrices and convex functions $s(x)$ over the domain $Ω$. Although homogenization is a non-linear and non-injective operator when applied directly to conductivity coefficients, homogenization becomes a linear interpolation operator over triangulations of $Ω$ when re-expressed using convex functions, and is a volume averaging operator when re-expressed with divergence-free matrices. Using optimal weighted Delaunay triangulations for linearly interpolating convex functions, we obtain an optimally robust homogenization algorithm for arbitrary rough coefficients. Next, we consider inverse homogenization and show how to decompose it into a linear ill-posed problem and a well-posed non-linear problem. We apply this new geometric approach to Electrical Impedance Tomography (EIT). It is known that the EIT problem admits at most one isotropic solution. If an isotropic solution exists, we show how to compute it from any conductivity having the same boundary Dirichlet-to-Neumann map. It is known that the EIT problem admits a unique (stable with respect to $G$-convergence) solution in the space of divergence-free matrices. As such we suggest that the space of convex functions is the natural space in which to parameterize solutions of the EIT problem.
△ Less
Submitted 6 May, 2009; v1 submitted 17 April, 2009;
originally announced April 2009.
-
Flux norm approach to finite dimensional homogenization approximations with non-separated scales and high contrast
Authors:
Leonid Berlyand,
Houman Owhadi
Abstract:
We consider divergence-form scalar elliptic equations and vectorial equations for elasticity with rough ($L^\infty(Ω)$, $Ω\subset \R^d$) coefficients $a(x)$ that, in particular, model media with non-separated scales and high contrast in material properties. We define the flux norm as the $L^2$ norm of the potential part of the fluxes of solutions, which is equivalent to the usual $H^1$-norm. We…
▽ More
We consider divergence-form scalar elliptic equations and vectorial equations for elasticity with rough ($L^\infty(Ω)$, $Ω\subset \R^d$) coefficients $a(x)$ that, in particular, model media with non-separated scales and high contrast in material properties. We define the flux norm as the $L^2$ norm of the potential part of the fluxes of solutions, which is equivalent to the usual $H^1$-norm. We show that in the flux norm, the error associated with approximating, in a properly defined finite-dimensional space, the set of solutions of the aforementioned PDEs with rough coefficients is equal to the error associated with approximating the set of solutions of the same type of PDEs with smooth coefficients in a standard space (e.g., piecewise polynomial). We refer to this property as the {\it transfer property}.
A simple application of this property is the construction of finite dimensional approximation spaces with errors independent of the regularity and contrast of the coefficients and with optimal and explicit convergence rates. This transfer property also provides an alternative to the global harmonic change of coordinates for the homogenization of elliptic operators that can be extended to elasticity equations. The proofs of these homogenization results are based on a new class of elliptic inequalities which play the same role in our approach as the div-curl lemma in classical homogenization.
△ Less
Submitted 11 January, 2010; v1 submitted 11 January, 2009;
originally announced January 2009.
-
Long-Run Accuracy of Variational Integrators in the Stochastic Context
Authors:
Nawaf Bou-Rabee,
Houman Owhadi
Abstract:
This paper presents a Lie-Trotter splitting for inertial Langevin equations (Geometric Langevin Algorithm) and analyzes its long-time statistical properties. The splitting is defined as a composition of a variational integrator with an Ornstein-Uhlenbeck flow. Assuming the exact solution and the splitting are geometrically ergodic, the paper proves the discrete invariant measure of the splitting…
▽ More
This paper presents a Lie-Trotter splitting for inertial Langevin equations (Geometric Langevin Algorithm) and analyzes its long-time statistical properties. The splitting is defined as a composition of a variational integrator with an Ornstein-Uhlenbeck flow. Assuming the exact solution and the splitting are geometrically ergodic, the paper proves the discrete invariant measure of the splitting approximates the invariant measure of inertial Langevin to within the accuracy of the variational integrator in representing the Hamiltonian. In particular, if the variational integrator admits no energy error, then the method samples the invariant measure of inertial Langevin without error. Numerical validation is provided using explicit variational integrators with first, second, and fourth order accuracy.
△ Less
Submitted 13 January, 2010; v1 submitted 25 December, 2007;
originally announced December 2007.
-
Ergodicity of Langevin Processes with Degenerate Diffusion in Momentums
Authors:
Nawaf Bou-Rabee,
Houman Owhadi
Abstract:
This paper introduces a geometric method for proving ergodicity of degenerate noise driven stochastic processes. The driving noise is assumed to be an arbitrary Levy process with non-degenerate diffusion component (but that may be applied to a single degree of freedom of the system). The geometric conditions are the approximate controllability of the process the fact that there exists a point in…
▽ More
This paper introduces a geometric method for proving ergodicity of degenerate noise driven stochastic processes. The driving noise is assumed to be an arbitrary Levy process with non-degenerate diffusion component (but that may be applied to a single degree of freedom of the system). The geometric conditions are the approximate controllability of the process the fact that there exists a point in the phase space where the interior of the image of a point via a secondarily randomized version of the driving noise is non void. The paper applies the method to prove ergodicity of a sliding disk governed by Langevin-type equations (a simple stochastic rigid body system). The paper shows that a key feature of this Langevin process is that even though the diffusion and drift matrices associated to the momentums are degenerate, the system is still at uniform temperature.
△ Less
Submitted 10 April, 2008; v1 submitted 23 October, 2007;
originally announced October 2007.
-
Ballistic Transport at Uniform Temperature
Authors:
Nawaf Bou-Rabee,
Houman Owhadi
Abstract:
A paradigm for isothermal, mechanical rectification of stochastic fluctuations is introduced in this paper. The central idea is to transform energy injected by random perturbations into rigid-body rotational kinetic energy. The prototype considered in this paper is a mechanical system consisting of a set of rigid bodies in interaction through magnetic fields. The system is stochastically forced…
▽ More
A paradigm for isothermal, mechanical rectification of stochastic fluctuations is introduced in this paper. The central idea is to transform energy injected by random perturbations into rigid-body rotational kinetic energy. The prototype considered in this paper is a mechanical system consisting of a set of rigid bodies in interaction through magnetic fields. The system is stochastically forced by white noise and dissipative through mechanical friction. The Gibbs-Boltzmann distribution at a specific temperature defines the unique invariant measure under the flow of this stochastic process and allows us to define ``the temperature'' of the system. This measure is also ergodic and weakly mixing. Although the system does not exhibit global directed motion, it is shown that global ballistic motion is possible (the mean-squared displacement grows like t squared). More precisely, although work cannot be extracted from thermal energy by the second law of thermodynamics, it is shown that ballistic transport from thermal energy is possible. In particular, the dynamics is characterized by a meta-stable state in which the system exhibits directed motion over random time scales. This phenomenon is caused by interaction of three attributes of the system: a non flat (yet bounded) potential energy landscape, a rigid body effect (coupling translational momentum and angular momentum through friction) and the degeneracy of the noise/friction tensor on the momentums (the fact that noise is not applied to all degrees of freedom).
△ Less
Submitted 17 October, 2007; v1 submitted 8 October, 2007;
originally announced October 2007.
-
Stochastic Variational Partitioned Runge-Kutta Integrators for Constrained Systems
Authors:
Nawaf Bou-Rabee,
Houman Owhadi
Abstract:
Stochastic variational integrators for constrained, stochastic mechanical systems are developed in this paper. The main results of the paper are twofold: an equivalence is established between a stochastic Hamilton-Pontryagin (HP) principle in generalized coordinates and constrained coordinates via Lagrange multipliers, and variational partitioned Runge-Kutta (VPRK) integrators are extended to th…
▽ More
Stochastic variational integrators for constrained, stochastic mechanical systems are developed in this paper. The main results of the paper are twofold: an equivalence is established between a stochastic Hamilton-Pontryagin (HP) principle in generalized coordinates and constrained coordinates via Lagrange multipliers, and variational partitioned Runge-Kutta (VPRK) integrators are extended to this class of systems. Among these integrators are first and second-order strongly convergent RATTLE-type integrators. We prove order of accuracy of the methods provided. The paper also reviews the deterministic treatment of VPRK integrators from the HP viewpoint.
△ Less
Submitted 22 September, 2007; v1 submitted 14 September, 2007;
originally announced September 2007.
-
Stochastic Variational Integrators
Authors:
Nawaf Bou-Rabee,
Houman Owhadi
Abstract:
This paper presents a continuous and discrete Lagrangian theory for stochastic Hamiltonian systems on manifolds. The main result is to derive stochastic governing equations for such systems from a critical point of a stochastic action. Using this result the paper derives Langevin-type equations for constrained mechanical systems and implements a stochastic analog of Lagrangian reduction. These a…
▽ More
This paper presents a continuous and discrete Lagrangian theory for stochastic Hamiltonian systems on manifolds. The main result is to derive stochastic governing equations for such systems from a critical point of a stochastic action. Using this result the paper derives Langevin-type equations for constrained mechanical systems and implements a stochastic analog of Lagrangian reduction. These are easy consequences of the fact that the stochastic action is intrinsically defined. Stochastic variational integrators (SVIs) are developed using a discretized stochastic variational principle. The paper shows that the discrete flow of an SVI is a.s. symplectic and in the presence of symmetry a.s. momentum-map preserving. A first-order mean-square convergent SVI for mechanical systems on Lie groups is introduced. As an application of the theory, SVIs are exhibited for multiple, randomly forced and torqued rigid-bodies interacting via a potential.
△ Less
Submitted 23 October, 2007; v1 submitted 16 August, 2007;
originally announced August 2007.
-
Bistable equilibrium points of mercury body burden
Authors:
Houman Owhadi,
Areen Boulos
Abstract:
In the last century mercury levels in the global environment have tripled as a result of increased pollution from industrial, occupational, medicinal and domestic uses \cite{BaMe03}. Glutathione is known to be the main agent responsible for the excretion of mercury (we refer to \cite{Thim05}, \cite{ZalBar99} and \cite{Lyn02}). It has also been shown that mercury inhibits glutathione synthetase (…
▽ More
In the last century mercury levels in the global environment have tripled as a result of increased pollution from industrial, occupational, medicinal and domestic uses \cite{BaMe03}. Glutathione is known to be the main agent responsible for the excretion of mercury (we refer to \cite{Thim05}, \cite{ZalBar99} and \cite{Lyn02}). It has also been shown that mercury inhibits glutathione synthetase (an enzyme acting in the synthesization of Glutathione), therefore leading to decreased glutathione levels
(we refer to \cite{Thim05}, \cite{GeGe05}, \cite{GeGe06} and \cite{RDeth04}). Mercury also interferes with the production of heme in the porphyrin pathway \cite{WoMaEc93}. Heme is needed for biological energy production and ability to detox organic toxins via the P450 enzymes \cite{Boy06}. The purpose of this paper is to show that body's response to mercury exposure is hysteretic, i.e. when this feedback of mercury on its main detoxifying agents is strong enough then mercury body burden has two points of equilibrium: one with normal abilities to detoxify and low levels of mercury and one with inhibited abilities to detoxify and high levels of mercury. Furthermore, a small increase of body's mercury burden may not be sufficient to trigger observable neurotoxic effects but it may be sufficient to act as a switch leading to an accumulation of mercury in the body through environmental exposure until its toxicity becomes manifest.
△ Less
Submitted 19 October, 2007; v1 submitted 17 June, 2006;
originally announced June 2006.
-
Numerical Homogenization of the Acoustic Wave Equations with a Continuum of Scales
Authors:
Houman Owhadi,
Lei Zhang
Abstract:
In this paper, we consider numerical homogenization of acoustic wave equations with heterogeneous coefficients, namely, when the bulk modulus and the density of the medium are only bounded. We show that under a Cordes type condition the second order derivatives of the solution with respect to harmonic coordinates are $L^2$ (instead $H^{-1}$ with respect to Euclidean coordinates) and the solution…
▽ More
In this paper, we consider numerical homogenization of acoustic wave equations with heterogeneous coefficients, namely, when the bulk modulus and the density of the medium are only bounded. We show that under a Cordes type condition the second order derivatives of the solution with respect to harmonic coordinates are $L^2$ (instead $H^{-1}$ with respect to Euclidean coordinates) and the solution itself is in $L^{\infty}(0,T,H^2(Ω))$ (instead of $L^{\infty}(0,T,H^1(Ω))$ with respect to Euclidean coordinates). Then, we propose an implicit time step** method to solve the resulted linear system on coarse spatial scales, and present error estimates of the method. It follows that by pre-computing the associated harmonic coordinates, it is possible to numerically homogenize the wave equation without assumptions of scale separation or ergodicity.
△ Less
Submitted 3 May, 2008; v1 submitted 18 April, 2006;
originally announced April 2006.
-
Homogenization of parabolic equations with a continuum of space and time scales
Authors:
Houman Owhadi,
Lei Zhang
Abstract:
This paper addresses the issue of homogenization of linear divergence form parabolic operators in situations where no ergodicity and no scale separation in time or space are available. Namely, we consider divergence form linear parabolic operators in $Ω\subset \R^n$ with $L^\infty(Ω\times (0,T))$-coefficients. It appears that the inverse operator maps the unit ball of $L^2(Ω\times (0,T))$ into a…
▽ More
This paper addresses the issue of homogenization of linear divergence form parabolic operators in situations where no ergodicity and no scale separation in time or space are available. Namely, we consider divergence form linear parabolic operators in $Ω\subset \R^n$ with $L^\infty(Ω\times (0,T))$-coefficients. It appears that the inverse operator maps the unit ball of $L^2(Ω\times (0,T))$ into a space of functions which at small (time and space) scales are close in $H^1$-norm to a functional space of dimension $n$. It follows that once one has solved these equations at least $n$-times it is possible to homogenize them both in space and in time, reducing the number of operations counts necessary to obtain further solutions. In practice we show that under a Cordes type condition that the first order time derivatives and second order space derivatives of the solution of these operators with respect to harmonic coordinates are in $L^2$ (instead of $H^{-1}$ with Euclidean coordinates). If the medium is time independent then it is sufficient to solve $n$ times the associated elliptic equation in order to homogenize the parabolic equation.
△ Less
Submitted 21 December, 2005;
originally announced December 2005.
-
Metric based up-scaling
Authors:
Houman Owhadi,
Lei Zhang
Abstract:
We consider divergence form elliptic operators in dimension $n\geq 2$ with $L^\infty$ coefficients. Although solutions of these operators are only Hölder continuous, we show that they are differentiable ($C^{1,α}$) with respect to harmonic coordinates. It follows that numerical homogenization can be extended to situations where the medium has no ergodicity at small scales and is characterized by…
▽ More
We consider divergence form elliptic operators in dimension $n\geq 2$ with $L^\infty$ coefficients. Although solutions of these operators are only Hölder continuous, we show that they are differentiable ($C^{1,α}$) with respect to harmonic coordinates. It follows that numerical homogenization can be extended to situations where the medium has no ergodicity at small scales and is characterized by a continuum of scales by transferring a new metric in addition to traditional averaged (homogenized) quantities from subgrid scales into computational scales and error bounds can be given. This numerical homogenization method can also be used as a compression tool for differential operators.
△ Less
Submitted 16 November, 2005; v1 submitted 11 May, 2005;
originally announced May 2005.
-
Averaging versus Chaos in Turbulent Transport?
Authors:
Houman Owhadi
Abstract:
In this paper we analyze the transport of passive tracers by deterministic stationary incompressible flows which can be decomposed over an infinite number of spatial scales without separation between them. It appears that a low order dynamical system related to local Peclet numbers can be extracted from these flows and it controls their transport properties. Its analysis shows that these flows a…
▽ More
In this paper we analyze the transport of passive tracers by deterministic stationary incompressible flows which can be decomposed over an infinite number of spatial scales without separation between them. It appears that a low order dynamical system related to local Peclet numbers can be extracted from these flows and it controls their transport properties. Its analysis shows that these flows are strongly self-averaging and super-diffusive: the delay $τ(r)$ for any finite number of passive tracers initially close to separate till a distance $r$ is almost surely anomalously fast ($τ(r)\sim r^{2-ν}$, with $ν>0$). This strong self-averaging property is such that the dissipative power of the flow compensates its convective power at every scale. However as the circulation increase in the eddies the transport behavior of the flow may (discontinuously) bifurcate and become ruled by deterministic chaos: the self-averaging property collapses and advection dominates dissipation. When the flow is anisotropic a new formula describing turbulent conductivity is identified.
△ Less
Submitted 11 February, 2004;
originally announced February 2004.
-
Approximation of the effective conductivity of ergodic media by periodization
Authors:
Houman Owhadi
Abstract:
This paper is concerned with the approximation of the effective conductivity $σ(A,μ)$ associated to an elliptic operator $\nabla_x A(x,η) \nabla_x$ where for $x\in \R^d$, $d\geq 1$, $A(x,η)$ is a bounded elliptic random symmetric $d\times d$ matrix and $η$ takes value in an ergodic probability space $(X,μ)$. Writing $A^N(x,η)$ the periodization of $A(x,η)$ on the torus $T^d_N$ of dimension $d$ a…
▽ More
This paper is concerned with the approximation of the effective conductivity $σ(A,μ)$ associated to an elliptic operator $\nabla_x A(x,η) \nabla_x$ where for $x\in \R^d$, $d\geq 1$, $A(x,η)$ is a bounded elliptic random symmetric $d\times d$ matrix and $η$ takes value in an ergodic probability space $(X,μ)$. Writing $A^N(x,η)$ the periodization of $A(x,η)$ on the torus $T^d_N$ of dimension $d$ and side $N$ we prove that for $μ$-almost all $η$ $$ \lim_{N\to +\infty}σ(A^N,η)=σ(A,μ) $$ We extend this result to non-symmetric operators $\nabla_x (a+E(x,η)) \nabla_x$ corresponding to diffusions in ergodic divergence free flows ($a$ is $d\times d$ elliptic symmetric matrix and $E(x,η)$ an ergodic skew-symmetric matrix); and to discrete operators corresponding to random walks on $\Z^d$ with ergodic jump rates. The core of our result is to show that the ergodic Weyl decomposition associated to $Ł^2(X,μ)$ can almost surely be approximated by periodic Weyl decompositions with increasing periods, implying that semi-continuous variational formulae associated to $Ł^2(X,μ)$ can almost surely be approximated by variational formulae minimizing on periodic potential and solenoidal functions.
△ Less
Submitted 30 March, 2004; v1 submitted 8 January, 2002;
originally announced January 2002.
-
Multi-scale homogenization with bounded ratios and Anomalous Slow Diffusion
Authors:
Gérard Ben-Arous,
Houman Owhadi
Abstract:
We show that the effective diffusivity matrix $D(V^n)$ for the heat operator $\partial_t-(Δ/2-\nabla V^n \nabla)$ in a periodic potential $V^n=\sum_{k=0}^n U_k(x/R_k)$ obtained as a superposition of Holder-continuous periodic potentials $U_k$ (of period $\T^d:=\R^d/\Z^d$, $d\in \N^*$, $U_k(0)=0$) decays exponentially fast with the number of scales when the scale-ratios $R_{k+1}/R_k$ are bounded…
▽ More
We show that the effective diffusivity matrix $D(V^n)$ for the heat operator $\partial_t-(Δ/2-\nabla V^n \nabla)$ in a periodic potential $V^n=\sum_{k=0}^n U_k(x/R_k)$ obtained as a superposition of Holder-continuous periodic potentials $U_k$ (of period $\T^d:=\R^d/\Z^d$, $d\in \N^*$, $U_k(0)=0$) decays exponentially fast with the number of scales when the scale-ratios $R_{k+1}/R_k$ are bounded above and below. From this we deduce the anomalous slow behavior for a Brownian Motion in a potential obtained as a superposition of an infinite number of scales: $dy_t=dω_t -\nabla V^\infty(y_t) dt$
△ Less
Submitted 8 January, 2002; v1 submitted 31 May, 2001;
originally announced May 2001.
-
Super-diffusivity in a shear flow model from perpetual homogenization
Authors:
Gérard Ben-Arous,
Houman Owhadi
Abstract:
This paper is concerned with the asymptotic behavior solutions of stochastic differential equations $dy_t=dω_t -\nabla Γ(y_t) dt$, $y_0=0$ and $d=2$. $Γ$ is a $2\times 2$ skew-symmetric matrix associated to a shear flow characterized by an infinite number of spatial scales $Γ_{12}=-Γ_{21}=h(x_1)$, with $h(x_1)=\sum_{n=0}^\infty γ_n h^n(x_1/R_n)$ where $h^n$ are smooth functions of period 1,…
▽ More
This paper is concerned with the asymptotic behavior solutions of stochastic differential equations $dy_t=dω_t -\nabla Γ(y_t) dt$, $y_0=0$ and $d=2$. $Γ$ is a $2\times 2$ skew-symmetric matrix associated to a shear flow characterized by an infinite number of spatial scales $Γ_{12}=-Γ_{21}=h(x_1)$, with $h(x_1)=\sum_{n=0}^\infty γ_n h^n(x_1/R_n)$ where $h^n$ are smooth functions of period 1, $h^n(0)=0$, $γ_n$ and $R_n$ grow exponentially fast with $n$. We can show that $y_t$ has an anomalous fast behavior ($\E[|y_t|^2]\sim t^{1+ν}$ with $ν>0$) and obtain quantitative estimates on the anomaly using and develo** the tools of homogenization.
△ Less
Submitted 30 March, 2004; v1 submitted 24 May, 2001;
originally announced May 2001.
-
Anomalous Slow Diffusion from Perpetual Homogenization
Authors:
Houman Owhadi
Abstract:
This paper is concerned with the asymptotic behavior of solutions of stochastic differential equations $dy_t=dω_t -\nabla V(y_t) dt$, $y_0=0$. When $d=1$ and $V$ is not periodic but obtained as a superposition of an infinite number of periodic potentials with geometrically increasing periods ($V(x) = \sum_{k=0}^\infty U_k(x/R_k)$, where $U_k$ are smooth functions of period 1, $U_k(0)=0$, and…
▽ More
This paper is concerned with the asymptotic behavior of solutions of stochastic differential equations $dy_t=dω_t -\nabla V(y_t) dt$, $y_0=0$. When $d=1$ and $V$ is not periodic but obtained as a superposition of an infinite number of periodic potentials with geometrically increasing periods ($V(x) = \sum_{k=0}^\infty U_k(x/R_k)$, where $U_k$ are smooth functions of period 1, $U_k(0)=0$, and $R_k$ grows exponentially fast with $k$) we can show that $y_t$ has an anomalous slow behavior and we obtain quantitative estimates on the anomaly using and develo** the tools of homogenization. Pointwise estimates are based on a new analytical inequality for sub-harmonic functions. When $d\geq 1$ and $V$ is periodic, quantitative estimates are obtained on the heat kernel of $y_t$, showing the rate at which homogenization takes place. The latter result proves Davies's conjecture and is based on a quantitative estimate for the Laplace transform of martingales that can be used to obtain similar results for periodic elliptic generators
△ Less
Submitted 30 March, 2004; v1 submitted 20 May, 2001;
originally announced May 2001.
