-
Perspectives on locally weighted ensemble Kalman methods
Authors:
Philipp Wacker
Abstract:
This manuscript derives locally weighted ensemble Kalman methods from the point of view of ensemble-based function approximation. This is done by using pointwise evaluations to build up a local linear or quadratic approximation of a function, tapering off the effect of distant particles via local weighting. This introduces a candidate method (the locally weighted Ensemble Kalman method for inversi…
▽ More
This manuscript derives locally weighted ensemble Kalman methods from the point of view of ensemble-based function approximation. This is done by using pointwise evaluations to build up a local linear or quadratic approximation of a function, tapering off the effect of distant particles via local weighting. This introduces a candidate method (the locally weighted Ensemble Kalman method for inversion) with the motivation of combining some of the strengths of the particle filter (ability to cope with nonlinear maps and non-Gaussian distributions) and the Ensemble Kalman filter (no filter degeneracy).
△ Less
Submitted 7 May, 2024; v1 submitted 6 January, 2024;
originally announced February 2024.
-
Nested Sampling for Uncertainty Quantification and Rare Event Estimation
Authors:
Jonas Latz,
Doris Schneider,
Philipp Wacker
Abstract:
Nested Sampling is a method for computing the Bayesian evidence, also called the marginal likelihood, which is the integral of the likelihood with respect to the prior. More generally, it is a numerical probabilistic quadrature rule. The main idea of Nested Sampling is to replace a high-dimensional likelihood integral over parameter space with an integral over the unit line by employing a push-for…
▽ More
Nested Sampling is a method for computing the Bayesian evidence, also called the marginal likelihood, which is the integral of the likelihood with respect to the prior. More generally, it is a numerical probabilistic quadrature rule. The main idea of Nested Sampling is to replace a high-dimensional likelihood integral over parameter space with an integral over the unit line by employing a push-forward with respect to a suitable transformation. Practically, a set of active samples ascends the level sets of the integrand function, with the measure contraction of the super-level sets being statistically estimated. We justify the validity of this approach for integrands with non-negligible plateaus, and demonstrate Nested Sampling's practical effectiveness in estimating the (log-)probability of rare events.
△ Less
Submitted 6 October, 2023; v1 submitted 2 October, 2023;
originally announced October 2023.
-
Please, not \textit{another} note about Generalized Inverses
Authors:
Philipp Wacker
Abstract:
We prove some statements of left- and right-continuous variants of generalized inverses of non-decreasing real functions.
We prove some statements of left- and right-continuous variants of generalized inverses of non-decreasing real functions.
△ Less
Submitted 12 June, 2023;
originally announced June 2023.
-
Polarized consensus-based dynamics for optimization and sampling
Authors:
Leon Bungert,
Tim Roith,
Philipp Wacker
Abstract:
In this paper we propose polarized consensus-based dynamics in order to make consensus-based optimization (CBO) and sampling (CBS) applicable for objective functions with several global minima or distributions with many modes, respectively. For this, we ``polarize'' the dynamics with a localizing kernel and the resulting model can be viewed as a bounded confidence model for opinion formation in th…
▽ More
In this paper we propose polarized consensus-based dynamics in order to make consensus-based optimization (CBO) and sampling (CBS) applicable for objective functions with several global minima or distributions with many modes, respectively. For this, we ``polarize'' the dynamics with a localizing kernel and the resulting model can be viewed as a bounded confidence model for opinion formation in the presence of common objective. Instead of being attracted to a common weighted mean as in the original consensus-based methods, which prevents the detection of more than one minimum or mode, in our method every particle is attracted to a weighted mean which gives more weight to nearby particles. We prove that in the mean-field regime the polarized CBS dynamics are unbiased for Gaussian targets. We also prove that in the zero temperature limit and for sufficiently well-behaved strongly convex objectives the solution of the Fokker--Planck equation converges in the Wasserstein-2 distance to a Dirac measure at the minimizer. Finally, we propose a computationally more efficient generalization which works with a predefined number of clusters and improves upon our polarized baseline method for high-dimensional optimization.
△ Less
Submitted 9 October, 2023; v1 submitted 9 November, 2022;
originally announced November 2022.
-
Ensemble-based gradient inference for particle methods in optimization and sampling
Authors:
Claudia Schillings,
Claudia Totzeck,
Philipp Wacker
Abstract:
We propose an approach based on function evaluations and Bayesian inference to extract higher-order differential information of objective functions {from a given ensemble of particles}. Pointwise evaluation $\{V(x^i)\}_i$ of some potential $V$ in an ensemble $\{x^i\}_i$ contains implicit information about first or higher order derivatives, which can be made explicit with little computational effor…
▽ More
We propose an approach based on function evaluations and Bayesian inference to extract higher-order differential information of objective functions {from a given ensemble of particles}. Pointwise evaluation $\{V(x^i)\}_i$ of some potential $V$ in an ensemble $\{x^i\}_i$ contains implicit information about first or higher order derivatives, which can be made explicit with little computational effort (ensemble-based gradient inference -- EGI). We suggest to use this information for the improvement of established ensemble-based numerical methods for optimization and sampling such as Consensus-based optimization and Langevin-based samplers. Numerical studies indicate that the augmented algorithms are often superior to their gradient-free variants, in particular the augmented methods help the ensembles to escape their initial domain, to explore multimodal, non-Gaussian settings and to speed up the collapse at the end of optimization dynamics.}
The code for the numerical examples in this manuscript can be found in the paper's Github repository (https://github.com/MercuryBench/ensemble-based-gradient.git).
△ Less
Submitted 1 March, 2023; v1 submitted 23 September, 2022;
originally announced September 2022.
-
Maximum a posteriori estimators in $\ell^p$ are well-defined for diagonal Gaussian priors
Authors:
Ilja Klebanov,
Philipp Wacker
Abstract:
We prove that maximum a posteriori estimators are well-defined for diagonal Gaussian priors $μ$ on $\ell^p$ under common assumptions on the potential $Φ$. Further, we show connections to the Onsager--Machlup functional and provide a corrected and strongly simplified proof in the Hilbert space case $p=2$, previously established by Dashti et al (2013) and Kretschmann (2019).
These corrections do n…
▽ More
We prove that maximum a posteriori estimators are well-defined for diagonal Gaussian priors $μ$ on $\ell^p$ under common assumptions on the potential $Φ$. Further, we show connections to the Onsager--Machlup functional and provide a corrected and strongly simplified proof in the Hilbert space case $p=2$, previously established by Dashti et al (2013) and Kretschmann (2019).
These corrections do not generalize to the setting $1 \leq p < \infty$, which requires a novel convexification result for the difference between the Cameron--Martin norm and the $p$-norm.
△ Less
Submitted 29 September, 2022; v1 submitted 1 July, 2022;
originally announced July 2022.
-
Nested sampling for physical scientists
Authors:
Greg Ashton,
Noam Bernstein,
Johannes Buchner,
Xi Chen,
Gábor Csányi,
Andrew Fowlie,
Farhan Feroz,
Matthew Griffiths,
Will Handley,
Michael Habeck,
Edward Higson,
Michael Hobson,
Anthony Lasenby,
David Parkinson,
Livia B. Pártay,
Matthew Pitkin,
Doris Schneider,
Joshua S. Speagle,
Leah South,
John Veitch,
Philipp Wacker,
David J. Wales,
David Yallup
Abstract:
We review Skilling's nested sampling (NS) algorithm for Bayesian inference and more broadly multi-dimensional integration. After recapitulating the principles of NS, we survey developments in implementing efficient NS algorithms in practice in high-dimensions, including methods for sampling from the so-called constrained prior. We outline the ways in which NS may be applied and describe the applic…
▽ More
We review Skilling's nested sampling (NS) algorithm for Bayesian inference and more broadly multi-dimensional integration. After recapitulating the principles of NS, we survey developments in implementing efficient NS algorithms in practice in high-dimensions, including methods for sampling from the so-called constrained prior. We outline the ways in which NS may be applied and describe the application of NS in three scientific fields in which the algorithm has proved to be useful: cosmology, gravitational-wave astronomy, and materials science. We close by making recommendations for best practice when using NS and by summarizing potential limitations and optimizations of NS.
△ Less
Submitted 31 May, 2022;
originally announced May 2022.
-
Continuous time limit of the stochastic ensemble Kalman inversion: Strong convergence analysis
Authors:
Dirk Blömker,
Claudia Schillings,
Philipp Wacker,
Simon Weissmann
Abstract:
The Ensemble Kalman inversion (EKI) method is a method for the estimation of unknown parameters in the context of (Bayesian) inverse problems. The method approximates the underlying measure by an ensemble of particles and iteratively applies the ensemble Kalman update to evolve (the approximation of the) prior into the posterior measure.
For the convergence analysis of the EKI it is common pract…
▽ More
The Ensemble Kalman inversion (EKI) method is a method for the estimation of unknown parameters in the context of (Bayesian) inverse problems. The method approximates the underlying measure by an ensemble of particles and iteratively applies the ensemble Kalman update to evolve (the approximation of the) prior into the posterior measure.
For the convergence analysis of the EKI it is common practice to derive a continuous version, replacing the iteration with a stochastic differential equation. In this paper we validate this approach by showing that the stochastic EKI iteration converges to paths of the continuous-time stochastic differential equation by considering both the nonlinear and linear setting, and we prove convergence in probability for the former, and convergence in moments for the latter. The methods employed can also be applied to the analysis of more general numerical schemes for stochastic differential equations in general.
△ Less
Submitted 30 July, 2021;
originally announced July 2021.
-
Complete Deterministic Dynamics and Spectral Decomposition of the Linear Ensemble Kalman Inversion
Authors:
Leon Bungert,
Philipp Wacker
Abstract:
The ensemble Kalman inversion (EKI) for the solution of Bayesian inverse problems of type $y = A u +\varepsilon$, with $u$ being an unknown parameter, $y$ a given datum, and $\varepsilon$ measurement noise, is a powerful tool usually derived from a sequential Monte Carlo point of view. It describes the dynamics of an ensemble of particles $\{u^j(t)\}_{j=1}^J$, whose initial empirical measure is sa…
▽ More
The ensemble Kalman inversion (EKI) for the solution of Bayesian inverse problems of type $y = A u +\varepsilon$, with $u$ being an unknown parameter, $y$ a given datum, and $\varepsilon$ measurement noise, is a powerful tool usually derived from a sequential Monte Carlo point of view. It describes the dynamics of an ensemble of particles $\{u^j(t)\}_{j=1}^J$, whose initial empirical measure is sampled from the prior, evolving over an artificial time $t$ towards an approximate solution of the inverse problem, with $t=1$ emulating the posterior, and $t\to\infty$ corresponding to the under-regularized minimum-norm solution of the inverse problem. Using spectral techniques, we provide a complete description of the deterministic dynamics of EKI and its asymptotic behavior in parameter space. In particular, we analyze the dynamics of naive EKI and mean-field EKI with a special focus on their time asymptotic behavior. Furthermore, we show that -- even in the deterministic case -- residuals in parameter space do not decrease monotonously in the Euclidean norm and suggest a problem-adapted norm, where monotonicity can be proved. Finally, we derive a system of ordinary differential equations governing the spectrum and eigenvectors of the covariance matrix. While the analysis is aimed at the EKI, we believe that it can be applied to understand more general particle-based dynamical systems.
△ Less
Submitted 30 October, 2022; v1 submitted 27 April, 2021;
originally announced April 2021.
-
The lion in the attic -- A resolution of the Borel--Kolmogorov paradox
Authors:
Leon Bungert,
Philipp Wacker
Abstract:
The Borel--Kolmogorov paradox of conditioning with respect to events of prior probability zero has fascinated students and researchers since its discovery more than 100 years ago. Classical conditioning is only valid with respect to events of positive probability. If we ignore this constraint and condition on such sets, for example events of type $\{Y=y\}$ for a continuously distributed random var…
▽ More
The Borel--Kolmogorov paradox of conditioning with respect to events of prior probability zero has fascinated students and researchers since its discovery more than 100 years ago. Classical conditioning is only valid with respect to events of positive probability. If we ignore this constraint and condition on such sets, for example events of type $\{Y=y\}$ for a continuously distributed random variable $Y$, almost any probability measure can be chosen as the conditional measure on such sets. There have been numerous descriptions and explanations of the paradox' appearance in the setting of conditioning on a subset of probability zero. However, most treatments don't supply explicit instructions on how to avoid it. We propose to close this gap by defining a version of conditional measure which utilizes the Hausdorff measure. This makes the choice canonical in the sense that it only depends on the geometry of the space, thus removing any ambiguity. We describe the set of possible measures arising in the context of the Borel--Kolmogorov paradox and classify those coinciding with the canonical measure. The objective of this manuscript is to provide a manual for singular conditional probability: We give an explicit explanation in which settings ambiguity arises (and where not) and how to get rid of this ambiguity once and for all by a canonical choice.
△ Less
Submitted 1 April, 2022; v1 submitted 10 September, 2020;
originally announced September 2020.
-
MAP estimators for nonparametric Bayesian inverse problems in Banach spaces
Authors:
Philipp Wacker
Abstract:
In order to rigorously define maximum-a-posteriori estimators for nonparametric Bayesian inverse problems for general Banach space valued parameters, we derive and prove certain previously postulated but unproven bounds on small ball probabilities. This allows us to prove existence of MAP estimators in the Banach space setting under very mild assumptions on the loglikelihood. As a similar statemen…
▽ More
In order to rigorously define maximum-a-posteriori estimators for nonparametric Bayesian inverse problems for general Banach space valued parameters, we derive and prove certain previously postulated but unproven bounds on small ball probabilities. This allows us to prove existence of MAP estimators in the Banach space setting under very mild assumptions on the loglikelihood. As a similar statement so far (as far as the author is aware) only existed in the Hilbert space setting, this closes an important gap in the literature.
△ Less
Submitted 6 July, 2022; v1 submitted 24 July, 2020;
originally announced July 2020.
-
Pointwise defined version of conditional expectation with respect to a random variable
Authors:
Philipp Wacker
Abstract:
It is often of interest to condition on a singular event given by a random variable, e.g. $\{Y=y\}$ for a continuous random variable $Y$. Conditional measures with respect to this event are usually derived as a special case of the conditional expectation with respect to the random variables generating sigma algebra. The existence of the latter is usually proven via a non-constructive measure-theor…
▽ More
It is often of interest to condition on a singular event given by a random variable, e.g. $\{Y=y\}$ for a continuous random variable $Y$. Conditional measures with respect to this event are usually derived as a special case of the conditional expectation with respect to the random variables generating sigma algebra. The existence of the latter is usually proven via a non-constructive measure-theoretic argument which yields an only almost-everywhere defined quantity. In particular, the quantity $\mathbb E[f|Y]$ is initially only defined almost everywhere and conditioning on $Y=y$ corresponds to evaluating $\mathbb E[f|Y=y] = \mathbb E[f|Y]{Y=y}$, which is not meaningful because of $\mathbb E[f|Y]$ not being well-defined on such singular sets. This problem is not addressed by the introduction of regular conditional distributions, either. On the other hand it can be shown that the naively computed conditional density $f_{Z|Y=y}(z)$ (which is given by the ratio of joint and marginal densities) is a version of the conditional distribution, i.e. $\mathbb E[\{Z\in B\}|Y=y] = \int_B f_{Z|Y=y}(z) dz$ and this density can indeed be evaluated pointwise in $y$. This mismatch between mathematical theory (which generates an object which cannot produce what we need from it) and practical computation via the conditional density is an unfortunate fact. Furthermore, the classical approach does not allow a pointwise definition of conditional expectations of the form $\mathbb E[f|Y=y]$, only of conditional distributions $\mathbb E[\{Z\in B\}|Y=y]$. We propose a (as far as the author is aware) little known approach to obtaining a pointwise defined version of conditional expectation by use of the Lebesgue-Besicovich lemma without the need of additional topological arguments which are necessary in the usual derivation.
△ Less
Submitted 3 July, 2020;
originally announced July 2020.
-
Nested Sampling And Likelihood Plateaus
Authors:
Doris Schittenhelm,
Philipp Wacker
Abstract:
The main idea of nested sampling is to substitute the high-dimensional likelihood integral over the parameter space $Ω$ by an integral over the unit line $[0,1]$ by employing a push-forward with respect to a suitable transformation. For this substitution, it is often implicitly or explicitly assumed that samples from the prior are uniformly distributed along this unit line after having been mapped…
▽ More
The main idea of nested sampling is to substitute the high-dimensional likelihood integral over the parameter space $Ω$ by an integral over the unit line $[0,1]$ by employing a push-forward with respect to a suitable transformation. For this substitution, it is often implicitly or explicitly assumed that samples from the prior are uniformly distributed along this unit line after having been mapped by this transformation. We show that this assumption is wrong, especially in the case of a likelihood function with plateaus. Nevertheless, we show that the substitution enacted by nested sampling works because of more interesting reasons which we lay out. Although this means that analytically, nested sampling can deal with plateaus in the likelihood function, the actual performance of the algorithm suffers under such a setting and the method fails to approximate the evidence, mean and variance appropriately. We suggest a robust implementation of nested sampling by a simple decomposition idea which demonstrably overcomes this issue.
△ Less
Submitted 28 April, 2021; v1 submitted 18 May, 2020;
originally announced May 2020.
-
On the Convergence of the Laplace Approximation and Noise-Level-Robustness of Laplace-based Monte Carlo Methods for Bayesian Inverse Problems
Authors:
Claudia Schillings,
Björn Sprungk,
Philipp Wacker
Abstract:
The Bayesian approach to inverse problems provides a rigorous framework for the incorporation and quantification of uncertainties in measurements, parameters and models. We are interested in designing numerical methods which are robust w.r.t. the size of the observational noise, i.e., methods which behave well in case of concentrated posterior measures. The concentration of the posterior is a high…
▽ More
The Bayesian approach to inverse problems provides a rigorous framework for the incorporation and quantification of uncertainties in measurements, parameters and models. We are interested in designing numerical methods which are robust w.r.t. the size of the observational noise, i.e., methods which behave well in case of concentrated posterior measures. The concentration of the posterior is a highly desirable situation in practice, since it relates to informative or large data. However, it can pose a computational challenge for numerical methods based on the prior or reference measure. We propose to employ the Laplace approximation of the posterior as the base measure for numerical integration in this context. The Laplace approximation is a Gaussian measure centered at the maximum a-posteriori estimate and with covariance matrix depending on the logposterior density. We discuss convergence results of the Laplace approximation in terms of the Hellinger distance and analyze the efficiency of Monte Carlo methods based on it. In particular, we show that Laplace-based importance sampling and Laplace-based quasi-Monte-Carlo methods are robust w.r.t. the concentration of the posterior for large classes of posterior distributions and integrands whereas prior-based importance sampling and plain quasi-Monte Carlo are not. Numerical experiments are presented to illustrate the theoretical findings.
△ Less
Submitted 26 June, 2020; v1 submitted 13 January, 2019;
originally announced January 2019.
-
Well Posedness and Convergence Analysis of the Ensemble Kalman Inversion
Authors:
Dirk Blömker,
Claudia Schillings,
Philipp Wacker,
Simon Weissmann
Abstract:
The ensemble Kalman inversion is widely used in practice to estimate unknown parameters from noisy measurement data. Its low computational costs, straightforward implementation, and non-intrusive nature makes the method appealing in various areas of application. We present a complete analysis of the ensemble Kalman inversion with perturbed observations for a fixed ensemble size when applied to lin…
▽ More
The ensemble Kalman inversion is widely used in practice to estimate unknown parameters from noisy measurement data. Its low computational costs, straightforward implementation, and non-intrusive nature makes the method appealing in various areas of application. We present a complete analysis of the ensemble Kalman inversion with perturbed observations for a fixed ensemble size when applied to linear inverse problems. The well-posedness and convergence results are based on the continuous time scaling limits of the method. The resulting coupled system of stochastic differential equations allows to derive estimates on the long-time behaviour and provides insights into the convergence properties of the ensemble Kalman inversion. We view the method as a derivative free optimization method for the least-squares misfit functional, which opens up the perspective to use the method in various areas of applications such as imaging, groundwater flow problems, biological problems as well as in the context of the training of neural networks.
△ Less
Submitted 26 February, 2019; v1 submitted 19 October, 2018;
originally announced October 2018.
-
Wavelet-based priors accelerate maximum-a-posteriori optimization in Bayesian inverse problems
Authors:
Philipp Wacker,
Peter Knabner
Abstract:
Wavelet (Besov) priors are a promising way of reconstructing indirectly measured fields in a regularized manner. We demonstrate how wavelets can be used as a localized basis for reconstructing permeability fields with sharp interfaces from noisy pointwise pressure field measurements in the context of the elliptic inverse problem. For this we derive the adjoint method of minimizing the Besov-norm-r…
▽ More
Wavelet (Besov) priors are a promising way of reconstructing indirectly measured fields in a regularized manner. We demonstrate how wavelets can be used as a localized basis for reconstructing permeability fields with sharp interfaces from noisy pointwise pressure field measurements in the context of the elliptic inverse problem. For this we derive the adjoint method of minimizing the Besov-norm-regularized misfit functional (this corresponds to determining the maximum a posteriori point in the Bayesian point of view) in the Haar wavelet setting. As it turns out, choosing a wavelet--based prior allows for accelerated optimization compared to established trigonometrically--based priors.
△ Less
Submitted 7 July, 2019; v1 submitted 20 October, 2017;
originally announced October 2017.
-
A strongly convergent numerical scheme from Ensemble Kalman inversion
Authors:
Dirk Blömker,
Claudia Schillings,
Philipp Wacker
Abstract:
The Ensemble Kalman methodology in an inverse problems setting can be viewed as an iterative scheme, which is a weakly tamed discretization scheme for a certain stochastic differential equation (SDE). Assuming a suitable approximation result, dynamical properties of the SDE can be rigorously pulled back via the discrete scheme to the original Ensemble Kalman inversion.
The results of this paper…
▽ More
The Ensemble Kalman methodology in an inverse problems setting can be viewed as an iterative scheme, which is a weakly tamed discretization scheme for a certain stochastic differential equation (SDE). Assuming a suitable approximation result, dynamical properties of the SDE can be rigorously pulled back via the discrete scheme to the original Ensemble Kalman inversion.
The results of this paper make a step towards closing the gap of the missing approximation result by proving a strong convergence result in a simplified model of a scalar stochastic differential equation. We focus here on a toy model with similar properties than the one arising in the context of Ensemble Kalman filter. The proposed model can be interpreted as a single particle filter for a linear map and thus forms the basis for further analysis. The difficulty in the analysis arises from the formally derived limiting SDE with non-globally Lipschitz continuous nonlinearities both in the drift and in the diffusion. Here the standard Euler-Maruyama scheme might fail to provide a strongly convergent numerical scheme and taming is necessary. In contrast to the strong taming usually used, the method presented here provides a weaker form of taming.
We present a strong convergence analysis by first proving convergence on a domain of high probability by using a cut-off or localisation, which then leads, combined with bounds on moments for both the SDE and the numerical scheme, by a bootstrap** argument to strong convergence.
△ Less
Submitted 18 June, 2018; v1 submitted 20 March, 2017;
originally announced March 2017.
-
Laplace's method in Bayesian inverse problems
Authors:
Philipp Wacker
Abstract:
In a Bayesian inverse problem setting, the solution consists of a posterior measure obtained by combining prior belief, information about the forward operator, and noisy observational data. This measure is most often given in terms of a density with respect to a reference measure in a high-dimensional (or infinite-dimensional) Banach space. Although Monte Carlo sampling methods provide a way of qu…
▽ More
In a Bayesian inverse problem setting, the solution consists of a posterior measure obtained by combining prior belief, information about the forward operator, and noisy observational data. This measure is most often given in terms of a density with respect to a reference measure in a high-dimensional (or infinite-dimensional) Banach space. Although Monte Carlo sampling methods provide a way of querying the posterior, the necessity of evaluating the forward operator many times (which will often be a costly PDE solver) prohibits this in practice. For this reason, many practitioners choose a suitable Gaussian approximation of the posterior measure, in a procedure called Laplace's method. Once generated, this Gaussian measure is a lot easier to sample from and properties like moments are immediately acquired. This paper derives Laplace's approximation of the posterior measure attributed to the inverse problem explicitly as the posterior measure of a second-order approximation of the data-misfit functional, specifically in the infinite-dimensional setting. By use of a reverse Cauchy-Schwarz inequality we are able to explicitly bound the Hellinger distance between the posterior and its approximation.
△ Less
Submitted 11 April, 2017; v1 submitted 27 January, 2017;
originally announced January 2017.
-
Probabilistic Estimates of the Maximum Norm of Random Neumann Fourier Series
Authors:
Dirk Blömker,
Philipp Wacker,
Thomas Wanner
Abstract:
We study the maximum norm behavior of $L^2$-normalized random Fourier cosine series with a prescribed large wave number. Precise bounds of this type are an important technical tool in estimates for spinodal decomposition, the celebrated phase separation phenomenon in metal alloys. We derive rigorous asymptotic results as the wave number converges to infinity, and shed light on the behavior of the…
▽ More
We study the maximum norm behavior of $L^2$-normalized random Fourier cosine series with a prescribed large wave number. Precise bounds of this type are an important technical tool in estimates for spinodal decomposition, the celebrated phase separation phenomenon in metal alloys. We derive rigorous asymptotic results as the wave number converges to infinity, and shed light on the behavior of the maximum norm for medium range wave numbers through numerical simulations. Finally, we develop a simplified model for describing the magnitude of extremal values of random Neumann Fourier series. The model describes key features of the development of maxima and can be used to predict them. This is achieved by decoupling magnitude and sign distribution, where the latter plays an important role for the study of the size of the maximum norm. Since we are considering series with Neumann boundary conditions, particular care has to be placed on understanding the behavior of the random sums at the boundary.
△ Less
Submitted 14 March, 2016;
originally announced March 2016.
-
Bayesian model selection for linear regression
Authors:
Miguel de Benito Delgado,
Philipp Wacker
Abstract:
In this note we introduce linear regression with basis functions in order to apply Bayesian model selection. The goal is to incorporate Occam's razor as provided by Bayes analysis in order to automatically pick the model optimally able to explain the data without overfitting.
In this note we introduce linear regression with basis functions in order to apply Bayesian model selection. The goal is to incorporate Occam's razor as provided by Bayes analysis in order to automatically pick the model optimally able to explain the data without overfitting.
△ Less
Submitted 15 December, 2015;
originally announced December 2015.
-
Pattern size in Gaussian fields from spinodal decomposition
Authors:
Luigi Amedeo Bianchi,
Dirk Blömker,
Philipp Wacker
Abstract:
We study the two-dimensional snake-like pattern that arises in phase separation of alloys described by spinodal decomposition in the Cahn-Hilliard model. These are somewhat universal patterns due to an overlay of eigenfunctions of the Laplacian with a similar wave-number. Similar structures appear in other models like reaction-diffusion systems describing animal coats' patterns or vegetation patte…
▽ More
We study the two-dimensional snake-like pattern that arises in phase separation of alloys described by spinodal decomposition in the Cahn-Hilliard model. These are somewhat universal patterns due to an overlay of eigenfunctions of the Laplacian with a similar wave-number. Similar structures appear in other models like reaction-diffusion systems describing animal coats' patterns or vegetation patterns in desertification.
Our main result studies random functions given by cosine Fourier series with independent Gaussian coefficients, that dominate the dynamics in the Cahn-Hilliard model. This is not a cosine process, as the sum is taken over domains in Fourier space that not only grow and scale with a parameter of order $1/\varepsilon$, but also move to infinity. Moreover, the model under consideration is neither stationary nor isotropic.
To study the pattern size of nodal domains we consider the density of zeros on any straight line through the spatial domain. Using a theorem by Edelman and Kostlan and weighted ergodic theorems that ensure the convergence of the moving sums, we show that the average distance of zeros is asymptotically of order $\varepsilon$ with a precisely given constant.
△ Less
Submitted 17 November, 2015; v1 submitted 7 October, 2015;
originally announced October 2015.
