Showing 1–25 of 25 results for author: Roininen, L

Bayesian inversion with Student's t priors based on Gaussian scale mixtures

Authors: Angelina Senchukova, Felipe Uribe, Lassi Roininen

Abstract: Many inverse problems focus on recovering a quantity of interest that is a priori known to exhibit either discontinuous or smooth behavior. Within the Bayesian approach to inverse problems, such structural information can be encoded using Markov random field priors. Here, we propose a class of priors that combine Markov random field structure with Student's t distribution. This approach offers fle… ▽ More Many inverse problems focus on recovering a quantity of interest that is a priori known to exhibit either discontinuous or smooth behavior. Within the Bayesian approach to inverse problems, such structural information can be encoded using Markov random field priors. Here, we propose a class of priors that combine Markov random field structure with Student's t distribution. This approach offers flexibility in modeling diverse structural behaviors depending on available data. Flexibility is achieved by including the degrees of freedom parameter of Student's t in the formulation of the Bayesian inverse problem. To facilitate posterior computations, we employ Gaussian scale mixture representation for the Student's t Markov random field prior which allows expressing the prior as a conditionally Gaussian distribution depending of auxiliary hyperparameters. Adopting this representation, we can derive most of the posterior conditional distributions in closed form and utilize the Gibbs sampler to explore the posterior. We illustrate the method with two numerical examples: signal deconvolution and image deblurring. △ Less

Submitted 20 March, 2024; originally announced March 2024.

Log-Gaussian Gamma Processes for Training Bayesian Neural Networks in Raman and CARS Spectroscopies

Authors: Teemu Härkönen, Erik M. Vartiainen, Lasse Lensu, Matthew T. Moores, Lassi Roininen

Abstract: We propose an approach utilizing gamma-distributed random variables, coupled with log-Gaussian modeling, to generate synthetic datasets suitable for training neural networks. This addresses the challenge of limited real observations in various applications. We apply this methodology to both Raman and coherent anti-Stokes Raman scattering (CARS) spectra, using experimental spectra to estimate gamma… ▽ More We propose an approach utilizing gamma-distributed random variables, coupled with log-Gaussian modeling, to generate synthetic datasets suitable for training neural networks. This addresses the challenge of limited real observations in various applications. We apply this methodology to both Raman and coherent anti-Stokes Raman scattering (CARS) spectra, using experimental spectra to estimate gamma process parameters. Parameter estimation is performed using Markov chain Monte Carlo methods, yielding a full Bayesian posterior distribution for the model which can be sampled for synthetic data generation. Additionally, we model the additive and multiplicative background functions for Raman and CARS with Gaussian processes. We train two Bayesian neural networks to estimate parameters of the gamma process which can then be used to estimate the underlying Raman spectrum and simultaneously provide uncertainty through the estimation of parameters of a probability distribution. We apply the trained Bayesian neural networks to experimental Raman spectra of phthalocyanine blue, aniline black, naphthol red, and red 264 pigments and also to experimental CARS spectra of adenosine phosphate, fructose, glucose, and sucrose. The results agree with deterministic point estimates for the underlying Raman and CARS spectral signatures. △ Less

Submitted 21 December, 2023; v1 submitted 12 October, 2023; originally announced October 2023.

MSC Class: 62F15; 60G10; 62M45 (Primary) 78M31 (Secondary)

Denture reinforcement via topology optimization

Authors: Rabia Altunay, Kalevi Vesterinen, Pasi Alander, Eero Immonen, Andreas Rupp, Lassi Roininen

Abstract: We present a computational design method that optimizes the reinforcement of dental prostheses and increases the durability and fracture resistance of dentures. Our approach optimally places reinforcement, which could be implemented by modern multi-material, three-dimensional printers. The study focuses on reducing deformation by identifying regions within the structure that require reinforcement… ▽ More We present a computational design method that optimizes the reinforcement of dental prostheses and increases the durability and fracture resistance of dentures. Our approach optimally places reinforcement, which could be implemented by modern multi-material, three-dimensional printers. The study focuses on reducing deformation by identifying regions within the structure that require reinforcement (E-glass material). Our method is applied to a three-dimensional removable lower jaw dental prosthesis and aims to improve the living quality of denture patients and pretend fracture of dental reinforcement in clinical studies. To do this, we compare the deformation results of a non-reinforced denture and a reinforced denture that has two materials. The results indicate the maximum deformation is lower and node-based displacement distribution demonstrates that the average displacement distribution is much better in the reinforced denture. △ Less

Submitted 1 September, 2023; originally announced September 2023.

A Statistical Framework and Analysis for Perfect Radar Pulse Compression

Authors: Neil K. Chada, Petteri Piiroinen, Lassi Roininen

Abstract: Perfect radar pulse compression coding is a potential emerging field which aims at providing rigorous analysis and fundamental limit radar experiments. It is based on finding non-trivial pulse codes, which we can make statistically equivalent, to the radar experiments carried out with elementary pulses of some shape. A common engineering-based radar experiment design, regarding pulse-compression,… ▽ More Perfect radar pulse compression coding is a potential emerging field which aims at providing rigorous analysis and fundamental limit radar experiments. It is based on finding non-trivial pulse codes, which we can make statistically equivalent, to the radar experiments carried out with elementary pulses of some shape. A common engineering-based radar experiment design, regarding pulse-compression, often omits the rigorous theory and mathematical limitations. In this work our aim is to develop a mathematical theory which coincides with understanding the radar experiment in terms of the theory of comparison of statistical experiments. We review and generalize some properties of the Itô measure. We estimate the unknown i.e. the structure function in the context of Bayesian statistical inverse problems. We study the posterior for generalized $d$-dimensional inverse problems, where we consider both real-valued and complex-valued inputs for posteriori analysis. Finally this is then extended to the infinite dimensional setting, where our analysis suggests the underlying posterior is non-Gaussian. △ Less

Submitted 15 August, 2023; originally announced August 2023.

Bayesian inversion with α-stable priors

Authors: Jarkko Suuronen, Tomás Soto, Neil K. Chada, Lassi Roininen

Abstract: We propose to use Lévy α-stable distributions for constructing priors for Bayesian inverse problems. The construction is based on Markov fields with stable-distributed increments. Special cases include the Cauchy and Gaussian distributions, with stability indices α = 1, and α = 2, respectively. Our target is to show that these priors provide a rich class of priors for modelling rough features. The… ▽ More We propose to use Lévy α-stable distributions for constructing priors for Bayesian inverse problems. The construction is based on Markov fields with stable-distributed increments. Special cases include the Cauchy and Gaussian distributions, with stability indices α = 1, and α = 2, respectively. Our target is to show that these priors provide a rich class of priors for modelling rough features. The main technical issue is that the α-stable probability density functions do not have closed-form expressions in general, and this limits their applicability. For practical purposes, we need to approximate probability density functions through numerical integration or series expansions. Current available approximation methods are either too time-consuming or do not function within the range of stability and radius arguments needed in Bayesian inversion. To address the issue, we propose a new hybrid approximation method for symmetric univariate and bivariate α-stable distributions, which is both fast to evaluate, and accurate enough from a practical viewpoint. Then we use approximation method in the numerical implementation of α-stable random field priors. We demonstrate the applicability of the constructed priors on selected Bayesian inverse problems which include the deconvolution problem, and the inversion of a function governed by an elliptic partial differential equation. We also demonstrate hierarchical α-stable priors in the one-dimensional deconvolution problem. We employ maximum-a-posterior-based estimation at all the numerical examples. To that end, we exploit the limited-memory BFGS and its bounded variant for the estimator. △ Less

Submitted 23 June, 2023; v1 submitted 11 December, 2022; originally announced December 2022.

Mixtures of Gaussian Process Experts with SMC$^2$

Authors: Teemu Härkönen, Sara Wade, Kody Law, Lassi Roininen

Abstract: Gaussian processes are a key component of many flexible statistical and machine learning models. However, they exhibit cubic computational complexity and high memory constraints due to the need of inverting and storing a full covariance matrix. To circumvent this, mixtures of Gaussian process experts have been considered where data points are assigned to independent experts, reducing the complexit… ▽ More Gaussian processes are a key component of many flexible statistical and machine learning models. However, they exhibit cubic computational complexity and high memory constraints due to the need of inverting and storing a full covariance matrix. To circumvent this, mixtures of Gaussian process experts have been considered where data points are assigned to independent experts, reducing the complexity by allowing inference based on smaller, local covariance matrices. Moreover, mixtures of Gaussian process experts substantially enrich the model's flexibility, allowing for behaviors such as non-stationarity, heteroscedasticity, and discontinuities. In this work, we construct a novel inference approach based on nested sequential Monte Carlo samplers to simultaneously infer both the gating network and Gaussian process expert parameters. This greatly improves inference compared to importance sampling, particularly in settings when a stationary Gaussian process is inappropriate, while still being thoroughly parallelizable. △ Less

Submitted 26 August, 2022; originally announced August 2022.

Geometry parameter estimation for sparse X-ray log imaging

Authors: Angelina Senchukova, Jarkko Suuronen, Jere Heikkinen, Lassi Roininen

Abstract: We consider geometry parameter estimation in industrial sawmill fan-beam X-ray tomography. In such industrial settings, scanners do not always allow identification of the location of the source-detector pair, which creates the issue of unknown geometry. This work considers an approach for geometry estimation based on the calibration object. We parametrise the geometry using a set of 5 parameters.… ▽ More We consider geometry parameter estimation in industrial sawmill fan-beam X-ray tomography. In such industrial settings, scanners do not always allow identification of the location of the source-detector pair, which creates the issue of unknown geometry. This work considers an approach for geometry estimation based on the calibration object. We parametrise the geometry using a set of 5 parameters. To estimate the geometry parameters, we calculate the maximum cross-correlation between a known-sized calibration object image and its filtered backprojection reconstruction and use differential evolution as an optimiser. The approach allows estimating geometry parameters from full-angle measurements as well as from sparse measurements. We show numerically that different sets of parameters can be used for artefact-free reconstruction. We deploy Bayesian inversion with first-order isotropic Cauchy difference priors for reconstruction of synthetic and real sawmill data with a very low number of measurements. △ Less

Submitted 8 December, 2023; v1 submitted 29 June, 2022; originally announced June 2022.

Reconstruction and segmentation from sparse sequential X-ray measurements of wood logs

Authors: Sebastian Springer, Aldo Glielmo, Angelina Senchukova, Tomi Kauppi, Jarkko Suuronen, Lassi Roininen, Heikki Haario, Andreas Hauptmann

Abstract: In industrial applications, it is common to scan objects on a moving conveyor belt. If slice-wise 2D computed tomography (CT) measurements of the moving object are obtained we call it a sequential scanning geometry. In this case, each slice on its own does not carry sufficient information to reconstruct a useful tomographic image. Thus, here we propose the use of a Dimension reduced Kalman Filter… ▽ More In industrial applications, it is common to scan objects on a moving conveyor belt. If slice-wise 2D computed tomography (CT) measurements of the moving object are obtained we call it a sequential scanning geometry. In this case, each slice on its own does not carry sufficient information to reconstruct a useful tomographic image. Thus, here we propose the use of a Dimension reduced Kalman Filter to accumulate information between slices and allow for sufficiently accurate reconstructions for further assessment of the object. Additionally, we propose to use an unsupervised clustering approach known as Density Peak Advanced, to perform a segmentation and spot density anomalies in the internal structure of the reconstructed objects. We evaluate the method in a proof of concept study for the application of wood log scanning for the industrial sawing process, where the goal is to spot anomalies within the wood log to allow for optimal sawing patterns. Reconstruction and segmentation quality are evaluated from experimental measurement data for various scenarios of severely undersampled X-measurements. Results show clearly that an improvement in reconstruction quality can be obtained by employing the Dimension reduced Kalman Filter allowing to robustly obtain the segmented logs. △ Less

Submitted 9 November, 2023; v1 submitted 20 June, 2022; originally announced June 2022.

A Log-Gaussian Cox Process with Sequential Monte Carlo for Line Narrowing in Spectroscopy

Authors: Teemu Härkönen, Emma Hannula, Matthew T. Moores, Erik M. Vartiainen, Lassi Roininen

Abstract: We propose a statistical model for narrowing line shapes in spectroscopy that are well approximated as linear combinations of Lorentzian or Voigt functions. We introduce a log-Gaussian Cox process to represent the peak locations thereby providing uncertainty quantification for the line narrowing. Bayesian formulation of the method allows for robust and explicit inclusion of prior information as pr… ▽ More We propose a statistical model for narrowing line shapes in spectroscopy that are well approximated as linear combinations of Lorentzian or Voigt functions. We introduce a log-Gaussian Cox process to represent the peak locations thereby providing uncertainty quantification for the line narrowing. Bayesian formulation of the method allows for robust and explicit inclusion of prior information as probability distributions for parameters of the model. Estimation of the signal and its parameters is performed using a sequential Monte Carlo algorithm followed by an optimization step to determine the peak locations. Our method is validated using a simulation study and applied to a mineralogical Raman spectrum. △ Less

Submitted 7 June, 2023; v1 submitted 26 February, 2022; originally announced February 2022.

MSC Class: 62F15; 62L12 (Primary); 78M31 (Secondary)

Cauchy Markov Random Field Priors for Bayesian Inversion

Authors: Neil K. Chada, Lassi Roininen, Jarkko Suuronen

Abstract: The use of Cauchy Markov random field priors in statistical inverse problems can potentially lead to posterior distributions which are non-Gaussian, high-dimensional, multimodal and heavy-tailed. In order to use such priors successfully, sophisticated optimization and Markov chain Monte Carlo (MCMC) methods are usually required. In this paper, our focus is largely on reviewing recently developed C… ▽ More The use of Cauchy Markov random field priors in statistical inverse problems can potentially lead to posterior distributions which are non-Gaussian, high-dimensional, multimodal and heavy-tailed. In order to use such priors successfully, sophisticated optimization and Markov chain Monte Carlo (MCMC) methods are usually required. In this paper, our focus is largely on reviewing recently developed Cauchy difference priors, while introducing interesting new variants, whilst providing a comparison. We firstly propose a one-dimensional second order Cauchy difference prior, and construct new first and second order two-dimensional isotropic Cauchy difference priors. Another new Cauchy prior is based on the stochastic partial differential equation approach, derived from Matérn type Gaussian presentation. The comparison also includes Cauchy sheets. Our numerical computations are based on both maximum a posteriori and conditional mean estimation.We exploit state-of-the-art MCMC methodologies such as Metropolis-within-Gibbs, Repelling-Attracting Metropolis, and No-U-Turn sampler variant of Hamiltonian Monte Carlo. We demonstrate the models and methods constructed for one-dimensional and two-dimensional deconvolution problems. Thorough MCMC statistics are provided for all test cases, including potential scale reduction factors. △ Less

Submitted 13 February, 2022; v1 submitted 26 May, 2021; originally announced May 2021.

Blind hierarchical deconvolution

Authors: Arttu Arjas, Lassi Roininen, Mikko J. Sillanpää, Andreas Hauptmann

Abstract: Deconvolution is a fundamental inverse problem in signal processing and the prototypical model for recovering a signal from its noisy measurement. Nevertheless, the majority of model-based inversion techniques require knowledge on the convolution kernel to recover an accurate reconstruction and additionally prior assumptions on the regularity of the signal are needed. To overcome these limitations… ▽ More Deconvolution is a fundamental inverse problem in signal processing and the prototypical model for recovering a signal from its noisy measurement. Nevertheless, the majority of model-based inversion techniques require knowledge on the convolution kernel to recover an accurate reconstruction and additionally prior assumptions on the regularity of the signal are needed. To overcome these limitations, we parametrise the convolution kernel and prior length-scales, which are then jointly estimated in the inversion procedure. The proposed framework of blind hierarchical deconvolution enables accurate reconstructions of functions with varying regularity and unknown kernel size and can be solved efficiently with an empirical Bayes two-step procedure, where hyperparameters are first estimated by optimisation and other unknowns then by an analytical formula. △ Less

Submitted 22 July, 2020; originally announced July 2020.

Non-Stationary Multi-layered Gaussian Priors for Bayesian Inversion

Authors: Muhammad Emzir, Sari Lasanen, Zenith Purisha, Lassi Roininen, Simo Särkkä

Abstract: In this article, we study Bayesian inverse problems with multi-layered Gaussian priors. We first describe the conditionally Gaussian layers in terms of a system of stochastic partial differential equations. We build the computational inference method using a finite-dimensional Galerkin method. We show that the proposed approximation has a convergence-in-probability property to the solution of the… ▽ More In this article, we study Bayesian inverse problems with multi-layered Gaussian priors. We first describe the conditionally Gaussian layers in terms of a system of stochastic partial differential equations. We build the computational inference method using a finite-dimensional Galerkin method. We show that the proposed approximation has a convergence-in-probability property to the solution of the original multi-layered model. We then carry out Bayesian inference using the preconditioned Crank--Nicolson algorithm which is modified to work with multi-layered Gaussian fields. We show via numerical experiments in signal deconvolution and computerized X-ray tomography problems that the proposed method can offer both smoothing and edge preservation at the same time. △ Less

Submitted 28 June, 2020; originally announced June 2020.

Bayesian quantification for coherent anti-Stokes Raman scattering spectroscopy

Authors: Teemu Härkönen, Lassi Roininen, Matthew T. Moores, Erik M. Vartiainen

Abstract: We propose a Bayesian statistical model for analyzing coherent anti-Stokes Raman scattering (CARS) spectra. Our quantitative analysis includes statistical estimation of constituent line-shape parameters, underlying Raman signal, error-corrected CARS spectrum, and the measured CARS spectrum. As such, this work enables extensive uncertainty quantification in the context of CARS spectroscopy. Further… ▽ More We propose a Bayesian statistical model for analyzing coherent anti-Stokes Raman scattering (CARS) spectra. Our quantitative analysis includes statistical estimation of constituent line-shape parameters, underlying Raman signal, error-corrected CARS spectrum, and the measured CARS spectrum. As such, this work enables extensive uncertainty quantification in the context of CARS spectroscopy. Furthermore, we present an unsupervised method for improving spectral resolution of Raman-like spectra requiring little to no \textit{a priori} information. Finally, the recently-proposed wavelet prism method for correcting the experimental artefacts in CARS is enhanced by using interpolation techniques for wavelets. The method is validated using CARS spectra of adenosine mono-, di-, and triphosphate in water, as well as, equimolar aqueous solutions of D-fructose, D-glucose, and their disaccharide combination sucrose. △ Less

Submitted 14 May, 2020; originally announced May 2020.

Enhancing Industrial X-ray Tomography by Data-Centric Statistical Methods

Authors: Jarkko Suuronen, Muhammad Emzir, Sari Lasanen, Simo Särkkä, Lassi Roininen

Abstract: X-ray tomography has applications in various industrial fields such as sawmill industry, oil and gas industry, chemical engineering, and geotechnical engineering. In this article, we study Bayesian methods for the X-ray tomography reconstruction. In Bayesian methods, the inverse problem of tomographic reconstruction is solved with help of a statistical prior distribution which encodes the possible… ▽ More X-ray tomography has applications in various industrial fields such as sawmill industry, oil and gas industry, chemical engineering, and geotechnical engineering. In this article, we study Bayesian methods for the X-ray tomography reconstruction. In Bayesian methods, the inverse problem of tomographic reconstruction is solved with help of a statistical prior distribution which encodes the possible internal structures by assigning probabilities for smoothness and edge distribution of the object. We compare Gaussian random field priors, that favour smoothness, to non-Gaussian total variation, Besov, and Cauchy priors which promote sharp edges and high-contrast and low-contrast areas in the object. We also present computational schemes for solving the resulting high-dimensional Bayesian inverse problem with 100,000-1,000,000 unknowns. In particular, we study the applicability of a no-U-turn variant of Hamiltonian Monte Carlo methods and of a more classical adaptive Metropolis-within-Gibbs algorithm for this purpose. These methods also enable full uncertainty quantification of the reconstructions. For faster computations, we use maximum a posteriori estimates with limited-memory BFGS optimisation algorithm. As the first industrial application, we consider sawmill industry X-ray log tomography. The logs have knots, rotten parts, and even possibly metallic pieces, making them good examples for non-Gaussian priors. Secondly, we study drill-core rock sample tomography, an example from oil and gas industry. We show that Cauchy priors produce smaller number of artefacts than other choices, especially with sparse high-noise measurements, and choosing Hamiltonian Monte Carlo enables systematic uncertainty quantification. △ Less

Submitted 8 March, 2020; originally announced March 2020.

Brexit Risk Implied by the SABR Martingale Defect in the EUR-GBP Smile

Authors: Petteri Piiroinen, Lassi Roininen, Martin Simon

Abstract: We construct a data-driven statistical indicator for quantifying the tail risk perceived by the EURGBP option market surrounding Brexit-related events. We show that under lognormal SABR dynamics this tail risk is closely related to the so-called martingale defect and provide a closed-form expression for this defect which can be computed by solving an inverse calibration problem. In order to cope w… ▽ More We construct a data-driven statistical indicator for quantifying the tail risk perceived by the EURGBP option market surrounding Brexit-related events. We show that under lognormal SABR dynamics this tail risk is closely related to the so-called martingale defect and provide a closed-form expression for this defect which can be computed by solving an inverse calibration problem. In order to cope with the the uncertainty which is inherent to this inverse problem, we adopt a Bayesian statistical parameter estimation perspective. We probe the resulting posterior densities with a combination of optimization and adaptive Markov chain Monte Carlo methods, thus providing a careful uncertainty estimation for all of the underlying parameters and the martingale defect indicator. Finally, to support the feasibility of the proposed method, we provide a Brexit "fever curve" for the year 2019. △ Less

Submitted 27 March, 2020; v1 submitted 12 December, 2019; originally announced December 2019.

A Bayesian-based approach to improving acoustic Born waveform inversion of seismic data for viscoelastic media

Authors: Kenneth Muhumuza, Lassi Roininen, Janne M. J. Huttunen, Timo Lähivaara

Abstract: In seismic waveform inversion, the reconstruction of the subsurface properties is usually carried out using approximative wave propagation models to ensure computational efficiency. The viscoelastic nature of the subsurface is often unaccounted for, and two popular approximations--the acoustic and linearized Born inversion--are widely used. This leads to reconstruction errors since the approximati… ▽ More In seismic waveform inversion, the reconstruction of the subsurface properties is usually carried out using approximative wave propagation models to ensure computational efficiency. The viscoelastic nature of the subsurface is often unaccounted for, and two popular approximations--the acoustic and linearized Born inversion--are widely used. This leads to reconstruction errors since the approximations ignore realistic (physical) aspects of seismic wave propagation in the heterogeneous earth. In this study, we show that the Bayesian approximation error approach can be used to partially recover from errors, addressing elastic and viscous effects in acoustic Born inversion for viscoelastic media. The results of numerical examples indicate that neglecting the modelling errors induced by the approximations results in very poor recovery of the subsurface velocity fields. △ Less

Submitted 4 November, 2019; originally announced November 2019.

Comments: 27 pages, 8 figures

Posterior Convergence Analysis of $α$-Stable Sheets

Authors: Neil K. Chada, Sari Lasanen, Lassi Roininen

Abstract: This paper is concerned with the theoretical understanding of $α$-stable sheets $U$ on $\mathbb{R}^d$. Our motivation for this is in the context of Bayesian inverse problems, where we consider these processes as prior distributions, aiming to quantify information of the posterior. We derive convergence results referring to finite-dimensional approximations of infinite-dimensional random variables.… ▽ More This paper is concerned with the theoretical understanding of $α$-stable sheets $U$ on $\mathbb{R}^d$. Our motivation for this is in the context of Bayesian inverse problems, where we consider these processes as prior distributions, aiming to quantify information of the posterior. We derive convergence results referring to finite-dimensional approximations of infinite-dimensional random variables. In doing so we use a number of variants which these sheets can take, such as a stochastic integral representation, but also random series expansions through Poisson processes. Our proofs will rely on the fact of whether $U$ can omit $L^p$-sample paths. To aid with the convergence of the finite approximations we provide a natural discretization to represent the prior. Aside from convergence of these stable sheets we address whether both well-posedness and well-definiteness of the inverse problem can be attained. △ Less

Submitted 12 August, 2019; v1 submitted 6 July, 2019; originally announced July 2019.

MSC Class: 60G52; 60G17; 62M40; 35R30

Asset Price Bubbles: An Option-based Indicator

Authors: Petteri Piiroinen, Lassi Roininen, Tobias Schoden, Martin Simon

Abstract: We construct a statistical indicator for the detection of short-term asset price bubbles based on the information content of bid and ask market quotes for plain vanilla put and call options. Our construction makes use of the martingale theory of asset price bubbles and the fact that such scenarios where the price for an asset exceeds its fundamental value can in principle be detected by analysis o… ▽ More We construct a statistical indicator for the detection of short-term asset price bubbles based on the information content of bid and ask market quotes for plain vanilla put and call options. Our construction makes use of the martingale theory of asset price bubbles and the fact that such scenarios where the price for an asset exceeds its fundamental value can in principle be detected by analysis of the asymptotic behavior of the implied volatility surface. For extrapolating this implied volatility, we choose the SABR model, mainly because of its decent fit to real option market quotes for a broad range of maturities and its ease of calibration. As main theoretical result, we show that under lognormal SABR dynamics, we can compute a simple yet powerful closed-form martingale defect indicator by solving an ill-posed inverse calibration problem. In order to cope with the ill-posedness and to quantify the uncertainty which is inherent to such an indicator, we adopt a Bayesian statistical parameter estimation perspective. We probe the resulting posterior densities with a combination of optimization and adaptive Markov chain Monte Carlo methods, thus providing a full-blown uncertainty estimation of all the underlying parameters and the martingale defect indicator. Finally, we provide real-market tests of the proposed option-based indicator with focus on tech stocks due to increasing concerns about a tech bubble 2.0. △ Less

Submitted 14 July, 2018; v1 submitted 18 May, 2018; originally announced May 2018.

Posterior Inference for Sparse Hierarchical Non-stationary Models

Authors: Karla Monterrubio-Gómez, Lassi Roininen, Sara Wade, Theo Damoulas, Mark Girolami

Abstract: Gaussian processes are valuable tools for non-parametric modelling, where typically an assumption of stationarity is employed. While removing this assumption can improve prediction, fitting such models is challenging. In this work, hierarchical models are constructed based on Gaussian Markov random fields with stochastic spatially varying parameters. Importantly, this allows for non-stationarity w… ▽ More Gaussian processes are valuable tools for non-parametric modelling, where typically an assumption of stationarity is employed. While removing this assumption can improve prediction, fitting such models is challenging. In this work, hierarchical models are constructed based on Gaussian Markov random fields with stochastic spatially varying parameters. Importantly, this allows for non-stationarity while also addressing the computational burden through a sparse banded representation of the precision matrix. In this setting, efficient Markov chain Monte Carlo (MCMC) sampling is challenging due to the strong coupling a posteriori of the parameters and hyperparameters. We develop and compare three adaptive MCMC schemes and make use of banded matrix operations for faster inference. Furthermore, a novel extension to multi-dimensional settings is proposed through an additive structure that retains the flexibility and scalability of the model, while also inheriting interpretability from the additive approach. A thorough assessment of the efficiency and accuracy of the methods in nonstationary settings is presented for both simulated experiments and a computer emulation problem. △ Less

Submitted 1 May, 2019; v1 submitted 4 April, 2018; originally announced April 2018.

Parameterizations for Ensemble Kalman Inversion

Authors: Neil K. Chada, Marco A. Iglesias, Lassi Roininen, Andrew M. Stuart

Abstract: The use of ensemble methods to solve inverse problems is attractive because it is a derivative-free methodology which is also well-adapted to parallelization. In its basic iterative form the method produces an ensemble of solutions which lie in the linear span of the initial ensemble. Choice of the parameterization of the unknown field is thus a key component of the success of the method. We demon… ▽ More The use of ensemble methods to solve inverse problems is attractive because it is a derivative-free methodology which is also well-adapted to parallelization. In its basic iterative form the method produces an ensemble of solutions which lie in the linear span of the initial ensemble. Choice of the parameterization of the unknown field is thus a key component of the success of the method. We demonstrate how both geometric ideas and hierarchical ideas can be used to design effective parameterizations for a number of applied inverse problems arising in electrical impedance tomography, groundwater flow and source inversion. In particular we show how geometric ideas, including the level set method, can be used to reconstruct piecewise continuous fields, and we show how hierarchical methods can be used to learn key parameters in continuous fields, such as length-scales, resulting in improved reconstructions. Geometric and hierarchical ideas are combined in the level set method to find piecewise constant reconstructions with interfaces of unknown topology. △ Less

Submitted 19 March, 2018; v1 submitted 6 September, 2017; originally announced September 2017.

Hyperpriors for Matérn fields with applications in Bayesian inversion

Authors: Lassi Roininen, Mark Girolami, Sari Lasanen, Markku Markkanen

Abstract: We introduce non-stationary Matérn field priors with stochastic partial differential equations, and construct correlation length-scaling with hyperpriors. We model both the hyperprior and the Matérn prior as continuous-parameter random fields. As hypermodels, we use Cauchy and Gaussian random fields, which we map suitably to a desired correlation length-scaling range. For computations, we discreti… ▽ More We introduce non-stationary Matérn field priors with stochastic partial differential equations, and construct correlation length-scaling with hyperpriors. We model both the hyperprior and the Matérn prior as continuous-parameter random fields. As hypermodels, we use Cauchy and Gaussian random fields, which we map suitably to a desired correlation length-scaling range. For computations, we discretise the models with finite difference methods. We consider the convergence of the discretised prior and posterior to the discretisation limit. We apply the developed methodology to certain interpolation and numerical differentiation problems, and show numerically that we can make Bayesian inversion which promotes competing constraints of smoothness and edge-preservation. For computing the conditional mean estimator of the posterior distribution, we use a combination of Gibbs and Metropolis-within-Gibbs sampling algorithms. △ Less

Submitted 9 December, 2016; originally announced December 2016.

Cauchy difference priors for edge-preserving Bayesian inversion with an application to X-ray tomography

Authors: Markku Markkanen, Lassi Roininen, Janne M J Huttunen, Sari Lasanen

Abstract: We study Cauchy-distributed difference priors for edge-preserving Bayesian statistical inverse problems. On the contrary to the well-known total variation priors, one-dimensional Cauchy priors are non-Gaussian priors also in the discretization limit. Cauchy priors have independent and identically distributed increments. One-dimensional Cauchy and Gaussian random walks are special cases of Lévy… ▽ More We study Cauchy-distributed difference priors for edge-preserving Bayesian statistical inverse problems. On the contrary to the well-known total variation priors, one-dimensional Cauchy priors are non-Gaussian priors also in the discretization limit. Cauchy priors have independent and identically distributed increments. One-dimensional Cauchy and Gaussian random walks are special cases of Lévy $α$-stable random walks with $α=1$ and $α=2$, respectively. Both random walks can be written in closed-form, and as priors, they provide smoothing and edge-preserving properties. We briefly discuss also continuous and discrete Lévy $α$-stable random walks, and generalize the methodology to two-dimensional priors. We apply the developed algorithm to one-dimensional deconvolution and two-dimensional X-ray tomography problems. We compute conditional mean estimates with single-component Metropolis-Hastings and maximum a posteriori estimates with Gauss-Newton-type optimization method. We compare the proposed tomography reconstruction method to filtered back-projection estimate and conditional mean estimates with Gaussian and total variation priors. △ Less

Submitted 19 March, 2016; originally announced March 2016.

Elliptic boundary value problems with Gaussian white noise loads

Authors: Sari Lasanen, Lassi Roininen, Janne M. J. Huttunen

Abstract: Linear second order elliptic boundary value problems (BVP) on bounded Lipschitz domains are studied in the case of Gaussian white noise loads. Especially, Neumann and Robin BVPs are considered. The main obstacle for applying the usual variational approach is that the Gaussian white noise has irregular realizations. In particular, the corresponding Neumann boundary values are not well-defined in… ▽ More Linear second order elliptic boundary value problems (BVP) on bounded Lipschitz domains are studied in the case of Gaussian white noise loads. Especially, Neumann and Robin BVPs are considered. The main obstacle for applying the usual variational approach is that the Gaussian white noise has irregular realizations. In particular, the corresponding Neumann boundary values are not well-defined in the ordinary sense. In this work, the BVP is reformulated by replacing the continuity of the boundary trace map** with measurability. Instead of using variational methods alone, the reformulation of the BVP derives also from Cameron-Martin space techniques. The reformulation essentially returns the study of irregular white noise loads to study of $L^2$-loads. Admissibility of the reformulation is demonstrated by showing that usual finite element approximations of the BVP with discretized white noise loads converge to the solution of the reformulated problem. For Neumann and Robin BVPs, the finite dimensional approximations have been utilized before. However, here also the infinite-dimensional limit is considered. △ Less

Submitted 2 March, 2016; originally announced March 2016.

MSC Class: 34B05; 60B10; 60H15; 60H35; 65N30

Broadband Meter-Wavelength Observations of Ionospheric Scintillation

Authors: R. A. Fallows, W. A. Coles, D. McKay, J. Vierinen, I. I. Virtanen, M. Postila, Th. Ulich, C-F. Enell, A. Kero, T. Iinatti, M. Lehtinen, M. Orispää, T. Raita, L. Roininen, E. Turunen, M. Brentjens, N. Ebbendorf, M. Gerbers, T. Grit, P. Gruppen, H. Meulman, M. Norden, J-P. de Reijer, A. Schoenmakers, K. Stuurwold

Abstract: Intensity scintillations of cosmic radio sources are used to study astrophysical plasmas like the ionosphere, the solar wind, and the interstellar medium. Normally these observations are relatively narrow band. With Low Frequency Array (LOFAR) technology at the Kilpisjärvi Atmospheric Imaging Receiver Array (KAIRA) station in northern Finland we have observed scintillations over a 3 octave bandwid… ▽ More Intensity scintillations of cosmic radio sources are used to study astrophysical plasmas like the ionosphere, the solar wind, and the interstellar medium. Normally these observations are relatively narrow band. With Low Frequency Array (LOFAR) technology at the Kilpisjärvi Atmospheric Imaging Receiver Array (KAIRA) station in northern Finland we have observed scintillations over a 3 octave bandwidth. ``Parabolic arcs'', which were discovered in interstellar scintillations of pulsars, can provide precise estimates of the distance and velocity of the scattering plasma. Here we report the first observations of such arcs in the ionosphere and the first broad-band observations of arcs anywhere, raising hopes that study of the phenomenon may similarly improve the analysis of ionospheric scintillations. These observations were made of the strong natural radio source Cygnus-A and covered the entire 30-250\,MHz band of KAIRA. Well-defined parabolic arcs were seen early in the observations, before transit, and disappeared after transit although scintillations continued to be obvious during the entire observation. We show that this can be attributed to the structure of Cygnus-A. Initial results from modeling these scintillation arcs are consistent with simultaneous ionospheric soundings taken with other instruments, and indicate that scattering is most likely to be associated more with the topside ionosphere than the F-region peak altitude. Further modeling and possible extension to interferometric observations, using international LOFAR stations, are discussed. △ Less

Submitted 3 November, 2015; originally announced November 2015.

Comments: 11 pages, 17 figures

Journal ref: Fallows, R A et al, Broadband meter-wavelength observations of ionospheric scintillation, Journal of Geophysical Research Space Physics, 119(12), 10-544, 2014

Sparse approximations of fractional Matérn fields

Authors: Lassi Roininen, Sari Lasanen, Mikko Orispää, Simo Särkkä

Abstract: We consider a fast approximation method for a solution of a certain stochastic non-local pseudodifferential equation. This equation defines a Matérn class random field. The approximation method is based on the spectral compactness of the solution. We approximate the pseudodifferential operator with a Taylor expansion. By truncating the expansion, we can construct an approximation with Gaussian Mar… ▽ More We consider a fast approximation method for a solution of a certain stochastic non-local pseudodifferential equation. This equation defines a Matérn class random field. The approximation method is based on the spectral compactness of the solution. We approximate the pseudodifferential operator with a Taylor expansion. By truncating the expansion, we can construct an approximation with Gaussian Markov random fields. We show that the solution of the truncated version can be constructed with an over-determined system of stochastic matrix equations with sparse matrices. We solve the system of equations with a sparse Cholesky decomposition. We consider the convergence of the discrete approximation of the solution to the continuous one. Finally numerical examples are given. △ Less

Submitted 8 October, 2014; originally announced October 2014.

Comments: Submitted to Inverse Problems and Imaging, October 2014