-
On Bayesian wavelet shrinkage estimation of nonparametric regression models with stationary errors
Authors:
Alex Rodrigo dos S. Sousa,
Mauricio Zevallos
Abstract:
This work proposes a Bayesian rule based on the mixture of a point mass function at zero and the logistic distribution to perform wavelet shrinkage in nonparametric regression models with stationary errors (with short or long-memory behavior). The proposal is assessed through Monte Carlo experiments and illustrated with real data. Simulation studies indicate that the precision of the estimates dec…
▽ More
This work proposes a Bayesian rule based on the mixture of a point mass function at zero and the logistic distribution to perform wavelet shrinkage in nonparametric regression models with stationary errors (with short or long-memory behavior). The proposal is assessed through Monte Carlo experiments and illustrated with real data. Simulation studies indicate that the precision of the estimates decreases as the amount of correlation increases. However, given a sample size and error correlated noise, the performance of the rule is almost the same while the signal-to-noise ratio decreases, compared to the performance of the rule under independent and identically distributed errors. Further, we find that the performance of the proposal is better than the standard soft thresholding rule with universal policy in most of the considered underlying functions, sample sizes and signal-to-noise ratios scenarios.
△ Less
Submitted 22 April, 2024;
originally announced April 2024.
-
Bootstrap confidence intervals: A comparative simulation study
Authors:
VinÃcius Litvinoff Justus,
Vitor Batista Rodrigues,
Alex Rodrigo dos Santos Sousa
Abstract:
Bootstrap is a widely used technique that allows estimating the properties of a given estimator, such as its bias and standard error. In this paper, we evaluate and compare five bootstrap-based methods for making confidence intervals: two of them (Normal and Studentized) based on the bootstrap estimate of the standard error; another two (Quantile and Better) based on the estimated distribution of…
▽ More
Bootstrap is a widely used technique that allows estimating the properties of a given estimator, such as its bias and standard error. In this paper, we evaluate and compare five bootstrap-based methods for making confidence intervals: two of them (Normal and Studentized) based on the bootstrap estimate of the standard error; another two (Quantile and Better) based on the estimated distribution of the parameter estimator; and finally, considering an interval constructed based on Bayesian bootstrap, relying on the notion of credible interval. The methods are compared through Monte Carlo simulations in different scenarios, including samples with autocorrelation induced by a copula model. The results are also compared with respect to the coverage rate, the median interval length and a novel indicator, proposed in this paper, combining both of them. The results show that the Studentized method has the best coverage rate, although the smallest intervals are attained by the Bayesian method. In general, all methods are appropriate and demonstrated good performance even in the scenarios violating the independence assumption.
△ Less
Submitted 19 April, 2024;
originally announced April 2024.
-
A bayesian wavelet shrinkage rule under LINEX loss function
Authors:
Alex Rodrigo dos Santos Sousa
Abstract:
This work proposes a wavelet shrinkage rule under asymmetric LINEX loss function and a mixture of a point mass function at zero and the logistic distribution as prior distribution to the wavelet coefficients in a nonparametric regression model with gaussian error. Underestimation of a significant wavelet coefficient can lead to a bad detection of features of the unknown function such as peaks, dis…
▽ More
This work proposes a wavelet shrinkage rule under asymmetric LINEX loss function and a mixture of a point mass function at zero and the logistic distribution as prior distribution to the wavelet coefficients in a nonparametric regression model with gaussian error. Underestimation of a significant wavelet coefficient can lead to a bad detection of features of the unknown function such as peaks, discontinuities and oscillations. It can also occur under asymmetrically distributed wavelet coefficients. Thus the proposed rule is suitable when overestimation and underestimation have asymmetric losses. Statistical properties of the rule such as squared bias, variance, frequentist and bayesian risks are obtained. Simulation studies are conducted to evaluate the performance of the rule against standard methods and an application in a real dataset involving infrared spectra is provided.
△ Less
Submitted 26 July, 2023;
originally announced July 2023.
-
Simulation studies to compare bayesian wavelet shrinkage methods in aggregated functional data
Authors:
Alex Rodrigo dos Santos Sousa
Abstract:
The present work describes simulation studies to compare the performances of bayesian wavelet shrinkage methods in estimating component curves from aggregated functional data. To do so, five methods were considered: the bayesian shrinkage rule under logistic prior by Sousa (2020), bayesian shrinkage rule under beta prior by Sousa et al. (2020), Large Posterior Mode method by Cutillo et al. (2008),…
▽ More
The present work describes simulation studies to compare the performances of bayesian wavelet shrinkage methods in estimating component curves from aggregated functional data. To do so, five methods were considered: the bayesian shrinkage rule under logistic prior by Sousa (2020), bayesian shrinkage rule under beta prior by Sousa et al. (2020), Large Posterior Mode method by Cutillo et al. (2008), Amplitude-scale invariant Bayes Estimator by Figueiredo and Nowak (2001) and Bayesian Adaptive Multiresolution Smoother by Vidakovic and Ruggeri (2001). Further, the so called Donoho-Johnstone test functions, Logit and SpaHet functions were considered as component functions. It was observed that the signal to noise ratio of the data had impact on the performances of the methods.
△ Less
Submitted 10 October, 2022;
originally announced October 2022.
-
A wavelet-based method in aggregated functional data analysis
Authors:
Alex Rodrigo dos Santos Sousa
Abstract:
In this paper we consider aggregated functional data composed by a linear combination of component curves and the problem of estimating these component curves. We propose the application of a bayesian wavelet shrinkage rule based on a mixture of a point mass function at zero and the logistic distribution as prior to wavelet coefficients to estimate mean curves of components. This procedure has the…
▽ More
In this paper we consider aggregated functional data composed by a linear combination of component curves and the problem of estimating these component curves. We propose the application of a bayesian wavelet shrinkage rule based on a mixture of a point mass function at zero and the logistic distribution as prior to wavelet coefficients to estimate mean curves of components. This procedure has the advantage of estimating component functions with important local characteristics such as discontinuities, spikes and oscillations for example, due the features of wavelet basis expansion of functions. Simulation studies were done to evaluate the performance of the proposed method and its results are compared with a spline-based method. An application on the so called tecator dataset is also provided.
△ Less
Submitted 31 May, 2022;
originally announced May 2022.
-
Wavelet Shrinkage in Nonparametric Regression Models with Positive Noise
Authors:
Alex Rodrigo dos Santos Sousa,
Nancy Lopes Garcia
Abstract:
Wavelet shrinkage estimators are widely applied in several fields of science for denoising data in wavelet domain by reducing the magnitudes of empirical coefficients. In nonparametric regression problem, most of the shrinkage rules are derived from models composed by an unknown function with additive gaussian noise. Although gaussian noise assumption is reasonable in several real data analysis, m…
▽ More
Wavelet shrinkage estimators are widely applied in several fields of science for denoising data in wavelet domain by reducing the magnitudes of empirical coefficients. In nonparametric regression problem, most of the shrinkage rules are derived from models composed by an unknown function with additive gaussian noise. Although gaussian noise assumption is reasonable in several real data analysis, mainly for large sample sizes, it is not general. Contaminated data with positive noise can occur in practice and nonparametric regression models with positive noise bring challenges in wavelet shrinkage point of view. This work develops bayesian shrinkage rules to estimate wavelet coefficients from a nonparametric regression framework with additive and strictly positive noise under exponential and lognormal distributions. Computational aspects are discussed and simulation studies to analyse the performances of the proposed shrinkage rules and compare them with standard techniques are done. An application in winning times Boston Marathon dataset is also provided.
△ Less
Submitted 13 September, 2021;
originally announced September 2021.
-
Kurtosis control in wavelet shrinkage with generalized secant hyperbolic prior
Authors:
Alex Rodrigo dos Santos Sousa
Abstract:
The present paper proposes a bayesian approach for wavelet shrinkage with the use of a shrinkage prior based on the generalized secant hyperbolic distribution symmetric around zero in a nonparemetric regression problem. This shrinkage prior allows the control of the kurtosis of the coefficients, which impacts on the level of shrinkage on its extreme values. Statistical properties such as bias, var…
▽ More
The present paper proposes a bayesian approach for wavelet shrinkage with the use of a shrinkage prior based on the generalized secant hyperbolic distribution symmetric around zero in a nonparemetric regression problem. This shrinkage prior allows the control of the kurtosis of the coefficients, which impacts on the level of shrinkage on its extreme values. Statistical properties such as bias, variance, classical and bayesian risks of the rule are analyzed and performances of the proposed rule are obtained in simulations studies involving the Donoho-Johnstone test functions. Application of the proposed shrinker in denoising Brazilian stock market dataset is also provided.
△ Less
Submitted 11 August, 2021;
originally announced August 2021.
-
Asymmetric prior in wavelet shrinkage
Authors:
Alex Rodrigo dos Santos Sousa
Abstract:
In bayesian wavelet shrinkage, the already proposed priors to wavelet coefficients are assumed to be symmetric around zero. Although this assumption is reasonable in many applications, it is not general. The present paper proposes the use of an asymmetric shrinkage rule based on the discrete mixture of a point mass function at zero and an asymmetric beta distribution as prior to the wavelet coeffi…
▽ More
In bayesian wavelet shrinkage, the already proposed priors to wavelet coefficients are assumed to be symmetric around zero. Although this assumption is reasonable in many applications, it is not general. The present paper proposes the use of an asymmetric shrinkage rule based on the discrete mixture of a point mass function at zero and an asymmetric beta distribution as prior to the wavelet coefficients in a non-parametric regression model. Statistical properties such as bias, variance, classical and bayesian risks of the associated asymmetric rule are provided and performances of the proposed rule are obtained in simulation studies involving artificial asymmetric distributed coefficients and the Donoho-Johnstone test functions. Application in a seismic real dataset is also analyzed.
△ Less
Submitted 9 October, 2020;
originally announced October 2020.
-
Model selection criteria for regression models with splines and the automatic localization of knots
Authors:
Alex Rodrigo dos S. Sousa,
Magno T. F. Severino,
Florencia G. Leonardi
Abstract:
In this paper we propose a model selection approach to fit a regression model using splines with a variable number of knots. We introduce a penalized criterion to estimate the number and the position of the knots where to anchor the splines basis. The method is evaluated on simulated data and applied to covid-19 daily reported cases for short-term prediction.
In this paper we propose a model selection approach to fit a regression model using splines with a variable number of knots. We introduce a penalized criterion to estimate the number and the position of the knots where to anchor the splines basis. The method is evaluated on simulated data and applied to covid-19 daily reported cases for short-term prediction.
△ Less
Submitted 26 July, 2021; v1 submitted 4 June, 2020;
originally announced June 2020.
-
Bayesian Wavelet Shrinkage with Beta Priors
Authors:
Alex Rodrigo dos Santos Sousa,
Nancy Lopes Garcia,
Branislav Vidakovic
Abstract:
In wavelet shrinkage and thresholding, most of the standard techniques do not consider information that wavelet coefficients might be bounded, although information about bounded energy in signals can be readily available. To address this, we present a Bayesian approach for shrinkage of bounded wavelet coefficients in the context of non-parametric regression. We propose the use of a zero-contaminat…
▽ More
In wavelet shrinkage and thresholding, most of the standard techniques do not consider information that wavelet coefficients might be bounded, although information about bounded energy in signals can be readily available. To address this, we present a Bayesian approach for shrinkage of bounded wavelet coefficients in the context of non-parametric regression. We propose the use of a zero-contaminated beta distribution with a support symmetric around zero as the prior distribution for the location parameter in the wavelet domain in models with additive gaussian errors. The hyperparameters of the proposed model are closely related to the shrinkage level, which facilitates their elicitation and interpretation. For signals with a low signal-to-noise ratio, the associated Bayesian shrinkage rules provide significant improvement in performance in simulation studies when compared with standard techniques.
△ Less
Submitted 11 November, 2020; v1 submitted 15 July, 2019;
originally announced July 2019.