-
Least Squares Wavelet-based Estimation for Additive Regression Models using Non Equally-Spaced Designs
Authors:
German A. Schnaidt Grez,
Brani Vidakovic
Abstract:
Additive regression models are actively researched in the statistical field because of their usefulness in the analysis of responses determined by non-linear relationships with multivariate predictors. In this kind of statistical models, the response depends linearly on unknown functions of predictor variables and typically, the goal of the analysis is to make inference about these functions.
In…
▽ More
Additive regression models are actively researched in the statistical field because of their usefulness in the analysis of responses determined by non-linear relationships with multivariate predictors. In this kind of statistical models, the response depends linearly on unknown functions of predictor variables and typically, the goal of the analysis is to make inference about these functions.
In this paper, we study the problem of additive regression using a least squares approach based on periodic orthogonal wavelets on the interval [0,1]. For this estimator, we obtain strong consistency (with respect to the $\mathbb{L}_{2}$ norm) characterized by optimal convergence rates up to a logarithmic factor, independent of the dimensionality of the problem. This is achieved by truncating the model estimates by a properly chosen parameter, and selecting the multiresolution level $J$ used for the wavelet expansion, as a function of the sample size. In this approach, we obtain these results without the assumption of an equispaced design, a condition that is typically assumed in most wavelet-based procedures.
Finally, we show practical results obtained from a simulation study and a real life application, demonstrating the applicability of the proposed methods for the problem of non-linear robust additive regression models.
△ Less
Submitted 6 April, 2018;
originally announced April 2018.
-
Empirical Wavelet-based Estimation for Non-linear Additive Regression Models
Authors:
German A. Schnaidt Grez,
Brani Vidakovic
Abstract:
Additive regression models are actively researched in the statistical field because of their usefulness in the analysis of responses determined by non-linear relationships with multivariate predictors. In this kind of statistical models, the response depends linearly on unknown functions of predictor variables and typically, the goal of the analysis is to make inference about these functions.
In…
▽ More
Additive regression models are actively researched in the statistical field because of their usefulness in the analysis of responses determined by non-linear relationships with multivariate predictors. In this kind of statistical models, the response depends linearly on unknown functions of predictor variables and typically, the goal of the analysis is to make inference about these functions.
In this paper, we consider the problem of Additive Regression with random designs from a novel viewpoint: we propose an estimator based on an orthogonal projection onto a multiresolution space using empirical wavelet coefficients that are fully data driven. In this setting, we derive a mean-square consistent estimator based on periodic wavelets on the interval $[0,1]$. For construction of the estimator, we assume that the joint distribution of predictors is non-zero and bounded on its support; We also assume that the functions belong to a Sobolev space and integrate to zero over the $[0,1]$ interval, which guarantees model identifiability and convergence of the proposed method. Moreover, we provide the $\mathbb{L}_{2}$ risk analysis of the estimator and derive its convergence rate.
Theoretically, we show that this approach achieves good convergence rates when the dimensionality of the problem is relatively low and the set of unknown functions is sufficiently smooth. In this approach, the results are obtained without the assumption of an equispaced design, a condition that is typically assumed in most wavelet-based procedures.
Finally, we show practical results obtained from simulated data, demonstrating the potential applicability of our method in the problem of additive regression models with random designs.
△ Less
Submitted 12 March, 2018;
originally announced March 2018.
-
An Empirical approach to Survival Density Estimation for randomly-censored data using Wavelets
Authors:
German A. Schnaidt Grez,
Brani Vidakovic
Abstract:
Density estimation is a classical problem in statistics and has received considerable attention when both the data has been fully observed and in the case of partially observed (censored) samples. In survival analysis or clinical trials, a typical problem encountered in the data collection stage is that the samples may be censored from the right. The variable of interest could be observed partiall…
▽ More
Density estimation is a classical problem in statistics and has received considerable attention when both the data has been fully observed and in the case of partially observed (censored) samples. In survival analysis or clinical trials, a typical problem encountered in the data collection stage is that the samples may be censored from the right. The variable of interest could be observed partially due to the presence of a set of events that occur at random and potentially censor the data. Consequently, develo** a methodology that enables robust estimation of the lifetimes in such setting is of high interest for researchers.
In this paper, we propose a non-parametric linear density estimator using empirical wavelet coefficients that are fully data driven. We derive an asymptotically unbiased estimator constructed from the complete sample based on an inductive bias correction procedure. Also, we provide upper bounds for the bias and analyze the large sample behavior of the expected $\mathbb{L}_{2}$ estimation error based on the approach used by Stute (1995), showing that the estimates are asymptotically normal and possess global mean square consistency.
In addition, we evaluate the proposed approach via a theoretical simulation study using different exemplary baseline distributions with different sample sizes. In this study, we choose a censoring scheme that produces a censoring proportion of 40\% on average. Finally, we apply the proposed estimator to real data-sets previously published, showing that the proposed wavelet estimator provides a robust and useful tool for the non-parametric estimation of the survival time density function.
△ Less
Submitted 16 April, 2018; v1 submitted 26 September, 2017;
originally announced September 2017.