-
Ridge-Type Shrinkage Estimators in Low and High Dimensional Beta Regression Model with Application in Econometrics and Medicine
Authors:
Ejaz Ahmed,
Reza Arabi Belaghi,
Yasin Asar,
Abdulkhadir Hussein
Abstract:
Beta regression model is useful in the analysis of bounded continuous outcomes such as proportions. It is well known that for any regression model, the presence of multicollinearity leads to poor performance of the maximum likelihood estimators. The ridge type estimators have been proposed to alleviate the adverse effects of the multicollinearity. Furthermore, when some of the predictors have insi…
▽ More
Beta regression model is useful in the analysis of bounded continuous outcomes such as proportions. It is well known that for any regression model, the presence of multicollinearity leads to poor performance of the maximum likelihood estimators. The ridge type estimators have been proposed to alleviate the adverse effects of the multicollinearity. Furthermore, when some of the predictors have insignificant or weak effects on the outcomes, it is desired to recover as much information as possible from these predictors instead of discarding them all together. In this paper we proposed ridge type shrinkage estimators for the low and high dimensional beta regression model, which address the above two issues simultaneously. We compute the biases and variances of the proposed estimators in closed forms and use Monte Carlo simulations to evaluate their performances. The results show that, both in low and high dimensional data, the performance of the proposed estimators are superior to ridge estimators that discard weak or insignificant predictors. We conclude this paper by applying the proposed methods for two real data from econometric and medicine.
△ Less
Submitted 27 November, 2021;
originally announced November 2021.
-
Liu Estimator in the Multinomial Logistic Regression Model
Authors:
Yasin Asar,
Murat Erişoğlu
Abstract:
This paper considers the Liu estimator in the multinomial logistic regression model. We propose some different estimators of the biasing parameter. The mean square error (MSE) is considered as the performance criterion. In order to compare the performance of the estimators, we performed a Monte Carlo simulation study. According to the results of the simulation study, we found that increasing the c…
▽ More
This paper considers the Liu estimator in the multinomial logistic regression model. We propose some different estimators of the biasing parameter. The mean square error (MSE) is considered as the performance criterion. In order to compare the performance of the estimators, we performed a Monte Carlo simulation study. According to the results of the simulation study, we found that increasing the correlation between the independent variables and the number of regressors has a negative effect on the MSE. However, when the sample size increases the MSE decreases even when the correlation between the independent variables is large. Based on the minimum MSE criterion some useful estimators for estimating the biasing parameter d are recommended for the practitioners.
△ Less
Submitted 5 November, 2021;
originally announced November 2021.
-
Inference for Two Lomax Populations Under Joint Type-II Censoring
Authors:
Yasin Asar,
R. Arabi Belaghi
Abstract:
Lomax distribution has been widely used in economics, business and actuarial sciences. Due to its importance, we consider the statistical inference of this model under joint type-II censoring scenario. In order to estimate the parameters, we derive the Newton-Raphson(NR) procedure and we observe that most of the times in the simulation NR algorithm does not converge. Consequently, we make use of t…
▽ More
Lomax distribution has been widely used in economics, business and actuarial sciences. Due to its importance, we consider the statistical inference of this model under joint type-II censoring scenario. In order to estimate the parameters, we derive the Newton-Raphson(NR) procedure and we observe that most of the times in the simulation NR algorithm does not converge. Consequently, we make use of the expectation-maximization (EM) algorithm. Moreover, Bayesian estimations are also provided based on squared error, linear-exponential and generalized entropy loss functions together with the importance sampling method due to the structure of posterior density function. In the sequel, we perform a Monte Carlo simulation experiment to compare the performances of the listed methods. Mean squared error values, averages of estimated values as well as coverage probabilities and average interval lengths are considered to compare the performances of different methods. The approximate confidence intervals, bootstrap-p and bootstrap-t confidence intervals are computed for EM estimations. Also, Bayesian coverage probabilities and credible intervals are obtained. Finally, we consider the Bladder Cancer data to illustrate the applicability of the methods covered in the paper.
△ Less
Submitted 5 December, 2019;
originally announced December 2019.
-
Estimation in Weibull Distribution Under Progressively Type-I Hybrid Censored Data
Authors:
Yasin Asar,
R. Arabi Belaghi
Abstract:
In this article, we consider the estimation of unknown parameters of Weibull distribution when the lifetime data are observed in the presence of progressively type-I hybrid censoring scheme. The Newton-Raphson algorithm, Expectation-Maximization (EM) algorithm and Stochastic EM (SEM) algorithm are utilized to derive the maximum likelihood estimates (MLEs) for the unknown parameters. Moreover, Baye…
▽ More
In this article, we consider the estimation of unknown parameters of Weibull distribution when the lifetime data are observed in the presence of progressively type-I hybrid censoring scheme. The Newton-Raphson algorithm, Expectation-Maximization (EM) algorithm and Stochastic EM (SEM) algorithm are utilized to derive the maximum likelihood estimates (MLEs) for the unknown parameters. Moreover, Bayesian estimators using Tierney-Kadane Method and Markov Chain Monte Carlo (MCMC) method are obtained under three different loss functions, namely, squared error loss (SEL), linear-exponential (LINEX) and generalized entropy loss (GEL) functions. Also, the shrinkage pre-test estimators are derived. An extensive Monte Carlo simulation experiment is conducted under different schemes so that the performances of the listed estimators are compared using mean squared error, confidence interval length and coverage probabilities. Asymptotic normality and MCMC samples are used to obtain the confidence intervals and highest posterior density (HPD) intervals respectively. Further, a real data example is presented to illustrate the methods. Finally, some conclusive remarks are presented.
△ Less
Submitted 11 November, 2019;
originally announced November 2019.
-
LLASSO: A linear unified LASSO for multicollinear situations
Authors:
M. Arashi,
Y. Asar,
B. Yuzbasi
Abstract:
We propose a rescaled LASSO, by premultipying the LASSO with a matrix term, namely linear unified LASSO (LLASSO) for multicollinear situations. Our numerical study has shown that the LLASSO is comparable with other sparse modeling techniques and often outperforms the LASSO and elastic net. Our findings open new visions about using the LASSO still for sparse modeling and variable selection. We conc…
▽ More
We propose a rescaled LASSO, by premultipying the LASSO with a matrix term, namely linear unified LASSO (LLASSO) for multicollinear situations. Our numerical study has shown that the LLASSO is comparable with other sparse modeling techniques and often outperforms the LASSO and elastic net. Our findings open new visions about using the LASSO still for sparse modeling and variable selection. We conclude our study by pointing that the LLASSO can be solved by the same efficient algorithm for solving the LASSO and suggest to follow the same construction technique for other penalized estimators.
△ Less
Submitted 12 October, 2017;
originally announced October 2017.
-
On the stochastic restricted Liu-type maximum likelihood estimator in logistic regression
Authors:
Jibo Wu,
Yasin Asar
Abstract:
In order to overcome multicollinearity, we propose a stochastic restricted Liu-type max- imum likelihood estimator by incorporating Liu-type maximum likelihood estimator (Inan and Erdo- gan, 2013) to the logistic regression model when the linear restrictions are stochastic. We also discuss the properties of the new estimator. Moreover, we give a method to choose the biasing parameter in the new es…
▽ More
In order to overcome multicollinearity, we propose a stochastic restricted Liu-type max- imum likelihood estimator by incorporating Liu-type maximum likelihood estimator (Inan and Erdo- gan, 2013) to the logistic regression model when the linear restrictions are stochastic. We also discuss the properties of the new estimator. Moreover, we give a method to choose the biasing parameter in the new estimator. Finally, a simulation study is given to show the performance of the new estimator.
△ Less
Submitted 6 October, 2017;
originally announced October 2017.
-
Improved Quantile Regression Estimators when the Errors are Independently and Non-identically Distributed
Authors:
Bahadır Yüzbaşı,
Yasin Asar,
Ahmet Demiralp,
M. Şamil Şık
Abstract:
In a classical regression model, it is usually assumed that the explanatory variables are independent of each other and error terms are normally distributed. But when these assumptions are not met, situations like the error terms are not independent or they are not identically distributed or both of these, LSE will not be robust. Hence, quantile regression has been used to complement this deficien…
▽ More
In a classical regression model, it is usually assumed that the explanatory variables are independent of each other and error terms are normally distributed. But when these assumptions are not met, situations like the error terms are not independent or they are not identically distributed or both of these, LSE will not be robust. Hence, quantile regression has been used to complement this deficiency of classical regression analysis and to improve the least square estimation (LSE). In this study, we consider preliminary test and shrinkage estimation strategies for quantile regression models with independently and non-identically distributed (i.ni.d.) errors. A Monte Carlo simulation study is conducted to assess the relative performance of the estimators. Also, we numerically compare their performance with Ridge, Lasso, Elastic Net penalty estimation strategies. A real data example is presented to illustrate the usefulness of the suggested methods. Finally, we obtain the asymptotic results of suggested estimators
△ Less
Submitted 6 September, 2017;
originally announced September 2017.
-
Liu-type Shrinkage Estimations in Linear Models
Authors:
Bahadır Yüzbaşı,
Yasin Asar,
S. Ejaz Ahmed
Abstract:
In this study, we present the preliminary test, Stein-type and positive part Liu estimators in the linear models when the parameter vector $\boldsymbolβ$ is partitioned into two parts, namely, the main effects $\boldsymbolβ_1$ and the nuisance effects $\boldsymbolβ_2$ such that $\boldsymbolβ=\left(\boldsymbolβ_1, \boldsymbolβ_2 \right)$. We consider the case that a priori known or suspected set of…
▽ More
In this study, we present the preliminary test, Stein-type and positive part Liu estimators in the linear models when the parameter vector $\boldsymbolβ$ is partitioned into two parts, namely, the main effects $\boldsymbolβ_1$ and the nuisance effects $\boldsymbolβ_2$ such that $\boldsymbolβ=\left(\boldsymbolβ_1, \boldsymbolβ_2 \right)$. We consider the case that a priori known or suspected set of the explanatory variables do not contribute to predict the response so that a sub-model may be enough for this purpose. Thus, the main interest is to estimate $\boldsymbolβ_1$ when $\boldsymbolβ_2$ is close to zero. Therefore, we conduct a Monte Carlo simulation study to evaluate the relative efficiency of the suggested estimators, where we demonstrate the superiority of the proposed estimators.
△ Less
Submitted 4 September, 2017;
originally announced September 2017.
-
Preliminary testing derivatives of a linear unified estimator in the logistic regression model
Authors:
Yasin Asar,
Bahadır Yüzbaşı,
Mohammad Arashi,
Jibo Wu
Abstract:
Recently, the well known Liu estimator (Liu, 1993) is attracted researcher's attention in regression parameter estimation for an ill conditioned linear model. It is also argued that imposing sub-space hypothesis restriction on parameters improves estimation by shrinking toward non-sample information. Chang (2015) proposed the almost unbiased Liu estimator (AULE) in the binary logistic regression.…
▽ More
Recently, the well known Liu estimator (Liu, 1993) is attracted researcher's attention in regression parameter estimation for an ill conditioned linear model. It is also argued that imposing sub-space hypothesis restriction on parameters improves estimation by shrinking toward non-sample information. Chang (2015) proposed the almost unbiased Liu estimator (AULE) in the binary logistic regression. In this article, some improved unbiased Liu type estimators, namely, restricted AULE, preliminary test AULE, Stein-type shrinkage AULE and its positive part for estimating the regression parameters in the binary logistic regression model are proposed based on the work Chang (2015). The performances of the newly defined estimators are analysed through some numerical results. A real data example is also provided to support the findings.
△ Less
Submitted 29 August, 2017;
originally announced August 2017.
-
Efficiency of the principal component Liu-type estimator in logistic regression model
Authors:
Jibo Wu,
Yasin Asar
Abstract:
In this paper we propose a principal component Liu-type logistic estimator by combining the principal component logistic regression estimator and Liu-type logistic estimator to overcome the multicollinearity problem. The superiority of the new estimator over some related estimators are studied under the asymptotic mean squared error matrix. A Monte Carlo simulation experiment is designed to compar…
▽ More
In this paper we propose a principal component Liu-type logistic estimator by combining the principal component logistic regression estimator and Liu-type logistic estimator to overcome the multicollinearity problem. The superiority of the new estimator over some related estimators are studied under the asymptotic mean squared error matrix. A Monte Carlo simulation experiment is designed to compare the performances of the estimators using mean squared error criterion. Finally, a conclusion section is presented.
△ Less
Submitted 24 July, 2017;
originally announced July 2017.
-
On the restricted almost unbiased Liu estimator in the Logistic regression model
Authors:
Jibo Wu,
Yasin Asar,
M. Arashi
Abstract:
It is known that when the multicollinearity exists in the logistic regression model, variance of maximum likelihood estimator is unstable. As a remedy, in the context of biased shrinkage ridge estimation, Chang (2015) introduced an almost unbiased Liu estimator in the logistic regression model. Making use of his approach, when some prior knowledge in the form of linear restrictions are also availa…
▽ More
It is known that when the multicollinearity exists in the logistic regression model, variance of maximum likelihood estimator is unstable. As a remedy, in the context of biased shrinkage ridge estimation, Chang (2015) introduced an almost unbiased Liu estimator in the logistic regression model. Making use of his approach, when some prior knowledge in the form of linear restrictions are also available, we introduce a restricted almost unbiased Liu estimator in the logistic regression model. Statistical properties of this newly defined estimator are derived and some comparison result are also provided in the form of theorems. A Monte Carlo simulation study along with a real data example are given to investigate the performance of this estimator.
△ Less
Submitted 22 July, 2017;
originally announced July 2017.
-
Pretest and Stein-Type Estimations in Quantile Regression Model
Authors:
Bahadır Yüzbaşı,
Yasin Asar,
M. Şamil Şık,
Ahmet Demiralp
Abstract:
In this study, we consider preliminary test and shrinkage estimation strategies for quantile regression models. In classical Least Squares Estimation (LSE) method, the relationship between the explanatory and explained variables in the coordinate plane is estimated with a mean regression line. In order to use LSE, there are three main assumptions on the error terms showing white noise process of t…
▽ More
In this study, we consider preliminary test and shrinkage estimation strategies for quantile regression models. In classical Least Squares Estimation (LSE) method, the relationship between the explanatory and explained variables in the coordinate plane is estimated with a mean regression line. In order to use LSE, there are three main assumptions on the error terms showing white noise process of the regression model, also known as Gauss-Markov Assumptions, must be met: (1) The error terms have zero mean, (2) The variance of the error terms is constant and (3) The covariance between the errors is zero i.e., there is no autocorrelation. However, data in many areas, including econometrics, survival analysis and ecology, etc. does not provide these assumptions. First introduced by Koenker, quantile regression has been used to complement this deficiency of classical regression analysis and to improve the least square estimation. The aim of this study is to improve the performance of quantile regression estimators by using pre-test and shrinkage strategies. A Monte Carlo simulation study including a comparison with quantile $L_1$--type estimators such as Lasso, Ridge and Elastic Net are designed to evaluate the performances of the estimators. Two real data examples are given for illustrative purposes. Finally, we obtain the asymptotic results of suggested estimators
△ Less
Submitted 6 September, 2017; v1 submitted 12 July, 2017;
originally announced July 2017.
-
Improving Estimations in Quantile Regression Model with Autoregressive Errors
Authors:
Bahadır Yüzbaşı,
Yasin Aşar,
Şamil Şık,
Ahmet Demiralp
Abstract:
An important issue is that the respiratory mortality may be a result of air pollution which can be measured by the following variables: temperature, relative humidity, carbon monoxide, sulfur dioxide, nitrogen dioxide, hydrocarbons, ozone and particulates. The usual way is to fit a model using the ordinary least squares regression, which has some assumptions, also known as Gauss-Markov assumptions…
▽ More
An important issue is that the respiratory mortality may be a result of air pollution which can be measured by the following variables: temperature, relative humidity, carbon monoxide, sulfur dioxide, nitrogen dioxide, hydrocarbons, ozone and particulates. The usual way is to fit a model using the ordinary least squares regression, which has some assumptions, also known as Gauss-Markov assumptions, on the error term showing white noise process of the regression model. However, in many applications, especially for this example, these assumptions are not satisfied. Therefore, in this study, a quantile regression approach is used to model the respiratory mortality using the mentioned explanatory variables. Moreover, improved estimation techniques such as preliminary testing and shrinkage strategies are also obtained when the errors are autoregressive. A Monte Carlo simulation experiment, including the quantile penalty estimators such as Lasso, Ridge and Elastic Net, is designed to evaluate the performances of the proposed techniques. Finally, the theoretical risks of the listed estimators are given.
△ Less
Submitted 4 July, 2017;
originally announced July 2017.
-
Liu-type Negative Binomial Regression: A Comparison of Recent Estimators and Applications
Authors:
Yasin Asar
Abstract:
This paper introduces a new biased estimator for the negative binomial regression model that is a generalization of Liu-type estimator proposed for the linear model in [12]. Since the variance of the maximum likelihood estimator (MLE) is inflated when there is multicollinearity between the explanatory variables, a new biased estimator is proposed to solve the problem and decrease the variance of M…
▽ More
This paper introduces a new biased estimator for the negative binomial regression model that is a generalization of Liu-type estimator proposed for the linear model in [12]. Since the variance of the maximum likelihood estimator (MLE) is inflated when there is multicollinearity between the explanatory variables, a new biased estimator is proposed to solve the problem and decrease the variance of MLE in order to make stable inferences. Moreover, we obtain some theoretical comparisons between the new estimator and some others via matrix mean squared error (MMSE) criterion. Furthermore, a Monte Carlo simulation study is designed to evaluate performances of the estimators in the sense of mean squared error. Finally, a real data application is used to illustrate the benefits of new estimator.
△ Less
Submitted 8 April, 2016;
originally announced April 2016.
-
On Some New Modifications of Ridge Estimators
Authors:
Yasin Asar,
Aşır Genç
Abstract:
Ridge estimator is an alternative to ordinary least square estimator when there is multicollinearity problem. There are many proposed estimators in literature. In this paper, we propose new estimators which are modifications of the estimator suggested by Lawless and Wang (1976). A Monte Carlo experiment has been conducted for the comparison of the performances of the estimators. Mean squared error…
▽ More
Ridge estimator is an alternative to ordinary least square estimator when there is multicollinearity problem. There are many proposed estimators in literature. In this paper, we propose new estimators which are modifications of the estimator suggested by Lawless and Wang (1976). A Monte Carlo experiment has been conducted for the comparison of the performances of the estimators. Mean squared error (MSE) is used as a performance criterion. The benefits of new estimators are illustrated using two real datasets. According to both simulation results and applications, our new estimators have better performances in the sense of MSE in most of the situations.
△ Less
Submitted 9 December, 2015;
originally announced December 2015.
-
Stancu type generalization of the q-Favard-Szasz operators
Authors:
Ali Karaisa,
Durhasan Turgut Tollu,
Yasin Asar
Abstract:
In this paper, we introduce a Stancu type generalization of the q-Favard-Szasz operators, estimate the rates of statistical convergence and study the local approximation properties of these operators.
In this paper, we introduce a Stancu type generalization of the q-Favard-Szasz operators, estimate the rates of statistical convergence and study the local approximation properties of these operators.
△ Less
Submitted 10 July, 2014;
originally announced July 2014.
