-
Estimation of Dirichlet distribution parameters with bias-reducing adjusted score functions
Authors:
Vincenzo Gioia,
Euloge Clovis Kenne Pagui
Abstract:
The Dirichlet distribution, also known as multivariate beta, is the most used to analyse frequencies or proportions data. Maximum likelihood is widespread for estimation of Dirichlet's parameters. However, for small sample sizes, the maximum likelihood estimator may shows a significant bias. In this paper, Dirchlet's parameters estimation is obtained through modified score functions aiming at mean…
▽ More
The Dirichlet distribution, also known as multivariate beta, is the most used to analyse frequencies or proportions data. Maximum likelihood is widespread for estimation of Dirichlet's parameters. However, for small sample sizes, the maximum likelihood estimator may shows a significant bias. In this paper, Dirchlet's parameters estimation is obtained through modified score functions aiming at mean and median bias reduction of the maximum likelihood estimator, respectively. A simulation study and an application compare the adjusted score approaches with maximum likelihood.
△ Less
Submitted 3 March, 2021;
originally announced March 2021.
-
Accurate inference in negative binomial regression
Authors:
Euloge Clovis Kenne Pagui,
Alessandra Salvan,
Nicola Sartori
Abstract:
Negative binomial regression is commonly employed to analyze overdispersed count data. With small to moderate sample sizes, the maximum likelihood estimator of the dispersion parameter may be subject to a significant bias, that in turn affects inference on mean parameters. This paper proposes inference for negative binomial regression based on adjustments of the score function aimed at mean and me…
▽ More
Negative binomial regression is commonly employed to analyze overdispersed count data. With small to moderate sample sizes, the maximum likelihood estimator of the dispersion parameter may be subject to a significant bias, that in turn affects inference on mean parameters. This paper proposes inference for negative binomial regression based on adjustments of the score function aimed at mean and median bias reduction. The resulting estimating equations are similar to those available for improved inference in generalized linear models and, in particular, can be solved using a suitable extension of iterative weighted least squares. Simulation studies show a remarkable performance of the new methods, which are also found to solve in many cases numerical problems of maximum likelihood estimates. The methods are illustrated and evaluated using two case studies: an Ames salmonella assay data set and data on epileptic seizures. Inference based on adjusted scores turns out to be generally preferable to explicit bias correction.
△ Less
Submitted 5 November, 2020;
originally announced November 2020.
-
Median bias reduction in cumulative link models
Authors:
Vincenzo Gioia,
Euloge Clovis Kenne Pagui,
Alessandra Salvan
Abstract:
This paper presents a novel estimation approach for cumulative link models, based on median bias reduction as developed in Kenne Pagui et al. (2017). The median bias reduced estimator is obtained as solution of an estimating equation based on an adjustment of the score. It allows to obtain higher-order median centering of maximum likelihood estimates without requiring their finiteness. Moreover, t…
▽ More
This paper presents a novel estimation approach for cumulative link models, based on median bias reduction as developed in Kenne Pagui et al. (2017). The median bias reduced estimator is obtained as solution of an estimating equation based on an adjustment of the score. It allows to obtain higher-order median centering of maximum likelihood estimates without requiring their finiteness. Moreover, the estimator is equivariant under componentwise monotone reparameterizations and the method is effective in preventing boundary estimates. We evaluate the properties of the median bias reduced estimator through simulation studies and compare it with the two main competitors, the maximum likelihood and the mean bias reduced (Firth, 1993) estimators. Finally, we show an application where the proposed estimator is able to solve the boundary estimates problem.
△ Less
Submitted 15 September, 2020; v1 submitted 27 May, 2020;
originally announced May 2020.
-
Efficient implementation of median bias reduction with applications to general regression models
Authors:
Euloge Clovis Kenne Pagui,
Alessandra Salvan,
Nicola Sartori
Abstract:
In numerous regular statistical models, median bias reduction (Kenne Pagui et al., 2017) has proven to be a noteworthy improvement over maximum likelihood, alternative to mean bias reduction. The estimator is obtained as solution to a modified score equation ensuring smaller asymptotic median bias than the maximum likelihood estimator. This paper provides a simplified algebraic form of the adjustm…
▽ More
In numerous regular statistical models, median bias reduction (Kenne Pagui et al., 2017) has proven to be a noteworthy improvement over maximum likelihood, alternative to mean bias reduction. The estimator is obtained as solution to a modified score equation ensuring smaller asymptotic median bias than the maximum likelihood estimator. This paper provides a simplified algebraic form of the adjustment term for general regular models. With the new formula, the estimation procedure benefits from a considerable computational gain by avoiding multiple summations and thus allows an efficient implementation. More importantly, the new formulation allows to highlight how the median bias reduction adjustment can be obtained by adding an extra term to the mean bias reduction adjustment. Illustrations are provided through new applications of median bias reduction to two regression models not belonging to the generalized linear models class, extended beta regression and beta-binomial regression. Mean bias reduction is also provided here for the latter model. Simulation studies show remarkable componentwise median centering of the median bias reduced estimator, while variability and coverage of related confidence intervals are comparable with those of mean bias reduction. Moreover, empirical results for the beta-binomial model show that the method is successful in solving maximum likelihood boundary estimate problem.
△ Less
Submitted 30 November, 2020; v1 submitted 18 April, 2020;
originally announced April 2020.
-
Mean and median bias reduction in generalized linear models
Authors:
Ioannis Kosmidis,
Euloge Clovis Kenne Pagui,
Nicola Sartori
Abstract:
This paper presents an integrated framework for estimation and inference from generalized linear models using adjusted score equations that result in mean and median bias reduction. The framework unifies theoretical and methodological aspects of past research on mean bias reduction and accommodates, in a natural way, new advances on median bias reduction. General expressions for the adjusted score…
▽ More
This paper presents an integrated framework for estimation and inference from generalized linear models using adjusted score equations that result in mean and median bias reduction. The framework unifies theoretical and methodological aspects of past research on mean bias reduction and accommodates, in a natural way, new advances on median bias reduction. General expressions for the adjusted score functions are derived in terms of quantities that are readily available in standard software for fitting generalized linear models. The resulting estimating equations are solved using a unifying quasi-Fisher scoring algorithm that is shown to be equivalent to iteratively re-weighted least squares with appropriately adjusted working variates. Formal links between the iterations for mean and median bias reduction are established. Core model invariance properties are used to develop a novel mixed adjustment strategy when the estimation of a dispersion parameter is necessary. It is also shown how median bias reduction in multinomial logistic regression can be done using the equivalent Poisson log-linear model. The estimates coming out from mean and median bias reduction are found to overcome practical issues related to infinite estimates that can occur with positive probability in generalized linear models with multinomial or discrete responses, and can result in valid inferences even in the presence of a high-dimensional nuisance parameter
△ Less
Submitted 12 January, 2019; v1 submitted 11 April, 2018;
originally announced April 2018.
