Showing 1–20 of 20 results for author: Masuda, H

On estimation of heavy-tailed stable linear regression

Authors: Eitaro Kawamo, Hiroki Masuda

Abstract: We study the parameter estimation method for linear regression models with possibly skewed stable distributed errors. Our estimation procedure consists of two stages: first, for the regression coefficients, the Cauchy quasi-maximum likelihood estimator (CQMLE) is considered after taking the differences to remove the skewness of noise, and we prove its asymptotic normality and tail-probability esti… ▽ More We study the parameter estimation method for linear regression models with possibly skewed stable distributed errors. Our estimation procedure consists of two stages: first, for the regression coefficients, the Cauchy quasi-maximum likelihood estimator (CQMLE) is considered after taking the differences to remove the skewness of noise, and we prove its asymptotic normality and tail-probability estimate; second, as for stable-distribution parameters, we consider the moment estimators based on the symmetrized and centered residuals and prove their $\sqrt{n}$-consistency. To derive the $\sqrt{n}$-consistency, we essentially used the tail-probability estimate of the CQMLE. The proposed estimation procedure has a very low computational load and is much less time-consuming compared with the maximum-likelihood estimator. Further, our estimator can be effectively used as an initial value of the numerical optimization of the log-likelihood. △ Less

Submitted 16 April, 2024; originally announced April 2024.

Adaptive Ridge Approach to Heteroscedastic Regression

Authors: Ka Long Keith Ho, Hiroki Masuda

Abstract: We propose an adaptive ridge (AR) based estimation scheme for a heteroscedastic linear model equipped with log-linear errors. We simultaneously estimate the mean and variance parameters and show new asymptotic distributional and tightness properties in a sparse setting. We also show that estimates for zero parameters shrink with more iterations under suitable assumptions for tuning parameters. We… ▽ More We propose an adaptive ridge (AR) based estimation scheme for a heteroscedastic linear model equipped with log-linear errors. We simultaneously estimate the mean and variance parameters and show new asymptotic distributional and tightness properties in a sparse setting. We also show that estimates for zero parameters shrink with more iterations under suitable assumptions for tuning parameters. We observe possible generalizations of this paper's results through simulations and will apply the estimation method in forecasting electricity consumption. △ Less

Submitted 4 May, 2024; v1 submitted 21 February, 2024; originally announced February 2024.

Comments: 25 pages, 3 tables, 7 figures

MSC Class: 62J07

Quasi-Likelihood Analysis for Student-Lévy Regression

Authors: Hiroki Masuda, Lorenzo Mercuri, Yuma Uehara

Abstract: We consider the quasi-likelihood analysis for a linear regression model driven by a Student-t Lévy process with constant scale and arbitrary degrees of freedom. The model is observed at high frequency over an extending period, under which we can quantify how the sampling frequency affects estimation accuracy. In that setting, joint estimation of trend, scale, and degrees of freedom is a non-trivia… ▽ More We consider the quasi-likelihood analysis for a linear regression model driven by a Student-t Lévy process with constant scale and arbitrary degrees of freedom. The model is observed at high frequency over an extending period, under which we can quantify how the sampling frequency affects estimation accuracy. In that setting, joint estimation of trend, scale, and degrees of freedom is a non-trivial problem. The bottleneck is that the Student-t distribution is not closed under convolution, making it difficult to estimate all the parameters fully based on the high-frequency time scale. To efficiently deal with the intricate nature from both theoretical and computational points of view, we propose a two-step quasi-likelihood analysis: first, we make use of the Cauchy quasi-likelihood for estimating the regression-coefficient vector and the scale parameter; then, we construct the sequence of the unit-period cumulative residuals to estimate the remaining degrees of freedom. In particular, using full data in the first step causes a problem stemming from the small-time Cauchy approximation, showing the need for data thinning. △ Less

Submitted 26 May, 2024; v1 submitted 29 June, 2023; originally announced June 2023.

On local likelihood asymptotics for Gaussian mixed-effects model with system noise

Authors: Takumi Imamura, Hiroki Masuda, Hayato Tajima

Abstract: The Gaussian mixed-effects model driven by a stationary integrated Ornstein-Uhlenbeck process has been used for analyzing longitudinal data having an explicit and simple serial-correlation structure in each individual. However, the theoretical aspect of its asymptotic inference is yet to be elucidated. We prove the local asymptotics for the associated log-likelihood function, which in particular g… ▽ More The Gaussian mixed-effects model driven by a stationary integrated Ornstein-Uhlenbeck process has been used for analyzing longitudinal data having an explicit and simple serial-correlation structure in each individual. However, the theoretical aspect of its asymptotic inference is yet to be elucidated. We prove the local asymptotics for the associated log-likelihood function, which in particular guarantees the asymptotic optimality of the suitably chosen maximum-likelihood estimator. We illustrate the obtained asymptotic normality result through some simulations for both balanced and unbalanced datasets. △ Less

Submitted 4 November, 2023; v1 submitted 29 March, 2023; originally announced March 2023.

Comments: 11 pages, 3 figures

Mixed-effects location-scale model based on generalized hyperbolic distribution

Authors: Yuki Fu**aga, Hiroki Masuda

Abstract: Motivated by better modeling of intra-individual variability in longitudinal data, we propose a class of location-scale mixed effects models, in which the data of each individual is modeled by a parameter-varying generalized hyperbolic distribution. We first study the local maximum-likelihood asymptotics and reveal the instability in the numerical optimization of the log-likelihood. Then, we const… ▽ More Motivated by better modeling of intra-individual variability in longitudinal data, we propose a class of location-scale mixed effects models, in which the data of each individual is modeled by a parameter-varying generalized hyperbolic distribution. We first study the local maximum-likelihood asymptotics and reveal the instability in the numerical optimization of the log-likelihood. Then, we construct an asymptotically efficient estimator based on the Newton-Raphson method based on the original log-likelihood function with the initial estimator being naive least-squares-type. Numerical experiments are conducted to show that the proposed one-step estimator is not only theoretically efficient but also numerically much more stable and much less time-consuming compared with the maximum-likelihood estimator. △ Less

Submitted 10 March, 2023; v1 submitted 29 September, 2022; originally announced September 2022.

Gaussian quasi-information criteria for ergodic Lévy driven SDE

Authors: Shoichi Eguchi, Hiroki Masuda

Abstract: We consider relative model comparison for the parametric coefficients of a semiparametric ergodic Lévy driven model observed at high-frequency. Our asymptotics is based on the fully explicit two-stage Gaussian quasi-likelihood function (GQLF) of the Euler-approximation type. For selections of the scale and drift coefficients, we propose explicit Gaussian quasi-AIC (GQAIC) and Gaussian quasi-BIC (G… ▽ More We consider relative model comparison for the parametric coefficients of a semiparametric ergodic Lévy driven model observed at high-frequency. Our asymptotics is based on the fully explicit two-stage Gaussian quasi-likelihood function (GQLF) of the Euler-approximation type. For selections of the scale and drift coefficients, we propose explicit Gaussian quasi-AIC (GQAIC) and Gaussian quasi-BIC (GQBIC) statistics through the stepwise inference procedure. In particular, we show that the mixed-rates structure of the joint GQLF, which does not emerge for the case of diffusions, gives rise to the non-standard forms of the regularization terms in the selection of the scale coefficient, quantitatively clarifying the relation between estimation precision and sampling frequency. Numerical experiments are given to illustrate our theoretical findings. △ Less

Submitted 22 May, 2023; v1 submitted 8 March, 2022; originally announced March 2022.

Estimation of ergodic square-root diffusion under high-frequency sampling

Authors: Yuzhong Cheng, Nicole Hufnagel, Hiroki Masuda

Abstract: Gaussian quasi-likelihood estimation of the parameter $θ$ in the square-root diffusion process is studied under high frequency sampling. Different from the previous study of Overbeck and Rydén(1998) under low-frequency sampling, high-frequency of data provides very simple form of the asymptotic covariance matrix. Through easy-to-compute preliminary contrast functions, a practical two-stage manner… ▽ More Gaussian quasi-likelihood estimation of the parameter $θ$ in the square-root diffusion process is studied under high frequency sampling. Different from the previous study of Overbeck and Rydén(1998) under low-frequency sampling, high-frequency of data provides very simple form of the asymptotic covariance matrix. Through easy-to-compute preliminary contrast functions, a practical two-stage manner without numerical optimization is formulated in order to conduct not only an asymptotically efficient estimation of the drift parameters, but also high-precision estimator of the diffusion parameter. Simulation experiments are given to illustrate the results. △ Less

Submitted 23 June, 2022; v1 submitted 29 March, 2021; originally announced March 2021.

Comments: Figure 3 is exchanged. Previously, the simulations from Figure 2 were also shown here

Optimal stable Ornstein-Uhlenbeck regression

Authors: Hiroki Masuda

Abstract: We prove some efficient inference results concerning estimation of a Ornstein-Uhlenbeck regression model, which is driven by a non-Gaussian stable Levy process and where the output process is observed at high-frequency over a fixed time period. Local asymptotics for the likelihood function is presented, followed by a way to construct an asymptotically efficient estimator through a suboptimal yet v… ▽ More We prove some efficient inference results concerning estimation of a Ornstein-Uhlenbeck regression model, which is driven by a non-Gaussian stable Levy process and where the output process is observed at high-frequency over a fixed time period. Local asymptotics for the likelihood function is presented, followed by a way to construct an asymptotically efficient estimator through a suboptimal yet very simple preliminary estimator. △ Less

Submitted 15 January, 2023; v1 submitted 8 June, 2020; originally announced June 2020.

Comments: fixed some mistakes in the previous versions

Infinite nonabelian corks

Authors: Hiroto Masuda

Abstract: We construct $G$-corks for any extension $G$ of $\mathbb Z^m$ by any finite subgroup of $\mathrm{SO}(4)$ and weakly equivariant $G$-corks for any extension $G$ of $\mathbb Z^m$ by any finite solvable group. In particular, this is the first example of $G$-corks for an infinite nonabelian group $G$ and answers a question by Tange. The construction is a combination of previous results by Auckly-Kim-M… ▽ More We construct $G$-corks for any extension $G$ of $\mathbb Z^m$ by any finite subgroup of $\mathrm{SO}(4)$ and weakly equivariant $G$-corks for any extension $G$ of $\mathbb Z^m$ by any finite solvable group. In particular, this is the first example of $G$-corks for an infinite nonabelian group $G$ and answers a question by Tange. The construction is a combination of previous results by Auckly-Kim-Melvin-Ruberman, Gompf, and Tange. Using Gompf's results about exotic $\mathbb R^4$'s, we give an application to construct exotic $\mathbb R^4$'s whose diffeotopy group contains all poly-cyclic groups. △ Less

Submitted 21 April, 2019; originally announced April 2019.

Comments: 12 pages, 5 figures

Efficient estimation of stable Levy process with symmetric jumps

Authors: Alexandre Brouste, Hiroki Masuda

Abstract: Efficient estimation of a non-Gaussian stable Levy process with drift and symmetric jumps observed at high frequency is considered. For this statistical experiment, the local asymptotic normality of the likelihood is proved with a non-singular Fisher information matrix through the use of a non-diagonal norming matrix. The asymptotic normality and efficiency of a sequence of roots of the associated… ▽ More Efficient estimation of a non-Gaussian stable Levy process with drift and symmetric jumps observed at high frequency is considered. For this statistical experiment, the local asymptotic normality of the likelihood is proved with a non-singular Fisher information matrix through the use of a non-diagonal norming matrix. The asymptotic normality and efficiency of a sequence of roots of the associated likelihood equation are shown as well. Moreover, we show that a simple preliminary method of moments can be used as an initial estimator of a scoring procedure, thereby conveniently enabling us to bypass numerically demanding likelihood optimization. Our simulation results show that the one-step estimator can exhibit quite similar finite-sample performance as the maximum likelihood estimator. △ Less

Submitted 29 May, 2018; v1 submitted 22 May, 2018; originally announced May 2018.

Comments: Minor typos fixed in pages 5 and 7, specified in red; the original version published from Statistical Inference for Stochastic Processes

Data driven time scale in Gaussian quasi-likelihood inference

Authors: Shoichi Eguchi, Hiroki Masuda

Abstract: We study parametric estimation of ergodic diffusions observed at high frequency. Different from the previous studies, we suppose that sampling stepsize is unknown, thereby making the conventional Gaussian quasi-likelihood not directly applicable. In this situation, we construct estimators of both model parameters and sampling stepsize in a fully explicit way, and prove that they are jointly asympt… ▽ More We study parametric estimation of ergodic diffusions observed at high frequency. Different from the previous studies, we suppose that sampling stepsize is unknown, thereby making the conventional Gaussian quasi-likelihood not directly applicable. In this situation, we construct estimators of both model parameters and sampling stepsize in a fully explicit way, and prove that they are jointly asymptotically normally distributed. The $L^{q}$-boundedness of the obtained estimator is also derived. Further, we propose the Schwarz (BIC) type statistics for model selection and show its model-selection consistency. We conducted some numerical experiments and found that the observed finite-sample performance well supports our theoretical findings. Also provided is a real data example. △ Less

Submitted 31 January, 2019; v1 submitted 31 January, 2018; originally announced January 2018.

Bayesian inference for Stable Levy driven Stochastic Differential Equations with high-frequency data

Authors: Ajay Jasra, Kengo Kamatani, Hiroki Masuda

Abstract: In this article we consider parametric Bayesian inference for stochastic differential equations (SDE) driven by a pure-jump stable Levy process, which is observed at high frequency. In most cases of practical interest, the likelihood function is not available, so we use a quasi-likelihood and place an associated prior on the unknown parameters. It is shown under regularity conditions that there is… ▽ More In this article we consider parametric Bayesian inference for stochastic differential equations (SDE) driven by a pure-jump stable Levy process, which is observed at high frequency. In most cases of practical interest, the likelihood function is not available, so we use a quasi-likelihood and place an associated prior on the unknown parameters. It is shown under regularity conditions that there is a Bernstein-von Mises theorem associated to the posterior. We then develop a Markov chain Monte Carlo (MCMC) algorithm for Bayesian inference and assisted by our theoretical results, we show how to scale Metropolis-Hastings proposals when the frequency of the data grows, in order to prevent the acceptance ratio going to zero in the large data limit. Our algorithm is presented on numerical examples that help to verify our theoretical findings. △ Less

Submitted 27 July, 2017; originally announced July 2017.

Non-Gaussian quasi-likelihood estimation of SDE driven by locally stable Lévy process

Authors: Hiroki Masuda

Abstract: We address estimation of parametric coefficients of a pure-jump Lévy driven univariate stochastic differential equation (SDE) model, which is observed at high frequency over a fixed time period. It is known from the previous study Masuda (2013) that adopting the conventional Gaussian quasi-maximum likelihood estimator then leads to an inconsistent estimator. In this paper, under the assumption tha… ▽ More We address estimation of parametric coefficients of a pure-jump Lévy driven univariate stochastic differential equation (SDE) model, which is observed at high frequency over a fixed time period. It is known from the previous study Masuda (2013) that adopting the conventional Gaussian quasi-maximum likelihood estimator then leads to an inconsistent estimator. In this paper, under the assumption that the driving Lévy process is locally stable, we extend the Gaussian framework into a non-Gaussian counterpart, by introducing a novel quasi-likelihood function formally based on the small-time stable approximation of the unknown transition density. The resulting estimator turns out to be asymptotically mixed normally distributed without ergodicity and finite moments for a wide range of the driving pure-jump Lévy process, showing much better theoretical performance compared with the Gaussian quasi-maximum likelihood estimator. Extensive simulations are carried out to show good estimation accuracy. The case of large-time asymptotics under ergodicity is briefly mentioned as well, where we can deduce an analogous asymptotic normality result. △ Less

Submitted 17 April, 2018; v1 submitted 24 August, 2016; originally announced August 2016.

Schwarz type model comparison for LAQ models

Authors: Shoichi Eguchi, Hiroki Masuda

Abstract: For model-specification purpose, we study asymptotic behavior of the marginal quasi-log likelihood associated with a family of locally asymptotically quadratic (LAQ) statistical experiments. Our result entails a far-reaching extension of applicable scope of the classical approximate Bayesian model comparison due to Schwarz, with frequentist-view theoretical foundation. In particular, the proposed… ▽ More For model-specification purpose, we study asymptotic behavior of the marginal quasi-log likelihood associated with a family of locally asymptotically quadratic (LAQ) statistical experiments. Our result entails a far-reaching extension of applicable scope of the classical approximate Bayesian model comparison due to Schwarz, with frequentist-view theoretical foundation. In particular, the proposed statistics can deal with both ergodic and non-ergodic stochastic-process models, where the corresponding $M$-estimator is of multi-scaling type and the asymptotic quasi-information matrix is random. Focusing on the ergodic diffusion model, we also deduce the consistency of the multistage optimal-model selection where we may select an optimal sub-model structure step by step, so that computational cost can be much reduced. We illustrate the proposed method by the Gaussian quasi-likelihood for diffusion-type models in details, together with several numerical experiments. △ Less

Submitted 23 September, 2016; v1 submitted 6 June, 2016; originally announced June 2016.

Two-step estimation of ergodic Lévy driven SDE

Authors: Hiroki Masuda, Yuma Uehara

Abstract: We consider high frequency samples from ergodic Lévy driven stochastic differential equation (SDE) with drift coefficient $a(x,α)$ and scale coefficient $c(x,γ)$ involving unknown parameters $α$ and $γ$. We suppose that the Lévy measure $ν_{0}$, has all order moments but is not fully specified. We will prove the joint asymptotic normality of some estimators of $α$, $γ$ and a class of functional pa… ▽ More We consider high frequency samples from ergodic Lévy driven stochastic differential equation (SDE) with drift coefficient $a(x,α)$ and scale coefficient $c(x,γ)$ involving unknown parameters $α$ and $γ$. We suppose that the Lévy measure $ν_{0}$, has all order moments but is not fully specified. We will prove the joint asymptotic normality of some estimators of $α$, $γ$ and a class of functional parameter $\int\varphi(z)ν_0(dz)$, which are constructed in a two-step manner: first, we use the Gaussian quasi-likelihood for estimation of $(α,γ)$, and then, for estimating $\int\varphi(z)ν_0(dz)$ we makes use of the method of moments based on the Euler-type residual with the the previously obtained quasi-likelihood estimator. △ Less

Submitted 10 January, 2016; v1 submitted 7 May, 2015; originally announced May 2015.

Uniform LAN property of locally stable Lévy process observed at high frequency

Authors: Dmytro Ivanenko, Alexey M. Kulik, Hiroki Masuda

Abstract: Suppose we have a high-frequency sample from the Lévy process of the form $X_t^θ=βt+γZ_t+U_t$, where $Z$ is a possibly asymmetric locally $α$-stable Lévy process, and $U$ is a nuisance Lévy process less active than $Z$. We prove the LAN property about the explicit parameter $θ=(β,γ)$ under very mild conditions without specific form of the Lévy measure of $Z$, thereby generalizing the LAN result of… ▽ More Suppose we have a high-frequency sample from the Lévy process of the form $X_t^θ=βt+γZ_t+U_t$, where $Z$ is a possibly asymmetric locally $α$-stable Lévy process, and $U$ is a nuisance Lévy process less active than $Z$. We prove the LAN property about the explicit parameter $θ=(β,γ)$ under very mild conditions without specific form of the Lévy measure of $Z$, thereby generalizing the LAN result of Aït-Sahalia and Jacod (2007). In particular, it is clarified that a non-diagonal norming may be necessary in the truly asymmetric case. Due to the special nature of the local $α$-stable property, the asymptotic Fisher information matrix takes a clean-cut form. △ Less

Submitted 14 August, 2015; v1 submitted 6 November, 2014; originally announced November 2014.

Comments: 24 pages

Parametric estimation of Lévy processes

Authors: Hiroki Masuda

Abstract: The main purpose of this chapter is to present some theoretical aspects of parametric estimation of Lévy processes based on high-frequency sampling, with a focus on infinite activity pure-jump models. Asymptotics for several classes of explicit estimating functions are discussed. In addition to the asymptotic normality at several rates of convergence, a uniform tail-probability estimate for statis… ▽ More The main purpose of this chapter is to present some theoretical aspects of parametric estimation of Lévy processes based on high-frequency sampling, with a focus on infinite activity pure-jump models. Asymptotics for several classes of explicit estimating functions are discussed. In addition to the asymptotic normality at several rates of convergence, a uniform tail-probability estimate for statistical random fields is given. As specific cases, we discuss method of moments for the stable Lévy processes in much greater detail, with briefly mentioning locally stable Lévy processes too. Also discussed is, due to its theoretical importance, a brief review of how the classical likelihood approach works or does not, beyond the fact that the likelihood function is not explicit. △ Less

Submitted 1 September, 2014; originally announced September 2014.

Moment convergence in regularized estimation under multiple and mixed-rates asymptotics

Authors: Hiroki Masuda, Yusuke Shimizu

Abstract: In $M$-estimation under standard asymptotics, the weak convergence combined with the polynomial type large deviation estimate of the associated statistical random field Yoshida (2011) provides us with not only the asymptotic distribution of the associated $M$-estimator but also the convergence of its moments, the latter playing an important role in theoretical statistics. In this paper, we study t… ▽ More In $M$-estimation under standard asymptotics, the weak convergence combined with the polynomial type large deviation estimate of the associated statistical random field Yoshida (2011) provides us with not only the asymptotic distribution of the associated $M$-estimator but also the convergence of its moments, the latter playing an important role in theoretical statistics. In this paper, we study the above program for statistical random fields of multiple and also possibly mixed-rates type in the sense of Radchenko (2008) where the associated statistical random fields may be non-differentiable and may fail to be locally asymptotically quadratic. Consequently, a very strong mode of convergence of a wide range of regularized $M$-estimators is ensured. The results are applied to regularized estimation of an ergodic diffusion observed at high frequency. △ Less

Submitted 16 April, 2017; v1 submitted 25 June, 2014; originally announced June 2014.

Convergence of Gaussian quasi-likelihood random fields for ergodic Lévy driven SDE observed at high frequency

Authors: Hiroki Masuda

Abstract: This paper investigates the Gaussian quasi-likelihood estimation of an exponentially ergodic multidimensional Markov process, which is expressed as a solution to a Lévy driven stochastic differential equation whose coefficients are known except for the finite-dimensional parameters to be estimated, where the diffusion coefficient may be degenerate or even null. We suppose that the process is discr… ▽ More This paper investigates the Gaussian quasi-likelihood estimation of an exponentially ergodic multidimensional Markov process, which is expressed as a solution to a Lévy driven stochastic differential equation whose coefficients are known except for the finite-dimensional parameters to be estimated, where the diffusion coefficient may be degenerate or even null. We suppose that the process is discretely observed under the rapidly increasing experimental design with step size $h_n$. By means of the polynomial-type large deviation inequality, convergence of the corresponding statistical random fields is derived in a mighty mode, which especially leads to the asymptotic normality at rate $\sqrt{nh_n}$ for all the target parameters, and also to the convergence of their moments. As our Gaussian quasi-likelihood solely looks at the local-mean and local-covariance structures, efficiency loss would be large in some instances. Nevertheless, it has the practically important advantages: first, the computation of estimates does not require any fine tuning, and hence it is straightforward; second, the estimation procedure can be adopted without full specification of the Lévy measure. △ Less

Submitted 13 August, 2013; originally announced August 2013.

Comments: Published in at http://dx.doi.org/10.1214/13-AOS1121 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS1121

Journal ref: Annals of Statistics 2013, Vol. 41, No. 3, 1593-1641

Edgeworth expansion for the integrated Levy driven Ornstein-Uhlenbeck process

Authors: Hiroki Masuda, Nakahiro Yoshida

Abstract: We verify the Edgeworth expansion of any order for the integrated ergodic Levy driven Ornstein-Uhlenbeck process, applying a Malliavin calculus with truncation over the Wiener-Poisson space. Due to the special structure of the model, the coefficients of the expansion can be given in a closed form. We verify the Edgeworth expansion of any order for the integrated ergodic Levy driven Ornstein-Uhlenbeck process, applying a Malliavin calculus with truncation over the Wiener-Poisson space. Due to the special structure of the model, the coefficients of the expansion can be given in a closed form. △ Less

Submitted 9 April, 2013; originally announced April 2013.

Comments: 9 pages