Showing 1–22 of 22 results for author: Chen, S X

TiNO-Edit: Timestep and Noise Optimization for Robust Diffusion-Based Image Editing

Authors: Sherry X. Chen, Yaron Vaxman, Elad Ben Baruch, David Asulin, Aviad Moreshet, Kuo-Chin Lien, Misha Sra, Pradeep Sen

Abstract: Despite many attempts to leverage pre-trained text-to-image models (T2I) like Stable Diffusion (SD) for controllable image editing, producing good predictable results remains a challenge. Previous approaches have focused on either fine-tuning pre-trained T2I models on specific datasets to generate certain kinds of images (e.g., with a specific object or person), or on optimizing the weights, text… ▽ More Despite many attempts to leverage pre-trained text-to-image models (T2I) like Stable Diffusion (SD) for controllable image editing, producing good predictable results remains a challenge. Previous approaches have focused on either fine-tuning pre-trained T2I models on specific datasets to generate certain kinds of images (e.g., with a specific object or person), or on optimizing the weights, text prompts, and/or learning features for each input image in an attempt to coax the image generator to produce the desired result. However, these approaches all have shortcomings and fail to produce good results in a predictable and controllable manner. To address this problem, we present TiNO-Edit, an SD-based method that focuses on optimizing the noise patterns and diffusion timesteps during editing, something previously unexplored in the literature. With this simple change, we are able to generate results that both better align with the original images and reflect the desired result. Furthermore, we propose a set of new loss functions that operate in the latent domain of SD, greatly speeding up the optimization when compared to prior approaches, which operate in the pixel domain. Our method can be easily applied to variations of SD including Textual Inversion and DreamBooth that encode new concepts and incorporate them into the edited results. We present a host of image-editing capabilities enabled by our approach. Our code is publicly available at https://github.com/SherryXTChen/TiNO-Edit. △ Less

Submitted 17 April, 2024; originally announced April 2024.

Comments: Conference on Computer Vision and Pattern Recognition (CVPR) 2024

A Review on the Optimal Fingerprinting Approach in Climate Change Studies

Authors: Hanyue Chen, Song Xi Chen, Mu Mu

Abstract: We provide a review on the "optimal fingerprinting" approach as summarized in Allen and Tett (1999) from a point view of statistical inference in light of the recent criticism of McKitrick (2021). Our review finds that the "optimal fingerprinting" approach would survive much of McKitrick (2021)'s criticism under two conditions: (i) the null simulation of the climate model is independent of the phy… ▽ More We provide a review on the "optimal fingerprinting" approach as summarized in Allen and Tett (1999) from a point view of statistical inference in light of the recent criticism of McKitrick (2021). Our review finds that the "optimal fingerprinting" approach would survive much of McKitrick (2021)'s criticism under two conditions: (i) the null simulation of the climate model is independent of the physical observations and (ii) the null simulation provides consistent estimation of the residual covariance matrix of the physical observations, both depend on the conduction and the quality of the climate models. If the latter condition fails, the estimator would be still unbiased and consistent under routine conditions, but losing the "optimal" aspect of the approach. The residual consistency test suggested by Allen and Tett (1999) is valid for checking the agreement between the residual covariances of the null simulation and the physical observations. We further outline the connection between the "optimal fingerprinting" approach and the Feasible Generalized Least Square. △ Less

Submitted 21 May, 2022; originally announced May 2022.

Web-Scale Generic Object Detection at Microsoft Bing

Authors: Stephen Xi Chen, Saurajit Mukherjee, Unmesh Phadke, Tingting Wang, Junwon Park, Ravi Theja Yada

Abstract: In this paper, we present Generic Object Detection (GenOD), one of the largest object detection systems deployed to a web-scale general visual search engine that can detect over 900 categories for all Microsoft Bing Visual Search queries in near real-time. It acts as a fundamental visual query understanding service that provides object-centric information and shows gains in multiple production sce… ▽ More In this paper, we present Generic Object Detection (GenOD), one of the largest object detection systems deployed to a web-scale general visual search engine that can detect over 900 categories for all Microsoft Bing Visual Search queries in near real-time. It acts as a fundamental visual query understanding service that provides object-centric information and shows gains in multiple production scenarios, improving upon domain-specific models. We discuss the challenges of collecting data, training, deploying and updating such a large-scale object detection model with multiple dependencies. We discuss a data collection pipeline that reduces per-bounding box labeling cost by 81.5% and latency by 61.2% while improving on annotation quality. We show that GenOD can improve weighted average precision by over 20% compared to multiple domain-specific models. We also improve the model update agility by nearly 2 times with the proposed disjoint detector training compared to joint fine-tuning. Finally we demonstrate how GenOD benefits visual search applications by significantly improving object-level search relevance by 54.9% and user engagement by 59.9%. △ Less

Submitted 5 July, 2021; originally announced July 2021.

Comments: In Proceedings of the 27th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD) 2021, Virtual Event, Singapore

Concentration Inequalities for Statistical Inference

Authors: Huiming Zhang, Song Xi Chen

Abstract: This paper gives a review of concentration inequalities which are widely employed in non-asymptotical analyses of mathematical statistics in a wide range of settings, from distribution-free to distribution-dependent, from sub-Gaussian to sub-exponential, sub-Gamma, and sub-Weibull random variables, and from the mean to the maximum concentration. This review provides results in these settings with… ▽ More This paper gives a review of concentration inequalities which are widely employed in non-asymptotical analyses of mathematical statistics in a wide range of settings, from distribution-free to distribution-dependent, from sub-Gaussian to sub-exponential, sub-Gamma, and sub-Weibull random variables, and from the mean to the maximum concentration. This review provides results in these settings with some fresh new results. Given the increasing popularity of high-dimensional data and inference, results in the context of high-dimensional linear and Poisson regressions are also provided. We aim to illustrate the concentration inequalities with known constants and to improve existing bounds with sharper constants. △ Less

Submitted 28 March, 2021; v1 submitted 4 November, 2020; originally announced November 2020.

Comments: Invited review article on constants-specified concentration inequalities published in Communications in Mathematical Research

MSC Class: 60F10; 60G50; 62E17

Journal ref: Communications in Mathematical Research. 37(1), 1-85 (2021)

Analyzing China's Consumer Price Index Comparatively with that of United States

Authors: Zhenzhong Wang, Yundong Tu, Song Xi Chen

Abstract: This paper provides a thorough analysis on the dynamic structures and predictability of China's Consumer Price Index (CPI-CN), with a comparison to those of the United States. Despite the differences in the two leading economies, both series can be well modeled by a class of Seasonal Autoregressive Integrated Moving Average Model with Covariates (S-ARIMAX). The CPI-CN series possess regular patter… ▽ More This paper provides a thorough analysis on the dynamic structures and predictability of China's Consumer Price Index (CPI-CN), with a comparison to those of the United States. Despite the differences in the two leading economies, both series can be well modeled by a class of Seasonal Autoregressive Integrated Moving Average Model with Covariates (S-ARIMAX). The CPI-CN series possess regular patterns of dynamics with stable annual cycles and strong Spring Festival effects, with fitting and forecasting errors largely comparable to their US counterparts. Finally, for the CPI-CN, the diffusion index (DI) approach offers improved predictions than the S-ARIMAX models. △ Less

Submitted 29 October, 2019; originally announced October 2019.

Multi-level Thresholding Test for High Dimensional Covariance Matrices

Authors: Song Xi Chen, Bin Guo, Yumou Qiu

Abstract: We consider testing the equality of two high-dimensional covariance matrices by carrying out a multi-level thresholding procedure, which is designed to detect sparse and faint differences between the covariances. A novel U-statistic composition is developed to establish the asymptotic distribution of the thresholding statistics in conjunction with the matrix blocking and the coupling techniques. W… ▽ More We consider testing the equality of two high-dimensional covariance matrices by carrying out a multi-level thresholding procedure, which is designed to detect sparse and faint differences between the covariances. A novel U-statistic composition is developed to establish the asymptotic distribution of the thresholding statistics in conjunction with the matrix blocking and the coupling techniques. We propose a multi-thresholding test that is shown to be powerful in detecting sparse and weak differences between two covariance matrices. The test is shown to have attractive detection boundary and to attain the optimal minimax rate in the signal strength under different regimes of high dimensionality and the sparsity of the signal. Simulation studies are conducted to demonstrate the utility of the proposed test. △ Less

Submitted 28 October, 2019; originally announced October 2019.

Matrix Completion under Low-Rank Missing Mechanism

Authors: Xiaojun Mao, Raymond K. W. Wong, Song Xi Chen

Abstract: Matrix completion is a modern missing data problem where both the missing structure and the underlying parameter are high dimensional. Although missing structure is a key component to any missing data problems, existing matrix completion methods often assume a simple uniform missing mechanism. In this work, we study matrix completion from corrupted data under a novel low-rank missing mechanism. Th… ▽ More Matrix completion is a modern missing data problem where both the missing structure and the underlying parameter are high dimensional. Although missing structure is a key component to any missing data problems, existing matrix completion methods often assume a simple uniform missing mechanism. In this work, we study matrix completion from corrupted data under a novel low-rank missing mechanism. The probability matrix of observation is estimated via a high dimensional low-rank matrix estimation procedure, and further used to complete the target matrix via inverse probabilities weighting. Due to both high dimensional and extreme (i.e., very small) nature of the true probability matrix, the effect of inverse probability weighting requires careful study. We derive optimal asymptotic convergence rates of the proposed estimators for both the observation probabilities and the target matrix. △ Less

Submitted 19 March, 2020; v1 submitted 19 December, 2018; originally announced December 2018.

Comments: 29 pages, 0 figures

Distributed Statistical Inference for Massive Data

Authors: Song Xi Chen, Liuhua Peng

Abstract: This paper considers distributed statistical inference for general symmetric statistics %that encompasses the U-statistics and the M-estimators in the context of massive data where the data can be stored at multiple platforms in different locations. In order to facilitate effective computation and to avoid expensive communication among different platforms, we formulate distributed statistics which… ▽ More This paper considers distributed statistical inference for general symmetric statistics %that encompasses the U-statistics and the M-estimators in the context of massive data where the data can be stored at multiple platforms in different locations. In order to facilitate effective computation and to avoid expensive communication among different platforms, we formulate distributed statistics which can be conducted over smaller data blocks. The statistical properties of the distributed statistics are investigated in terms of the mean square error of estimation and asymptotic distributions with respect to the number of data blocks. In addition, we propose two distributed bootstrap algorithms which are computationally effective and are able to capture the underlying distribution of the distributed statistics. Numerical simulation and real data applications of the proposed approaches are provided to demonstrate the empirical performance. △ Less

Submitted 28 May, 2018; originally announced May 2018.

High-dimensional empirical likelihood inference

Authors: **yuan Chang, Song Xi Chen, Cheng Yong Tang, Tong Tong Wu

Abstract: High-dimensional statistical inference with general estimating equations are challenging and remain less explored. In this paper, we study two problems in the area: confidence set estimation for multiple components of the model parameters, and model specifications test. For the first one, we propose to construct a new set of estimating equations such that the impact from estimating the high-dimens… ▽ More High-dimensional statistical inference with general estimating equations are challenging and remain less explored. In this paper, we study two problems in the area: confidence set estimation for multiple components of the model parameters, and model specifications test. For the first one, we propose to construct a new set of estimating equations such that the impact from estimating the high-dimensional nuisance parameters becomes asymptotically negligible. The new construction enables us to estimate a valid confidence region by empirical likelihood ratio. For the second one, we propose a test statistic as the maximum of the marginal empirical likelihood ratios to quantify data evidence against the model specification. Our theory establishes the validity of the proposed empirical likelihood approaches, accommodating over-identification and exponentially growing data dimensionality. The numerical studies demonstrate promising performance and potential practical benefits of the new methods. △ Less

Submitted 6 November, 2019; v1 submitted 27 May, 2018; originally announced May 2018.

Comments: The original title of this paper is "High-dimensional statistical inferences with over-identification: confidence set estimation and specification test"

Journal ref: Biometrika 2021, Vol. 108, No. 1, 127-147

Two-Sample Tests for High Dimensional Means with Thresholding and Data Transformation

Authors: Song Xi Chen, Jun Li, **-Shou Zhong

Abstract: We consider testing for two-sample means of high dimensional populations by thresholding. Two tests are investigated, which are designed for better power performance when the two population mean vectors differ only in sparsely populated coordinates. The first test is constructed by carrying out thresholding to remove the non-signal bearing dimensions. The second test combines data transformation v… ▽ More We consider testing for two-sample means of high dimensional populations by thresholding. Two tests are investigated, which are designed for better power performance when the two population mean vectors differ only in sparsely populated coordinates. The first test is constructed by carrying out thresholding to remove the non-signal bearing dimensions. The second test combines data transformation via the precision matrix with the thresholding. The benefits of the thresholding and the data transformations are showed by a reduced variance of the test thresholding statistics, the improved power and a wider detection region of the tests. Simulation experiments and an empirical study are performed to confirm the theoretical findings and to demonstrate the practical implementations. △ Less

Submitted 10 October, 2014; originally announced October 2014.

Comments: 64 pages

Tests for High Dimensional Generalized Linear Models

Authors: Song Xi Chen, Bin Guo

Abstract: We consider testing regression coefficients in high dimensional generalized linear models. An investigation of the test of Goeman et al. (2011) is conducted, which reveals that if the inverse of the link function is unbounded, the high dimensionality in the covariates can impose adverse impacts on the power of the test. We propose a test formation which can avoid the adverse impact of the high dim… ▽ More We consider testing regression coefficients in high dimensional generalized linear models. An investigation of the test of Goeman et al. (2011) is conducted, which reveals that if the inverse of the link function is unbounded, the high dimensionality in the covariates can impose adverse impacts on the power of the test. We propose a test formation which can avoid the adverse impact of the high dimensionality. When the inverse of the link function is bounded such as the logistic or probit regression, the proposed test is as good as Goeman et al. (2011)'s test. The proposed tests provide p-values for testing significance for gene-sets as demonstrated in a case study on an acute lymphoblastic leukemia dataset. △ Less

Submitted 19 February, 2014; originally announced February 2014.

Comments: The research paper was stole by someone last November and illegally submitted to arXiv by a person named gong zi jiang nan. We have asked arXiv to withdraw the unfinished paper [arXiv:1311.4043] and it was removed last December. We have collected enough evidences to identify the person and Peking University has begun to investigate the plagiarizer

Tests alternative to higher criticism for high-dimensional means under sparsity and column-wise dependence

Authors: **-Shou Zhong, Song Xi Chen, Minya Xu

Abstract: We consider two alternative tests to the Higher Criticism test of Donoho and ** [Ann. Statist. 32 (2004) 962-994] for high-dimensional means under the sparsity of the nonzero means for sub-Gaussian distributed data with unknown column-wise dependence. The two alternative test statistics are constructed by first thresholding $L_1$ and $L_2$ statistics based on the sample means, respectively, follo… ▽ More We consider two alternative tests to the Higher Criticism test of Donoho and ** [Ann. Statist. 32 (2004) 962-994] for high-dimensional means under the sparsity of the nonzero means for sub-Gaussian distributed data with unknown column-wise dependence. The two alternative test statistics are constructed by first thresholding $L_1$ and $L_2$ statistics based on the sample means, respectively, followed by maximizing over a range of thresholding levels to make the tests adaptive to the unknown signal strength and sparsity. The two alternative tests can attain the same detection boundary of the Higher Criticism test in [Ann. Statist. 32 (2004) 962-994] which was established for uncorrelated Gaussian data. It is demonstrated that the maximal $L_2$-thresholding test is at least as powerful as the maximal $L_1$-thresholding test, and both the maximal $L_2$ and $L_1$-thresholding tests are at least as powerful as the Higher Criticism test. △ Less

Submitted 18 December, 2013; originally announced December 2013.

Comments: Published in at http://dx.doi.org/10.1214/13-AOS1168 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS1168

Journal ref: Annals of Statistics 2013, Vol. 41, No. 6, 2820-2851

High dimensional generalized empirical likelihood for moment restrictions with dependent data

Authors: **yuan Chang, Song Xi Chen, Xiaohong Chen

Abstract: This paper considers the maximum generalized empirical likelihood (GEL) estimation and inference on parameters identified by high dimensional moment restrictions with weakly dependent data when the dimensions of the moment restrictions and the parameters diverge along with the sample size. The consistency with rates and the asymptotic normality of the GEL estimator are obtained by properly restric… ▽ More This paper considers the maximum generalized empirical likelihood (GEL) estimation and inference on parameters identified by high dimensional moment restrictions with weakly dependent data when the dimensions of the moment restrictions and the parameters diverge along with the sample size. The consistency with rates and the asymptotic normality of the GEL estimator are obtained by properly restricting the growth rates of the dimensions of the parameters and the moment restrictions, as well as the degree of data dependence. It is shown that even in the high dimensional time series setting, the GEL ratio can still behave like a chi-square random variable asymptotically. A consistent test for the over-identification is proposed. A penalized GEL method is also provided for estimation under sparsity setting. △ Less

Submitted 27 January, 2015; v1 submitted 26 August, 2013; originally announced August 2013.

Journal ref: Journal of Econometrics 2015, Vol. 185, No. 1, 283-304

Parameter estimation and model testing for Markov processes via conditional characteristic functions

Authors: Song X. Chen, Liang Peng, Cindy L. Yu

Abstract: Markov processes are used in a wide range of disciplines, including finance. The transition densities of these processes are often unknown. However, the conditional characteristic functions are more likely to be available, especially for Lévy-driven processes. We propose an empirical likelihood approach, for both parameter estimation and model specification testing, based on the conditional charac… ▽ More Markov processes are used in a wide range of disciplines, including finance. The transition densities of these processes are often unknown. However, the conditional characteristic functions are more likely to be available, especially for Lévy-driven processes. We propose an empirical likelihood approach, for both parameter estimation and model specification testing, based on the conditional characteristic function for processes with either continuous or discontinuous sample paths. Theoretical properties of the empirical likelihood estimator for parameters and a smoothed empirical likelihood ratio test for a parametric specification of the process are provided. Simulations and empirical case studies are carried out to confirm the effectiveness of the proposed estimator and test. △ Less

Submitted 1 February, 2013; originally announced February 2013.

Comments: Published in at http://dx.doi.org/10.3150/11-BEJ400 the Bernoulli (http://isi.cbs.nl/bernoulli/) by the International Statistical Institute/Bernoulli Society (http://isi.cbs.nl/BS/bshome.htm)

Report number: IMS-BEJ-BEJ400

Journal ref: Bernoulli 2013, Vol. 19, No. 1, 228-251

ANOVA for longitudinal data with missing values

Authors: Song Xi Chen, **-Shou Zhong

Abstract: We carry out ANOVA comparisons of multiple treatments for longitudinal studies with missing values. The treatment effects are modeled semiparametrically via a partially linear regression which is flexible in quantifying the time effects of treatments. The empirical likelihood is employed to formulate model-robust nonparametric ANOVA tests for treatment effects with respect to covariates, the nonpa… ▽ More We carry out ANOVA comparisons of multiple treatments for longitudinal studies with missing values. The treatment effects are modeled semiparametrically via a partially linear regression which is flexible in quantifying the time effects of treatments. The empirical likelihood is employed to formulate model-robust nonparametric ANOVA tests for treatment effects with respect to covariates, the nonparametric time-effect functions and interactions between covariates and time. The proposed tests can be readily modified for a variety of data and model combinations, that encompasses parametric, semiparametric and nonparametric regression models; cross-sectional and longitudinal data, and with or without missing values. △ Less

Submitted 13 November, 2012; originally announced November 2012.

Comments: Published in at http://dx.doi.org/10.1214/10-AOS824 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS824

Journal ref: Annals of Statistics 2010, Vol. 38, No. 6, 3630-3659

Test for bandedness of high-dimensional covariance matrices and bandwidth estimation

Authors: Yumou Qiu, Song Xi Chen

Abstract: Motivated by the latest effort to employ banded matrices to estimate a high-dimensional covariance $Σ$, we propose a test for $Σ$ being banded with possible diverging bandwidth. The test is adaptive to the "large $p$, small $n$" situations without assuming a specific parametric distribution for the data. We also formulate a consistent estimator for the bandwidth of a banded high-dimensional covari… ▽ More Motivated by the latest effort to employ banded matrices to estimate a high-dimensional covariance $Σ$, we propose a test for $Σ$ being banded with possible diverging bandwidth. The test is adaptive to the "large $p$, small $n$" situations without assuming a specific parametric distribution for the data. We also formulate a consistent estimator for the bandwidth of a banded high-dimensional covariance matrix. The properties of the test and the bandwidth estimator are investigated by theoretical evaluations and simulation studies, as well as an empirical analysis on a protein mass spectroscopy data. △ Less

Submitted 16 August, 2012; originally announced August 2012.

Comments: Published in at http://dx.doi.org/10.1214/12-AOS1002 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS1002

Journal ref: Annals of Statistics 2012, Vol. 40, No. 3, 1285-1314

Two sample tests for high-dimensional covariance matrices

Authors: Jun Li, Song Xi Chen

Abstract: We propose two tests for the equality of covariance matrices between two high-dimensional populations. One test is on the whole variance--covariance matrices, and the other is on off-diagonal sub-matrices, which define the covariance between two nonoverlap** segments of the high-dimensional random vectors. The tests are applicable (i) when the data dimension is much larger than the sample sizes,… ▽ More We propose two tests for the equality of covariance matrices between two high-dimensional populations. One test is on the whole variance--covariance matrices, and the other is on off-diagonal sub-matrices, which define the covariance between two nonoverlap** segments of the high-dimensional random vectors. The tests are applicable (i) when the data dimension is much larger than the sample sizes, namely the "large $p$, small $n$" situations and (ii) without assuming parametric distributions for the two populations. These two aspects surpass the capability of the conventional likelihood ratio test. The proposed tests can be used to test on covariances associated with gene ontology terms. △ Less

Submitted 5 June, 2012; originally announced June 2012.

Comments: Published in at http://dx.doi.org/10.1214/12-AOS993 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS993

Journal ref: Annals of Statistics 2012, Vol. 40, No. 2, 908-940

On the approximate maximum likelihood estimation for diffusion processes

Authors: **yuan Chang, Song Xi Chen

Abstract: The transition density of a diffusion process does not admit an explicit expression in general, which prevents the full maximum likelihood estimation (MLE) based on discretely observed sample paths. Aït-Sahalia [J. Finance 54 (1999) 1361--1395; Econometrica 70 (2002) 223--262] proposed asymptotic expansions to the transition densities of diffusion processes, which lead to an approximate maximum li… ▽ More The transition density of a diffusion process does not admit an explicit expression in general, which prevents the full maximum likelihood estimation (MLE) based on discretely observed sample paths. Aït-Sahalia [J. Finance 54 (1999) 1361--1395; Econometrica 70 (2002) 223--262] proposed asymptotic expansions to the transition densities of diffusion processes, which lead to an approximate maximum likelihood estimation (AMLE) for parameters. Built on Aït-Sahalia's [Econometrica 70 (2002) 223--262; Ann. Statist. 36 (2008) 906--937] proposal and analysis on the AMLE, we establish the consistency and convergence rate of the AMLE, which reveal the roles played by the number of terms used in the asymptotic density expansions and the sampling interval between successive observations. We find conditions under which the AMLE has the same asymptotic distribution as that of the full MLE. A first order approximation to the Fisher information matrix is proposed. △ Less

Submitted 9 March, 2012; originally announced March 2012.

Comments: Published in at http://dx.doi.org/10.1214/11-AOS922 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS922

Journal ref: Annals of Statistics 2011, Vol. 39, No. 6, 2820-2851

A two-sample test for high-dimensional data with applications to gene-set testing

Authors: Song Xi Chen, Ying-Li Qin

Abstract: We propose a two-sample test for the means of high-dimensional data when the data dimension is much larger than the sample size. Hotelling's classical $T^2$ test does not work for this "large $p$, small $n$" situation. The proposed test does not require explicit conditions in the relationship between the data dimension and sample size. This offers much flexibility in analyzing high-dimensional d… ▽ More We propose a two-sample test for the means of high-dimensional data when the data dimension is much larger than the sample size. Hotelling's classical $T^2$ test does not work for this "large $p$, small $n$" situation. The proposed test does not require explicit conditions in the relationship between the data dimension and sample size. This offers much flexibility in analyzing high-dimensional data. An application of the proposed test is in testing significance for sets of genes which we demonstrate in an empirical study on a leukemia data set. △ Less

Submitted 24 February, 2010; originally announced February 2010.

Comments: Published in at http://dx.doi.org/10.1214/09-AOS716 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS716 MSC Class: 62H15; 60K35 (Primary) 62G10 (Secondary)

Journal ref: Annals of Statistics 2010, Vol. 38, No. 2, 808-835

A goodness-of-fit test for parametric and semi-parametric models in multiresponse regression

Authors: Song Xi Chen, Ingrid Van Keilegom

Abstract: We propose an empirical likelihood test that is able to test the goodness of fit of a class of parametric and semi-parametric multiresponse regression models. The class includes as special cases fully parametric models; semi-parametric models, like the multiindex and the partially linear models; and models with shape constraints. Another feature of the test is that it allows both the response va… ▽ More We propose an empirical likelihood test that is able to test the goodness of fit of a class of parametric and semi-parametric multiresponse regression models. The class includes as special cases fully parametric models; semi-parametric models, like the multiindex and the partially linear models; and models with shape constraints. Another feature of the test is that it allows both the response variable and the covariate be multivariate, which means that multiple regression curves can be tested simultaneously. The test also allows the presence of infinite-dimensional nuisance functions in the model to be tested. It is shown that the empirical likelihood test statistic is asymptotically normally distributed under certain mild conditions and permits a wild bootstrap calibration. Despite the large size of the class of models to be considered, the empirical likelihood test enjoys good power properties against departures from a hypothesized model within the class. △ Less

Submitted 11 January, 2010; originally announced January 2010.

Comments: Published in at http://dx.doi.org/10.3150/09-BEJ208 the Bernoulli (http://isi.cbs.nl/bernoulli/) by the International Statistical Institute/Bernoulli Society (http://isi.cbs.nl/BS/bshome.htm)

Report number: IMS-BEJ-BEJ208

Journal ref: Bernoulli 2009, Vol. 15, No. 4, 955-976

Empirical likelihood for estimating equations with missing values

Authors: Dong Wang, Song Xi Chen

Abstract: We consider an empirical likelihood inference for parameters defined by general estimating equations when some components of the random observations are subject to missingness. As the nature of the estimating equations is wide-ranging, we propose a nonparametric imputation of the missing values from a kernel estimator of the conditional distribution of the missing variable given the always obser… ▽ More We consider an empirical likelihood inference for parameters defined by general estimating equations when some components of the random observations are subject to missingness. As the nature of the estimating equations is wide-ranging, we propose a nonparametric imputation of the missing values from a kernel estimator of the conditional distribution of the missing variable given the always observable variable. The empirical likelihood is used to construct a profile likelihood for the parameter of interest. We demonstrate that the proposed nonparametric imputation can remove the selection bias in the missingness and the empirical likelihood leads to more efficient parameter estimation. The proposed method is further evaluated by simulation and an empirical study on a genetic dataset on recombinant inbred mice. △ Less

Submitted 4 March, 2009; originally announced March 2009.

Comments: Published in at http://dx.doi.org/10.1214/07-AOS585 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS585 MSC Class: 62G05 (Primary) 62G20 (Secondary)

Journal ref: Annals of Statistics 2009, Vol. 37, No. 1, 490-517

A test for model specification of diffusion processes

Authors: Song Xi Chen, Jiti Gao, Cheng Yong Tang

Abstract: We propose a test for model specification of a parametric diffusion process based on a kernel estimation of the transitional density of the process. The empirical likelihood is used to formulate a statistic, for each kernel smoothing bandwidth, which is effectively a Studentized $L_2$-distance between the kernel transitional density estimator and the parametric transitional density implied by th… ▽ More We propose a test for model specification of a parametric diffusion process based on a kernel estimation of the transitional density of the process. The empirical likelihood is used to formulate a statistic, for each kernel smoothing bandwidth, which is effectively a Studentized $L_2$-distance between the kernel transitional density estimator and the parametric transitional density implied by the parametric process. To reduce the sensitivity of the test on smoothing bandwidth choice, the final test statistic is constructed by combining the empirical likelihood statistics over a set of smoothing bandwidths. To better capture the finite sample distribution of the test statistic and data dependence, the critical value of the test is obtained by a parametric bootstrap procedure. Properties of the test are evaluated asymptotically and numerically by simulation and by a real data example. △ Less

Submitted 12 March, 2008; v1 submitted 6 February, 2007; originally announced February 2007.

Comments: Published in at http://dx.doi.org/10.1214/009053607000000659 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS0288 MSC Class: 62G05 (Primary); 62J02 (Secondary)

Journal ref: Annals of Statistics 2008, Vol. 36, No. 1, 167-198