Statistical inference for high-dimensional models via recursive online-score estimation

Shi, Chengchun ORCID: 0000-0001-7773-2099, Song, Rui, Lu, Wenbin and Li, Runzi (2020) Statistical inference for high-dimensional models via recursive online-score estimation. Journal of the American Statistical Association. ISSN 0162-1459

Text (Statistical inference for high-dimensional models via recursive online-score estimation) - Accepted Version Download (691kB)

• Author

Abstract

In this article, we develop a new estimation and valid inference method for single or low-dimensional regression coefficients in high-dimensional generalized linear models. The number of the predictors is allowed to grow exponentially fast with respect to the sample size. The proposed estimator is computed by solving a score function. We recursively conduct model selection to reduce the dimensionality from high to a moderate scale and construct the score equation based on the selected variables. The proposed confidence interval (CI) achieves valid coverage without assuming consistency of the model selection procedure. When the selection consistency is achieved, we show the length of the proposed CI is asymptotically the same as the CI of the “oracle” method which works as well as if the support of the control variables were known. In addition, we prove the proposed CI is asymptotically narrower than the CIs constructed based on the desparsified Lasso estimator and the decorrelated score statistic. Simulation studies and real data applications are presented to back up our theoretical findings. Supplementary materials for this article are available online.

Item Type:	Article
Official URL:	https://www.tandfonline.com/toc/uasa20/current
Additional Information:	© 2020 American Statistical Association
Divisions:	Statistics
Subjects:	H Social Sciences > HA Statistics
Date Deposited:	13 Jan 2020 11:21
Last Modified:	15 Nov 2024 20:09
URI:	http://eprints.lse.ac.uk/id/eprint/103043

Actions (login required)

View Item