A splicing algorithm for best subset selection in sliced inverse regression

Tang, Bo Rui, Zhu, Jin ORCID: 0000-0001-8550-5822, Wang, Ting Yin and Zhu, Junxian (2025) A splicing algorithm for best subset selection in sliced inverse regression. Journal of University of Science and Technology of China, 55 (5). ISSN 0253-2778

Text (JUSTC-2024-0034) - Published Version Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (2MB)

• Scopus publication

Abstract

In this paper, we examine the problem of sliced inverse regression (SIR), a widely used method for sufficient dimension reduction (SDR). It was designed to find reduced-dimensional versions of multivariate predictors by replacing them with a minimally adequate collection of their linear combinations without loss of information. Recently, regularization methods have been proposed in SIR to incorporate a sparse structure of predictors for better interpretability. However, existing methods consider convex relaxation to bypass the sparsity constraint, which may not lead to the best subset, and particularly tends to include irrelevant variables when predictors are correlated. In this paper, we approach sparse SIR as a nonconvex optimization problem and directly tackle the sparsity constraint by establishing the optimal conditions and iteratively solving them via the splicing technique. Without employing convex relaxation on the sparsity constraint and the orthogonal constraint, our algorithm exhibits superior empirical merits, as evidenced by extensive numerical studies. Computationally, our algorithm is much faster than the relaxed approach for the natural sparse SIR estimator. Statistically, our algorithm surpasses existing methods in terms of accuracy for central subspace estimation and best subset selection and sustains high performance even with correlated predictors.

Item Type:	Article
Additional Information:	© 2025 The Author(s)
Divisions:	Statistics
Subjects:	H Social Sciences > HA Statistics Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Date Deposited:	07 Oct 2025 11:00
Last Modified:	07 Oct 2025 16:03
URI:	http://eprints.lse.ac.uk/id/eprint/129705

Actions (login required)

View Item