Sharp-SSL: selective high-dimensional axis-aligned random projections for semi-supervised learning

Wang, Tengyao ORCID: 0000-0003-2072-6645, Dobriban, Edgar, Gataric, Milana and Samworth, Richard J. (2024) Sharp-SSL: selective high-dimensional axis-aligned random projections for semi-supervised learning. Journal of the American Statistical Association. ISSN 0162-1459

Text (Sharp-SSL Selective High-Dimensional Axis-Aligned Random Projections for Semi-Supervised Learning) - Published Version Available under License Creative Commons Attribution. Download (2MB)

• Scopus publication
• Author

Abstract

We propose a new method for high-dimensional semi-supervised learning problems based on the careful aggregation of the results of a low-dimensional procedure applied to many axis-aligned random projections of the data. Our primary goal is to identify important variables for distinguishing between the classes; existing low-dimensional methods can then be applied for final class assignment. To this end, we score projections according to their class-distinguishing ability; for instance, motivated by a generalized Rayleigh quotient, we can compute the traces of estimated whitened between-class covariance matrices on the projected data. This enables us to assign an importance weight to each variable for a given projection, and to select our signal variables by aggregating these weights over high-scoring projections. Our theory shows that the resulting Sharp-SSL algorithm is able to recover the signal coordinates with high probability when we aggregate over sufficiently many random projections and when the base procedure estimates the diagonal entries of the whitened between-class covariance matrix sufficiently well. For the Gaussian EM base procedure, we provide a new analysis of its performance in semi-supervised settings that controls the parameter estimation error in terms of the proportion of labeled data in the sample. Numerical results on both simulated data and a real colon tumor dataset support the excellent empirical performance of the method. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.

Item Type:	Article
Official URL:	https://www.tandfonline.com/journals/uasa20
Additional Information:	© 2024 The Authors
Divisions:	Statistics
Subjects:	H Social Sciences > HA Statistics
Date Deposited:	08 Apr 2024 11:15
Last Modified:	13 Nov 2024 23:57
URI:	http://eprints.lse.ac.uk/id/eprint/122552

Actions (login required)

View Item