Nonlinear regression estimation using subset-based kernel principal components

Ke, Yuan, Li, Degui and Yao, Qiwei ORCID: 0000-0003-2065-8486 (2018) Nonlinear regression estimation using subset-based kernel principal components. Statistica Sinica, 28 (4). pp. 2771-2794. ISSN 1017-0405

Text - Accepted Version Download (595kB)

• Author

Abstract

We study the estimation of conditional mean regression functions through the so-called subset-based kernel principal component analysis (KPCA). Instead of using one global kernel feature space, we project a target function into different localized kernel feature spaces at different parts of the sample space. Each localized kernel feature space reflects the relationship on a subset between the response and covariates more parsimoniously. When the observations are collected from a strictly stationary and weakly dependent process, the orthonormal eigenfunctions which span the kernel feature space are consistently estimated by implementing an eigenanalysis on the subset-based kernel Gram matrix, and the estimated eigenfunctions are then used to construct the estimation of the mean regression function. Under some regularity conditions, the developed estimator is shown to be uniformly consistent over the subset with a convergence rate faster than those of some well-known nonparametric estimation methods. In addition, we also discuss some generalizations of the KPCA approach, and consider using the same subset-based KPCA approach to estimate the conditional distribution function. The numerical studies including three simulated examples and two real data sets illustrate the reliable performance of the proposed method. In particular, the improvement over the global KPCA method is evident.

Item Type:	Article
Official URL:	http://www3.stat.sinica.edu.tw/statistica/
Additional Information:	© 2018 Institute of Statistical Science
Divisions:	Statistics
Subjects:	Q Science > QA Mathematics
Date Deposited:	30 Nov 2018 12:22
Last Modified:	01 Oct 2024 03:28
Projects:	EP/L01226X/1
Funders:	Engineering and Physical Sciences Research Council
URI:	http://eprints.lse.ac.uk/id/eprint/90945

Actions (login required)

View Item