Random rotation ensembles

Blaser, Rico and Fryzlewicz, Piotr ORCID: 0000-0002-9676-902X (2016) Random rotation ensembles. Journal of Machine Learning Research, 17 (4). pp. 1-26. ISSN 1532-4435

Preview

PDF - Accepted Version Download (1MB) | Preview

• Publisher

Abstract

In machine learning, ensemble methods combine the predictions of multiple base learners to construct more accurate aggregate predictions. Established supervised learning algorithms inject randomness into the construction of the individual base learners in an effort to promote diversity within the resulting ensembles. An undesirable side effect of this approach is that it generally also reduces the accuracy of the base learners. In this paper, we introduce a method that is simple to implement yet general and effective in improving ensemble diversity with only modest impact on the accuracy of the individual base learners. By randomly rotating the feature space prior to inducing the base learners, we achieve favorable aggregate predictions on standard data sets compared to state of the art ensemble methods, most notably for tree-based ensembles, which are particularly sensitive to rotation.

Item Type:	Article
Official URL:	http://www.jmlr.org/
Additional Information:	© 2016 Rico Blaser and Piotr Fryzlewicz.
Divisions:	Statistics
Subjects:	H Social Sciences > HA Statistics
Date Deposited:	04 Jun 2015 13:47
Last Modified:	31 Oct 2024 08:48
URI:	http://eprints.lse.ac.uk/id/eprint/62182

Actions (login required)

View Item