A random forest guided tour

Abstract : The random forest algorithm, proposed by L. Breiman in 2001, has been extremely successful as a general-purpose classification and regression method. The approach, which combines several randomized decision trees and aggregates their predictions by averaging, has shown excellent performance in settings where the number of variables is much larger than the number of observations. Moreover, it is versatile enough to be applied to large-scale problems, is easily adapted to various ad hoc learning tasks, and returns measures of variable importance. The present article reviews the most recent theoretical and methodological developments for random forests. Emphasis is placed on the mathematical forces driving the algorithm, with special attention given to the selection of parameters, the resampling mechanism, and variable importance measures. This review is intended to provide non-experts easy access to the main ideas.
Document type :
Journal articles
Complete list of metadatas

https://hal.sorbonne-universite.fr/hal-01307105
Contributor : Gestionnaire Hal-Upmc <>
Submitted on : Tuesday, April 26, 2016 - 11:40:33 AM
Last modification on : Friday, May 24, 2019 - 5:23:09 PM

Links full text

Identifiers

Citation

Gérard Biau, Erwan Scornet. A random forest guided tour. Test, Spanish Society of Statistics and Operations Research/Springer, 2016, pp.1-31. ⟨10.1007/s11749-016-0481-7⟩. ⟨hal-01307105⟩

Share

Metrics

Record views

186