Fast Cross-Validation via Sequential Testing
The package CVST is hosted on CRAN, so
install.packages("CVST") library(CVST) example(CVST)
will give you a first impression.