Cross validation
Suppose we are training a model on some training data
. If we partition into folds for . Then cross validation is the practice of training the model on all but one fold then assessing it on using our objective function. The practice usually involves doing this for all possible folds and picking the model with least error.