Learning using Large Datasets

The statistical learning theory suggests to choose large capacity models that barely avoid over-fitting the training data.

source