American Economic Review
ISSN 0002-8282 (Print) | ISSN 1944-7981 (Online)
On the Use of Holdout Samples for Model Selection
American Economic Review
vol. 102,
no. 3, May 2012
(pp. 477–81)
Abstract
Researchers often hold out data from the estimation of econometric models to use for external validation. However, the use of holdout samples is suboptimal from a Bayesian perspective, which prescribes using the entire sample to form posterior model weights. This paper examines a possible rationale for the use of holdout samples: data-inspired modifications of structural models are likely to lead to an exaggeration of model fit. The use of holdout samples can, in principle, set an incentive for the modeler not to exaggerate model fit.Citation
Schorfheide, Frank, and Kenneth I. Wolpin. 2012. "On the Use of Holdout Samples for Model Selection." American Economic Review, 102 (3): 477–81. DOI: 10.1257/aer.102.3.477JEL Classification
- C52 Model Evaluation, Validation, and Selection