Glossary
Retrospective Validation
Also called: retrospective study
Evaluating a model on previously collected data, which is faster and cheaper than prospective study and systematically more optimistic.
Retrospective validation runs a model over archived cases with known outcomes. It is how the majority of medical AI evidence, including most regulatory submissions, is generated.
Where This Gets Misread
Archived datasets are curated: poor-quality studies get excluded, case mix gets enriched toward interesting findings, and the messy real-world inputs that break models in production are exactly what was filtered out. Optimism here is structural, not a matter of researcher bias.