Glossary

Retrospective Validation

Also called: retrospective study

Evaluating a model on previously collected data, which is faster and cheaper than prospective study and systematically more optimistic.

Retrospective validation runs a model over archived cases with known outcomes. It is how the majority of medical AI evidence, including most regulatory submissions, is generated.

Where This Gets Misread

Archived datasets are curated: poor-quality studies get excluded, case mix gets enriched toward interesting findings, and the messy real-world inputs that break models in production are exactly what was filtered out. Optimism here is structural, not a matter of researcher bias.