Benchmark contamination limits gains in fine-tuned clinical language model
Overlap with training data inflated scores on several medical QA benchmarks, while held-out MedXpertQA showed only a modest true gain.
By Dr. A. Nikhil Krishnan, MBBS
·
Nov 3, 2026
·
5 min read