Glossary
Benchmark contamination
Quick answer
When test examples leak into a model's training data, inflating its scores.
It is a common problem as public benchmarks spread online.
Private, never-published business data is valuable for evaluation partly because it is less likely to be contaminated.
Why Benchmark contamination matters when licensing company data to AI
Benchmark contamination occurs when test examples leak into a model's training data, inflating its scores. It is a common problem as public benchmarks spread online. Private, never-published business data is valuable for evaluation partly because it is less likely to be contaminated, which is one reason buyers ask whether records have ever been public.
- 01Your work records
- 02Personal details removed
- 03You approve the release
- 04Licensed to AI developers
Related terms
Related resources
- SolutionWhat is AI evaluation data?
- SolutionHow AI developers source data
- IndustryBPO & contact centers data
- IndustryRecruiting & staffing data
- DataInternal knowledge bases
- QuestionShould companies sell or license their data?
- QuestionCan CRM data be licensed?
- InsightCan you license spreadsheets and financial models to AI companies?
- InsightCan you license training materials and course content to AI companies?
- InsightCan I limit licensing to evaluation only?
- DataWorkflow data
- GlossaryDataset
See if your company qualifies
A short company assessment. No data uploads are needed.