Glossary
Pretraining
Quick answer
The first, large-scale stage of training a language model on broad text to learn general patterns.
It uses vast amounts of data and compute.
Specialized business data is more often used in later stages, such as fine-tuning and evaluation.
Why Pretraining matters when licensing company data to AI
Pretraining is the first, large-scale stage of training a language model on broad text to learn general patterns. It uses very large amounts of data and computing power. Specialized business data is more often used in later stages, such as fine-tuning and evaluation, so licensed business records are usually relevant to those later stages.
- 01Your work records
- 02Personal details removed
- 03You approve the release
- 04Licensed to AI developers
Related terms
Related resources
- QuestionShould companies sell or license their data?
- QuestionDo AI labs buy spreadsheets?
- SolutionWhat is AI evaluation data?
- SolutionHow AI developers source data
- IndustryBPO & contact centers data
- IndustryRecruiting & staffing data
- DataInternal knowledge bases
- GlossaryRevenue share
- InsightCan fitness and wellness businesses sell their data to AI companies?
- InsightCan you license spreadsheets and financial models to AI companies?
- InsightCan you license training materials and course content to AI companies?
- DataWorkflow data
See if your company qualifies
A short company assessment. No data uploads are needed.