Glossary
Tokens
Quick answer
The small chunks of text, often word pieces, that language models read and produce.
In English, a token averages roughly four characters.
Dataset size is often described in tokens, and some deals price by token count.
Why Tokens matters when licensing company data to AI
Tokens are the small chunks of text, often word pieces, that language models read and produce. In English, a token averages roughly four characters. Dataset size is often described in tokens, and some deals price by token count, so the counting method should be stated in the deal.
- 01Your work records
- 02Personal details removed
- 03You approve the release
- 04Licensed to AI developers
Related terms
Related resources
- SolutionWhat is AI evaluation data?
- SolutionHow AI developers source data
- IndustryBPO & contact centers data
- IndustryRecruiting & staffing data
- DataInternal knowledge bases
- QuestionShould companies sell or license their data?
- QuestionCan CRM data be licensed?
- InsightCan you license spreadsheets and financial models to AI companies?
- InsightCan you license training materials and course content to AI companies?
- InsightCan I limit licensing to evaluation only?
- DataWorkflow data
- GlossaryDataset
See if your company qualifies
A short company assessment. No data uploads are needed.