# Pre-training

URL: https://aidataforsale.com/glossary/pre-training
Publisher: AI Data For Sale (Marketing Signals Ltd)
Updated: 2026-11-10

The first stage of training a foundation model on very large, broad datasets to learn general knowledge and language.

Pre-training data is measured in trillions of tokens. Most licensed private data is used in later stages, where smaller, specialist sets have more effect.