Mid-training

Mid-training: An intermediate stage that continues pretraining on a smaller, higher-quality or domain-specific corpus before post-training begins.

Browse the full glossary →