Distillation

Distillation: Training a smaller model to reproduce the outputs of a larger one, transferring much of its capability into a cheaper, faster form.

Browse the full glossary →