DeepSpeed

DeepSpeed: Microsoft's training library, best known for the ZeRO optimiser states sharding that made very large models trainable.

Browse the full glossary →