What is Model FLOPs utilisation (MFU)?

Model FLOPs utilisation (MFU)

Model FLOPs utilisation (MFU): The fraction of a cluster's theoretical peak arithmetic a training run actually achieves, a headline measure of engineering quality.

Related terms

Autoregressive model
Cascade (model cascade)
Consistency model
Denoising diffusion implicit model (DDIM)
Denoising diffusion probabilistic model (DDPM)
Diffusion model
Distillation of a frontier model
Draft model

Browse the full glossary →