What is Masked language modelling (MLM)?

Masked language modelling (MLM)

Masked language modelling (MLM): A self-supervised task where random words are hidden and the model learns to predict them from the surrounding context.

Related terms

Contrastive Language-Image Pre-training (CLIP)
Holistic Evaluation of Language Models (HELM)
Large language model (LLM)
Massive Multitask Language Understanding (MMLU)
Program-aided language model (PAL)
Small language model (SLM)
Speech synthesis markup language (SSML)
Topic modelling

Browse the full glossary →