YFarmX

Weight decay

AI

Weight decay: A regularisation method that shrinks weights slightly on every update, keeping them small and improving the model's ability to generalise.

Related terms

Browse the full glossary →