Adam

Adam: A widely used optimiser that adapts each weight's step size using running averages of recent gradients and their squared values.

Browse the full glossary →