Momentum
AIMomentum: An optimisation technique that accumulates a moving average of past gradients, helping updates keep direction and move faster through shallow regions.
Momentum: An optimisation technique that accumulates a moving average of past gradients, helping updates keep direction and move faster through shallow regions.