AdamW
AIAdamW: A variant of Adam that applies weight decay separately from the gradient update, giving cleaner regularisation and better generalisation for large models.
AdamW: A variant of Adam that applies weight decay separately from the gradient update, giving cleaner regularisation and better generalisation for large models.