Concept
Nesterov momentum
Nesterov momentum (also called Nesterov Accelerated Gradient) is a variant of classical momentum that computes the gradient at a lookahead position rather than the current one.
The rest of “Nesterov momentum” is a premium feature: every concept in the library gets a precise, practitioner-focused write-up like this one, cross-linked straight from the paper summaries that use it.
Log in to unlock→