Yogi | Optimizer

Developed by researchers at Google and Stanford, Yogi modifies Adam's adaptive learning rate mechanism to make it more robust to noisy gradients.

Yogi, introduced by Zaheer et al. (in a paper titled "Adaptive Methods for Nonconvex Optimization" ), proposes a simple yet profound change to the update rule of the second moment. yogi optimizer