rmsprop optimizer , на сайте с June 16, 2023 21:35
Optimizer that implements the RMSprop algorithm. The gist of RMSprop is to: Maintain a moving (discounted) average of the square of gradients. Divide the gradient by the root of this average. This implementation of RMSprop uses plain momentum, not Nesterov momentum.