Convergence guarantees for RMSProp and ADAM in non-convex optimization and their comparison to Nesterov acceleration on autoencoders.
Research article (arXiv (Cornell University), 2018) · cited 32× · AI/ML