Sharan Vaswani

Publications

Stochastic polyak step-size for sgd: An adaptive learning rate for fast convergence. Nicolas Loizou, Sharan Vaswani, Issam H. Laradji, Simon Lacoste-Julien. At International Conference on Artificial Intelligence and Statistics (AISTATS), 2021.

PDF Cite Code Video

Fast and Furious Convergence: Stochastic Second Order Methods under Interpolation. Si Yi Meng, Sharan Vaswani, Issam H. Laradji, Mark Schmidt, Simon Lacoste-Julien. At International Conference on Artificial Intelligence and Statistics (AISTATS), 2020.

PDF Cite Code Slides Video

Painless Stochastic Gradient: Interpolation, Line-Search, and Convergence Rates. Sharan Vaswani, Aaron Mishkin, Issam H. Laradji, Mark Schmidt, Gauthier Gidel, Simon Lacoste-Julien. At Conference on Neural Information Processing Systems (NeurIPS), 2019.