Optimization Algorithms for Deep-NNs

This repository contains Pytorch optim wrapper code to implement Optimization algorithms like

• Stochastic Mirror Descent
• Proximal Stochastic Mirror Descent
• Nesterov Accelerated Stochastic Mirror Descent

for optimizing deep neural networks under various types of regularization