Add support for NeMo scope Optimizers support and add Novograd Optimizer#793

Merged

okuchaiev merged 15 commits intoNVIDIA:candidatefrom titu1994:candidate_optimizer_refactor

Jul 2, 2020

+417-20

Commits on Jul 1, 2020