Code

Hydra Configs#816

Code

Merged

ericharper merged 44 commits intocandidateNVIDIA/NeMo:candidatefrom dev-hydraNVIDIA/NeMo:dev-hydraCopy head branch name to clipboardJul 9, 2020

+1,050-234

Commits

Commits on Jul 9, 2020

• Hydra + config objects - some test examples

  Show description for 6728bd7
  

  tkornuta-nvidia

  authored and

  ericharper

  committed
  6728bd7

  Copy full SHA for 6728bd7

• example with overriding params in the code

  Show description for 6e29cf4
  

  tkornuta-nvidia

  authored and

  ericharper

  committed
  6e29cf4

  Copy full SHA for 6e29cf4

• experiments with Jasper block initialization

  Show description for 7988e19
  

  tkornuta-nvidia

  authored and

  ericharper

  committed
  7988e19

  Copy full SHA for 7988e19

• CV collection - init

  Show description for ed9f13e
  

  tkornuta-nvidia

  authored and

  ericharper

  committed
  ed9f13e

  Copy full SHA for ed9f13e

• MNIST LeNet-5 training working in pure PyTorch

  Show description for 6aeaca4
  

  tkornuta-nvidia

  authored and

  ericharper

  committed
  6aeaca4

  Copy full SHA for 6aeaca4

• 3 use-cases operational: pure pytorch, mixed pytorch, pure_lightning

  Show description for bdc1e5e
  

  tkornuta-nvidia

  authored and

  ericharper

  committed
  bdc1e5e

  Copy full SHA for bdc1e5e

• First example refactored using the NeMo Structured Configuration. BAM

  Show description for 9b5b1d9
  

  tkornuta-nvidia

  authored and

  ericharper

  committed
  9b5b1d9

  Copy full SHA for 9b5b1d9

• Refactored configs, renamed NeMoConfig->Config, added Adam config

  Show description for 344330f
  

  tkornuta-nvidia

  authored and

  ericharper

  committed
  344330f

  Copy full SHA for 344330f

• mixed lenet-5 working with automatic instantiation of optimizer based on config. BAM BAM

  Show description for 15c077e
  

  tkornuta-nvidia

  authored and

  ericharper

  committed
  15c077e

  Copy full SHA for 15c077e

• Refactored pur PTL training. BAM BAM BAM

  Show description for 8f813eb
  

  tkornuta-nvidia

  authored and

  ericharper

  committed
  8f813eb

  Copy full SHA for 8f813eb

• Refactor - names of Optimizer Params and Config

  Show description for 34929ad
  

  tkornuta-nvidia

  authored and

  ericharper

  committed
  34929ad

  Copy full SHA for 34929ad

• style fix

  Show description for 57186c1
  

  tkornuta-nvidia

  authored and

  ericharper

  committed
  57186c1

  Copy full SHA for 57186c1

• cleanups of the config logging

  Show description for 717bb84
  

  tkornuta-nvidia

  authored and

  ericharper

  committed
  717bb84

  Copy full SHA for 717bb84

• cleanups, removed examples

  Show description for c955f6b
  

  tkornuta-nvidia

  authored and

  ericharper

  committed
  c955f6b

  Copy full SHA for c955f6b

• cleanups, removed examples

  Show description for 702ea0e
  

  tkornuta-nvidia

  authored and

  ericharper

  committed
  702ea0e

  Copy full SHA for 702ea0e

• LeNet5 module - added dummy config

  Show description for 6bc6952
  

  tkornuta-nvidia

  authored and

  ericharper

  committed
  6bc6952

  Copy full SHA for 6bc6952

• formatting

  Show description for 88ee61f
  

  tkornuta-nvidia

  authored and

  ericharper

  committed
  88ee61f

  Copy full SHA for 88ee61f

• multi-gpu working with hydra, very rough draft

  Show description for fb45f4c
  ericharper

  committed
  fb45f4c

  Copy full SHA for fb45f4c

• bug with instantiating Jasper because of ListConfig

  Show description for 7217e62
  ericharper

  committed
  7217e62

  Copy full SHA for 7217e62

• bug with instantiating Jasper because of ListConfig

  Show description for f286fc1
  ericharper

  committed
  f286fc1

  Copy full SHA for f286fc1

• bug with instantiating Jasper because of ListConfig

  Show description for c33c7dc
  ericharper

  committed
  c33c7dc

  Copy full SHA for c33c7dc

• hack for jasper listconfig

  Show description for fb1bb2f
  ericharper

  committed
  fb1bb2f

  Copy full SHA for fb1bb2f

• instantiate optimizer and schduler with hydra

  Show description for f09b18a
  ericharper

  committed
  f09b18a

  Copy full SHA for f09b18a

• small cleanup

  Show description for 8361864
  ericharper

  committed
  8361864

  Copy full SHA for 8361864

• style fix + broken lr_scheduler

  Show description for 3b84edc
  ericharper

  committed
  3b84edc

  Copy full SHA for 3b84edc

• commented lr_scheduler out

  Show description for c2c865d
  ericharper

  committed
  c2c865d

  Copy full SHA for c2c865d

• style fix

  Show description for 7803f74
  ericharper

  committed
  7803f74

  Copy full SHA for 7803f74

• test.* removed

  Show description for 6f55f2b
  

  tkornuta-nvidia

  authored and

  ericharper

  committed
  6f55f2b

  Copy full SHA for 6f55f2b

• reverting to changes to setup_optimization to play nice with candidate

  Show description for 283b443
  ericharper

  committed
  283b443

  Copy full SHA for 283b443

• style fix

  Show description for 590a606
  ericharper

  committed
  590a606

  Copy full SHA for 590a606

• reverting to changes to setup_optimization to play nice with candidate

  Show description for 26c68fb
  ericharper

  committed
  26c68fb

  Copy full SHA for 26c68fb

• clean print statements

  Show description for 772fc50
  ericharper

  committed
  772fc50

  Copy full SHA for 772fc50

• added basic usage

  Show description for ee04d16
  ericharper

  committed
  ee04d16

  Copy full SHA for ee04d16

• removed star imports

  Show description for eea7cea
  ericharper

  committed
  eea7cea

  Copy full SHA for eea7cea

• removed log statement

  Show description for 4306854
  ericharper

  committed
  4306854

  Copy full SHA for 4306854

• updated docstrings

  Show description for bc226b8
  ericharper

  committed
  bc226b8

  Copy full SHA for bc226b8

• removed star import

  Show description for 3171c79
  ericharper

  committed
  3171c79

  Copy full SHA for 3171c79

• removed dummy docstrings

  Show description for 605f33b
  ericharper

  committed
  605f33b

  Copy full SHA for 605f33b

• removed star import, __all__

  Show description for 7598aca
  ericharper

  committed
  7598aca

  Copy full SHA for 7598aca

• removed star import, __all__

  Show description for 61eb5e1
  ericharper

  committed
  61eb5e1

  Copy full SHA for 61eb5e1

• removed star import

  Show description for b57ec10
  ericharper

  committed
  b57ec10

  Copy full SHA for b57ec10

• changed print to logging

  Show description for 99be72b
  ericharper

  committed
  99be72b

  Copy full SHA for 99be72b

• removed imports

  Show description for a5df77f
  ericharper

  committed
  a5df77f

  Copy full SHA for a5df77f

• style fix

  Show description for 0b3c961
  ericharper

  committed
  0b3c961

  Copy full SHA for 0b3c961