Code

Add 1-bit Adam support to DeepSpeed#380

Code

Merged

jeffra merged 36 commits intomastermicrosoft/DeepSpeed:masterfrom staging-1bit-adam-v2microsoft/DeepSpeed:staging-1bit-adam-v2Copy head branch name to clipboardSep 9, 2020

+1,362-66

Commits

Commits on Sep 8, 2020

• 1-bit adam (#353)

  Show description for fa66867
  

  6 peopleauthored
  fa66867

  Copy full SHA for fa66867

• updated launcher to support pdsh and openmpi (#375)

  Show description for 45619af
  jeffra

  authored
  45619af

  Copy full SHA for 45619af

• revert timer and update args

  jeffra

  committed
  6ae0437

  Copy full SHA for 6ae0437

• add mvapich to launcher

  jeffra

  committed
  036a96c

  Copy full SHA for 036a96c

• update parse args

  jeffra

  committed
  dce677e

  Copy full SHA for dce677e

• convert ordered dict to list before indexing

  jeffra

  committed
  4fa6e05

  Copy full SHA for 4fa6e05

• cleanup

  jeffra

  committed
  2fdb79d

  Copy full SHA for 2fdb79d

• update default launcher envs to include mpi vars

  jeffra

  committed
  1d6d5f5

  Copy full SHA for 1d6d5f5

• Merge branch 'master' into staging-1bit-adam-v2

  jeffra

  authored
  b3894e8

  Copy full SHA for b3894e8

Commits on Sep 9, 2020

• address comments on launcher

  jeffra

  committed
  65564e5

  Copy full SHA for 65564e5

• Merge branch 'staging-1bit-adam-v2' of github.com:microsoft/DeepSpeed into staging-1bit-adam-v2

  jeffra

  committed
  402dccd

  Copy full SHA for 402dccd

• Add a new test.

  awan-10

  committed
  0bab578

  Copy full SHA for 0bab578

• Merge branch 'staging-1bit-adam-v2' of github.com:microsoft/DeepSpeed into staging-1bit-adam-v2

  awan-10

  committed
  f358e6a

  Copy full SHA for f358e6a

• Crucial fix in testing code.

  awan-10

  committed
  cae1acc

  Copy full SHA for cae1acc

• Fix formatting.

  awan-10

  committed
  efe71b4

  Copy full SHA for efe71b4

• Merge branch 'staging-1bit-adam-v2' of github.com:microsoft/DeepSpeed into staging-1bit-adam-v2

  awan-10

  committed
  1a124c4

  Copy full SHA for 1a124c4

• Fix formatting.

  awan-10

  committed
  5ecdcf0

  Copy full SHA for 5ecdcf0

• Seperate host and cuda tests for ease of use.

  awan-10

  committed
  847447b

  Copy full SHA for 847447b

• Merge branch 'master' into staging-1bit-adam-v2

  jeffra

  authored
  cdc1818

  Copy full SHA for cdc1818

• update copyright

  jeffra

  committed
  03e99db

  Copy full SHA for 03e99db

• Merge branch 'staging-1bit-adam-v2' of github.com:microsoft/DeepSpeed into staging-1bit-adam-v2

  jeffra

  committed
  769d9b5

  Copy full SHA for 769d9b5

• Significantly enhance the tutorial for 1-bit Adam.

  awan-10

  committed
  ba787c2

  Copy full SHA for ba787c2

• Merge branch 'staging-1bit-adam-v2' of github.com:microsoft/DeepSpeed into staging-1bit-adam-v2

  awan-10

  committed
  9cb5134

  Copy full SHA for 9cb5134

• Fix typo.Fix typo.

  awan-10

  committed
  f623517

  Copy full SHA for f623517

• install openmpi in conda

  jeffra

  committed
  eb47cdf

  Copy full SHA for eb47cdf

• Merge branch 'staging-1bit-adam-v2' of github.com:microsoft/DeepSpeed into staging-1bit-adam-v2

  jeffra

  committed
  0ac97ea

  Copy full SHA for 0ac97ea

• Update azure-pipelines.yml

  jeffra

  authored
  2b9d9c8

  Copy full SHA for 2b9d9c8

• update basic install test

  jeffra

  committed
  5e33b08

  Copy full SHA for 5e33b08

• small update to getting started docs

  jeffra

  committed
  8adb63d

  Copy full SHA for 8adb63d

• Merge branch 'staging-1bit-adam-v2' of github.com:microsoft/DeepSpeed into staging-1bit-adam-v2

  jeffra

  committed
  a76d2a2

  Copy full SHA for a76d2a2

• formatting

  jeffra

  committed
  6693159

  Copy full SHA for 6693159

• output env

  jeffra

  committed
  e944d22

  Copy full SHA for e944d22

• Fix initializer.

  awan-10

  committed
  ded0475

  Copy full SHA for ded0475

• Update setup.py

  jeffra

  authored
  07fe582

  Copy full SHA for 07fe582

• Update azure-pipelines.yml

  jeffra

  authored
  15d2abe

  Copy full SHA for 15d2abe

• Merge branch 'master' into staging-1bit-adam-v2

  jeffra

  authored
  6df3dbb

  Copy full SHA for 6df3dbb