Code

Enables ZeRO-3 inference#1514

Code

Merged

jeffra merged 22 commits intomastermicrosoft/DeepSpeed:masterfrom jeffra/no_optimmicrosoft/DeepSpeed:jeffra/no_optimCopy head branch name to clipboardNov 19, 2021

+96-20

Commits

Commits on Nov 2, 2021

• add initial support for no optimizer init for Z3

  jeffra

  committed
  bdb9068

  Copy full SHA for bdb9068

• add guards and clean-up

  jeffra

  committed
  054565b

  Copy full SHA for 054565b

• Merge branch 'master' into jeffra/no_optim

  jeffra

  authored
  d4b7c86

  Copy full SHA for d4b7c86

• add docstring to dummy optim

  jeffra

  committed
  7c2075a

  Copy full SHA for 7c2075a

• Merge branch 'jeffra/no_optim' of github.com:microsoft/DeepSpeed into jeffra/no_optim

  jeffra

  committed
  c3f594a

  Copy full SHA for c3f594a

• Merge branch 'master' into jeffra/no_optim

  jeffra

  authored
  e26bc31

  Copy full SHA for e26bc31

Commits on Nov 8, 2021

• fix regression introduced in SimpleModel refactor

  jeffra

  committed
  dfdf025

  Copy full SHA for dfdf025

• Merge branch 'jeffra/no_optim' of github.com:microsoft/DeepSpeed into jeffra/no_optim

  jeffra

  committed
  f091fd8

  Copy full SHA for f091fd8

• Merge branch 'master' into jeffra/no_optim

  jeffra

  authored
  901c88a

  Copy full SHA for 901c88a

• all environ var for test port

  jeffra

  committed
  28ed372

  Copy full SHA for 28ed372

• Merge branch 'jeffra/no_optim' of github.com:microsoft/DeepSpeed into jeffra/no_optim

  jeffra

  committed
  569747d

  Copy full SHA for 569747d

• Merge branch 'master' into jeffra/no_optim

  jeffra

  authored
  d92c9a8

  Copy full SHA for d92c9a8

Commits on Nov 16, 2021

• align remote_device/pin_memory in ds config with zero.Init

  jeffra

  committed
  16f32f6

  Copy full SHA for 16f32f6

• update test to use config

  jeffra

  committed
  2fe7901

  Copy full SHA for 2fe7901

• Merge branch 'master' into jeffra/no_optim

  jeffra

  authored
  da953d3

  Copy full SHA for da953d3

• address comment

  jeffra

  committed
  498af69

  Copy full SHA for 498af69

• Merge branch 'jeffra/no_optim' of github.com:microsoft/DeepSpeed into jeffra/no_optim

  jeffra

  committed
  3484b6f

  Copy full SHA for 3484b6f

• fix new lines that broke diff

  jeffra

  committed
  28988a3

  Copy full SHA for 28988a3

Commits on Nov 17, 2021

• Merge branch 'master' into jeffra/no_optim

  jeffra

  authored
  60f284d

  Copy full SHA for 60f284d

Commits on Nov 18, 2021

• skip param offload test on older torch

  jeffra

  committed
  a7140c1

  Copy full SHA for a7140c1

• Merge branch 'master' into jeffra/no_optim

  jeffra

  authored
  346e85e

  Copy full SHA for 346e85e

• fix import typo

  jeffra

  committed
  3d21b50

  Copy full SHA for 3d21b50