Code

Alibi Tensor Parallel Fix #244

Code

Merged

DanielHesslow merged 6 commits intomainbigscience-workshop/Megatron-DeepSpeed:mainfrom alibi_tpbigscience-workshop/Megatron-DeepSpeed:alibi_tpCopy head branch name to clipboardFeb 1, 2022

+216-10

Commits

Commits on Jan 31, 2022

• Alibi tensor parallel fix

  DanielHesslow

  committed
  3210920

  Copy full SHA for 3210920

• Tensor Parallel Test

  DanielHesslow

  committed
  28e2057

  Copy full SHA for 28e2057

• Force mp_start_method and disable git_ds_info

  DanielHesslow

  committed
  d5fa070

  Copy full SHA for d5fa070

• change port

  DanielHesslow

  committed
  1b7bd0d

  Copy full SHA for 1b7bd0d

Commits on Feb 1, 2022

• spelling

  DanielHesslow

  committed
  d2a8671

  Copy full SHA for d2a8671

• minor refactoring + cleanup

  DanielHesslow

  committed
  87e75d2

  Copy full SHA for 87e75d2