Code

Release v1.4.2#349

Code

Merged

Chris113113 merged 43 commits intomainGoogleCloudPlatform/ai-infra-cluster-provisioning:mainfrom release-v1.4.2GoogleCloudPlatform/ai-infra-cluster-provisioning:release-v1.4.2Copy head branch name to clipboardDec 15, 2023

+1,831-63

Commits

Commits on Nov 6, 2023

• main to develop (#325)

  soumyapani

  authored
  9676b57

  Copy full SHA for 9676b57

• Merging main to develop (#327)

  soumyapani

  authored
  c4f1240

  Copy full SHA for c4f1240

Commits on Nov 9, 2023

• staging changes for litgpt

  Chris113113

  committed
  26e3b34

  Copy full SHA for 26e3b34

• Revert trainer code

  Chris113113

  committed
  a76f635

  Copy full SHA for a76f635

• Add microbatch params

  Chris113113

  committed
  67ef18b

  Copy full SHA for 67ef18b

• Update to flash_attn functional commit

  Chris113113

  committed
  d2935e1

  Copy full SHA for d2935e1

• Set llama2 and 6,6 batch

  Chris113113

  committed
  0557a9f

  Copy full SHA for 0557a9f

Commits on Nov 10, 2023

• Set precision

  Chris113113

  committed
  d9d9132

  Copy full SHA for d9d9132

• Minor fixes in helm file

  gkroiz

  committed
  ec48223

  Copy full SHA for ec48223

Commits on Nov 11, 2023

• Bump flash-attn back to 2.0.4

  Chris113113

  committed
  06631a8

  Copy full SHA for 06631a8

• Add modelName param, remove mfu from output

  Chris113113

  committed
  64fc504

  Copy full SHA for 64fc504

• Remove readme for now

  Chris113113

  committed
  2e2ba34

  Copy full SHA for 2e2ba34

• LitGPT enhancements (new flash-attn) (#330)

  Chris113113

  authored
  8c1adf3

  Copy full SHA for 8c1adf3

Commits on Nov 14, 2023

• Add litgpt readme

  Chris113113

  committed
  d9d860e

  Copy full SHA for d9d860e

• Remove comments

  Chris113113

  committed
  b31e9a8

  Copy full SHA for b31e9a8

• Address comments

  Chris113113

  committed
  959e60a

  Copy full SHA for 959e60a

• 23.05 -> 23.09

  Chris113113

  committed
  26ba6d2

  Copy full SHA for 26ba6d2

• Add litgpt readme (#332)

  Chris113113

  authored
  b6dc51a

  Copy full SHA for b6dc51a

Commits on Nov 16, 2023

• split gcsBucket var into two (data + exp Buckets)

  gkroiz

  committed
  8ed80a7

  Copy full SHA for 8ed80a7

• clone litgpt at d5d37 hash

  gkroiz

  committed
  8ff8694

  Copy full SHA for 8ff8694

• Small fixes + updates to README

  gkroiz

  committed
  7d8188c

  Copy full SHA for 7d8188c

• Clean empty lines

  gkroiz

  committed
  86d87bb

  Copy full SHA for 86d87bb

Commits on Nov 17, 2023

• Fix "out" folder location so that it syncs to gcs

  gkroiz

  committed
  dcddd5f

  Copy full SHA for dcddd5f

• Remove extra line

  gkroiz

  authored
  088c14e

  Copy full SHA for 088c14e

• Remove extra line

  gkroiz

  committed
  ef46259

  Copy full SHA for ef46259

• Small fixes to Lit-GPT demo (#334)

  gkroiz

  authored
  6c5e3fe

  Copy full SHA for 6c5e3fe

• remove profiling setup (currently not used)

  gkroiz

  committed
  5a94575

  Copy full SHA for 5a94575

• remove profiling setup (currently not used) (#335)

  gkroiz

  authored
  a3e72f2

  Copy full SHA for a3e72f2

Commits on Nov 21, 2023

• Adding details to explain MFU calculation (#339)

  parambole

  authored
  17bb362

  Copy full SHA for 17bb362

Commits on Dec 5, 2023

• Update rxdm image version

  Chris113113

  committed
  7c29031

  Copy full SHA for 7c29031

• Add readme update

  Chris113113

  committed
  cf84951

  Copy full SHA for cf84951

• Update rxdm image version (#341)

  Chris113113

  authored
  846e81e

  Copy full SHA for 846e81e

• Fix unsupported envvar are set for SLURM cluster #343 (#344)

  parambole

  authored
  606760a

  Copy full SHA for 606760a

Commits on Dec 6, 2023

• Adding SLURM scripts to setup and launch lit-gpt training (#342)

  parambole

  authored
  c74ba5a

  Copy full SHA for c74ba5a

Commits on Dec 13, 2023

• Adding a simple Multi-Node Pingpong PyTorch Workload (#347)

  parambole

  authored
  2cec121

  Copy full SHA for 2cec121

Commits on Dec 14, 2023

• Set clustertype, fix cpu pinning

  Chris113113

  committed
  c9bf5fb

  Copy full SHA for c9bf5fb

• Pass num iters as param, fix gke CLUSTER_TYPE

  Chris113113

  committed
  2f811f3

  Copy full SHA for 2f811f3

• Whitespace fixes

  Chris113113

  committed
  31ded59

  Copy full SHA for 31ded59

• Fix sidecar termination, change warmup iters, move .example

  Chris113113

  committed
  804fa39

  Copy full SHA for 804fa39

Commits on Dec 15, 2023

• Update litgpt LKG, more params for injection (#348)

  Chris113113

  authored
  77085c0

  Copy full SHA for 77085c0

• Fix cleanup path

  Chris113113

  committed
  12c7ce5

  Copy full SHA for 12c7ce5

• Add a nccl-test sample workload (#345)

  Chris113113

  authored
  9696b8f

  Copy full SHA for 9696b8f

• Release v1.4.2

  stevenBorisko

  committed
  9796582

  Copy full SHA for 9796582