Code

Add multiple evaluation compat#336

Code

Open

Muennighoff wants to merge 13 commits intot0loadingbigscience-workshop/Megatron-DeepSpeed:t0loadingfrom mtf-multivalbigscience-workshop/Megatron-DeepSpeed:mtf-multivalCopy head branch name to clipboard

+54-17

Commits

Commits on Aug 9, 2022

• Tmp lossseq

  Muennighoff

  committed
  462efd9

  Copy full SHA for 462efd9

Commits on Aug 10, 2022

• Efficient loss normalization

  Muennighoff

  committed
  992446c

  Copy full SHA for 992446c

• Reuse variable

  Muennighoff

  committed
  616cfe8

  Copy full SHA for 616cfe8

• Simplify division

  Muennighoff

  committed
  900c835

  Copy full SHA for 900c835

Commits on Aug 15, 2022

• Add norm_target_loss arg

  Muennighoff

  committed
  7bc1dd2

  Copy full SHA for 7bc1dd2

Commits on Aug 16, 2022

• Clarify loss on targets & remove kwarg

  Muennighoff

  committed
  fce1a98

  Copy full SHA for fce1a98

Commits on Aug 17, 2022

• Loss mask is already float

  Muennighoff

  committed
  2e7554d

  Copy full SHA for 2e7554d

• Move norm to batch pipe

  Muennighoff

  committed
  a6b2624

  Copy full SHA for a6b2624

Commits on Aug 20, 2022

• Reshape loss mask

  Muennighoff

  committed
  549f499

  Copy full SHA for 549f499

• Move view

  Muennighoff

  committed
  d9a91fe

  Copy full SHA for d9a91fe

Commits on Aug 30, 2022

• Merge branch 't0loading' into lossseq

  Muennighoff

  committed
  456327c

  Copy full SHA for 456327c

• Add multiple evaluation compat

  Muennighoff

  committed
  6c1018f

  Copy full SHA for 6c1018f

Commits on Sep 3, 2022

• Set iteration to args by default

  Muennighoff

  committed
  477cda6

  Copy full SHA for 477cda6