Code

merge upstream#198

Code

Closed

jarbus wants to merge 13 commits intochengchingwen:masterchengchingwen/Transformers.jl:masterfrom jarbus:masterjarbus/Transformers.jl:masterCopy head branch name to clipboard

+1,519-25

Commits

Commits on Mar 19, 2024

• disable cross-attention, we are doing decoder-only

  jarbus

  committed
  1c8f734

• readme

  jarbus

  committed
  cad51f7

• remove dropout, fix cross attention show

  jarbus

  committed
  5d8a582

Commits on Apr 16, 2024

• update deps

  jarbus

  committed
  27f604d

Commits on Apr 30, 2024

• fix gpu issue with latest flux

  jarbus

  committed
  f52ee88

Commits on May 24, 2024

• nn fix gpu memory leak for distributed self-att

  jarbus

  committed
  9d09cab

Commits on May 31, 2024

• dep add jarbus/NeuralAttentionlib

  jarbus

  committed
  7cda722

Commits on Jun 3, 2024

• fix wrong batch size

  jarbus

  committed
  6807721

• Merge branch 'master' of github.com:jarbus/Transformers.jl

  jarbus

  committed
  bbd6666

Commits on Jun 22, 2024

• add Manifest.toml

  jarbus

  committed
  a300948

Commits on Sep 5, 2024

• Add rope

  jarbus

  committed
  2bc4bd5

Commits on Oct 2, 2024

• add flash attention

  jarbus

  committed
  453bb2a

Commits on Oct 3, 2024

• remove early termination of infinite block

  jarbus

  committed
  94df0f3