Code

[CUDA] Lean Attention#22352

Code

Merged

tianleiwu merged 10 commits intomainmicrosoft/onnxruntime:mainfrom tlwu/lean_attmicrosoft/onnxruntime:tlwu/lean_attCopy head branch name to clipboardOct 14, 2024

+3,578-68

Commits

Commits on Sep 23, 2024

• Add Lean Attention (by Srikant Bharadwaj)

  tianleiwu

  committed
  1ee1aa1

  Copy full SHA for 1ee1aa1

Commits on Oct 12, 2024

• Add Lean Att to MHA op

  tianleiwu

  committed
  78c056b

  Copy full SHA for 78c056b

Commits on Oct 13, 2024

• Add benchmark

  tianleiwu

  committed
  b703499

  Copy full SHA for b703499

• format

  tianleiwu

  committed
  b44f4ee

  Copy full SHA for b44f4ee

• Disable Lean in Windows

  tianleiwu

  committed
  8b380e2

  Copy full SHA for 8b380e2

• fix flops

  tianleiwu

  committed
  787b7dd

  Copy full SHA for 787b7dd

• fix build

  tianleiwu

  committed
  7004bec

  Copy full SHA for 7004bec

• clean up

  tianleiwu

  committed
  2142b96

  Copy full SHA for 2142b96

Commits on Oct 14, 2024

• refactoring; update tests

  tianleiwu

  committed
  ef23fef

  Copy full SHA for ef23fef

• conditional compile

  tianleiwu

  committed
  a3c9e8e

  Copy full SHA for a3c9e8e