Code

Add batched RoPE kernel#3095

Code

Merged

Yard1 merged 10 commits intovllm-project:mainvllm-project/vllm:mainfrom tterrysun:batched_ropetterrysun/vllm:batched_ropeCopy head branch name to clipboardMar 13, 2024

+417-37

Commits

Commits on Feb 28, 2024

• add batched rope kernel

  tterrysun

  committed
  d0105ac

Commits on Mar 1, 2024

• refactor kernel

  tterrysun

  committed
  09399b9

Commits on Mar 6, 2024

• benchmarking script wip

  tterrysun

  committed
  98f0c7a

• benchmarking script on

  tterrysun

  committed
  d7f8869

• Merge branch 'main' into batched_rope

  tterrysun

  committed
  d3fa2c1

• formatting

  tterrysun

  committed
  ccb3c74

Commits on Mar 7, 2024

• update benchmarking script

  tterrysun

  committed
  bfbe4db

• remove breakpoint

  tterrysun

  committed
  870fcf2

Commits on Mar 8, 2024

• align bm behavior

  tterrysun

  committed
  77b0da5

• minor polishing

  tterrysun

  committed
  d7f691e