Code

Support FP32#141

Code

Merged

WoosukKwon merged 21 commits intomainvllm-project/vllm:mainfrom compile-timevllm-project/vllm:compile-timeCopy head branch name to clipboardJun 7, 2023

+65-54

Commits

Commits on Jun 6, 2023

• Omit block and head sizes for reduced compilation time

  WoosukKwon

  committed
  cc12338

  Copy full SHA for cc12338

• Restrict block sizes

  WoosukKwon

  committed
  67006dd

  Copy full SHA for 67006dd

• Fix supported head sizes

  WoosukKwon

  committed
  f29f81c

  Copy full SHA for f29f81c

• Omit block size 64

  WoosukKwon

  committed
  2550917

  Copy full SHA for 2550917

• Omit block size 64

  WoosukKwon

  committed
  b8d1be4

  Copy full SHA for b8d1be4

• Allow float16 <-> bfloat16 casting

  WoosukKwon

  committed
  a2a17bb

  Copy full SHA for a2a17bb

• Support FP32

  WoosukKwon

  committed
  205c78f

  Copy full SHA for 205c78f

• Add float32 to attention test

  WoosukKwon

  committed
  d917bc5

  Copy full SHA for d917bc5

• Fix installation

  WoosukKwon

  committed
  56532b5

  Copy full SHA for 56532b5

• Fix

  WoosukKwon

  committed
  042bc25

  Copy full SHA for 042bc25

• default -> auto

  WoosukKwon

  committed
  30b4239

  Copy full SHA for 30b4239

• default -> auto

  WoosukKwon

  committed
  c2b9186

  Copy full SHA for c2b9186

• Minor

  WoosukKwon

  committed
  d408884

  Copy full SHA for d408884

• Polish

  WoosukKwon

  committed
  000710a

  Copy full SHA for 000710a

• Minor

  WoosukKwon

  committed
  37e7a21

  Copy full SHA for 37e7a21

• Merge branch 'main' into compile-time

  WoosukKwon

  committed
  0931129

  Copy full SHA for 0931129

• Add float for testing

  WoosukKwon

  committed
  75a69c4

  Copy full SHA for 75a69c4

Commits on Jun 7, 2023

• Address comments

  WoosukKwon

  committed
  9ffd926

  Copy full SHA for 9ffd926

• Use NVCC threads option for parallelization

  WoosukKwon

  committed
  5075bbc

  Copy full SHA for 5075bbc

• Add comments on using docker image

  WoosukKwon

  committed
  6dcd3c1

  Copy full SHA for 6dcd3c1

• Revert back to 5-10 mins

  WoosukKwon

  committed
  e08afd7

  Copy full SHA for e08afd7