Add document for vllm paged attention kernel. (vllm-project#2978)

Temirulan · Mar 4, 2024 · 7f2485f · 7f2485f
1 parent 6d905b8
commit 7f2485f
Show file tree

Hide file tree

Showing 9 changed files with 526 additions and 0 deletions.
diff --git a/docs/source/assets/kernel/k_vecs.png b/docs/source/assets/kernel/k_vecs.png
diff --git a/docs/source/assets/kernel/key.png b/docs/source/assets/kernel/key.png
diff --git a/docs/source/assets/kernel/logits_vec.png b/docs/source/assets/kernel/logits_vec.png
diff --git a/docs/source/assets/kernel/q_vecs.png b/docs/source/assets/kernel/q_vecs.png
diff --git a/docs/source/assets/kernel/query.png b/docs/source/assets/kernel/query.png
diff --git a/docs/source/assets/kernel/v_vec.png b/docs/source/assets/kernel/v_vec.png
diff --git a/docs/source/assets/kernel/value.png b/docs/source/assets/kernel/value.png
diff --git a/docs/source/dev/kernel/paged_attention.rst b/docs/source/dev/kernel/paged_attention.rst
diff --git a/docs/source/index.rst b/docs/source/index.rst
@@ -98,6 +98,7 @@ Documentation
    :caption: Developer Documentation
 
    dev/engine/engine_index
+   dev/kernel/paged_attention
 
 Indices and tables
 ==================