Todos about top-p

cgbur · Aug 9, 2023 · 8b819e5 · 8b819e5
1 parent 5419748
commit 8b819e5
Showing 1 changed file with 1 addition and 0 deletions.
diff --git a/README.md b/README.md
@@ -169,6 +169,7 @@ strip = "symbols"
 - \[ \] Incorporate the Python script used to generate checkpoints
 - \[ \] Parallelize multi-head attention process
 - \[ \] Add support for multi-threading (this is not going well)
+- \[ \] Top-p sampling is really slow, maybe some way to speed it up
 
 ## Contributing