diff --git a/README.md b/README.md index e5e2250..59f257b 100644 --- a/README.md +++ b/README.md @@ -170,7 +170,8 @@ strip = "symbols" - \[ \] Incorporate the Python script used to generate checkpoints - \[ \] Parallelize multi-head attention process - \[ \] Add support for multi-threading (this is not going well) -- \[ \] Top-p sampling is really slow, maybe some way to speed it up +- \[x\] Top-p sampling is really slow, maybe some way to speed it up +- \[ \] Try top-p sampling by doing multiple linear scans to avoid sorting ## Contributing