Skip to content

Commit

Permalink
Todos
Browse files Browse the repository at this point in the history
  • Loading branch information
cgbur committed Aug 12, 2023
1 parent ea19ffa commit 993dce9
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -170,7 +170,8 @@ strip = "symbols"
- \[ \] Incorporate the Python script used to generate checkpoints
- \[ \] Parallelize multi-head attention process
- \[ \] Add support for multi-threading (this is not going well)
- \[ \] Top-p sampling is really slow, maybe some way to speed it up
- \[x\] Top-p sampling is really slow, maybe some way to speed it up
- \[ \] Try top-p sampling by doing multiple linear scans to avoid sorting
## Contributing
Expand Down

0 comments on commit 993dce9

Please sign in to comment.