Skip to content

Pull requests: openai/tiktoken

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Assignee
Filter by who’s assigned
Sort

Pull requests list

make decoder and sorted_token_bytes re-use existing memory
#352 opened Oct 17, 2024 by tmm1 Loading…
use HashSet from rustc-hash too
#351 opened Oct 17, 2024 by tmm1 Loading…
Uses Regex instead of fancy-regex - 6x speedup
#331 opened Aug 5, 2024 by Majdoddin Loading…
Cache for Encoding - Runtime Boosted by 12%
#319 opened Jul 10, 2024 by Majdoddin Loading…
DOC: Add a link toward PyPI tiktoken package.
#318 opened Jul 9, 2024 by MaxJPRey Loading…
Remove dependency on requests
#271 opened Mar 26, 2024 by tristan-jl Loading…
In-code documentation update
#260 opened Feb 19, 2024 by louisbrulenaudet Loading…
feat: Add option TIKTOKEN_FORCE_CACHE
#170 opened Jul 28, 2023 by Kontrolix Loading…
Option to use env variable for BPE_FILE location
#128 opened May 15, 2023 by csnelsonchu Loading…
Add ruby bindings
#83 opened Mar 28, 2023 by arjun810 Loading…
Enable ppc64le wheels
#65 opened Mar 16, 2023 by mgiessing Loading…
Add WASM/JS bindings
#50 opened Mar 6, 2023 by dqbd Loading…
WIP: refactor for Java bindings
#40 opened Feb 28, 2023 by eisber Loading…
ProTip! Mix and match filters to narrow down what you’re looking for.