Fix equal prio merges (caused incorrect results in extremely rare cases)

belladoreai · Jun 24, 2023 · 9d97ab5 · 9d97ab5
1 parent d5199b9
commit 9d97ab5
Showing 1 changed file with 11 additions and 1 deletion.
diff --git a/llama-tokenizer.js b/llama-tokenizer.js