Skip to content

Respect tokenizer.ggml.add_bos_token value when tokenizing#4040

Merged
KerfuffleV2 merged 4 commits intoggerganov:masterfrom KerfuffleV2:fix-respect-use-bos-tokenNov 17, 2023