Fix tokenize implementation in Swift#4321

Merged

ggerganov merged 1 commit intoggerganov:masterfrom ensan-hcl:fix/swift_prompt_tokenize

Dec 4, 2023

+6-4

Commits on Dec 4, 2023

fix prompt tokenization logic
ensan-hcl
committed