You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the Issue
After updating from 1.76 to 1.77 I started to get a bunch of weird messages on model load.
Example: llm_load_vocab: control token: 109 '<SPECIAL_109>' is not marked as EOG full listing below.
Additional Information:
Win 11, i5 12th gen, RTX 3060, KoboldCpp 1.77. I'm using Mistral-family model GGUF quantized.
version 1.76 output log:
Using automatic RoPE scaling for GGUF. If the model has custom RoPE settings, they'll be used directly instead!
It means that the RoPE values written above will be replaced by the RoPE values indicated after loading.
System Info: AVX = 1 | AVX_VNNI = 0 | AVX2 = 1 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | AVX512_BF16 = 0 | FMA = 1 | NEON = 0 | SVE = 0 | ARM_FMA = 0 | F16C = 1 | FP16_VA = 0 | RISCV_VECT = 0 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 1 | SSSE3 = 1 | VSX = 0 | MATMUL_INT8 = 0 | LLAMAFILE = 1 |
ggml_cuda_init: found 1 CUDA devices:
Device 0: NVIDIA GeForce RTX 3060, compute capability 8.6, VMM: yes
llama_model_loader: loaded meta data with 40 key-value pairs and 363 tensors from X:\Models\MN_Q4_K_M-im▼з7mЪЗllm_load_vocab: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect
version 1.77 output log:
Using automatic RoPE scaling for GGUF. If the model has custom RoPE settings, they'll be used directly instead!
It means that the RoPE values written above will be replaced by the RoPE values indicated after loading.
System Info: AVX = 1 | AVX_VNNI = 0 | AVX2 = 1 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | AVX512_BF16 = 0 | AMX_INT8 = 0 | FMA = 1 | NEON = 0 | SVE = 0 | ARM_FMA = 0 | F16C = 1 | FP16_VA = 0 | RISCV_VECT = 0 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 1 | SSSE3 = 1 | VSX = 0 | MATMUL_INT8 = 0 | LLAMAFILE = 1 |
ggml_cuda_init: found 1 CUDA devices:
Device 0: NVIDIA GeForce RTX 3060, compute capability 8.6, VMM: yes
llama_load_model_from_file: using device CUDA0 (NVIDIA GeForce RTX 3060) - 11247 MiB free
llama_model_loader: loaded meta data with 40 key-value pairs and 363 tensors from X:\Models\MN_Q4_K_M-im$./?╪ llm_load_vocab: control token: 475 '<SPECIAL_475>' is not marked as EOG
llm_load_vocab: control token: 787 '<SPECIAL_787>' is not marked as EOG
llm_load_vocab: control token: 59 '<SPECIAL_59>' is not marked as EOG
llm_load_vocab: control token: 109 '<SPECIAL_109>' is not marked as EOG
llm_load_vocab: control token: 978 '<SPECIAL_978>' is not marked as EOG
llm_load_vocab: control token: 11 '[PREFIX]' is not marked as EOG
llm_load_vocab: control token: 318 '<SPECIAL_318>' is not marked as EOG
llm_load_vocab: control token: 996 '<SPECIAL_996>' is not marked as EOG
llm_load_vocab: control token: 2 '</s>' is not marked as EOG
llm_load_vocab: control token: 51 '<SPECIAL_51>' is not marked as EOG
llm_load_vocab: control token: 505 '<SPECIAL_505>' is not marked as EOG
llm_load_vocab: control token: 970 '<SPECIAL_970>' is not marked as EOG
llm_load_vocab: control token: 101 '<SPECIAL_101>' is not marked as EOG
llm_load_vocab: control token: 0 '<unk>' is not marked as EOG
llm_load_vocab: control token: 788 '<SPECIAL_788>' is not marked as EOG
llm_load_vocab: control token: 56 '<SPECIAL_56>' is not marked as EOG
llm_load_vocab: control token: 502 '<SPECIAL_502>' is not marked as EOG
llm_load_vocab: control token: 814 '<SPECIAL_814>' is not marked as EOG
llm_load_vocab: control token: 4 '[/INST]' is not marked as EOG
llm_load_vocab: control token: 1 '<s>' is not marked as EOG
llm_load_vocab: control token: 472 '<SPECIAL_472>' is not marked as EOG
llm_load_vocab: control token: 545 '<SPECIAL_545>' is not marked as EOG
llm_load_vocab: control token: 224 '<SPECIAL_224>' is not marked as EOG
llm_load_vocab: control token: 6 '[/AVAILABLE_TOOLS]' is not marked as EOG
llm_load_vocab: control token: 659 '<SPECIAL_659>' is not marked as EOG
llm_load_vocab: control token: 24 '<SPECIAL_24>' is not marked as EOG
llm_load_vocab: control token: 3 '[INST]' is not marked as EOG
llm_load_vocab: control token: 174 '<SPECIAL_174>' is not marked as EOG
llm_load_vocab: control token: 19 '<SPECIAL_19>' is not marked as EOG
llm_load_vocab: control token: 658 '<SPECIAL_658>' is not marked as EOG
llm_load_vocab: control token: 25 '<SPECIAL_25>' is not marked as EOG
llm_load_vocab: control token: 175 '<SPECIAL_175>' is not marked as EOG
llm_load_vocab: control token: 18 '<SPECIAL_18>' is not marked as EOG
llm_load_vocab: control token: 5 '[AVAILABLE_TOOLS]' is not marked as EOG
llm_load_vocab: control token: 69 '<SPECIAL_69>' is not marked as EOG
llm_load_vocab: control token: 474 '<SPECIAL_474>' is not marked as EOG
llm_load_vocab: control token: 786 '<SPECIAL_786>' is not marked as EOG
llm_load_vocab: control token: 58 '<SPECIAL_58>' is not marked as EOG
llm_load_vocab: control token: 7 '[TOOL_RESULTS]' is not marked as EOG
llm_load_vocab: control token: 319 '<SPECIAL_319>' is not marked as EOG
llm_load_vocab: control token: 464 '<SPECIAL_464>' is not marked as EOG
llm_load_vocab: control token: 851 '<SPECIAL_851>' is not marked as EOG
llm_load_vocab: control token: 792 '<SPECIAL_792>' is not marked as EOG
llm_load_vocab: control token: 40 '<SPECIAL_40>' is not marked as EOG
llm_load_vocab: control token: 323 '<SPECIAL_323>' is not marked as EOG
llm_load_vocab: control token: 709 '<SPECIAL_709>' is not marked as EOG
llm_load_vocab: control token: 8 '[/TOOL_RESULTS]' is not marked as EOG
llm_load_vocab: control token: 37 '<SPECIAL_37>' is not marked as EOG
llm_load_vocab: control token: 260 '<SPECIAL_260>' is not marked as EOG
llm_load_vocab: control token: 9 '[TOOL_CALLS]' is not marked as EOG
llm_load_vocab: control token: 91 '<SPECIAL_91>' is not marked as EOG
llm_load_vocab: control token: 425 '<SPECIAL_425>' is not marked as EOG
llm_load_vocab: control token: 10 '<pad>' is not marked as EOG
llm_load_vocab: control token: 375 '<SPECIAL_375>' is not marked as EOG
llm_load_vocab: control token: 38 '<SPECIAL_38>' is not marked as EOG
llm_load_vocab: control token: 898 '<SPECIAL_898>' is not marked as EOG
llm_load_vocab: control token: 12 '[MIDDLE]' is not marked as EOG
llm_load_vocab: control token: 52 '<SPECIAL_52>' is not marked as EOG
llm_load_vocab: control token: 13 '[SUFFIX]' is not marked as EOG
llm_load_vocab: control token: 506 '<SPECIAL_506>' is not marked as EOG
llm_load_vocab: control token: 197 '<SPECIAL_197>' is not marked as EOG
llm_load_vocab: control token: 878 '<SPECIAL_878>' is not marked as EOG
llm_load_vocab: control token: 302 '<SPECIAL_302>' is not marked as EOG
llm_load_vocab: control token: 654 '<SPECIAL_654>' is not marked as EOG
llm_load_vocab: control token: 980 '<SPECIAL_980>' is not marked as EOG
llm_load_vocab: control token: 29 '<SPECIAL_29>' is not marked as EOG
llm_load_vocab: control token: 867 '<SPECIAL_867>' is not marked as EOG
llm_load_vocab: control token: 179 '<SPECIAL_179>' is not marked as EOG
llm_load_vocab: control token: 14 '<SPECIAL_14>' is not marked as EOG
llm_load_vocab: control token: 196 '<SPECIAL_196>' is not marked as EOG
llm_load_vocab: control token: 879 '<SPECIAL_879>' is not marked as EOG
llm_load_vocab: control token: 303 '<SPECIAL_303>' is not marked as EOG
llm_load_vocab: control token: 981 '<SPECIAL_981>' is not marked as EOG
llm_load_vocab: control token: 655 '<SPECIAL_655>' is not marked as EOG
llm_load_vocab: control token: 28 '<SPECIAL_28>' is not marked as EOG
llm_load_vocab: control token: 866 '<SPECIAL_866>' is not marked as EOG
llm_load_vocab: control token: 178 '<SPECIAL_178>' is not marked as EOG
llm_load_vocab: control token: 15 '<SPECIAL_15>' is not marked as EOG
llm_load_vocab: control token: 16 '<SPECIAL_16>' is not marked as EOG
llm_load_vocab: control token: 17 '<SPECIAL_17>' is not marked as EOG
llm_load_vocab: control token: 989 '<SPECIAL_989>' is not marked as EOG
llm_load_vocab: control token: 20 '<SPECIAL_20>' is not marked as EOG
llm_load_vocab: control token: 988 '<SPECIAL_988>' is not marked as EOG
llm_load_vocab: control token: 21 '<SPECIAL_21>' is not marked as EOG
llm_load_vocab: control token: 873 '<SPECIAL_873>' is not marked as EOG
llm_load_vocab: control token: 309 '<SPECIAL_309>' is not marked as EOG
llm_load_vocab: control token: 22 '<SPECIAL_22>' is not marked as EOG
llm_load_vocab: control token: 872 '<SPECIAL_872>' is not marked as EOG
llm_load_vocab: control token: 308 '<SPECIAL_308>' is not marked as EOG
llm_load_vocab: control token: 23 '<SPECIAL_23>' is not marked as EOG
llm_load_vocab: control token: 198 '<SPECIAL_198>' is not marked as EOG
llm_load_vocab: control token: 877 '<SPECIAL_877>' is not marked as EOG
llm_load_vocab: control token: 26 '<SPECIAL_26>' is not marked as EOG
llm_load_vocab: control token: 199 '<SPECIAL_199>' is not marked as EOG
llm_load_vocab: control token: 876 '<SPECIAL_876>' is not marked as EOG
llm_load_vocab: control token: 27 '<SPECIAL_27>' is not marked as EOG
llm_load_vocab: control token: 30 '<SPECIAL_30>' is not marked as EOG
llm_load_vocab: control token: 31 '<SPECIAL_31>' is not marked as EOG
llm_load_vocab: control token: 32 '<SPECIAL_32>' is not marked as EOG
llm_load_vocab: control token: 33 '<SPECIAL_33>' is not marked as EOG
llm_load_vocab: control token: 843 '<SPECIAL_843>' is not marked as EOG
llm_load_vocab: control token: 379 '<SPECIAL_379>' is not marked as EOG
llm_load_vocab: control token: 34 '<SPECIAL_34>' is not marked as EOG
llm_load_vocab: control token: 842 '<SPECIAL_842>' is not marked as EOG
llm_load_vocab: control token: 378 '<SPECIAL_378>' is not marked as EOG
llm_load_vocab: control token: 35 '<SPECIAL_35>' is not marked as EOG
llm_load_vocab: control token: 36 '<SPECIAL_36>' is not marked as EOG
llm_load_vocab: control token: 374 '<SPECIAL_374>' is not marked as EOG
llm_load_vocab: control token: 39 '<SPECIAL_39>' is not marked as EOG
llm_load_vocab: control token: 850 '<SPECIAL_850>' is not marked as EOG
llm_load_vocab: control token: 465 '<SPECIAL_465>' is not marked as EOG
llm_load_vocab: control token: 793 '<SPECIAL_793>' is not marked as EOG
llm_load_vocab: control token: 41 '<SPECIAL_41>' is not marked as EOG
llm_load_vocab: control token: 853 '<SPECIAL_853>' is not marked as EOG
llm_load_vocab: control token: 466 '<SPECIAL_466>' is not marked as EOG
llm_load_vocab: control token: 790 '<SPECIAL_790>' is not marked as EOG
llm_load_vocab: control token: 42 '<SPECIAL_42>' is not marked as EOG
llm_load_vocab: control token: 852 '<SPECIAL_852>' is not marked as EOG
llm_load_vocab: control token: 467 '<SPECIAL_467>' is not marked as EOG
llm_load_vocab: control token: 791 '<SPECIAL_791>' is not marked as EOG
llm_load_vocab: control token: 43 '<SPECIAL_43>' is not marked as EOG
llm_load_vocab: control token: 460 '<SPECIAL_460>' is not marked as EOG
llm_load_vocab: control token: 855 '<SPECIAL_855>' is not marked as EOG
llm_load_vocab: control token: 796 '<SPECIAL_796>' is not marked as EOG
llm_load_vocab: control token: 44 '<SPECIAL_44>' is not marked as EOG
llm_load_vocab: control token: 518 '<SPECIAL_518>' is not marked as EOG
llm_load_vocab: control token: 461 '<SPECIAL_461>' is not marked as EOG
llm_load_vocab: control token: 854 '<SPECIAL_854>' is not marked as EOG
llm_load_vocab: control token: 797 '<SPECIAL_797>' is not marked as EOG
llm_load_vocab: control token: 45 '<SPECIAL_45>' is not marked as EOG
llm_load_vocab: control token: 519 '<SPECIAL_519>' is not marked as EOG
llm_load_vocab: control token: 857 '<SPECIAL_857>' is not marked as EOG
llm_load_vocab: control token: 462 '<SPECIAL_462>' is not marked as EOG
llm_load_vocab: control token: 794 '<SPECIAL_794>' is not marked as EOG
llm_load_vocab: control token: 46 '<SPECIAL_46>' is not marked as EOG
llm_load_vocab: control token: 856 '<SPECIAL_856>' is not marked as EOG
llm_load_vocab: control token: 463 '<SPECIAL_463>' is not marked as EOG
llm_load_vocab: control token: 47 '<SPECIAL_47>' is not marked as EOG
llm_load_vocab: control token: 795 '<SPECIAL_795>' is not marked as EOG
llm_load_vocab: control token: 514 '<SPECIAL_514>' is not marked as EOG
llm_load_vocab: control token: 48 '<SPECIAL_48>' is not marked as EOG
llm_load_vocab: control token: 515 '<SPECIAL_515>' is not marked as EOG
llm_load_vocab: control token: 49 '<SPECIAL_49>' is not marked as EOG
llm_load_vocab: control token: 50 '<SPECIAL_50>' is not marked as EOG
llm_load_vocab: control token: 504 '<SPECIAL_504>' is not marked as EOG
llm_load_vocab: control token: 53 '<SPECIAL_53>' is not marked as EOG
llm_load_vocab: control token: 507 '<SPECIAL_507>' is not marked as EOG
llm_load_vocab: control token: 54 '<SPECIAL_54>' is not marked as EOG
llm_load_vocab: control token: 500 '<SPECIAL_500>' is not marked as EOG
llm_load_vocab: control token: 478 '<SPECIAL_478>' is not marked as EOG
llm_load_vocab: control token: 55 '<SPECIAL_55>' is not marked as EOG
llm_load_vocab: control token: 501 '<SPECIAL_501>' is not marked as EOG
llm_load_vocab: control token: 479 '<SPECIAL_479>' is not marked as EOG
llm_load_vocab: control token: 789 '<SPECIAL_789>' is not marked as EOG
llm_load_vocab: control token: 57 '<SPECIAL_57>' is not marked as EOG
llm_load_vocab: control token: 503 '<SPECIAL_503>' is not marked as EOG
llm_load_vocab: control token: 444 '<SPECIAL_444>' is not marked as EOG
llm_load_vocab: control token: 60 '<SPECIAL_60>' is not marked as EOG
llm_load_vocab: control token: 776 '<SPECIAL_776>' is not marked as EOG
llm_load_vocab: control token: 445 '<SPECIAL_445>' is not marked as EOG
llm_load_vocab: control token: 777 '<SPECIAL_777>' is not marked as EOG
llm_load_vocab: control token: 61 '<SPECIAL_61>' is not marked as EOG
llm_load_vocab: control token: 446 '<SPECIAL_446>' is not marked as EOG
llm_load_vocab: control token: 62 '<SPECIAL_62>' is not marked as EOG
llm_load_vocab: control token: 774 '<SPECIAL_774>' is not marked as EOG
llm_load_vocab: control token: 447 '<SPECIAL_447>' is not marked as EOG
llm_load_vocab: control token: 775 '<SPECIAL_775>' is not marked as EOG
llm_load_vocab: control token: 63 '<SPECIAL_63>' is not marked as EOG
llm_load_vocab: control token: 440 '<SPECIAL_440>' is not marked as EOG
llm_load_vocab: control token: 772 '<SPECIAL_772>' is not marked as EOG
llm_load_vocab: control token: 64 '<SPECIAL_64>' is not marked as EOG
llm_load_vocab: control token: 441 '<SPECIAL_441>' is not marked as EOG
llm_load_vocab: control token: 773 '<SPECIAL_773>' is not marked as EOG
llm_load_vocab: control token: 65 '<SPECIAL_65>' is not marked as EOG
llm_load_vocab: control token: 442 '<SPECIAL_442>' is not marked as EOG
llm_load_vocab: control token: 770 '<SPECIAL_770>' is not marked as EOG
llm_load_vocab: control token: 66 '<SPECIAL_66>' is not marked as EOG
llm_load_vocab: control token: 443 '<SPECIAL_443>' is not marked as EOG
llm_load_vocab: control token: 771 '<SPECIAL_771>' is not marked as EOG
llm_load_vocab: control token: 67 '<SPECIAL_67>' is not marked as EOG
llm_load_vocab: control token: 68 '<SPECIAL_68>' is not marked as EOG
llm_load_vocab: control token: 454 '<SPECIAL_454>' is not marked as EOG
llm_load_vocab: control token: 762 '<SPECIAL_762>' is not marked as EOG
llm_load_vocab: control token: 70 '<SPECIAL_70>' is not marked as EOG
llm_load_vocab: control token: 455 '<SPECIAL_455>' is not marked as EOG
llm_load_vocab: control token: 763 '<SPECIAL_763>' is not marked as EOG
llm_load_vocab: control token: 71 '<SPECIAL_71>' is not marked as EOG
llm_load_vocab: control token: 456 '<SPECIAL_456>' is not marked as EOG
llm_load_vocab: control token: 760 '<SPECIAL_760>' is not marked as EOG
llm_load_vocab: control token: 72 '<SPECIAL_72>' is not marked as EOG
llm_load_vocab: control token: 457 '<SPECIAL_457>' is not marked as EOG
llm_load_vocab: control token: 761 '<SPECIAL_761>' is not marked as EOG
llm_load_vocab: control token: 73 '<SPECIAL_73>' is not marked as EOG
llm_load_vocab: control token: 450 '<SPECIAL_450>' is not marked as EOG
llm_load_vocab: control token: 766 '<SPECIAL_766>' is not marked as EOG
llm_load_vocab: control token: 74 '<SPECIAL_74>' is not marked as EOG
llm_load_vocab: control token: 451 '<SPECIAL_451>' is not marked as EOG
llm_load_vocab: control token: 767 '<SPECIAL_767>' is not marked as EOG
llm_load_vocab: control token: 75 '<SPECIAL_75>' is not marked as EOG
llm_load_vocab: control token: 908 '<SPECIAL_908>' is not marked as EOG
llm_load_vocab: control token: 452 '<SPECIAL_452>' is not marked as EOG
llm_load_vocab: control token: 764 '<SPECIAL_764>' is not marked as EOG
llm_load_vocab: control token: 76 '<SPECIAL_76>' is not marked as EOG
llm_load_vocab: control token: 909 '<SPECIAL_909>' is not marked as EOG
llm_load_vocab: control token: 453 '<SPECIAL_453>' is not marked as EOG
llm_load_vocab: control token: 77 '<SPECIAL_77>' is not marked as EOG
llm_load_vocab: control token: 765 '<SPECIAL_765>' is not marked as EOG
llm_load_vocab: control token: 78 '<SPECIAL_78>' is not marked as EOG
llm_load_vocab: control token: 79 '<SPECIAL_79>' is not marked as EOG
llm_load_vocab: control token: 253 '<SPECIAL_253>' is not marked as EOG
llm_load_vocab: control token: 969 '<SPECIAL_969>' is not marked as EOG
llm_load_vocab: control token: 80 '<SPECIAL_80>' is not marked as EOG
llm_load_vocab: control token: 252 '<SPECIAL_252>' is not marked as EOG
llm_load_vocab: control token: 968 '<SPECIAL_968>' is not marked as EOG
llm_load_vocab: control token: 81 '<SPECIAL_81>' is not marked as EOG
llm_load_vocab: control token: 251 '<SPECIAL_251>' is not marked as EOG
llm_load_vocab: control token: 82 '<SPECIAL_82>' is not marked as EOG
llm_load_vocab: control token: 250 '<SPECIAL_250>' is not marked as EOG
llm_load_vocab: control token: 83 '<SPECIAL_83>' is not marked as EOG
llm_load_vocab: control token: 257 '<SPECIAL_257>' is not marked as EOG
llm_load_vocab: control token: 84 '<SPECIAL_84>' is not marked as EOG
llm_load_vocab: control token: 256 '<SPECIAL_256>' is not marked as EOG
llm_load_vocab: control token: 85 '<SPECIAL_85>' is not marked as EOG
llm_load_vocab: control token: 255 '<SPECIAL_255>' is not marked as EOG
llm_load_vocab: control token: 86 '<SPECIAL_86>' is not marked as EOG
llm_load_vocab: control token: 138 '<SPECIAL_138>' is not marked as EOG
llm_load_vocab: control token: 254 '<SPECIAL_254>' is not marked as EOG
llm_load_vocab: control token: 87 '<SPECIAL_87>' is not marked as EOG
llm_load_vocab: control token: 139 '<SPECIAL_139>' is not marked as EOG
llm_load_vocab: control token: 136 '<SPECIAL_136>' is not marked as EOG
llm_load_vocab: control token: 961 '<SPECIAL_961>' is not marked as EOG
llm_load_vocab: control token: 88 '<SPECIAL_88>' is not marked as EOG
llm_load_vocab: control token: 137 '<SPECIAL_137>' is not marked as EOG
llm_load_vocab: control token: 960 '<SPECIAL_960>' is not marked as EOG
llm_load_vocab: control token: 89 '<SPECIAL_89>' is not marked as EOG
llm_load_vocab: control token: 261 '<SPECIAL_261>' is not marked as EOG
llm_load_vocab: control token: 90 '<SPECIAL_90>' is not marked as EOG
llm_load_vocab: control token: 263 '<SPECIAL_263>' is not marked as EOG
llm_load_vocab: control token: 128 '<SPECIAL_128>' is not marked as EOG
llm_load_vocab: control token: 919 '<SPECIAL_919>' is not marked as EOG
llm_load_vocab: control token: 92 '<SPECIAL_92>' is not marked as EOG
llm_load_vocab: control token: 262 '<SPECIAL_262>' is not marked as EOG
llm_load_vocab: control token: 129 '<SPECIAL_129>' is not marked as EOG
llm_load_vocab: control token: 918 '<SPECIAL_918>' is not marked as EOG
llm_load_vocab: control token: 93 '<SPECIAL_93>' is not marked as EOG
llm_load_vocab: control token: 265 '<SPECIAL_265>' is not marked as EOG
llm_load_vocab: control token: 94 '<SPECIAL_94>' is not marked as EOG
llm_load_vocab: control token: 264 '<SPECIAL_264>' is not marked as EOG
llm_load_vocab: control token: 95 '<SPECIAL_95>' is not marked as EOG
llm_load_vocab: control token: 267 '<SPECIAL_267>' is not marked as EOG
llm_load_vocab: control token: 96 '<SPECIAL_96>' is not marked as EOG
llm_load_vocab: control token: 266 '<SPECIAL_266>' is not marked as EOG
llm_load_vocab: control token: 97 '<SPECIAL_97>' is not marked as EOG
llm_load_vocab: control token: 269 '<SPECIAL_269>' is not marked as EOG
llm_load_vocab: control token: 122 '<SPECIAL_122>' is not marked as EOG
llm_load_vocab: control token: 913 '<SPECIAL_913>' is not marked as EOG
llm_load_vocab: control token: 98 '<SPECIAL_98>' is not marked as EOG
llm_load_vocab: control token: 268 '<SPECIAL_268>' is not marked as EOG
llm_load_vocab: control token: 123 '<SPECIAL_123>' is not marked as EOG
llm_load_vocab: control token: 912 '<SPECIAL_912>' is not marked as EOG
llm_load_vocab: control token: 99 '<SPECIAL_99>' is not marked as EOG
... same type of messages ...
llm_load_vocab: control token: 991 '<SPECIAL_991>' is not marked as EOG
llm_load_vocab: control token: 992 '<SPECIAL_992>' is not marked as EOG
llm_load_vocab: control token: 993 '<SPECIAL_993>' is not marked as EOG
llm_load_vocab: control token: 997 '<SPECIAL_997>' is not marked as EOG
llm_load_vocab: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect
The text was updated successfully, but these errors were encountered:
Describe the Issue
After updating from 1.76 to 1.77 I started to get a bunch of weird messages on model load.
Example:
llm_load_vocab: control token: 109 '<SPECIAL_109>' is not marked as EOG
full listing below.Additional Information:
Win 11, i5 12th gen, RTX 3060, KoboldCpp 1.77. I'm using Mistral-family model GGUF quantized.
version 1.76 output log:
version 1.77 output log:
The text was updated successfully, but these errors were encountered: