Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error: "llm_load_vocab: control token: ... is not marked as EOG" #1203

Open
Chiaki opened this issue Nov 7, 2024 · 1 comment
Open

Error: "llm_load_vocab: control token: ... is not marked as EOG" #1203

Chiaki opened this issue Nov 7, 2024 · 1 comment

Comments

@Chiaki
Copy link

Chiaki commented Nov 7, 2024

Describe the Issue
After updating from 1.76 to 1.77 I started to get a bunch of weird messages on model load.
Example: llm_load_vocab: control token: 109 '<SPECIAL_109>' is not marked as EOG full listing below.

Additional Information:
Win 11, i5 12th gen, RTX 3060, KoboldCpp 1.77. I'm using Mistral-family model GGUF quantized.

version 1.76 output log:

Using automatic RoPE scaling for GGUF. If the model has custom RoPE settings, they'll be used directly instead!
It means that the RoPE values written above will be replaced by the RoPE values indicated after loading.
System Info: AVX = 1 | AVX_VNNI = 0 | AVX2 = 1 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | AVX512_BF16 = 0 | FMA = 1 | NEON = 0 | SVE = 0 | ARM_FMA = 0 | F16C = 1 | FP16_VA = 0 | RISCV_VECT = 0 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 1 | SSSE3 = 1 | VSX = 0 | MATMUL_INT8 = 0 | LLAMAFILE = 1 |
ggml_cuda_init: found 1 CUDA devices:
  Device 0: NVIDIA GeForce RTX 3060, compute capability 8.6, VMM: yes
llama_model_loader: loaded meta data with 40 key-value pairs and 363 tensors from X:\Models\MN_Q4_K_M-im▼з7mЪЗllm_load_vocab: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect

version 1.77 output log:

Using automatic RoPE scaling for GGUF. If the model has custom RoPE settings, they'll be used directly instead!
It means that the RoPE values written above will be replaced by the RoPE values indicated after loading.
System Info: AVX = 1 | AVX_VNNI = 0 | AVX2 = 1 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | AVX512_BF16 = 0 | AMX_INT8 = 0 | FMA = 1 | NEON = 0 | SVE = 0 | ARM_FMA = 0 | F16C = 1 | FP16_VA = 0 | RISCV_VECT = 0 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 1 | SSSE3 = 1 | VSX = 0 | MATMUL_INT8 = 0 | LLAMAFILE = 1 |
ggml_cuda_init: found 1 CUDA devices:
  Device 0: NVIDIA GeForce RTX 3060, compute capability 8.6, VMM: yes
llama_load_model_from_file: using device CUDA0 (NVIDIA GeForce RTX 3060) - 11247 MiB free
llama_model_loader: loaded meta data with 40 key-value pairs and 363 tensors from X:\Models\MN_Q4_K_M-im$./?╪ llm_load_vocab: control token:    475 '<SPECIAL_475>' is not marked as EOG
llm_load_vocab: control token:    787 '<SPECIAL_787>' is not marked as EOG
llm_load_vocab: control token:     59 '<SPECIAL_59>' is not marked as EOG
llm_load_vocab: control token:    109 '<SPECIAL_109>' is not marked as EOG
llm_load_vocab: control token:    978 '<SPECIAL_978>' is not marked as EOG
llm_load_vocab: control token:     11 '[PREFIX]' is not marked as EOG
llm_load_vocab: control token:    318 '<SPECIAL_318>' is not marked as EOG
llm_load_vocab: control token:    996 '<SPECIAL_996>' is not marked as EOG
llm_load_vocab: control token:      2 '</s>' is not marked as EOG
llm_load_vocab: control token:     51 '<SPECIAL_51>' is not marked as EOG
llm_load_vocab: control token:    505 '<SPECIAL_505>' is not marked as EOG
llm_load_vocab: control token:    970 '<SPECIAL_970>' is not marked as EOG
llm_load_vocab: control token:    101 '<SPECIAL_101>' is not marked as EOG
llm_load_vocab: control token:      0 '<unk>' is not marked as EOG
llm_load_vocab: control token:    788 '<SPECIAL_788>' is not marked as EOG
llm_load_vocab: control token:     56 '<SPECIAL_56>' is not marked as EOG
llm_load_vocab: control token:    502 '<SPECIAL_502>' is not marked as EOG
llm_load_vocab: control token:    814 '<SPECIAL_814>' is not marked as EOG
llm_load_vocab: control token:      4 '[/INST]' is not marked as EOG
llm_load_vocab: control token:      1 '<s>' is not marked as EOG
llm_load_vocab: control token:    472 '<SPECIAL_472>' is not marked as EOG
llm_load_vocab: control token:    545 '<SPECIAL_545>' is not marked as EOG
llm_load_vocab: control token:    224 '<SPECIAL_224>' is not marked as EOG
llm_load_vocab: control token:      6 '[/AVAILABLE_TOOLS]' is not marked as EOG
llm_load_vocab: control token:    659 '<SPECIAL_659>' is not marked as EOG
llm_load_vocab: control token:     24 '<SPECIAL_24>' is not marked as EOG
llm_load_vocab: control token:      3 '[INST]' is not marked as EOG
llm_load_vocab: control token:    174 '<SPECIAL_174>' is not marked as EOG
llm_load_vocab: control token:     19 '<SPECIAL_19>' is not marked as EOG
llm_load_vocab: control token:    658 '<SPECIAL_658>' is not marked as EOG
llm_load_vocab: control token:     25 '<SPECIAL_25>' is not marked as EOG
llm_load_vocab: control token:    175 '<SPECIAL_175>' is not marked as EOG
llm_load_vocab: control token:     18 '<SPECIAL_18>' is not marked as EOG
llm_load_vocab: control token:      5 '[AVAILABLE_TOOLS]' is not marked as EOG
llm_load_vocab: control token:     69 '<SPECIAL_69>' is not marked as EOG
llm_load_vocab: control token:    474 '<SPECIAL_474>' is not marked as EOG
llm_load_vocab: control token:    786 '<SPECIAL_786>' is not marked as EOG
llm_load_vocab: control token:     58 '<SPECIAL_58>' is not marked as EOG
llm_load_vocab: control token:      7 '[TOOL_RESULTS]' is not marked as EOG
llm_load_vocab: control token:    319 '<SPECIAL_319>' is not marked as EOG
llm_load_vocab: control token:    464 '<SPECIAL_464>' is not marked as EOG
llm_load_vocab: control token:    851 '<SPECIAL_851>' is not marked as EOG
llm_load_vocab: control token:    792 '<SPECIAL_792>' is not marked as EOG
llm_load_vocab: control token:     40 '<SPECIAL_40>' is not marked as EOG
llm_load_vocab: control token:    323 '<SPECIAL_323>' is not marked as EOG
llm_load_vocab: control token:    709 '<SPECIAL_709>' is not marked as EOG
llm_load_vocab: control token:      8 '[/TOOL_RESULTS]' is not marked as EOG
llm_load_vocab: control token:     37 '<SPECIAL_37>' is not marked as EOG
llm_load_vocab: control token:    260 '<SPECIAL_260>' is not marked as EOG
llm_load_vocab: control token:      9 '[TOOL_CALLS]' is not marked as EOG
llm_load_vocab: control token:     91 '<SPECIAL_91>' is not marked as EOG
llm_load_vocab: control token:    425 '<SPECIAL_425>' is not marked as EOG
llm_load_vocab: control token:     10 '<pad>' is not marked as EOG
llm_load_vocab: control token:    375 '<SPECIAL_375>' is not marked as EOG
llm_load_vocab: control token:     38 '<SPECIAL_38>' is not marked as EOG
llm_load_vocab: control token:    898 '<SPECIAL_898>' is not marked as EOG
llm_load_vocab: control token:     12 '[MIDDLE]' is not marked as EOG
llm_load_vocab: control token:     52 '<SPECIAL_52>' is not marked as EOG
llm_load_vocab: control token:     13 '[SUFFIX]' is not marked as EOG
llm_load_vocab: control token:    506 '<SPECIAL_506>' is not marked as EOG
llm_load_vocab: control token:    197 '<SPECIAL_197>' is not marked as EOG
llm_load_vocab: control token:    878 '<SPECIAL_878>' is not marked as EOG
llm_load_vocab: control token:    302 '<SPECIAL_302>' is not marked as EOG
llm_load_vocab: control token:    654 '<SPECIAL_654>' is not marked as EOG
llm_load_vocab: control token:    980 '<SPECIAL_980>' is not marked as EOG
llm_load_vocab: control token:     29 '<SPECIAL_29>' is not marked as EOG
llm_load_vocab: control token:    867 '<SPECIAL_867>' is not marked as EOG
llm_load_vocab: control token:    179 '<SPECIAL_179>' is not marked as EOG
llm_load_vocab: control token:     14 '<SPECIAL_14>' is not marked as EOG
llm_load_vocab: control token:    196 '<SPECIAL_196>' is not marked as EOG
llm_load_vocab: control token:    879 '<SPECIAL_879>' is not marked as EOG
llm_load_vocab: control token:    303 '<SPECIAL_303>' is not marked as EOG
llm_load_vocab: control token:    981 '<SPECIAL_981>' is not marked as EOG
llm_load_vocab: control token:    655 '<SPECIAL_655>' is not marked as EOG
llm_load_vocab: control token:     28 '<SPECIAL_28>' is not marked as EOG
llm_load_vocab: control token:    866 '<SPECIAL_866>' is not marked as EOG
llm_load_vocab: control token:    178 '<SPECIAL_178>' is not marked as EOG
llm_load_vocab: control token:     15 '<SPECIAL_15>' is not marked as EOG
llm_load_vocab: control token:     16 '<SPECIAL_16>' is not marked as EOG
llm_load_vocab: control token:     17 '<SPECIAL_17>' is not marked as EOG
llm_load_vocab: control token:    989 '<SPECIAL_989>' is not marked as EOG
llm_load_vocab: control token:     20 '<SPECIAL_20>' is not marked as EOG
llm_load_vocab: control token:    988 '<SPECIAL_988>' is not marked as EOG
llm_load_vocab: control token:     21 '<SPECIAL_21>' is not marked as EOG
llm_load_vocab: control token:    873 '<SPECIAL_873>' is not marked as EOG
llm_load_vocab: control token:    309 '<SPECIAL_309>' is not marked as EOG
llm_load_vocab: control token:     22 '<SPECIAL_22>' is not marked as EOG
llm_load_vocab: control token:    872 '<SPECIAL_872>' is not marked as EOG
llm_load_vocab: control token:    308 '<SPECIAL_308>' is not marked as EOG
llm_load_vocab: control token:     23 '<SPECIAL_23>' is not marked as EOG
llm_load_vocab: control token:    198 '<SPECIAL_198>' is not marked as EOG
llm_load_vocab: control token:    877 '<SPECIAL_877>' is not marked as EOG
llm_load_vocab: control token:     26 '<SPECIAL_26>' is not marked as EOG
llm_load_vocab: control token:    199 '<SPECIAL_199>' is not marked as EOG
llm_load_vocab: control token:    876 '<SPECIAL_876>' is not marked as EOG
llm_load_vocab: control token:     27 '<SPECIAL_27>' is not marked as EOG
llm_load_vocab: control token:     30 '<SPECIAL_30>' is not marked as EOG
llm_load_vocab: control token:     31 '<SPECIAL_31>' is not marked as EOG
llm_load_vocab: control token:     32 '<SPECIAL_32>' is not marked as EOG
llm_load_vocab: control token:     33 '<SPECIAL_33>' is not marked as EOG
llm_load_vocab: control token:    843 '<SPECIAL_843>' is not marked as EOG
llm_load_vocab: control token:    379 '<SPECIAL_379>' is not marked as EOG
llm_load_vocab: control token:     34 '<SPECIAL_34>' is not marked as EOG
llm_load_vocab: control token:    842 '<SPECIAL_842>' is not marked as EOG
llm_load_vocab: control token:    378 '<SPECIAL_378>' is not marked as EOG
llm_load_vocab: control token:     35 '<SPECIAL_35>' is not marked as EOG
llm_load_vocab: control token:     36 '<SPECIAL_36>' is not marked as EOG
llm_load_vocab: control token:    374 '<SPECIAL_374>' is not marked as EOG
llm_load_vocab: control token:     39 '<SPECIAL_39>' is not marked as EOG
llm_load_vocab: control token:    850 '<SPECIAL_850>' is not marked as EOG
llm_load_vocab: control token:    465 '<SPECIAL_465>' is not marked as EOG
llm_load_vocab: control token:    793 '<SPECIAL_793>' is not marked as EOG
llm_load_vocab: control token:     41 '<SPECIAL_41>' is not marked as EOG
llm_load_vocab: control token:    853 '<SPECIAL_853>' is not marked as EOG
llm_load_vocab: control token:    466 '<SPECIAL_466>' is not marked as EOG
llm_load_vocab: control token:    790 '<SPECIAL_790>' is not marked as EOG
llm_load_vocab: control token:     42 '<SPECIAL_42>' is not marked as EOG
llm_load_vocab: control token:    852 '<SPECIAL_852>' is not marked as EOG
llm_load_vocab: control token:    467 '<SPECIAL_467>' is not marked as EOG
llm_load_vocab: control token:    791 '<SPECIAL_791>' is not marked as EOG
llm_load_vocab: control token:     43 '<SPECIAL_43>' is not marked as EOG
llm_load_vocab: control token:    460 '<SPECIAL_460>' is not marked as EOG
llm_load_vocab: control token:    855 '<SPECIAL_855>' is not marked as EOG
llm_load_vocab: control token:    796 '<SPECIAL_796>' is not marked as EOG
llm_load_vocab: control token:     44 '<SPECIAL_44>' is not marked as EOG
llm_load_vocab: control token:    518 '<SPECIAL_518>' is not marked as EOG
llm_load_vocab: control token:    461 '<SPECIAL_461>' is not marked as EOG
llm_load_vocab: control token:    854 '<SPECIAL_854>' is not marked as EOG
llm_load_vocab: control token:    797 '<SPECIAL_797>' is not marked as EOG
llm_load_vocab: control token:     45 '<SPECIAL_45>' is not marked as EOG
llm_load_vocab: control token:    519 '<SPECIAL_519>' is not marked as EOG
llm_load_vocab: control token:    857 '<SPECIAL_857>' is not marked as EOG
llm_load_vocab: control token:    462 '<SPECIAL_462>' is not marked as EOG
llm_load_vocab: control token:    794 '<SPECIAL_794>' is not marked as EOG
llm_load_vocab: control token:     46 '<SPECIAL_46>' is not marked as EOG
llm_load_vocab: control token:    856 '<SPECIAL_856>' is not marked as EOG
llm_load_vocab: control token:    463 '<SPECIAL_463>' is not marked as EOG
llm_load_vocab: control token:     47 '<SPECIAL_47>' is not marked as EOG
llm_load_vocab: control token:    795 '<SPECIAL_795>' is not marked as EOG
llm_load_vocab: control token:    514 '<SPECIAL_514>' is not marked as EOG
llm_load_vocab: control token:     48 '<SPECIAL_48>' is not marked as EOG
llm_load_vocab: control token:    515 '<SPECIAL_515>' is not marked as EOG
llm_load_vocab: control token:     49 '<SPECIAL_49>' is not marked as EOG
llm_load_vocab: control token:     50 '<SPECIAL_50>' is not marked as EOG
llm_load_vocab: control token:    504 '<SPECIAL_504>' is not marked as EOG
llm_load_vocab: control token:     53 '<SPECIAL_53>' is not marked as EOG
llm_load_vocab: control token:    507 '<SPECIAL_507>' is not marked as EOG
llm_load_vocab: control token:     54 '<SPECIAL_54>' is not marked as EOG
llm_load_vocab: control token:    500 '<SPECIAL_500>' is not marked as EOG
llm_load_vocab: control token:    478 '<SPECIAL_478>' is not marked as EOG
llm_load_vocab: control token:     55 '<SPECIAL_55>' is not marked as EOG
llm_load_vocab: control token:    501 '<SPECIAL_501>' is not marked as EOG
llm_load_vocab: control token:    479 '<SPECIAL_479>' is not marked as EOG
llm_load_vocab: control token:    789 '<SPECIAL_789>' is not marked as EOG
llm_load_vocab: control token:     57 '<SPECIAL_57>' is not marked as EOG
llm_load_vocab: control token:    503 '<SPECIAL_503>' is not marked as EOG
llm_load_vocab: control token:    444 '<SPECIAL_444>' is not marked as EOG
llm_load_vocab: control token:     60 '<SPECIAL_60>' is not marked as EOG
llm_load_vocab: control token:    776 '<SPECIAL_776>' is not marked as EOG
llm_load_vocab: control token:    445 '<SPECIAL_445>' is not marked as EOG
llm_load_vocab: control token:    777 '<SPECIAL_777>' is not marked as EOG
llm_load_vocab: control token:     61 '<SPECIAL_61>' is not marked as EOG
llm_load_vocab: control token:    446 '<SPECIAL_446>' is not marked as EOG
llm_load_vocab: control token:     62 '<SPECIAL_62>' is not marked as EOG
llm_load_vocab: control token:    774 '<SPECIAL_774>' is not marked as EOG
llm_load_vocab: control token:    447 '<SPECIAL_447>' is not marked as EOG
llm_load_vocab: control token:    775 '<SPECIAL_775>' is not marked as EOG
llm_load_vocab: control token:     63 '<SPECIAL_63>' is not marked as EOG
llm_load_vocab: control token:    440 '<SPECIAL_440>' is not marked as EOG
llm_load_vocab: control token:    772 '<SPECIAL_772>' is not marked as EOG
llm_load_vocab: control token:     64 '<SPECIAL_64>' is not marked as EOG
llm_load_vocab: control token:    441 '<SPECIAL_441>' is not marked as EOG
llm_load_vocab: control token:    773 '<SPECIAL_773>' is not marked as EOG
llm_load_vocab: control token:     65 '<SPECIAL_65>' is not marked as EOG
llm_load_vocab: control token:    442 '<SPECIAL_442>' is not marked as EOG
llm_load_vocab: control token:    770 '<SPECIAL_770>' is not marked as EOG
llm_load_vocab: control token:     66 '<SPECIAL_66>' is not marked as EOG
llm_load_vocab: control token:    443 '<SPECIAL_443>' is not marked as EOG
llm_load_vocab: control token:    771 '<SPECIAL_771>' is not marked as EOG
llm_load_vocab: control token:     67 '<SPECIAL_67>' is not marked as EOG
llm_load_vocab: control token:     68 '<SPECIAL_68>' is not marked as EOG
llm_load_vocab: control token:    454 '<SPECIAL_454>' is not marked as EOG
llm_load_vocab: control token:    762 '<SPECIAL_762>' is not marked as EOG
llm_load_vocab: control token:     70 '<SPECIAL_70>' is not marked as EOG
llm_load_vocab: control token:    455 '<SPECIAL_455>' is not marked as EOG
llm_load_vocab: control token:    763 '<SPECIAL_763>' is not marked as EOG
llm_load_vocab: control token:     71 '<SPECIAL_71>' is not marked as EOG
llm_load_vocab: control token:    456 '<SPECIAL_456>' is not marked as EOG
llm_load_vocab: control token:    760 '<SPECIAL_760>' is not marked as EOG
llm_load_vocab: control token:     72 '<SPECIAL_72>' is not marked as EOG
llm_load_vocab: control token:    457 '<SPECIAL_457>' is not marked as EOG
llm_load_vocab: control token:    761 '<SPECIAL_761>' is not marked as EOG
llm_load_vocab: control token:     73 '<SPECIAL_73>' is not marked as EOG
llm_load_vocab: control token:    450 '<SPECIAL_450>' is not marked as EOG
llm_load_vocab: control token:    766 '<SPECIAL_766>' is not marked as EOG
llm_load_vocab: control token:     74 '<SPECIAL_74>' is not marked as EOG
llm_load_vocab: control token:    451 '<SPECIAL_451>' is not marked as EOG
llm_load_vocab: control token:    767 '<SPECIAL_767>' is not marked as EOG
llm_load_vocab: control token:     75 '<SPECIAL_75>' is not marked as EOG
llm_load_vocab: control token:    908 '<SPECIAL_908>' is not marked as EOG
llm_load_vocab: control token:    452 '<SPECIAL_452>' is not marked as EOG
llm_load_vocab: control token:    764 '<SPECIAL_764>' is not marked as EOG
llm_load_vocab: control token:     76 '<SPECIAL_76>' is not marked as EOG
llm_load_vocab: control token:    909 '<SPECIAL_909>' is not marked as EOG
llm_load_vocab: control token:    453 '<SPECIAL_453>' is not marked as EOG
llm_load_vocab: control token:     77 '<SPECIAL_77>' is not marked as EOG
llm_load_vocab: control token:    765 '<SPECIAL_765>' is not marked as EOG
llm_load_vocab: control token:     78 '<SPECIAL_78>' is not marked as EOG
llm_load_vocab: control token:     79 '<SPECIAL_79>' is not marked as EOG
llm_load_vocab: control token:    253 '<SPECIAL_253>' is not marked as EOG
llm_load_vocab: control token:    969 '<SPECIAL_969>' is not marked as EOG
llm_load_vocab: control token:     80 '<SPECIAL_80>' is not marked as EOG
llm_load_vocab: control token:    252 '<SPECIAL_252>' is not marked as EOG
llm_load_vocab: control token:    968 '<SPECIAL_968>' is not marked as EOG
llm_load_vocab: control token:     81 '<SPECIAL_81>' is not marked as EOG
llm_load_vocab: control token:    251 '<SPECIAL_251>' is not marked as EOG
llm_load_vocab: control token:     82 '<SPECIAL_82>' is not marked as EOG
llm_load_vocab: control token:    250 '<SPECIAL_250>' is not marked as EOG
llm_load_vocab: control token:     83 '<SPECIAL_83>' is not marked as EOG
llm_load_vocab: control token:    257 '<SPECIAL_257>' is not marked as EOG
llm_load_vocab: control token:     84 '<SPECIAL_84>' is not marked as EOG
llm_load_vocab: control token:    256 '<SPECIAL_256>' is not marked as EOG
llm_load_vocab: control token:     85 '<SPECIAL_85>' is not marked as EOG
llm_load_vocab: control token:    255 '<SPECIAL_255>' is not marked as EOG
llm_load_vocab: control token:     86 '<SPECIAL_86>' is not marked as EOG
llm_load_vocab: control token:    138 '<SPECIAL_138>' is not marked as EOG
llm_load_vocab: control token:    254 '<SPECIAL_254>' is not marked as EOG
llm_load_vocab: control token:     87 '<SPECIAL_87>' is not marked as EOG
llm_load_vocab: control token:    139 '<SPECIAL_139>' is not marked as EOG
llm_load_vocab: control token:    136 '<SPECIAL_136>' is not marked as EOG
llm_load_vocab: control token:    961 '<SPECIAL_961>' is not marked as EOG
llm_load_vocab: control token:     88 '<SPECIAL_88>' is not marked as EOG
llm_load_vocab: control token:    137 '<SPECIAL_137>' is not marked as EOG
llm_load_vocab: control token:    960 '<SPECIAL_960>' is not marked as EOG
llm_load_vocab: control token:     89 '<SPECIAL_89>' is not marked as EOG
llm_load_vocab: control token:    261 '<SPECIAL_261>' is not marked as EOG
llm_load_vocab: control token:     90 '<SPECIAL_90>' is not marked as EOG
llm_load_vocab: control token:    263 '<SPECIAL_263>' is not marked as EOG
llm_load_vocab: control token:    128 '<SPECIAL_128>' is not marked as EOG
llm_load_vocab: control token:    919 '<SPECIAL_919>' is not marked as EOG
llm_load_vocab: control token:     92 '<SPECIAL_92>' is not marked as EOG
llm_load_vocab: control token:    262 '<SPECIAL_262>' is not marked as EOG
llm_load_vocab: control token:    129 '<SPECIAL_129>' is not marked as EOG
llm_load_vocab: control token:    918 '<SPECIAL_918>' is not marked as EOG
llm_load_vocab: control token:     93 '<SPECIAL_93>' is not marked as EOG
llm_load_vocab: control token:    265 '<SPECIAL_265>' is not marked as EOG
llm_load_vocab: control token:     94 '<SPECIAL_94>' is not marked as EOG
llm_load_vocab: control token:    264 '<SPECIAL_264>' is not marked as EOG
llm_load_vocab: control token:     95 '<SPECIAL_95>' is not marked as EOG
llm_load_vocab: control token:    267 '<SPECIAL_267>' is not marked as EOG
llm_load_vocab: control token:     96 '<SPECIAL_96>' is not marked as EOG
llm_load_vocab: control token:    266 '<SPECIAL_266>' is not marked as EOG
llm_load_vocab: control token:     97 '<SPECIAL_97>' is not marked as EOG
llm_load_vocab: control token:    269 '<SPECIAL_269>' is not marked as EOG
llm_load_vocab: control token:    122 '<SPECIAL_122>' is not marked as EOG
llm_load_vocab: control token:    913 '<SPECIAL_913>' is not marked as EOG
llm_load_vocab: control token:     98 '<SPECIAL_98>' is not marked as EOG
llm_load_vocab: control token:    268 '<SPECIAL_268>' is not marked as EOG
llm_load_vocab: control token:    123 '<SPECIAL_123>' is not marked as EOG
llm_load_vocab: control token:    912 '<SPECIAL_912>' is not marked as EOG
llm_load_vocab: control token:     99 '<SPECIAL_99>' is not marked as EOG
... same type of messages ...
llm_load_vocab: control token:    991 '<SPECIAL_991>' is not marked as EOG
llm_load_vocab: control token:    992 '<SPECIAL_992>' is not marked as EOG
llm_load_vocab: control token:    993 '<SPECIAL_993>' is not marked as EOG
llm_load_vocab: control token:    997 '<SPECIAL_997>' is not marked as EOG
llm_load_vocab: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect
@LostRuins
Copy link
Owner

Yeah don't worry about that. It's just some extra debug logging, it'll be gone in the next ver

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants