Skip to content

Commit

Permalink
fix TrainerState doc because num_input_tokens_seen is unused by defau… (
Browse files Browse the repository at this point in the history
huggingface#34593)

fix TrainerState doc because num_input_tokens_seen is unused by default config

Co-authored-by: kangsheng <[email protected]>
  • Loading branch information
techkang and kangsheng authored Nov 4, 2024
1 parent 0a6795a commit bfa021b
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion src/transformers/trainer_callback.py
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,8 @@ class TrainerState:
The batch size for the training dataloader. Only needed when
`auto_find_batch_size` has been used.
num_input_tokens_seen (`int`, *optional*, defaults to 0):
The number of tokens seen during training (number of input tokens, not the number of prediction tokens).
When tracking the inputs tokens, the number of tokens seen during training (number of input tokens, not the
number of prediction tokens).
total_flos (`float`, *optional*, defaults to 0):
The total number of floating operations done by the model since the beginning of training (stored as floats
to avoid overflow).
Expand Down

0 comments on commit bfa021b

Please sign in to comment.