feat: implement the min_tokens sampling parameter#3124

Merged

simon-mo merged 14 commits intovllm-project:mainfrom tjohnson31415:min-new-tokens

Mar 25, 2024

+299-12

Commits on Feb 29, 2024

Commits on Mar 3, 2024

feat: implement _apply_min_tokens_penalty
tjohnson31415
committed

Commits on Mar 4, 2024

fix: determine stop tokens per seq group
tjohnson31415
committed

Commits on Mar 14, 2024

review/fix: actually set logits to -inf

tjohnson31415
and
njhill
authored

Commits on Mar 19, 2024

Commits on Mar 21, 2024

Merge remote-tracking branch 'upstream/main' into min-new-tokens
tjohnson31415
committed
refactor: simplify setting of eos_token_id

tjohnson31415
and
njhill
authored