[Bugfix] Support logprobs when using guided_json and other constrained decoding fields#4149

Merged

simon-mo merged 3 commits intovllm-project:mainfrom team-telnyx:main

Apr 18, 2024

+33-1

Commits on Apr 17, 2024

match openai's json serializable behavior for very unlikely token logprobs (-9999.0)
jamestwhedbee
committed

Commits on Apr 18, 2024