Skip to content

Commit

Permalink
[Bugfix]: Fix the logic for deciding if tool parsing is used (vllm-pr…
Browse files Browse the repository at this point in the history
  • Loading branch information
tomeras91 authored and MengqingCao committed Sep 30, 2024
1 parent b1ea1c7 commit c19359e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion vllm/entrypoints/openai/serving_chat.py
Original file line number Diff line number Diff line change
Expand Up @@ -607,7 +607,7 @@ async def chat_completion_full_generator(

# if auto tools are not enabled, and a named tool choice using
# outlines is not being used
if not (self.enable_auto_tools
if (not self.enable_auto_tools
or not self.tool_parser) and not isinstance(
request.tool_choice,
ChatCompletionNamedToolChoiceParam):
Expand Down

0 comments on commit c19359e

Please sign in to comment.