Skip to content

Commit

Permalink
fix(model_runtime): fix wrong max_tokens for Claude 3.5 Haiku on Amaz…
Browse files Browse the repository at this point in the history
…on Bedrock (#10286)
  • Loading branch information
mazyu36 authored and iamjoel committed Nov 7, 2024
1 parent 6ab6b9c commit e0e4a6f
Showing 1 changed file with 2 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -16,9 +16,9 @@ parameter_rules:
use_template: max_tokens
required: true
type: int
default: 4096
default: 8192
min: 1
max: 4096
max: 8192
help:
zh_Hans: 停止前生成的最大令牌数。请注意,Anthropic Claude 模型可能会在达到 max_tokens 的值之前停止生成令牌。不同的 Anthropic Claude 模型对此参数具有不同的最大值。
en_US: The maximum number of tokens to generate before stopping. Note that Anthropic Claude models might stop generating tokens before reaching the value of max_tokens. Different Anthropic Claude models have different maximum values for this parameter.
Expand Down

0 comments on commit e0e4a6f

Please sign in to comment.