Skip to content

Commit

Permalink
refine
Browse files Browse the repository at this point in the history
  • Loading branch information
xiangyuT committed Mar 25, 2024
1 parent 7b8c7ae commit d7e9700
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion python/llm/src/ipex_llm/transformers/speculative.py
Original file line number Diff line number Diff line change
Expand Up @@ -57,7 +57,7 @@ def generate(
_enable_ipex = get_enable_ipex()
if _enable_ipex and inputs.size(1) < 256:
logger.warning(
"IPEX optimized models have issues for speculative decoding with short prompts"
"IPEX_CPU optimized models have issues for speculative decoding with short prompts"
"(length < 256). Using normal generate() method instead."
)
for var in ['max_step_draft', 'th_stop_draft', 'hf_adjust',
Expand Down

0 comments on commit d7e9700

Please sign in to comment.