ModelTC lightllm Q A · Discussions · GitHub

[Query] 请问lightllm支持llama2模型的多batch推理吗？
Q&A ChristineSeven

Sort by: Latest activity

Categories

Community guidelines

Q&A Discussions

Ask the community for help

You must be logged in to vote

What parameters required for using quantized llama2 models?

suhjohn asked Sep 22, 2023 in Q&A · Unanswered

1
You must be logged in to vote

ROCm support

ehartford asked Sep 16, 2023 in Q&A · Unanswered

0
You must be logged in to vote

[Query] 请问lightllm支持llama2模型的多batch推理吗？

ChristineSeven asked Sep 6, 2023 in Q&A · Unanswered

0