Skip to content
Back to pull request #6495

ci: bench: support sse and fix prompt processing time / server: add tokens usage in stream OAI response #10374

Sign in to view logs

ci: bench: support sse and fix prompt processing time / server: add tokens usage in stream OAI response

ci: bench: support sse and fix prompt processing time / server: add tokens usage in stream OAI response #10374

Annotations

1 error

windows-latest-cmake (avx512, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_AVX512=ON -DBUIL...

windows-latest-cmake (avx512, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DLLAMA_AVX512=ON -DBUIL...
succeeded Apr 5, 2024 in 20m 20s