Skip to content
CI

ci: bench: support sse and fix prompt processing time / server: add tokens usage in stream OAI response #10374

Sign in to view logs

ci: bench: support sse and fix prompt processing time / server: add tokens usage in stream OAI response

ci: bench: support sse and fix prompt processing time / server: add tokens usage in stream OAI response #10374

windows-latest-cmake (avx2, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DBUILD_SHARED_LIBS=ON)

windows-latest-cmake (avx2, -DLLAMA_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DBUILD_SHARED_LIBS=ON)
succeeded Apr 4, 2024 in 5m 23s