Skip to content

ci: bench: support sse and fix prompt processing time / server: add tokens usage in stream OAI response #3776

ci: bench: support sse and fix prompt processing time / server: add tokens usage in stream OAI response

ci: bench: support sse and fix prompt processing time / server: add tokens usage in stream OAI response #3776

Annotations

1 warning

nix-eval (ubuntu-latest)

succeeded Apr 4, 2024 in 2m 18s