ci: bench: support sse and fix prompt processing time / server: add tokens usage in stream OAI response #10374
| Job | Run time |
|---|---|
| 2m 6s | |
| 4m 19s | |
| 2m 6s | |
| 1m 17s | |
| 2m 13s | |
| 2m 20s | |
| 2m 24s | |
| 1m 1s | |
| 3m 58s | |
| 1m 21s | |
| 1m 18s | |
| 4m 19s | |
| 2m 59s | |
| 1m 52s | |
| 5m 43s | |
| 2m 33s | |
| 5m 34s | |
| 2m 28s | |
| 6m 3s | |
| 11m 47s | |
| 16m 51s | |
| 5m 23s | |
| 17m 27s | |
| 6m 14s | |
| 20m 20s | |
| 6m 4s | |
| 4m 0s | |
| 5m 7s | |
| 6m 1s | |
| 4m 46s | |
| 5m 18s | |
| 0s | |
| 2h 45m 12s |