LLM: Refactor Pipeline-Parallel-FastAPI example (#11319) #6669
Job | Run time |
---|---|
1s | |
2s | |
1s | |
3s | |
2s | |
2s | |
1s | |
2m 41s | |
1m 6s | |
1m 19s | |
1m 23s | |
1m 15s | |
2m 8s | |
28m 16s | |
1m 50s | |
15m 5s | |
23m 37s | |
1h 18m 52s |
Job | Run time |
---|---|
1s | |
2s | |
1s | |
3s | |
2s | |
2s | |
1s | |
2m 41s | |
1m 6s | |
1m 19s | |
1m 23s | |
1m 15s | |
2m 8s | |
28m 16s | |
1m 50s | |
15m 5s | |
23m 37s | |
1h 18m 52s |