Add phi-3 model support for pipeline parallel inference (#11334) #6522
Job | Run time |
---|---|
3s | |
4s | |
3s | |
3s | |
2s | |
7s | |
2s | |
49s | |
1m 24s | |
2m 22s | |
1m 0s | |
1m 14s | |
56s | |
10m 10s | |
27m 46s | |
15m 25s | |
27m 5s | |
1h 28m 35s |
Job | Run time |
---|---|
3s | |
4s | |
3s | |
3s | |
2s | |
7s | |
2s | |
49s | |
1m 24s | |
2m 22s | |
1m 0s | |
1m 14s | |
56s | |
10m 10s | |
27m 46s | |
15m 25s | |
27m 5s | |
1h 28m 35s |