Add phi-3 model support for pipeline parallel inference #6515
Job | Run time |
---|---|
1s | |
4s | |
2s | |
2s | |
3s | |
2s | |
3s | |
1m 1s | |
2m 36s | |
1m 15s | |
1m 53s | |
51s | |
1m 27s | |
0s | |
0s | |
9m 20s |
Job | Run time |
---|---|
1s | |
4s | |
2s | |
2s | |
3s | |
2s | |
3s | |
1m 1s | |
2m 36s | |
1m 15s | |
1m 53s | |
51s | |
1m 27s | |
0s | |
0s | |
9m 20s |