allowed getting n_batch from llama_context in c api #7020
Job | Run time |
---|---|
1m 28s | |
2m 49s | |
14s | |
14s | |
2m 8s | |
1s | |
1m 34s | |
10s | |
1s | |
1m 38s | |
1m 44s | |
5m 45s | |
1m 46s | |
3m 49s | |
15m 50s | |
6m 7s | |
2m 14s | |
5m 29s | |
2m 59s | |
2m 52s | |
6m 55s | |
3m 53s | |
2m 23s | |
16m 10s | |
2m 25s | |
15m 44s | |
0s | |
1h 46m 22s |