[release branch] Add infer request queue for tokenizers and allow for optional plugin_config in tokenizer #1053
Job | Run time |
---|---|
15m 0s | |
9m 7s | |
12m 13s | |
9m 55s | |
18m 23s | |
18m 38s | |
1h 23m 16s |
Job | Run time |
---|---|
15m 0s | |
9m 7s | |
12m 13s | |
9m 55s | |
18m 23s | |
18m 38s | |
1h 23m 16s |