You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi,
I have a text classficitaion model (with 3 classes). My business logic consists of 2 partsPart A and Part B when in the in the post processing I apply another Binaric model that its input is the 2 predictions Part A^and Part B^ and classify it to a Binaric
So the flow is:
[Part A, PartB] -> Model_1(Part A), Model_1(Part B) -> Model2 (Model_1(Part A), Model_1(Part B))
How should I write the config in Triton to support such a scenario? I know I should use the ensemble, but it seem that ifI create 2 models, it would load 2 instances of Model_1 and I don't think it is neccesry.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hi,
I have a text classficitaion model (with 3 classes). My business logic consists of 2 parts
Part A and Part B
when in the in the post processing I apply another Binaric model that its input is the 2 predictionsPart A^
and Part B^
and classify it to a BinaricSo the flow is:
[Part A, PartB] -> Model_1(Part A), Model_1(Part B) -> Model2 (Model_1(Part A), Model_1(Part B))
How should I write the config in Triton to support such a scenario? I know I should use the ensemble, but it seem that ifI create 2 models, it would load 2 instances of Model_1 and I don't think it is neccesry.
Any help would be appreciated
Beta Was this translation helpful? Give feedback.
All reactions