Concurrency safety issues in Triton Server streaming inference #6214
-
Is there a thread safety issue in |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 2 replies
-
Thanks for identifying and reporting this. If this is a race condition, we have not yet seen it reported. It's good to be proactive though. CC: @tanmayv25, who wrote this code. It's 3 years old, so a lot of context might be gone. Let me know if you want me to convert this into an issue and create a ticket for us to investigate. |
Beta Was this translation helpful? Give feedback.
Of course. We greatly appreciate you reviewing the code and relaying this to us. Converting to issue for tracking purposes: #6245.
We can continue discussion there.