Add device-specific request validation in LLMEngine and modify request-specific asserts in TTModelRunner to not crash server instances#41

Merged

skhorasganiTT merged 1 commit intodevfrom skhorasgani/fix_request_validation

Dec 10, 2024

+56-20

Commits on Dec 10, 2024

Add device-specific request validation in LLMEngine and modify request-specific asserts in TTModelRunner to not crash server instances
skhorasganiTT
committed