Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] getting error when sending request to TIS after loading a TF4Rec PyT model #1502

Closed
rnyak opened this issue Apr 6, 2022 · 2 comments · Fixed by #1628
Closed

[BUG] getting error when sending request to TIS after loading a TF4Rec PyT model #1502

rnyak opened this issue Apr 6, 2022 · 2 comments · Fixed by #1628
Labels
bug Something isn't working P1
Milestone
Merlin 22.06

Comments

@rnyak
Copy link
Contributor

rnyak commented Apr 6, 2022

This happens when serving end-to-end-notebook example to Triton. This is related to export_pytorch_ensemble is not generating the configs properly.

Please refer to this issue on TF4Rec repo to repro: NVIDIA-Merlin/Transformers4Rec#400
@rnyak rnyak added the bug Something isn't working label Apr 6, 2022
@rnyak rnyak changed the title [BUG] getting error when sending request to TIS #400 [BUG] getting error when sending request to TIS Apr 6, 2022
@rnyak rnyak changed the title [BUG] getting error when sending request to TIS [BUG] getting error when sending request to TIS after loading a TF4Rec PyT model Apr 6, 2022
@rnyak rnyak added this to the Merlin 22.05 milestone Apr 6, 2022
@viswa-nvidia
Copy link

@EvenOldridge , Please assign an engineer for this bug

@viswa-nvidia
Copy link

Reduced priority to P1

@karlhigley karlhigley linked a pull request Jul 20, 2022 that will close this issue
Fix PyTorch export/serving with Python back-end for T4R notebooks #1628
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working P1
Projects
None yet
Milestone
Merlin 22.06
Development

Successfully merging a pull request may close this issue.

Fix PyTorch export/serving with Python back-end for T4R notebooks karlhigley/NVTabular
2 participants
@rnyak @viswa-nvidia