Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

✨[Feature] A CLI arg to load torch custom op libraries for compilation #877

Closed
narendasan opened this issue Feb 16, 2022 · 1 comment
Closed
Assignees
Labels

Comments

@narendasan
Copy link
Collaborator

Is your feature request related to a problem? Please describe.

Right now compilation will fail with torchtrtc if you use custom operators, i.e. ops defined by libraries other than torch. This is because the PyTorch operator registry is missing information about these operators and so when trying to deserialize, TorchScript does not know what to do

This includes torchvision and torch_squeeze (#876 )

Describe the solution you'd like

Be able to add paths to .so files that need to be DL_OPEN before compilation so that custom ops are available for deserialization.

Describe alternatives you've considered

Right now the work around is to use C++ or Python with the libraries imported by the user

Additional context

@narendasan narendasan added the feature request New feature or request label Feb 16, 2022
@narendasan narendasan self-assigned this Feb 16, 2022
@github-actions
Copy link

This issue has not seen activity for 90 days, Remove stale label or comment or this will be closed in 10 days

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants