Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Encountered cuda 710 error when optimizing BERT with nebullvm #100

Closed
valeriosofi opened this issue Oct 26, 2022 · 0 comments
Closed

Encountered cuda 710 error when optimizing BERT with nebullvm #100

valeriosofi opened this issue Oct 26, 2022 · 0 comments
Labels
problem Structural problem, requires huge commitment

Comments

@valeriosofi
Copy link
Collaborator

When optimizing BERT with nebullvm, the python process is killed with an error of PyTorch-TensorRT that causes a segmentation fault error:

CUDA initialization failure with error: 710. Please check your CUDA installation: http://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html
Segmentation fault (core dumped)

For now the problem can be avoided by setting ignore_compilers=["tensor RT"] as parameter in the optimize_model, function.
Must wait for the fix from Pytorch-TensorRT, the issue is reported here: pytorch/TensorRT#1418

@valeriosofi valeriosofi added the problem Structural problem, requires huge commitment label Oct 26, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
problem Structural problem, requires huge commitment
Projects
None yet
Development

No branches or pull requests

1 participant