Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is there any way to insert thirdparty api call in Triton? #4837

Open
juinshell opened this issue Oct 2, 2024 · 1 comment
Open

Is there any way to insert thirdparty api call in Triton? #4837

juinshell opened this issue Oct 2, 2024 · 1 comment

Comments

@juinshell
Copy link

juinshell commented Oct 2, 2024

Hello! Currently I need to use some NVIDIA Library API(like NVSHMEM) that I think not be support currently in Triton. So I want to know If the user needs to insert some custom or third-party api call (with parameters related to threadIdx or blockIdx) into triton cuda kernel, can this be done as efficiently and concisely as possible?

The followings are some references I found:

Thanks for any help anyone could give.

@juinshell
Copy link
Author

https://github.com/triton-lang/triton/blob/main/python/triton/tools/compile.py can export CUBIN as a CUDA kernel which cannot be changed by the user. I thought the seem goes equally to export PTX. It may lead to complex errors in execution and be difficult to debug.

@juinshell juinshell changed the title Is there any way to insert NVSHMEM api? Is there any way to insert thirdparty api call in Triton? Oct 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant