Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: Enable Prefix caching kernel on Pallas for TPU backend #7607

Open
miladm opened this issue Aug 16, 2024 · 1 comment
Open

[Feature]: Enable Prefix caching kernel on Pallas for TPU backend #7607

miladm opened this issue Aug 16, 2024 · 1 comment
Labels
feature request stale tpu Related to Google TPUs

Comments

@miladm
Copy link

miladm commented Aug 16, 2024

🚀 The feature, motivation and pitch

Enable Prefix caching kernel on Pallas for TPU backend

According to @WoosukKwon, we have a Triton and CUDA kernel implementations.

@WoosukKwon WoosukKwon added the tpu Related to Google TPUs label Aug 17, 2024
Copy link

This issue has been automatically marked as stale because it has not had any activity within 90 days. It will be automatically closed if no further activity occurs within 30 days. Leave a comment if you feel this issue should remain open. Thank you!

@github-actions github-actions bot added the stale label Nov 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request stale tpu Related to Google TPUs
Projects
None yet
Development

No branches or pull requests

2 participants