Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SYCL] Fix cpy with dims of 3 #5289

Merged
merged 2 commits into from
Feb 5, 2024

Conversation

AidanBeltonS
Copy link
Contributor

This PR adds support for the cpy operator when the input has a 3rd dimension that is not 1. The approach is taken from the CUDA implementation to get tests passing with the SYCL backend. The tests were run on the SYCL-CUDA backend with an A100 GPU.

@AidanBeltonS
Copy link
Contributor Author

Copy link
Collaborator

@NeoZhangJianyu NeoZhangJianyu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's great to see your PR.

ggml-sycl.cpp Outdated Show resolved Hide resolved
ggml-sycl.cpp Outdated Show resolved Hide resolved
@abhilash1910
Copy link
Collaborator

LGTM for merge. @NeoZhangJianyu @ggerganov

@abhilash1910 abhilash1910 merged commit 4833ac2 into ggerganov:master Feb 5, 2024
53 checks passed
@AidanBeltonS AidanBeltonS deleted the fix_cpy_dims branch February 5, 2024 09:27
jordankanter pushed a commit to jordankanter/llama.cpp that referenced this pull request Mar 13, 2024
* Fix cpy with dims of 3

* rm asserts

---------

Co-authored-by: Abhilash Majumder <[email protected]>
hodlen pushed a commit to hodlen/llama.cpp that referenced this pull request Apr 1, 2024
* Fix cpy with dims of 3

* rm asserts

---------

Co-authored-by: Abhilash Majumder <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants