Skip to content

Commit

Permalink
[CINN]Add qkv unpack attn (PaddlePaddle#64439)
Browse files Browse the repository at this point in the history 
* add fast infer attention

* remove usless code

* fix rocm compile bug

* polish code

* fix conflict

* remove depulicate
  • Loading branch information
@phlrain @chen2016013
phlrain authored and chen2016013 committed May 26, 2024
1 parent 82c1ac9 commit 49db1eb
Show file tree
Hide file tree
Showing 2 changed files with 532 additions and 0 deletions.
Loading

0 comments on commit 49db1eb

Please sign in to comment.