Skip to content

Commit

Permalink
[GPT-Neo] Simplify local attention (#13491)
Browse files Browse the repository at this point in the history 
* simplify local attention

* update tests

* add a comment and use torch.bitwise_xor
  • Loading branch information
@patil-suraj
patil-suraj authored Sep 10, 2021
1 parent a57d784 commit 010965d
Show file tree
Hide file tree
Showing 2 changed files with 156 additions and 509 deletions.
Loading

0 comments on commit 010965d

Please sign in to comment.