Code

Feature/add sincos pos embed#416

Code

Merged

benjijamorris merged 3 commits intomainAllenCellModeling/cyto-dl:mainfrom feature/add_sincos_pos_embedAllenCellModeling/cyto-dl:feature/add_sincos_pos_embedCopy head branch name to clipboardAug 14, 2024

+65-11

Commits

Commits on Aug 13, 2024

• allow learnable and fixed positional embeddings

  

  Benjamin Morris

  committed
  50d9d53

Commits on Aug 14, 2024

• add positional-encodings

  

  Benjamin Morris

  committed
  61fe64d

• describe when to use fixed embeddings

  

  Benjamin Morris

  committed
  4f3f36b