Skip to content

Commit

Permalink
Add mamba-minimal
Browse files Browse the repository at this point in the history 
- Add stateless forward impl.
  - Efficient for training (but training is not yet implemented).
  - Input requires the entire sequence, and requires no state cache.
  - Generates one output for each input sequence.
- Add stateful forward impl.
  - Efficient for inference.
  - Input requires the last single sequence point, and requires the last state cache.
  - Generates a single output referring to the last input.
  • Loading branch information
@swfsql
swfsql committed Feb 9, 2024
1 parent b77719a commit 1005250
Show file tree
Hide file tree
Showing 2 changed files with 1,108 additions and 0 deletions.
Loading

0 comments on commit 1005250

Please sign in to comment.