Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] Dynamic length in static cache #30862

Draft
wants to merge 18 commits into
base: main
Choose a base branch
from
Draft

[WIP] Dynamic length in static cache #30862

wants to merge 18 commits into from
+55 −29

Commits on Jul 4, 2024

  1. Use cache_info

    @ydshieh
    ydshieh committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    9ab68d0 View commit details
    Browse the repository at this point in the history

  2. [run-slow] gemma

    @ydshieh
    ydshieh committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    81e795a View commit details
    Browse the repository at this point in the history

  3. [run-slow] gemma

    @ydshieh
    ydshieh committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    c1098f9 View commit details
    Browse the repository at this point in the history

  4. [run-slow] gemma

    @ydshieh
    ydshieh committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    b7eaf50 View commit details
    Browse the repository at this point in the history

  5. reconstruct cache_position from _length: 0001

    @ydshieh
    ydshieh committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    888a2c0 View commit details
    Browse the repository at this point in the history

  6. reconstruct cache_position from _length: 0002

    @ydshieh
    ydshieh committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    01cd35f View commit details
    Browse the repository at this point in the history

  7. reconstruct cache_position from _length: 0003

    @ydshieh
    ydshieh committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    f93b239 View commit details
    Browse the repository at this point in the history

  8. [run-slow] gemma

    @ydshieh
    ydshieh committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    8029b7f View commit details
    Browse the repository at this point in the history

  9. fix

    @ydshieh
    ydshieh committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    b6f30f5 View commit details
    Browse the repository at this point in the history

  10. [run-slow] gemma

    @ydshieh
    ydshieh committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    33ef0b1 View commit details
    Browse the repository at this point in the history

  11. remove cache info

    @ydshieh
    ydshieh committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    3ca52cf View commit details
    Browse the repository at this point in the history

  12. fix

    @ydshieh
    ydshieh committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    dcd292b View commit details
    Browse the repository at this point in the history

  13. [run-slow] gemma

    @ydshieh
    ydshieh committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    843876b View commit details
    Browse the repository at this point in the history

  14. fix

    @ydshieh
    ydshieh committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    f47f4a8 View commit details
    Browse the repository at this point in the history

  15. [run-slow] gemma

    @ydshieh
    ydshieh committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    8d4e17b View commit details
    Browse the repository at this point in the history

  16. fix

    @ydshieh
    ydshieh committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    84e694d View commit details
    Browse the repository at this point in the history

  17. [run-slow] gemma

    @ydshieh
    ydshieh committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    4df64e6 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2024

  1. fix

    @ydshieh
    ydshieh committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    450b1d2 View commit details
    Browse the repository at this point in the history