Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

batched : add bench tool #3545

Merged
merged 7 commits into from
Oct 11, 2023
Merged

batched : add bench tool #3545

merged 7 commits into from
Oct 11, 2023

Commits on Oct 8, 2023

  1. batched : add bench tool

    @ggerganov
    ggerganov committed Oct 8, 2023
    Configuration menu
    Copy the full SHA
    bf06d65 View commit details
    Browse the repository at this point in the history

  2. batched : minor fix table

    @ggerganov
    ggerganov committed Oct 8, 2023
    Configuration menu
    Copy the full SHA
    7438728 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2023

  1. batched-bench : add readme + n_kv_max is now configurable

    @ggerganov
    ggerganov committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    026bb1b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into batched-bench

    @ggerganov
    ggerganov committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    76e17f8 View commit details
    Browse the repository at this point in the history

  3. batched-bench : init warm-up batch

    @ggerganov
    ggerganov committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    c062ffd View commit details
    Browse the repository at this point in the history

  4. batched-bench : pass custom set of PP, TG and PL

    @ggerganov
    ggerganov committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    daeb834 View commit details
    Browse the repository at this point in the history

  5. batched-bench : add mmq CLI arg

    @ggerganov
    ggerganov committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    2fcdf86 View commit details
    Browse the repository at this point in the history