Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Hardware][CPU] Cross-attention and Encoder-Decoder models support on CPU backend #9089

Merged
merged 16 commits into from
Oct 7, 2024
Merged

[Hardware][CPU] Cross-attention and Encoder-Decoder models support on CPU backend #9089

merged 16 commits into from
Oct 7, 2024

Commits on Oct 3, 2024

  1. draft

    @Isotr0py
    Isotr0py committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    89801d3 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2024

  1. SDPA enc-dec support

    @Isotr0py
    Isotr0py committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    489c772 View commit details
    Browse the repository at this point in the history

  2. init enc dec cpu runner

    @Isotr0py
    Isotr0py committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    339992a View commit details
    Browse the repository at this point in the history

  3. fix sdpa attn

    @Isotr0py
    Isotr0py committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    56fa7e6 View commit details
    Browse the repository at this point in the history

  4. fix numberic divergence

    @Isotr0py
    Isotr0py committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    59476b9 View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2024

  1. Merge branch 'vllm-project:main' into enc-dec-cpu

    @Isotr0py
    Isotr0py authored Oct 5, 2024
    Configuration menu
    Copy the full SHA
    d9093bb View commit details
    Browse the repository at this point in the history

  2. fix causal mask

    @Isotr0py
    Isotr0py committed Oct 5, 2024
    Configuration menu
    Copy the full SHA
    d1dc06b View commit details
    Browse the repository at this point in the history

  3. Merge branch 'enc-dec-cpu' of https://github.com/Isotr0py/vllm into e… 

    …nc-dec-cpu
    @Isotr0py
    Isotr0py committed Oct 5, 2024
    Configuration menu
    Copy the full SHA
    1e3791d View commit details
    Browse the repository at this point in the history

  4. fix batching enc dec

    @Isotr0py
    Isotr0py committed Oct 5, 2024
    Configuration menu
    Copy the full SHA
    870944f View commit details
    Browse the repository at this point in the history

  5. enable encoder decoder CPU test

    @Isotr0py
    Isotr0py committed Oct 5, 2024
    Configuration menu
    Copy the full SHA
    d5ad790 View commit details
    Browse the repository at this point in the history

  6. clean up print

    @Isotr0py
    Isotr0py committed Oct 5, 2024
    Configuration menu
    Copy the full SHA
    cb58542 View commit details
    Browse the repository at this point in the history

  7. code format

    @Isotr0py
    Isotr0py committed Oct 5, 2024
    Configuration menu
    Copy the full SHA
    5a7bd3d View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2024

  1. clean up

    @Isotr0py
    Isotr0py committed Oct 6, 2024
    Configuration menu
    Copy the full SHA
    29f99a9 View commit details
    Browse the repository at this point in the history

  2. code format

    @Isotr0py
    Isotr0py committed Oct 6, 2024
    Configuration menu
    Copy the full SHA
    955f060 View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. Merge branch 'vllm-project:main' into enc-dec-cpu

    @Isotr0py
    Isotr0py authored Oct 7, 2024
    Configuration menu
    Copy the full SHA
    6006118 View commit details
    Browse the repository at this point in the history

  2. fix cpu input type

    @Isotr0py
    Isotr0py committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    1e2d246 View commit details
    Browse the repository at this point in the history