Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Encoder Decoder] Add flash_attn kernel support for encoder-decoder models #9559

Merged
merged 104 commits into from
Nov 2, 2024
Merged

[Encoder Decoder] Add flash_attn kernel support for encoder-decoder models #9559

merged 104 commits into from
Nov 2, 2024

Commits on May 29, 2024

  1. Merge pull request #1 from vllm-project/main 

    Pull from head
    @sroy745
    sroy745 authored May 29, 2024
    Configuration menu
    Copy the full SHA
    5650b95 View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 3, 2024
    Configuration menu
    Copy the full SHA
    8f36146 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 3, 2024
    Configuration menu
    Copy the full SHA
    9e75057 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 7, 2024
    Configuration menu
    Copy the full SHA
    db2c679 View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 10, 2024
    Configuration menu
    Copy the full SHA
    8d7512c View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 12, 2024
    Configuration menu
    Copy the full SHA
    1473f74 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 14, 2024
    Configuration menu
    Copy the full SHA
    4013e1a View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 17, 2024
    Configuration menu
    Copy the full SHA
    2dbdd78 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 20, 2024
    Configuration menu
    Copy the full SHA
    b3575e9 View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 24, 2024
    Configuration menu
    Copy the full SHA
    94b0d43 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 27, 2024
    Configuration menu
    Copy the full SHA
    fa8fedf View commit details
    Browse the repository at this point in the history

  2. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 27, 2024
    Configuration menu
    Copy the full SHA
    6ed96b4 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 28, 2024
    Configuration menu
    Copy the full SHA
    b71c533 View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jun 29, 2024
    Configuration menu
    Copy the full SHA
    57babef View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jul 1, 2024
    Configuration menu
    Copy the full SHA
    4b19bac View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jul 6, 2024
    Configuration menu
    Copy the full SHA
    eb7a1c4 View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jul 10, 2024
    Configuration menu
    Copy the full SHA
    7e2c87e View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jul 15, 2024
    Configuration menu
    Copy the full SHA
    6212d5f View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jul 17, 2024
    Configuration menu
    Copy the full SHA
    5491438 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Jul 31, 2024
    Configuration menu
    Copy the full SHA
    68e080a View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Aug 13, 2024
    Configuration menu
    Copy the full SHA
    55e4332 View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Aug 22, 2024
    Configuration menu
    Copy the full SHA
    532eb48 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Aug 22, 2024
    Configuration menu
    Copy the full SHA
    7cea056 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Aug 24, 2024
    Configuration menu
    Copy the full SHA
    185e056 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Aug 27, 2024
    Configuration menu
    Copy the full SHA
    e2be95f View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Aug 28, 2024
    Configuration menu
    Copy the full SHA
    2ed5473 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Aug 29, 2024
    Configuration menu
    Copy the full SHA
    efa4714 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Aug 29, 2024
    Configuration menu
    Copy the full SHA
    fb87d34 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Aug 31, 2024
    Configuration menu
    Copy the full SHA
    5419e49 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Sep 2, 2024
    Configuration menu
    Copy the full SHA
    9ba12f8 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Sep 3, 2024
    Configuration menu
    Copy the full SHA
    25cef3d View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Sep 4, 2024
    Configuration menu
    Copy the full SHA
    9d4cd09 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Sep 5, 2024
    Configuration menu
    Copy the full SHA
    c48cacb View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Sep 7, 2024
    Configuration menu
    Copy the full SHA
    c42c399 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Sep 9, 2024
    Configuration menu
    Copy the full SHA
    3d13e43 View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Sep 11, 2024
    Configuration menu
    Copy the full SHA
    7479775 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    df9b966 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    9a7ed92 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    118e838 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Sep 20, 2024
    Configuration menu
    Copy the full SHA
    e640c69 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Sep 23, 2024
    Configuration menu
    Copy the full SHA
    89fb6cd View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    5d886cc View commit details
    Browse the repository at this point in the history

  2. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    56f2065 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Sep 25, 2024
    Configuration menu
    Copy the full SHA
    28e103e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Sep 25, 2024
    Configuration menu
    Copy the full SHA
    2fc1490 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    8805750 View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Sep 28, 2024
    Configuration menu
    Copy the full SHA
    b30e5af View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Sep 30, 2024
    Configuration menu
    Copy the full SHA
    92322f1 View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Oct 1, 2024
    Configuration menu
    Copy the full SHA
    85e9001 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Oct 1, 2024
    Configuration menu
    Copy the full SHA
    cd4ff89 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Oct 1, 2024
    Configuration menu
    Copy the full SHA
    0dd96ed View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Oct 3, 2024
    Configuration menu
    Copy the full SHA
    9d4d969 View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Oct 5, 2024
    Configuration menu
    Copy the full SHA
    7d223b5 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Oct 5, 2024
    Configuration menu
    Copy the full SHA
    f327d91 View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Oct 6, 2024
    Configuration menu
    Copy the full SHA
    b5adf28 View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Oct 7, 2024
    Configuration menu
    Copy the full SHA
    caf0d12 View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    28e77b1 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Oct 9, 2024
    Configuration menu
    Copy the full SHA
    db7e46d View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Oct 17, 2024
    Configuration menu
    Copy the full SHA
    59b35f0 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Oct 17, 2024
    Configuration menu
    Copy the full SHA
    dd9affa View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Oct 21, 2024
    Configuration menu
    Copy the full SHA
    f61a15d View commit details
    Browse the repository at this point in the history

  2. Add flash attn kernel support for encoder-decoder models

    @sroy745
    sroy745 committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    b3f42ed View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2024

  1. Run with flash attn

    @sroy745
    sroy745 committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    551008e View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. Flash Attn support

    @sroy745
    sroy745 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    99cfaf1 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. Some more fixes

    @sroy745
    sroy745 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    1e1fb57 View commit details
    Browse the repository at this point in the history

  2. More fixes

    @sroy745
    sroy745 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    e16cbcb View commit details
    Browse the repository at this point in the history

  3. More fixes to model_runner

    @sroy745
    sroy745 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    1b2c060 View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2024

  1. Fixes

    @sroy745
    sroy745 committed Oct 26, 2024
    Configuration menu
    Copy the full SHA
    b619e32 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Oct 27, 2024
    Configuration menu
    Copy the full SHA
    0569773 View commit details
    Browse the repository at this point in the history

  2. commits

    @sroy745
    sroy745 committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    ffd82c0 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into sroy-vllm-encdec-flash

    @sroy745
    sroy745 authored Oct 27, 2024
    Configuration menu
    Copy the full SHA
    d5f478e View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/main' into sroy-vllm-encdec-flash

    @sroy745
    sroy745 committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    a1c2e7c View commit details
    Browse the repository at this point in the history

  5. Merge branch 'sroy-vllm-encdec-flash' of https://github.com/sroy745/vllm 

     into sroy-vllm-encdec-flash
    @sroy745
    sroy745 committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    2adb7fd View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2024

  1. Fixes

    @sroy745
    sroy745 committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    d995221 View commit details
    Browse the repository at this point in the history

  2. Format

    @sroy745
    sroy745 committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    d1f8140 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into sroy-vllm-encdec-flash

    @sroy745
    sroy745 authored Oct 28, 2024
    Configuration menu
    Copy the full SHA
    b438166 View commit details
    Browse the repository at this point in the history

  4. Remove unused import

    @sroy745
    sroy745 committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    d99370c View commit details
    Browse the repository at this point in the history

  5. Reverting layer changes

    @sroy745
    sroy745 committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    11bda4f View commit details
    Browse the repository at this point in the history

  6. Fixes

    @sroy745
    sroy745 committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    040f61e View commit details
    Browse the repository at this point in the history

Commits on Oct 29, 2024

  1. Fixes

    @sroy745
    sroy745 committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    1bc6fe1 View commit details
    Browse the repository at this point in the history

  2. Format

    @sroy745
    sroy745 committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    4573f8f View commit details
    Browse the repository at this point in the history

  3. Fix test reset logic

    @sroy745
    sroy745 committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    ed587cb View commit details
    Browse the repository at this point in the history

  4. Fixes

    @sroy745
    sroy745 committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    18e8a97 View commit details
    Browse the repository at this point in the history

  5. Dummu

    @sroy745
    sroy745 committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    9f7dc04 View commit details
    Browse the repository at this point in the history

  6. Fix

    @sroy745
    sroy745 committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    fce7f62 View commit details
    Browse the repository at this point in the history

  7. Dummy

    @sroy745
    sroy745 committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    d596c23 View commit details
    Browse the repository at this point in the history

  8. Format

    @sroy745
    sroy745 committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    7bed5e6 View commit details
    Browse the repository at this point in the history

  9. Format

    @sroy745
    sroy745 committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    3a7d05e View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2024

  1. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Oct 30, 2024
    Configuration menu
    Copy the full SHA
    a2090e0 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into sroy-vllm-encdec-flash

    @sroy745
    sroy745 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    a1e8c98 View commit details
    Browse the repository at this point in the history

  3. Comments

    @sroy745
    sroy745 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    0604c0a View commit details
    Browse the repository at this point in the history

  4. Format

    @sroy745
    sroy745 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    77ee5e2 View commit details
    Browse the repository at this point in the history

  5. Comments

    @sroy745
    sroy745 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    b147fb9 View commit details
    Browse the repository at this point in the history

  6. Comment

    @sroy745
    sroy745 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    7284de5 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2024

  1. Comments

    @sroy745
    sroy745 committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    282a918 View commit details
    Browse the repository at this point in the history

  2. Comments

    @sroy745
    sroy745 committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    c39d4c9 View commit details
    Browse the repository at this point in the history

  3. Comments

    @sroy745
    sroy745 committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    cc58ebe View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into sroy-vllm-encdec-flash

    @sroy745
    sroy745 authored Nov 1, 2024
    Configuration menu
    Copy the full SHA
    5785714 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'vllm-project:main' into main

    @sroy745
    sroy745 authored Nov 1, 2024
    Configuration menu
    Copy the full SHA
    c9a3f00 View commit details
    Browse the repository at this point in the history

  6. Comments

    @sroy745
    sroy745 committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    834572f View commit details
    Browse the repository at this point in the history

  7. Merge remote-tracking branch 'origin/main' into sroy-vllm-encdec-flash

    @sroy745
    sroy745 committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    15dc714 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'main' into sroy-vllm-encdec-flash

    @sroy745
    sroy745 authored Nov 1, 2024
    Configuration menu
    Copy the full SHA
    21946be View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2024

  1. Dummy

    @sroy745
    sroy745 committed Nov 2, 2024
    Configuration menu
    Copy the full SHA
    2264a62 View commit details
    Browse the repository at this point in the history

  2. Format

    @sroy745
    sroy745 committed Nov 2, 2024
    Configuration menu
    Copy the full SHA
    7ca0ab7 View commit details
    Browse the repository at this point in the history