Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GPTQ & AWQ Fused MOE #2761

Open
wants to merge 29 commits into
base: main
Choose a base branch
from
Open

GPTQ & AWQ Fused MOE #2761

wants to merge 29 commits into from

Commits on Feb 4, 2024

  1. Add kernel

    @chu-tianxiang
    chu-tianxiang committed Feb 4, 2024
    Configuration menu
    Copy the full SHA
    2d970c5 View commit details
    Browse the repository at this point in the history

Commits on Feb 5, 2024

  1. Add group gemm kernel for gptq

    @chu-tianxiang
    chu-tianxiang committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    281354a View commit details
    Browse the repository at this point in the history

  2. Add dequant kernel

    @chu-tianxiang
    chu-tianxiang committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    2a1c106 View commit details
    Browse the repository at this point in the history

Commits on Feb 6, 2024

  1. Add awq supprt

    @chu-tianxiang
    chu-tianxiang committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    e9846d0 View commit details
    Browse the repository at this point in the history

  2. Add test

    @chu-tianxiang
    chu-tianxiang committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    a9d65a9 View commit details
    Browse the repository at this point in the history

  3. format

    @chu-tianxiang
    chu-tianxiang committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    7dea006 View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2024

  1. Merge main and fix problem in kernel

    @chu-tianxiang
    chu-tianxiang committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    dfbb034 View commit details
    Browse the repository at this point in the history

  2. format

    @chu-tianxiang
    chu-tianxiang committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    46d15fb View commit details
    Browse the repository at this point in the history

Commits on Feb 16, 2024

  1. Merge main and fix conflicts

    @chu-tianxiang
    chu-tianxiang committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    78e6e70 View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2024

  1. Fix unit test

    @chu-tianxiang
    chu-tianxiang committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    6b3e23e View commit details
    Browse the repository at this point in the history

Commits on Feb 24, 2024

  1. Merge branch 'main' into moe_exp

    @chu-tianxiang
    chu-tianxiang committed Feb 24, 2024
    Configuration menu
    Copy the full SHA
    238f544 View commit details
    Browse the repository at this point in the history

  2. Add guard for awq unit test

    @chu-tianxiang
    chu-tianxiang committed Feb 24, 2024
    Configuration menu
    Copy the full SHA
    d43445e View commit details
    Browse the repository at this point in the history

  3. Fix format

    @chu-tianxiang
    chu-tianxiang committed Feb 24, 2024
    Configuration menu
    Copy the full SHA
    2c68478 View commit details
    Browse the repository at this point in the history

  4. test

    @chu-tianxiang
    chu-tianxiang committed Feb 24, 2024
    Configuration menu
    Copy the full SHA
    2c27dcc View commit details
    Browse the repository at this point in the history

Commits on Feb 27, 2024

  1. merge main

    @chu-tianxiang
    chu-tianxiang committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    c1b98ef View commit details
    Browse the repository at this point in the history

  2. Fix import

    @chu-tianxiang
    chu-tianxiang committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    68d34af View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into moe_exp

    @chu-tianxiang
    chu-tianxiang committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    6e69101 View commit details
    Browse the repository at this point in the history

  4. fix format

    @chu-tianxiang
    chu-tianxiang committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    d956844 View commit details
    Browse the repository at this point in the history

Commits on Feb 29, 2024

  1. Merge main and fix conflicts

    @chu-tianxiang
    chu-tianxiang committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    f19ddfb View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2024

  1. Adapt gptq dequant to 3/8-bit

    @chu-tianxiang
    chu-tianxiang committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    7a4ba90 View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2024

  1. Merge main branch

    @chu-tianxiang
    chu-tianxiang committed Mar 3, 2024
    Configuration menu
    Copy the full SHA
    2fe491d View commit details
    Browse the repository at this point in the history

  2. Fix marlin

    @chu-tianxiang
    chu-tianxiang committed Mar 3, 2024
    Configuration menu
    Copy the full SHA
    4ef69d5 View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2024

  1. Merge main branch and fix conflicts

    @chu-tianxiang
    chu-tianxiang committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    7a11506 View commit details
    Browse the repository at this point in the history

  2. Fix format check

    @chu-tianxiang
    chu-tianxiang committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    9d6f7d1 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2024

  1. Merge main

    @chu-tianxiang
    chu-tianxiang committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    d08c4fa View commit details
    Browse the repository at this point in the history

  2. Fix isort

    @chu-tianxiang
    chu-tianxiang committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    4faebc3 View commit details
    Browse the repository at this point in the history

  3. Fix format

    @chu-tianxiang
    chu-tianxiang committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    e8b2127 View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2024

  1. Replace expert parallel with tensor parallel

    @chu-tianxiang
    chu-tianxiang committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    1922e83 View commit details
    Browse the repository at this point in the history

  2. Fix typo

    @chu-tianxiang
    chu-tianxiang committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    8bc089f View commit details
    Browse the repository at this point in the history