Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Optimization] Implicit gemm rewrite #2545

Open
wants to merge 66 commits into
base: main
Choose a base branch
from
Open

[Optimization] Implicit gemm rewrite #2545

wants to merge 66 commits into from
+1,852 −159

Commits on Oct 19, 2024

  1. Add SPIR-V backend

    @wingertge
    wingertge committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    116a582 View commit details
    Browse the repository at this point in the history

  2. Update READMEs

    @wingertge
    wingertge committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    5eb4dfe View commit details
    Browse the repository at this point in the history

  3. More doc updates and testing

    @wingertge
    wingertge committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    6f8f589 View commit details
    Browse the repository at this point in the history

  4. Ensure SPIR-V tests actually run

    @wingertge
    wingertge committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    636b280 View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2024

  1. Disable SPIR-V tests if WGPU is disabled in general

    @wingertge
    wingertge committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    325f659 View commit details
    Browse the repository at this point in the history

  2. Disable SPIR-V tests on MacOS

    @wingertge
    wingertge committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    00a3036 View commit details
    Browse the repository at this point in the history

  3. Update cubecl

    @wingertge
    wingertge committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    08f212f View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into feat/wgpu-spirv-backend

    @wingertge
    wingertge committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    1cf435a View commit details
    Browse the repository at this point in the history

  5. Disable SPIR-V CI tests until I can figure out what causes the segfau… 

    …lt in CPU execution
    @wingertge
    wingertge committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    44f116e View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into feat/wgpu-spirv-backend

    @wingertge
    wingertge committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    351cf07 View commit details
    Browse the repository at this point in the history

  7. Reenable SPIR-V tests to see if fixes work

    @wingertge
    wingertge committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    bf81855 View commit details
    Browse the repository at this point in the history

  8. Temporarily point to fork to check fixes

    @wingertge
    wingertge committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    2c124ae View commit details
    Browse the repository at this point in the history

  9. Revert to main

    @wingertge
    wingertge committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    9eecef1 View commit details
    Browse the repository at this point in the history

  10. Disable SPIR-V tests on CI

    @wingertge
    wingertge committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    19a9f3f View commit details
    Browse the repository at this point in the history

  11. More conv2d benches

    @wingertge
    wingertge committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    82d4a58 View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2024

  1. Optimize implicit GEMM

    @wingertge
    wingertge committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    27b93a5 View commit details
    Browse the repository at this point in the history

  2. Ensure weight isn't vectorized if it's loaded directly

    @wingertge
    wingertge committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    3bfdfd6 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into opt/implicit_gemm

    @wingertge
    wingertge committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    7535046 View commit details
    Browse the repository at this point in the history

  4. Implement tf32 for implicit GEMM

    @wingertge
    wingertge committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    95822d0 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2024

  1. Fixes

    @wingertge
    wingertge committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    d472a17 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into opt/implicit_gemm

    @wingertge
    wingertge committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    efe36e1 View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2024

  1. Make reduce checked since we're still getting segfaults

    @wingertge
    wingertge committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    7543f7b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into opt/implicit_gemm

    @wingertge
    wingertge committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    b17713e View commit details
    Browse the repository at this point in the history

  3. Make bicubic interp checked

    @wingertge
    wingertge committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    07bd12f View commit details
    Browse the repository at this point in the history

  4. Undo direct weight loader because it was backfiring

    @wingertge
    wingertge committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    ea9e872 View commit details
    Browse the repository at this point in the history

  5. Undo version change

    @wingertge
    wingertge committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    449e464 View commit details
    Browse the repository at this point in the history

  6. Use git version of cubecl

    @wingertge
    wingertge committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    a95b692 View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2024

  1. Update cubecl

    @wingertge
    wingertge committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    6577812 View commit details
    Browse the repository at this point in the history

  2. Use select to ensure correctness in bilinear interpolate

    @wingertge
    wingertge committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    ca64d18 View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2024

  1. Disable reduce_dim_subcube if warp size isn't known, to prevent poten… 

    …tial issues on AMD
    @wingertge
    wingertge committed Nov 18, 2024
    Configuration menu
    Copy the full SHA
    83adb2f View commit details
    Browse the repository at this point in the history

  2. Initial commit

    @wingertge
    wingertge committed Nov 18, 2024
    Configuration menu
    Copy the full SHA
    8dd1a39 View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2024

  1. Broken version

    @wingertge
    wingertge committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    5f9ce2f View commit details
    Browse the repository at this point in the history

  2. a

    @wingertge
    wingertge committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    8971d23 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into feat/conv2d-benches

    @wingertge
    wingertge committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    3157e93 View commit details
    Browse the repository at this point in the history

  4. Use more descriptive naming

    @wingertge
    wingertge committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    34e460a View commit details
    Browse the repository at this point in the history

Commits on Nov 24, 2024

  1. Add custom NCHW to NHWC kernel to speed up implicit GEMM

    @wingertge
    wingertge committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    b1f8af1 View commit details
    Browse the repository at this point in the history

  2. Tune block size

    @wingertge
    wingertge committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    83601aa View commit details
    Browse the repository at this point in the history

  3. Cleanup

    @wingertge
    wingertge committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    3b65d28 View commit details
    Browse the repository at this point in the history

  4. Simplify swizzle

    @wingertge
    wingertge committed Nov 24, 2024
    Configuration menu
    Copy the full SHA
    8b3b0df View commit details
    Browse the repository at this point in the history

Commits on Nov 25, 2024

  1. Migrate

    @wingertge
    wingertge committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    47e9a83 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'opt/conv-custom-transpose' into opt/implicit-gemm-rewrite

    @wingertge
    wingertge committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    42c73b1 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into opt/implicit-gemm-rewrite

    @wingertge
    wingertge committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    3257cbd View commit details
    Browse the repository at this point in the history

  4. Merge branch 'feat/conv2d-benches' into opt/implicit-gemm-rewrite

    @wingertge
    wingertge committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    6853af4 View commit details
    Browse the repository at this point in the history

  5. Revert default conv to 16x16

    @wingertge
    wingertge committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    55e207b View commit details
    Browse the repository at this point in the history

  6. Check k bounds

    @wingertge
    wingertge committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    ad307c8 View commit details
    Browse the repository at this point in the history

  7. Attempt fixes

    @wingertge
    wingertge committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    d488193 View commit details
    Browse the repository at this point in the history

  8. Update matmul

    @nathanielsimard
    nathanielsimard committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    41f2069 View commit details
    Browse the repository at this point in the history

Commits on Nov 26, 2024

  1. Fix bias loading, refactor

    @wingertge
    wingertge committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    d8d8ccf View commit details
    Browse the repository at this point in the history

  2. Refactor and documentation

    @wingertge
    wingertge committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    25a8adb View commit details
    Browse the repository at this point in the history

  3. Refactor

    @wingertge
    wingertge committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    774e49f View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into opt/implicit-gemm-rewrite

    @wingertge
    wingertge committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    7b50d93 View commit details
    Browse the repository at this point in the history

  5. Revert accidental changes

    @wingertge
    wingertge committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    378a77c View commit details
    Browse the repository at this point in the history

  6. Add newline

    @wingertge
    wingertge committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    70b4532 View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2024

  1. Update cubecl

    @wingertge
    wingertge committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    55cfbb5 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/matmulupdate' into opt/implici… 

    …t-gemm-rewrite
    @wingertge
    wingertge committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    100780e View commit details
    Browse the repository at this point in the history

  3. Vectorize SMEM for implicit_gemm

    @wingertge
    wingertge committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    3f17791 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into opt/implicit-gemm-rewrite

    @wingertge
    wingertge committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    ac8ea65 View commit details
    Browse the repository at this point in the history

  5. Update cubecl

    @wingertge
    wingertge committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    7d8d119 View commit details
    Browse the repository at this point in the history

  6. Temp fix for cubecl strategy

    @wingertge
    wingertge committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    135d256 View commit details
    Browse the repository at this point in the history

  7. Fix deform_conv_transpose2d

    @wingertge
    wingertge committed Nov 27, 2024
    Configuration menu
    Copy the full SHA
    5565f8e View commit details
    Browse the repository at this point in the history

Commits on Nov 28, 2024

  1. Cleanup and generic typing

    @wingertge
    wingertge committed Nov 28, 2024
    Configuration menu
    Copy the full SHA
    86dd009 View commit details
    Browse the repository at this point in the history

  2. Update cubecl

    @wingertge
    wingertge committed Nov 28, 2024
    Configuration menu
    Copy the full SHA
    253f85b View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into opt/implicit-gemm-rewrite

    @wingertge
    wingertge committed Nov 28, 2024
    Configuration menu
    Copy the full SHA
    9ce83c8 View commit details
    Browse the repository at this point in the history

  4. Cleanup

    @wingertge
    wingertge committed Nov 28, 2024
    Configuration menu
    Copy the full SHA
    266c07b View commit details
    Browse the repository at this point in the history

  5. Fix clippy

    @wingertge
    wingertge committed Nov 28, 2024
    Configuration menu
    Copy the full SHA
    cec10e1 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into opt/implicit-gemm-rewrite

    @wingertge
    wingertge committed Nov 28, 2024
    Configuration menu
    Copy the full SHA
    927e026 View commit details
    Browse the repository at this point in the history