Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

torch.compile + CUDA Graph optimization for bs=1 #272

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

torch.compile + CUDA Graph optimization for bs=1 #272

wants to merge 4 commits into from

Commits on Jan 8, 2024

  1. Perform KV cache reordering only when we need to remove beams

    @YJYJLee
    YJYJLee committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    44e01f3 View commit details
    Browse the repository at this point in the history

Commits on Jan 18, 2024

  1. update

    @YJYJLee
    YJYJLee committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    09428d6 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of https://github.com/facebookresearch/fairseq2 i… 

    …nto main
    @YJYJLee
    YJYJLee committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    78e0d48 View commit details
    Browse the repository at this point in the history

  3. torch.compile + CUDA Graph optimization for bs=1

    @YJYJLee
    YJYJLee committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    311e6ae View commit details
    Browse the repository at this point in the history