Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Make _prepare_sample non blocking and pin memory of CPU input buffers #2207

Merged
merged 9 commits into from
Dec 20, 2023
Merged

Make _prepare_sample non blocking and pin memory of CPU input buffers #2207

merged 9 commits into from
Dec 20, 2023

Commits on Dec 19, 2023

  1. less blocking

    @hanzhi713
    hanzhi713 committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    8de791a View commit details
    Browse the repository at this point in the history

  2. add wsl check

    @hanzhi713
    hanzhi713 committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    30337bd View commit details
    Browse the repository at this point in the history

  3. format

    @hanzhi713
    hanzhi713 committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    f131669 View commit details
    Browse the repository at this point in the history

  4. Update vllm/worker/model_runner.py 

    Co-authored-by: Antoni Baum <[email protected]>
    @hanzhi713 @Yard1
    hanzhi713 and Yard1 authored Dec 19, 2023
    Configuration menu
    Copy the full SHA
    39cb1bf View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2023

  1. add comma and format

    @hanzhi713
    hanzhi713 committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    57a87bb View commit details
    Browse the repository at this point in the history

  2. Update vllm/worker/model_runner.py 

    Co-authored-by: Woosuk Kwon <[email protected]>
    @hanzhi713 @WoosukKwon
    hanzhi713 and WoosukKwon authored Dec 20, 2023
    Configuration menu
    Copy the full SHA
    f967c54 View commit details
    Browse the repository at this point in the history

  3. name fix

    @hanzhi713
    hanzhi713 committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    4d5f604 View commit details
    Browse the repository at this point in the history

  4. Update vllm/worker/model_runner.py 

    Co-authored-by: Woosuk Kwon <[email protected]>
    @hanzhi713 @WoosukKwon
    hanzhi713 and WoosukKwon authored Dec 20, 2023
    Configuration menu
    Copy the full SHA
    3f5fff5 View commit details
    Browse the repository at this point in the history

  5. format

    @hanzhi713
    hanzhi713 committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    97e309e View commit details
    Browse the repository at this point in the history