Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[core] Multi Step Scheduling #7000

Merged
merged 2 commits into from
Aug 19, 2024
Merged

[core] Multi Step Scheduling #7000

merged 2 commits into from
Aug 19, 2024

Commits on Aug 19, 2024

  1. multi-step scheduling 

    remove some redundant test cases

set v2 blockmananger and fix rebase

Update vllm/engine/async_llm_engine.py

Co-authored-by: Zhuohan Li <[email protected]>

Update vllm/engine/async_llm_engine.py

Co-authored-by: Zhuohan Li <[email protected]>

Update vllm/worker/multi_step_model_runner.py

Co-authored-by: Zhuohan Li <[email protected]>

add comment

typo

rename to StatefulModelInput

renamed outputs to cached_outputs

Update vllm/worker/multi_step_model_runner.py

Co-authored-by: afeldman-nm <[email protected]>
    @SolitaryThinker @afeldman-nm
    SolitaryThinker and afeldman-nm committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    a2b3c7e View commit details
    Browse the repository at this point in the history

  2. format

    @SolitaryThinker
    SolitaryThinker committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    5fac4a1 View commit details
    Browse the repository at this point in the history