Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Upstream merge 24 11 04 #262

Merged
merged 80 commits into from
Nov 5, 2024
Merged

Upstream merge 24 11 04 #262

merged 80 commits into from
Nov 5, 2024

Conversation

gshtras
Copy link
Collaborator

@gshtras gshtras commented Nov 4, 2024

No description provided.

Abatom and others added 30 commits October 29, 2024 10:32
@Abatom
[Misc] Add metrics for request queue time, forward time, and execute …
74fc2d7 
…time (vllm-project#9659)
@tastelikefeet
Fix the log to correct guide user to install modelscope (vllm-project…
08600dd 
…#9793)

Signed-off-by: yuze.zyz <[email protected]>
@svenseeberg
[Bugfix] Use host argument to bind to interface (vllm-project#9798)
0f43387
@yannicks1
[Misc]: Typo fix: Renaming classes (casualLM -> causalLM) (vllm-proje…
0ce7798 
…ct#9801)

Signed-off-by: Yannick Schnider <[email protected]>
@jsato8094
[Model] Add LlamaEmbeddingModel as an embedding Implementation of Lla…
ac3d748 
…maModel (vllm-project#9806)
@mgoin
[CI][Bugfix] Skip chameleon for transformers 4.46.1 (vllm-project#9808)
ab6f981
@russellb
[CI/Build] mergify: fix rules for ci/build label (vllm-project#9804)
7585ec9 
Signed-off-by: Russell Bryant <[email protected]>
@coolkp
[MISC] Set label value to timestamp over 0, to keep track of recent h…
0ad216f 
…istory (vllm-project#9777)

Signed-off-by: Kunjan Patel <[email protected]>
@joerunde
[Bugfix][Frontend] Guard against bad token ids (vllm-project#9634)
67bdf8e 
Signed-off-by: Joe Runde <[email protected]>
@wseaton @maxdebayser
[Model] tool calling support for ibm-granite/granite-20b-functioncall…
882a1ad 
…ing (vllm-project#8339)

Signed-off-by: Max de Bayser <[email protected]>
Co-authored-by: Max de Bayser <[email protected]>
Co-authored-by: Maximilien de Bayser <[email protected]>
@simon-mo
[Docs] Add notes about Snowflake Meetup (vllm-project#9814)
8d77241 
Signed-off-by: simon-mo <[email protected]>
@mgoin
[Bugfix] Fix prefix strings for quantized VLMs (vllm-project#9772)
bc73e98
@youkaichao
[core][distributed] fix custom allreduce in pytorch 2.5 (vllm-project…
1ab6f6b 
…#9815)

Signed-off-by: youkaichao <[email protected]>
@LiuXiaoxuanPKU
Update README.md (vllm-project#9819)
64cb1cd
@mgoin
[Bugfix][VLM] Make apply_fp8_linear work with >2D input (vllm-project…
226688b 
…#9812)
@khluu
[ci/build] Pin CI dependencies version with pip-compile (vllm-project…
62fac4b 
…#9810)

Signed-off-by: kevin <[email protected]>
@yma11 @ys950902
[Bugfix] Fix multi nodes TP+PP for XPU (vllm-project#8884)
04a3ae0 
Signed-off-by: YiSheng5 <[email protected]>
Signed-off-by: yan ma <[email protected]>
Co-authored-by: YiSheng5 <[email protected]>
@russellb @mgoin @DarkLight1337
[Doc] Add the DCO to CONTRIBUTING.md (vllm-project#9803)
7b0365e 
Signed-off-by: Russell Bryant <[email protected]>
Co-authored-by: Michael Goin <[email protected]>
Co-authored-by: Cyrus Leung <[email protected]>
@youkaichao
[torch.compile] rework compile control with piecewise cudagraph (vllm…
ff5ed6e 
…-project#9715)

Signed-off-by: youkaichao <[email protected]>
@jeejeelee
[Misc] Specify minimum pynvml version (vllm-project#9827)
6aa6020 
Signed-off-by: Jee Jee Li <[email protected]>
@WoosukKwon
[TPU] Correctly profile peak memory usage & Upgrade PyTorch XLA (vllm…
211fe91 
…-project#9438)
@alex-jw-brooks
[CI/Build] VLM Test Consolidation (vllm-project#9372)
cc98f1e 
Signed-off-by: Alex-Brooks <[email protected]>
@Went-Liang
[Model] Support math-shepherd-mistral-7b-prm model (vllm-project#9697)
81f09cf 
Signed-off-by: Went-Liang <[email protected]>
@elfiegg
[Misc] Add chunked-prefill support on FlashInfer. (vllm-project#9781)
9ff4511
@joerunde
[Bugfix][core] replace heartbeat with pid check (vllm-project#9818)
3b3f1e7 
Signed-off-by: Joe Runde <[email protected]>
@joerunde
[Doc] link bug for multistep guided decoding (vllm-project#9843)
33d2577 
Signed-off-by: Joe Runde <[email protected]>
@hbikki
[Neuron] Update Dockerfile.neuron to fix build failure (vllm-project#…
c787f2d 
…9822)
@youkaichao
[doc] update pp support (vllm-project#9853)
c2cd1a2 
Signed-off-by: youkaichao <[email protected]>
@CRZbulabula @youkaichao
[CI/Build] Simplify exception trace in api server tests (vllm-project…
00d91c8 
…#9787)

Signed-off-by: youkaichao <[email protected]>
Co-authored-by: youkaichao <[email protected]>
@youkaichao
[torch.compile] upgrade tests (vllm-project#9858)
64384bb 
Signed-off-by: youkaichao <[email protected]>
pavanimajety and others added 27 commits November 1, 2024 12:15
@pavanimajety
[Bugfix/Core] Flashinfer k_scale and v_scale (vllm-project#9861)
598b6d7
@youkaichao
[1/N] pass the complete config from engine to executor (vllm-project#…
18bd758 
…9933)

Signed-off-by: youkaichao <[email protected]>
@GeneDer
[Bugfix] PicklingError on RayTaskError (vllm-project#9934)
27cd36e 
Signed-off-by: Gene Su <[email protected]>
@dependabot @khluu
[ci/build] Bump the patch-update group with 10 updates (vllm-project#…
d151fde 
…9897)

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin H. Luu <[email protected]>
@petersalas
[Core][VLM] Add precise multi-modal placeholder tracking (vllm-projec…
6c0b7f5 
…t#8346)

Signed-off-by: Peter Salas <[email protected]>
@khluu
[ci/build] Have dependabot ignore pinned dependencies (vllm-project#9935
d522034 
)

Signed-off-by: kevin <[email protected]>
@sroy745
[Encoder Decoder] Add flash_attn kernel support for encoder-decoder m…
a78dd33 
…odels (vllm-project#9559)
@youkaichao
[torch.compile] fix cpu broken code (vllm-project#9947)
af7380d 
Signed-off-by: youkaichao <[email protected]>
@njhill @DarkLight1337
[Docs] Update Granite 3.0 models in supported models table (vllm-proj…
eed92f1 
…ect#9930)

Signed-off-by: Nick Hill <[email protected]>
Signed-off-by: Nick Hill <[email protected]>
Co-authored-by: Cyrus Leung <[email protected]>
@mikegre-google
[Doc] Updated tpu-installation.rst with more details (vllm-project#9926)
1d4cfe2 
Signed-off-by: Michael Green <[email protected]>
@youkaichao @njhill
[2/N] executor pass the complete config to worker/modelrunner (vllm-p…
e893795 
…roject#9938)

Signed-off-by: youkaichao <[email protected]>
Co-authored-by: Nick Hill <[email protected]>
@robertgshaw2-neuralmagic
[V1] Fix EngineArgs refactor on V1 (vllm-project#9954)
d6459b4
@youkaichao
[bugfix] fix chatglm dummy_data_for_glmv (vllm-project#9955)
74b529c 
Signed-off-by: youkaichao <[email protected]>
@youkaichao
[3/N] model runner pass the whole config to model (vllm-project#9958)
cea808f 
Signed-off-by: youkaichao <[email protected]>
@nokados
[CI/Build] Quoting around > (vllm-project#9956)
1b73ab2
@CRZbulabula
[torch.compile] Adding torch compile to vision-language models (vllm-…
ae5279a 
…project#9946)
@youkaichao
[bugfix] fix tsts (vllm-project#9959)
3bb4bef 
Signed-off-by: youkaichao <[email protected]>
@njhill
[V1] Support per-request seed (vllm-project#9945)
1f1b6d6 
Signed-off-by: Nick Hill <[email protected]>
@cooleel @ywang96
[Model] Add support for H2OVL-Mississippi models (vllm-project#9747)
5459772 
Signed-off-by: Shanshan Wang <[email protected]>
Signed-off-by: Roger Wang <[email protected]>
Co-authored-by: Roger Wang <[email protected]>
@robertgshaw2-neuralmagic
[V1] Fix Configs (vllm-project#9971)
91c9ebb
@jeejeelee
[Bugfix] Fix MiniCPMV and Mllama BNB bug (vllm-project#9917)
c49f040 
Signed-off-by: Jee Jee Li <[email protected]>
@gshtras
[Bugfix]Using the correct type hints (vllm-project#9885)
b67feb1 
Signed-off-by: Gregory Shtrasberg <[email protected]>
@zhengy001
[Misc] Compute query_start_loc/seq_start_loc on CPU (vllm-project#9447)
4dbcbbe 
Co-authored-by: Yang Zheng(SW)(Alex) <[email protected]>
@daitran2k1
[Bugfix] Fix E2EL mean and median stats (vllm-project#9984)
ea4aded 
Signed-off-by: daitran2k1 <[email protected]>
@MengqingCao
[Bugfix][OpenVINO] Fix circular reference vllm-project#9939 (vllm-pro…
ccb5376 
…ject#9974)

Signed-off-by: MengqingCao <[email protected]>
@chaunceyjiang
[Frontend] Multi-Modality Support for Loading Local Image Files (vllm…
ac6b8f1 
…-project#9915)

Signed-off-by: chaunceyjiang <[email protected]>
@gshtras
Merge remote-tracking branch 'upstream/main'
65405fd
@gshtras gshtras merged commit 36fff16 into main Nov 5, 2024
16 of 17 checks passed
@gshtras gshtras deleted the upstream_merge_24_11_04 branch November 5, 2024 16:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@shajrawi shajrawi shajrawi approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.