Skip to content

Pull requests: vllm-project/vllm

New pull request New
408 Open 4,305 Closed
408 Open 4,305 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix open_collective value in FUNDING.yml ci/build
#10426 opened Nov 18, 2024 by andrew Loading…
1
[CI/Build] Support compilation with local cutlass path (#10423) ci/build
#10424 opened Nov 18, 2024 by wchen61 Loading…
3
[Misc] Reduce medusa weight
#10422 opened Nov 18, 2024 by skylee-01 Loading…
2
Fix: Build error seen on Power Architecture ci/build ready ONLY add when PR is ready to merge/full CI is needed
#10421 opened Nov 18, 2024 by mikejuliet13 Loading…
2
[Bugfix]Fix Phi-3 BNB online quantization
#10417 opened Nov 18, 2024 by jeejeelee Loading…
1
4
Bump the patch-update group with 2 updates ci/build dependencies Pull requests that update a dependency file
#10413 opened Nov 18, 2024 by dependabot bot Loading…
1
[core] Bump ray to use _overlap_gpu_communication in compiled graph t…
#10410 opened Nov 18, 2024 by ruisearch42 • Draft
1
[Model][Bugfix] Support TP for PixtralHF ViT ready ONLY add when PR is ready to merge/full CI is needed
#10405 opened Nov 17, 2024 by mgoin Loading…
3
[Experimental] Support Cross encoder models frontend
#10400 opened Nov 17, 2024 by maxdebayser Loading…
9
[3/N][torch.compile] consolidate custom op logging needs-rebase
#10399 opened Nov 17, 2024 by youkaichao Loading…
3
[BugFix] Fix hermes tool parser output error stream arguments in some cases (#10395) frontend
#10398 opened Nov 16, 2024 by xiyuan-lee Loading…
2
6
Add ngram speculation to API frontend
#10390 opened Nov 16, 2024 by flozi00 • Draft
1
2
[v1] V1EngineArgs for better config handling ci/build
#10382 opened Nov 15, 2024 by rickyyx Loading…
7
[Doc] Add the start of an arch overview page ci/build documentation Improvements or additions to documentation
#10368 opened Nov 15, 2024 by russellb Loading…
4
[CI/Build] Add sphinx/rst linter for docs ci/build
#10366 opened Nov 15, 2024 by rafvasq • Draft
7
[Platform][Refactor] Extract func get_default_attn_backend to Platform needs-rebase ready ONLY add when PR is ready to merge/full CI is needed
#10358 opened Nov 15, 2024 by MengqingCao Loading…
12
[Hardware][CPU] Support chunked-prefill and prefix-caching on CPU ci/build documentation Improvements or additions to documentation ready ONLY add when PR is ready to merge/full CI is needed x86 CPU
#10355 opened Nov 15, 2024 by bigPYJ1151 Loading…
17
Add KV-Cache int8 quant support
#10354 opened Nov 15, 2024 by YanyunDuanIEI Loading…
2
[Core] Interface for accessing model from engine needs-rebase
#10353 opened Nov 15, 2024 by DarkLight1337 Loading…
7
[DRAFT] Cutlass 2:4 ci/build needs-rebase
#10346 opened Nov 15, 2024 by robertgshaw2-neuralmagic • Draft
2
Rahul quant merged ci/build needs-rebase
#10341 opened Nov 14, 2024 by robertgshaw2-neuralmagic • Draft
3
[Kernel] Add CUTLASS sparse support, heuristics, and torch operators ci/build
#10340 opened Nov 14, 2024 by Faraz9877 Loading…
4
[Feature] enable host memory for kv cache
#10330 opened Nov 14, 2024 by YZP17121579 • Draft
3
Rs 24 sparse ci/build needs-rebase
#10329 opened Nov 14, 2024 by robertgshaw2-neuralmagic • Draft
2
DistServe Prototype
#10321 opened Nov 14, 2024 by Jocn2020 • Draft
1
ProTip! Exclude everything labeled bug with -label:bug.