Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

u #1

Closed
wants to merge 158 commits into from
Closed

u #1

wants to merge 158 commits into from

Conversation

liuyanyi
Copy link
Owner

No description provided.

zhuohan123 and others added 30 commits August 22, 2023 11:51
@zhuohan123
Update Supported Model List (vllm-project#825)
14f9c72
@HermitSun
fix: revert code to avoid no attribute problem (vllm-project#827)
eedac9d
@WoosukKwon
Add compute capability 8.9 to default targets (vllm-project#829)
a41c204
@WoosukKwon
Implement approximate GELU kernels (vllm-project#828)
d64bf16
@ftgreat
Fix typo of Aquila in README.md (vllm-project#836)
85ebcda
@WoosukKwon
Fix for breaking changes in xformers 0.0.21 (vllm-project#834)
2a4ec90
@wenjun93
Clean up code (vllm-project#844)
75c0ca9
@WoosukKwon
Set replacement=True in torch.multinomial (vllm-project#858)
94d2f59
@WoosukKwon
Bump up the version to v0.1.4 (vllm-project#846)
791d79d
@Yard1
Add support for CodeLlama (vllm-project#854)
4b6f069
@zhuohan123
[Fix] Fix a condition for ignored sequences (vllm-project#867)
d2b2eed
@tmm1
use flash-attn via xformers (vllm-project#877)
7547138
@Peilun-Li
Enable request body OpenAPI spec for OpenAI endpoints (vllm-project#865)
becd7a5
@JF-D
Accelerate LLaMA model loading (vllm-project#234)
0d93f15
@zhuohan123
Add acknowledgement to a16z grant
0080d83
@tmm1
Improve _prune_hidden_states micro-benchmark (vllm-project#707)
28873a2
@pfldy2850
fix: bug fix when penalties are negative (vllm-project#913)
e112223 
Co-authored-by: dongyong-lee <[email protected]>
@WoosukKwon @zhuohan123
[Docs] Minor fixes in supported models (vllm-project#920)
55b28b1 
* Minor fix in supported models

* Add another small fix for Aquila model

---------

Co-authored-by: Zhuohan Li <[email protected]>
@zhuohan123
Fix README.md Link (vllm-project#927)
c128d69
@WoosukKwon
Add tests for models (vllm-project#922)
32b6816
@WoosukKwon
Avoid compiling kernels for double data type (vllm-project#933)
8ce9c50
@WoosukKwon
[BugFix] Fix NaN errors in paged attention kernel (vllm-project#936)
bf87484
@Yard1
Refactor AsyncLLMEngine (vllm-project#880)
ce741ba
@nelson-liu
Only emit warning about internal tokenizer if it isn't being used (vl…
e15932b 
…lm-project#939)
@zhuohan123
Align vLLM's beam search implementation with HF generate (vllm-projec…
002800f 
…t#857)
@Yard1
Initialize AsyncLLMEngine bg loop correctly (vllm-project#943)
1696725
@HermitSun
fix: typo (vllm-project#948)
22379d5
@WoosukKwon
Clean up kernel unit tests (vllm-project#938)
fbd80ad
@Yard1
Use queue for finished requests (vllm-project#957)
c9927c1
@WoosukKwon
[BugFix] Implement RoPE for GPT-J (vllm-project#941)
320a622
WoosukKwon and others added 29 commits October 16, 2023 12:37
@WoosukKwon
Fix PyTorch index URL in workflow (vllm-project#1378)
e8ef4c0
@WoosukKwon
Fix sampler test (vllm-project#1379)
d3a5bd9
@zhuohan123
Bump up the version to v0.2.1 (vllm-project#1355)
651c614
@WoosukKwon
Change scheduler & input tensor shape (vllm-project#1381)
c1376e0
@WoosukKwon
Add Mistral 7B to test_models (vllm-project#1366)
9524867
@WrRan
Fix typo (vllm-project#1383)
a132435
@WoosukKwon
[BugFix] Define __eq__ in SequenceGroupOutputs (vllm-project#1389)
f8a1e39
@lxrite
Fix type hints (vllm-project#1427)
f61dc80
@WrRan
remove useless statements (vllm-project#1408)
d189170
@thiagosalvatore
Pin pydantic dependency versions (vllm-project#1429)
bf31d36
@chooper1 @WoosukKwon
Support SqueezeLLM (vllm-project#1326)
1f24755 
Co-authored-by: squeeze-ai-lab <[email protected]>
Co-authored-by: Woosuk Kwon <[email protected]>
@Sanster
Add rope_scaling to Aquila model (vllm-project#1457)
28b47d1
@gesanqiu
fix: don't skip first special token. (vllm-project#1497)
beac8dd
@beginlner
Support repetition_penalty (vllm-project#1424)
69be658
@WoosukKwon
Fix bias in InternLM (vllm-project#1501)
aa9af07
@Yard1
Delay GPU->CPU sync in sampling (vllm-project#1337)
15f5632
@iongpt @zhuohan123
Refactor LLMEngine demo script for clarity and modularity (vllm-proje…
ac8d36f 
…ct#1413)

Co-authored-by: Zhuohan Li <[email protected]>
@Tostino
Fix logging so we actually get info level entries in the log. (vllm-p…
2f3d36a 
…roject#1494)
@jroesch
Add py.typed so consumers of vLLM can get type checking (vllm-project…
79a3091 
…#1509)

* Add py.typed so consumers of vLLM can get type checking

* Update py.typed

---------
Co-authored-by: aarnphm <[email protected]>
Co-authored-by: Zhuohan Li <[email protected]>
@blahblahasdf
Add support for spaces_between_special_tokens
7013a80
@zhuohan123
[Fix] Fix duplicated logging messages (vllm-project#1524)
7b895c5
@skrider
Add Dockerfile (vllm-project#1350)
9cabcb7
@WoosukKwon
Fix integer overflows in attention & cache ops (vllm-project#1514)
0ce8647
@cadedaniel
[Small] Formatter only checks lints in changed files (vllm-project#1528)
e575df3
@wenfeiy-db
Add MptForCausalLM key in model_loader (vllm-project#1526)
cf8849f
@beginlner
[BugFix] Set engine_use_ray=True when TP>1 (vllm-project#1531)
5687d58
@Fluder-Paradyne
Add /health Endpoint for both Servers (vllm-project#1540)
7e90a2d
@WoosukKwon
Remove MPTConfig (vllm-project#1529)
1fe0990
@Yard1
Force paged attention v2 for long contexts (vllm-project#1510)
9738b84
@liuyanyi liuyanyi closed this Dec 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.