Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement LLaMA #9

Merged
merged 16 commits into from
Mar 30, 2023
Merged

Implement LLaMA #9

merged 16 commits into from
Mar 30, 2023

Conversation

WoosukKwon
Copy link
Collaborator

@WoosukKwon WoosukKwon commented Mar 26, 2023 •
edited by zhuohan123
Loading

TODO:

  • Test against HF implementation
  • Add TP support (@zhuohan123)

@WoosukKwon
Copy link
Collaborator Author

@zhuohan123 Please feel free to approve and merge this PR once you think it's ready.

@zhuohan123 zhuohan123 self-requested a review March 29, 2023 06:37
@zhuohan123 zhuohan123 merged commit 80a2f81 into main Mar 30, 2023
@WoosukKwon WoosukKwon deleted the llama branch April 12, 2023 03:12
@TheBloke TheBloke mentioned this pull request Jul 20, 2023
Closed
v1nc3nt27 pushed a commit to v1nc3nt27/vllm that referenced this pull request Sep 12, 2023
@ri938
Merge pull request vllm-project#9 from ri938/organise
010b5bc 
dont error if user doesnt have kernels installed
@shanshanpt shanshanpt mentioned this pull request Nov 17, 2023
Closed
@junior-zsy junior-zsy mentioned this pull request Nov 20, 2023
Closed
bigPYJ1151 pushed a commit to bigPYJ1151/vllm that referenced this pull request Dec 29, 2023
@maktukmak @bigPYJ1151
CPU only build (vllm-project#9)
62936e3
bigPYJ1151 pushed a commit to bigPYJ1151/vllm that referenced this pull request Jan 15, 2024
@maktukmak @bigPYJ1151
CPU only build (vllm-project#9)
fff0ebd
bigPYJ1151 pushed a commit to bigPYJ1151/vllm that referenced this pull request Jan 18, 2024
@maktukmak @bigPYJ1151
CPU only build (vllm-project#9)
cd14045
jianan-gu pushed a commit to jianan-gu/vllm that referenced this pull request Jan 23, 2024
@maktukmak @jianan-gu
CPU only build (vllm-project#9)
45c26d2
bigPYJ1151 pushed a commit to bigPYJ1151/vllm that referenced this pull request Jan 31, 2024
@maktukmak @bigPYJ1151
CPU only build (vllm-project#9)
ad25d65
hongxiayang pushed a commit to hongxiayang/vllm that referenced this pull request Feb 13, 2024
@WoosukKwon @zhuohan123
Implement LLaMA (vllm-project#9)
bc9de71 
Co-authored-by: Zhuohan Li <[email protected]>
bigPYJ1151 pushed a commit to bigPYJ1151/vllm that referenced this pull request Mar 15, 2024
@maktukmak @bigPYJ1151
CPU only build (vllm-project#9)
4df1cf4
fxmarty pushed a commit to fxmarty/vllm-public that referenced this pull request May 31, 2024
@mawong-amd
Merge pull request vllm-project#9 from ROCm/main_upstream_candidate
3489ce7 
Bringing in the latest commits from upstream post FA Triton merge, FP8 KV merge, layernorm optimizations merge.
This was referenced Jul 5, 2024
Merged
Open
@xinzaifeixiang1992 xinzaifeixiang1992 mentioned this pull request Jul 24, 2024
Open
@alixiaodi alixiaodi mentioned this pull request Aug 2, 2024
Closed
@Minami-su Minami-su mentioned this pull request Aug 11, 2024
Closed
zeroorhero pushed a commit to zeroorhero/vllm that referenced this pull request Sep 23, 2024
@KuntaiDu
Merge pull request vllm-project#9 from KuntaiDu/kuntai-disagg-refactor
f101b40 
Kuntai disagg refactor
@liulisi16323 liulisi16323 mentioned this pull request Sep 24, 2024
Open
1 task
@SpaceHunterInf SpaceHunterInf mentioned this pull request Sep 30, 2024
Closed
1 task
This was referenced Oct 12, 2024
Closed
Open
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@zhuohan123 zhuohan123 zhuohan123 approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@WoosukKwon @zhuohan123