Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Usage]: Why use_beam_search is eliminated in vllm.SamplingParams from v0.6.3? #10605

Closed
1 task done
BAI-Yeqi opened this issue Nov 24, 2024 · 2 comments
Closed
1 task done
Labels
usage How to use vllm

Comments

@BAI-Yeqi
Copy link

Your current environment

I am asking a general API question regarding vllm, therefore, env info is not needed.

How would you like to use vllm

I want to ask why use_beam_search is eliminated in vllm.SamplingParams from v0.6.3 (https://docs.vllm.ai/en/v0.6.3/dev/sampling_params.html)?

How can we control the usage of beam search from v0.6.3 onwards?

To the best of my knowledge, use_beam_search is supported in all versions from v0.4.0.post1 to v0.6.2.

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
@BAI-Yeqi BAI-Yeqi added the usage How to use vllm label Nov 24, 2024
@noooop
Copy link
Contributor

noooop commented Nov 24, 2024

PTAL

@BAI-Yeqi
Copy link
Author

@noooop This is very informative. Thanks a lot!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
usage How to use vllm
Projects
None yet
Development

No branches or pull requests

3 participants