[pull] master from kserve:master #361
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![pull[bot]](https://avatars.githubusercontent.com/in/12910?s=60&v=4){kind=small}
Signed-off-by: Vincent Hou <[email protected]>
|
Hi @pull[bot]. Thanks for your PR. I'm waiting for a opendatahub-io member to verify that this patch is reasonable to test. If it is, they should reply with Once the patch is verified, the new status will be reflected by the I understand the commands that are listed here. Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
Signed-off-by: Sivanantham Chinnaiyan <[email protected]>
fix conflict Signed-off-by: jooho <[email protected]>
* Add precaution again running v1 endpoints on openai models Signed-off-by: grandbora <[email protected]> * Remove the check from explain Signed-off-by: grandbora <[email protected]> * Add a warning log for explain Signed-off-by: grandbora <[email protected]> --------- Signed-off-by: grandbora <[email protected]>
* Add FP16 datatype support for OIP grpc Add grpc server tests Signed-off-by: Sivanantham Chinnaiyan <[email protected]> * Add grpcio-testing as test dependency Signed-off-by: Sivanantham Chinnaiyan <[email protected]> * Fix model repository initialization default value Signed-off-by: Sivanantham Chinnaiyan <[email protected]> * Remove fp16 global map Signed-off-by: Sivanantham Chinnaiyan <[email protected]> * Resolve comments Signed-off-by: Sivanantham Chinnaiyan <[email protected]> --------- Signed-off-by: Sivanantham Chinnaiyan <[email protected]>
* added flag to return raw prediction results Signed-off-by: Andrews Arokiam <[email protected]> * black fix Signed-off-by: Andrews Arokiam <[email protected]> * unit test bug fix Signed-off-by: Andrews Arokiam <[email protected]> * unittest for token classification Signed-off-by: Andrews Arokiam <[email protected]> * verify codegen Signed-off-by: Andrews Arokiam <[email protected]> * bug fix Signed-off-by: Andrews Arokiam <[email protected]> --------- Signed-off-by: Andrews Arokiam <[email protected]>
Signed-off-by: Alex Peters <[email protected]> Signed-off-by: Dan Sun <[email protected]> Co-authored-by: Dan Sun <[email protected]>
Fix model_id and model_dir precendence Signed-off-by: Dan Sun <[email protected]>
Signed-off-by: Dan Sun <[email protected]>
* Fixup max_length for HF and model info for vLLM Signed-off-by: Dattu Sharma <[email protected]> * Use vLLM's implementation for max_length Also fixup error in calculating input sequence lenngth Signed-off-by: Dattu Sharma <[email protected]> * Fixup linter Signed-off-by: Dattu Sharma <[email protected]> * Add license to new file Signed-off-by: Dattu Sharma <[email protected]> * Add bloom test case for max_tokens Revert input length fix Signed-off-by: Dattu Sharma <[email protected]> * Set limit on opt chat competion e2e test Signed-off-by: Dattu Sharma <[email protected]> --------- Signed-off-by: Dattu Sharma <[email protected]>
#3712) * Fix input token count and add completion usage Signed-off-by: Sivanantham Chinnaiyan <[email protected]> * Add max_length for test models Signed-off-by: Sivanantham Chinnaiyan <[email protected]> --------- Signed-off-by: Sivanantham Chinnaiyan <[email protected]>
update version to 0.13.0 Signed-off-by: Sivanantham Chinnaiyan <[email protected]>
|
/ok-to-test |
|
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: israel-hdez, pull[bot] The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
openshift-merge-bot
bot
merged commit 97c83cf
into
opendatahub-io:master
26 checks passed
Jooho
pushed a commit
to Jooho/kserve
that referenced
this pull request
Jul 19, 2024
updating ksi file
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
See Commits and Changes for more details.
Created by
pull[bot]
Can you help keep this open source service alive? 💖 Please sponsor : )