HuggingFace backend implementation #135
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
added 8 commits
March 20, 2023 14:44
dmytrostruk
added
PR: ready for review
|
We need to merge the new backend under the AI namespace, along with OpenAI and Azure OpenAI, following the same naming convention. |
dluc
requested changes
Mar 24, 2023
dotnet/src/Backends.HuggingFace/HttpSchema/CompletionRequest.cs
Outdated
Show resolved
Hide resolved
dotnet/src/Backends.HuggingFace/HttpSchema/CompletionRequest.cs
Outdated
Show resolved
Hide resolved
dotnet/src/SemanticKernel/AI/Extensions/HttpClientExtensions.cs
Outdated
Show resolved
Hide resolved
dluc
added
PR: feedback to address
dmytrostruk
added
PR: ready for review
dluc
reviewed
Mar 24, 2023
|
could you run resharper CLI to fix the code style? there are a few missing empty lines and incorrect indentations |
added 2 commits
March 24, 2023 17:48
@dluc I'm not using resharper, although I run |
@dluc Done, thanks for feedback! |
dluc
approved these changes
Mar 25, 2023
golden-aries
pushed a commit
to golden-aries/semantic-kernel
that referenced
this pull request
Oct 10, 2023
…s on relevant paths (microsoft#135) ### Motivation and Context <!-- Thank you for your contribution to the copilot-chat repo! Please help reviewers and future users, providing the following information: 1. Why is this change required? 2. What problem does it solve? 3. What scenario does it contribute to? 4. If it fixes an open issue, please link to the issue here. --> updates deploy scripts to have execute permissions, so that they can run correctly in Github, and changes build workflows to run only when the relevant paths are updated. ### Description <!-- Describe your changes, the overall approach, the underlying design. These notes will help understanding how your code works. Thanks! --> ### Contribution Checklist <!-- Before submitting this PR, please make sure: --> - [ ] The code builds clean without any errors or warnings - [ ] The PR follows the [Contribution Guidelines](https://github.com/microsoft/copilot-chat/blob/main/CONTRIBUTING.md) and the [pre-submission formatting script](https://github.com/microsoft/copilot-chat/blob/main/CONTRIBUTING.md#development-scripts) raises no violations - [ ] All unit tests pass, and I have added new tests where possible - [ ] I didn't break anyone 😄
Bryan-Roe
added a commit
to BMR-Cloud-Dev/semantic
that referenced
this pull request
Jun 28, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Motivation and Context
HuggingFace is a platform with over 120k different models, so we need to provide a way to use these models with Semantic Kernel. While users can implement their own backend implementation for HuggingFace models, we can provide default implementation which will be ready for usage out-of-the-box.
To run models locally, users can run local inference server from our samples:
https://github.com/microsoft/semantic-kernel/tree/experimental-huggingface/samples/apps/local_inference_server
Description
CompletionGeneratorandEmbeddingGeneratorin local inference server.HuggingFaceBackendclass.HuggingFaceBackend.Contribution Checklist
dotnet format