Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Huggingface API Compatibility Inquiry #493

Open
viasky657 opened this issue Dec 19, 2024 · 2 comments
Open

Huggingface API Compatibility Inquiry #493

viasky657 opened this issue Dec 19, 2024 · 2 comments
Labels
question Further information is requested Stale

Comments

@viasky657
Copy link

I am curious to know if it is possible to utilize custom models or Huggingface model API endpoints through a custom API url similarly to how the Pydantic program handles Openrouter API calls as demonstrated in the "Models" section of the Pydantic documentation. Thank you for your time and consideration.
@samuelcolvin samuelcolvin added the question Further information is requested label Dec 19, 2024
@samuelcolvin
Copy link
Member

See #398, sounds like it should be possible soon once we work around a bug in hugging face's TGI project.

@github-actions GitHub Actions
Copy link

This issue is stale, and will be closed in 3 days if no reply is received.

@github-actions github-actions bot added the Stale label Dec 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
question Further information is requested Stale
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@samuelcolvin @viasky657