Add custom OAI/compatible model endpoint #3923
micoraweb
started this conversation in
Feature Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello, I was hoping that there is a way to interact with my TabbyAPI back-end that runs a EXL2 model and provides an OpenAI compatible API (without an API key). A custom OAI compatible endpoint, I could chat with, but unfortunately there is no way to add it under "Model Providers". I believe it could be a great feature which is easy to add. Don't enforce an API key, and allow a custom OAI-compatible local endpoint.. That would make it a perfect product :) Did we miss this option? If not, please consider adding it
Beta Was this translation helpful? Give feedback.
All reactions