You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If you have a model loaded from a json file, it will appear on the list of the available models on the web UI, but it won't appear on the openai_api_server, because it's not added to the controller.
The text was updated successfully, but these errors were encountered:
Adding the model with the register_worker.py will fail with a 404.
For example, an ollama server is running at its default port 11434. If I add it via the json file, it opens fine on the web ui.
If I try to open it with the python3 fastchat/serve/register_worker.py --controller http://localhost:21001 --worker-name http://localhost:11434, it will fail.
Should we add support for the json file on the register_worker.py or make the web interface add the worker to the controller?
If you have a model loaded from a json file, it will appear on the list of the available models on the web UI, but it won't appear on the openai_api_server, because it's not added to the controller.
The text was updated successfully, but these errors were encountered: