Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Not able to chat with agents when using Azure model provider because of not being able to select the the correct target model(values provided in dropdown are incorrect) #702

Closed
sangee2004 opened this issue Nov 26, 2024 · 3 comments
Assignees
Labels
bug Something isn't working

Comments

@sangee2004
Copy link

Pre req - Have the following Azure Environment variables set:

AZURE_OPENAI_MODEL_PROVIDER_API_KEY , OTTO8_AZURE_OPENAI_MODEL_PROVIDER_DEPLOYMENT_NAME, OTTO8_AZURE_OPENAI_MODEL_PROVIDER_ENDPOINT

Steps to reproduce the problem:

  1. Add a model using Add Model option and select "Azure OpenAI" as model provider.
  2. Notice that the options provided in the model dropdown list are incorrect (they are the same list as the one presented for OpenAI)
Screenshot 2024-11-26 at 2 38 28 PM
  1. Picked gpt-40 option from this list and created a model provider.
  2. Made this the default LLM provider.

Chatting with agents results in the following error:

failed to run: failed calling model for completion: error, status code: 404, message: {"detail":"Error occurred: Error code: 404 - {'error': {'code': 'DeploymentNotFound', 'message': 'The API deployment for this resource does not exist. If you created the deployment within the last 5 minutes, please wait a moment and try again.'}}"}

Expected Behavior:
User should be presented with the correct model provider list that is available for the configured Azure OpenAI configuration.

@sangee2004 sangee2004 added the bug Something isn't working label Nov 26, 2024
@cjellick
Copy link
Contributor

cjellick commented Dec 3, 2024

assigned to @thedadams for the backend, @ryanhopperlowe for the frontend

@ryanhopperlowe
Copy link
Contributor

@cjellick - This should be fixed with #744

@sangee2004
Copy link
Author

This issue is not seen anymore when testing with latest builds.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants