Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Image generation tools errors out when using Azure OpenAI model provider. #619

Closed
sangee2004 opened this issue Nov 18, 2024 · 4 comments
Closed
Assignees
Labels
bug Something isn't working tools

Comments

@sangee2004
Copy link

Steps to reproduce the problem:

  1. Modify the existing dall-e-3 model entry to use Azure Openai provider.
  2. Modify gpt-4o model to use Azure Openai provider and set it as default.
  3. Create an agent with image bundle and ask to generate images.

This fails to generate images

Screenshot 2024-11-15 at 4 51 32 PM Screenshot 2024-11-15 at 4 52 24 PM

Debug logs - calls - 2024-11-15T165241.266.json

@njhale
Copy link
Member

njhale commented Nov 19, 2024

This will require:

  1. The Generate Images tool to consume the model environment variable (the exact naming of this variable is TBD)
  2. Implementing the /v1/images/generations route in the model provider (in here)

@cjellick
Copy link
Contributor

cjellick commented Dec 5, 2024

@thedadams is this addressed?

@thedadams thedadams self-assigned this Dec 5, 2024
@thedadams
Copy link
Contributor

This will be addressed once obot-platform/tools#260 and https://github.com/otto8-ai/otto8/pull/781 are merged.

@sangee2004
Copy link
Author

Able to generate images successfully when setting the default model aliases for Image generation to dall-e-3 model from Azure OpenAI model provider.
Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working tools
Projects
None yet
Development

No branches or pull requests

4 participants