Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optional image model provider to character and runtime #647

Closed
yoniebans opened this issue Nov 28, 2024 · 1 comment
Closed

Optional image model provider to character and runtime #647

yoniebans opened this issue Nov 28, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@yoniebans
Copy link
Contributor

Is your feature request related to a problem? Please describe.

Currently, users can only select a single model provider for both text and image generation. This becomes limiting when a provider excels at text generation but offers subpar image generation capabilities, or vice versa.

Describe the solution you'd like

We propose adding an optional image model provider setting that would take precedence over the default model provider when configured. If no image provider is specified, the system would continue using the default model provider, maintaining backward compatibility.

Describe alternatives you've considered

We've explored using a single provider (such as Heurist or OpenAI) for both text and image generation. While this works adequately, it limits flexibility. For instance, if you want to use a fine-tuned model from a specialized image generation service, this isn't currently possible.

Additional context

I've implemented a similar solution that allows me to use OpenAI for text generation while leveraging a custom fine-tuned model on fal.ai for image generation.

@yoniebans yoniebans added the enhancement New feature or request label Nov 28, 2024
@yoniebans yoniebans changed the title feature: add an optional image model provider to character and runtime optional image model provider to character and runtime Nov 28, 2024
@yoniebans yoniebans changed the title optional image model provider to character and runtime Optional image model provider to character and runtime Nov 28, 2024
@0xTomDaniel
Copy link

Added in #491

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants