Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FR] Add support for multiple language models, including local models via Ollama, and GPT-4o-mini #803

Open
temperatio opened this issue Sep 8, 2024 · 0 comments

Comments

@temperatio
Copy link

1–3 main use cases of the proposed feature:

As a user, I would like to choose between different AI language models, including self-hosted or locally run models like Ollama, to ensure flexibility and future-proof AI model integrations. This would allow AppFlowy-Cloud to support users who prefer running local models for privacy, or who want to switch between models from various providers.

What types of users can benefit from using your proposed feature:

  • Users who prioritize data privacy and prefer to use local models.
  • Developers and organizations looking for flexibility in AI model providers, especially in self-hosted environments.
  • Users who want to continue using up-to-date models like GPT-4o-mini, as GPT-3.5-turbo will be deprecated next week, and there is no direct support for switching to an alternative model.

Additional context:

Given that GPT-3.5-turbo will be deprecated next week, the need for an easy transition to newer models such as GPT-4o-mini or alternatives from Anthropic or Ollama is critical. By providing users with a choice of models, AppFlowy-Cloud can ensure it remains adaptable and suitable for a variety of use cases, including self-hosted setups. Additionally, this feature could make it easier to switch between models as AI capabilities evolve or as certain models become deprecated or unavailable.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant