Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Google AI plugin] Add support for Gemini experimental models? #852

Open
thatfiredev opened this issue Sep 2, 2024 · 2 comments
Open

[Google AI plugin] Add support for Gemini experimental models? #852

thatfiredev opened this issue Sep 2, 2024 · 2 comments

Comments

@thatfiredev
Copy link
Member

In August 2024, Gemini launched a few experimental models. As described in the docs:

In addition to the base models, the Gemini API offers experimental models available in Preview, as defined in the Terms, meaning it is not for production use. We release experimental models to gather feedback, get our latest updates into the hands of developers quickly, and highlight the pace of innovation happening at Google. What we learn from experimental launches informs how we release models more widely. An experimental model can be swapped for another without prior notice. We don't guarantee that an experimental model will become a stable model in the future.

At the time of writing, there are 4 available models:

  • gemini-1.5-pro-exp-0801
  • gemini-1.5-pro-exp-0827
  • gemini-1.5-flash-exp-0827
  • gemini-1.5-flash-8b-exp-0827

Question: Is this something we would like to support in the Google AI plugin?
I suspect those may be hard to maintain given that they may change without prior notice. But since Genkit supports marking a model as unstable, perhaps we could mark those as unstable so that developers don't mistakenly use them in production.

@MichaelDoyle
Copy link
Member

These are available without any code changes. Maybe we need to improve docs on this? For example:

import { configureGenkit } from "@genkit-ai/core";
import { z } from "@genkit-ai/core/schema";
import { generate } from "@genkit-ai/ai";
import { googleAI, gemini15Flash } from "@genkit-ai/googleai";

configureGenkit({
  // set GOOGLE_GENAI_API_KEY env variable to your api key
  plugins: [googleAI()]
});

await generate({
  prompt: "Write a Node.js script to invert a binary tree.",
  model: gemini15Flash,
  config: { version: "gemini-1.5-flash-exp-0827" },
});

@thatfiredev
Copy link
Member Author

@MichaelDoyle Oh, for some reason I thought we were limited to the versions specified in the modelRef. Good to know we can specify any version 👍

Yes, I think having docs around this would be nice.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: No status
Development

No branches or pull requests

2 participants