Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[JS] Add support for Vertex Vector Search to the Vertex AI plugin #448

Closed
chrisraygill opened this issue Jun 22, 2024 · 2 comments · Fixed by #519
Closed

[JS] Add support for Vertex Vector Search to the Vertex AI plugin #448

chrisraygill opened this issue Jun 22, 2024 · 2 comments · Fixed by #519
Assignees
Labels
feature New feature or request js

Comments

@chrisraygill
Copy link
Contributor

Is your feature request related to a problem? Please describe.

Developers who want to use Vertex Vector Search as a scalable, production-ready solution don't have a way to do so through Genkit.

Describe the solution you'd like

Make Vertex Vector Search available through the Vertex AI plugin as indexer and retriever components.

Describe alternatives you've considered

Developers can define their own indexer and retriever components, but it's more convenient to have it exposed through the plugin as a first class experience.

Additional context

More info on Vertex Vector Search available here: https://cloud.google.com/vertex-ai/docs/vector-search/overview

@chrisraygill chrisraygill added the feature New feature or request label Jun 22, 2024
@cabljac cabljac self-assigned this Jun 25, 2024
@cabljac
Copy link
Contributor

cabljac commented Jun 25, 2024

@chrisraygill I thought I'd discuss this here, let me know if it should be somewhere else:

Unless I've misunderstood. a Vertex AI index will store an id and the embedding, and users are expected to keep the content of the document and any metadata which corresponds to this id somewhere else (In another database, e.g BQ, to retrieve via the id)

see here for example

In Genkit we have a Document which has content and metadata, and a retriever responds with a list of documents.

Should we enforce BigQuery as the database in this feature?

@cabljac
Copy link
Contributor

cabljac commented Jul 23, 2024

adding for reference #519

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request js
Projects
Status: Done
Development

Successfully merging a pull request may close this issue.

2 participants