-
Notifications
You must be signed in to change notification settings - Fork 26
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add image retrieval from FAISS index #876
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @mrchtr!
Would be ideal if we let the user search with embeddings or images as well. Similar to the retrieve_laion_by_embedding
component. That should be possible now in a single component with the additionalFields
support, although maybe not really nice yet without schema support.
We can do it in a separate PR anyway.
src/fondant/components/retrieve_images_from_faiss_index/src/main.py
Outdated
Show resolved
Hide resolved
src/fondant/components/retrieve_images_from_faiss_index/src/main.py
Outdated
Show resolved
Hide resolved
Also, we probably want to use a GPU, I did it here for the embedding component: |
src/fondant/components/retrieve_images_from_faiss_index/fondant_component.yaml
Outdated
Show resolved
Hide resolved
src/fondant/components/retrieve_images_from_faiss_index/src/main.py
Outdated
Show resolved
Hide resolved
src/fondant/components/retrieve_images_from_faiss_index/fondant_component.yaml
Outdated
Show resolved
Hide resolved
src/fondant/components/retrieve_images_from_faiss_index/src/main.py
Outdated
Show resolved
Hide resolved
src/fondant/components/retrieve_images_from_faiss_index/src/main.py
Outdated
Show resolved
Hide resolved
src/fondant/components/retrieve_images_from_faiss_index/tests/resources/create_dummy_dataset.py
Outdated
Show resolved
Hide resolved
src/fondant/components/retrieve_images_from_faiss_index/tests/test_component.py
Outdated
Show resolved
Hide resolved
src/fondant/components/retrieve_images_from_faiss_index/src/main.py
Outdated
Show resolved
Hide resolved
src/fondant/components/retrieve_images_from_faiss_index/src/main.py
Outdated
Show resolved
Hide resolved
src/fondant/components/retrieve_images_from_faiss_index_by_prompt/src/main.py
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @mrchtr!
The component expects a dataset in the form of:
The component will load the dataset from the remote storage into the component, initialise a CLIP model,
and retrieve similar images based on given prompts.