Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Vector format info from FieldInfo in Index Segments API #108658

Merged
merged 2 commits into from
May 16, 2024

Conversation

tteofili
Copy link
Contributor

@tteofili tteofili commented May 15, 2024

Engine should collect KnnVectorFormat from FieldInfo instead of Codec.
This will result in reading actual per-segment, per-field vector format information; in fact right now vector format information is provided by codec, which in turn is read from mappings, and therefore not always reflecting what's on-disk (e.g. when updating dense vector mappings).

@tteofili tteofili added >non-issue :Search/Search Search-related issues that do not fall into other categories labels May 15, 2024
@tteofili
Copy link
Contributor Author

I had initially opened a Lucene PR to add this information in SegmentInfo, but that same information is present in FieldInfo and hence I've closed it and opened this PR which makes things much simpler.

@tteofili tteofili marked this pull request as ready for review May 15, 2024 11:22
@elasticsearchmachine elasticsearchmachine added the Team:Search Meta label for search team label May 15, 2024
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-search (Team:Search)

Copy link
Contributor

@jimczi jimczi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@tteofili tteofili merged commit 2d0715c into elastic:main May 16, 2024
15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>non-issue :Search/Search Search-related issues that do not fall into other categories Team:Search Meta label for search team v8.15.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants