Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add method to validate/check number of Flavors (present/expected) for a given ADO #255

Open
DiegoPino opened this issue Feb 3, 2023 · 1 comment
Assignees
Labels
enhancement New feature or request Search API F around and find out Strawberry Flavor Post Processing data extracted that goes into Solr Typed Data and Search
Milestone

Comments

@DiegoPino
Copy link
Member

See

public function getCountByProcessorInSolr(

Sadly this (even still useful) is not enough. We need to also get "how many we should expect to have". Luckily we index also sequence_total as a value so the idea is:

Similar query, facet by sequence_total, get the "value" not the "count" from the extra data from the results. Sum them up. return both count and expected.

This is needed to be able to "avoid" reprocessing (as an option) ADOs where all matches/is in place. Even if the queue item workers will not run OCR again if present (we already have that) re-enqueing 700K OCRs just to check that is an overkill. Thinking of JSON patching etc.

@DiegoPino
Copy link
Member Author

@alliomeria ping here. This is the idea. I will code this now so you can test. Thanks again for your work

@DiegoPino DiegoPino self-assigned this Feb 3, 2023
@DiegoPino DiegoPino added enhancement New feature or request Typed Data and Search Strawberry Flavor Post Processing data extracted that goes into Solr Search API F around and find out labels Feb 3, 2023
@DiegoPino DiegoPino added this to the 1.1.0 milestone Feb 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Search API F around and find out Strawberry Flavor Post Processing data extracted that goes into Solr Typed Data and Search
Projects
None yet
Development

No branches or pull requests

1 participant