Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Search performance and empty results #964

Merged
merged 2 commits into from
Feb 15, 2023
Merged

fix: Search performance and empty results #964

merged 2 commits into from
Feb 15, 2023

Conversation

ptbrowne
Copy link
Collaborator

@ptbrowne ptbrowne commented Feb 15, 2023

Fixes on search

  • Empty list of IRIs was not taken into account
  • Different languages lead to combinatorial explosion and poor performance as the dataset list grew
    Previously the table returned in the results would be like so
cubeIRI cube theme creator
1 Snowfalls Snow WSL
1 Schneefall Schnee WSL
1 Snowfalls Schnee WSL
1 Schneefall Snow WSL

So for a single cube we would have 4 (more generally N_LANGUAGE*N_FIELDS_WITH_LANGUAGE) different rows instead of 2 (one row for each language). The added equality filter ensures each row is in the same language.

Fix #963
Fix #959

Previously the search was broken due to empty list of IRIs
@vercel
Copy link

vercel bot commented Feb 15, 2023

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated
visualization-tool ✅ Ready (Inspect) Visit Preview 💬 Add your feedback Feb 15, 2023 at 10:10AM (UTC)

Prevent combinatorial explosion due to languages differences between
search rows
@ptbrowne ptbrowne changed the title fix: Search works when there is no result fix: Search performance and empty results Feb 15, 2023
Copy link
Collaborator

@bprusinowski bprusinowski left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Comment on lines +171 to +173
FILTER(LANG(?name) = LANG(?description))
FILTER(LANG(?name) = LANG(?creatorLabel))
FILTER(LANG(?name) = LANG(?themeName))
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How does this work?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I edited the description, please tell me if it's clearer.

@ptbrowne ptbrowne merged commit d89fa36 into main Feb 15, 2023
@ptbrowne ptbrowne deleted the fix/empty-search branch February 15, 2023 10:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

search on TEST broken poor performance loading list of datasets
2 participants