Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Items being imported are considered stale objects in discovery #8125

Closed
benbosman opened this issue Jan 20, 2022 · 0 comments · Fixed by #8267
Closed

Items being imported are considered stale objects in discovery #8125

benbosman opened this issue Jan 20, 2022 · 0 comments · Fixed by #8267
Assignees
Labels
bug Estimate TBD Needs to have an estimate added help wanted Needs a volunteer to claim to move forward high priority tools: import Related to import of data into the system

Comments

@benbosman
Copy link
Member

Describe the bug
During an import, items added to discovery can be deleted again before the import script completed

To Reproduce
Steps to reproduce the behavior:

  • Start a large import (using scripts and processes or a command line script)
  • Wait for it to have processed the DB changes, and starts the consumers (discovery indexing)
  • Don't wait so long that the script completed (and the DB changes are committed)
  • Perform a discovery query in the UI (or REST) containing items which were indexed
  • The logs will mention Cleaning x stale objects from Discovery Index
  • The records will no longer be in discovery
  • Later, the script completes, and the DB changes are committed, but the records are already gone from Discovery

Expected behavior
Items which are not deleted, but rather still being imported, should not removed from discovery

Alternatively, the DB changes should be committed before the discovery updates can start

Related work
#3265

@benbosman benbosman added bug needs triage New issue needs triage and/or scheduling labels Jan 20, 2022
@tdonohue tdonohue added high priority tools: import Related to import of data into the system Estimate TBD Needs to have an estimate added help wanted Needs a volunteer to claim to move forward and removed needs triage New issue needs triage and/or scheduling labels Jan 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Estimate TBD Needs to have an estimate added help wanted Needs a volunteer to claim to move forward high priority tools: import Related to import of data into the system
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants