Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stored cursor ignored on reboot #12

Open
joelghill opened this issue Dec 2, 2024 · 0 comments
Open

Stored cursor ignored on reboot #12

joelghill opened this issue Dec 2, 2024 · 0 comments
Labels
bug Something isn't working good first issue Good for newcomers help wanted Extra attention is needed

Comments

@joelghill
Copy link
Owner

Describe the bug
The feed keeps track of a timestamp as a cursor used when connecting to the Jetstream API. If the feed experiences a fatal error, it reboots but then fails to restart consumption of the jetstream where it left off. Appears to start indexing the jetstream feed 2 days in the past.

Expected behavior
On reboot, the feed should:

  1. Query the state of the cursor and fetch the timestamp if it exists
  2. Start the connection to the Jetstream using the cursor as a query parameter
  3. Indexing of the Jetstream feed should start from where the feed indexer left off.

Additional context
A short term patch would be to ignore the cursor in the database and restart the feed from the current timestamp minus ~1 hour or some other standard unit of time.

@joelghill joelghill added the bug Something isn't working label Dec 2, 2024
@joelghill joelghill added help wanted Extra attention is needed good first issue Good for newcomers labels Dec 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working good first issue Good for newcomers help wanted Extra attention is needed
Projects
Status: Ready
Development

No branches or pull requests

1 participant