Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ingest all GitHub data every day #46

Closed
ghickman opened this issue Nov 23, 2023 · 1 comment
Closed

Ingest all GitHub data every day #46

ghickman opened this issue Nov 23, 2023 · 1 comment
Assignees

Comments

@ghickman
Copy link
Contributor

Now that the github backfill is pulling in all the data from the GraphQL API (#45 ), it might be worth just doing this every day.

I see this change doing something like:

  • drop the github subcommands
  • replace the github command with the contents of the current github backfill command
  • script removing the appropriate table(s) so we can remove the table in production without hitting memory limits
@ghickman
Copy link
Contributor Author

Fixed in #51

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant