Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Chart for executor service #264

Merged
merged 17 commits into from
Nov 23, 2024
Merged

feat: Chart for executor service #264

merged 17 commits into from
Nov 23, 2024

Conversation

annirudh
Copy link
Contributor

@annirudh annirudh commented Nov 18, 2024

Operator changes to add a new executor pod that is responsible for handling background tasks that are currently handled in wandb-app.

With this change, wandb-app and parquet just schedule tasks using async, which is backed by the existing Redis instance. Then the executor pod is responsible for actually kicking this off. This has a few advantages:

  • If pods restart, because the tasks are still in redis, the pods will pick the work back up.
  • We offload heavy work off of wandb-app which we know causes instability for customers.
  • We could autoscale executor to better scale with specific customer workloads.

@annirudh annirudh marked this pull request as ready for review November 20, 2024 21:49
@annirudh annirudh changed the title feat: WIP - Chart for executor service feat: Chart for executor service Nov 20, 2024
@annirudh annirudh merged commit 634003d into main Nov 23, 2024
2 checks passed
@annirudh annirudh deleted the annirudh/executor branch November 23, 2024 01:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants