Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update original Pangeo cluster with customized profile list based on group membership #1307

Closed
2 of 3 tasks
rabernat opened this issue May 11, 2022 · 4 comments · Fixed by #1328
Closed
2 of 3 tasks
Assignees

Comments

@rabernat
Copy link
Contributor

rabernat commented May 11, 2022

Context

We recently made a lot of improvements to the Pangeo-style hub to support LEAP and M2LInES. We should now apply these retroactively to the original Pangeo community cluster at https://us-central1-b.gcp.pangeo.io/.

Proposal

  • Create a github group in pangeo-data with extra privileges
  • Set up a profile list option like LEAP to allow these users to get a bigger notebook server
  • Tweak the dask gateway settings (see [LEAP] Dask workers limit #1293)

Alternatively, rather than working to synchronize configurations across three different hubs, we could instead pursue the "one spawner to rule them all" approach that @yuvipanda started to work on. This might be more efficient in the long run.

Updates and actions

No response

@yuvipanda
Copy link
Member

I think for now we should just setup profiles via github groups. If you can create github groups, I can configure the permissions @rabernat.

@yuvipanda
Copy link
Member

@rabernat so the pangeo hub is in us-central1-b, but that zone does not have any GPU support at all! We relocated m2lines and leap to us-central1-c for this, so if you want GPUs here we'll have to do that. This would involve some downtime and I think possibly also some home directory migration.

@yuvipanda
Copy link
Member

@rabernat ok I changed the size of the instances and restricted the large profiles. Can you test it out?

@rabernat
Copy link
Contributor Author

rabernat commented Jun 9, 2022

It works! Fantastic!

I will follow up later about GPUs if we decide that is necessary.

@rabernat rabernat closed this as completed Jun 9, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
No open projects
Development

Successfully merging a pull request may close this issue.

2 participants