Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OVH down #2863

Open
minrk opened this issue Dec 13, 2023 · 1 comment
Open

OVH down #2863

minrk opened this issue Dec 13, 2023 · 1 comment

Comments

@minrk
Copy link
Member

minrk commented Dec 13, 2023

The whole OVH cluster is down, apparently the project is suspended for some reason. We've received no communication about it, but are pursuing via email.

Because OVH was the 'prime' member, this meant mybinder.org was unavailable. The 'prime' member does two things:

  1. it serves the HTML pages for mybinder.org (via proxy, not directly)
  2. it will still be routed requests when it's full/unhealthy, relying on its own quota to limit traffic

Thanks to the separation of the federation-redirect from the main cluster when we had to shut down most of GKE, making another member prime is all we needed to do (#2862) to get mybinder.org back up, since no member directly serves mybinder.org.

And thanks to @manics and @stevejpurves, we actually have another candidate in curvenote, which has filled in as the prime member, so mybinder.org is back up at diminished capacity, rather than completely unavailable. GESIS probably shouldn't be prime because it serves a custom main page at https://notebooks.gesis.org/binder/

@minrk
Copy link
Member Author

minrk commented Dec 14, 2023

OVH is back up, we are still trying to understand what happened.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant