Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add carbonplan cluster + hubs #391

Merged
merged 12 commits into from
May 14, 2021
Merged

Commits on May 11, 2021

  1. Add carbonplan cluster + hubs

    - staging and prod clusters that are exactly the same,
      with just domain differences
    - Uses traditional autohttps + LoadBalancer to get traffic
      into the cluster. Could be nginx-ingress later on if necessary.
    - Manual DNS entries for staging.carbonplan.2i2c.cloud and
      carbonplan.2i2c.cloud. Initial manual deploy with
      `proxy.https.enabled` set to false to complete deployment,
      fetch externalIP of `proxy-public` service, setup DNS,
      then re-deploy with `proxy.https.enabled` set to true.
    
    Ref 2i2c-org#291
    yuvipanda committed May 11, 2021
    Configuration menu
    Copy the full SHA
    a97ab8b View commit details
    Browse the repository at this point in the history
  2. Standardize labels used for our various nodes

    We have three sets of labels:
    
    1. What components of a JupyterHub can run here? core / user
    2. What components of a dask gateway can run here? core / scheduler /
       worker
    3. What are the features of the node pool we care about? For example,
       if we want to be on an r5.xlarge node, we should target the
       existing node.kubernetes.io/instance-type label
    
    This gives us flexibility without adding too much overhead.
    yuvipanda committed May 11, 2021
    Configuration menu
    Copy the full SHA
    3c344a4 View commit details
    Browse the repository at this point in the history
  3. Use upstream pangeo image

    dask-gateway requires that the image used for it
    contains the `dask-gateway` package. The scheduler image is
    the same image as the user notebook image, to make sure that
    versions match. The previously used image did not have
    dask-gateway installed
    yuvipanda committed May 11, 2021
    Configuration menu
    Copy the full SHA
    6553ab5 View commit details
    Browse the repository at this point in the history
  4. Tell clusterautoscaler about node.kubernetes.io/machine-type

    Otherwise it doesn't know which instance group to scale up
    when a pod wants a node with that label
    yuvipanda committed May 11, 2021
    Configuration menu
    Copy the full SHA
    4593a11 View commit details
    Browse the repository at this point in the history
  5. Use new cluster creds + EFS

    yuvipanda committed May 11, 2021
    Configuration menu
    Copy the full SHA
    09302c9 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    b3dd9e2 View commit details
    Browse the repository at this point in the history
  7. Set configBase explicitly

    yuvipanda committed May 11, 2021
    Configuration menu
    Copy the full SHA
    e898ae8 View commit details
    Browse the repository at this point in the history

Commits on May 12, 2021

  1. Configuration menu
    Copy the full SHA
    a13443a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ef2df6e View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    5c90a76 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2021

  1. Configuration menu
    Copy the full SHA
    3b79055 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    302438f View commit details
    Browse the repository at this point in the history