Cloud metadata

[dacbd]

Closes #430
Supercedes or Blocked by: #747
Requires upstream: iterative/terraform-provider-iterative#185

Manual testing:

./bin/cml.js runner \
    --single \
    --log=debug \
    --idle-timeout=1800 \
    --token=xxx \
    --cloud=gcp \
    --cloud-region=us-west \
    --cloud-type=m \
    --cloud-metadata="mykey=myval" \
    --cloud-gpu=nogpu \
    --repo=xxx \
    --driver=github \
    --cloud-hdd-size=10

Terraform template:

terraform {
  required_providers {
    iterative = {
      source = "iterative/iterative"
    }
  }
}

provider "iterative" {}


resource "iterative_cml_runner" "runner" {
  repo = "xxx"
  token = "xxx"
  driver = "github"
  labels = "cml"
  idle_timeout = 1800
  name = "cml-40elk3xchx"
  single = "true"
  cloud = "gcp"
  region = "us-west"
  instance_type = "m"
  
  instance_hdd_size = 10
  
  
  spot_price = -1
  
  
  metadata = {
    mykey = "myval"
  }
}

Test:

./bin/cml.js runner \
    --single \
    --log=debug \
    --idle-timeout=1800 \
    --token=xxx \
    --cloud=gcp \
    --cloud-region=us-west \
    --cloud-type=m \
    --cloud-metadata="mykey=myval" \
    --cloud-metadata="mykey2=myval2" \
    --cloud-metadata="mykey3=myval3" \
    --cloud-gpu=nogpu \
    --repo=xxx \
    --driver=github \
    --cloud-hdd-size=10

Terraform template:

terraform {
  required_providers {
    iterative = {
      source = "iterative/iterative"
    }
  }
}

provider "iterative" {}


resource "iterative_cml_runner" "runner" {
  repo = "xxx"
  token = "xxx"
  driver = "github"
  labels = "cml"
  idle_timeout = 1800
  name = "cml-40elk3xchx"
  single = "true"
  cloud = "gcp"
  region = "us-west"
  instance_type = "m"
  
  instance_hdd_size = 10
  
  
  spot_price = -1
  
  
  metadata = {
    mykey = "myval"
    mykey2 = "myval2"
    mykey3 = "myval3"
  }
}

[dacbd]

@0x2b3bfa0 or @DavidGOrtega are you able to add a contrib branch and change the PR target while it is still marked as a draft?

[dacbd]

Updated based on: #430 (comment)

[0x2b3bfa0]

are you able to add a contrib branch and change the PR target while it is still marked as a draft?

Yes, we can. Would you like to merge it first to a contrib branch on our repository?

[0x2b3bfa0]

@danielbarnes, counter–attacking with some suggestions and updated tests on dacbd#1. Feel free to review and merge that into your pull request.

[dacbd]

are you able to add a contrib branch and change the PR target while it is still marked as a draft?

Yes, we can. Would you like to merge it first to a contrib branch on our repository?

I'm fine with 'owning' this patch should any changes be required but I'm still knocking off ~6yrs of nodejs rust and would prefer it lives on a branch here since upstream changes need to be published before it can really be tested.

and I have a bad habit of blasting my own repos and re-forking things 😨

[0x2b3bfa0]

Awesome!

[0x2b3bfa0]

Merged into a separate branch. We'll release it after the Terraform provider.