This repository is under construction and contains untested, experimental and unfinished code. This code is not production-ready, and while it could be useful for others, should not be copied over without appropriate scrutiny.
Use at your own risk.
Monorepo containing dagster DAGs.
The resources in this repository assume that you have set up your infrastructure using the resources in the dagster-infra repository.
-
Install the gcloud client
-
Log into your own GCP account
gcloud auth login
-
Set the default project
gcloud config set project <project-name>
-
Also set the default project and cluster base name in the
.justfile
-
Execute
gcloud components install gke-gcloud-auth-plugin
-
Install just
-
Install pants
-
Install poetry
Execute just authenticate_kubectl
to authenticate with the kubernetes cluster.
The CI/CD pipelines defined under '.github'