Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deploy kubeflow error: Unable to recognize "---", no matches for kind "---" #104

Closed
subodh101 opened this issue Jul 28, 2020 · 7 comments
Closed

Comments

@subodh101
Copy link
Contributor

What?
Deploy Kubeflow is throwing effectively three errors:

  1. no matches for kind "ContainerCluster" in version "container.cnrm.cloud.google.com/v1beta1"
  2. no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
  3. no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"

More details after firing make apply:

$ make apply
# Delete build because we want to prune any resources which are no longer defined in the manifests
rm -rf .build/
mkdir -p .build/
PROJECT=kouzoh-sigmoid-jp-dev NAME=kf-multi-user ./hack/check_domain_length.sh
./hack/check_oauth_secret.sh
# ***********************************************************************************
# Hydrate cnrm
mkdir -p .build/gcp_config
kustomize build --load_restrictor none -o .build/gcp_config ./instance/gcp_config
#************************************************************************************
# hydrate asm
istioctl manifest generate -f ./upstream/manifests/gcp/v2/asm/istio-operator.yaml -o .build/istio
Component dependencies tree:
Base
  Grafana
  Galley
  IngressGateway
  Prometheus
  Pilot
  NodeAgent
  Injector
  PrometheusOperator
  Tracing
  Citadel
  Telemetry
  CertManager
  EgressGateway
  Cni
  Kiali
  Policy

Rendering manifests to output dir .build/istio
Rendering: Base
Writing manifest to .build/istio/Base/Base.yaml
Rendering: Tracing
Writing manifest to .build/istio/Base/Tracing/Tracing.yaml
Rendering: Citadel
Writing manifest to .build/istio/Base/Citadel/Citadel.yaml
Rendering: NodeAgent
Writing manifest to .build/istio/Base/NodeAgent/NodeAgent.yaml
Rendering: Injector
Writing manifest to .build/istio/Base/Injector/Injector.yaml
Rendering: PrometheusOperator
Writing manifest to .build/istio/Base/PrometheusOperator/PrometheusOperator.yaml
Rendering: Cni
Writing manifest to .build/istio/Base/Cni/Cni.yaml
Rendering: Kiali
Writing manifest to .build/istio/Base/Kiali/Kiali.yaml
Rendering: Policy
Writing manifest to .build/istio/Base/Policy/Policy.yaml
Rendering: Telemetry
Writing manifest to .build/istio/Base/Telemetry/Telemetry.yaml
Rendering: CertManager
Writing manifest to .build/istio/Base/CertManager/CertManager.yaml
Rendering: EgressGateway
Writing manifest to .build/istio/Base/EgressGateway/EgressGateway.yaml
Rendering: Galley
Writing manifest to .build/istio/Base/Galley/Galley.yaml
Rendering: Grafana
Writing manifest to .build/istio/Base/Grafana/Grafana.yaml
Rendering: Pilot
Writing manifest to .build/istio/Base/Pilot/Pilot.yaml
Rendering: IngressGateway
Writing manifest to .build/istio/Base/IngressGateway/IngressGateway.yaml
Rendering: Prometheus
Writing manifest to .build/istio/Base/Prometheus/Prometheus.yaml
#************************************************************************************
# Hydrate kubeflow applications
mkdir -p .build/namespaces
kustomize build --load_restrictor none -o .build/namespaces  ./instance/kustomize/namespaces
mkdir -p .build/application
kustomize build --load_restrictor none -o .build/application ./instance/kustomize/application
mkdir -p .build/knative
kustomize build --load_restrictor none -o .build/knative ./instance/kustomize/knative
mkdir -p .build/cert-manager
kustomize build --load_restrictor none -o .build/cert-manager ./instance/kustomize/cert-manager
mkdir -p .build/cert-manager-crds
kustomize build --load_restrictor none -o .build/cert-manager-crds ./instance/kustomize/cert-manager-crds
mkdir -p .build/cert-manager-kube-system-resources
kustomize build --load_restrictor none -o .build/cert-manager-kube-system-resources ./instance/kustomize/cert-manager-kube-system-resources
mkdir -p .build/cloud-endpoints
kustomize build --load_restrictor none -o .build/cloud-endpoints ./instance/kustomize/cloud-endpoints
2020/07/28 18:02:10 well-defined vars that were never replaced: secretName
mkdir -p .build/iap-ingress
kustomize build --load_restrictor none -o .build/iap-ingress ./instance/kustomize/iap-ingress
2020/07/28 18:02:10 well-defined vars that were never replaced: tlsSecretName
mkdir -p .build/kubeflow-apps
kustomize build --load_restrictor none -o .build/kubeflow-apps ./instance/kustomize/kubeflow-apps
2020/07/28 18:02:11 nil value at `valueFrom.configMapKeyRef.name` ignored in mutation attempt
2020/07/28 18:02:11 nil value at `valueFrom.secretKeyRef.name` ignored in mutation attempt
mkdir -p .build/kubeflow-apps
kustomize build --load_restrictor none -o .build/kubeflow-istio ./instance/kustomize/kubeflow-istio
mkdir -p .build/metacontroller
kustomize build --load_restrictor none -o .build/metacontroller ./instance/kustomize/metacontroller
mkdir -p .build/kubeflow-issuer
kustomize build --load_restrictor none -o .build/kubeflow-issuer ./instance/kustomize/kubeflow-issuer
# ignore error per https://github.com/kubeflow/gcp-blueprints/issues/37
kpt fn run .build
Error: resources must be annotated with config.kubernetes.io/index to be written to files
make: [hydrate] Error 1 (ignored)
# Apply management resources
kubectl --context=kf-multi-user apply -f ./.build/gcp_config
computeaddress.compute.cnrm.cloud.google.com/kf-multi-user-ip unchanged
computedisk.compute.cnrm.cloud.google.com/kf-multi-user-storage-artifact-store unchanged
computedisk.compute.cnrm.cloud.google.com/kf-multi-user-storage-metadata-store unchanged
unable to recognize ".build/gcp_config/container.cnrm.cloud.google.com_v1beta1_containercluster_kf-multi-user.yaml": no matches for kind "ContainerCluster" in version "container.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-bigquery.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-cloudbuild.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-cloudsql.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-dataflow.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-dataproc.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-istio-wi.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-kubeflow-wi.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-logging.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-manages-user.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-metricwriter.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-ml.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-monitoringviewer.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-network.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-servicemanagement.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-source.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-storage.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-viewer.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-workload-identity-user.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-bigquery.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-cloudbuild.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-cloudsql.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-dataflow.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-dataproc.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-logging.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-metricwriter.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-ml.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-monitoringviewer.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-source.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-storage.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-viewer.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-workload-identity-user-ml-pipeline-ui.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-workload-identity-user-ml-pipeline-visualizationserver.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-workload-identity-user-pipeline-runner.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-vm-logging.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-vm-policy-cloudtrace.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-vm-policy-meshtelemetry.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-vm-policy-monitoring-viewer.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-vm-policy-monitoring.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-vm-policy-storage.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iamserviceaccount_kf-multi-user-admin.yaml": no matches for kind "IAMServiceAccount" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iamserviceaccount_kf-multi-user-user.yaml": no matches for kind "IAMServiceAccount" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iamserviceaccount_kf-multi-user-vm.yaml": no matches for kind "IAMServiceAccount" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_anthos.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_cloudbuild.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_cloudresourcemanager.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_compute.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_container.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_gkeconnect.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_gkehub.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_iamcredentials.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_iap.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_logging.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_meshca.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_meshconfig.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_meshtelemetry.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_monitoring.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
make: *** [apply-gcp] Error 1
(⎈ |kf-multi-user:default)
~/kubeflow/first-multi                                                                                                                                                                                            ⍉
▶ kubectl --context=kf-multi-user apply -f ./.build/gcp_config
computeaddress.compute.cnrm.cloud.google.com/kf-multi-user-ip unchanged
computedisk.compute.cnrm.cloud.google.com/kf-multi-user-storage-artifact-store unchanged
computedisk.compute.cnrm.cloud.google.com/kf-multi-user-storage-metadata-store unchanged
unable to recognize ".build/gcp_config/container.cnrm.cloud.google.com_v1beta1_containercluster_kf-multi-user.yaml": no matches for kind "ContainerCluster" in version "container.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-bigquery.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-cloudbuild.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-cloudsql.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-dataflow.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-dataproc.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-istio-wi.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-kubeflow-wi.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-logging.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-manages-user.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-metricwriter.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-ml.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-monitoringviewer.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-network.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-servicemanagement.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-source.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-storage.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-viewer.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-admin-workload-identity-user.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-bigquery.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-cloudbuild.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-cloudsql.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-dataflow.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-dataproc.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-logging.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-metricwriter.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-ml.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-monitoringviewer.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-source.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-storage.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-viewer.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-workload-identity-user-ml-pipeline-ui.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-workload-identity-user-ml-pipeline-visualizationserver.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-user-workload-identity-user-pipeline-runner.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-vm-logging.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-vm-policy-cloudtrace.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-vm-policy-meshtelemetry.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-vm-policy-monitoring-viewer.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-vm-policy-monitoring.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iampolicymember_kf-multi-user-vm-policy-storage.yaml": no matches for kind "IAMPolicyMember" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iamserviceaccount_kf-multi-user-admin.yaml": no matches for kind "IAMServiceAccount" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iamserviceaccount_kf-multi-user-user.yaml": no matches for kind "IAMServiceAccount" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/iam.cnrm.cloud.google.com_v1beta1_iamserviceaccount_kf-multi-user-vm.yaml": no matches for kind "IAMServiceAccount" in version "iam.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_anthos.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_cloudbuild.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_cloudresourcemanager.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_compute.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_container.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_gkeconnect.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_gkehub.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_iamcredentials.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_iap.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_logging.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_meshca.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_meshconfig.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_meshtelemetry.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
unable to recognize ".build/gcp_config/serviceusage.cnrm.cloud.google.com_v1beta1_service_monitoring.googleapis.com.yaml": no matches for kind "Service" in version "serviceusage.cnrm.cloud.google.com/v1beta1"
@issue-label-bot
Copy link

Issue-Label Bot is automatically applying the labels:

Label Probability
kind/bug 0.92
platform/gcp 1.00
area/kfctl 0.98

Please mark this comment with 👍 or 👎 to give our bot feedback!
Links: app homepage, dashboard and code for this bot.

@Bobgy
Copy link
Contributor

Bobgy commented Jul 28, 2020

Looks like your management cluster wasn't properly set up.

Can you retry steps in https://github.com/kubeflow/gcp-blueprints/tree/master/management?
and verify KCC is properly installed (the missing kinds are CRDs installed by KCC).

Note, the management cluster needs to be a separate one, looks like you are installing both in the same cluster kf-multi-user.

@subodh101
Copy link
Contributor Author

subodh101 commented Jul 29, 2020

In the management, 5th step is creating an error.

  1. Set the name for the management resources in the upstream kustomize package

kpt cfg set ./upstream name ${MGMT_NAME}

I made some changes in the ./upstream to get make apply working. Definitely did something wrong there.

The error without manual changes:

  1. 5th step
▶ kpt cfg set ./upstream name ${MGMT_NAME}
set 0 fields
Error: open upstream/Kptfile: no such file or directory
  1. 7th step
▶ make apply
# Delete the directory so any resources that have been removed
# from the manifests will be pruned
rm -rf .build
mkdir -p .build/
mkdir -p .build/cluster
kustomize build ./instance/cluster -o .build/cluster 
Error: no matches for OriginalId container.cnrm.cloud.google.com_v1alpha2_ContainerCluster|~X|kf-mgmt; no matches for CurrentId container.cnrm.cloud.google.com_v1alpha2_ContainerCluster|~X|kf-mgmt; failed to find unique target for patch container.cnrm.cloud.google.com_v1alpha2_ContainerCluster|kf-mgmt
make: *** [hydrate] Error 1

Tool Versions:

▶ kpt version                             
v0.24.0
▶ kustomize version                                           
Version: {Version:kustomize/v3.2.1 ...
▶ gcloud version  
Google Cloud SDK 299.0.0
▶ istioctl version
client version: 1.4.10-asm.15

@subodh101
Copy link
Contributor Author

subodh101 commented Jul 29, 2020

Note, the management cluster needs to be a separate one, looks like you are installing both in the same cluster kf-multi-user.

Are we going to maintain two clusters? Management cluster like a parent one and another cluster for kubeflow applications that gets created using management cluster.

@Bobgy
Copy link
Contributor

Bobgy commented Jul 29, 2020

Not sure if related, can you try updated instruction after #105 PR? Or probably looks like there's more changes coming in, you might want to wait a few days before all fixes are ready.

@jlewi can you confirm whether current state in this repo works?

Are we going to maintain two clusters? Management cluster like a parent one and another cluster for kubeflow applications that gets created using management cluster.

Yes, we'll have two clusters, the management cluster is meant to provide declarative GCP resource management by Kubernetes resources, it's using https://cloud.google.com/config-connector/docs/overview.

You can potentially use management cluster for any other GCP resource management.

@jlewi
Copy link
Contributor

jlewi commented Jul 30, 2020

@Bobgy @subodh101 The management cluster is broken per #102 and needs #105 as well as the related PR in kubeflow/manifests ; the pending fixes are needed.

@subodh101
Copy link
Contributor Author

@Bobgy @jlewi
Thanks, it is fixed now.
I was able to successfully deploy it.
Closing the issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants