Specifying tolerations for storage-version-migration-serving

[serenagrl]

Hi,

I am evaluating Knative serving on a 3 control-plane k8s configuration and I have chose to use the operator installation method. I am able to get all the knative-serving pods (i.e. activator, autoscaler, net-istio-xxx and etc.) running by configuring the tolerations and nodeselector in the workloads section under the KnativeServing kind. However, I can't get 1 particular pod to run which is the storage-version-migration-serving pod which is stuck at Pending status caused by failed scheduling due to untolerated taints on the nodes.

I have tried to configure it by putting an item with the name "storage-version-migration-serving" in the workloads section but it did not work. Also because the pods are running for the storage-version-migration-serving job, I am unable to patch it.

I would like to know how and where can I configure the tolerations and nodeselector for the storage-version-migration-serving.

Thank You.

[dprotaso]

cc @houshengbo is it possible to configure the operator to include tolerations/node the post install jobs?

[houshengbo]

@serenagrl Does Kubernetes support the tolerations and nodeselector configuration on Jobs?
So far, Knative Operator does not support configuration of tolerations and nodeselector for Job. If we plan to enable it, we need to makes sure Jobs can support it first. From the operator's perspective, it can directly touch/configure the Job, not on the pod.

[dprotaso]

Hey @houshengbo Job resource embeds the PodSpec which supports toleration and node selectors

[houshengbo]

Yep, I just found them. I guess what I can do with operator is to enable the configuration for Jobs.

[serenagrl]

Thank you.

[dprotaso]

I created an issue in the operator repo - knative/operator#1480