Job template with role annotation

[elena123]

     Hi team,

I want to use a specific role in AWS for a POD which executes the tests. What would be the best approach to achieve this?
I tried to use a job template like the following:

1. Defined the job template:
`apiVersion: batch/v1
kind: Job
metadata:
  name: job-template-test
spec:
  template:
    metadata:
      annotations:
        iam.amazonaws.com/role: NAME_OF_THE_ROLE
    spec:
      containers:
        - name: test-container
          image: DOCKER_IMAGE
          imagePullPolicy: Always
          command:
      		......
          env:
		    ......`

 2. Applied it to the cluster:
 
` kubectl apply -f job-template.yaml`
 
 3. When tried to apply the template to the POD:
 
 `POD_NAME=$(kubectl testkube run test test-data --namespace NAMESPACE_NAME --job-template-reference job-template-test)`
 
 I received the following error:

 (error: api/POST-testkube.Execution returned error: api server problem: failed to execute test: execution failed: test execution failed: templates.tests.testkube.io "job-template-test" not found, context: null;
 
 Any help on this will be highly appreciated.

[vLia]

Hello @elena123,

The templates in Testkube are namespaced resources. Have you tried adding the testkube namespace to the definition?

[elena123]

Hi @vLia,
Yes, I tried, but received the following error:
Error from server (NotFound): error when creating "job-template.yaml": namespaces "testkube" not found

[vsukhin]

hey @elena123 have you tried to use this helm chart var https://github.com/kubeshop/helm-charts/blob/develop/charts/testkube/values.yaml

[elena123]

Thank you, @vsukhin!

I'll try to set it and test in the cluster.
Regards,
Elena

[elena123]

Hi @vsukhin ,
We just realised that we don't want to use a single role for all the tests. What would be the best way to define a role for a single test?

Regards,
Elena

[vsukhin]

Use jobTemplate field in Test CRD
https://docs.testkube.io/articles/creating-tests#changing-the-default-job-template-used-for-test-execution
Example
https://github.com/kubeshop/testkube/blob/develop/test/container-executor/executor-smoke/crd/k6.yaml#L19

[elena123]

Thank you, @vsukhin!
I created a job template and was able to run successfully the test with this command:
kubectl testkube run test test-data --namespace test-namespace --job-template job-template.yaml

Thank you for the support,
Elena

[vsukhin]

Welcome, Elena and happy Testkubing!

[elena123]

Hi again @vsukhin,
Now I'm able to run the tests locally in the cluster, but I want to run them as part of the gitlab pipeline.

What would be the best in this case:

1. To include the job template in the docker image with the tests and later to execute the tests from that image
2. Somehow to apply the template to the cluster and execute the test run command?

Thank you!

[vsukhin]

Good practice is to store eerything in git, in your case in gitlab repo