Update the test infrastructure to use kustomize

[IronPan]

Currently the test infra deploys a cluster with pipeline code from HEAD
https://github.com/kubeflow/pipelines/blob/master/test/deploy-kubeflow.sh#L35
https://github.com/kubeflow/pipelines/blob/master/test/deploy-pipeline.sh#L50
relying on ksonnet.

We need to update these script to use kustomize as kubeflow is deprecating ksonnet in favor of kustomize.

[Bobgy]

Depends on Upgradability Issue

[Bobgy]

General plan:

• (p0) presubmit/postsubmit tests should run on pipeline lite deployment.
• (p1) the same tests should run continuously for master branch on kubeflow 0.6 deployment.

Detailed steps:

1. Refactor presubmit-tests-with-pipeline-deployment.sh to run in other projects #1732 that let me run tests on my own gcp project
2. Use KFP lite deployment for presubmit tests #1808 changes presubmit-tests-with-pipeline-deployment.sh to run tests on kfp lightweight deployment
3. Move postsubmit tests to lite deployment #1939 change postsubmit-tests-with-pipeline-deployment.sh to run tests on kfp lightweight deployment
4. add an additional flag on presubmit and postsubmit tests to run on kubeflow 0.6+ and configure it to run continuously (or maybe postsubmit?)

[Bobgy]

@jessiezcc all p0 issues are resolved, can we change the tag to p1 now?

[Bobgy]

Actually, I think it's better creating a new issue for

add an additional flag on presubmit and postsubmit tests to run on kubeflow 0.6+ and configure it to run continuously (or maybe postsubmit?

[Bobgy]

/close

Created new issue for step 4.

[k8s-ci-robot]

@Bobgy: Closing this issue.

In response to this:

/close

Created new issue for step 4.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.