Migrate CI to Github actions

[castelblanque]

Description:

Move CI to Github actions

• Benefit: Be aligned with most of the Tanzu projects using it

Related to #4096

Progress

• test_go
• test_dashboard
• test_pinniped_proxy
• test_chart_render
• build_go_images
• build_dashboard
• build_pinniped_proxy
• build_e2e_runner
• local_e2e_tests
• sync_chart_from_bitnami
• GKE_REGULAR_VERSION_MAIN
• GKE_REGULAR_VERSION_LATEST_RELEASE
• GKE_STABLE_VERSION_MAIN
• GKE_STABLE_VERSION_LATEST_RELEASE
• push_images
• report_srp
• sync_chart_to_bitnami
• release
• Fix flaky local_e2e_tests(operators)
• Add GHA's badges to the README.md file
• Add new workflow to run Full Integration Pipeline on schedule
• Switch off the CircleCI pipeline.
  • Remove/deactivate the current CircleCI workflow
  • Remove CircleCI badge from README.md
  • Turn off DEV_MODE for GHA's kubeapps-main.yml workflow.
  • Adjust branch-protection configuration to require the GHA's status checks to pass before merging to main, and remove the requirements from the CircleCI status checks.
  • Adjust the configuration of the project in the CircleCI App to stop building the project (also, should we remove the project from CircleCI??).
• Update CI documentation
• Fix failing workflows triggered by dependabot's PRs.
• Unify workflows as much as possible

[antgamdia]

In the meantime, we could start splitting some logic into some container images, as Rafa suggested (see #5177 (review))

[beni0888]

The first iteration of the migration has been completed with the merge of the first version of the new workflow, which includes those jobs that are run for every single push of a branch: test, build images, push images, run e2e tests, and sync from/to Bitnami chart (all but those that belong to the pre-release and release flows, and report_srp).

[ppbaena]

Great work @beni0888 !!!

[castelblanque]

Awesome @beni0888!
Are we storing artifacts from E2E in case they fail? (e.g. screenshots, videos, logs, etc.)

[antgamdia]

I think so, under the "artifacts" section in the github action:
However, they are stored in a zip, so we have to download and uncompress it to view the files. An extra step, unfortunately, but not a big deal.

[beni0888]

To be able to report the SRP source provenance from GHA, we need to generate and ask for the registration of a new SRP UID. I have filed this ticket in Jira Service Desk for that.

[beni0888]

According to the activity in the Jira Ticket, our request has been fulfilled and the new SRP UID has been registered, so we should be able to report the source provenance from GHA.

[beni0888]

I have confirmed with the SRP team that we are already properly reporting the source provenance from the GHA pipeline 🎉

[absoludity]

Nice - looks like you've completed everything other than the easy parts of just switching circle CI off and docs! Well done @beni0888

[beni0888]

I've been working on fixing some minor issues that were preventing the release workflow from working properly. Fortunately, it seems that it finally does 🎉 Although it's still running in DEV_MODE and not actually creating the release, so we cannot be 100% sure until we trigger a real release from the GHA pipeline.

[beni0888]

The PRs with the decommission of CircleCI and the documentation update have been merged. Besides that, I have a couple of ideas to simplify the workflow, better said, to simplify the branch protection rules:

• Add a unit_tests_result job that aggregates the result of all the unit-test jobs, so we can relay in just one status check instead of N
• The same for the image-building jobs

But I think that could be tackle in separate issues, so we can finally close this one

[beni0888]

I've configured the Kubeapps project in CircleCI to stop building this repo. Should we also completely remove the Kubeapps project from CircleCI?