11815 New github action to test projects that depend on the project being changed

[suhomud]

What

New github action to test projects that depend on the project being changed

How

• It used git diff to compare created branch with master.
• The connector considered as changed only if it's files changed in /airbyte-integrations/connectors/src/main/ or it's build.gradle file was updated
• It used python script to go through every connector under the /airbyte-integrations/connectors/ directory and parse the build.gradle files to see if a connector depends on the updated connector.
• It will report which integration tests should be executed in PR comments.
  For example:

Recommended reading order

1. x.java
2. y.python

🚨 User Impact 🚨

No user impact

[github-actions]

NOTE ⚠️ Changes in this PR affect the following connectors. Make sure to run corresponding integration tests:

• destination-bigquery-denormalized
• destination-bigquery
• destination-gcs
• destination-snowflake

[suhomud]

NOTE: I'll remove this change https://github.com/airbytehq/airbyte/pull/15783/files#diff-76d8a8b5d7069ee4ae2863e3e5db859b33d5e099ed367e958ace9ad8e0be0d55R54
After final approval. This change is for showing GitHub action report

[github-actions]

NOTE ⚠️ Changes in this PR affect the following connectors. Make sure to run corresponding integration tests:

• destination-bigquery
• destination-gcs
• destination-bigquery-denormalized
• destination-snowflake

[suhomud]

@grishick @tuliren,

I did update for this one. So now it works in this way:

• git diff will return result for airbyte-integrations/bases airbyte-integrations/connectors folders only
• script will filter files which are in IGNORE_LIST like tests folders (unit, integration) for Java and Python and some common files like README.md and cetera. NOTE: Please review IGNORE_LIST Mayme I missed something which can be ignored
• then it checks all connectors build.gradle file if it contains affected modules.

Check 1

Here I made changes in airbyte-integrations/connectors/destination-gcs and airbyte-integrations/bases/debezium-v1-9-2

debezium-v1-9-2 -> source-mysql, source-postgres

destination-gcs -> destination-snowflake, destination-bigquery-denormalized, destination-gcs, destination-bigquery

Check 2

Script found 40 dependencies if I'll change airbyte-integrations/bases/standart-destination-test module:

The same result I have for manual search:

[grishick]

Great job! This is going to be so useful!