Update release notes for RC2 release of Providers for May 2022

Also updates links to example dags to work properly following apache#24331
potiuk · Jun 8, 2022 · 04fbe61 · 04fbe61
1 parent 047a616
commit 04fbe61
Show file tree

Hide file tree

Showing 209 changed files with 693 additions and 408 deletions.
diff --git a/.pre-commit-config.yaml b/.pre-commit-config.yaml
@@ -779,6 +779,13 @@ repos:
         # We sometimes won't have newsfragments in the repo, so always run it so `check-hooks-apply` passes
         # This is fast, so not too much downside
         always_run: true
+      - id: check-example-dags-urls
+        name: Check that example dags url include provider versions
+        entry: ./scripts/ci/pre_commit/pre_commit_update_example_dags_paths.py
+        language: python
+        pass_filenames: true
+        files: ^docs/.*index\.rst$|^docs/.*example-dags\.rst$
+        additional_dependencies: ['rich>=12.4.4', 'pyyaml']
         ## ADD MOST PRE-COMMITS ABOVE THAT LINE
         # The below pre-commits are those requiring CI image to be built
       - id: run-mypy

diff --git a/STATIC_CODE_CHECKS.rst b/STATIC_CODE_CHECKS.rst
@@ -161,6 +161,8 @@ require Breeze Docker image to be build locally.
 +--------------------------------------------------------+------------------------------------------------------------------+---------+
 | check-docstring-param-types                            | Check that docstrings do not specify param types                 |         |
 +--------------------------------------------------------+------------------------------------------------------------------+---------+
+| check-example-dags-urls                                | Check that example dags url include provider versions            |         |
++--------------------------------------------------------+------------------------------------------------------------------+---------+
 | check-executables-have-shebangs                        | Check that executables have shebang                              |         |
 +--------------------------------------------------------+------------------------------------------------------------------+---------+
 | check-extra-packages-references                        | Checks setup extra packages                                      |         |

diff --git a/airflow/providers/airbyte/CHANGELOG.rst b/airflow/providers/airbyte/CHANGELOG.rst
@@ -37,6 +37,7 @@ Breaking changes
    appropriate section above if needed. Do not delete the lines(!):
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.1.4
 .....

diff --git a/airflow/providers/alibaba/CHANGELOG.rst b/airflow/providers/alibaba/CHANGELOG.rst
@@ -48,6 +48,7 @@ Misc
    * ``Migrate Alibaba example DAGs to new design #22437 (#24130)``
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 1.1.1
 .....

diff --git a/airflow/providers/amazon/CHANGELOG.rst b/airflow/providers/amazon/CHANGELOG.rst
@@ -46,6 +46,7 @@ Bug Fixes
 * ``fix: StepFunctionHook ignores explicit set 'region_name' (#23976)``
 * ``Fix Amazon EKS example DAG raises warning during Imports (#23849)``
 * ``Move string arg evals to 'execute()' in 'EksCreateClusterOperator' (#23877)``
+* ``fix: patches #24215. Won't raise KeyError when 'create_job_kwargs' contains the 'Command' key. (#24308)``
 
 Misc
 ~~~~
@@ -70,6 +71,7 @@ Misc
    * ``Introduce 'flake8-implicit-str-concat' plugin to static checks (#23873)``
    * ``pydocstyle D202 added (#24221)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 3.4.0
 .....

diff --git a/airflow/providers/apache/beam/CHANGELOG.rst b/airflow/providers/apache/beam/CHANGELOG.rst
@@ -49,6 +49,7 @@ Misc
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``AIP-47 - Migrate beam DAGs to new design #22439 (#24211)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 3.4.0
 .....

diff --git a/airflow/providers/apache/cassandra/CHANGELOG.rst b/airflow/providers/apache/cassandra/CHANGELOG.rst
@@ -43,6 +43,7 @@ Misc
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``AIP-47 - Migrate cassandra DAGs to new design #22439 (#24209)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.1.3
 .....

diff --git a/airflow/providers/apache/drill/CHANGELOG.rst b/airflow/providers/apache/drill/CHANGELOG.rst
@@ -39,9 +39,9 @@ Breaking changes
    * ``AIP-47 - Migrate drill DAGs to new design #22439 (#24206)``
    * ``Prepare provider documentation 2022.05.11 (#23631)``
    * ``Clean up in-line f-string concatenation (#23591)``
-
    * ``chore: Refactoring and Cleaning Apache Providers (#24219)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 1.0.4
 .....

diff --git a/airflow/providers/apache/druid/CHANGELOG.rst b/airflow/providers/apache/druid/CHANGELOG.rst
@@ -44,6 +44,7 @@ Misc
    * ``AIP-47 - Migrate druid DAGs to new design #22439 (#24207)``
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.3.3
 .....

diff --git a/airflow/providers/apache/hdfs/CHANGELOG.rst b/airflow/providers/apache/hdfs/CHANGELOG.rst
@@ -43,6 +43,7 @@ Misc
    appropriate section above if needed. Do not delete the lines(!):
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.2.3
 .....

diff --git a/airflow/providers/apache/hive/CHANGELOG.rst b/airflow/providers/apache/hive/CHANGELOG.rst
@@ -44,6 +44,7 @@ Misc
    * ``Add typing for airflow/configuration.py (#23716)``
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.3.3
 .....

diff --git a/airflow/providers/apache/kylin/CHANGELOG.rst b/airflow/providers/apache/kylin/CHANGELOG.rst
@@ -44,6 +44,7 @@ Misc
    appropriate section above if needed. Do not delete the lines(!):
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.0.4
 .....

diff --git a/airflow/providers/apache/livy/CHANGELOG.rst b/airflow/providers/apache/livy/CHANGELOG.rst
@@ -38,6 +38,7 @@ Breaking changes
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``AIP-47 - Migrate livy DAGs to new design #22439 (#24208)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.2.3
 .....

diff --git a/airflow/providers/apache/pig/CHANGELOG.rst b/airflow/providers/apache/pig/CHANGELOG.rst
@@ -38,6 +38,7 @@ Breaking changes
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``AIP-47 - Migrate apache pig DAGs to new design #22439 (#24212)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.0.4
 .....

diff --git a/airflow/providers/apache/pinot/CHANGELOG.rst b/airflow/providers/apache/pinot/CHANGELOG.rst
@@ -42,6 +42,7 @@ Misc
    appropriate section above if needed. Do not delete the lines(!):
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.0.4
 .....

diff --git a/airflow/providers/apache/spark/CHANGELOG.rst b/airflow/providers/apache/spark/CHANGELOG.rst
@@ -50,6 +50,7 @@ Misc
    appropriate section above if needed. Do not delete the lines(!):
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.1.3
 .....

diff --git a/airflow/providers/apache/sqoop/CHANGELOG.rst b/airflow/providers/apache/sqoop/CHANGELOG.rst
@@ -37,6 +37,7 @@ Breaking changes
    appropriate section above if needed. Do not delete the lines(!):
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.1.3
 .....

diff --git a/airflow/providers/arangodb/CHANGELOG.rst b/airflow/providers/arangodb/CHANGELOG.rst
@@ -38,6 +38,7 @@ Breaking changes
    * ``Clean up f-strings in logging calls (#23597)``
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 1.0.0
 .....

diff --git a/airflow/providers/asana/CHANGELOG.rst b/airflow/providers/asana/CHANGELOG.rst
@@ -40,6 +40,7 @@ Breaking changes
    * ``Use new Breese for building, pulling and verifying the images. (#23104)``
    * ``Fix new MyPy errors in main (#22884)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 1.1.3
 .....

diff --git a/airflow/providers/celery/CHANGELOG.rst b/airflow/providers/celery/CHANGELOG.rst
@@ -37,6 +37,7 @@ Breaking changes
    appropriate section above if needed. Do not delete the lines(!):
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.1.4
 .....

diff --git a/airflow/providers/cloudant/CHANGELOG.rst b/airflow/providers/cloudant/CHANGELOG.rst
@@ -40,6 +40,7 @@ Breaking changes
    * ``Use new Breese for building, pulling and verifying the images. (#23104)``
    * ``Fix new MyPy errors in main (#22884)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.0.4
 .....

diff --git a/airflow/providers/cncf/kubernetes/CHANGELOG.rst b/airflow/providers/cncf/kubernetes/CHANGELOG.rst
@@ -24,14 +24,11 @@
 Changelog
 ---------
 
-5.0.0
+4.1.0
 .....
 
-Breaking changes
-~~~~~~~~~~~~~~~~
-
-* This release of provider is only available for Airflow 2.2+ as explained in the Apache Airflow
-  providers support policy https://github.com/apache/airflow/blob/main/README.md#support-for-providers
+Features
+~~~~~~~~
 
 * Previously, KubernetesPodOperator relied on core Airflow configuration (namely setting for kubernetes
   executor) for certain settings used in client generation.  Now KubernetesPodOperator
@@ -41,9 +38,6 @@ Breaking changes
   configure the kubernetes client, then prior to the next major release you will need to
   add an Airflow connection and set your KPO tasks to use that connection.
 
-Features
-~~~~~~~~
-
 * ``Use KubernetesHook to create api client in KubernetesPodOperator (#20578)``
 * ``[FEATURE] KPO use K8S hook (#22086)``
 * ``Add param docs to KubernetesHook and KubernetesPodOperator (#23955) (#24054)``
@@ -66,6 +60,7 @@ Misc
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``pydocstyle D202 added (#24221)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 4.0.2
 .....

diff --git a/airflow/providers/cncf/kubernetes/provider.yaml b/airflow/providers/cncf/kubernetes/provider.yaml
@@ -22,7 +22,7 @@ description: |
     `Kubernetes <https://kubernetes.io/>`__
 
 versions:
-  - 5.0.0
+  - 4.1.0
   - 4.0.2
   - 4.0.1
   - 4.0.0

diff --git a/airflow/providers/databricks/CHANGELOG.rst b/airflow/providers/databricks/CHANGELOG.rst
@@ -51,6 +51,7 @@ Bug Fixes
    * ``Introduce 'flake8-implicit-str-concat' plugin to static checks (#23873)``
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.7.0
 .....

diff --git a/airflow/providers/datadog/CHANGELOG.rst b/airflow/providers/datadog/CHANGELOG.rst
@@ -41,6 +41,7 @@ Breaking changes
    * ``Prepare provider documentation 2022.05.11 (#23631)``
    * ``Use new Breeze for building, pulling and verifying the images. (#23104)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.0.4
 .....

diff --git a/airflow/providers/dbt/cloud/CHANGELOG.rst b/airflow/providers/dbt/cloud/CHANGELOG.rst
@@ -53,6 +53,7 @@ Bug Fixes
    * ``Replace usage of 'DummyOperator' with 'EmptyOperator' (#22974)``
    * ``Update dbt.py (#24218)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 1.0.2
 .....

diff --git a/airflow/providers/dingding/CHANGELOG.rst b/airflow/providers/dingding/CHANGELOG.rst
@@ -42,6 +42,7 @@ Breaking changes
    * ``Use new Breese for building, pulling and verifying the images. (#23104)``
    * ``Update tree doc references to grid (#22966)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.0.4
 .....

diff --git a/airflow/providers/discord/CHANGELOG.rst b/airflow/providers/discord/CHANGELOG.rst
@@ -37,6 +37,7 @@ Breaking changes
    appropriate section above if needed. Do not delete the lines(!):
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.1.4
 .....

diff --git a/airflow/providers/docker/CHANGELOG.rst b/airflow/providers/docker/CHANGELOG.rst
@@ -43,6 +43,7 @@ Misc
    appropriate section above if needed. Do not delete the lines(!):
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.7.0
 .....

diff --git a/airflow/providers/elasticsearch/CHANGELOG.rst b/airflow/providers/elasticsearch/CHANGELOG.rst
@@ -46,6 +46,7 @@ Misc
    * ``Prepare provider documentation 2022.05.11 (#23631)``
    * ``Use new Breese for building, pulling and verifying the images. (#23104)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 3.0.3
 .....

diff --git a/airflow/providers/exasol/CHANGELOG.rst b/airflow/providers/exasol/CHANGELOG.rst
@@ -42,6 +42,7 @@ Bug Fixes
    appropriate section above if needed. Do not delete the lines(!):
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.1.3
 .....

diff --git a/airflow/providers/facebook/CHANGELOG.rst b/airflow/providers/facebook/CHANGELOG.rst
@@ -37,6 +37,7 @@ Breaking changes
    appropriate section above if needed. Do not delete the lines(!):
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.2.3
 .....

diff --git a/airflow/providers/ftp/CHANGELOG.rst b/airflow/providers/ftp/CHANGELOG.rst
@@ -38,6 +38,7 @@ Breaking changes
    appropriate section above if needed. Do not delete the lines(!):
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.1.2
 .....

diff --git a/airflow/providers/github/CHANGELOG.rst b/airflow/providers/github/CHANGELOG.rst
@@ -41,6 +41,7 @@ Bug Fixes
    * ``Prepare provider documentation 2022.05.11 (#23631)``
    * ``Use new Breese for building, pulling and verifying the images. (#23104)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 1.0.3
 .....

diff --git a/airflow/providers/google/CHANGELOG.rst b/airflow/providers/google/CHANGELOG.rst
@@ -56,6 +56,7 @@ Bug Fixes
 * ``Fix DataprocJobBaseOperator not being compatible with dotted names (#23439). (#23791)``
 * ``Remove hack from BigQuery DTS hook (#23887)``
 * ``Fix GCSToGCSOperator cannot copy a single file/folder without copying other files/folders with that prefix (#24039)``
+* ``Workaround job race bug on biguery to gcs transfer (#24330)``
 
 Misc
 ~~~~
@@ -73,6 +74,7 @@ Misc
    * ``Clean up f-strings in logging calls (#23597)``
    * ``pydocstyle D202 added (#24221)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 7.0.0
 .....

diff --git a/airflow/providers/grpc/CHANGELOG.rst b/airflow/providers/grpc/CHANGELOG.rst
@@ -37,6 +37,7 @@ Breaking changes
    appropriate section above if needed. Do not delete the lines(!):
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.0.4
 .....

diff --git a/airflow/providers/hashicorp/CHANGELOG.rst b/airflow/providers/hashicorp/CHANGELOG.rst
@@ -38,6 +38,9 @@ Breaking changes
    * ``pydocstyle D202 added (#24221)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
 
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.2.0
 .....

diff --git a/airflow/providers/http/CHANGELOG.rst b/airflow/providers/http/CHANGELOG.rst
@@ -38,6 +38,7 @@ Breaking changes
    * ``Migrate HTTP example DAGs to new design AIP-47 (#23991)``
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.1.2
 .....

diff --git a/airflow/providers/imap/CHANGELOG.rst b/airflow/providers/imap/CHANGELOG.rst
@@ -37,6 +37,7 @@ Breaking changes
    appropriate section above if needed. Do not delete the lines(!):
    * ``Add explanatory note for contributors about updating Changelog (#24229)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.2.3
 .....

diff --git a/airflow/providers/influxdb/CHANGELOG.rst b/airflow/providers/influxdb/CHANGELOG.rst
@@ -41,6 +41,7 @@ Breaking changes
    * ``Prepare provider documentation 2022.05.11 (#23631)``
    * ``Bump pre-commit hook versions (#22887)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 1.1.3
 .....

diff --git a/airflow/providers/jdbc/CHANGELOG.rst b/airflow/providers/jdbc/CHANGELOG.rst
@@ -46,6 +46,7 @@ Features
    * ``Use new Breese for building, pulling and verifying the images. (#23104)``
    * ``Replace usage of 'DummyOperator' with 'EmptyOperator' (#22974)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.1.3
 .....

diff --git a/airflow/providers/jenkins/CHANGELOG.rst b/airflow/providers/jenkins/CHANGELOG.rst
@@ -46,6 +46,7 @@ Bug Fixes
    * ``Prepare provider documentation 2022.05.11 (#23631)``
    * ``Use new Breese for building, pulling and verifying the images. (#23104)``
    * ``Prepare docs for May 2022 provider's release (#24231)``
+   * ``Update package description to remove double min-airflow specification (#24292)``
 
 2.1.0
 .....
-Original file line number
+Diff line change
@@ Expand Up / @@ -22,7 +22,7 @@ description: | @@
         `Kubernetes <https://kubernetes.io/>`__
     versions:
-      - 5.0.0
+      - 4.1.0
       - 4.0.2
       - 4.0.1
       - 4.0.0
@@ Expand Down @@