Skip to content

Commit

Permalink
Prepare bug-fix release of providers out of band (#26109)
Browse files Browse the repository at this point in the history
* Prepare release of amazon provider out of band

There is an circular import error that means 5.0.0 can't be used with
the SecretsManager - worth releaseing a fix for this now

* Include common.sql, presto, sqlite and trino in the batch

* Correctly set dep back to common-sql>=1.2.0

* Postgres provider too
  • Loading branch information
ashb authored Sep 5, 2022
1 parent 54e7d20 commit 25d0baa
Show file tree
Hide file tree
Showing 24 changed files with 252 additions and 28 deletions.
36 changes: 36 additions & 0 deletions airflow/providers/amazon/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,42 @@
Changelog
---------

5.1.0
.....


Features
~~~~~~~~

* ``Additional mask aws credentials (#26014)``
* ``Add RedshiftDeleteClusterSnapshotOperator (#25975)``
* ``Add redshift create cluster snapshot operator (#25857)``
* ``Add common-sql lower bound for common-sql (#25789)``
* ``Allow AWS Secrets Backends use AWS Connection capabilities (#25628)``
* ``Implement 'EmrEksCreateClusterOperator' (#25816)``
* ``Improve error handling/messaging around bucket exist check (#25805)``

Bug Fixes
~~~~~~~~~

* ``Fix display aws connection info (#26025)``
* ``Fix 'EcsBaseOperator' and 'EcsBaseSensor' arguments (#25989)``
* ``Fix RDS system test (#25839)``
* ``Avoid circular import problems when instantiating AWS SM backend (#25810)``
* ``fix bug construction of Connection object in version 5.0.0rc3 (#25716)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Fix EMR serverless system test (#25969)``
* ``Add 'output' property to MappedOperator (#25604)``
* ``Add Airflow specific warning classes (#25799)``
* ``Replace SQL with Common SQL in pre commit (#26058)``
* ``Hook into Mypy to get rid of those cast() (#26023)``
* ``Raise an error on create bucket if use regional endpoint for us-east-1 and region not set (#25945)``
* ``Update AWS system tests to use SystemTestContextBuilder (#25748)``
* ``Convert Quicksight Sample DAG to System Test (#25696)``
* ``Consolidate to one 'schedule' param (#25410)``
5.0.0
.....

Expand Down
3 changes: 2 additions & 1 deletion airflow/providers/amazon/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,7 @@ description: |
Amazon integration (including `Amazon Web Services (AWS) <https://aws.amazon.com/>`__).
versions:
- 5.1.0
- 5.0.0
- 4.1.0
- 4.0.0
Expand All @@ -45,7 +46,7 @@ versions:

dependencies:
- apache-airflow>=2.2.0
- apache-airflow-providers-common-sql>=1.1.0
- apache-airflow-providers-common-sql>=1.2.0
- boto3>=1.15.0
# watchtower 3 has been released end Jan and introduced breaking change across the board that might
# change logging behaviour:
Expand Down
21 changes: 21 additions & 0 deletions airflow/providers/common/sql/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,27 @@
Changelog
---------

1.2.0
.....


Features
~~~~~~~~

* ``Make placeholder style configurable (#25939)``
* ``Better error messsage for pre-common-sql providers (#26051)``

Bug Fixes
~~~~~~~~~

* ``Fix (and test) SQLTableCheckOperator on postgresql (#25821)``
* ``Don't use Pandas for SQLTableCheckOperator (#25822)``
* ``Discard semicolon stripping in SQL hook (#25855)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
1.1.0
.....

Expand Down
13 changes: 13 additions & 0 deletions airflow/providers/postgres/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,19 @@
Changelog
---------

5.2.1
.....

Bug Fixes
~~~~~~~~~

* ``Bump dep on common-sql to fix issue with SQLTableCheckOperator (#26143)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``postgres provider: use non-binary psycopg2 (#25710)``
* ``Add common-sql lower bound for common-sql (#25789)``
5.2.0
.....

Expand Down
1 change: 1 addition & 0 deletions airflow/providers/postgres/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,7 @@ description: |
`PostgreSQL <https://www.postgresql.org/>`__
versions:
- 5.2.1
- 5.2.0
- 5.1.0
- 5.0.0
Expand Down
16 changes: 16 additions & 0 deletions airflow/providers/presto/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,22 @@
Changelog
---------

4.0.1
.....

Features
~~~~~~~~

* ``Add common-sql lower bound for common-sql (#25789)``

Bug Fixes
~~~~~~~~~

* ``Fix placeholders in 'TrinoHook', 'PrestoHook', 'SqliteHook' (#25939)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
4.0.0
.....

Expand Down
1 change: 1 addition & 0 deletions airflow/providers/presto/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,7 @@ description: |
`Presto <https://prestodb.github.io/>`__
versions:
- 4.0.1
- 4.0.0
- 3.1.0
- 3.0.0
Expand Down
16 changes: 16 additions & 0 deletions airflow/providers/sqlite/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,22 @@
Changelog
---------

3.2.1
.....

Features
~~~~~~~~

* ``Add common-sql lower bound for common-sql (#25789)``

Bug Fixes
~~~~~~~~~

* ``Fix placeholders in 'TrinoHook', 'PrestoHook', 'SqliteHook' (#25939)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
3.2.0
.....

Expand Down
1 change: 1 addition & 0 deletions airflow/providers/sqlite/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,7 @@ description: |
`SQLite <https://www.sqlite.org/>`__
versions:
- 3.2.1
- 3.2.0
- 3.1.0
- 3.0.0
Expand Down
16 changes: 16 additions & 0 deletions airflow/providers/trino/CHANGELOG.rst
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,22 @@
Changelog
---------

4.0.1
.....

Features
~~~~~~~~

* ``Add common-sql lower bound for common-sql (#25789)``

Bug Fixes
~~~~~~~~~

* ``Fix placeholders in 'TrinoHook', 'PrestoHook', 'SqliteHook' (#25939)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
4.0.0
.....

Expand Down
1 change: 1 addition & 0 deletions airflow/providers/trino/provider.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,7 @@ description: |
`Trino <https://trino.io/>`__
versions:
- 4.0.1
- 4.0.0
- 3.1.0
- 3.0.0
Expand Down
32 changes: 32 additions & 0 deletions docs/apache-airflow-providers-amazon/commits.rst
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,37 @@ For high-level changelog, see :doc:`package information including changelog <ind



5.1.0
.....

Latest change: 2022-08-31

================================================================================================= =========== ======================================================================================================
Commit Committed Subject
================================================================================================= =========== ======================================================================================================
`6c57acc654 <https://github.com/apache/airflow/commit/6c57acc6545e467c27913d54239cab2de47daae1>`_ 2022-08-31 ``Additional mask aws credentials (#26014)``
`6d703dd9e1 <https://github.com/apache/airflow/commit/6d703dd9e13a68863faa211cbfdc24ddfb3bdcf0>`_ 2022-08-31 ``Fix display aws connection info (#26025)``
`8acdc2a834 <https://github.com/apache/airflow/commit/8acdc2a834b9c4e287fe612ed56ab8908d777609>`_ 2022-08-30 ``Replace SQL with Common SQL in pre commit (#26058)``
`1d06374194 <https://github.com/apache/airflow/commit/1d06374194586d6dd857e95c866925e9034d9a48>`_ 2022-08-30 ``Hook into Mypy to get rid of those cast() (#26023)``
`1ed014647e <https://github.com/apache/airflow/commit/1ed014647e7293d342d9d1c2706343a68f003655>`_ 2022-08-29 ``Add 'output' property to MappedOperator (#25604)``
`dbfa6487b8 <https://github.com/apache/airflow/commit/dbfa6487b820e6c94770404b3ba29ab11ae2a05e>`_ 2022-08-27 ``Fix 'EcsBaseOperator' and 'EcsBaseSensor' arguments (#25989)``
`c9c89e5c3b <https://github.com/apache/airflow/commit/c9c89e5c3be37dd2475abf4214d5efdd2ad48c2a>`_ 2022-08-27 ``Add RedshiftDeleteClusterSnapshotOperator (#25975)``
`695e1a53f8 <https://github.com/apache/airflow/commit/695e1a53f88c78c5c624f9478a73963062f42a8b>`_ 2022-08-27 ``Raise an error on create bucket if use regional endpoint for us-east-1 and region not set (#25945)``
`b75797e809 <https://github.com/apache/airflow/commit/b75797e80954df1e67dbc63dec874db0457244e7>`_ 2022-08-27 ``Fix EMR serverless system test (#25969)``
`810f3847c2 <https://github.com/apache/airflow/commit/810f3847c241453195fa2c27f447ecf7fe06bbfc>`_ 2022-08-27 ``Update AWS system tests to use SystemTestContextBuilder (#25748)``
`626a54904a <https://github.com/apache/airflow/commit/626a54904ad1b7042f44a31bb1bbae13ad385c1e>`_ 2022-08-26 ``Convert Quicksight Sample DAG to System Test (#25696)``
`994f18872a <https://github.com/apache/airflow/commit/994f18872af8d2977d78e6d1a27314efbeedb886>`_ 2022-08-25 ``Add redshift create cluster snapshot operator (#25857)``
`1a1f352479 <https://github.com/apache/airflow/commit/1a1f352479d6dbff21d73d3c51b1e5d5188e00e3>`_ 2022-08-23 ``Add Airflow specific warning classes (#25799)``
`6b7a343b25 <https://github.com/apache/airflow/commit/6b7a343b25b06ab592f19b7e70843dda2d7e0fdb>`_ 2022-08-22 ``Implement 'EmrEksCreateClusterOperator' (#25816)``
`e1ace8d018 <https://github.com/apache/airflow/commit/e1ace8d018e94a13e258a9fbde3544440660f8c0>`_ 2022-08-21 ``Fix RDS system test (#25839)``
`f1e0a48500 <https://github.com/apache/airflow/commit/f1e0a485005ed41c7c40096983daaa2d98609069>`_ 2022-08-19 ``Avoid circular import problems when instantiating AWS SM backend (#25810)``
`92fce4fe87 <https://github.com/apache/airflow/commit/92fce4fe8786ae66ba60df94949dc41cbb3526ce>`_ 2022-08-19 ``Improve error handling/messaging around bucket exist check (#25805)``
`ca9229b6fe <https://github.com/apache/airflow/commit/ca9229b6fe7eda198c7ce32da13afb97ab9f3e28>`_ 2022-08-18 ``Add common-sql lower bound for common-sql (#25789)``
`b9b8841ef3 <https://github.com/apache/airflow/commit/b9b8841ef38d94edcb05f75d5883e5b37ac07c54>`_ 2022-08-16 ``Allow AWS Secrets Backends use AWS Connection capabilities (#25628)``
`762588dcf4 <https://github.com/apache/airflow/commit/762588dcf4a05c47aa253b864bda00726a5569dc>`_ 2022-08-15 ``fix bug construction of Connection object in version 5.0.0rc3 (#25716)``
`1b412c9cbe <https://github.com/apache/airflow/commit/1b412c9cbe48235cf02bb57a94c0d47d3f86df20>`_ 2022-08-10 ``Consolidate to one 'schedule' param (#25410)``
================================================================================================= =========== ======================================================================================================

5.0.0
.....

Expand All @@ -36,6 +67,7 @@ Latest change: 2022-08-10
================================================================================================= =========== ==========================================================================================================================================================
Commit Committed Subject
================================================================================================= =========== ==========================================================================================================================================================
`5923788143 <https://github.com/apache/airflow/commit/5923788143e7871b56de5164b96a407b2fba75b8>`_ 2022-08-10 ``Fix CHANGELOG for common.sql provider and add amazon commit (#25636)``
`358593c6b6 <https://github.com/apache/airflow/commit/358593c6b65620807103ae16946825e0bfad974f>`_ 2022-08-10 ``Enable multiple query execution in RedshiftDataOperator (#25619)``
`e5ac6c7cfb <https://github.com/apache/airflow/commit/e5ac6c7cfb189c33e3b247f7d5aec59fe5e89a00>`_ 2022-08-10 ``Prepare docs for new providers release (August 2022) (#25618)``
`8a1b7d43e0 <https://github.com/apache/airflow/commit/8a1b7d43e05e38576a728f2c49e75a63093f9103>`_ 2022-08-10 ``Refactor monolithic ECS Operator into Operators, Sensors, and a Hook (#25413)``
Expand Down
8 changes: 4 additions & 4 deletions docs/apache-airflow-providers-amazon/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -66,7 +66,7 @@ Package apache-airflow-providers-amazon
Amazon integration (including `Amazon Web Services (AWS) <https://aws.amazon.com/>`__).


Release: 5.0.0
Release: 5.1.0

Provider package
----------------
Expand All @@ -88,7 +88,7 @@ Requirements
PIP package Version required
======================================= ==================
``apache-airflow`` ``>=2.2.0``
``apache-airflow-providers-common-sql``
``apache-airflow-providers-common-sql`` ``>=1.2.0``
``boto3`` ``>=1.15.0``
``watchtower`` ``~=2.0.1``
``jsonpath_ng`` ``>=1.5.3``
Expand Down Expand Up @@ -134,7 +134,7 @@ Downloading official packages
You can download officially released packages and verify their checksums and signatures from the
`Official Apache Download site <https://downloads.apache.org/airflow/providers/>`_

* `The apache-airflow-providers-amazon 5.0.0 sdist package <https://downloads.apache.org/airflow/providers/apache-airflow-providers-amazon-5.0.0.tar.gz>`_ (`asc <https://downloads.apache.org/airflow/providers/apache-airflow-providers-amazon-5.0.0.tar.gz.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache-airflow-providers-amazon-5.0.0.tar.gz.sha512>`__)
* `The apache-airflow-providers-amazon 5.0.0 wheel package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_amazon-5.0.0-py3-none-any.whl>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_amazon-5.0.0-py3-none-any.whl.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_amazon-5.0.0-py3-none-any.whl.sha512>`__)
* `The apache-airflow-providers-amazon 5.1.0 sdist package <https://downloads.apache.org/airflow/providers/apache-airflow-providers-amazon-5.1.0.tar.gz>`_ (`asc <https://downloads.apache.org/airflow/providers/apache-airflow-providers-amazon-5.1.0.tar.gz.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache-airflow-providers-amazon-5.1.0.tar.gz.sha512>`__)
* `The apache-airflow-providers-amazon 5.1.0 wheel package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_amazon-5.1.0-py3-none-any.whl>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_amazon-5.1.0-py3-none-any.whl.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_amazon-5.1.0-py3-none-any.whl.sha512>`__)

.. include:: ../../airflow/providers/amazon/CHANGELOG.rst
16 changes: 16 additions & 0 deletions docs/apache-airflow-providers-common-sql/commits.rst
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,21 @@ For high-level changelog, see :doc:`package information including changelog <ind



1.2.0
.....

Latest change: 2022-08-30

================================================================================================= =========== ========================================================================
Commit Committed Subject
================================================================================================= =========== ========================================================================
`27e2101f6e <https://github.com/apache/airflow/commit/27e2101f6ee5567b2843cbccf1dca0b0e7c96186>`_ 2022-08-30 ``Better error messsage for pre-common-sql providers (#26051)``
`a74d934991 <https://github.com/apache/airflow/commit/a74d9349919b340638f0db01bc3abb86f71c6093>`_ 2022-08-27 ``Fix placeholders in 'TrinoHook', 'PrestoHook', 'SqliteHook' (#25939)``
`874a95cc17 <https://github.com/apache/airflow/commit/874a95cc17c3578a0d81c5e034cb6590a92ea310>`_ 2022-08-22 ``Discard semicolon stripping in SQL hook (#25855)``
`dd72e67524 <https://github.com/apache/airflow/commit/dd72e67524c99e34ba4c62bfb554e4caf877d5ec>`_ 2022-08-19 ``Fix (and test) SQLTableCheckOperator on postgresql (#25821)``
`5b3d579a42 <https://github.com/apache/airflow/commit/5b3d579a42bcf21c43fa648c473dad3228cb37e8>`_ 2022-08-19 ``Don't use Pandas for SQLTableCheckOperator (#25822)``
================================================================================================= =========== ========================================================================

1.1.0
.....

Expand All @@ -36,6 +51,7 @@ Latest change: 2022-08-15
================================================================================================= =========== ============================================================================
Commit Committed Subject
================================================================================================= =========== ============================================================================
`7d0525a55b <https://github.com/apache/airflow/commit/7d0525a55b93e5c8de8a9ef0c8dde0f9c93bb80c>`_ 2022-08-15 ``Prepare documentation for RC4 release of providers (#25720)``
`7a19651369 <https://github.com/apache/airflow/commit/7a19651369790e2abb563d96a42f41ec31ebfb85>`_ 2022-08-15 ``Fix SQL split string to include ';-less' statements (#25713)``
`5923788143 <https://github.com/apache/airflow/commit/5923788143e7871b56de5164b96a407b2fba75b8>`_ 2022-08-10 ``Fix CHANGELOG for common.sql provider and add amazon commit (#25636)``
`d82436b382 <https://github.com/apache/airflow/commit/d82436b382c41643a7385af8a58c50c106b0d01a>`_ 2022-08-05 ``Fix fetch_all_handler & db-api tests for it (#25430)``
Expand Down
2 changes: 1 addition & 1 deletion docs/apache-airflow-providers-common-sql/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@ Package apache-airflow-providers-common-sql
`Common SQL Provider <https://en.wikipedia.org/wiki/SQL>`__


Release: 1.1.0
Release: 1.2.0

Provider package
----------------
Expand Down
16 changes: 15 additions & 1 deletion docs/apache-airflow-providers-postgres/commits.rst
Original file line number Diff line number Diff line change
Expand Up @@ -28,14 +28,28 @@ For high-level changelog, see :doc:`package information including changelog <ind



5.2.1
.....

Latest change: 2022-09-05

================================================================================================= =========== ===========================================================================
Commit Committed Subject
================================================================================================= =========== ===========================================================================
`54e7d20176 <https://github.com/apache/airflow/commit/54e7d20176a08ecee659cdd9844c75f4f7570a11>`_ 2022-09-05 ``Bump dep on common-sql to fix issue with SQLTableCheckOperator (#26143)``
`14d56a5a9e <https://github.com/apache/airflow/commit/14d56a5a9e78580c53cf85db504464daccffe21c>`_ 2022-08-23 ``postgres provider: use non-binary psycopg2 (#25710)``
`ca9229b6fe <https://github.com/apache/airflow/commit/ca9229b6fe7eda198c7ce32da13afb97ab9f3e28>`_ 2022-08-18 ``Add common-sql lower bound for common-sql (#25789)``
================================================================================================= =========== ===========================================================================

5.2.0
.....

Latest change: 2022-08-02
Latest change: 2022-08-10

================================================================================================= =========== ============================================================================
Commit Committed Subject
================================================================================================= =========== ============================================================================
`e5ac6c7cfb <https://github.com/apache/airflow/commit/e5ac6c7cfb189c33e3b247f7d5aec59fe5e89a00>`_ 2022-08-10 ``Prepare docs for new providers release (August 2022) (#25618)``
`4eb0a410bb <https://github.com/apache/airflow/commit/4eb0a410bb2a9c3d195da0ce4e129c401ad25174>`_ 2022-08-02 ``Use only public AwsHook's methods during IAM authorization (#25424)``
`df00436569 <https://github.com/apache/airflow/commit/df00436569bb6fb79ce8c0b7ca71dddf02b854ef>`_ 2022-07-22 ``Unify DbApiHook.run() method with the methods which override it (#23971)``
================================================================================================= =========== ============================================================================
Expand Down
Loading

0 comments on commit 25d0baa

Please sign in to comment.