Bump apache-airflow[amazon,http,postgres] from 2.6.2 to 2.6.3 in /catalog

[dependabot]

Bumps apache-airflow[amazon,http,postgres] from 2.6.2 to 2.6.3.

Release notes

Sourced from apache-airflow[amazon,http,postgres]'s releases.

Apache Airflow 2.6.3

Bug Fixes

• Use linear time regular expressions (#32303)
• Fix triggerers alive check and add a new conf for triggerer heartbeat rate (#32123)
• Catch the exception that triggerer initialization failed (#31999)
• Hide sensitive values from extra in connection edit form (#32309)
• Sanitize DagRun.run_id and allow flexibility (#32293)
• Add triggerer canceled log (#31757)
• Fix try number shown in the task view (#32361)
• Retry transactions on occasional deadlocks for rendered fields (#32341)
• Fix behaviour of LazyDictWithCache when import fails (#32248)
• Remove executor_class from Job - fixing backfill for custom executors (#32219)
• Fix bugged singleton implementation (#32218)
• Use mapIndex to display extra links per mapped task. (#32154)
• Ensure that main triggerer thread exits if the async thread fails (#32092)
• Use re2 for matching untrusted regex (#32060)
• Render list items in rendered fields view (#32042)
• Fix hashing of dag_dependencies in serialized dag (#32037)
• Return None if an XComArg fails to resolve in a multiple_outputs Task (#32027)
• Check for DAG ID in query param from url as well as kwargs (#32014)
• Flash an error message instead of failure in rendered-templates when map index is not found (#32011)
• Fix ExternalTaskSensor when there is no task group TIs for the current execution date (#32009)
• Fix number param html type in trigger template (#31980, #31946)
• Fix masking nested variable fields (#31964)
• Fix operator_extra_links property serialization in mapped tasks (#31904)
• Decode old-style nested Xcom value (#31866)
• Add a check for trailing slash in webserver base_url (#31833)
• Fix connection uri parsing when the host includes a scheme (#31465)
• Fix database session closing with xcom_pull and inlets (#31128)
• Fix DAG's on_failure_callback is not invoked when task failed during testing dag. (#30965)
• Fix airflow module version check when using ExternalPythonOperator and debug logging level (#30367)

Misc/Internal

• Fix task.sensor annotation in type stub (#31954)
• Limit Pydantic to < 2.0.0 until we solve 2.0.0 incompatibilities (#32312)
• Fix Pydantic 2 pickiness about model definition (#32307)

Doc only changes

• Add explanation about tag creation and cleanup (#32406)
• Minor updates to docs (#32369, #32315, #32310, #31794)
• Clarify Listener API behavior (#32269)
• Add information for users who ask for requirements (#32262)
• Add links to DAGRun / DAG / Task in Templates Reference (#32245)
• Add comment to warn off a potential wrong fix (#32230)
• Add a note that we'll need to restart triggerer to reflect any trigger change (#32140)
• Adding missing hyperlink to the tutorial documentation (#32105)
• Added difference between Deferrable and Non-Deferrable Operators (#31840)
• Add comments explaining need for special "trigger end" log message (#31812)
• Documentation update on Plugin updates. (#31781)

... (truncated)

Changelog

Sourced from apache-airflow[amazon,http,postgres]'s changelog.

Airflow 2.6.3 (2023-07-10)

Significant Changes ^^^^^^^^^^^^^^^^^^^

No significant changes.

Bug Fixes """""""""

• Use linear time regular expressions (#32303)
• Fix triggerers alive check and add a new conf for triggerer heartbeat rate (#32123)
• Catch the exception that triggerer initialization failed (#31999)
• Hide sensitive values from extra in connection edit form (#32309)
• Sanitize DagRun.run_id and allow flexibility (#32293)
• Add triggerer canceled log (#31757)
• Fix try number shown in the task view (#32361)
• Retry transactions on occasional deadlocks for rendered fields (#32341)
• Fix behaviour of LazyDictWithCache when import fails (#32248)
• Remove executor_class from Job - fixing backfill for custom executors (#32219)
• Fix bugged singleton implementation (#32218)
• Use mapIndex to display extra links per mapped task. (#32154)
• Ensure that main triggerer thread exits if the async thread fails (#32092)
• Use re2 for matching untrusted regex (#32060)
• Render list items in rendered fields view (#32042)
• Fix hashing of dag_dependencies in serialized dag (#32037)
• Return None if an XComArg fails to resolve in a multiple_outputs Task (#32027)
• Check for DAG ID in query param from url as well as kwargs (#32014)
• Flash an error message instead of failure in rendered-templates when map index is not found (#32011)
• Fix ExternalTaskSensor when there is no task group TIs for the current execution date (#32009)
• Fix number param html type in trigger template (#31980, #31946)
• Fix masking nested variable fields (#31964)
• Fix operator_extra_links property serialization in mapped tasks (#31904)
• Decode old-style nested Xcom value (#31866)
• Add a check for trailing slash in webserver base_url (#31833)
• Fix connection uri parsing when the host includes a scheme (#31465)
• Fix database session closing with xcom_pull and inlets (#31128)
• Fix DAG's on_failure_callback is not invoked when task failed during testing dag. (#30965)
• Fix airflow module version check when using ExternalPythonOperator and debug logging level (#30367)

Misc/Internal """""""""""""

• Fix task.sensor annotation in type stub (#31954)
• Limit Pydantic to < 2.0.0 until we solve 2.0.0 incompatibilities (#32312)
• Fix Pydantic 2 pickiness about model definition (#32307)

Doc only changes """"""""""""""""

• Add explanation about tag creation and cleanup (#32406)
• Minor updates to docs (#32369, #32315, #32310, #31794)

... (truncated)

Commits

• eb24742 Update RELEASE_NOTES.rst
• b550d65 Update version to 2.6.3
• 00af083 Add explanation about tag creation and cleanup (#32406)
• d4afc4d fixup! feat(jobs/triggerer_job_runner): add triggerer canceled log (#31757)
• 62859f0 Update trigger url to fix test
• fc4934e Use WebEncoder to encode DagRun.conf in DagRun's list view (#32385)
• aa4cda3 Limit click until we fix mypy issues (#32413)
• b329587 Use linear time regular expressions (#32303)
• fc61875 Fix failing main due to new release of jsonschema (#32405)
• cf31c6f Fix triggerers alive check and add a new conf for triggerer heartbeat rate (#...
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[krysal]

@dependabot rebase

[stacimc]

@dependabot rebase

[stacimc]

Looking into why it's failing to build the aws_default connection 👀

[stacimc]

We're getting an error building the connection here because our query includes an endpoint url :/ I'll look further into this.

[AetherUnbound]

Wow, incredible find @stacimc! Do you know if this would work if we set endpoint_url=s3:5000, without the scheme?

[stacimc]

Do you know if this would work if we set endpoint_url=s3:5000, without the scheme?

Unfortunately, no -- that does get us past the current problem, but we get an Invalid endpoint error.

[stacimc]

Okay, I think I found a workaround -- urlencoding the endpoint url we use in defining our AWS connection bypasses the error. Before the change, log files for all Airflow tasks fail to be load, and provider DAGs all fail at the copy_to_s3 step. After the change everything seems to be working, although I'll run a few more DAGs. You'll need to update your catalog/.env to test.

[AetherUnbound]

Thanks for finding a fix! Fortunately that shouldn't affect production since we use the default AWS endpoint URL for that 😄

[AetherUnbound]

Built and tested locally with the changed .env value, everything worked well!

[openverse-bot]

Based on the low urgency of this PR, the following reviewers are being gently reminded to review this PR:

@krysal
@stacimc
This reminder is being automatically generated due to the urgency configuration.

Excluding weekend¹ days, this PR was ready for review 10 day(s) ago. PRs labelled with low urgency are expected to be reviewed within 5 weekday(s)².

@dependabot[bot], if this PR is not ready for a review, please draft it to prevent reviewers from getting further unnecessary pings.

Footnotes

1. Specifically, Saturday and Sunday. ↩

2. For the purpose of these reminders we treat Monday - Friday as weekdays. Please note that the operation that generates these reminders runs at midnight UTC on Monday - Friday. This means that depending on your timezone, you may be pinged outside of the expected range. ↩

[stacimc]

Agreed! I went back and tested audio and popularity refreshes as well, and everything looks good locally so I think we're good to go :)