Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Respect "soft_fail" argument when "poke" is called #33401

Merged

Conversation

Lee-W
Copy link
Member

@Lee-W Lee-W commented Aug 15, 2023

This is the following PR to #33196 and intends to solve the issue that the soft_fail argument might not work on all sensors.

This PR handles the case that non-AirflowSkipException is raised, but soft_fail is set to True.


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@boring-cyborg boring-cyborg bot added the area:core-operators Operators, Sensors and hooks within Core Airflow label Aug 15, 2023
@Lee-W Lee-W changed the title Respect soft fail argument when poke is called Respect soft_fail argument when poke is called Aug 15, 2023
@Lee-W Lee-W changed the title Respect soft_fail argument when poke is called Respect "soft_fail" argument when "poke" is called Aug 15, 2023
@Lee-W Lee-W force-pushed the respect_soft_fail_argument_when_poke_is_called branch 3 times, most recently from 0ae94e4 to 89cf2e5 Compare August 25, 2023 04:10
@Lee-W Lee-W force-pushed the respect_soft_fail_argument_when_poke_is_called branch from 89cf2e5 to 6b144d5 Compare August 25, 2023 17:07
@potiuk potiuk added this to the Airflow 2.7.1 milestone Aug 25, 2023
@potiuk potiuk merged commit d91c481 into apache:main Aug 25, 2023
40 checks passed
@ephraimbuddy ephraimbuddy added the type:bug-fix Changelog: Bug Fixes label Aug 27, 2023
ephraimbuddy pushed a commit that referenced this pull request Aug 28, 2023
* feat(sensors/base): raise AirflowSkipException if soft_fail is set to True and exception occurs after running poke()

* test(sensor/base): add test case for respecting soft_fail option when other kinds of exception is raised

(cherry picked from commit d91c481)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:core-operators Operators, Sensors and hooks within Core Airflow type:bug-fix Changelog: Bug Fixes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants