Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Only execute TIs of running DagRuns #20182

Merged
merged 1 commit into from
Dec 10, 2021

Conversation

ephraimbuddy
Copy link
Contributor

Since we can no longer have TIs without DagRun, we can
also, stop executing TIs if the DagRun is not in a RUNNING state.

Less work for the Scheduler


^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.

@boring-cyborg boring-cyborg bot added the area:Scheduler including HA (high availability) scheduler label Dec 9, 2021
@github-actions github-actions bot added the full tests needed We need to run full set of tests for this PR to merge label Dec 9, 2021
@github-actions
Copy link

github-actions bot commented Dec 9, 2021

The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and take the risk. If they don't merge it quickly - please rebase it to the latest main at your convenience, or amend the last commit of the PR, and push it with --force-with-lease.

Since we can no longer have TIs without DagRun, we can
also, stop executing TIs if the DagRun is not in a RUNNING state.

Less work for the Scheduler
@ephraimbuddy ephraimbuddy merged commit 534df1e into apache:main Dec 10, 2021
@ephraimbuddy ephraimbuddy added this to the Airflow 2.3.0 milestone Dec 10, 2021
@ephraimbuddy ephraimbuddy deleted the only-running-dag branch December 10, 2021 13:01
@jedcunningham jedcunningham added the type:improvement Changelog: Improvements label Apr 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:Scheduler including HA (high availability) scheduler full tests needed We need to run full set of tests for this PR to merge type:improvement Changelog: Improvements
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants