Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding max_consecutive_failed_dag_runs in UI for dag #38171

Closed
2 tasks done
pateash opened this issue Mar 15, 2024 · 1 comment · Fixed by #38229
Closed
2 tasks done

Adding max_consecutive_failed_dag_runs in UI for dag #38171

pateash opened this issue Mar 15, 2024 · 1 comment · Fixed by #38229
Assignees
Labels

Comments

@pateash
Copy link
Contributor

pateash commented Mar 15, 2024

Description

related - #36935

We are adding the ability to automatically turn off DAG after X number of consecutive failures.

There are 2 ways to configure this

in DAG() using max_consecutive_failed_dag_runs parameter this will override any config (as below)
Using core config inside airflow.cfg or variable AIRFLOW__CORE_MAX_CONSECUTIVE_FAILED_DAG_RUNS_PER_DAG
environment variable.

Use case/motivation

We should also show this information into dag_id(besides dag_id) if this is being used,
although we are showing this in dag details for now.

image

Related issues

#36935

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@pateash pateash added kind:feature Feature Requests needs-triage label for new issues that we didn't triage yet labels Mar 15, 2024
@nathadfield nathadfield added area:core and removed needs-triage label for new issues that we didn't triage yet labels Mar 15, 2024
@Taragolis
Copy link
Contributor

This one required significant changes in Airflow. There any existed options for the change the behavior of the DAG/Task thought the UI. Only thought the configurations (explicit or cluster policies) or by the code.

So I guess it might comes thought AIP (Airflow Improvement Proposals) first, see: https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvement+Proposals

But lets see what the other say.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants