-
Notifications
You must be signed in to change notification settings - Fork 14.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Ship zombie info #32693
Ship zombie info #32693
Conversation
Thoughts on somehow linking to docs on zombies in the message? Or even just explaining in the message some things that might cause zombies? An Airflow end-user might not know what a zombie is. |
yes makes sense. We can add "Refer: https://airflow.apache.org/docs/apache-airflow/stable/core-concepts/tasks.html#zombie-undead-tasks" |
I am also thinking perhaps we need to enhance the documentation to include possible scenarios when tasks can become zombies based on all information we have observed so far. |
This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for your contributions. |
ecdad8c
to
9f0d4cc
Compare
9f0d4cc
to
978c1bf
Compare
@RNHTTR this is how the message appears upon zombie detections. Please check if you would like to open a PR to modify the message or have something additional to add in the message. I will merge this one for now |
Have we improved doumentation as mentioned in earlier comments? |
Yes, this can come up in a separate PR. I have created a good-first issue for this #35698 |
This PR depends on #32646 and adds scheduler log to task log if the task is detected as a zombie task.
How to test it
BashOperator
with bash_command="sleep 600")^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named
{pr_number}.significant.rst
or{issue_number}.significant.rst
, in newsfragments.