Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[7.x] [ML] Ignore exceptions while opening job after SIGTERM to JVM (#75850) #75872

Merged

Conversation

elasticsearchmachine
Copy link
Collaborator

Backports the following commits to 7.x:

…c#75850)

* [ML] Ignore exceptions while opening job after SIGTERM to JVM

We observed that some jobs failed during a rolling upgrade
in Elastic Cloud.  This happened because steps of the job
open sequence failed with exceptions after core Elasticsearch
services shut down in response to the SIGTERM.

This change makes the persistent task executor for anomaly
detection jobs ignore exceptions received after the JVM has
received a shutdown signal, for example a SIGTERM.  By doing
nothing in response to such exceptions the persistent task
remains in cluster state and will get assigned to a different
node after the current node leaves the cluster.

* Address review comment
@droberts195 droberts195 added the auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) label Jul 30, 2021
@elasticsearchmachine elasticsearchmachine merged commit ebfbd1a into elastic:7.x Jul 30, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) backport v7.15.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants