Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create annotations on significant model changes. #55781

Closed
przemekwitek opened this issue Apr 27, 2020 · 2 comments
Closed

Create annotations on significant model changes. #55781

przemekwitek opened this issue Apr 27, 2020 · 2 comments
Labels
>enhancement :ml Machine learning

Comments

@przemekwitek
Copy link
Contributor

In order to give users more insight into anomaly detection, we could be creating an annotation every time there is a significant change in the model calculation. Some ideas on what to report are:

  • step change detected
  • periodicity detected
  • trend detected

How this could work technically:

  • CPP emits log messages with special marker string denoting log message related to a significant model change
  • Java adds a hook to CppLogMessageHandler class so that every time such message is discovered, an annotation is created
  • Annotation is automatically visible in the UI, just like user-created annotations or other system-created annotations (e.g.: model snapshot annotation)
  • When job is deleted, we don't need to delete the annotations as they provide history that the user may want to retain
@przemekwitek przemekwitek added >enhancement :ml Machine learning labels Apr 27, 2020
@przemekwitek przemekwitek self-assigned this Apr 27, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core (:ml)

@droberts195
Copy link
Contributor

Fixed by elastic/ml-cpp#1247

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>enhancement :ml Machine learning
Projects
None yet
Development

No branches or pull requests

3 participants