Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML] Write out forecasts predictions at "bucket time" rather than the actual times they are made in the time buckets #332

Merged
merged 1 commit into from
Dec 7, 2018

Conversation

tveasey
Copy link
Contributor

@tveasey tveasey commented Dec 7, 2018

The Java notion of "bucket time" is the start of a job's time buckets, i.e. if the job uses 30 minute time buckets then the "bucket time" is the start of each 30 minute time interval (from 00:00:00 in UTC). Currently, all anomaly detection results are written at bucket time for the buckets which contain them.

As a result of #327, we started evaluating forecasts at the sample offset in the time bucket (for good reasons). In addition, we reported their times as at the evaluation time rather than "bucket time" for the bucket which contains them. This change reverts to report them at bucket time.

Going forward we will probably want to revisit this behaviour and decouple the notion of bucket time from forecast documents. They would simply hold a time and the forecast at that time, whatever time that may be. However, this requires knock on changes to our UI, which we don't want to make now, and makes more sense in the context of planned changes to the forecast API.

I've marked this as a non-issue, as it is a change to revert behaviour introduced in #327 which is not yet released.

Copy link
Contributor

@droberts195 droberts195 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

But please hold off backporting to 6.5 until 6.5.3 is released

@tveasey
Copy link
Contributor Author

tveasey commented Dec 7, 2018

Thanks. Will do.

@tveasey tveasey merged commit f55c717 into elastic:master Dec 7, 2018
tveasey added a commit that referenced this pull request Dec 13, 2018
…n the actual times they are made in the time buckets (#341)

Backports #332.
droberts195 added a commit to droberts195/elasticsearch that referenced this pull request Jan 3, 2019
The problem that caused the test to be muted was fixed in
elastic/ml-cpp#332

Closes elastic#36258
droberts195 added a commit to elastic/elasticsearch that referenced this pull request Jan 3, 2019
The problem that caused the test to be muted was fixed in
elastic/ml-cpp#332

Closes #36258
droberts195 added a commit to elastic/elasticsearch that referenced this pull request Jan 3, 2019
The problem that caused the test to be muted was fixed in
elastic/ml-cpp#332

Closes #36258
droberts195 added a commit to elastic/elasticsearch that referenced this pull request Jan 3, 2019
The problem that caused the test to be muted was fixed in
elastic/ml-cpp#332

Closes #36258
droberts195 added a commit to elastic/elasticsearch that referenced this pull request Jan 3, 2019
The problem that caused the test to be muted was fixed in
elastic/ml-cpp#332

Closes #36258
@tveasey tveasey deleted the forecast-write-bucket-time branch May 1, 2019 14:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants