Commits on Jul 3, 2018

1. [ML] Rate limit established model memory updates …

   There is at most one model size stats document per bucket, but
   during lookback a job can churn through many buckets very quickly.
   This can lead to many cluster state updates if established model
   memory needs to be updated for a given model size stats document.
   
   This change rate limits established model memory updates to one
   per job per 5 seconds.  This is done by scheduling the updates 5
   seconds in the future, but replacing the value to be written if
   another model size stats document is received during the waiting
   period.  Updating the values in arrears like this means that the
   last value received will be the one associated with the job in the
   long term, whereas alternative approaches such as not updating the
   value if a new value was close to the old value would not.

   

   droberts195 committed Jul 3, 2018
   Configuration menu

   • View commit details
   • Copy full SHA for 6978c30
   • Browse repository at this point

   Copy the full SHA

   6978c30 View commit details

   Browse the repository at this point in the history