Question: How does the service deal with delayed or not existing click response (reward has to be set to value 0)

[Rainer-Kempkes]

Example:

User A enters the URL, the predicted banner/pic/text is displayed.

a) User A clicks on it after 4 secs -> reward = 1 - OK

b) User A leaves the URL by clicking on another link -> no click - how and when is the reward 0 set?

Is there something like "pending" events with open (not set) rewards - and maybe a timeout after x secs/mins with automatical reward-set to 0?

regards,

Rainer

[eisber]

The Azure Stream Analytics will produce an output event for every impression, regardless of having a click or not, after n-secs (=experimental unit duration). a) This takes care of (b) – the default reward of 0 is specified in the ASA query (join). b) We delay training of each example by n-secs to avoid any bias that could be introduced (e.g. certain actions receive feedback earlier than others).