Telemetry usage on Segment is growing linearly: is it a bug or is it normal?

[m-vdb]

2 possible explanations:

• a bug: we’re not able to keep tracking ids properly, or not in the majority of cases. Another way to see it would be to look at how many of these events are sent via CI, that could explain the steady growth as well.
• nothing: it’s normal growth and people try out rasa. They are still counted as users even if they do only 1 event.

Definition of Done:

• Find out if it's a bug or if it's expected
• Cause determined and explained

[wochinge]

related to #8574

[ancalita]

Initial findings:

• The events with highest unique count are Server Started, Training Started and Training Completed.
• Month-on-month view showed steady count for all 3 events in April and May.
• In June, the count for Server Started doubled (from 56k events to 121k events) - while for the other 2 events, the count remained steady. The full view is here.
• In June, out of these 121k events: 62,966 were 2.6.1 version -> out of these, 62,388 were Python 3.8.5 version -> out of these, 62,375 were Linux: view is here.
• All the Linux, Python 3.8.5, rasa 2.6.1 Server Started events have unique user IDs and context CI is false.
• Out of the above group, 62,351 have Docker false.
• Also Project is blank for 62,367 Server Started events on Linux, rasa 2.6.1, Python 3.8.5.
• All the Linux, Python 3.8.5, rasa 2.6.1 Server Started events also have this OS version (AWS Linux): 4.14.225-168.357.amzn2.x86_64

[ancalita]

Added follow-up issue to the Enable inbox to be looked into the near future.