Flush expired
lines before polling input at file
source line aggregation
#1870
Labels
source: file
Anything `file` source related
type: tech debt
A code change that does not add user value.
Something that came up during #1852 review. See #1852 (comment).
We should flush
expired
before pollinginner
, otherwise, we don't provide proper backpressure and the expired lines may never even flush at all if the load is super-high.There should be many more tests for the timeout and expiration logic, and once those are done - we can safely alter details like this.
The text was updated successfully, but these errors were encountered: