Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate blocking issue in apache Tailer class #29

Open
aionick opened this issue Feb 21, 2019 · 2 comments
Open

Investigate blocking issue in apache Tailer class #29

aionick opened this issue Feb 21, 2019 · 2 comments
Labels
question Further information is requested

Comments

@aionick
Copy link
Contributor

aionick commented Feb 21, 2019

Despite the Tailer being launched on a separate thread, @aionWilliam and I have both observed some odd behaviour related to the Tailer when the main execution thread sleeps. Sleeping seems to have caused the Tailer to begin reading from the start of the file again, and seems to make it unable to read past the latest line before the sleep.

The problem is either in the Tailer or else could be related to how the node's output buffer is being flushed to the file or something of the sort.

We need to investigate this further.

@aionick aionick added the question Further information is requested label Feb 21, 2019
@aionick aionick added this to the Second internal release milestone Feb 21, 2019
@aionick aionick removed this from the Second internal release milestone Mar 7, 2019
@aionick
Copy link
Contributor Author

aionick commented Mar 7, 2019

This is really not a priority for the current milestone. @aionWilliam's decision to set the tailer's delay to 2 seconds seems to be sufficient for our purposes. Once we get some time to pursue this question, we want to answer the following:

  1. Why does the tailer start reading again from the top of the file?
  2. What is the optimal delay range in terms of throughput

@aionick
Copy link
Contributor Author

aionick commented Mar 13, 2019

Note that we are considering switching to our own implementation in the future, one that handles a stream instead of a file. So this is low priority for now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

1 participant