-
Notifications
You must be signed in to change notification settings - Fork 375
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[resque] Shutdown tracer and flush data on job finish instead of using SyncWriter. #474
[resque] Shutdown tracer and flush data on job finish instead of using SyncWriter. #474
Conversation
@pawelchcki This is marked as WIP: is it ready for review? |
@delner for now there is no pressing need to disable SyncWriter. I'll close this PR for now |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍
end | ||
end | ||
end | ||
end | ||
end | ||
|
||
Resque.before_first_fork do |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
are we sure of that change? I remember we added it to handle some cases. We need to deeply test those changes.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We want to ship it first as a beta release and before that do another round of testing.
I've tested this change locally when developing it and coupled with some other improvements in separate PRs, it did flush and shutdown as quickly as SyncWriter
.
This change is mostly driven by the fact that SyncWriter
performance deteriorates quite a bit under multithreaded setup.
Using latest improvements to how shutdown is performed - we can safely and quickly flush all data manually when the job has finished running.
Its faster and safer than SyncWriter that needs to spawn two threads and connection to the agent on each trace write.