Qualification tool: Add option to filter event logs for a maximum file system size #1275
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
We have customers with TBs of event logs and some of them can be in the 100's of GB. Right now the qual tool needs as much memory as the uncompressed size. To allow for us to skip these add an option that skips event logs over a user specified size. Note this doesn't handle rolling event logs as it says in the option description below. I will file a followup to add that and add it to profiling tool.
The logic is first to filter by eventlog size and then by the file system time and number.
I also add a log info message to print the logs we filtered out.
Add a new option:
Testing was manual on some event logs and verified it only picked up ones <= to the size specified.