Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

perf(#64): optimize memory and CPU usage #69

Merged
merged 3 commits into from
May 27, 2024
Merged

Conversation

hedhyw
Copy link
Owner

@hedhyw hedhyw commented May 27, 2024

  1. Parse only 100 rows after the current cursor (by config).
  2. Add threshold between file reloads -> 1s (by config).
  3. Limit the maximum size of the file -> 1 GB (by config).
  4. Trigger garbage collector after file reloading.
  5. Add benchmark test.

@hedhyw hedhyw self-assigned this May 27, 2024
@hedhyw hedhyw marked this pull request as ready for review May 27, 2024 13:32
@hedhyw hedhyw merged commit 144f8b8 into main May 27, 2024
2 checks passed
@hedhyw hedhyw deleted the perf/optimize-cpu-memory branch May 27, 2024 13:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant