Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[[enhancement](compaction) adjust compaction concurrency based on compaction score and workload #37491

Merged
merged 2 commits into from
Jul 9, 2024

Commits on Jul 8, 2024

  1. [enhancement](compaction) adjust compaction concurrency based on comp…

    …action score and workload (apache#36672)
    
    1 Resolved the issue where the priority queue did not reserve slots for
    cumulative compaction.
    
    2 When considering compaction task priorities, introduced metrics for
    CPU and memory usage rates. When the compaction score is low, and CPU or
    memory usage is high, reduce the number of compaction tasks generated
    and allocate CPU and memory resources to queries or load.
    
    3 Integrated the logic of the priority queue and concurrency control
    together, removing the previous priority code.
    luwei16 committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    6f66452 View commit details
    Browse the repository at this point in the history
  2. [fix](compaction) fix null pointer when retrieving CPU load average (a…

    …pache#37171)
    
    1 When enable_system_metrics = false, system_metrics is a null pointer
    2 When BE exits, system_metrics has been destructed, and the compaction
    background thread may still be running
    luwei16 committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    9042fa1 View commit details
    Browse the repository at this point in the history