enhance: Add delete buffer related quota logic

[congqixia]

See also #35303

[sre-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: congqixia

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• configs/OWNERS [congqixia]
• internal/querynodev2/OWNERS [congqixia]
• internal/rootcoord/OWNERS [congqixia]
• pkg/util/OWNERS [congqixia]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[tedxu]

The patch looks good to me, except some minor issues.

Question: will this patch deprecate the same protection feature based on L0 row number?

[tedxu]

The default values may be too small, I suppose it won't be a problem if the deletions can be easily consumed in less than 1 minute or so.

And, please note the unit of the delete buffer size in the comments.

[congqixia]

Question: will this patch deprecate the same protection feature based on L0 row number?

nope, this PR only add quota rules based on delete buffer number/size on querynodes, which will not affect the previously added l0 segment statistics one

[codecov]

Codecov Report

Attention: Patch coverage is 79.71014% with 28 lines in your changes missing coverage. Please review.

Project coverage is 72.64%. Comparing base (325f198) to head (b8f31dd).
Report is 18 commits behind head on master.

Files with missing lines	Patch %	Lines
internal/rootcoord/quota_center.go	26.31%	28 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master   #35918      +/-   ##
==========================================
- Coverage   81.58%   72.64%   -8.94%     
==========================================
  Files        1264     1264              
  Lines      150745   150876     +131     
==========================================
- Hits       122983   109604   -13379     
- Misses      22878    36385   +13507     
- Partials     4884     4887       +3     

Files with missing lines	Coverage Δ
internal/querynodev2/delegator/delegator.go	87.14% <100.00%> (-0.34%)	⬇️
...uerynodev2/delegator/deletebuffer/delete_buffer.go	98.66% <100.00%> (+0.55%)	⬆️
.../querynodev2/delegator/deletebuffer/delete_item.go	100.00% <100.00%> (ø)
...odev2/delegator/deletebuffer/list_delete_buffer.go	100.00% <100.00%> (ø)
internal/querynodev2/metrics_info.go	85.49% <100.00%> (+1.04%)	⬆️
pkg/util/paramtable/quota_param.go	80.88% <100.00%> (+0.65%)	⬆️
internal/rootcoord/quota_center.go	83.45% <26.31%> (-2.06%)	⬇️

... and 247 files with indirect coverage changes

[XuanYang-cn]

This can be merged ahead, but the waterlevel value is not sensible, need to adjust it before put in prod

[congqixia]

agree, this value shall be updated after we get some experience data from the tests

[tedxu]

/lgtm