enhance: Support memory mode chunk cache (#35347)

[bigsheeper]

Chunk cache supports loading raw vectors into memory.

issue: #35273

pr: #35347

[mergify]

@bigsheeper E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@bigsheeper E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[codecov]

Codecov Report

Attention: Patch coverage is 76.19048% with 10 lines in your changes missing coverage. Please review.

Project coverage is 79.76%. Comparing base (22838a8) to head (ed795c7).
Report is 3 commits behind head on 2.4.

Files with missing lines	Patch %	Lines
internal/querynodev2/segments/segment.go	0.00%	8 Missing ⚠️
internal/core/src/segcore/segment_c.cpp	0.00%	2 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##              2.4   #35836      +/-   ##
==========================================
- Coverage   80.60%   79.76%   -0.85%     
==========================================
  Files        1065     1065              
  Lines      164516   164540      +24     
==========================================
- Hits       132615   131249    -1366     
- Misses      27556    28937    +1381     
- Partials     4345     4354       +9     

Files with missing lines	Coverage Δ
internal/core/src/segcore/SegmentSealed.h	100.00% <ø> (ø)
internal/core/src/segcore/SegmentSealedImpl.cpp	84.28% <100.00%> (+0.04%)	⬆️
internal/core/src/segcore/SegmentSealedImpl.h	80.00% <ø> (ø)
internal/core/src/storage/ChunkCache.cpp	86.36% <100.00%> (+0.99%)	⬆️
internal/core/src/storage/ChunkCache.h	0.00% <ø> (-100.00%)	⬇️
internal/querynodev2/server.go	77.71% <100.00%> (+0.12%)	⬆️
pkg/util/paramtable/component_param.go	98.33% <100.00%> (+<0.01%)	⬆️
internal/core/src/segcore/segment_c.cpp	65.67% <0.00%> (ø)
internal/querynodev2/segments/segment.go	66.80% <0.00%> (-0.22%)	⬇️

... and 90 files with indirect coverage changes

[bigsheeper]

/hold

[bigsheeper]

/unhold

[czs007]

e2e is not triggered

[czs007]

/approve
/lgtm

[sre-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: bigsheeper, czs007

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• configs/OWNERS [czs007]
• internal/core/OWNERS [czs007]
• internal/querynodev2/OWNERS [czs007]
• pkg/util/OWNERS [czs007]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment