Use pagination when listing large numbers of resources

[brandond]

Proposed Changes

Use pagination when listing large numbers of resources

etcd snapshots and secrets are the only thing we bulk list, everything else should either have a selector, or there aren't enough resource of that type to matter.

Types of Changes

enhancement

Verification

See linked issue - note that this requires a LARGE number of snapshots to make a visible difference in memory - at least 100

Testing

Linked Issues

• K3s etcd snapshot reconcile consumes excessive memory when a large number of snapshots are present #10450

User-Facing Change

Further Comments

[codecov]

Codecov Report

Attention: Patch coverage is 0% with 42 lines in your changes missing coverage. Please review.

Project coverage is 43.37%. Comparing base (37830fe) to head (e1f300b).

Files	Patch %	Lines
pkg/etcd/snapshot.go	0.00%	18 Missing ⚠️
pkg/secretsencrypt/controller.go	0.00%	14 Missing ⚠️
pkg/etcd/snapshot_controller.go	0.00%	10 Missing ⚠️

❗ There is a different number of reports uploaded between BASE (37830fe) and HEAD (e1f300b). Click for more details.

HEAD has 3 uploads less than BASE

Flag	BASE (37830fe)	HEAD (e1f300b)
e2etests	9	6

Additional details and impacted files

@@            Coverage Diff             @@
##           master   #10527      +/-   ##
==========================================
- Coverage   49.66%   43.37%   -6.30%     
==========================================
  Files         179      179              
  Lines       14936    14943       +7     
==========================================
- Hits         7418     6481     -937     
- Misses       6158     7265    +1107     
+ Partials     1360     1197     -163     

Flag	Coverage Δ
e2etests	36.35% <0.00%> (-10.23%)	⬇️
inttests	19.71% <0.00%> (-0.01%)	⬇️
unittests	13.34% <0.00%> (-0.01%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.