rolls out merkle shreds to 100% of testnet slots

[behzadnouri]

Problem

Ramping up Merkle shreds rollout as the results look good: #31950 (comment)

Summary of Changes

Rolls out merkle shreds to 100% of testnet slots.

[codecov]

Codecov Report

Merging #32316 (7fcaca7) into master (5e830d2) will increase coverage by 0.0%.
The diff coverage is 100.0%.

@@           Coverage Diff           @@
##           master   #32316   +/-   ##
=======================================
  Coverage    82.0%    82.0%           
=======================================
  Files         773      773           
  Lines      209659   209659           
=======================================
+ Hits       172097   172108   +11     
+ Misses      37562    37551   -11     

[steviez]

So kind of eye-balling it from your post in #31950 (comment), it seems as if:

• The repair/data ratio is improved at towards the tail end of the distribution (bottom right of table), and comparable / marginally worse elsewhere.
  • I guess this would seem to indicate that legacy shreds show more variance on this metric?
• The propagation time (millis/shred) is improved across the distribution (ie element to element for the table) for merkle-shred-slots over legacy-slots

[behzadnouri]

• I guess this would seem to indicate that legacy shreds show more variance on this metric?

Don't know how to interpret that. But since overall repair numbers are pretty low, and worst slots/nodes have improved, I feel ok with that.

[steviez]

Don't know how to interpret that

Might have abused some terminology, but as a concrete example:

99% slots / 75% nodes
    0.0009 legacy
    0.0016 merkle
99% slots / 99% nodes
    0.0455 legacy
    0.0431 merkle

The "best" 75% of nodes do better with legacy, but the entire cluster (or 99% of it that are reporting metrics) do better with merkle. So, a bigger spread for legacy.

But since overall repair numbers are pretty low, and worst slots/nodes have improved, I feel ok with that.

True - I'm probably guilty of splitting hairs here by comparins 0.09% to 0.16%