Skip to content

Commit

Permalink
Browse files Browse the repository at this point in the history
41012: roachtest: reduce row size in hotspotsplits to fix flake r=rytaft a=rytaft

This commit reduces the kv block size from 512 KB to 256 KB in the
`hotspotsplits/nodes=4` roachtest to fix an out-of-memory condition
that was causing flakiness in the test.

The flakiness is caused by the fact that automatic stats collection
requires a full table scan, and the kv batch size is currently
hard-coded to 10,000 rows. With each row utilizing 512 KB, this
results in a minimum of 5 GB of memory utilization during calculation
of stats.

Once the kv batch size can be dynamically adjusted based on the
size of the rows, we can reset the block size in this roachtest back
to 512 KB.

Informs cockroachdb#33660

Release note: None
Release justification: Non-production code change to fix a flaky test.

Co-authored-by: Rebecca Taft <[email protected]>
  • Loading branch information
craig[bot] and rytaft committed Sep 24, 2019
2 parents bf42553 + 22c1459 commit 9422434
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion pkg/cmd/roachtest/hotspotsplits.go
Original file line number Diff line number Diff line change
Expand Up @@ -48,7 +48,9 @@ func registerHotSpotSplits(r *testRegistry) {
}
defer quietL.close()

const blockSize = 1 << 19 // 512 KB
// TODO(rytaft): reset this to 1 << 19 (512 KB) once we can dynamically
// size kv batches.
const blockSize = 1 << 18 // 256 KB
return c.RunL(ctx, quietL, appNode, fmt.Sprintf(
"./workload run kv --read-percent=0 --tolerate-errors --concurrency=%d "+
"--min-block-bytes=%d --max-block-bytes=%d --duration=%s {pgurl:1-3}",
Expand Down

0 comments on commit 9422434

Please sign in to comment.