roachtest: kv95/enc=false/nodes=3/cpu=32/size=64kb failed

[cockroach-teamcity]

roachtest.kv95/enc=false/nodes=3/cpu=32/size=64kb failed with artifacts on release-23.1 @ fa2d7f7c9894d701ac4a393f058aa84552957087:

(cluster.go:2247).Run: output in run_141545.120523358_n4_workload-run-kv-tole: ./workload run kv --tolerate-errors --init --histograms=perf/stats.json --concurrency=192 --splits=1000 --duration=30m0s --read-percent=95 --min-block-bytes=65536 --max-block-bytes=65536 {pgurl:1-3} returned: context canceled
(monitor.go:137).Wait: monitor failure: monitor command failure: unexpected node event: 3: dead (exit status 7)
(test_runner.go:1120).func1: 1 dead node(s) detected
test artifacts and logs in: /artifacts/kv95/enc=false/nodes=3/cpu=32/size=64kb/run_1

Parameters: ROACHTEST_arch=amd64 , ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_encrypted=false , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

/cc @cockroachdb/test-eng

This test on roachdash | Improve this report!

Jira issue: CRDB-29486

[renatolabs]

F230706 14:33:47.616422 2951028 storage/pebble.go:1268 ⋮ [T1,n3] 1883 file write stall detected: disk slowness detected: syncdata on file 077071.sst (0 bytes) has been ongoing for 21.9s

We've been seeing more disk stalls recently. Tagging #97968 to keep track.