roachtest: tpcc/mixed-headroom/n5cpu16 failed

[cockroach-teamcity]

roachtest.tpcc/mixed-headroom/n5cpu16 failed with artifacts on release-23.2 @ 10522d2341eebf9fe921137239becec47be593c5:

(mixedversion.go:645).Run: unexpected node event: n1: cockroach process for system interface died (exit code 1)
test artifacts and logs in: /artifacts/tpcc/mixed-headroom/n5cpu16/cpu_arch=arm64/run_1

Parameters:

• ROACHTEST_arch=arm64
• ROACHTEST_cloud=gce
• ROACHTEST_coverageBuild=false
• ROACHTEST_cpu=16
• ROACHTEST_encrypted=true
• ROACHTEST_fs=zfs
• ROACHTEST_localSSD=false
• ROACHTEST_metamorphicBuild=false
• ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

/cc @cockroachdb/test-eng

This test on roachdash | Improve this report!

Jira issue: CRDB-40499

[herkolategan]

Exit code from node (out of disk space):

cockroach exited with code 10: Sat Jul 20 19:10:27 UTC 2024

[renatolabs]

We need to investigate why this is running out of disk space. It's suggestive that both failures happened on 23.2 and on arm64 builds.

[renatolabs]

This hasn't happened again in over a month, so I'm going to close and we can reconsider if it reoccurs.

[rytaft]

This happened again in #129211

[renatolabs]

@rytaft this is a failure in the tpcc/mixed-headroom test. The issue you mentioned is a failure on import/mixed-version. This failure happened because a node ran out of disk space. I don't see any evidence of that on #129211.

[rytaft]

Thanks, sorry for the noise

[srosenberg]

Duplicate of #129919
Fixed by #130202