roachtest: tpcc/mixed-headroom/n5cpu16 failed

[cockroach-teamcity]

roachtest.tpcc/mixed-headroom/n5cpu16 failed with artifacts on master @ 771432d1099e516dbc11827c5458886c176e73e3:

		  |   524.0s        0            0.0           18.7      0.0      0.0      0.0      0.0 delivery
		  |   524.0s        0            0.0          187.0      0.0      0.0      0.0      0.0 newOrder
		  |   524.0s        0            0.0           18.7      0.0      0.0      0.0      0.0 orderStatus
		  |   524.0s        0            0.0          186.9      0.0      0.0      0.0      0.0 payment
		  |   524.0s        0            0.0           18.7      0.0      0.0      0.0      0.0 stockLevel
		  | _elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
		  |   525.0s        0            0.0           18.7      0.0      0.0      0.0      0.0 delivery
		  |   525.0s        0            0.0          186.7      0.0      0.0      0.0      0.0 newOrder
		  |   525.0s        0            0.0           18.7      0.0      0.0      0.0      0.0 orderStatus
		  |   525.0s        0            0.0          186.5      0.0      0.0      0.0      0.0 payment
		  |   525.0s        0            0.0           18.6      0.0      0.0      0.0      0.0 stockLevel
		Wraps: (8) COMMAND_PROBLEM
		Wraps: (9) Node 5. Command with error:
		  | ``````
		  | ./cockroach workload run tpcc --warehouses=909 --histograms=perf/stats.json  --ramp=5m0s --duration=2h0m0s --prometheus-port=2112 --pprofport=33333  {pgurl:1-4}
		  | ``````
		Wraps: (10) exit status 1
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *withstack.withStack (6) *errutil.withPrefix (7) *cluster.WithCommandDetails (8) errors.Cmd (9) *hintdetail.withDetail (10) *exec.ExitError

	mixed_version_jobs.go:73,versionupgrade.go:206,tpcc.go:427,test_runner.go:875: monitor failure: monitor task failed: t.Fatal() was called
		(1) attached stack trace
		  -- stack trace:
		  | main.(*monitorImpl).WaitE
		  | 	main/pkg/cmd/roachtest/monitor.go:115
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*backgroundStepper).wait
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_jobs.go:69
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:206
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerTPCC.func2
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/tpcc.go:427
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:875
		Wraps: (2) monitor failure
		Wraps: (3) attached stack trace
		  -- stack trace:
		  | main.(*monitorImpl).wait.func2
		  | 	main/pkg/cmd/roachtest/monitor.go:171
		Wraps: (4) monitor task failed
		Wraps: (5) attached stack trace
		  -- stack trace:
		  | main.init
		  | 	main/pkg/cmd/roachtest/monitor.go:80
		  | runtime.doInit
		  | 	GOROOT/src/runtime/proc.go:6498
		  | runtime.main
		  | 	GOROOT/src/runtime/proc.go:238
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1581
		Wraps: (6) t.Fatal() was called
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *withstack.withStack (6) *errutil.leafError

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

• roachtest: tpcc/mixed-headroom/n5cpu16 failed #79765 roachtest: tpcc/mixed-headroom/n5cpu16 failed [C-test-failure O-roachtest O-robot T-bulkio T-kv branch-release-22.1 release-blocker]
• roachtest: tpcc/mixed-headroom/n5cpu16 failed [OOM during import while running 21.2] #74892 roachtest: tpcc/mixed-headroom/n5cpu16 failed [OOM during import while running 21.2] [C-test-failure O-roachtest O-robot T-bulkio branch-release-21.2]

/cc @cockroachdb/kv-triage

This test on roachdash | Improve this report!

Jira issue: CRDB-15632

[kvoli]

tracking issue #80072, caused by #76609. Resolved in #80071.