roachtest: import/tpcc/warehouses=4000/geo failed

[cockroach-teamcity]

roachtest.import/tpcc/warehouses=4000/geo failed with artifacts on master @ ff13325e9368c4e8dd9a4d5cf4aa2ad2f33e9ac0:

		  | stderr:
		  | I220926 19:05:28.150745 1 ccl/workloadccl/fixture.go:318  [-] 1  starting import of 9 tables
		  | I220926 19:05:33.693665 87 ccl/workloadccl/fixture.go:481  [-] 2  imported 3.9 MiB in district table (40000 rows, 0 index entries, took 5.392455121s, 0.73 MiB/s)
		  | I220926 19:05:34.259181 86 ccl/workloadccl/fixture.go:481  [-] 3  imported 213 KiB in warehouse table (4000 rows, 0 index entries, took 5.957868177s, 0.03 MiB/s)
		  | I220926 19:05:34.805334 92 ccl/workloadccl/fixture.go:481  [-] 4  imported 7.9 MiB in item table (100000 rows, 0 index entries, took 6.503956113s, 1.21 MiB/s)
		  | I220926 19:06:20.181039 91 ccl/workloadccl/fixture.go:481  [-] 5  imported 546 MiB in new_order table (36000000 rows, 0 index entries, took 51.879693967s, 10.53 MiB/s)
		  | I220926 19:10:31.551478 90 ccl/workloadccl/fixture.go:481  [-] 6  imported 6.5 GiB in order table (120000000 rows, 120000000 index entries, took 5m3.25015768s, 22.00 MiB/s)
		  | I220926 19:11:05.121376 89 ccl/workloadccl/fixture.go:481  [-] 7  imported 8.6 GiB in history table (120000000 rows, 0 index entries, took 5m36.820103269s, 26.16 MiB/s)
		  | Error: importing fixture: importing table stock: pq: job 800026552908840961: could not mark as reverting: job 800026552908840961: with status running: expected session "dea0bcdef8e7425c8534e9f73f0f0f77" but found "9803c16eaee84c2ca8107aee71f7f9d6"
		  |
		  | stdout:
		Wraps: (4) COMMAND_PROBLEM
		Wraps: (5) Node 1. Command with error:
		  | ``````
		  | ./cockroach workload fixtures import tpcc --warehouses=4000 --csv-server='http://localhost:8081'
		  | ``````
		Wraps: (6) exit status 1
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) errors.Cmd (5) *hintdetail.withDetail (6) *exec.ExitError

	monitor.go:127,import.go:154,import.go:181,test_runner.go:928: monitor failure: monitor task failed: t.Fatal() was called
		(1) attached stack trace
		  -- stack trace:
		  | main.(*monitorImpl).WaitE
		  | 	main/pkg/cmd/roachtest/monitor.go:115
		  | main.(*monitorImpl).Wait
		  | 	main/pkg/cmd/roachtest/monitor.go:123
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerImportTPCC.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/import.go:154
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerImportTPCC.func3
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/import.go:181
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:928
		Wraps: (2) monitor failure
		Wraps: (3) attached stack trace
		  -- stack trace:
		  | main.(*monitorImpl).wait.func2
		  | 	main/pkg/cmd/roachtest/monitor.go:171
		Wraps: (4) monitor task failed
		Wraps: (5) attached stack trace
		  -- stack trace:
		  | main.init
		  | 	main/pkg/cmd/roachtest/monitor.go:80
		  | runtime.doInit
		  | 	GOROOT/src/runtime/proc.go:6340
		  | runtime.main
		  | 	GOROOT/src/runtime/proc.go:233
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (6) t.Fatal() was called
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *withstack.withStack (6) *errutil.leafError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_encrypted=false , ROACHTEST_fs=ext4 , ROACHTEST_localSSD=true , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

• roachtest: import/tpcc/warehouses=4000/geo failed #88451 roachtest: import/tpcc/warehouses=4000/geo failed [C-test-failure O-roachtest O-robot T-disaster-recovery blocks-22.2.0-beta.2 branch-release-22.2 release-blocker]
• roachtest: import/tpcc/warehouses=4000/geo failed #81430 roachtest: import/tpcc/warehouses=4000/geo failed [C-test-failure O-roachtest O-robot T-disaster-recovery branch-release-22.1]
• roachtest: import/tpcc/warehouses=4000/geo failed [raft sideload oom] #76824 roachtest: import/tpcc/warehouses=4000/geo failed [raft sideload oom] [C-test-failure O-roachtest O-robot S-3 T-kv-replication X-nostale branch-release-21.2 no-test-failure-activity]

/cc @cockroachdb/disaster-recovery

This test on roachdash | Improve this report!

Jira issue: CRDB-19978

[dt]

job lease moved