roachtest: jepsen/bank-multitable/majority-ring-start-kill-2 failed

[cockroach-teamcity]

(roachtest).jepsen/bank-multitable/majority-ring-start-kill-2 failed on release-19.2@a50439b7808533873305957259bb6d1d48965ed3:

		    main.runJepsen.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/jepsen.go:159
		    main.runJepsen.func3
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/jepsen.go:180
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - error with embedded safe details: output in %s
		    -- arg 1: <string>
		  - output in run_081613.963_n6_bash:
		  - error with attached stack trace:
		    main.execCmd
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:406
		    main.(*cluster).RunL
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2019
		    main.(*cluster).RunE
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2000
		    main.runJepsen.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/jepsen.go:159
		    main.runJepsen.func3
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/jepsen.go:180
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - error with embedded safe details: %s returned:
		    stderr:
		    %s
		    stdout:
		    %s
		    -- arg 1: <string>
		    -- arg 2: <string>
		    -- arg 3: <string>
		  - /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-1817002-1584600112-39-n6cpu4:6 -- bash -e -c "\
		    cd /mnt/data1/jepsen/cockroachdb && set -eo pipefail && \
		     ~/lein run test \
		       --tarball file://${PWD}/cockroach.tgz \
		       --username ${USER} \
		       --ssh-private-key ~/.ssh/id_rsa \
		       --os ubuntu \
		       --time-limit 300 \
		       --concurrency 30 \
		       --recovery-time 25 \
		       --test-count 1 \
		       -n 10.128.0.241 -n 10.128.1.14 -n 10.128.0.234 -n 10.128.0.228 -n 10.128.0.236 \
		       --test bank-multitable --nemesis majority-ring --nemesis2 start-kill-2 \
		    > invoke.log 2>&1 \
		    " returned:
		    stderr:
		    Error:  exit status 255
		    
		    stdout::
		  - exit status 1

More

Artifacts: /jepsen/bank-multitable/majority-ring-start-kill-2

See this test on roachdash
_{powered by pkg/cmd/internal/issues}

[cockroach-teamcity]

(roachtest).jepsen/bank-multitable/majority-ring failed on release-19.2@63fcb9fa24525c41bc36f1d5dd873828c99a96fe:

		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - error with embedded safe details: output in %s
		    -- arg 1: <string>
		  - output in run_082007.645_n1-6_sh:
		  - error with attached stack trace:
		    main.execCmd
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:406
		    main.(*cluster).RunL
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2019
		    main.(*cluster).RunE
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2000
		    main.(*cluster).Run
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:1933
		    main.initJepsen
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/jepsen.go:86
		    main.runJepsen
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/jepsen.go:138
		    main.registerJepsen.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/jepsen.go:325
		    main.(*testRunner).runTest.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:753
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - error with embedded safe details: %s returned:
		    stderr:
		    %s
		    stdout:
		    %s
		    -- arg 1: <string>
		    -- arg 2: <string>
		    -- arg 3: <string>
		  - /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-1841499-1585723639-40-n6cpu4:1-6 -- sh -c "sudo apt-get -y update > logs/apt-upgrade.log 2>&1" returned:
		    stderr:
		    Error: DEAD_ROACH_PROBLEM:
		      - error with user detail: Node 1. Command with error:
		        ```
		        sh -c "sudo apt-get -y update > logs/apt-upgrade.log 2>&1"
		        ```
		      - exit status 100
		    
		    stdout:
		    teamcity-1841499-1585723639-40-n6cpu4: sh -c "sudo apt-get -y upda..........
		       1: 
		    DEAD_ROACH_PROBLEM: exit status 100
		       2: 
		       3: 
		       4: 
		       5: 
		       6: :
		  - exit status 30

More

Artifacts: /jepsen/bank-multitable/majority-ring

See this test on roachdash
_{powered by pkg/cmd/internal/issues}

[knz]

Superseded by more recent issues.