roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed #27688

cockroach-teamcity · 2018-07-18T06:28:22Z

SHA: https://github.com/cockroachdb/cockroach/commits/eed443af32474fd76d3b860b44ebfa339b249703

Parameters:

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=783566&tab=buildLog

	test.go:499,copy.go:120,cluster.go:1077,errgroup.go:58: failed to copy rows: pq: TransactionStatusError: transaction deadline exceeded (REASON_UNKNOWN)

The text was updated successfully, but these errors were encountered:

cockroach-teamcity · 2018-07-19T06:28:40Z

SHA: https://github.com/cockroachdb/cockroach/commits/6b49d8cf1b8130a21698c74f541964dfd6a4e3c8

Parameters:

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=785763&tab=buildLog

tbg · 2018-07-23T18:39:50Z

@andreimatei, could you take a look at what's going on here?

andreimatei · 2018-07-23T18:57:16Z

will do

cockroach-teamcity · 2018-07-30T05:44:56Z

SHA: https://github.com/cockroachdb/cockroach/commits/4f21f583432bef4e5f9d634854248b835945d059

Parameters:

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=803679&tab=buildLog

andreimatei · 2018-08-03T21:57:22Z

Last failure is just roachprod put ... failing.
Attempting to repro deadline exceeded error.

andreimatei · 2018-08-03T23:26:52Z

Doesn't repro locally, but in any case this test runs a long transaction, and I believe we don't prevent those from running into the deadline.
This is likely #24041 and #18684

I think maybe we should just raise the lease duration before we get a better story for their renewal.

cockroach-teamcity · 2018-08-14T06:30:58Z

SHA: https://github.com/cockroachdb/cockroach/commits/199436af8696d0028e1adfccec8a8fc61a5d347f

Parameters:

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=834301&tab=buildLog

cockroach-teamcity · 2018-08-16T06:09:33Z

SHA: https://github.com/cockroachdb/cockroach/commits/956889269f956a74bc9f075663c06d0f0c7de830

Parameters:

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=840149&tab=buildLog

cockroach-teamcity · 2018-08-21T06:27:38Z

SHA: https://github.com/cockroachdb/cockroach/commits/4004c1e37f6bf9dcd1024cff7f00ed606e771f44

Parameters:

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=850976&tab=buildLog

cockroach-teamcity · 2018-08-24T06:31:30Z

SHA: https://github.com/cockroachdb/cockroach/commits/d6a4a0d6a7e84debc0195822f6cd196405c584c4

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stressrace instead of stress and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
make stress TESTS=copy/bank/rows=10000000,nodes=9,txn=true PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-stderr=false -maxtime 20m -timeout 10m'

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=858104&tab=buildLog

cockroach-teamcity · 2018-08-25T06:23:58Z

SHA: https://github.com/cockroachdb/cockroach/commits/a6e5d24201c45b49415d95be9b04d9d0a523e44c

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stressrace instead of stress and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
make stress TESTS=copy/bank/rows=10000000,nodes=9,txn=true PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-stderr=false -maxtime 20m -timeout 10m'

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=859524&tab=buildLog

cockroach-teamcity · 2018-09-02T07:43:10Z

SHA: https://github.com/cockroachdb/cockroach/commits/14b53bcf4501e9117155eed1653c113a74e267cb

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stressrace instead of stress and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
make stress TESTS=copy/bank/rows=10000000,nodes=9,txn=true PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-stderr=false -maxtime 20m -timeout 10m'

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=877965&tab=buildLog

cockroach-teamcity · 2018-09-04T07:03:58Z

SHA: https://github.com/cockroachdb/cockroach/commits/d05e6c8f5b70607e729e38f199b624ea0ae44fda

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stressrace instead of stress and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
make stress TESTS=copy/bank/rows=10000000,nodes=9,txn=true PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-stderr=false -maxtime 20m -timeout 10m'

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=880356&tab=buildLog

petermattis · 2018-09-05T23:55:45Z

This test has been failing fairly regularly:

@andreimatei Can you do some additional investigation?

cockroach-teamcity · 2018-09-06T18:01:54Z

SHA: https://github.com/cockroachdb/cockroach/commits/acc8f8337524c7654259f0540780e7237503001d

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stressrace instead of stress and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
make stress TESTS=copy/bank/rows=10000000,nodes=9,txn=true PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-stderr=false -maxtime 20m -timeout 10m'

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=888557&tab=buildLog

nvanbenschoten · 2018-09-06T18:15:20Z

Latest failure was:

Error: finding fixture: Get https://www.googleapis.com/storage/v1/b/cockroach-fixtures/o?alt=json&delimiter=%2F&pageToken=&prefix=workload%2Fbank%2Fversion%3D1.0.0%2Cpayload-bytes%3D100%2Cranges%3D10%2Crows%3D10000000%2Cseed%3D1&projection=full&versions=false: Get http://169.254.169.254/computeMetadata/v1/instance/service-accounts/default/token: net/http: timeout awaiting response headers

I don't even see where the previous two failed.

cockroach-teamcity · 2018-09-07T06:21:35Z

SHA: https://github.com/cockroachdb/cockroach/commits/51b4ca988b80c8a6309fb5fd72a47beb2b5bd372

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stressrace instead of stress and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
make stress TESTS=copy/bank/rows=10000000,nodes=9,txn=true PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-stderr=false -maxtime 20m -timeout 10m'

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=890070&tab=buildLog

cockroach-teamcity · 2018-09-09T06:23:43Z

SHA: https://github.com/cockroachdb/cockroach/commits/d0db30ebdec433ee5a8c10ada53d9a927439cb3c

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stressrace instead of stress and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
make stress TESTS=copy/bank/rows=10000000,nodes=9,txn=true PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-stderr=false -maxtime 20m -timeout 10m'

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=893713&tab=buildLog

andreimatei · 2018-09-11T01:07:45Z

tomorrow's the day!

cockroach-teamcity · 2019-07-03T06:13:22Z

SHA: https://github.com/cockroachdb/cockroach/commits/adcc5aca6113bf05e67338f0faa55bd7110a221f

Parameters:

TAGS= gss make x86_64_pc_linux_gnu
GOFLAGS=

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=timeout PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1371808&tab=buildLog

The test failed on branch=<unknown branch>, cloud=gce:
test artifacts and logs in: 
	test_runner.go:695: test timed out (10ms)

cockroach-teamcity · 2019-07-03T06:13:28Z

SHA: https://github.com/cockroachdb/cockroach/commits/adcc5aca6113bf05e67338f0faa55bd7110a221f

Parameters:

TAGS= gss make x86_64_pc_linux_gnu
GOFLAGS=

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=timeout PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1371808&tab=buildLog

The test failed on branch=<unknown branch>, cloud=gce:
test artifacts and logs in: 
	test_runner.go:695: test timed out (10ms)

cockroach-teamcity · 2019-07-03T06:13:36Z

SHA: https://github.com/cockroachdb/cockroach/commits/adcc5aca6113bf05e67338f0faa55bd7110a221f

Parameters:

TAGS= gss make x86_64_pc_linux_gnu
GOFLAGS=

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=timeout PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1371808&tab=buildLog

The test failed on branch=<unknown branch>, cloud=gce:
test artifacts and logs in: 
	test_runner.go:695: test timed out (10ms)

cockroach-teamcity · 2019-07-03T06:13:42Z

SHA: https://github.com/cockroachdb/cockroach/commits/adcc5aca6113bf05e67338f0faa55bd7110a221f

Parameters:

TAGS= gss make x86_64_pc_linux_gnu
GOFLAGS=

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=timeout PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1371808&tab=buildLog

The test failed on branch=<unknown branch>, cloud=gce:
test artifacts and logs in: 
	test_runner.go:695: test timed out (10ms)

cockroach-teamcity · 2019-07-03T06:14:09Z

SHA: https://github.com/cockroachdb/cockroach/commits/adcc5aca6113bf05e67338f0faa55bd7110a221f

Parameters:

TAGS= gss make x86_64_pc_linux_gnu
GOFLAGS=

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=timeout PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1371808&tab=buildLog

The test failed on branch=<unknown branch>, cloud=gce:
test artifacts and logs in: 
	test_runner.go:695: test timed out (10ms)

cockroach-teamcity · 2019-07-03T06:14:16Z

SHA: https://github.com/cockroachdb/cockroach/commits/adcc5aca6113bf05e67338f0faa55bd7110a221f

Parameters:

TAGS= gss make x86_64_pc_linux_gnu
GOFLAGS=

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=timeout PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1371808&tab=buildLog

The test failed on branch=<unknown branch>, cloud=gce:
test artifacts and logs in: 
	test_runner.go:695: test timed out (10ms)

cockroach-teamcity · 2019-07-03T06:14:23Z

SHA: https://github.com/cockroachdb/cockroach/commits/adcc5aca6113bf05e67338f0faa55bd7110a221f

Parameters:

TAGS= gss make x86_64_pc_linux_gnu
GOFLAGS=

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=timeout PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1371808&tab=buildLog

The test failed on branch=<unknown branch>, cloud=gce:
test artifacts and logs in: 
	test_runner.go:695: test timed out (10ms)

cockroach-teamcity · 2019-07-03T06:14:30Z

SHA: https://github.com/cockroachdb/cockroach/commits/adcc5aca6113bf05e67338f0faa55bd7110a221f

Parameters:

TAGS= gss make x86_64_pc_linux_gnu
GOFLAGS=

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=timeout PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1371808&tab=buildLog

The test failed on branch=<unknown branch>, cloud=gce:
test artifacts and logs in: 
	test_runner.go:695: test timed out (10ms)

cockroach-teamcity · 2019-08-07T11:30:08Z

SHA: https://github.com/cockroachdb/cockroach/commits/a850466dfc4f8eed9e7f758a61f60b120798410f

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=copy/bank/rows=10000000,nodes=9,txn=true PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1426564&tab=buildLog

The test failed on branch=release-19.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20190807-1426564/copy/bank/rows=10000000_nodes=9_txn=true/run_1
	copy.go:62,copy.go:66,cluster.go:2078,errgroup.go:57: failed to get range count: pq: syntax error at or near "ranges"
	cluster.go:2099,copy.go:127,copy.go:139,test_runner.go:691: Goexit() was called

cockroach-teamcity · 2019-08-08T04:01:09Z

SHA: https://github.com/cockroachdb/cockroach/commits/51a6fdedf0ce1d1329d40d801a7deaf8206b6b07

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=copy/bank/rows=10000000,nodes=9,txn=true PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1428934&tab=buildLog

The test failed on branch=provisional_201908060405_v19.1.4, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20190807-1428934/copy/bank/rows=10000000_nodes=9_txn=true/run_1
	copy.go:62,copy.go:66,cluster.go:2078,errgroup.go:57: failed to get range count: pq: syntax error at or near "ranges"
	cluster.go:2099,copy.go:127,copy.go:139,test_runner.go:691: Goexit() was called

cockroach-teamcity · 2019-08-08T09:29:23Z

SHA: https://github.com/cockroachdb/cockroach/commits/1051f376924f18c5782887ed824ab5ede5027493

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=copy/bank/rows=10000000,nodes=9,txn=true PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1429376&tab=buildLog

The test failed on branch=release-2.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20190808-1429376/copy/bank/rows=10000000_nodes=9_txn=true/run_1
	copy.go:62,copy.go:66,cluster.go:2078,errgroup.go:57: failed to get range count: pq: syntax error at or near "ranges"
	cluster.go:2099,copy.go:127,copy.go:139,test_runner.go:691: Goexit() was called

cockroach-teamcity · 2019-11-09T08:47:33Z

SHA: https://github.com/cockroachdb/cockroach/commits/c019acf1ed7afc16e04dfe324d1b98b84d39a489

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=copy/bank/rows=10000000,nodes=9,txn=true PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1583760&tab=artifacts#/copy/bank/rows=10000000,nodes=9,txn=true

The test failed on branch=release-19.2, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20191109-1583760/copy/bank/rows=10000000_nodes=9_txn=true/run_1
	cluster.go:1783,copy.go:57,cluster.go:2142,errgroup.go:57: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-1583760-1573284569-33-n9cpu4:1 -- ./workload init bank --rows=0 --ranges=0 {pgurl:1} returned:
		stderr:
		
		stdout:
		Error:  exit status 255
		: exit status 1

cockroach-teamcity · 2020-01-17T08:54:06Z

(roachtest).copy/bank/rows=10000000,nodes=9,txn=true failed on master@96d7e50acfaa63b5b60addd7cec8e750a4a4d333:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20200117-1695913/copy/bank/rows=10000000_nodes=9_txn=true/run_1
	cluster.go:1821,copy.go:49,cluster.go:2180,errgroup.go:57: error with attached stack trace:
		    main.execCmd
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:399
		    main.(*cluster).RunL
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:1855
		    main.(*cluster).Run
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:1819
		    main.registerCopy.func1.1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:49
		    main.(*monitor).Go.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2180
		    github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - error with embedded safe details: %s returned:
		    stderr:
		    %s
		    stdout:
		    %s
		    -- arg 1: <string>
		    -- arg 2: <string>
		    -- arg 3: <string>
		  - /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-1695913-1579247026-29-n9cpu4:1 -- ./workload fixtures load bank --rows=10000000 --payload-bytes=100 {pgurl:1} returned:
		    stderr:
		    
		    stdout:
		    1: exit status 255
		    GetInternalIP: failed to execute hostname on teamcity-1695913-1579247026-29-n9cpu4:2:
		    (stdout) 
		    (stderr) 
		    github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install.(*SyncedCluster).GetInternalIP
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install/cluster_synced.go:124
		    github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install.(*SyncedCluster).pghosts.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install/cluster_synced.go:1445
		    github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install.(*SyncedCluster).Parallel.func1.1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install/cluster_synced.go:1553
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		    pghosts
		    github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install.(*SyncedCluster).pghosts.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install/cluster_synced.go:1446
		    github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install.(*SyncedCluster).Parallel.func1.1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install/cluster_synced.go:1553
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357: 
		    I200117 08:53:51.489978 39 cluster_synced.go:1635  command failed:
		  - exit status 1

Repro

Artifacts: /copy/bank/rows=10000000,nodes=9,txn=true

make stressrace TESTS=copy/bank/rows=10000000,nodes=9,txn=true PKG=./pkg/roachtest TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

_{powered by pkg/cmd/internal/issues}

cockroach-teamcity · 2020-02-13T08:44:58Z

(roachtest).copy/bank/rows=10000000,nodes=9,txn=true failed on master@2739821b911d777fa2a927295d699b559360a802:

		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - error with embedded safe details: %s returned:
		    stderr:
		    %s
		    stdout:
		    %s
		    -- arg 1: <string>
		    -- arg 2: <string>
		    -- arg 3: <string>
		  - /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-1747374-1581581035-34-n9cpu4:1 -- ./workload fixtures load bank --rows=10000000 --payload-bytes=100 {pgurl:1} returned:
		    stderr:
		    I200213 08:44:05.005989 1 ccl/workloadccl/cliccl/fixtures.go:279  starting restore of 1 tables
		    Error: restoring fixture: sql: expected 6 destination arguments in Scan, not 7
		    Error:  exit status 1
		    
		    stdout::
		  - exit status 1

	cluster.go:2368,copy.go:135,copy.go:148,test_runner.go:741: error with attached stack trace:
		    main.(*monitor).WaitE
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2356
		    main.(*monitor).Wait
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2364
		    main.registerCopy.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:135
		    main.registerCopy.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:148
		    main.(*testRunner).runTest.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:741
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - monitor failure:
		  - error with attached stack trace:
		    main.(*monitor).wait.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2412
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - monitor task failed:
		  - error with attached stack trace:
		    main.init
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2309
		    runtime.doInit
		    	/usr/local/go/src/runtime/proc.go:5222
		    runtime.main
		    	/usr/local/go/src/runtime/proc.go:190
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - Goexit() was called

More

Artifacts: /copy/bank/rows=10000000,nodes=9,txn=true
Related:

roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed #45058 roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed C-test-failure O-roachtest O-robot branch-44941 release-blocker

See this test on roachdash
_{powered by pkg/cmd/internal/issues}

cockroach-teamcity · 2020-02-20T09:20:55Z

(roachtest).copy/bank/rows=10000000,nodes=9,txn=true failed on master@fde991a0f5aba7ffd66112295996ad26f3725036:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/copy/bank/rows=10000000_nodes=9_txn=true/run_1
	cluster.go:2368,copy.go:135,copy.go:148,test_runner.go:741: error with attached stack trace:
		    main.(*monitor).WaitE
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2356
		    main.(*monitor).Wait
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2364
		    main.registerCopy.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:135
		    main.registerCopy.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:148
		    main.(*testRunner).runTest.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:741
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - monitor failure:
		  - error with attached stack trace:
		    main.(*monitor).wait.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2412
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - monitor task failed:
		  - expected range count for table between 38 and 77, found 7
		    main.registerCopy.func1.1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:130
		    main.(*monitor).Go.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2344
		    github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357

More

Artifacts: /copy/bank/rows=10000000,nodes=9,txn=true
Related:

roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed #45058 roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed C-test-failure O-roachtest O-robot branch-44941 release-blocker

See this test on roachdash
_{powered by pkg/cmd/internal/issues}

tbg · 2020-02-20T09:44:01Z

cc @ajwerner is this one of your large range runs? - expected range count for table between 38 and 77, found 7

cockroach-teamcity · 2020-02-21T09:13:50Z

(roachtest).copy/bank/rows=10000000,nodes=9,txn=true failed on master@b797cad6d130714748983bc53d4611ddc6151153:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/copy/bank/rows=10000000_nodes=9_txn=true/run_1
	cluster.go:2368,copy.go:135,copy.go:148,test_runner.go:741: error with attached stack trace:
		    main.(*monitor).WaitE
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2356
		    main.(*monitor).Wait
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2364
		    main.registerCopy.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:135
		    main.registerCopy.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:148
		    main.(*testRunner).runTest.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:741
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - monitor failure:
		  - error with attached stack trace:
		    main.(*monitor).wait.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2412
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - monitor task failed:
		  - expected range count for table between 38 and 77, found 7
		    main.registerCopy.func1.1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:130
		    main.(*monitor).Go.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2344
		    github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357

More

Artifacts: /copy/bank/rows=10000000,nodes=9,txn=true
Related:

roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed #45058 roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed C-test-failure O-roachtest O-robot branch-44941 release-blocker

See this test on roachdash
_{powered by pkg/cmd/internal/issues}

cockroach-teamcity · 2020-02-22T09:19:52Z

(roachtest).copy/bank/rows=10000000,nodes=9,txn=true failed on master@a51ddb8342ff54283baf5c7556cb1d4ff8c4e5da:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/copy/bank/rows=10000000_nodes=9_txn=true/run_1
	cluster.go:2368,copy.go:135,copy.go:148,test_runner.go:741: error with attached stack trace:
		    main.(*monitor).WaitE
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2356
		    main.(*monitor).Wait
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2364
		    main.registerCopy.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:135
		    main.registerCopy.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:148
		    main.(*testRunner).runTest.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:741
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - monitor failure:
		  - error with attached stack trace:
		    main.(*monitor).wait.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2412
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - monitor task failed:
		  - expected range count for table between 38 and 77, found 7
		    main.registerCopy.func1.1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:130
		    main.(*monitor).Go.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2344
		    github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357

More

Artifacts: /copy/bank/rows=10000000,nodes=9,txn=true
Related:

roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed #45297 roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed C-test-failure O-roachtest O-robot branch-45179 release-blocker
roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed #45058 roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed C-test-failure O-roachtest O-robot branch-44941 release-blocker

See this test on roachdash
_{powered by pkg/cmd/internal/issues}

andreimatei · 2020-02-22T16:52:16Z

Broken by the increased range size

cockroach-teamcity · 2020-02-23T09:25:44Z

(roachtest).copy/bank/rows=10000000,nodes=9,txn=true failed on master@49e2b18471a42aed8a8ad7cb658863f045ea1aac:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/copy/bank/rows=10000000_nodes=9_txn=true/run_1
	cluster.go:2368,copy.go:135,copy.go:148,test_runner.go:741: error with attached stack trace:
		    main.(*monitor).WaitE
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2356
		    main.(*monitor).Wait
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2364
		    main.registerCopy.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:135
		    main.registerCopy.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:148
		    main.(*testRunner).runTest.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:741
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - monitor failure:
		  - error with attached stack trace:
		    main.(*monitor).wait.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2412
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - monitor task failed:
		  - expected range count for table between 38 and 77, found 7
		    main.registerCopy.func1.1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:130
		    main.(*monitor).Go.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2344
		    github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357

More

Artifacts: /copy/bank/rows=10000000,nodes=9,txn=true
Related:

roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed #45297 roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed C-test-failure O-roachtest O-robot branch-45179 release-blocker
roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed #45058 roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed C-test-failure O-roachtest O-robot branch-44941 release-blocker

See this test on roachdash
_{powered by pkg/cmd/internal/issues}

cockroach-teamcity · 2020-02-25T09:21:36Z

(roachtest).copy/bank/rows=10000000,nodes=9,txn=true failed on master@abe944fb0ad990ceaba7e592cc83b8922639016c:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/copy/bank/rows=10000000_nodes=9_txn=true/run_1
	cluster.go:2368,copy.go:135,copy.go:148,test_runner.go:741: error with attached stack trace:
		    main.(*monitor).WaitE
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2356
		    main.(*monitor).Wait
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2364
		    main.registerCopy.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:135
		    main.registerCopy.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:148
		    main.(*testRunner).runTest.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:741
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - monitor failure:
		  - error with attached stack trace:
		    main.(*monitor).wait.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2412
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - monitor task failed:
		  - expected range count for table between 38 and 77, found 7
		    main.registerCopy.func1.1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:130
		    main.(*monitor).Go.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2344
		    github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357

More

Artifacts: /copy/bank/rows=10000000,nodes=9,txn=true
Related:

roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed #45297 roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed C-test-failure O-roachtest O-robot branch-45179 release-blocker
roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed #45058 roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed C-test-failure O-roachtest O-robot branch-44941 release-blocker

See this test on roachdash
_{powered by pkg/cmd/internal/issues}

cockroach-teamcity · 2020-02-26T09:43:08Z

(roachtest).copy/bank/rows=10000000,nodes=9,txn=true failed on master@8b5adba703fae9b6961623f65b685d93b0fe0290:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/copy/bank/rows=10000000_nodes=9_txn=true/run_1
	cluster.go:2368,copy.go:135,copy.go:148,test_runner.go:741: error with attached stack trace:
		    main.(*monitor).WaitE
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2356
		    main.(*monitor).Wait
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2364
		    main.registerCopy.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:135
		    main.registerCopy.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:148
		    main.(*testRunner).runTest.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:741
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - monitor failure:
		  - error with attached stack trace:
		    main.(*monitor).wait.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2412
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - monitor task failed:
		  - expected range count for table between 38 and 77, found 7
		    main.registerCopy.func1.1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/copy.go:130
		    main.(*monitor).Go.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2344
		    github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup.(*Group).Go.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/golang.org/x/sync/errgroup/errgroup.go:57
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357

More

Artifacts: /copy/bank/rows=10000000,nodes=9,txn=true
Related:

roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed #45380 roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed C-test-failure O-roachtest O-robot branch-provisional_202002240854_v20.1.0-beta.2 release-blocker
roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed #45297 roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed C-test-failure O-roachtest O-robot branch-45179 release-blocker
roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed #45058 roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed C-test-failure O-roachtest O-robot branch-44941 release-blocker

See this test on roachdash
_{powered by pkg/cmd/internal/issues}

cockroach-teamcity added this to the 2.1 milestone Jul 18, 2018

cockroach-teamcity added C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. labels Jul 18, 2018

tbg added the A-kv-client Relating to the KV client and the KV interface. label Jul 22, 2018

tbg assigned andreimatei Jul 23, 2018

tbg mentioned this issue Aug 28, 2018

roachtest: copy/bank/rows=10000000,nodes=9,txn=false failed on release-2.1 #28917

Closed

andreimatei mentioned this issue Sep 11, 2018

roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed on release-2.1 #29258

Closed

kenliu unassigned vivekmenezes Sep 20, 2019

tbg added the branch-master Failures and bugs on the master branch. label Jan 22, 2020

cockroach-teamcity mentioned this issue Feb 13, 2020

roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed #45058

Closed

cockroach-teamcity mentioned this issue Feb 21, 2020

roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed #45297

Closed

cockroach-teamcity mentioned this issue Feb 25, 2020

roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed #45380

Closed

cockroach-teamcity mentioned this issue Feb 27, 2020

roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed #45489

Closed

tbg closed this as completed Mar 10, 2020

roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed #27688

roachtest: copy/bank/rows=10000000,nodes=9,txn=true failed #27688

Comments

cockroach-teamcity commented Jul 18, 2018

cockroach-teamcity commented Jul 19, 2018

tbg commented Jul 23, 2018

andreimatei commented Jul 23, 2018

cockroach-teamcity commented Jul 30, 2018

andreimatei commented Aug 3, 2018

andreimatei commented Aug 3, 2018

cockroach-teamcity commented Aug 14, 2018

cockroach-teamcity commented Aug 16, 2018

cockroach-teamcity commented Aug 21, 2018

cockroach-teamcity commented Aug 24, 2018

cockroach-teamcity commented Aug 25, 2018

cockroach-teamcity commented Sep 2, 2018

cockroach-teamcity commented Sep 4, 2018

petermattis commented Sep 5, 2018

cockroach-teamcity commented Sep 6, 2018

nvanbenschoten commented Sep 6, 2018

cockroach-teamcity commented Sep 7, 2018

cockroach-teamcity commented Sep 9, 2018

andreimatei commented Sep 11, 2018

cockroach-teamcity commented Jul 3, 2019

cockroach-teamcity commented Jul 3, 2019

cockroach-teamcity commented Jul 3, 2019

cockroach-teamcity commented Jul 3, 2019

cockroach-teamcity commented Jul 3, 2019

cockroach-teamcity commented Jul 3, 2019

cockroach-teamcity commented Jul 3, 2019

cockroach-teamcity commented Jul 3, 2019

cockroach-teamcity commented Aug 7, 2019

cockroach-teamcity commented Aug 8, 2019

cockroach-teamcity commented Aug 8, 2019

cockroach-teamcity commented Nov 9, 2019

cockroach-teamcity commented Jan 17, 2020

cockroach-teamcity commented Feb 13, 2020

cockroach-teamcity commented Feb 20, 2020

tbg commented Feb 20, 2020

cockroach-teamcity commented Feb 21, 2020

cockroach-teamcity commented Feb 22, 2020

andreimatei commented Feb 22, 2020

cockroach-teamcity commented Feb 23, 2020

cockroach-teamcity commented Feb 25, 2020

cockroach-teamcity commented Feb 26, 2020