roachtest: cdc/poller/rangefeed=false failed

[cockroach-teamcity]

SHA: https://github.com/cockroachdb/cockroach/commits/7b2651400b2003d0a381cba9dbfc0b7bc0dfee00

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=cdc/poller/rangefeed=false PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1293898&tab=buildLog

The test failed on branch=master, cloud=gce:
	cluster.go:1474,cdc.go:732,cdc.go:128,cdc.go:509,test.go:1251: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-1293898-cdc-poller-rangefeed-false:4 -- ./workload fixtures load tpcc --warehouses=1000 --checks=false {pgurl:2} returned:
		stderr:
		
		stdout:
		t-status reply 0
		debug3: receive packet: type 96
		debug2: channel 0: rcvd eof
		debug2: channel 0: output open -> drain
		debug2: channel 0: obuf empty
		debug2: channel 0: close_write
		debug2: channel 0: output drain -> closed
		debug3: receive packet: type 97
		debug2: channel 0: rcvd close
		debug3: channel 0: will not send data after close
		debug2: channel 0: almost dead
		debug2: channel 0: gc: notify user
		debug2: channel 0: gc: user detached
		debug2: channel 0: send close
		debug3: send packet: type 97
		debug2: channel 0: is dead
		debug2: channel 0: garbage collecting
		debug1: channel 0: free: client-session, nchannels 1
		debug3: channel 0: status: The following connections are open:
		  #0 client-session (t4 r0 i3/0 o3/0 fd -1/-1 cc -1)
		
		debug3: send packet: type 1
		debug1: fd 0 clearing O_NONBLOCK
		debug1: fd 1 clearing O_NONBLOCK
		debug3: fd 2 is not O_NONBLOCK
		Transferred: sent 5340, received 5384 bytes, in 3879.5 seconds
		Bytes per second: sent 1.4, received 1.4
		debug1: Exit status 1
		: exit status 1
		: exit status 1

[danhhz]

column "ol_d_id" cannot be used by multiple foreign key constraints

[tbg]

#37590. I'll minize the failing test. Tonight we'll also get less ssh spam.

[cockroach-teamcity]

SHA: https://github.com/cockroachdb/cockroach/commits/5542939c07947546136d5ae895b7349751534595

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=cdc/poller/rangefeed=false PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1298482&tab=buildLog

The test failed on branch=master, cloud=gce:
	cluster.go:1474,cdc.go:732,cdc.go:128,cdc.go:509,test.go:1251: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-1298482-cdc-poller-rangefeed-false:4 -- ./workload fixtures load tpcc --warehouses=1000 --checks=false {pgurl:3} returned:
		stderr:
		
		stdout:
		I190521 06:20:18.633925 1 ccl/workloadccl/cliccl/fixtures.go:300  starting load of 9 tables
		Error: restoring fixture: pq: table "csv.item" does not exist
		Error:  ssh verbose log retained in /root/.roachprod/debug/ssh_34.73.40.76_2019-05-21T06:20:17Z: exit status 1
		: exit status 1

[cockroach-teamcity]

SHA: https://github.com/cockroachdb/cockroach/commits/9671342fead0509bec0913bae4ae1f244660788e

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=cdc/poller/rangefeed=false PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1298500&tab=buildLog

The test failed on branch=release-19.1, cloud=gce:
	cluster.go:1474,cdc.go:732,cdc.go:128,cdc.go:509,test.go:1251: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-1298500-cdc-poller-rangefeed-false:4 -- ./workload fixtures load tpcc --warehouses=1000 --checks=false {pgurl:1} returned:
		stderr:
		
		stdout:
		I190521 06:23:12.875020 1 ccl/workloadccl/cliccl/fixtures.go:300  starting load of 9 tables
		Error: restoring fixture: pq: table "csv.order_line" does not exist
		Error:  ssh verbose log retained in /root/.roachprod/debug/ssh_35.196.58.94_2019-05-21T06:23:11Z: exit status 1
		: exit status 1

[nvanbenschoten]

First four issues addressed by #36854.

Previous two issues addressed by #37701.