sql: TestPlanningDuringSplitsAndMerges failed under stress

[cockroach-teamcity]

SHA: https://github.com/cockroachdb/cockroach/commits/ecbef846abb2855afca8532097c42864d688f51d

Parameters:

TAGS=
GOFLAGS=-race

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
make stressrace TESTS=TestPlanningDuringSplitsAndMerges PKG=github.com/cockroachdb/cockroach/pkg/sql TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1017275&tab=buildLog

I181117 11:37:14.278612 11329 server/config.go:497  [n?] RocksDB cache size: 128 MiB
I181117 11:37:14.278659 11329 server/config.go:497  [n?] store 0: in-memory, size 0 B
I181117 11:37:14.354416 11329 server/node.go:370  [n?] **** cluster 4f9834f5-d997-4c3c-85af-40c5b333aa4b has been created
I181117 11:37:14.354642 11329 server/server.go:1396  [n?] **** add additional nodes by specifying --join=127.0.0.1:44103
I181117 11:37:14.355645 11329 gossip/gossip.go:393  [n1] NodeDescriptor set to node_id:1 address:<network_field:"tcp" address_field:"127.0.0.1:44103" > attrs:<> locality:<> ServerVersion:<major_val:2 minor_val:1 patch:0 unstable:3 > build_tag:"v2.2.0-alpha.00000000-2418-gecbef84" started_at:1542454634355316034 
I181117 11:37:14.387403 11329 server/node.go:474  [n1] initialized store [n1,s1]: disk (capacity=512 MiB, available=512 MiB, used=0 B, logicalBytes=7.1 KiB), ranges=1, leases=0, queries=0.00, writes=0.00, bytesPerReplica={p10=7227.00 p25=7227.00 p50=7227.00 p75=7227.00 p90=7227.00 pMax=7227.00}, writesPerReplica={p10=0.00 p25=0.00 p50=0.00 p75=0.00 p90=0.00 pMax=0.00}
I181117 11:37:14.389981 11329 storage/stores.go:242  [n1] read 0 node addresses from persistent storage
I181117 11:37:14.390660 11329 server/node.go:697  [n1] connecting to gossip network to verify cluster ID...
I181117 11:37:14.390930 11329 server/node.go:722  [n1] node connected via gossip and verified as part of cluster "4f9834f5-d997-4c3c-85af-40c5b333aa4b"
I181117 11:37:14.391478 11329 server/node.go:546  [n1] node=1: started with [<no-attributes>=<in-mem>] engine(s) and attributes []
I181117 11:37:14.392762 11329 server/status/recorder.go:610  [n1] available memory from cgroups (8.0 EiB) exceeds system memory 16 GiB, using system memory
I181117 11:37:14.392872 11329 server/server.go:1822  [n1] Could not start heap profiler worker due to: directory to store profiles could not be determined
I181117 11:37:14.398902 11329 server/server.go:1528  [n1] starting https server at 127.0.0.1:36069 (use: 127.0.0.1:36069)
I181117 11:37:14.403660 11329 server/server.go:1530  [n1] starting grpc/postgres server at 127.0.0.1:44103
I181117 11:37:14.403767 11329 server/server.go:1531  [n1] advertising CockroachDB node at 127.0.0.1:44103
W181117 11:37:14.404030 11329 jobs/registry.go:317  [n1] unable to get node liveness: node not in the liveness table
I181117 11:37:14.429250 11591 storage/replica_command.go:306  [n1,split,s1,r1/1:/M{in-ax}] initiating a split of this range at key /System/"" [r2]
I181117 11:37:14.571340 11601 storage/replica_command.go:306  [n1,split,s1,r2/1:/{System/-Max}] initiating a split of this range at key /System/NodeLiveness [r3]
W181117 11:37:14.629036 11598 storage/intent_resolver.go:675  [n1,s1] failed to push during intent resolution: failed to push "unnamed" id=ffc75bd6 key=/Table/SystemConfigSpan/Start rw=true pri=0.03660573 iso=SERIALIZABLE stat=PENDING epo=0 ts=1542454634.484125694,0 orig=1542454634.484125694,0 max=1542454634.484125694,0 wto=false rop=false seq=6
I181117 11:37:14.655802 11661 sql/event_log.go:126  [n1,intExec=optInToDiagnosticsStatReporting] Event: "set_cluster_setting", target: 0, info: {SettingName:diagnostics.reporting.enabled Value:true User:root}
I181117 11:37:14.747341 11663 storage/replica_command.go:306  [n1,split,s1,r3/1:/{System/NodeL…-Max}] initiating a split of this range at key /System/NodeLivenessMax [r4]
I181117 11:37:14.807861 11545 storage/replica_command.go:306  [n1,split,s1,r4/1:/{System/NodeL…-Max}] initiating a split of this range at key /System/tsd [r5]
I181117 11:37:14.931492 11688 storage/replica_command.go:306  [n1,split,s1,r5/1:/{System/tsd-Max}] initiating a split of this range at key /System/"tse" [r6]
I181117 11:37:14.966906 11543 sql/event_log.go:126  [n1,intExec=set-setting] Event: "set_cluster_setting", target: 0, info: {SettingName:version Value:2.1-3 User:root}
I181117 11:37:15.041353 11409 storage/replica_command.go:306  [n1,split,s1,r6/1:/{System/tse-Max}] initiating a split of this range at key /Table/SystemConfigSpan/Start [r7]

[tbg]

#32149