New index backfill schema change resulted in error in newOrder: ERROR: no inbound stream connection (SQLSTATE XX000) #34738
Labels
A-schema-changes
C-investigation
Further steps needed to qualify. C-label will change.
S-3-ux-surprise
Issue leaves users wondering whether CRDB is behaving properly. Likely to hurt reputation/adoption.
Describe the problem
While running tpc-c 10k, I created a schema change. The schema change caused an error that stopped QPS.
To Reproduce
Setup TPC-C 1K like normal.
Set flag for new schema change implementation:
Roachprod sql $CLUSTER:1
SET CLUSTER SETTING schemachanger.bulk_index_backfill.enabled = true
Run for 6 hours.
roachprod run $CLUSTER:4 "./workload run tpcc --ramp=5m --warehouses=2000 --duration=6h --split --scatter {pgurl:1-3}"
After five minutes, in another shell, change the zone config ttl to 10 minutes
Roachprod sql $CLUSTER:1
ALTER RANGE default CONFIGURE ZONE USING gc.ttlseconds = 600;
Then create an index or non-unique on any column:
use tpcc
CREATE INDEX ON item (i_price)
Expected behavior
Index < 10 minutes
Look at the front page on admin ui metrics SQL QPS and make sure it never went to less than 80% pre index
Environment:
v2.2.0-alpha.20181217-1144-ge3e4f96
The text was updated successfully, but these errors were encountered: