Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

roachtest: schemachange/random-load failed #61698

Closed
cockroach-teamcity opened this issue Mar 9, 2021 · 70 comments
Closed

roachtest: schemachange/random-load failed #61698

cockroach-teamcity opened this issue Mar 9, 2021 · 70 comments
Labels
C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. T-sql-foundations SQL Foundations Team (formerly SQL Schema + SQL Sessions)

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Mar 9, 2021 •
edited by cockroach-jira-scripts
Loading

(roachtest).schemachange/random-load failed on release-21.1@8c3fa11ca35deca2f38a1e6fb5f0dea4a77285bd:

		  |  "clientTimestamp": "11:45:00.357911",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE VIEW public.view340 AS SELECT \"IrrelevantColumnName\", public.table306.col306_308, public.table306.col306_309, public.table306.col306_321, public.table306.col306_311, public.table306.col306_310, public.table306.col306_319, public.table306.col306_317 FROM schema331.table332, public.table306"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema331.table332\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "11:44:58.246057",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER SEQUENCE public.seq170 RENAME TO public.seq224",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "",
		  |  "txStatus": "TxStatusCommitSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "11:44:57.652482",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER TABLE public.table3 ADD COLUMN col3_197 INT8",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "",
		  |  "txStatus": "TxStatusCommitSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "11:45:00.864063",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER TABLE public.table306 ALTER COLUMN \"col306_322\" DROP STORED"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"table306\" (100): virtual column \"col306_322\" is not computed (SQLSTATE XXUUU)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

Jira issue: CRDB-6264
@cockroach-teamcity cockroach-teamcity added branch-release-21.1 C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. labels Mar 9, 2021
@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@e5aebce55e34e66e8ce0cdbd81b9d9653243df81:

		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema6.table85\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "21:59:27.891269",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER TABLE public.table86 ADD CONSTRAINT IrrelevantConstraintName UNIQUE (IrrelevantColumnName)"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table86\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | _elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
		  |     1.0s        0           30.4           34.0     10.5     39.8     60.8     60.8 opOk
		  |     1.0s        0            4.5            5.0    704.6    771.8    771.8    771.8 txnCmtErr
		  |     1.0s        0            1.8            2.0     75.5    167.8    167.8    167.8 txnOk
		  |     1.0s        0           17.0           19.0     11.5     52.4     83.9     83.9 txnRbk
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "21:59:27.78301",
		  |  "ops": [
		  |   "BEGIN",
		  |   "INSERT INTO schema6.table82 (IrrelevantColumnName) VALUES (\"IrrelevantValue\")"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema6.table82\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "21:59:27.757742",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP SCHEMA \"schema6\" CASCADE",
		  |   "CREATE SCHEMA schema83 AUTHORIZATION root"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity cockroach-teamcity mentioned this issue Mar 12, 2021
Closed
@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@4a47e0e305cbdabf963f896c1cb571a28b34e63d:

		  |   "ALTER TABLE schema1.table116 DROP CONSTRAINT IrrelevantConstraintName"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema1.table116\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:56:51.685605",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SCHEMA schema1 AUTHORIZATION root",
		  |   "CREATE SEQUENCE IF NOT EXISTS schema1.seq45",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "",
		  |  "txStatus": "TxStatusCommitSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:56:52.308849",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER SEQUENCE schema1.seq45 RENAME TO schema1.seq67",
		  |   "DROP SEQUENCE IF EXISTS schema1.seq67",
		  |   "SELECT 'validating all objects'",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=2afc8c0e key=/Table/SystemConfigSpan/Start pri=0.06412566 epo=0 ts=1615892212.382949082,1 min=1615892212.308786245,0 seq=20} lock=true stat=PENDING rts=1615892212.308786245,0 wto=false gul=1615892212.808786245,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:56:52.641151",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SCHEMA schema115 AUTHORIZATION root"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@ba54410af79c0481e1e8f8fc45a9b132ee09a2b4:

		  | I210317 11:26:09.044243 1 workload/cli/run.go:392  [-] 2  creating load generator... done (took 111.866526ms)
		  | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column "col200_210" (SQLSTATE 55000)
		  | Error: COMMAND_PROBLEM: exit status 1
		  | (1) COMMAND_PROBLEM
		  | Wraps: (2) Node 1. Command with error:
		  |   | ```
		  |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 5000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
		  |   | ```
		  | Wraps: (3) exit status 1
		  | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
		  |
		  | stdout:
		  | <... some data truncated by circular buffer; go to artifacts for details ...>
		  | l176_187 BOX2D, col176_188 STRING NULL AS (lower(CAST(col176_186 AS STRING))) VIRTUAL, col176_189 STRING AS (lower(CAST(col176_187 AS STRING))) STORED, col176_190 STRING NOT NULL AS (lower(CAST(col176_185 AS STRING))) VIRTUAL, col176_191 STRING NULL AS (lower(CAST(col176_178 AS STRING))) STORED)",
		  |   "ALTER TABLE public.table176 ADD CONSTRAINT table176_col176_191_unique UNIQUE (col176_191)",
		  |   "CREATE SCHEMA schema199 AUTHORIZATION root"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=69cde019 key=/Table/SystemConfigSpan/Start pri=0.02154373 epo=0 ts=1615980370.795365026,1 min=1615980370.097541816,0 seq=19} lock=true stat=PENDING rts=1615980370.097541816,0 wto=false gul=1615980370.597541816,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "11:26:10.256176",
		  |  "ops": [
		  |   "BEGIN",
		  |   "SELECT 'validating all objects'",
		  |   "ALTER TABLE public.table233 ADD CONSTRAINT IrrelevantConstraintName UNIQUE (IrrelevantColumnName)"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table233\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "11:26:10.241701",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE IF NOT EXISTS public.table200 (col200_201 CHAR, col200_202 TIMESTAMPTZ NOT NULL, col200_203 FLOAT8 NOT NULL, col200_204 DECIMAL NOT NULL, col200_205 CHAR NOT NULL, col200_206 STRING, col200_207 BIT(47), col200_208 INTERVAL NOT NULL, col200_209 GEOMETRY, PRIMARY KEY (col200_203 DESC, col200_205, col200_202 ASC), col200_210 STRING NOT NULL AS (lower(CAST(col200_208 AS STRING))) STORED)",
		  |   "INSERT INTO public.table200 (col200_201,col200_202,col200_203,col200_204,col200_205,col200_206,col200_207,col200_208,col200_209,col200_210) VALUES (e'\\x19':::STRING,'2013-02-26 12:42:47.000976+00:00':::TIMESTAMPTZ,1.0:::FLOAT8,(-9.33306498518798062E+28):::DECIMAL,e'\\x16':::STRING,e'\\U00002603':::STRING,B'11000011100100100000111110010011010100001110000','79 years 2 mons 480 days 03:16:21.955576':::INTERVAL,'010400000008000000010100000034B820A9FC14EB416068E56DC860EBC10101000000D2496944763CF9412045FC241948BB4101010000002EC68228FFC2E4C198BAAC99BC4DFD410101000000881AF70F8AF4E041949E388DF61AF9C10101000000D6B518AA612101C212B18EDFFF84F0410101000000B0ACE690799DFC4150FC9CEEE0DEC641010100000084099CBC17A0014227CB3A38069AF4C101010000003478E6CDEA43E441EC47AB28CE030242':::GEOMETRY,'7}08}?':::STRING),('\"':::STRING,'2030-08-04 17:44:05.000207+00:00':::TIMESTAMPTZ,1.2058878173597278:::FLOAT8,(-64874416822702995.96):::DECIMAL,'-':::STRING,'f':::STRING,B'00000000000000000000000000000000000000000000000','-72 years -9 mons -822 days -06:40:31.589863':::INTERVAL,'0103000000010000000600000001F2753B5BF800C2D4EB2552B8B1F3C180AA380A86BBCB412A6BD52B6694F4C11837F55B2EB3D1C1F098FA2AF1CEE8419A220D043249EDC1F0BABC23AF9BF0415CDD996C0004FEC1484AD4190B0CFE4101F2753B5BF800C2D4EB2552B8B1F3C1':::GEOMETRY,e'\\'':::STRING),('q':::STRING,'1993-08-08 10:47:30.00021+00:00':::TIMESTAMPTZ,0.2042248312151529:::FLOAT8,(-3739.026122177823572):::DECIMAL,'V':::STRING,NULL,B'00000000000000000000000000000000000000000000000','-13 years -6 mons -950 days -10:30:53.55929':::INTERVAL,'01070000000300000001010000000000000000004440000000000000244001020000000300000000000000000024400000000000002440000000000000344000000000000034400000000000002440000000000000444001030000000100000004000000000000000000444000000000000044400000000000003440000000000080464000000000008046400000000000003E4000000000000044400000000000004440':::GEOMETRY,'':::STRING)"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col200_210\" (SQLSTATE 55000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@0ee391c3b96ba8695839ea60c45069bc771229b6:

		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP SCHEMA \"schema64\" CASCADE",
		  |   "CREATE SEQUENCE IF NOT EXISTS public.seq224",
		  |   "CREATE SCHEMA public AUTHORIZATION root"
		  |  ],
		  |  "expectedExecErrors": "42P06",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: schema \"public\" already exists (SQLSTATE 42P06)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:52:10.586635",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE INDEX \"IrrelevantName\" ON schema64.table226 (\"IrrelevantColumn\" ASC)"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema64.table226\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:52:10.538885",
		  |  "ops": [
		  |   "BEGIN",
		  |   "SELECT 'validating all objects'",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "",
		  |  "txStatus": "TxStatusCommitSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:52:10.385177",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP SCHEMA \"schema64\" CASCADE"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@cba235b11752e2f1e1c6dfee7ac55c514f4ea930:

		  |   "SELECT 'validating all objects'",
		  |   "CREATE VIEW schema14.view54 AS SELECT \"IrrelevantColumnName\" FROM schema51.table52"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema51.table52\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "11:20:51.078136",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP SCHEMA \"public\" CASCADE"
		  |  ],
		  |  "expectedExecErrors": "3F000",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "11:20:50.750939",
		  |  "ops": [
		  |   "BEGIN",
		  |   "SELECT 'validating all objects'",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "",
		  |  "txStatus": "TxStatusCommitSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "11:20:50.751505",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SEQUENCE IF NOT EXISTS public.seq13",
		  |   "CREATE SCHEMA IF NOT EXISTS schema40 AUTHORIZATION root",
		  |   "CREATE TABLE IF NOT EXISTS public.table55 (col55_56 GEOMETRY NULL, col55_57 STRING NULL, col55_58 BIT(26) NOT NULL, col55_59 OID NULL, PRIMARY KEY (col55_58), INVERTED INDEX (col55_59 ASC, col55_56), UNIQUE (col55_57, col55_58 ASC), INDEX (col55_57), UNIQUE (col55_57) STORING (col55_56, col55_59), INDEX (col55_58 ASC), INVERTED INDEX (col55_57 DESC, col55_59 ASC, col55_58, col55_56 DESC), INDEX (col55_59) STORING (col55_57))",
		  |   "INSERT INTO public.table55 (col55_56,col55_57,col55_58,col55_59) VALUES ('0105000000040000000102000000030000000024A7AC6F01F9418C700CE2A159E1C1C48C526071D3EB41E43DD239F3EEF641A6B838CEC9F9EAC12E8C71BA7D79F3410102000000070000006054FF3344E6B3C16F4A478B4B4D02C21026C0CBFB6DC0412773D2E65034F3C19C30B38AB12D0142905CBF4DE0B2C8C102BD3983AC2DF8414895C6C00BC8ED417C0AABBEFD08EA41208357DFEF33F241F0481BA86E41CE412CECB05E7F28E14100C7A048EB23894120BF40CB36B3D5410102000000040000004A16AA839F7CE8C17E39D149933EFDC1C00066176909AE41ACD3F9267F38FDC140A09377F97FC041D070937BBFEEE0C19019A4E99152F14114B77C4E2360EFC101020000000200000098D78A41FD65F141A0D2E74EAE30B7415045AE536535E7413813FD52D431F5C1':::GEOMETRY,'\"`':::STRING,B'10011000100000011110110111',1101205977:::OID)"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: geos: error during GEOS init: geos: cannot load GEOS from dir \"/usr/local/lib/cockroach\": geos error: /usr/local/lib/cockroach/libgeos.so: cannot open shared object file: No such file or directory (SQLSTATE XXUUU)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@8cdd17ff30a89b861a015a8f9d92da77ae781373:

		  |   "DROP VIEW public.view95"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.view95\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:57:34.395168",
		  |  "ops": [
		  |   "BEGIN",
		  |   "SELECT 'validating all objects'",
		  |   "DROP SCHEMA \"schema6\" CASCADE"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_PUSHER_ABORTED): \"sql txn\" meta={id=6c98c305 key=/Table/SystemConfigSpan/Start pri=0.00534980 epo=0 ts=1616237854.789836556,1 min=1616237854.395110479,0 seq=6} lock=true stat=ABORTED rts=1616237854.395110479,0 wto=false gul=1616237854.895110479,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:57:34.11772",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SCHEMA schema6 AUTHORIZATION root",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "",
		  |  "txStatus": "TxStatusCommitSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:57:34.262183",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TYPE public.enum74 AS ENUM ('ssf', 'sdd', 'dddsda')",
		  |   "CREATE TABLE public.table90 (col90_91 DECIMAL NOT NULL, col90_92 FLOAT4, PRIMARY KEY (col90_91), col90_93 FLOAT4 AS (col90_92 + 0.612314760684967:::FLOAT8) STORED, INDEX (col90_93, col90_92 DESC))",
		  |   "ALTER TABLE public.table90 ADD CONSTRAINT table90_col90_91_unique UNIQUE (col90_91)",
		  |   "ALTER TABLE public.table90 DROP COLUMN \"col90_92\""
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: column \"col90_92\" is referenced by computed column \"col90_93\" (SQLSTATE 42P10)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@2bdb62260a178e5bb63cf15f704944c5384f4347:

		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot publish new versions for descriptors: [{schemachange 52 1}], old versions still in use (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:55:05.212358",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SCHEMA schema67 AUTHORIZATION root",
		  |   "SELECT 'validating all objects'",
		  |   "CREATE TYPE public.enum92 AS ENUM ('sssda', 's', 'ddddd')",
		  |   "DROP SCHEMA \"public\" CASCADE"
		  |  ],
		  |  "expectedExecErrors": "3F000",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:55:05.191157",
		  |  "ops": [
		  |   "BEGIN",
		  |   "SELECT 'validating all objects'",
		  |   "ALTER TABLE schema14.table107 ALTER COLUMN \"IrrelevantColumnName\" DROP NOT NULL"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema14.table107\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | _elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
		  |     1.0s        0           29.3           33.0      8.9     88.1    176.2    176.2 opOk
		  |     1.0s        0            1.8            2.0    436.2    604.0    604.0    604.0 txnCmtErr
		  |     1.0s        0            1.8            2.0    159.4    209.7    209.7    209.7 txnOk
		  |     1.0s        0           18.7           21.0      1.1     13.1     79.7     79.7 txnRbk
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:55:05.658746",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SCHEMA IF NOT EXISTS schema75 AUTHORIZATION root"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@9ff77c449e4a4d24d36dc88f55830973815ce3d8:

		  |  "clientTimestamp": "11:00:18.948147",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TYPE schema120.enum435 AS ENUM ('f', 'fdsds', 'a')",
		  |   "CREATE TABLE schema6.table437 (col437_438 JSONB NOT NULL, col437_439 TIME NOT NULL, col437_440 STRING AS (lower(CAST(col437_438 AS STRING))) STORED, INVERTED INDEX (col437_438), INDEX (col437_439 DESC, col437_440 DESC) STORING (col437_438), INDEX (col437_439 ASC), UNIQUE (col437_439 DESC, col437_440 DESC) STORING (col437_438))",
		  |   "ALTER TABLE schema6.table437 DROP CONSTRAINT \"table437_col437_439_col437_440_key\""
		  |  ],
		  |  "expectedExecErrors": "0A000",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: cannot drop UNIQUE constraint \"table437_col437_439_col437_440_key\" using ALTER TABLE DROP CONSTRAINT, use DROP INDEX CASCADE instead (SQLSTATE 0A000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "11:00:19.981953",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TYPE schema441.enum442 AS ENUM ('sdassa', 'ss', 'f', 'aaff', 'fafsf', 'sdd')"
		  |  ],
		  |  "expectedExecErrors": "3F000",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema441.enum442\" because the target database or schema does not exist (SQLSTATE 3F000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "11:00:19.383935",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP INDEX schema120.table398@\"index398_445\" CASCADE"
		  |  ],
		  |  "expectedExecErrors": "42704",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: index \"index398_445\" does not exist (SQLSTATE 42704)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "11:00:19.7921",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP SCHEMA \"schema120\" CASCADE"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@23e7cb53bf5baede071832b59bd92ea8164531a6:

		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table51\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:59:07.842538",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SEQUENCE IF NOT EXISTS public.seq41",
		  |   "ALTER SEQUENCE public.seq41 RENAME TO public.seq49",
		  |   "CREATE TYPE public.enum50 AS ENUM ('ssdsd', 'dfdfss', 'dfadd', 'da', 'afadf', 'fddda')",
		  |   "CREATE TABLE IF NOT EXISTS schema53.table54 (col54_55 TIME NULL, col54_56 BOX2D NULL, col54_57 BYTES NOT NULL, col54_58 REGPROC, col54_59 JSONB NOT NULL, col54_60 REGTYPE NOT NULL, PRIMARY KEY (col54_57 ASC), INDEX (col54_55 ASC, col54_60 ASC), INDEX (col54_60 DESC, col54_56 ASC, col54_57 DESC, col54_58) STORING (col54_59), UNIQUE (col54_55 ASC) STORING (col54_56, col54_58, col54_60), INVERTED INDEX (col54_60, col54_56 ASC, col54_58 ASC, col54_57 DESC, col54_59 ASC), INDEX (col54_58 DESC, col54_56 DESC, col54_55 ASC) STORING (col54_59, col54_60), FAMILY (col54_57, col54_55, col54_60, col54_59, col54_56), FAMILY (col54_58))"
		  |  ],
		  |  "expectedExecErrors": "3F000",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema53.table54\" because the target database or schema does not exist (SQLSTATE 3F000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:59:07.841718",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE IF NOT EXISTS public.table2 (col2_3 REGPROCEDURE NOT NULL, col2_4 REGCLASS NOT NULL, col2_5 REGPROCEDURE NOT NULL, col2_6 TIMETZ NOT NULL, col2_7 GEOMETRY, col2_8 INT2 NOT NULL, PRIMARY KEY (col2_4 ASC, col2_6, col2_8 DESC, col2_5, col2_3 ASC), col2_9 STRING AS (lower(CAST(col2_5 AS STRING))) STORED, col2_10 STRING NOT NULL AS (lower(CAST(col2_3 AS STRING))) STORED, col2_11 STRING NOT NULL AS (lower(CAST(col2_7 AS STRING))) STORED, INVERTED INDEX (col2_7 DESC), INDEX (col2_6, col2_9 ASC, col2_10 ASC) STORING (col2_7, col2_11), INVERTED INDEX (col2_5 DESC, col2_11 ASC, col2_6 ASC, col2_9 DESC, col2_4 DESC, col2_10 DESC, col2_7), INDEX (col2_8 DESC, col2_5, col2_11 ASC, col2_3 DESC))",
		  |   "ALTER TABLE public.table2 ALTER COLUMN \"col2_3\" DROP DEFAULT",
		  |   "ALTER TABLE public.table2 ALTER COLUMN \"col2_11\" DROP STORED",
		  |   "SELECT 'validating all objects'",
		  |   "DROP TABLE public.table61 CASCADE"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table61\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:59:07.973352",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SCHEMA IF NOT EXISTS schema17 AUTHORIZATION root"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@da3c3dcccd18129bcd963eeca66bc063fc8b9756:

		  | }
		  |     2.0s        0           34.0           32.5     21.0    369.1    469.8    469.8 opOk
		  |     2.0s        0           10.0            6.5    872.4   1275.1   1275.1   1275.1 txnCmtErr
		  |     2.0s        0            1.0            1.0    570.4    570.4    570.4    570.4 txnOk
		  |     2.0s        0           16.0           18.5      1.9     14.2     14.2     14.2 txnRbk
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "11:16:33.308575",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP TABLE public.table3",
		  |   "CREATE TYPE schema98.enum156 AS ENUM ('f', 'adaddd')",
		  |   "DROP SCHEMA \"public\" CASCADE"
		  |  ],
		  |  "expectedExecErrors": "3F000",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "11:16:33.359268",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER TABLE public.table3 ADD CONSTRAINT table3_col3_5_table3_col3_5_fk FOREIGN KEY (col3_5) REFERENCES public.table3 (col3_5) ON DELETE CASCADE ON UPDATE CASCADE",
		  |   "ALTER TABLE public.table3 ADD COLUMN col3_158 NAME",
		  |   "CREATE VIEW public.view159 AS SELECT public.table3.col3_4, public.table3.col3_5 FROM public.table3",
		  |   "CREATE TABLE schema98.table160 AS SELECT public.table3.col3_5, public.table3.col3_4, public.table3.col3_5 FROM public.table3, public.table3"
		  |  ],
		  |  "expectedExecErrors": "42701,42712",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table3\" specified more than once (missing AS clause) (SQLSTATE 42712)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "11:16:33.466173",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER TABLE public.table3 ADD COLUMN col3_118 public.enum64 NOT NULL",
		  |   "INSERT INTO public.table3 (col3_4,col3_5) VALUES (e'\\'':::STRING,1194564275:::OID)",
		  |   "ALTER TABLE public.table3 RENAME TO public.table161"
		  |  ],
		  |  "expectedExecErrors": "0A000",
		  |  "expectedCommitErrors": "",
		  |  "message": "***FAIL; Failed to receive an execution error when errors were expected",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@f602e37e31a256980ae897917f45cba9c135b412:

		  |   "BEGIN",
		  |   "INSERT INTO schema207.table595 (IrrelevantColumnName) VALUES (\"IrrelevantValue\")"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema207.table595\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:56:28.627344",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER TABLE schema582.table632 DROP COLUMN \"IrrelevantColumnName\""
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema582.table632\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:56:28.104451",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP SEQUENCE IF EXISTS schema207.seq556",
		  |   "CREATE SEQUENCE IF NOT EXISTS schema207.seq663",
		  |   "DROP VIEW public.view664 CASCADE"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.view664\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:56:27.950262",
		  |  "ops": [
		  |   "BEGIN",
		  |   "SELECT 'validating all objects'",
		  |   "ALTER SEQUENCE schema207.seq556 RENAME TO schema207.seq649",
		  |   "ALTER SEQUENCE schema207.seq649 RENAME TO schema207.seq665"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@9caf4f8d29ed00aa01188a081465d9061c5fea64:

		  |   "CREATE TYPE public.enum211 AS ENUM ('aaad', 'afsfdf')",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=f8f453bd key=/Table/SystemConfigSpan/Start pri=0.03130999 epo=0 ts=1616842684.800140599,1 min=1616842684.714373055,0 seq=9} lock=true stat=PENDING rts=1616842684.714373055,0 wto=false gul=1616842685.214373055,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:58:04.605079",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP SEQUENCE IF EXISTS public.seq125",
		  |   "SELECT 'validating all objects'",
		  |   "CREATE INVERTED INDEX index160_212 ON schema27.table160 (col160_175 DESC, col160_161 ASC, col160_165 ASC, col160_164, col160_172 DESC, col160_163 DESC) STORING (col160_174)"
		  |  ],
		  |  "expectedExecErrors": "0A000,26000,42701",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: inverted indexes don't support stored columns (SQLSTATE 26000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:58:04.629142",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP SEQUENCE public.seq125",
		  |   "ALTER TABLE schema19.table214 ALTER COLUMN \"IrrelevantColumnName\" DROP DEFAULT"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema19.table214\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:58:04.225689",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP SCHEMA \"schema19\" CASCADE",
		  |   "CREATE SCHEMA schema213 AUTHORIZATION root"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@b886d8089334416b026391f2be76bc32e3a09b8a:

		  |   "CREATE TYPE schema38.enum164 AS ENUM ('dsssa', 'dds')",
		  |   "ALTER TABLE schema38.table165 ALTER COLUMN IrrelevantColumnName SET DATA TYPE IrrelevantDataType"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema38.table165\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "11:30:32.92543",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP SEQUENCE IF EXISTS public.seq103"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=46e374c8 key=/Table/SystemConfigSpan/Start pri=0.02416978 epo=0 ts=1617103833.633542842,1 min=1617103832.925371913,0 seq=6} lock=true stat=PENDING rts=1617103832.925371913,0 wto=false gul=1617103833.425371913,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "11:30:31.954395",
		  |  "ops": [
		  |   "BEGIN",
		  |   "SELECT 'validating all objects'",
		  |   "ALTER SEQUENCE public.seq6 RENAME TO public.seq103",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "",
		  |  "txStatus": "TxStatusCommitSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "11:30:32.751513",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE schema38.table145 (col145_146 INET NULL, col145_147 REGPROC NOT NULL, PRIMARY KEY (col145_147), UNIQUE (col145_146 DESC, col145_147 ASC), UNIQUE (col145_147 DESC), UNIQUE (col145_147 ASC, col145_146), INDEX (col145_146 DESC), UNIQUE (col145_146, col145_147), UNIQUE (col145_147 ASC, col145_146))",
		  |   "INSERT INTO schema38.table145 (col145_146,col145_147) VALUES ('257:b260:4f5b:7498:24c0:f080:c453:ecef/1':::INET,861558358:::OID)",
		  |   "ALTER TABLE schema38.table145 RENAME TO schema38.table166"
		  |  ],
		  |  "expectedExecErrors": "0A000",
		  |  "expectedCommitErrors": "",
		  |  "message": "***FAIL; Failed to receive an execution error when errors were expected",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@e6d07fa0b8fb13c447805709e2eadcceb783d661:

		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table127\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "11:23:39.066256",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE IF NOT EXISTS schema20.table114 (col114_115 INTERVAL NOT NULL, col114_116 INT8[] NOT NULL, col114_117 GEOGRAPHY NULL, col114_118 INT4 NULL, col114_119 GEOMETRY NOT NULL, col114_120 DECIMAL NOT NULL, col114_121 BOX2D NULL, col114_122 REGTYPE NULL, col114_123 INT4 NOT NULL, col114_124 INT4 NULL AS (col114_118 + col114_123) STORED, col114_125 STRING NULL AS (lower(CAST(col114_115 AS STRING))) VIRTUAL, col114_126 INT4 NULL AS (col114_118 + col114_123) VIRTUAL, FAMILY (col114_119, col114_115), FAMILY (col114_116), FAMILY (col114_121, col114_120, col114_124), FAMILY (col114_118), FAMILY (col114_122, col114_123), FAMILY (col114_117))",
		  |   "ALTER TABLE schema20.table128 RENAME TO schema20.table129"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema20.table128\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "11:23:38.697535",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE public.table23 (col23_24 NAME[] NULL, col23_25 FLOAT8, col23_26 TIMESTAMPTZ NOT NULL, col23_27 NAME[] NOT NULL, col23_28 BIT(35) NULL, col23_29 INT4 NOT NULL, FAMILY (col23_25, col23_28), FAMILY (col23_27), FAMILY (col23_29), FAMILY (col23_26), FAMILY (col23_24))",
		  |   "ALTER TABLE public.table23 ALTER COLUMN \"col23_26\" DROP DEFAULT",
		  |   "ALTER TABLE public.table23 RENAME COLUMN \"col23_25\" TO \"col23_113\"",
		  |   "DROP TABLE public.table23",
		  |   "SELECT 'validating all objects'",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=758ef2a9 key=/Table/SystemConfigSpan/Start pri=0.00268454 epo=0 ts=1617189819.201831098,1 min=1617189818.697462979,0 seq=32} lock=true stat=PENDING rts=1617189818.697462979,0 wto=false gul=1617189819.197462979,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "11:23:38.836335",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SCHEMA schema98 AUTHORIZATION root"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@eaa839f1da532d5b0076e1d32d202b9f620008cd:

		  |   "CREATE TYPE public.enum64 AS ENUM ('fda', 'afsf', 'fddds', 'ssa', 'sfaff')",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=5441d91d key=/Table/SystemConfigSpan/Start pri=0.03671953 epo=0 ts=1617360505.556261052,1 min=1617360505.555495575,0 seq=9} lock=true stat=PENDING rts=1617360505.555495575,0 wto=false gul=1617360506.055495575,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:48:25.556263",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TYPE public.enum17 AS ENUM ('aadd', 'dfs', 'a')",
		  |   "SELECT 'validating all objects'",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=089a0b65 key=/Table/SystemConfigSpan/Start pri=0.00967504 epo=0 ts=1617360505.556261052,1 min=1617360505.554557154,0 seq=9} lock=true stat=PENDING rts=1617360505.554557154,0 wto=false gul=1617360506.054557154,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:48:25.556191",
		  |  "ops": [
		  |   "BEGIN",
		  |   "SELECT 'validating all objects'",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "",
		  |  "txStatus": "TxStatusCommitSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:48:25.556239",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE IF NOT EXISTS public.table52 (col52_53 STRING NULL, col52_54 TIMESTAMP NOT NULL, col52_55 BYTES, col52_56 INT4 NOT NULL, col52_57 INT4 NOT NULL, col52_58 NAME NOT NULL, col52_59 INT4 NOT NULL, PRIMARY KEY (col52_57 ASC, col52_54 DESC, col52_58 ASC, col52_56 DESC, col52_59 ASC), col52_60 INT4 NOT NULL AS (col52_59 + 724185706:::INT8) VIRTUAL, col52_61 INT4 AS (col52_57 + 374878190:::INT8) VIRTUAL, col52_62 INT4 NOT NULL AS (col52_59 + col52_57) STORED, INDEX (col52_55 DESC, col52_53 DESC, col52_61 ASC, col52_54, col52_62, col52_60 DESC, col52_59, col52_57 ASC, col52_56 ASC, col52_58 ASC), INDEX (col52_61, col52_54 DESC, col52_57 DESC, col52_53, col52_58), INDEX (col52_58 DESC, col52_54 DESC, col52_55, col52_59 ASC), UNIQUE (col52_62, col52_53, col52_56 ASC, col52_59 ASC))",
		  |   "ALTER TABLE public.table52 ALTER COLUMN \"col52_61\" DROP STORED"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: column \"col52_61\" is not a stored computed column (SQLSTATE 42611)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@3fa241dd0d3aba2547e04ec5ef936315c0c5d3e1:

		  |  "workerId": 0,
		  |  "clientTimestamp": "10:52:21.455347",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE INDEX index245_256 ON public.table245 (col225_230 DESC, col225_231 DESC, col225_229 ASC, col225_228, col225_234 ASC, col225_233 ASC, col225_226 DESC, col225_232 ASC)"
		  |  ],
		  |  "expectedExecErrors": "0A000",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: column col225_228 is of type geography and thus is not indexable (SQLSTATE 0A000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:52:21.801352",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SCHEMA schema85 AUTHORIZATION root"
		  |  ],
		  |  "expectedExecErrors": "42P06",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: schema \"schema85\" already exists (SQLSTATE 42P06)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:52:21.678402",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE public.table251 AS SELECT public.table245.col225_234, public.table245.col225_231, public.table245.col225_233 FROM public.table245",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=70dd4405 key=/Table/SystemConfigSpan/Start pri=0.00361702 epo=0 ts=1617706341.763635681,1 min=1617706341.678305074,0 seq=7} lock=true stat=PENDING rts=1617706341.678305074,0 wto=false gul=1617706342.178305074,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:52:21.576978",
		  |  "ops": [
		  |   "BEGIN",
		  |   "INSERT INTO public.table245 (col225_226,col225_227,col225_228,col225_229,col225_230,col225_231,col225_232,col225_233,col225_234) VALUES (0.562847775855677373:::DECIMAL,e'x`\\x19w':::STRING,'0104000020E61000000A00000001010000000018F0811ED9294072E28FB4F3AC414001010000005013FEA3EC2B244010984394A17E24C001010000009048B5DC5B003BC06A86B5853F9949C00101000000484BABCF8D06484044353F20A21236C0010100000034495DCBCA546440346226E5E6B644400101000000F0916590749B49C0C25A97C7DE114DC00101000000D035427CBDC050409594E7F0814D53C0010100000079161191DE2452C04023ED63BD3EFDBF0101000000C4ABA83062E265C024845F08954630C001010000008BC40E369D8D50C05A5F6DC1D38650C0':::GEOGRAPHY,0:::OID,8904841029147907662:::INT8,(-9.028555896721637784E+36):::DECIMAL,'{d':::STRING,'':::STRING,e'}J\\x01~\\x1f=\\x01K':::STRING),(824479259430.7647531:::DECIMAL,e'\\x011]':::STRING,'0102000020E61000000600000038B0980A71754E40E0B32DFF57A74DC0C6B6DE0D37B5524009080565112E41C0B807B207C549444030DC40E2BCC035C0A65F768649DE6140A49CDFA5864338C0E0B4526FDC9738C0DA77F610C64E534012345D68D2E05BC000F083E589304440':::GEOGRAPHY,598744511:::OID,5641588138478850456:::INT8,(-5575560124262447478):::DECIMAL,e'HM\\t\\x02\\x1fi':::STRING,e'\"\\x17\\f8\\x12\\x1fd,v':::STRING,NULL),(0.03510320269760147122:::DECIMAL,'':::STRING,'0103000020E6100000010000000B0000004D922D7FB87F5DC01C1E1171F0243140E24CE12669D663C0F891B12F9E522A405C20816D5E4058C0A0383660035F18C022DCDD0E0BFA6140EA5BD4001FF150C0709C3D5E73DD5640C00078B4E65CF63FBC5B6A3F30DB5740A4CCFEEBFAE43540F470499BF76D474026070FB29D89414040722513631E6040F2F26D73FEE2554058264BC364D94340162E32F3531B52409BC2C11BD50757C0AE4815214E8552404D922D7FB87F5DC01C1E1171F0243140':::GEOGRAPHY,3969997303:::OID,(-5478560789930577103):::INT8,(-398.9410703302834939):::DECIMAL,e'\\x1a':::STRING,'0XX':::STRING,e'8\\x06\\x1f':::STRING)"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col225_231\" (SQLSTATE 55000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@389cbd4be0e9ce22ca7789cd61802f1f90392c97:

		  |  "clientTimestamp": "10:06:02.780839",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP TABLE public.table64 CASCADE",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=ae2b9592 key=/Table/SystemConfigSpan/Start pri=0.03063045 epo=0 ts=1617876363.905683898,1 min=1617876362.780775849,0 seq=11} lock=true stat=PENDING rts=1617876362.780775849,0 wto=false gul=1617876363.280775849,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:06:03.481844",
		  |  "ops": [
		  |   "BEGIN",
		  |   "INSERT INTO public.table82 (IrrelevantColumnName) VALUES (\"IrrelevantValue\")"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table82\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:06:03.178862",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER TABLE public.table64 ADD CONSTRAINT table64_col64_66_unique UNIQUE (col64_66)",
		  |   "ALTER TABLE public.table64 ALTER COLUMN \"col64_94\" DROP DEFAULT"
		  |  ],
		  |  "expectedExecErrors": "42703",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col64_94\" does not exist (SQLSTATE 42703)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:06:03.619371",
		  |  "ops": [
		  |   "BEGIN",
		  |   "INSERT INTO public.table64 (col64_65,col64_66,col64_67,col64_68,col64_69,col64_70,col64_71,col64_72,col64_73,col64_74) VALUES (true,'b424c23d-f56d-41f7-a4c7-184ef41d65ce':::UUID,'BOX(-0.10830329771289553 -0.4358103719711985,0.5000874146986246 1.1031041672191104)':::BOX2D,'0103000000010000000C0000004238765C7FC7FDC138CA3DFC4371D6C140EFA81BE527DA41C0D672D462D1ECC1AC0D0DC12ACDE14140EDC4EFB37EB9418E9394F58D860042BD2B9C1D81EDF9C10449B6CE612AFF4170791E78D6E5C9C14C2153AA2B58FF4198CC1309E32BD341ACBFCF6C8C7EED4130299B54C040D841485DD9F4E6FCF2410470CFF1E5F5E9410C0CB7221DF2E241DEBE51413670F9419002B1CE8A6FD041F4DA2CC723D3F04106210B31C4F6FBC1C0BE8ED2D57F02424238765C7FC7FDC138CA3DFC4371D6C1':::GEOMETRY,1140941206:::OID,B'10011010010010110111','2006-07-13 06:49:07.000685':::TIMESTAMP,ARRAY[]:::BOX2D[],e'\\x11':::STRING,e'o`\\n':::STRING)"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col64_73\" (SQLSTATE 55000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@80709778b7c7de7b2b704972197022305bb3ca12:

		  |   "BEGIN",
		  |   "CREATE TABLE IF NOT EXISTS public.table4 (col4_5 REGNAMESPACE NOT NULL, col4_6 DECIMAL NOT NULL, col4_7 BIT(44) NOT NULL, col4_8 OID NOT NULL, col4_9 GEOMETRY NULL, col4_10 BIT(35) NOT NULL, col4_11 STRING NOT NULL, col4_12 GEOGRAPHY NOT NULL, col4_13 \"char\" NOT NULL, col4_14 INT2 NOT NULL, col4_15 STRING AS (lower(col4_11)) STORED, col4_16 STRING AS (lower(col4_13)) STORED, INDEX (col4_13 DESC, col4_16 ASC) STORING (col4_5, col4_8, col4_9, col4_11), INVERTED INDEX (col4_11, col4_15 DESC, col4_6 DESC, col4_10, col4_5 ASC, col4_12 DESC), FAMILY (col4_16), FAMILY (col4_5, col4_14), FAMILY (col4_12, col4_9, col4_11), FAMILY (col4_7, col4_15), FAMILY (col4_8, col4_6, col4_10, col4_13))",
		  |   "ALTER TABLE public.table4 ALTER COLUMN \"col4_7\" DROP STORED"
		  |  ],
		  |  "expectedExecErrors": "42611",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col4_7\" is not a computed column (SQLSTATE 42611)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "23:30:41.135378",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SEQUENCE IF NOT EXISTS public.seq38",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=01742307 key=/Table/SystemConfigSpan/Start pri=0.00478067 epo=0 ts=1617924641.135808279,1 min=1617924641.135302998,0 seq=8} lock=true stat=PENDING rts=1617924641.135302998,0 wto=false gul=1617924641.635302998,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "23:30:41.135124",
		  |  "ops": [
		  |   "BEGIN",
		  |   "SELECT 'validating all objects'",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "",
		  |  "txStatus": "TxStatusCommitSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "23:30:41.134642",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE public.table19 (col19_20 TIME, col19_21 UUID NOT NULL, col19_22 BOOL NOT NULL, col19_23 OID NOT NULL, col19_24 GEOMETRY NOT NULL, col19_25 INET NULL, col19_26 JSONB, col19_27 REGNAMESPACE NOT NULL, col19_28 BIT(23) NULL, col19_29 BIT(35) NOT NULL, col19_30 FLOAT4 NULL, col19_31 DATE, col19_32 JSONB, col19_33 STRING NULL AS (lower(CAST(col19_27 AS STRING))) VIRTUAL, FAMILY (col19_29), FAMILY (col19_25, col19_28, col19_21, col19_22), FAMILY (col19_20), FAMILY (col19_32, col19_26, col19_24), FAMILY (col19_27), FAMILY (col19_23), FAMILY (col19_31, col19_30))",
		  |   "CREATE UNIQUE INDEX index19_39 ON public.table19 (col19_30) STORING (col19_33, col19_22, col19_27, col19_29, col19_23, col19_25, col19_24, col19_28, col19_20)"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"table19\" (55): index \"index19_39\" cannot store virtual column \"col19_33\" (SQLSTATE XXUUU)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@69122e0b458d473d62a7bf3e3b8dbb40162fc005:

		  |  "clientTimestamp": "23:18:08.89294",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER TABLE schema14.table485 DROP CONSTRAINT IrrelevantConstraintName"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema14.table485\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "23:18:08.453277",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TYPE schema14.enum483 AS ENUM ('sf', 'faf', 'sfdf')",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=9bef7428 key=/Table/SystemConfigSpan/Start pri=0.00276193 epo=0 ts=1618010288.902556218,1 min=1618010288.453204217,0 seq=9} lock=true stat=PENDING rts=1618010288.453204217,0 wto=false gul=1618010288.953204217,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "23:18:08.690022",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER SEQUENCE public.seq355 RENAME TO public.seq486",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=47e84ce9 key=/Table/SystemConfigSpan/Start pri=0.02468880 epo=0 ts=1618010288.902556218,1 min=1618010288.689909494,0 seq=12} lock=true stat=PENDING rts=1618010288.689909494,0 wto=false gul=1618010289.189909494,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "23:18:08.924765",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP SCHEMA \"schema208\" CASCADE"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@5323c44e1c3d3d9ded95a9f20be5ba738cd542ec:

		  |  "expectedExecErrors": "42602",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot change schema of table with RENAME (SQLSTATE 42602)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "23:44:37.080184",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SCHEMA IF NOT EXISTS schema1 AUTHORIZATION root",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "",
		  |  "txStatus": "TxStatusCommitSuccess"
		  | }
		  | _elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
		  |     1.0s        0           26.9           30.0      7.9     88.1     88.1     88.1 opOk
		  |     1.0s        0            2.7            3.0    486.5    486.5    486.5    486.5 txnCmtErr
		  |     1.0s        0            4.5            5.0    335.5    939.5    939.5    939.5 txnOk
		  |     1.0s        0           16.1           18.0      4.7     48.2    109.1    109.1 txnRbk
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "23:44:37.238165",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER TABLE public.table29 RENAME COLUMN \"col29_41\" TO \"col29_55\"",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "",
		  |  "txStatus": "TxStatusCommitSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "23:44:37.788257",
		  |  "ops": [
		  |   "BEGIN",
		  |   "INSERT INTO public.table29 (col29_30,col29_31,col29_32,col29_33,col29_34,col29_35,col29_36,col29_37,col29_38,col29_39,col29_40,col29_55,col29_42,col29_43,col29_44,col29_45) VALUES ('y':::STRING,B'11111101000010001001',e'[[[], false, \"qjL[p!/H=\"], \"N3K\\\\\"KbH#\", [{}, null], [0.20660057286475353], \"foo\"]':::JSONB,'15:16:10.530297':::TIME,e'\\'\\x19\\\\':::STRING,0:::OID,'c9a4:d8b9:b825:47dd:cbb2:9d78:d3e4:69c3/66':::INET,(-90871031):::INT8,'-4':::STRING,2754949964:::OID,570260786.1134044434:::DECIMAL,(-1430293264):::INT8,8.073379844686396269E+37:::DECIMAL,'\u003c':::STRING,e'a[\\x13':::STRING,'FRkhtymZ':::STRING)"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col29_55\" (SQLSTATE 55000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity
Copy link
Member Author

(roachtest).schemachange/random-load failed on release-21.1@8f66611a35da94ccdd98103dc7e7f3b694c3e8f2:

		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=33f56982 key=/Table/SystemConfigSpan/Start pri=0.00743433 epo=0 ts=1618269445.115755331,1 min=1618269444.611451274,0 seq=26} lock=true stat=PENDING rts=1618269444.611451274,0 wto=false gul=1618269445.111451274,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "23:17:24.803551",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER TABLE public.table42 ALTER COLUMN \"col42_50\" DROP NOT NULL",
		  |   "CREATE TABLE public.table161 AS SELECT public.table161.col161_167, public.table161.col161_175, public.table161.col161_172, public.table161.col161_166, public.table161.col161_177, public.table161.col161_163, public.table161.col161_171, public.table161.col161_169, public.table161.col161_176, public.table161.col161_165, public.table161.col161_168, public.table42.col42_56, public.table42.col42_51, public.table42.col42_52, public.table42.col42_60, public.table42.col42_46, public.table42.col42_49, public.table42.col42_45, public.table42.col42_44, public.table42.col42_59, public.table42.col42_47, public.table42.col42_54, public.table42.col42_43, public.table42.col42_50, public.table42.col42_58, public.table42.col42_53 FROM public.table161, public.table42"
		  |  ],
		  |  "expectedExecErrors": "42P07",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schemachange.public.table161\" already exists (SQLSTATE 42P07)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "23:17:24.927107",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE schema197.table239 AS SELECT public.table42.col42_43, public.table42.col42_50, public.table42.col42_53, public.table42.col42_47, public.table42.col42_61, public.table42.col42_58, public.table42.col42_59, public.table42.col42_44, public.table42.col42_55, public.table42.col42_56, public.table42.col42_52, public.table42.col42_51, public.table42.col42_46, public.table161.col161_179, public.table161.col161_163, public.table161.col161_164, public.table161.col161_180, public.table161.col161_172, public.table161.col161_178, public.table161.col161_168 FROM public.table42, public.table161",
		  |   "ALTER TABLE public.table42 ADD CONSTRAINT table42_col42_52_unique UNIQUE (col42_52)",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=f1099aef key=/Table/SystemConfigSpan/Start pri=0.02470957 epo=0 ts=1618269445.115755331,1 min=1618269444.927040633,0 seq=18} lock=true stat=PENDING rts=1618269444.927040633,0 wto=false gul=1618269445.427040633,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  |     5.0s        0           32.0           27.0     16.8   1342.2   1476.4   1476.4 opOk
		  |     5.0s        0           11.0            6.4   1342.2   2415.9   2550.1   2550.1 txnCmtErr
		  |     5.0s        0            1.0            1.0    251.7    251.7    251.7    251.7 txnOk
		  |     5.0s        0            8.0           14.0      1.0      2.6      2.6      2.6 txnRbk
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "23:17:25.503382",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SCHEMA IF NOT EXISTS schema245 AUTHORIZATION root"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
More

Artifacts: /schemachange/random-load
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity cockroach-teamcity mentioned this issue Apr 13, 2021
Closed
@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/random-load failed with artifacts on release-21.1 @ f60fbf28b0bb6110cf9870cc398ea169b81ff8f0:

		  |   "CREATE TYPE schema1.enum214 AS ENUM ('ddsd', 'f', 'sasafs')",
		  |   "DROP SCHEMA \"public\" CASCADE"
		  |  ],
		  |  "expectedExecErrors": "3F000",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:04:01.735987",
		  |  "ops": [
		  |   "BEGIN",
		  |   "SELECT 'validating all objects'",
		  |   "CREATE TABLE schema1.table149 (col149_150 FLOAT8 NOT NULL, col149_151 INT2 NOT NULL, col149_152 \"char\" NOT NULL, col149_153 DATE NOT NULL, col149_154 \"char\" NOT NULL, col149_155 TIMESTAMPTZ NOT NULL, col149_156 REGTYPE NOT NULL, col149_157 REGPROCEDURE NOT NULL, col149_158 INTERVAL NOT NULL, PRIMARY KEY (col149_151 ASC, col149_157, col149_156, col149_152 DESC, col149_158, col149_154 ASC, col149_150 ASC, col149_155 ASC), col149_159 STRING NULL AS (lower(col149_152)) VIRTUAL, col149_160 STRING NOT NULL AS (CASE WHEN col149_155 IS NULL THEN e'^\\x17\\x0b|O':::STRING ELSE e'\\'eQ{{v=':::STRING END) VIRTUAL, col149_161 INT2 NULL AS (col149_151 + 23029:::INT8) STORED, INDEX (col149_158 ASC, col149_152 DESC, col149_159 DESC, col149_160 ASC, col149_157 ASC, col149_153 DESC, col149_161 ASC, col149_156 DESC, col149_150 DESC, col149_151), UNIQUE (col149_157 ASC, col149_156 DESC, col149_151, col149_159 ASC, col149_160, col149_155 ASC), UNIQUE (col149_155 ASC, col149_153, col149_160), INDEX (col149_151 ASC, col149_153 ASC, col149_150 DESC, col149_154, col149_152, col149_158, col149_159 DESC), INDEX (col149_150, col149_159 DESC, col149_156 ASC, col149_157, col149_154 ASC, col149_153 DESC, col149_161, col149_152 DESC, col149_158 ASC, col149_155 ASC), UNIQUE (col149_152 DESC, col149_160), FAMILY (col149_150, col149_156, col149_154), FAMILY (col149_152), FAMILY (col149_155, col149_158), FAMILY (col149_151, col149_157, col149_153, col149_161))",
		  |   "DROP SEQUENCE IF EXISTS public.seq31"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_PUSHER_ABORTED): \"sql txn\" meta={id=78ecfaf9 key=/Table/SystemConfigSpan/Start pri=0.01047798 epo=0 ts=1624442642.117195554,1 min=1624442641.735918072,0 seq=12} lock=true stat=ABORTED rts=1624442641.735918072,0 wto=false gul=1624442642.235918072,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:04:01.722008",
		  |  "ops": [
		  |   "BEGIN",
		  |   "SELECT 'validating all objects'",
		  |   "CREATE SCHEMA schema211 AUTHORIZATION root",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=911f6913 key=/Table/SystemConfigSpan/Start pri=0.00812002 epo=0 ts=1624442642.421897053,1 min=1624442641.721946558,0 seq=13} lock=true stat=PENDING rts=1624442641.721946558,0 wto=false gul=1624442642.221946558,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:04:01.967177",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER SEQUENCE public.seq31 RENAME TO public.seq181"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: 

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh schemachange/random-load

Same failure on other branches

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/random-load failed with artifacts on release-21.1 @ 92e342b8f0032a5771d3e50932df4c6d7d85fe41:

		  |   "ALTER TABLE schema44.table182 ALTER COLUMN IrrelevantColumnName SET DEFAULT \"IrrelevantValue\""
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema44.table182\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "09:32:43.360208",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER TABLE schema7.table132 RENAME TO schema7.table192"
		  |  ],
		  |  "expectedExecErrors": "2BP01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot rename relation \"schema7.table132\" because view \"view166\" depends on it (SQLSTATE 2BP01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  |     2.0s        0           33.0           34.5     10.5    503.3    771.8    771.8 opOk
		  |     2.0s        0            6.0            5.5    520.1   1610.6   1610.6   1610.6 txnCmtErr
		  |     2.0s        0            3.0            4.5    906.0    906.0    906.0    906.0 txnOk
		  |     2.0s        0           19.0           19.5      2.2    436.2    520.1    520.1 txnRbk
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "09:32:43.594778",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TYPE schema44.enum183 AS ENUM ('fsfd', 'fsafff', 'sdsd', 'ass')",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=9cfb45a5 key=/Table/SystemConfigSpan/Start pri=0.02872194 epo=0 ts=1624527163.785719325,1 min=1624527163.594711672,0 seq=9} lock=true stat=PENDING rts=1624527163.594711672,0 wto=false gul=1624527164.094711672,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "09:32:43.651306",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER TABLE schema7.table132 ADD CONSTRAINT table132_col132_135_unique UNIQUE (col132_135)"
		  |  ],
		  |  "expectedExecErrors": "42710",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: duplicate index name: \"table132_col132_135_unique\" (SQLSTATE 42P07)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: 

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh schemachange/random-load

Same failure on other branches

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/random-load failed with artifacts on release-21.1 @ c38781390f0d07cf3d39d1af9ed01b4e370aaffa:

		  |   "ALTER TABLE public.table127 ADD COLUMN col127_202 REGPROCEDURE",
		  |   "ALTER TABLE public.table127 RENAME COLUMN \"col127_128\" TO \"col127_217\"",
		  |   "ALTER TABLE public.table127 ADD COLUMN col127_218 NAME NOT NULL",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=fb903aef key=/Table/SystemConfigSpan/Start pri=0.00353125 epo=0 ts=1624704294.997465594,1 min=1624704294.547310212,0 seq=27} lock=true stat=PENDING rts=1624704294.547310212,0 wto=false gul=1624704295.047310212,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:44:54.832121",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER TABLE public.table127 ADD CONSTRAINT table127_col127_129_unique UNIQUE (col127_129)",
		  |   "CREATE VIEW schema31.view220 AS SELECT public.table127.col127_128, public.table127.col127_129, public.table127.col127_128 FROM public.table127, public.table127"
		  |  ],
		  |  "expectedExecErrors": "42701,42712",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table127\" specified more than once (missing AS clause) (SQLSTATE 42712)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:44:54.656064",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER TABLE public.table127 ALTER COLUMN col127_128 SET DEFAULT '01:12:40.326872':::TIME",
		  |   "DROP SCHEMA \"public\" CASCADE"
		  |  ],
		  |  "expectedExecErrors": "3F000",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:44:54.831559",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP SEQUENCE public.seq165"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: 

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh schemachange/random-load

Same failure on other branches

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/random-load failed with artifacts on release-21.1 @ ede1628bd625a07b3f966a36ea841009803fc8a9:

		  | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column "col28_39" (SQLSTATE 55000)
		  | Error: COMMAND_PROBLEM: exit status 1
		  | (1) COMMAND_PROBLEM
		  | Wraps: (2) Node 1. Command with error:
		  |   | ``````
		  |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 5000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
		  |   | ``````
		  | Wraps: (3) exit status 1
		  | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
		  |
		  | stdout:
		  | <... some data truncated by circular buffer; go to artifacts for details ...>
		  | 20_23 ASC) STORING (col20_24), INDEX (col20_23) STORING (col20_24), FAMILY (col20_22), FAMILY (col20_21), FAMILY (col20_23, col20_24))",
		  |   "ALTER TABLE public.table20 ALTER COLUMN \"col20_24\" SET NOT NULL",
		  |   "ALTER TABLE public.table20 ALTER COLUMN \"col20_48\" SET DATA TYPE IrrelevantTypeName"
		  |  ],
		  |  "expectedExecErrors": "42703",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col20_48\" does not exist (SQLSTATE 42703)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:12:34.681838",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE IF NOT EXISTS schema52.table53 (col53_54 TIMESTAMPTZ NULL, col53_55 BOX2D NULL, col53_56 TIMETZ NOT NULL, col53_57 INT2 NULL, col53_58 INTERVAL NOT NULL, col53_59 REGPROC NULL, col53_60 UUID NULL, col53_61 GEOMETRY NOT NULL, col53_62 STRING NOT NULL AS (lower(CAST(col53_61 AS STRING))) VIRTUAL, col53_63 STRING AS (lower(CAST(col53_60 AS STRING))) STORED, UNIQUE (col53_54, col53_62) STORING (col53_59, col53_61, col53_63), FAMILY (col53_54), FAMILY (col53_57), FAMILY (col53_55), FAMILY (col53_60, col53_61, col53_63, col53_56, col53_58), FAMILY (col53_59))"
		  |  ],
		  |  "expectedExecErrors": "3F000",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema52.table53\" because the target database or schema does not exist (SQLSTATE 3F000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:12:34.682976",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SCHEMA IF NOT EXISTS schema14 AUTHORIZATION root",
		  |   "CREATE TABLE IF NOT EXISTS schema14.table28 (col28_29 REGTYPE NOT NULL, col28_30 TIMESTAMPTZ NULL, col28_31 NAME NOT NULL, col28_32 INT2 NULL, col28_33 BIT(10)[], col28_34 INET NOT NULL, col28_35 STRING NULL, col28_36 INTERVAL, col28_37 DATE, col28_38 INTERVAL, PRIMARY KEY (col28_34 ASC, col28_29 DESC, col28_31 DESC), col28_39 STRING NULL AS (CASE WHEN col28_30 IS NULL THEN 'VTf':::STRING ELSE '@O':::STRING END) STORED, col28_40 STRING AS (CASE WHEN col28_33 IS NULL THEN '*c_;@:':::STRING ELSE NULL END) STORED, col28_41 STRING AS (lower(col28_31)) VIRTUAL, col28_42 STRING AS (lower(CAST(col28_29 AS STRING))) STORED, col28_43 STRING NULL AS (CASE WHEN col28_33 IS NULL THEN NULL ELSE NULL END) STORED, UNIQUE (col28_40 ASC, col28_34, col28_42 DESC, col28_29 ASC, col28_30, col28_35 ASC, col28_37, col28_39 DESC, col28_31 DESC, col28_43 ASC, col28_41, col28_38 DESC, col28_32) STORING (col28_33, col28_36), INDEX (col28_43 ASC, col28_38 DESC), UNIQUE (col28_34 ASC, col28_35 DESC, col28_38, col28_37), FAMILY (col28_42), FAMILY (col28_34), FAMILY (col28_43), FAMILY (col28_38, col28_39), FAMILY (col28_33), FAMILY (col28_30, col28_29, col28_37, col28_35), FAMILY (col28_40), FAMILY (col28_36), FAMILY (col28_32, col28_31))",
		  |   "ALTER TABLE schema14.table28 RENAME TO schema14.table28",
		  |   "INSERT INTO schema14.table28 (col28_29,col28_30,col28_31,col28_32,col28_33,col28_34,col28_35,col28_36,col28_37,col28_38,col28_39,col28_40,col28_41,col28_42,col28_43) VALUES (2089524543:::OID,'2031-09-06 02:41:17.000905+00:00':::TIMESTAMPTZ,e'\\x0e\u003e+y\\\\pI':::STRING:::NAME,13758:::INT8,ARRAY[]:::BIT(10)[],'c16:95ce:f5f5:d0b:1c27:6a2b:8553:e0aa/3':::INET,'_z':::STRING,'54 years 3 mons 360 days 20:28:02.983974':::INTERVAL,'1978-03-02':::DATE,NULL,e'R\\x0f':::STRING,e'E\\x14PES\\x11\\x06F':::STRING,e'a0*U\"A\\x7f.':::STRING,'mY[':::STRING,e'Y\\x1eW\\x12\\f':::STRING),(3007974266:::OID,'2016-07-13 21:17:20.000362+00:00':::TIMESTAMPTZ,e'\u003e%\\x0f,5 vc':::STRING:::NAME,(-14457):::INT8,ARRAY[B'0110011001'],'153.18.122.121/0':::INET,'\u0026N$!':::STRING,'-68 years -6 mons -279 days -22:36:17.885882':::INTERVAL,'1996-11-01':::DATE,NULL,'':::STRING,NULL,e'sUnym5\\x16':::STRING,'6fQ':::STRING,e'OT\\x11C7v(\\r':::STRING)"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col28_39\" (SQLSTATE 55000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: 

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh schemachange/random-load

Same failure on other branches

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/random-load failed with artifacts on release-21.1 @ db3cdb8913ba56599cc52766411893438b5c4b54:

		  |   "BEGIN",
		  |   "CREATE SEQUENCE IF NOT EXISTS public.seq8",
		  |   "CREATE TABLE public.table46 (col46_47 INET, col46_48 TIME NULL, col46_49 BIT(6) NOT NULL, col46_50 DECIMAL NOT NULL, col46_51 CHAR NOT NULL, col46_52 UUID NOT NULL, col46_53 TIMESTAMP NOT NULL, col46_54 REGCLASS NOT NULL, PRIMARY KEY (col46_54 ASC, col46_51, col46_49 ASC, col46_53 DESC, col46_52, col46_50 DESC), UNIQUE (col46_52 ASC, col46_48 ASC, col46_54, col46_47, col46_53 ASC, col46_50, col46_49), INDEX (col46_49, col46_48, col46_50, col46_51 ASC, col46_52, col46_53, col46_54 ASC, col46_47 ASC))",
		  |   "CREATE INDEX IF NOT EXISTS index46_59 ON public.table46 (col46_50 ASC, col46_47 DESC) STORING (col46_53, col46_52, col46_51)"
		  |  ],
		  |  "expectedExecErrors": "42701",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: index \"index46_59\" already contains column \"col46_53\" (SQLSTATE 42701)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:00:43.304383",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER TABLE schema60.table61 ALTER COLUMN IrrelevantColumnName DROP STORED"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema60.table61\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:00:43.302903",
		  |  "ops": [
		  |   "BEGIN",
		  |   "SELECT 'validating all objects'",
		  |   "CREATE TABLE public.table28 (col28_29 TIMESTAMP, col28_30 DECIMAL[] NULL, col28_31 TIMESTAMP, col28_32 REGCLASS, col28_33 DECIMAL NOT NULL, col28_34 GEOMETRY NOT NULL, col28_35 BIT(12) NOT NULL, col28_36 GEOMETRY NULL, col28_37 GEOMETRY NOT NULL, col28_38 STRING NULL AS (lower(CAST(col28_31 AS STRING))) STORED, col28_39 STRING NOT NULL AS (lower(CAST(col28_36 AS STRING))) VIRTUAL, col28_40 STRING AS (lower(CAST(col28_34 AS STRING))) STORED, col28_41 STRING AS (CASE WHEN col28_30 IS NULL THEN 'ahv7':::STRING ELSE e'\\x1cMT5(':::STRING END) STORED, col28_42 STRING NOT NULL AS (lower(CAST(col28_37 AS STRING))) VIRTUAL, col28_43 DECIMAL NOT NULL AS (col28_33 + (-5.186861486395322856E+19):::DECIMAL) STORED)",
		  |   "CREATE VIEW public.view62 AS SELECT public.table28.col28_31, public.table28.col28_42, public.table28.col28_32, public.table28.col28_34 FROM public.table28, public.table28"
		  |  ],
		  |  "expectedExecErrors": "42712",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table28\" specified more than once (missing AS clause) (SQLSTATE 42712)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:00:43.306008",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SCHEMA IF NOT EXISTS schema2 AUTHORIZATION root"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: 

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh schemachange/random-load

Same failure on other branches

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/random-load failed with artifacts on release-21.1 @ 5e8abbb1796889f75550fef774632b1bb2dfa87b:

The test failed on branch=release-21.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/schemachange/random-load/run_1
	schemachange_random_load.go:145,schemachange_random_load.go:43,test_runner.go:730: output in run_100946.048_n1_workload_run_schemachange: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-3144427-1625206284-63-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 5000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned: exit status 20
		(1) attached stack trace
		  -- stack trace:
		  | main.(*cluster).RunE
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2332
		  | main.runSchemaChangeRandomLoad
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:142
		  | main.registerSchemaChangeRandomLoad.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/schemachange_random_load.go:43
		  | main.(*testRunner).runTest.func2
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:730
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1371
		Wraps: (2) output in run_100946.048_n1_workload_run_schemachange
		Wraps: (3) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-3144427-1625206284-63-n3cpu4:1 -- ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 5000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json returned
		  | stderr:
		  | I210702 10:09:46.648326 1 workload/cli/run.go:361  [-] 1  creating load generator...
		  | I210702 10:09:46.748810 1 workload/cli/run.go:392  [-] 2  creating load generator... done (took 100.481659ms)
		  | Error: ***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column "col230_245" (SQLSTATE 55000)
		  | Error: COMMAND_PROBLEM: exit status 1
		  | (1) COMMAND_PROBLEM
		  | Wraps: (2) Node 1. Command with error:
		  |   | ``````
		  |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 5000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
		  |   | ``````
		  | Wraps: (3) exit status 1
		  | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
		  |
		  | stdout:
		  | <... some data truncated by circular buffer; go to artifacts for details ...>
		  | 0000007AC3E96AA555AC0B885C68792F421C08695D70DA6805CC03722C05A55F844C018E902F2D4A13CC0DECF9275C91042C0F078A9A8AE38284058FC7FB2681A2FC0E04DA9EA79912D4098BA0453A52C22C060597FE8D9F32FC0881062932C294340E887D4A93D4237C0AC55AC70213E4B40E0B1001FAED45FC0CCE49006E08853404A49DB1F0ECA61C02CA84FF7634A52401C20ED88982759C0706D9A185AD13040A8EA082D8B3366C070044B61CCB8304007AC3E96AA555AC0B885C68792F421C00102000020E610000003000000B089B374C64233C0C0960BDFBC5C15C0AE78BE9F016F6140E0EDBA91E5BA1540440B4FAE8A86624008A2ECF8757F4F400101000020E610000050EB88A6DF5B39C00C872076FDDC3EC00104000020E6100000080000000101000000B0BC063D95115440580E3486F2C94740010100000041BF8079C63C63C0546BE99B73F34E4001010000006879732C4FA85F4050A62E281CD5434001010000000053628323CBE53F06F44B86816851C00101000000D8A0301CF47359406847794004322140010100000080F3FEF65AF14F400C391B8E5B59484001010000009002D40A449639C09823D973EE822E4001010000001A2231DC41E7624094C3D8CCB7F252C00101000020E6100000E00D246CA4265040581E462E3EF334C00106000020E610000007000000010300000001000000040000007186FD520BD555C0C840CE810E722DC0223A23AAED8C6240B8DC3F966AC92AC0082BF1EB98935EC060A933B667A80D407186FD520BD555C0C840CE810E722DC00103000000010000000D0000005E2A00CDA3AD60C06161F314C38B55C06499F3ACD93D40C0909F9100F43550C0F481C95B7CAE4940F495C9D3FB7D52C0DCDB49806D0F6040D92D4238EB7A53C066F003ADB9316440830FD3B8181341C026FC61CBB3F160400CC42C262AE63CC02AD7BA0247D3654020758F35420A054000534684A6380040409C40FC067525C0E396B9DEE06A5CC000B65A9A8BE1044013F6E811B16364C0605AEF2EB1F920C00F66B45187FB65C03802120D109C28C0DA376AED47CF63C0BA77E838F0023CC05E2A00CDA3AD60C06161F314C38B55C001030000000100000009000000D1F8824942F062C0186C3E9460082A40AF0E88D40D3F54C000F8D3ABFEA5EABF1C4C200C7A47454028B71E0ADFEC27C01ECA3EED68115040C04941CB39EAF3BF58A6F2EBFAD84C4010BCF4FE921C22403426959300F75F407A3189D8E2CC54407C0C7047849552402E5B3F5BDD105440D4DACA09C55564C0AEA24EAC61275140D1F8824942F062C0186C3E9460082A400103000000010000000C000000347F7C9EFB2960C060FB659FE2DF0E4070837EF5986B5FC0D60986514ADF40C0E0B578DE8F083D400B1D918A5C2A55C0F4BBC06A241E4F40074F83FBB8BD48C07090B2C89A3863407A8C13F542C73FC01E1C8D8573186540CE895FF4849D52408084D1C5EB4D524038FEECBC7EBB44409815F32C75703EC0C44BB19E32904840F85C11AE0F1648C0F461898631AF5140B9F164BCE5A961C0204A16F90F574340E4DDC568D40E55C01C19755F2F9F3440347F7C9EFB2960C060FB659FE2DF0E400103000000010000000A000000D2A90637A6D753C08099A0C48BCC0A40DC5A2C6C3D0343C0E6347FB9FB2F50C020B3B774C2FE29408C21C7F5E02944C09A6146CE86F05140E77ACC6541B552C0705503EABAA934403A3990382AF250407AC84927EED04DC00EF67C46FC0A5540BCF8C919B06566C050B26B4886C547400EDC369B66B35DC004CA05F2CEFA344083311DA95F9262C020E3C97A39C12140D2A90637A6D753C08099A0C48BCC0A4001030000000100000007000000CBF3EB733A5C63C01BF71158DDC946C0AC0CE68F79BA464034E7F5F534E652C0486C9A114FF960401B3D71B2BFC740C0FCBC07E6BFF059405060F5E848C816C0E9F5E9AFA10E66C0B409038B10213E40504F9E6F32A15DC0EC400C64BF4339C0CBF3EB733A5C63C01BF71158DDC946C001030000000100000004000000809DE0489A794B403006D6237BE521C0D8C7363FAB3E5C40C407F2F47C563C40BFB96BD432B357C0869A5A7C08365540809DE0489A794B403006D6237BE521C0':::GEOGRAPHY,e'\\'':::STRING,1200123088:::INT8,1104838057:::OID,'[[{\".NTTu\u0026Em1\": 1.7547885987121024, \"a\": [[[true], {}, []], [[]], true]}, [{}], []], {}, {}]':::JSONB,ARRAY['BOX(-0.6645833230895177 -1.0933911860201553,0.13289673728268828 -0.6638562282322614)':::BOX2D,'BOX(-2.9367744985904767 -1.1769717827878556,1.36711792306052 2.0631694990199034)':::BOX2D,'BOX(-1.736195251036203 -1.6591258964533218,-0.5780265465536142 1.8627109972878384)':::BOX2D,'BOX(-1.2676627432686915 0.021402715424039376,-1.0206374497392137 0.3431898401646871)':::BOX2D,'BOX(-0.5811189854157423 -2.235725325164144,0.6426673036188274 -0.95209788872328)':::BOX2D],'12:18:14.029646':::TIME,'':::STRING,e'``m\\x17K\\n2f':::STRING,'rg``cTW\u003e8[':::STRING,e'HBF\\x0fE\\x1ewa@':::STRING)"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col230_245\" (SQLSTATE 55000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: 

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh schemachange/random-load

Same failure on other branches

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/random-load failed with artifacts on release-21.1 @ a866c9fe3948bcfcd028b94fc06afda7268fa985:

		  |   "BEGIN",
		  |   "CREATE SCHEMA IF NOT EXISTS schema1 AUTHORIZATION root",
		  |   "CREATE SEQUENCE IF NOT EXISTS public.seq39",
		  |   "ALTER SEQUENCE public.seq39 RENAME TO public.seq63",
		  |   "SELECT 'validating all objects'",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "",
		  |  "txStatus": "TxStatusCommitSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:18:59.460171",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP INDEX public.table117@\"IrrelevantIndexName\""
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table117\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:18:59.70056",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER TABLE public.table4 DROP CONSTRAINT \"table4_col4_10_col4_6_col4_7_col4_8_col4_9_col4_5_key\""
		  |  ],
		  |  "expectedExecErrors": "0A000",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unimplemented: cannot drop UNIQUE constraint \"table4_col4_10_col4_6_col4_7_col4_8_col4_9_col4_5_key\" using ALTER TABLE DROP CONSTRAINT, use DROP INDEX CASCADE instead (SQLSTATE 0A000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:18:59.344248",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP SCHEMA \"schema1\" CASCADE"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: 

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh schemachange/random-load

Same failure on other branches

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/random-load failed with artifacts on release-21.1 @ 21b5b06ea907f4adf0fef3318848e28f454138ea:

		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table262\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:19:35.241998",
		  |  "ops": [
		  |   "BEGIN",
		  |   "SELECT 'validating all objects'",
		  |   "CREATE SCHEMA IF NOT EXISTS public AUTHORIZATION root",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "",
		  |  "txStatus": "TxStatusCommitSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:19:34.774881",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SEQUENCE IF NOT EXISTS public.seq225",
		  |   "DROP SEQUENCE IF EXISTS public.seq225",
		  |   "CREATE SCHEMA schema256 AUTHORIZATION root"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_PUSHER_ABORTED): \"sql txn\" meta={id=e85e31fa key=/Table/SystemConfigSpan/Start pri=0.00850363 epo=0 ts=1625480375.344842072,1 min=1625480374.774800110,0 seq=26} lock=true stat=ABORTED rts=1625480374.774800110,0 wto=false gul=1625480375.274800110,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:19:34.524009",
		  |  "ops": [
		  |   "BEGIN",
		  |   "SELECT 'validating all objects'",
		  |   "CREATE TABLE schema177.table245 (col245_246 GEOMETRY NOT NULL, col245_247 \"char\", UNIQUE (col245_247 ASC) STORING (col245_246), UNIQUE (col245_247), UNIQUE (col245_247), INDEX (col245_247 DESC), INVERTED INDEX (col245_246 ASC), FAMILY (col245_246), FAMILY (col245_247))",
		  |   "ALTER TABLE schema177.table245 ADD COLUMN col245_254 UUID[] NOT NULL",
		  |   "ALTER TABLE schema177.table245 ADD CONSTRAINT table245_rowid_table245_rowid_fk FOREIGN KEY (rowid) REFERENCES schema177.table245 (rowid) ON DELETE CASCADE ON UPDATE CASCADE"
		  |  ],
		  |  "expectedExecErrors": "23503",
		  |  "expectedCommitErrors": "",
		  |  "message": "***FAIL; Failed to receive an execution error when errors were expected",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: 

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh schemachange/random-load

Same failure on other branches

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/random-load failed with artifacts on release-21.1 @ 32273aa49ce7006677bb1b4a0003b4ed8ac8b455:

		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table65\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:15:46.409584",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE IF NOT EXISTS public.table37 (col37_38 UUID NOT NULL, PRIMARY KEY (col37_38), UNIQUE (col37_38 DESC), INDEX (col37_38 DESC), INDEX (col37_38 ASC), INDEX (col37_38))",
		  |   "ALTER TABLE public.table37 DROP COLUMN \"col37_38\""
		  |  ],
		  |  "expectedExecErrors": "42P10",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col37_38\" is referenced by the primary key (SQLSTATE 42P10)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:15:46.4098",
		  |  "ops": [
		  |   "BEGIN",
		  |   "SELECT 'validating all objects'",
		  |   "CREATE SCHEMA schema36 AUTHORIZATION root",
		  |   "DROP SCHEMA \"schema36\" CASCADE",
		  |   "CREATE SCHEMA IF NOT EXISTS schema68 AUTHORIZATION root",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=d6dc4180 key=/Table/SystemConfigSpan/Start pri=0.02932474 epo=0 ts=1625566546.762086353,1 min=1625566546.409694684,0 seq=43} lock=true stat=PENDING rts=1625566546.409694684,0 wto=false gul=1625566546.909694684,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:15:46.40997",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE public.table6 (col6_7 REGCLASS, col6_8 \"char\" NOT NULL, col6_9 \"char\" NOT NULL, col6_10 INT2 NOT NULL, col6_11 BIT(16) NOT NULL, col6_12 BOX2D NOT NULL, col6_13 BOX2D NOT NULL, col6_14 BIT(26) NULL, col6_15 REGCLASS NOT NULL, PRIMARY KEY (col6_10 ASC, col6_11 ASC, col6_15 DESC, col6_12 DESC, col6_13 DESC, col6_9 ASC), col6_16 STRING NOT NULL AS (lower(col6_8)) VIRTUAL, FAMILY (col6_14), FAMILY (col6_7, col6_13), FAMILY (col6_15, col6_9, col6_11, col6_10), FAMILY (col6_12, col6_8))",
		  |   "INSERT INTO public.table6 (col6_7,col6_8,col6_9,col6_10,col6_11,col6_12,col6_13,col6_14,col6_15,col6_16) VALUES (1917401541:::OID,'\"':::STRING,'F':::STRING,(-32628):::INT8,B'0001000110010110','BOX(-0.32574724217285844 -0.3882238041516644,1.106914272862832 1.2543129509231865)':::BOX2D,'BOX(-0.6178238888561677 0.29015318141029756,0.11155892988221572 0.6571130201761335)':::BOX2D,NULL,912377783:::OID,'!Z[':::STRING),(3431381214:::OID,e'\\x05':::STRING,e'\\x0f':::STRING,(-18458):::INT8,B'0000111101010011','BOX(-0.612344648212481 0.27723238713871456,0.5446726732890302 0.6277674427854512)':::BOX2D,'BOX(-0.5695426805835886 0.41953566498624695,0.2212497392281234 0.6487640890706463)':::BOX2D,B'11110010111111010000101111',2654682430:::OID,e'Nqu!\\f\\x10':::STRING)"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col6_16\" (SQLSTATE 55000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: 

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh schemachange/random-load

Same failure on other branches

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/random-load failed with artifacts on release-21.1 @ 4bdd64a13faabc2024969f68d3bca17feacb5147:

		  | Error: COMMAND_PROBLEM: exit status 1
		  | (1) COMMAND_PROBLEM
		  | Wraps: (2) Node 1. Command with error:
		  |   | ``````
		  |   | ./workload run schemachange --verbose=1 --tolerate-errors=false  --histograms=perf/stats.json --max-ops 5000 --concurrency 20 --txn-log /mnt/data1/cockroach/transactions.json
		  |   | ``````
		  | Wraps: (3) exit status 1
		  | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
		  |
		  | stdout:
		  | <... some data truncated by circular buffer; go to artifacts for details ...>
		  |  schema87 AUTHORIZATION root",
		  |   "ALTER TABLE schema33.table47 ALTER COLUMN \"col47_48\" DROP STORED"
		  |  ],
		  |  "expectedExecErrors": "42611",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col47_48\" is not a computed column (SQLSTATE 42611)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "09:54:17.361689",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SEQUENCE IF NOT EXISTS public.seq74",
		  |   "SELECT 'validating all objects'",
		  |   "SELECT 'validating all objects'",
		  |   "CREATE SCHEMA IF NOT EXISTS schema108 AUTHORIZATION root"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=c671e735 key=/Table/SystemConfigSpan/Start pri=0.00160714 epo=0 ts=1625651658.337935467,1 min=1625651657.361597092,0 seq=14} lock=true stat=PENDING rts=1625651657.361597092,0 wto=false gul=1625651657.861597092,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "09:54:17.830793",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP TABLE IF EXISTS schema33.table47 RESTRICT",
		  |   "CREATE TABLE schema33.table89 (col89_90 STRING NOT NULL, col89_91 BYTES NOT NULL, col89_92 INTERVAL, col89_93 STRING, col89_94 DECIMAL, col89_95 VARCHAR NULL, col89_96 REGPROC NOT NULL, col89_97 REGPROCEDURE NULL, col89_98 BIT(20) NOT NULL, col89_99 REGPROCEDURE NOT NULL, col89_100 DATE NOT NULL, col89_101 BYTES NULL, col89_102 FLOAT8 NOT NULL, col89_103 STRING NULL, PRIMARY KEY (col89_96, col89_102, col89_91 ASC, col89_99 ASC, col89_98 DESC, col89_100 DESC), col89_104 STRING AS (lower(col89_90)) VIRTUAL, col89_105 STRING NULL AS (lower(col89_103)) STORED, INDEX (col89_101, col89_103 ASC, col89_102 ASC, col89_93, col89_97, col89_94 DESC, col89_105 ASC, col89_92, col89_96 ASC, col89_91 DESC), UNIQUE (col89_102 ASC, col89_98 DESC, col89_91 ASC, col89_95 DESC, col89_92 ASC, col89_101 DESC, col89_99, col89_105 DESC, col89_103 DESC, col89_90, col89_96 ASC, col89_97 ASC, col89_100 DESC, col89_94 ASC, col89_104 ASC), INDEX (col89_91 ASC, col89_97 ASC, col89_104 DESC, col89_102 DESC, col89_93 ASC, col89_101, col89_92 ASC, col89_100, col89_90, col89_96 DESC, col89_94 DESC, col89_95, col89_103, col89_98, col89_99, col89_105 DESC), UNIQUE (col89_92 ASC, col89_103 ASC, col89_98, col89_94 ASC, col89_97 DESC, col89_104, col89_91 DESC, col89_93 DESC, col89_102 DESC, col89_105 ASC, col89_96 ASC, col89_90 ASC, col89_99 ASC, col89_100 ASC), INDEX (col89_96 DESC, col89_91, col89_101 ASC, col89_97 DESC, col89_92, col89_100 DESC, col89_104 ASC, col89_98 ASC, col89_90 ASC, col89_103 ASC, col89_102, col89_99 ASC, col89_94 ASC, col89_105 ASC, col89_93 ASC), UNIQUE (col89_98 DESC, col89_94 DESC, col89_93, col89_90 DESC, col89_97, col89_96 ASC) STORING (col89_103), UNIQUE (col89_99, col89_96 ASC, col89_95, col89_93 ASC, col89_103 ASC, col89_98, col89_105 ASC, col89_94 ASC, col89_104, col89_92 ASC, col89_97 ASC, col89_91 DESC, col89_90 DESC), UNIQUE (col89_105 ASC, col89_101, col89_93 ASC, col89_95 ASC, col89_96 DESC, col89_100 ASC, col89_99 DESC, col89_98 ASC, col89_91 ASC, col89_92 ASC, col89_102 DESC, col89_103, col89_104, col89_90 ASC, col89_94 DESC, col89_97 ASC), INDEX (col89_103 DESC, col89_105 ASC, col89_101 ASC, col89_90 ASC, col89_100 DESC, col89_92, col89_94 ASC, col89_97, col89_93 DESC), FAMILY (col89_90), FAMILY (col89_97, col89_99, col89_91), FAMILY (col89_93, col89_96), FAMILY (col89_95), FAMILY (col89_103), FAMILY (col89_94, col89_105, col89_101), FAMILY (col89_98, col89_102, col89_100), FAMILY (col89_92))",
		  |   "ALTER TABLE schema33.table89 ADD COLUMN col89_107 TIMETZ"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: 

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh schemachange/random-load

Same failure on other branches

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/random-load failed with artifacts on release-21.1 @ b7eaf3b47c220003b3d949af6d48d220c5f92db4:

		  |   "CREATE TABLE IF NOT EXISTS schema176.table431 (col431_432 CHAR NULL, col431_433 GEOGRAPHY NULL, col431_434 INET NULL, col431_435 FLOAT8, col431_436 DATE, col431_437 DECIMAL NULL, col431_438 DECIMAL AS (col431_437 + (-6.636861919961191616E+33):::DECIMAL) VIRTUAL, col431_439 DECIMAL NULL AS (col431_437 + (-87348687763283708.95):::DECIMAL) STORED, col431_440 DECIMAL AS (col431_437 + (-0.1118343929000686306):::DECIMAL) VIRTUAL, UNIQUE (col431_439 DESC, col431_440, col431_437 DESC, col431_434), INVERTED INDEX (col431_440, col431_434 DESC, col431_439, col431_437 DESC, col431_432, col431_438 ASC, col431_435 ASC, col431_433 DESC), UNIQUE (col431_440 DESC, col431_438 ASC, col431_439 DESC, col431_434, col431_437 ASC, col431_436 ASC, col431_432 DESC) STORING (col431_433), INDEX (col431_436 ASC, col431_434, col431_432 DESC, col431_439 ASC, col431_435))",
		  |   "DROP SEQUENCE schema176.seq448"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema176.seq448\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:05:49.581524",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP TABLE IF EXISTS schema176.table413",
		  |   "DROP TABLE IF EXISTS schema146.table443",
		  |   "SELECT 'validating all objects'",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "",
		  |  "txStatus": "TxStatusCommitSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:05:49.524272",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE schema146.table391 (col391_392 DATE NOT NULL, col391_393 REGNAMESPACE, col391_394 \"char\" NOT NULL, col391_395 JSONB NULL, col391_396 REGTYPE NOT NULL, col391_397 DATE, col391_398 FLOAT4 NOT NULL, col391_399 STRING AS (lower(col391_394)) VIRTUAL, col391_400 STRING AS (lower(CAST(col391_392 AS STRING))) STORED, col391_401 STRING NULL AS (lower(CAST(col391_395 AS STRING))) STORED, col391_402 STRING NULL AS (lower(CAST(col391_397 AS STRING))) STORED, col391_403 STRING AS (lower(CAST(col391_393 AS STRING))) VIRTUAL, col391_404 STRING NULL AS (lower(CAST(col391_397 AS STRING))) STORED, INVERTED INDEX (col391_392 ASC, col391_396 DESC, col391_393 ASC, col391_404 ASC, col391_403, col391_394 ASC, col391_397, col391_399 ASC, col391_401, col391_402, col391_395 DESC))",
		  |   "ALTER TABLE schema146.table391 ALTER COLUMN \"col391_398\" DROP STORED"
		  |  ],
		  |  "expectedExecErrors": "42611",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col391_398\" is not a computed column (SQLSTATE 42611)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:05:49.719683",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP SEQUENCE IF EXISTS schema146.seq364"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: 

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh schemachange/random-load

Same failure on other branches

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/random-load failed with artifacts on release-21.1 @ 3ee6d71402938c32c266243cffd94c2c1d7bef9a:

		  |   "CREATE VIEW public.view107 AS SELECT public.table45.col45_46, public.table45.col45_71, public.table45.col45_53, public.table45.col45_59, public.table45.col45_55, public.table45.col45_58, public.table45.col45_61, public.table45.col45_50, public.table45.col45_47, public.table45.col45_56, public.table45.col45_48, public.table45.col45_62, public.table45.col45_52, public.table45.col45_51 FROM public.table45"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_PUSHER_ABORTED): \"sql txn\" meta={id=21412304 key=/Table/SystemConfigSpan/Start pri=0.00473424 epo=0 ts=1625824553.308727504,1 min=1625824553.220838121,0 seq=15} lock=true stat=ABORTED rts=1625824553.220838121,0 wto=false gul=1625824553.720838121,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "09:55:53.317357",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE IF NOT EXISTS public.table77 (col77_78 VARCHAR NOT NULL, col77_79 INT2 NULL, col77_80 REGCLASS NOT NULL, col77_81 REGPROC NOT NULL, col77_82 BIT(33) NOT NULL, col77_83 TIME, col77_84 REGNAMESPACE NOT NULL, col77_85 REGTYPE NOT NULL, col77_86 GEOGRAPHY, PRIMARY KEY (col77_85 ASC, col77_80 DESC, col77_82, col77_84 ASC, col77_78, col77_81 ASC), col77_87 STRING AS (lower(CAST(col77_86 AS STRING))) STORED, col77_88 STRING AS (lower(CAST(col77_83 AS STRING))) STORED, col77_89 STRING NOT NULL AS (lower(CAST(col77_86 AS STRING))) STORED, col77_90 STRING NOT NULL AS (lower(col77_78)) STORED, col77_91 STRING AS (lower(col77_78)) VIRTUAL)",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "",
		  |  "txStatus": "TxStatusCommitSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "09:55:53.308809",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER TABLE public.table45 DROP COLUMN \"col45_58\"",
		  |   "DROP TABLE IF EXISTS public.table45",
		  |   "SELECT 'validating all objects'",
		  |   "CREATE TYPE public.enum137 AS ENUM ('asdsa', 'daafa', 'fs', 'fddad')",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=28cbbd12 key=/Table/SystemConfigSpan/Start pri=0.01304480 epo=0 ts=1625824553.495139250,2 min=1625824553.308727504,0 seq=45} lock=true stat=PENDING rts=1625824553.308727504,0 wto=false gul=1625824553.808727504,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "09:55:53.40963",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE INDEX index45_138 ON public.table45 (col45_55 ASC, col45_62) STORING (col45_48, col45_57, col45_53, col45_59, col45_52, col45_50, col45_46)"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: relation \"table45\" (59): index \"index45_138\" cannot store virtual column \"col45_57\" (SQLSTATE XXUUU)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: 

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh schemachange/random-load

Same failure on other branches

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/random-load failed with artifacts on release-21.1 @ a59bb25a0c234e1752aa201fc8d6ccc4683c16b1:

		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE public.table43 (col43_44 GEOMETRY NOT NULL, col43_45 CHAR, col43_46 STRING NULL, col43_47 INT4 NOT NULL, col43_48 STRING AS (lower(CAST(col43_44 AS STRING))) VIRTUAL, UNIQUE (col43_46, col43_48) STORING (col43_44, col43_47))",
		  |   "ALTER TABLE public.table43 ADD COLUMN col43_81 TIMETZ",
		  |   "CREATE TYPE public.enum37 AS ENUM ('dafff', 'dafaa', 'dffds')"
		  |  ],
		  |  "expectedExecErrors": "42710",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: type \"schemachange.public.enum37\" already exists (SQLSTATE 42710)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:25:45.359764",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP SCHEMA \"public\" CASCADE"
		  |  ],
		  |  "expectedExecErrors": "3F000",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot drop schema \"public\" (SQLSTATE 3F000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:25:45.119648",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER SEQUENCE public.seq73 RENAME TO public.seq77",
		  |   "ALTER TABLE public.table82 ADD CONSTRAINT IrrelevantConstraintName UNIQUE (IrrelevantColumnName)"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"public.table82\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:25:45.291147",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SCHEMA IF NOT EXISTS schema36 AUTHORIZATION root"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: 

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh schemachange/random-load

Same failure on other branches

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/random-load failed with artifacts on release-21.1 @ 03b83e02502e8876ecb366659156ab00f7431a51:

		  | table579 (col579_580 TIMETZ NOT NULL, col579_581 JSONB NULL, col579_582 GEOGRAPHY NULL, col579_583 OID NOT NULL, col579_584 REGCLASS, col579_585 FLOAT4 NOT NULL, col579_586 BOX2D NULL, col579_587 GEOMETRY NULL, col579_588 INT2 NOT NULL, col579_589 \"char\", col579_590 FLOAT4 NULL, PRIMARY KEY (col579_588 ASC, col579_585 DESC, col579_580 ASC))",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=3f28e458 key=/Table/SystemConfigSpan/Start pri=0.04084036 epo=0 ts=1626170026.843613450,1 min=1626170026.707327619,0 seq=24} lock=true stat=PENDING rts=1626170026.707327619,0 wto=false gul=1626170027.207327619,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "09:53:46.624738",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SEQUENCE IF NOT EXISTS schema79.seq556",
		  |   "DROP SEQUENCE schema79.seq556",
		  |   "CREATE SCHEMA schema591 AUTHORIZATION root"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=145e895a key=/Table/SystemConfigSpan/Start pri=0.00336748 epo=0 ts=1626170027.311048694,1 min=1626170026.624656426,0 seq=27} lock=true stat=PENDING rts=1626170026.624656426,0 wto=false gul=1626170027.124656426,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "09:53:46.587109",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SEQUENCE IF NOT EXISTS public.seq574",
		  |   "DROP SCHEMA \"schema593\" CASCADE"
		  |  ],
		  |  "expectedExecErrors": "3F000",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: unknown schema \"schema593\" (SQLSTATE 3F000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "09:53:46.620685",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE IF NOT EXISTS public.table559 (col559_560 DECIMAL NULL, col559_561 UUID NOT NULL, col559_562 FLOAT4[] NOT NULL, col559_563 INTERVAL NOT NULL, col559_564 INT2 NOT NULL, col559_565 BYTES NOT NULL, col559_566 FLOAT4 NOT NULL, col559_567 NAME NULL, col559_568 STRING, col559_569 BOX2D, col559_570 FLOAT4 NOT NULL, col559_571 TIMETZ NOT NULL, PRIMARY KEY (col559_564 ASC, col559_566 ASC, col559_570 DESC, col559_571, col559_563 DESC, col559_561), col559_572 FLOAT4 NOT NULL AS (col559_566 + 0.4531426429748535:::FLOAT8) VIRTUAL, UNIQUE (col559_570 DESC, col559_565 ASC, col559_567 DESC, col559_561 ASC), UNIQUE (col559_570 ASC, col559_563 ASC, col559_560 DESC) STORING (col559_562), UNIQUE (col559_567, col559_569 ASC, col559_566 ASC, col559_561 ASC, col559_572 DESC, col559_565 DESC, col559_563 ASC, col559_571), FAMILY (col559_561), FAMILY (col559_566), FAMILY (col559_562), FAMILY (col559_565, col559_560), FAMILY (col559_568, col559_567, col559_563), FAMILY (col559_569), FAMILY (col559_564, col559_570), FAMILY (col559_571))",
		  |   "INSERT INTO public.table559 (col559_560,col559_561,col559_562,col559_563,col559_564,col559_565,col559_566,col559_567,col559_568,col559_569,col559_570,col559_571,col559_572) VALUES ((-3.932746474450412578E+24):::DECIMAL,'9f202290-ba18-4e4a-9dc6-9a4187a98d2a':::UUID,ARRAY[0.3632606267929077:::FLOAT8,(-0.6921462416648865):::FLOAT8],'-69 years -4 mons -313 days -11:24:31.449923':::INTERVAL,(-10701):::INT8,'\\x0677':::BYTES,0.9584066271781921:::FLOAT8,'w':::STRING:::NAME,e'TGIcQT%\\x04(':::STRING,'BOX(-1.1393717267881298 0.4673196601488181,0.616744945232467 0.5296365909897172)':::BOX2D,0.07814019918441772:::FLOAT8,'14:58:14.48724-10:45:00':::TIMETZ,(-0.3508598804473877):::FLOAT8)"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col559_572\" (SQLSTATE 55000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: 

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh schemachange/random-load

Same failure on other branches

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/random-load failed with artifacts on release-21.1 @ 018479af8598930806ed99fda946c4ea72eb9d6a:

		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "09:59:38.042115",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER TABLE public.table135 ALTER COLUMN \"col135_141\" DROP STORED"
		  |  ],
		  |  "expectedExecErrors": "42611",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: column \"col135_141\" is not a computed column (SQLSTATE 42611)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "09:59:37.807515",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE public.table180 AS SELECT public.table135.col135_144, public.table135.col135_147, public.table135.col135_136, public.table135.col135_147, public.table135.col135_145, public.table135.col135_144, public.table135.col135_137, public.table135.col135_136, public.table135.col135_140, public.table135.col135_143, public.table135.col135_139 FROM public.table135, public.table135"
		  |  ],
		  |  "expectedExecErrors": "42701,42712",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table135\" specified more than once (missing AS clause) (SQLSTATE 42712)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "09:59:37.646983",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE public.table179 AS SELECT public.table135.col135_146, public.table135.col135_142, public.table135.col135_139, public.table135.col135_137, public.table135.col135_145, public.table135.col135_147, public.table135.col135_146, public.table135.col135_140, public.table135.col135_143 FROM public.table135, public.table135"
		  |  ],
		  |  "expectedExecErrors": "42701,42712",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: source name \"table135\" specified more than once (missing AS clause) (SQLSTATE 42712)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "09:59:37.630607",
		  |  "ops": [
		  |   "BEGIN",
		  |   "INSERT INTO public.table135 (col135_136,col135_137,col135_139,col135_140,col135_141,col135_142,col135_143,col135_144,col135_145,col135_146,col135_147,col135_148) VALUES (e'\\x12':::STRING,0:::OID,69298792:::INT8,'X':::STRING,'\"':::STRING,701638631:::INT8,'a':::STRING,2644932931:::OID,'01060000000200000001030000000100000004000000000000000000444000000000000044400000000000003440000000000080464000000000008046400000000000003E4000000000000044400000000000004440010300000002000000060000000000000000003440000000000080414000000000000024400000000000003E40000000000000244000000000000024400000000000003E4000000000000014400000000000804640000000000000344000000000000034400000000000804140040000000000000000003E40000000000000344000000000000034400000000000002E40000000000000344000000000000039400000000000003E400000000000003440':::GEOMETRY,e'M\\x150\\x14se:':::STRING,e'~\\x7f/0\\x0b/\\fg':::STRING,e'\\tc!6':::STRING)"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Received an unexpected execution error: ERROR: cannot write directly to computed column \"col135_146\" (SQLSTATE 55000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: 

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh schemachange/random-load

Same failure on other branches

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/random-load failed with artifacts on release-21.1 @ aa9506903f7a71f8117e89d1e344cd91a7d50cf4:

		  |   "SELECT 'validating all objects'",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "",
		  |  "txStatus": "TxStatusCommitSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:25:06.74435",
		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER SEQUENCE schema105.seq435 RENAME TO schema105.seq436"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema105.seq435\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:25:07.156576",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TYPE public.enum401 AS ENUM ('daf', 'a')",
		  |   "CREATE TYPE schema372.enum419 AS ENUM ('fff', 'dadas')",
		  |   "SELECT 'validating all objects'",
		  |   "CREATE TYPE schema105.enum437 AS ENUM ('saaf', 'faas', 'asffds')",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=bb81c6e0 key=/Table/SystemConfigSpan/Start pri=0.00319127 epo=0 ts=1626431107.181717355,1 min=1626431107.156533679,0 seq=27} lock=true stat=PENDING rts=1626431107.156533679,0 wto=false gul=1626431107.656533679,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:25:07.570779",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SCHEMA schema417 AUTHORIZATION root"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: 

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh schemachange/random-load

Same failure on other branches

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/random-load failed with artifacts on release-21.1 @ 42486498706391d1a63cf49fd47ffd67388293ab:

		  |  "ops": [
		  |   "BEGIN",
		  |   "ALTER TABLE schema3.table307 ALTER COLUMN \"IrrelevantColumnName\" DROP DEFAULT"
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema3.table307\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "18:26:50.437551",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE public.table309 (col309_310 INTERVAL NOT NULL, PRIMARY KEY (col309_310 DESC), INDEX (col309_310))",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=f6840ff9 key=/Table/SystemConfigSpan/Start pri=0.01718435 epo=0 ts=1626719210.788518808,1 min=1626719210.437459230,0 seq=7} lock=true stat=PENDING rts=1626719210.437459230,0 wto=false gul=1626719210.937459230,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "18:26:49.554528",
		  |  "ops": [
		  |   "BEGIN",
		  |   "SELECT 'validating all objects'",
		  |   "SELECT 'validating all objects'",
		  |   "CREATE SCHEMA schema264 AUTHORIZATION root"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_WRITE_TOO_OLD - WriteTooOld flag converted to WriteTooOldError): \"sql txn\" meta={id=157fdf42 key=/Table/SystemConfigSpan/Start pri=0.03913217 epo=0 ts=1626719210.961144864,1 min=1626719209.554418377,0 seq=6} lock=true stat=PENDING rts=1626719209.554418377,0 wto=false gul=1626719210.054418377,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "18:26:50.483412",
		  |  "ops": [
		  |   "BEGIN",
		  |   "DROP TABLE public.table285"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: 

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh schemachange/random-load

Same failure on other branches

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/random-load failed with artifacts on release-21.1 @ 7c3cf23b898815395fbc80e08ed8947a243267bc:

		  |   "CREATE TABLE IF NOT EXISTS schema1.table165 (col165_166 TIMESTAMP NULL, col165_167 INT2 NULL, col165_168 FLOAT4 NOT NULL, col165_169 BIT(37), col165_170 TIMETZ NOT NULL, PRIMARY KEY (col165_168 DESC, col165_170 DESC), col165_171 STRING NOT NULL AS (lower(CAST(col165_166 AS STRING))) VIRTUAL, col165_172 STRING NOT NULL AS (lower(CAST(col165_169 AS STRING))) VIRTUAL)",
		  |   "ALTER TABLE schema1.table165 ALTER COLUMN col165_169 SET DEFAULT B'0010110010001110101100011001000001111'",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=a3dad5fe key=/Table/SystemConfigSpan/Start pri=0.02083024 epo=0 ts=1626775125.497571453,1 min=1626775125.242025814,0 seq=13} lock=true stat=PENDING rts=1626775125.242025814,0 wto=false gul=1626775125.742025814,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "09:58:45.497678",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TYPE schema196.enum197 AS ENUM ('fffsdf')"
		  |  ],
		  |  "expectedExecErrors": "3F000",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: cannot create \"schema196.enum197\" because the target database or schema does not exist (SQLSTATE 3F000)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "09:58:45.179304",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE IF NOT EXISTS schema1.table157 (col157_158 STRING, col157_159 NAME NULL, col157_160 INT4 NOT NULL, col157_161 \"char\" NOT NULL, PRIMARY KEY (col157_160 DESC, col157_161), col157_162 INT4 NULL AS (col157_160 + (-525499535):::INT8) STORED, UNIQUE (col157_159 ASC, col157_162, col157_161 DESC, col157_158), UNIQUE (col157_158 ASC, col157_160 DESC, col157_159 ASC), UNIQUE (col157_159, col157_158 ASC), FAMILY (col157_160), FAMILY (col157_161), FAMILY (col157_158, col157_162), FAMILY (col157_159))",
		  |   "ALTER TABLE schema1.table157 DROP COLUMN \"col157_158\"",
		  |   "ALTER TABLE schema1.table157 RENAME COLUMN \"col157_161\" TO \"col157_198\"",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "TXN RETRY ERROR; ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionRetryError: retry txn (RETRY_SERIALIZABLE - failed preemptive refresh): \"sql txn\" meta={id=8d0bda7a key=/Table/SystemConfigSpan/Start pri=0.00841534 epo=0 ts=1626775125.497571453,1 min=1626775125.179237672,0 seq=44} lock=true stat=PENDING rts=1626775125.179237672,0 wto=false gul=1626775125.679237672,0 (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusCommitFailure"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "09:58:45.482957",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SCHEMA IF NOT EXISTS schema152 AUTHORIZATION root"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: 

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh schemachange/random-load

Same failure on other branches

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/random-load failed with artifacts on release-21.1 @ 5f22b990fbe53cefbf8493efa3270a88752d9e37:

		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema1.table55\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  |     2.0s        0           14.0           13.5    125.8    260.0    352.3    352.3 opOk
		  |     2.0s        0            2.0            2.5    536.9   1610.6   1610.6   1610.6 txnCmtErr
		  |     2.0s        0            0.5            0.5   1744.8   1744.8   1744.8   1744.8 txnOk
		  |     2.0s        0           10.0            8.0      1.2     50.3     50.3     50.3 txnRbk
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:12:05.68404",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE TABLE public.table41 (col41_42 BIT(13), col41_43 UUID NULL, col41_44 REGCLASS NULL, col41_45 TIMESTAMPTZ, col41_46 STRING NULL AS (lower(CAST(col41_42 AS STRING))) STORED, col41_47 STRING NOT NULL AS (lower(CAST(col41_42 AS STRING))) STORED, col41_48 STRING NULL AS (lower(CAST(col41_43 AS STRING))) VIRTUAL, INDEX (col41_47 ASC, col41_45 ASC, col41_42 DESC, col41_46, col41_44 DESC, col41_43, col41_48 ASC), UNIQUE (col41_47 DESC, col41_44 DESC, col41_46, col41_48, col41_45 DESC, col41_42), INDEX (col41_47 ASC, col41_46 ASC, col41_42, col41_45 ASC) STORING (col41_43), UNIQUE (col41_48), UNIQUE (col41_48 DESC, col41_47 DESC, col41_45 DESC, col41_42 ASC, col41_46 DESC, col41_44))",
		  |   "SELECT 'validating all objects'",
		  |   "ALTER TABLE schema1.table57 RENAME COLUMN \"IrrelevantColumnName\" TO \"OtherIrrelevantName\""
		  |  ],
		  |  "expectedExecErrors": "42P01",
		  |  "expectedCommitErrors": "",
		  |  "message": "ROLLBACK; Successfully got expected execution error: ERROR: relation \"schema1.table57\" does not exist (SQLSTATE 42P01)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:12:05.87982",
		  |  "ops": [
		  |   "BEGIN",
		  |   "SELECT 'validating all objects'",
		  |   "COMMIT"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "",
		  |  "txStatus": "TxStatusCommitSuccess"
		  | }
		  | {
		  |  "workerId": 0,
		  |  "clientTimestamp": "10:12:06.87618",
		  |  "ops": [
		  |   "BEGIN",
		  |   "CREATE SCHEMA schema27 AUTHORIZATION root"
		  |  ],
		  |  "expectedExecErrors": "",
		  |  "expectedCommitErrors": "",
		  |  "message": "***UNEXPECTED ERROR; Failed to generate a random operation: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: cannot rollback to savepoint after a transaction restart (SQLSTATE 40001)",
		  |  "txStatus": "TxStatusRollbackSuccess"
		  | }
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError
Reproduce

To reproduce, try: 

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh schemachange/random-load

Same failure on other branches

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

@cockroach-teamcity cockroach-teamcity mentioned this issue Sep 10, 2021
Closed
@cockroach-teamcity cockroach-teamcity mentioned this issue Mar 25, 2022
Closed
This was referenced Apr 28, 2022
Closed
Closed
@cockroach-teamcity cockroach-teamcity mentioned this issue May 6, 2022
Closed
@exalate-issue-sync exalate-issue-sync bot added T-sql-foundations SQL Foundations Team (formerly SQL Schema + SQL Sessions) and removed T-sql-schema-deprecated Use T-sql-foundations instead labels May 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. T-sql-foundations SQL Foundations Team (formerly SQL Schema + SQL Sessions)
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@jlinder @postamar @cockroach-teamcity