Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

roachtest: schemachange/mixed-versions failed #79107

Closed
cockroach-teamcity opened this issue Mar 31, 2022 · 9 comments
Closed

roachtest: schemachange/mixed-versions failed #79107

cockroach-teamcity opened this issue Mar 31, 2022 · 9 comments
Assignees
@chengxiong-ruan
Labels
branch-release-22.1 Used to mark GA and release blockers, technical advisories, and bugs for 22.1 C-test-failure Broken test (automatically or manually discovered). GA-blocker O-roachtest O-robot Originated from a bot. T-sql-foundations SQL Foundations Team (formerly SQL Schema + SQL Sessions)

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Mar 31, 2022 •
edited by cockroach-jira-scripts
Loading

roachtest.schemachange/mixed-versions failed with artifacts on release-22.1 @ a88367d7bd168a3614b7946cd7b77bb9c6374a30:

		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:866
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1581
		Wraps: (2) output in run_052724.245330906_n3_workload_run_schemachange
		Wraps: (3) ./workload run schemachange --verbose=1 --tolerate-errors=true --max-ops 100 --concurrency 5 {pgurl:1-4} returned
		  | stderr:
		  | <... some data truncated by circular buffer; go to artifacts for details ...>
		  | elpers.go:79  [-] 3536  pgx logger [error]: Query logParams=map[args:[] err:ERROR: relation "table247" (231): primary index column "col247_261" cannot be virtual (SQLSTATE XXUUU) sql:
		  | I220331 06:27:21.792399 1 workload/pgx_helpers.go:79  [-] 3536 +SELECT max(regexp_extract(name, '[0-9]+$')::INT8)
		  | I220331 06:27:21.792399 1 workload/pgx_helpers.go:79  [-] 3536 +  FROM (
		  | I220331 06:27:21.792399 1 workload/pgx_helpers.go:79  [-] 3536 +    SELECT name
		  | I220331 06:27:21.792399 1 workload/pgx_helpers.go:79  [-] 3536 +      FROM (
		  | I220331 06:27:21.792399 1 workload/pgx_helpers.go:79  [-] 3536 +	           (SELECT table_name FROM [SHOW TABLES]) UNION
		  | I220331 06:27:21.792399 1 workload/pgx_helpers.go:79  [-] 3536 +						 (SELECT sequence_name FROM [SHOW SEQUENCES]) UNION
		  | I220331 06:27:21.792399 1 workload/pgx_helpers.go:79  [-] 3536 +						 (SELECT name FROM [SHOW ENUMS]) UNION
		  | I220331 06:27:21.792399 1 workload/pgx_helpers.go:79  [-] 3536 +	           (SELECT schema_name FROM [SHOW SCHEMAS]) UNION
		  | I220331 06:27:21.792399 1 workload/pgx_helpers.go:79  [-] 3536 +						 (SELECT column_name FROM information_schema.columns) UNION
		  | I220331 06:27:21.792399 1 workload/pgx_helpers.go:79  [-] 3536 +						 (SELECT index_name FROM information_schema.statistics)
		  | I220331 06:27:21.792399 1 workload/pgx_helpers.go:79  [-] 3536 +           ) AS obj (name)
		  | I220331 06:27:21.792399 1 workload/pgx_helpers.go:79  [-] 3536 +       )
		  | I220331 06:27:21.792399 1 workload/pgx_helpers.go:79  [-] 3536 + WHERE name ~ '^(table|view|seq|enum|schema)[0-9]+$'
		  | I220331 06:27:21.792399 1 workload/pgx_helpers.go:79  [-] 3536 +    OR name ~ '^(col|index)[0-9]+_[0-9]+$';]
		  | W220331 06:27:23.690961 1 workload/cli/run.go:423  [-] 3537  retrying after error while creating load: failed to initialize the load generator: ERROR: relation "table247" (231): primary index column "col247_261" cannot be virtual (SQLSTATE XXUUU)
		  | I220331 06:27:23.729482 1 workload/pgx_helpers.go:79  [-] 3538  pgx logger [error]: Query logParams=map[args:[] err:ERROR: relation "table247" (231): primary index column "col247_261" cannot be virtual (SQLSTATE XXUUU) sql:
		  | I220331 06:27:23.729482 1 workload/pgx_helpers.go:79  [-] 3538 +SELECT max(regexp_extract(name, '[0-9]+$')::INT8)
		  | I220331 06:27:23.729482 1 workload/pgx_helpers.go:79  [-] 3538 +  FROM (
		  | I220331 06:27:23.729482 1 workload/pgx_helpers.go:79  [-] 3538 +    SELECT name
		  | I220331 06:27:23.729482 1 workload/pgx_helpers.go:79  [-] 3538 +      FROM (
		  | I220331 06:27:23.729482 1 workload/pgx_helpers.go:79  [-] 3538 +	           (SELECT table_name FROM [SHOW TABLES]) UNION
		  | I220331 06:27:23.729482 1 workload/pgx_helpers.go:79  [-] 3538 +						 (SELECT sequence_name FROM [SHOW SEQUENCES]) UNION
		  | I220331 06:27:23.729482 1 workload/pgx_helpers.go:79  [-] 3538 +						 (SELECT name FROM [SHOW ENUMS]) UNION
		  | I220331 06:27:23.729482 1 workload/pgx_helpers.go:79  [-] 3538 +	           (SELECT schema_name FROM [SHOW SCHEMAS]) UNION
		  | I220331 06:27:23.729482 1 workload/pgx_helpers.go:79  [-] 3538 +						 (SELECT column_name FROM information_schema.columns) UNION
		  | I220331 06:27:23.729482 1 workload/pgx_helpers.go:79  [-] 3538 +						 (SELECT index_name FROM information_schema.statistics)
		  | I220331 06:27:23.729482 1 workload/pgx_helpers.go:79  [-] 3538 +           ) AS obj (name)
		  | I220331 06:27:23.729482 1 workload/pgx_helpers.go:79  [-] 3538 +       )
		  | I220331 06:27:23.729482 1 workload/pgx_helpers.go:79  [-] 3538 + WHERE name ~ '^(table|view|seq|enum|schema)[0-9]+$'
		  | I220331 06:27:23.729482 1 workload/pgx_helpers.go:79  [-] 3538 +    OR name ~ '^(col|index)[0-9]+_[0-9]+$';]
		  | E220331 06:27:25.839340 1 workload/cli/run.go:437  [-] 3539  Attempt to create load generator failed. It's been more than 1h0m0s since we started trying to create the load generator so we're giving up. Last failure: failed to initialize the load generator: ERROR: relation "table247" (231): primary index column "col247_261" cannot be virtual (SQLSTATE XXUUU)
		  | Error: failed to initialize the load generator: ERROR: relation "table247" (231): primary index column "col247_261" cannot be virtual (SQLSTATE XXUUU)
		  |
		  | stdout:
		Wraps: (4) COMMAND_PROBLEM
		Wraps: (5) Node 3. Command with error:
		  | ``````
		  | ./workload run schemachange --verbose=1 --tolerate-errors=true --max-ops 100 --concurrency 5 {pgurl:1-4}
		  | ``````
		Wraps: (6) exit status 1
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) errors.Cmd (5) *hintdetail.withDetail (6) *exec.ExitError
Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

Jira issue: CRDB-14574
@cockroach-teamcity cockroach-teamcity added branch-release-22.1 Used to mark GA and release blockers, technical advisories, and bugs for 22.1 C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. labels Mar 31, 2022
@blathers-crl blathers-crl bot added the T-sql-schema-deprecated Use T-sql-foundations instead label Mar 31, 2022
@cockroach-teamcity cockroach-teamcity mentioned this issue Mar 31, 2022
Closed
@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on release-22.1 @ 7fcb94b0d6f870c3c2a5bb3bd0bd47c6e05eed3a:

		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:866
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1581
		Wraps: (2) output in run_053000.082916940_n2_workload_run_schemachange
		Wraps: (3) ./workload run schemachange --verbose=1 --tolerate-errors=true --max-ops 100 --concurrency 5 {pgurl:1-4} returned
		  | stderr:
		  | <... some data truncated by circular buffer; go to artifacts for details ...>
		  | -] 3536  pgx logger [error]: Query logParams=map[args:[] err:ERROR: relation "table1244" (481): primary index column "col1244_1259" cannot be virtual (SQLSTATE XXUUU) sql:
		  | I220401 06:29:58.738991 1 workload/pgx_helpers.go:79  [-] 3536 +SELECT max(regexp_extract(name, '[0-9]+$')::INT8)
		  | I220401 06:29:58.738991 1 workload/pgx_helpers.go:79  [-] 3536 +  FROM (
		  | I220401 06:29:58.738991 1 workload/pgx_helpers.go:79  [-] 3536 +    SELECT name
		  | I220401 06:29:58.738991 1 workload/pgx_helpers.go:79  [-] 3536 +      FROM (
		  | I220401 06:29:58.738991 1 workload/pgx_helpers.go:79  [-] 3536 +	           (SELECT table_name FROM [SHOW TABLES]) UNION
		  | I220401 06:29:58.738991 1 workload/pgx_helpers.go:79  [-] 3536 +						 (SELECT sequence_name FROM [SHOW SEQUENCES]) UNION
		  | I220401 06:29:58.738991 1 workload/pgx_helpers.go:79  [-] 3536 +						 (SELECT name FROM [SHOW ENUMS]) UNION
		  | I220401 06:29:58.738991 1 workload/pgx_helpers.go:79  [-] 3536 +	           (SELECT schema_name FROM [SHOW SCHEMAS]) UNION
		  | I220401 06:29:58.738991 1 workload/pgx_helpers.go:79  [-] 3536 +						 (SELECT column_name FROM information_schema.columns) UNION
		  | I220401 06:29:58.738991 1 workload/pgx_helpers.go:79  [-] 3536 +						 (SELECT index_name FROM information_schema.statistics)
		  | I220401 06:29:58.738991 1 workload/pgx_helpers.go:79  [-] 3536 +           ) AS obj (name)
		  | I220401 06:29:58.738991 1 workload/pgx_helpers.go:79  [-] 3536 +       )
		  | I220401 06:29:58.738991 1 workload/pgx_helpers.go:79  [-] 3536 + WHERE name ~ '^(table|view|seq|enum|schema)[0-9]+$'
		  | I220401 06:29:58.738991 1 workload/pgx_helpers.go:79  [-] 3536 +    OR name ~ '^(col|index)[0-9]+_[0-9]+$';]
		  | W220401 06:30:00.637784 1 workload/cli/run.go:423  [-] 3537  retrying after error while creating load: failed to initialize the load generator: ERROR: relation "table1244" (481): primary index column "col1244_1259" cannot be virtual (SQLSTATE XXUUU)
		  | I220401 06:30:00.677536 1 workload/pgx_helpers.go:79  [-] 3538  pgx logger [error]: Query logParams=map[args:[] err:ERROR: relation "table1244" (481): primary index column "col1244_1259" cannot be virtual (SQLSTATE XXUUU) sql:
		  | I220401 06:30:00.677536 1 workload/pgx_helpers.go:79  [-] 3538 +SELECT max(regexp_extract(name, '[0-9]+$')::INT8)
		  | I220401 06:30:00.677536 1 workload/pgx_helpers.go:79  [-] 3538 +  FROM (
		  | I220401 06:30:00.677536 1 workload/pgx_helpers.go:79  [-] 3538 +    SELECT name
		  | I220401 06:30:00.677536 1 workload/pgx_helpers.go:79  [-] 3538 +      FROM (
		  | I220401 06:30:00.677536 1 workload/pgx_helpers.go:79  [-] 3538 +	           (SELECT table_name FROM [SHOW TABLES]) UNION
		  | I220401 06:30:00.677536 1 workload/pgx_helpers.go:79  [-] 3538 +						 (SELECT sequence_name FROM [SHOW SEQUENCES]) UNION
		  | I220401 06:30:00.677536 1 workload/pgx_helpers.go:79  [-] 3538 +						 (SELECT name FROM [SHOW ENUMS]) UNION
		  | I220401 06:30:00.677536 1 workload/pgx_helpers.go:79  [-] 3538 +	           (SELECT schema_name FROM [SHOW SCHEMAS]) UNION
		  | I220401 06:30:00.677536 1 workload/pgx_helpers.go:79  [-] 3538 +						 (SELECT column_name FROM information_schema.columns) UNION
		  | I220401 06:30:00.677536 1 workload/pgx_helpers.go:79  [-] 3538 +						 (SELECT index_name FROM information_schema.statistics)
		  | I220401 06:30:00.677536 1 workload/pgx_helpers.go:79  [-] 3538 +           ) AS obj (name)
		  | I220401 06:30:00.677536 1 workload/pgx_helpers.go:79  [-] 3538 +       )
		  | I220401 06:30:00.677536 1 workload/pgx_helpers.go:79  [-] 3538 + WHERE name ~ '^(table|view|seq|enum|schema)[0-9]+$'
		  | I220401 06:30:00.677536 1 workload/pgx_helpers.go:79  [-] 3538 +    OR name ~ '^(col|index)[0-9]+_[0-9]+$';]
		  | E220401 06:30:01.332198 1 workload/cli/run.go:437  [-] 3539  Attempt to create load generator failed. It's been more than 1h0m0s since we started trying to create the load generator so we're giving up. Last failure: failed to initialize the load generator: ERROR: relation "table1244" (481): primary index column "col1244_1259" cannot be virtual (SQLSTATE XXUUU)
		  | Error: failed to initialize the load generator: ERROR: relation "table1244" (481): primary index column "col1244_1259" cannot be virtual (SQLSTATE XXUUU)
		  |
		  | stdout:
		Wraps: (4) COMMAND_PROBLEM
		Wraps: (5) Node 2. Command with error:
		  | ``````
		  | ./workload run schemachange --verbose=1 --tolerate-errors=true --max-ops 100 --concurrency 5 {pgurl:1-4}
		  | ``````
		Wraps: (6) exit status 1
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) errors.Cmd (5) *hintdetail.withDetail (6) *exec.ExitError
Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on release-22.1 @ ae5fec2629502404a949fa4496decf20d67b95b4:

		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:875
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1581
		Wraps: (2) output in run_052617.185882967_n4_workload_run_schemachange
		Wraps: (3) ./workload run schemachange --verbose=1 --tolerate-errors=true --max-ops 100 --concurrency 5 {pgurl:1-4} returned
		  | stderr:
		  | <... some data truncated by circular buffer; go to artifacts for details ...>
		  | elpers.go:79  [-] 3542  pgx logger [error]: Query logParams=map[args:[] err:ERROR: relation "table475" (282): primary index column "col475_486" cannot be virtual (SQLSTATE XXUUU) sql:
		  | I220402 06:26:16.019934 1 workload/pgx_helpers.go:79  [-] 3542 +SELECT max(regexp_extract(name, '[0-9]+$')::INT8)
		  | I220402 06:26:16.019934 1 workload/pgx_helpers.go:79  [-] 3542 +  FROM (
		  | I220402 06:26:16.019934 1 workload/pgx_helpers.go:79  [-] 3542 +    SELECT name
		  | I220402 06:26:16.019934 1 workload/pgx_helpers.go:79  [-] 3542 +      FROM (
		  | I220402 06:26:16.019934 1 workload/pgx_helpers.go:79  [-] 3542 +	           (SELECT table_name FROM [SHOW TABLES]) UNION
		  | I220402 06:26:16.019934 1 workload/pgx_helpers.go:79  [-] 3542 +						 (SELECT sequence_name FROM [SHOW SEQUENCES]) UNION
		  | I220402 06:26:16.019934 1 workload/pgx_helpers.go:79  [-] 3542 +						 (SELECT name FROM [SHOW ENUMS]) UNION
		  | I220402 06:26:16.019934 1 workload/pgx_helpers.go:79  [-] 3542 +	           (SELECT schema_name FROM [SHOW SCHEMAS]) UNION
		  | I220402 06:26:16.019934 1 workload/pgx_helpers.go:79  [-] 3542 +						 (SELECT column_name FROM information_schema.columns) UNION
		  | I220402 06:26:16.019934 1 workload/pgx_helpers.go:79  [-] 3542 +						 (SELECT index_name FROM information_schema.statistics)
		  | I220402 06:26:16.019934 1 workload/pgx_helpers.go:79  [-] 3542 +           ) AS obj (name)
		  | I220402 06:26:16.019934 1 workload/pgx_helpers.go:79  [-] 3542 +       )
		  | I220402 06:26:16.019934 1 workload/pgx_helpers.go:79  [-] 3542 + WHERE name ~ '^(table|view|seq|enum|schema)[0-9]+$'
		  | I220402 06:26:16.019934 1 workload/pgx_helpers.go:79  [-] 3542 +    OR name ~ '^(col|index)[0-9]+_[0-9]+$';]
		  | W220402 06:26:18.175829 1 workload/cli/run.go:423  [-] 3543  retrying after error while creating load: failed to initialize the load generator: ERROR: relation "table475" (282): primary index column "col475_486" cannot be virtual (SQLSTATE XXUUU)
		  | I220402 06:26:18.212603 1 workload/pgx_helpers.go:79  [-] 3544  pgx logger [error]: Query logParams=map[args:[] err:ERROR: relation "table475" (282): primary index column "col475_486" cannot be virtual (SQLSTATE XXUUU) sql:
		  | I220402 06:26:18.212603 1 workload/pgx_helpers.go:79  [-] 3544 +SELECT max(regexp_extract(name, '[0-9]+$')::INT8)
		  | I220402 06:26:18.212603 1 workload/pgx_helpers.go:79  [-] 3544 +  FROM (
		  | I220402 06:26:18.212603 1 workload/pgx_helpers.go:79  [-] 3544 +    SELECT name
		  | I220402 06:26:18.212603 1 workload/pgx_helpers.go:79  [-] 3544 +      FROM (
		  | I220402 06:26:18.212603 1 workload/pgx_helpers.go:79  [-] 3544 +	           (SELECT table_name FROM [SHOW TABLES]) UNION
		  | I220402 06:26:18.212603 1 workload/pgx_helpers.go:79  [-] 3544 +						 (SELECT sequence_name FROM [SHOW SEQUENCES]) UNION
		  | I220402 06:26:18.212603 1 workload/pgx_helpers.go:79  [-] 3544 +						 (SELECT name FROM [SHOW ENUMS]) UNION
		  | I220402 06:26:18.212603 1 workload/pgx_helpers.go:79  [-] 3544 +	           (SELECT schema_name FROM [SHOW SCHEMAS]) UNION
		  | I220402 06:26:18.212603 1 workload/pgx_helpers.go:79  [-] 3544 +						 (SELECT column_name FROM information_schema.columns) UNION
		  | I220402 06:26:18.212603 1 workload/pgx_helpers.go:79  [-] 3544 +						 (SELECT index_name FROM information_schema.statistics)
		  | I220402 06:26:18.212603 1 workload/pgx_helpers.go:79  [-] 3544 +           ) AS obj (name)
		  | I220402 06:26:18.212603 1 workload/pgx_helpers.go:79  [-] 3544 +       )
		  | I220402 06:26:18.212603 1 workload/pgx_helpers.go:79  [-] 3544 + WHERE name ~ '^(table|view|seq|enum|schema)[0-9]+$'
		  | I220402 06:26:18.212603 1 workload/pgx_helpers.go:79  [-] 3544 +    OR name ~ '^(col|index)[0-9]+_[0-9]+$';]
		  | E220402 06:26:18.605627 1 workload/cli/run.go:437  [-] 3545  Attempt to create load generator failed. It's been more than 1h0m0s since we started trying to create the load generator so we're giving up. Last failure: failed to initialize the load generator: ERROR: relation "table475" (282): primary index column "col475_486" cannot be virtual (SQLSTATE XXUUU)
		  | Error: failed to initialize the load generator: ERROR: relation "table475" (282): primary index column "col475_486" cannot be virtual (SQLSTATE XXUUU)
		  |
		  | stdout:
		Wraps: (4) COMMAND_PROBLEM
		Wraps: (5) Node 4. Command with error:
		  | ``````
		  | ./workload run schemachange --verbose=1 --tolerate-errors=true --max-ops 100 --concurrency 5 {pgurl:1-4}
		  | ``````
		Wraps: (6) exit status 1
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) errors.Cmd (5) *hintdetail.withDetail (6) *exec.ExitError
Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@ajwerner ajwerner added GA-blocker and removed release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. labels Apr 4, 2022
@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on release-22.1 @ bf1081a008727d4122f4c5da75c423049d0b9156:

		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:875
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1581
		Wraps: (2) output in run_052805.450121076_n3_workload_run_schemachange
		Wraps: (3) ./workload run schemachange --verbose=1 --tolerate-errors=true --max-ops 100 --concurrency 5 {pgurl:1-4} returned
		  | stderr:
		  | <... some data truncated by circular buffer; go to artifacts for details ...>
		  | elpers.go:79  [-] 3536  pgx logger [error]: Query logParams=map[args:[] err:ERROR: relation "table688" (346): primary index column "col688_699" cannot be virtual (SQLSTATE XXUUU) sql:
		  | I220405 06:28:03.815968 1 workload/pgx_helpers.go:79  [-] 3536 +SELECT max(regexp_extract(name, '[0-9]+$')::INT8)
		  | I220405 06:28:03.815968 1 workload/pgx_helpers.go:79  [-] 3536 +  FROM (
		  | I220405 06:28:03.815968 1 workload/pgx_helpers.go:79  [-] 3536 +    SELECT name
		  | I220405 06:28:03.815968 1 workload/pgx_helpers.go:79  [-] 3536 +      FROM (
		  | I220405 06:28:03.815968 1 workload/pgx_helpers.go:79  [-] 3536 +	           (SELECT table_name FROM [SHOW TABLES]) UNION
		  | I220405 06:28:03.815968 1 workload/pgx_helpers.go:79  [-] 3536 +						 (SELECT sequence_name FROM [SHOW SEQUENCES]) UNION
		  | I220405 06:28:03.815968 1 workload/pgx_helpers.go:79  [-] 3536 +						 (SELECT name FROM [SHOW ENUMS]) UNION
		  | I220405 06:28:03.815968 1 workload/pgx_helpers.go:79  [-] 3536 +	           (SELECT schema_name FROM [SHOW SCHEMAS]) UNION
		  | I220405 06:28:03.815968 1 workload/pgx_helpers.go:79  [-] 3536 +						 (SELECT column_name FROM information_schema.columns) UNION
		  | I220405 06:28:03.815968 1 workload/pgx_helpers.go:79  [-] 3536 +						 (SELECT index_name FROM information_schema.statistics)
		  | I220405 06:28:03.815968 1 workload/pgx_helpers.go:79  [-] 3536 +           ) AS obj (name)
		  | I220405 06:28:03.815968 1 workload/pgx_helpers.go:79  [-] 3536 +       )
		  | I220405 06:28:03.815968 1 workload/pgx_helpers.go:79  [-] 3536 + WHERE name ~ '^(table|view|seq|enum|schema)[0-9]+$'
		  | I220405 06:28:03.815968 1 workload/pgx_helpers.go:79  [-] 3536 +    OR name ~ '^(col|index)[0-9]+_[0-9]+$';]
		  | W220405 06:28:05.715484 1 workload/cli/run.go:423  [-] 3537  retrying after error while creating load: failed to initialize the load generator: ERROR: relation "table688" (346): primary index column "col688_699" cannot be virtual (SQLSTATE XXUUU)
		  | I220405 06:28:05.758079 1 workload/pgx_helpers.go:79  [-] 3538  pgx logger [error]: Query logParams=map[args:[] err:ERROR: relation "table688" (346): primary index column "col688_699" cannot be virtual (SQLSTATE XXUUU) sql:
		  | I220405 06:28:05.758079 1 workload/pgx_helpers.go:79  [-] 3538 +SELECT max(regexp_extract(name, '[0-9]+$')::INT8)
		  | I220405 06:28:05.758079 1 workload/pgx_helpers.go:79  [-] 3538 +  FROM (
		  | I220405 06:28:05.758079 1 workload/pgx_helpers.go:79  [-] 3538 +    SELECT name
		  | I220405 06:28:05.758079 1 workload/pgx_helpers.go:79  [-] 3538 +      FROM (
		  | I220405 06:28:05.758079 1 workload/pgx_helpers.go:79  [-] 3538 +	           (SELECT table_name FROM [SHOW TABLES]) UNION
		  | I220405 06:28:05.758079 1 workload/pgx_helpers.go:79  [-] 3538 +						 (SELECT sequence_name FROM [SHOW SEQUENCES]) UNION
		  | I220405 06:28:05.758079 1 workload/pgx_helpers.go:79  [-] 3538 +						 (SELECT name FROM [SHOW ENUMS]) UNION
		  | I220405 06:28:05.758079 1 workload/pgx_helpers.go:79  [-] 3538 +	           (SELECT schema_name FROM [SHOW SCHEMAS]) UNION
		  | I220405 06:28:05.758079 1 workload/pgx_helpers.go:79  [-] 3538 +						 (SELECT column_name FROM information_schema.columns) UNION
		  | I220405 06:28:05.758079 1 workload/pgx_helpers.go:79  [-] 3538 +						 (SELECT index_name FROM information_schema.statistics)
		  | I220405 06:28:05.758079 1 workload/pgx_helpers.go:79  [-] 3538 +           ) AS obj (name)
		  | I220405 06:28:05.758079 1 workload/pgx_helpers.go:79  [-] 3538 +       )
		  | I220405 06:28:05.758079 1 workload/pgx_helpers.go:79  [-] 3538 + WHERE name ~ '^(table|view|seq|enum|schema)[0-9]+$'
		  | I220405 06:28:05.758079 1 workload/pgx_helpers.go:79  [-] 3538 +    OR name ~ '^(col|index)[0-9]+_[0-9]+$';]
		  | E220405 06:28:06.803244 1 workload/cli/run.go:437  [-] 3539  Attempt to create load generator failed. It's been more than 1h0m0s since we started trying to create the load generator so we're giving up. Last failure: failed to initialize the load generator: ERROR: relation "table688" (346): primary index column "col688_699" cannot be virtual (SQLSTATE XXUUU)
		  | Error: failed to initialize the load generator: ERROR: relation "table688" (346): primary index column "col688_699" cannot be virtual (SQLSTATE XXUUU)
		  |
		  | stdout:
		Wraps: (4) COMMAND_PROBLEM
		Wraps: (5) Node 3. Command with error:
		  | ``````
		  | ./workload run schemachange --verbose=1 --tolerate-errors=true --max-ops 100 --concurrency 5 {pgurl:1-4}
		  | ``````
		Wraps: (6) exit status 1
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) errors.Cmd (5) *hintdetail.withDetail (6) *exec.ExitError
Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@ajwerner
Copy link
Contributor

ajwerner commented Apr 5, 2022

@chengxiong-ruan your fix should fix this.

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on release-22.1 @ 1ec23d5938e3e0a2dc4deff3fc05c2ea6b33cd80:

		  | 	main/pkg/cmd/roachtest/cluster.go:1987
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1951
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runSchemaChangeWorkloadStep.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_schemachange.go:69
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:206
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runSchemaChangeMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_schemachange.go:146
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerSchemaChangeMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_schemachange.go:38
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:875
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1581
		Wraps: (2) output in run_053052.889274172_n4_workload_run_schemachange
		Wraps: (3) ./workload run schemachange --verbose=1 --tolerate-errors=true --max-ops 100 --concurrency 5 {pgurl:1-4} returned
		  | stderr:
		  | <... some data truncated by circular buffer; go to artifacts for details ...>
		  | l tcp 10.142.0.47:26257: connect: connection refused
		  | I220406 06:30:35.431592 1 workload/pgx_helpers.go:79  [-] 3594  pgx logger [error]: connect failed logParams=map[err:dial tcp 10.142.0.47:26257: connect: connection refused]
		  | W220406 06:30:37.642345 1 workload/cli/run.go:423  [-] 3595  retrying after error while creating load: failed to initialize the load generator: dial tcp 10.142.0.47:26257: connect: connection refused
		  | I220406 06:30:37.644133 1 workload/pgx_helpers.go:79  [-] 3596  pgx logger [error]: connect failed logParams=map[err:dial tcp 10.142.0.47:26257: connect: connection refused]
		  | W220406 06:30:39.696515 1 workload/cli/run.go:423  [-] 3597  retrying after error while creating load: failed to initialize the load generator: dial tcp 10.142.0.47:26257: connect: connection refused
		  | I220406 06:30:39.698496 1 workload/pgx_helpers.go:79  [-] 3598  pgx logger [error]: connect failed logParams=map[err:dial tcp 10.142.0.47:26257: connect: connection refused]
		  | W220406 06:30:41.461824 1 workload/cli/run.go:423  [-] 3599  retrying after error while creating load: failed to initialize the load generator: dial tcp 10.142.0.47:26257: connect: connection refused
		  | I220406 06:30:41.463781 1 workload/pgx_helpers.go:79  [-] 3600  pgx logger [error]: connect failed logParams=map[err:dial tcp 10.142.0.47:26257: connect: connection refused]
		  | W220406 06:30:43.553986 1 workload/cli/run.go:423  [-] 3601  retrying after error while creating load: failed to initialize the load generator: dial tcp 10.142.0.47:26257: connect: connection refused
		  | I220406 06:30:43.555872 1 workload/pgx_helpers.go:79  [-] 3602  pgx logger [error]: connect failed logParams=map[err:dial tcp 10.142.0.47:26257: connect: connection refused]
		  | W220406 06:30:45.812491 1 workload/cli/run.go:423  [-] 3603  retrying after error while creating load: failed to initialize the load generator: dial tcp 10.142.0.47:26257: connect: connection refused
		  | I220406 06:30:45.814552 1 workload/pgx_helpers.go:79  [-] 3604  pgx logger [error]: connect failed logParams=map[err:dial tcp 10.142.0.47:26257: connect: connection refused]
		  | W220406 06:30:47.875453 1 workload/cli/run.go:423  [-] 3605  retrying after error while creating load: failed to initialize the load generator: dial tcp 10.142.0.47:26257: connect: connection refused
		  | I220406 06:30:47.877513 1 workload/pgx_helpers.go:79  [-] 3606  pgx logger [error]: connect failed logParams=map[err:dial tcp 10.142.0.47:26257: connect: connection refused]
		  | W220406 06:30:49.799434 1 workload/cli/run.go:423  [-] 3607  retrying after error while creating load: failed to initialize the load generator: dial tcp 10.142.0.47:26257: connect: connection refused
		  | I220406 06:30:49.801470 1 workload/pgx_helpers.go:79  [-] 3608  pgx logger [error]: connect failed logParams=map[err:dial tcp 10.142.0.47:26257: connect: connection refused]
		  | W220406 06:30:51.923747 1 workload/cli/run.go:423  [-] 3609  retrying after error while creating load: failed to initialize the load generator: dial tcp 10.142.0.47:26257: connect: connection refused
		  | I220406 06:30:51.925697 1 workload/pgx_helpers.go:79  [-] 3610  pgx logger [error]: connect failed logParams=map[err:dial tcp 10.142.0.47:26257: connect: connection refused]
		  | W220406 06:30:54.221443 1 workload/cli/run.go:423  [-] 3611  retrying after error while creating load: failed to initialize the load generator: dial tcp 10.142.0.47:26257: connect: connection refused
		  | I220406 06:30:54.223394 1 workload/pgx_helpers.go:79  [-] 3612  pgx logger [error]: connect failed logParams=map[err:dial tcp 10.142.0.47:26257: connect: connection refused]
		  | E220406 06:30:54.229548 1 workload/cli/run.go:437  [-] 3613  Attempt to create load generator failed. It's been more than 1h0m0s since we started trying to create the load generator so we're giving up. Last failure: failed to initialize the load generator: dial tcp 10.142.0.47:26257: connect: connection refused
		  | Error: failed to initialize the load generator: failed to connect to ``host=10.142.0.47 user=root database=schemachange``: dial error (dial tcp 10.142.0.47:26257: connect: connection refused)
		  |
		  | stdout:
		Wraps: (4) COMMAND_PROBLEM
		Wraps: (5) Node 4. Command with error:
		  | ``````
		  | ./workload run schemachange --verbose=1 --tolerate-errors=true --max-ops 100 --concurrency 5 {pgurl:1-4}
		  | ``````
		Wraps: (6) exit status 1
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) errors.Cmd (5) *hintdetail.withDetail (6) *exec.ExitError
Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@stevendanna
Copy link
Collaborator

stevendanna commented Apr 6, 2022 •
edited
Loading

It appears one of the 21.2 nodes is failing with a NPE during validate_multi_region_zone_configs

* ERROR: [n2,client=10.142.0.72:52658,hostnossl,user=root] a SQL panic has occurred while executing the following statement:
* SELECT 'validating all objects', crdb_internal.validate_multi_region_zone_configs()
*
*
* ERROR: [n2,client=10.142.0.72:52658,hostnossl,user=root] a panic has occurred!
* runtime error: invalid memory address or nil pointer dereference
* (1) attached stack trace
*   -- stack trace:
*   | github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn.func1
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:666
*   | [...repeated from below...]
* Wraps: (2) while executing: SELECT '_', crdb_internal.validate_multi_region_zone_configs()
* Wraps: (3) attached stack trace
*   -- stack trace:
*   | github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn.func1
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:666
*   | runtime.gopanic
*   | 	/usr/local/go/src/runtime/panic.go:965
*   | github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/colexecerror/error.go:58
*   | runtime.gopanic
*   | 	/usr/local/go/src/runtime/panic.go:965
*   | runtime.panicmem
*   | 	/usr/local/go/src/runtime/panic.go:212
*   | runtime.sigpanic
*   | 	/usr/local/go/src/runtime/signal_unix.go:734
*   | github.com/cockroachdb/cockroach/pkg/sql.glob..func308
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/region_util.go:562
*   | github.com/cockroachdb/cockroach/pkg/sql.(*zoneConfigForMultiRegionValidatorExistingMultiRegionObject).getExpectedTableZoneConfig
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/region_util.go:1450
*   | github.com/cockroachdb/cockroach/pkg/sql.(*planner).validateZoneConfigForMultiRegionTable
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/region_util.go:1696
*   | github.com/cockroachdb/cockroach/pkg/sql.(*planner).validateAllMultiRegionZoneConfigsInDatabase.func2
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/region_util.go:1041
*   | github.com/cockroachdb/cockroach/pkg/sql.(*planner).forEachMutableTableInDatabase
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/database.go:121
*   | github.com/cockroachdb/cockroach/pkg/sql.(*planner).validateAllMultiRegionZoneConfigsInDatabase
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/region_util.go:1037
*   | github.com/cockroachdb/cockroach/pkg/sql.(*planner).ValidateAllMultiRegionZoneConfigsInCurrentDatabase
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/region_util.go:923
*   | github.com/cockroachdb/cockroach/pkg/sql/sem/builtins.glob..func306
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/sem/builtins/builtins.go:6032
*   | github.com/cockroachdb/cockroach/pkg/sql/sem/tree.(*FuncExpr).Eval
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/sem/tree/eval.go:4237
*   | github.com/cockroachdb/cockroach/pkg/sql.(*valuesNode).startExec
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/values.go:156
*   | github.com/cockroachdb/cockroach/pkg/sql.startExec.func2
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/plan.go:509
*   | github.com/cockroachdb/cockroach/pkg/sql.(*planVisitor).visitInternal.func1
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/walk.go:112
*   | github.com/cockroachdb/cockroach/pkg/sql.(*planVisitor).visitInternal
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/walk.go:289
*   | github.com/cockroachdb/cockroach/pkg/sql.(*planVisitor).visit
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/walk.go:79
*   | github.com/cockroachdb/cockroach/pkg/sql.walkPlan
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/walk.go:43
*   | github.com/cockroachdb/cockroach/pkg/sql.startExec
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/plan.go:512
*   | github.com/cockroachdb/cockroach/pkg/sql.(*planNodeToRowSource).Start
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/plan_node_to_row_source.go:142
*   | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*FlowCoordinator).Start.func1
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/colflow/flow_coordinator.go:119
*   | github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/colexecerror/error.go:91
*   | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*FlowCoordinator).Start
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/colflow/flow_coordinator.go:118
*   | github.com/cockroachdb/cockroach/pkg/sql/execinfra.(*ProcessorBaseNoHelper).Run
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/execinfra/processorsbase.go:730
*   | github.com/cockroachdb/cockroach/pkg/sql/flowinfra.(*FlowBase).Run
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/flowinfra/flow.go:447
*   | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*vectorizedFlow).Run
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/colflow/vectorized_flow.go:245
*   | github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).Run
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:548
*   | github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRun
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:1289
*   | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithDistSQLEngine
*   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:1381
* Wraps: (4) runtime error: invalid memory address or nil pointer dereference
* Error types: (1) *withstack.withStack (2) *safedetails.withSafeDetails (3) *withstack.withStack (4) runtime.errorString
*

@fqazi
Copy link
Collaborator

fqazi commented Apr 6, 2022

@stevendanna Let me try and root cause this one, there isn't any obvious validation difference between the two versions

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on release-22.1 @ 5d1063406d48c2713e0a7a8421f1946349b3db65:

		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:875
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1581
		Wraps: (2) output in run_052947.945375659_n3_workload_run_schemachange
		Wraps: (3) ./workload run schemachange --verbose=1 --tolerate-errors=true --max-ops 100 --concurrency 5 {pgurl:1-4} returned
		  | stderr:
		  | <... some data truncated by circular buffer; go to artifacts for details ...>
		  | -] 3536  pgx logger [error]: Query logParams=map[args:[] err:ERROR: relation "table1451" (555): primary index column "col1451_1461" cannot be virtual (SQLSTATE XXUUU) sql:
		  | I220407 06:29:45.814129 1 workload/pgx_helpers.go:79  [-] 3536 +SELECT max(regexp_extract(name, '[0-9]+$')::INT8)
		  | I220407 06:29:45.814129 1 workload/pgx_helpers.go:79  [-] 3536 +  FROM (
		  | I220407 06:29:45.814129 1 workload/pgx_helpers.go:79  [-] 3536 +    SELECT name
		  | I220407 06:29:45.814129 1 workload/pgx_helpers.go:79  [-] 3536 +      FROM (
		  | I220407 06:29:45.814129 1 workload/pgx_helpers.go:79  [-] 3536 +	           (SELECT table_name FROM [SHOW TABLES]) UNION
		  | I220407 06:29:45.814129 1 workload/pgx_helpers.go:79  [-] 3536 +						 (SELECT sequence_name FROM [SHOW SEQUENCES]) UNION
		  | I220407 06:29:45.814129 1 workload/pgx_helpers.go:79  [-] 3536 +						 (SELECT name FROM [SHOW ENUMS]) UNION
		  | I220407 06:29:45.814129 1 workload/pgx_helpers.go:79  [-] 3536 +	           (SELECT schema_name FROM [SHOW SCHEMAS]) UNION
		  | I220407 06:29:45.814129 1 workload/pgx_helpers.go:79  [-] 3536 +						 (SELECT column_name FROM information_schema.columns) UNION
		  | I220407 06:29:45.814129 1 workload/pgx_helpers.go:79  [-] 3536 +						 (SELECT index_name FROM information_schema.statistics)
		  | I220407 06:29:45.814129 1 workload/pgx_helpers.go:79  [-] 3536 +           ) AS obj (name)
		  | I220407 06:29:45.814129 1 workload/pgx_helpers.go:79  [-] 3536 +       )
		  | I220407 06:29:45.814129 1 workload/pgx_helpers.go:79  [-] 3536 + WHERE name ~ '^(table|view|seq|enum|schema)[0-9]+$'
		  | I220407 06:29:45.814129 1 workload/pgx_helpers.go:79  [-] 3536 +    OR name ~ '^(col|index)[0-9]+_[0-9]+$';]
		  | W220407 06:29:47.713220 1 workload/cli/run.go:423  [-] 3537  retrying after error while creating load: failed to initialize the load generator: ERROR: relation "table1451" (555): primary index column "col1451_1461" cannot be virtual (SQLSTATE XXUUU)
		  | I220407 06:29:47.754813 1 workload/pgx_helpers.go:79  [-] 3538  pgx logger [error]: Query logParams=map[args:[] err:ERROR: relation "table1451" (555): primary index column "col1451_1461" cannot be virtual (SQLSTATE XXUUU) sql:
		  | I220407 06:29:47.754813 1 workload/pgx_helpers.go:79  [-] 3538 +SELECT max(regexp_extract(name, '[0-9]+$')::INT8)
		  | I220407 06:29:47.754813 1 workload/pgx_helpers.go:79  [-] 3538 +  FROM (
		  | I220407 06:29:47.754813 1 workload/pgx_helpers.go:79  [-] 3538 +    SELECT name
		  | I220407 06:29:47.754813 1 workload/pgx_helpers.go:79  [-] 3538 +      FROM (
		  | I220407 06:29:47.754813 1 workload/pgx_helpers.go:79  [-] 3538 +	           (SELECT table_name FROM [SHOW TABLES]) UNION
		  | I220407 06:29:47.754813 1 workload/pgx_helpers.go:79  [-] 3538 +						 (SELECT sequence_name FROM [SHOW SEQUENCES]) UNION
		  | I220407 06:29:47.754813 1 workload/pgx_helpers.go:79  [-] 3538 +						 (SELECT name FROM [SHOW ENUMS]) UNION
		  | I220407 06:29:47.754813 1 workload/pgx_helpers.go:79  [-] 3538 +	           (SELECT schema_name FROM [SHOW SCHEMAS]) UNION
		  | I220407 06:29:47.754813 1 workload/pgx_helpers.go:79  [-] 3538 +						 (SELECT column_name FROM information_schema.columns) UNION
		  | I220407 06:29:47.754813 1 workload/pgx_helpers.go:79  [-] 3538 +						 (SELECT index_name FROM information_schema.statistics)
		  | I220407 06:29:47.754813 1 workload/pgx_helpers.go:79  [-] 3538 +           ) AS obj (name)
		  | I220407 06:29:47.754813 1 workload/pgx_helpers.go:79  [-] 3538 +       )
		  | I220407 06:29:47.754813 1 workload/pgx_helpers.go:79  [-] 3538 + WHERE name ~ '^(table|view|seq|enum|schema)[0-9]+$'
		  | I220407 06:29:47.754813 1 workload/pgx_helpers.go:79  [-] 3538 +    OR name ~ '^(col|index)[0-9]+_[0-9]+$';]
		  | E220407 06:29:49.301986 1 workload/cli/run.go:437  [-] 3539  Attempt to create load generator failed. It's been more than 1h0m0s since we started trying to create the load generator so we're giving up. Last failure: failed to initialize the load generator: ERROR: relation "table1451" (555): primary index column "col1451_1461" cannot be virtual (SQLSTATE XXUUU)
		  | Error: failed to initialize the load generator: ERROR: relation "table1451" (555): primary index column "col1451_1461" cannot be virtual (SQLSTATE XXUUU)
		  |
		  | stdout:
		Wraps: (4) COMMAND_PROBLEM
		Wraps: (5) Node 3. Command with error:
		  | ``````
		  | ./workload run schemachange --verbose=1 --tolerate-errors=true --max-ops 100 --concurrency 5 {pgurl:1-4}
		  | ``````
		Wraps: (6) exit status 1
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) errors.Cmd (5) *hintdetail.withDetail (6) *exec.ExitError
Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@ajwerner
Copy link
Contributor

Fixed by #79609

@exalate-issue-sync exalate-issue-sync bot added T-sql-foundations SQL Foundations Team (formerly SQL Schema + SQL Sessions) and removed T-sql-schema-deprecated Use T-sql-foundations instead labels May 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@chengxiong-ruan chengxiong-ruan

Labels
branch-release-22.1 Used to mark GA and release blockers, technical advisories, and bugs for 22.1 C-test-failure Broken test (automatically or manually discovered). GA-blocker O-roachtest O-robot Originated from a bot. T-sql-foundations SQL Foundations Team (formerly SQL Schema + SQL Sessions)
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
6 participants
@jlinder @stevendanna @fqazi @ajwerner @chengxiong-ruan @cockroach-teamcity