Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

roachtest: schemachange/mixed-versions failed [index contains stored column "" with unknown ID 0] #129395

Closed
cockroach-teamcity opened this issue Aug 21, 2024 · 32 comments
Assignees
Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. P-2 Issues/test failures with a fix SLA of 3 months T-sql-foundations SQL Foundations Team (formerly SQL Schema + SQL Sessions)

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Aug 21, 2024

roachtest.schemachange/mixed-versions failed with artifacts on master @ f1a5aa8a633636138fededdf46a8dcc20f899a48:

(mixedversion.go:710).Run: mixed-version test failure while running step 22 (run "run schemachange workload and validation in mixed version"): full command output in run_091011.234416824_n4_COCKROACHRANDOMSEED3.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

/cc @cockroachdb/sql-foundations

This test on roachdash | Improve this report!

Jira issue: CRDB-41520

@cockroach-teamcity cockroach-teamcity added branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-sql-foundations SQL Foundations Team (formerly SQL Schema + SQL Sessions) labels Aug 21, 2024
@rafiss
Copy link
Collaborator

rafiss commented Aug 21, 2024

{
 "workerId": 4,
 "clientTimestamp": "09:10:53.727297",
 "ops": [
  "BEGIN",
  {
   "sql": "CREATE INDEX index_w0_112_w4_613 ON public.table_w0_112 (col112_w0_116, col112_w0_114, \"co\tl1̏12 _w0_113\") STORING (\"co\\\\U0000B125l112_w0_115\", \"co'l112_w0_117\", col11😮2_w0_118)",
   "expectedExecErr": "42701"
  }
 ],
 "expectedExecErrors": "42701",
 "expectedCommitErrors": "",
 "message": "***UNEXPECTED ERROR; Received an unexpected execution error.: ERROR: error executing StatementPhase stage 1 of 1 with 15 MutationType ops: relation \"table_w0_112\" (253): index \"index_w0_112_w4_613\" contains stored column \"\" with unknown ID 0 (SQLSTATE XXUUU)",
 "errorState": {
  "expectedErrors": [
   "42701"
  ],

table definition is

   "sql": "CREATE TABLE IF NOT EXISTS public.table_w0_112 (\"co\tl1�12 _w0_113\" STRING COLLATE en_US NOT NULL, col112_w0_114 JSONB NOT NULL, \"co\\\\U0000B125l112_w0_115\" STRING COLLATE en_US NOT NULL, col112_w0_116 CHAR, \"co'l112_w0_117\" NAME NULL, col11😮2_w0_118 STRING NOT NULL AS (lower(CAST(\"co\\\\U0000B125l112_w0_115\" AS STRING))) STORED, PRIMARY KEY (\"co\\\\U0000B125l112_w0_115\" ASC), INVERTED INDEX (col112_w0_116, \"co\\\\U0000B125l112_w0_115\", col11😮2_w0_118 gin_trgm_ops ASC), INDEX (\"co\tl1�12 _w0_113\" DESC), INDEX (col112_w0_114 ASC), UNIQUE (col11😮2_w0_118, col112_w0_114 DESC), INDEX (col11😮2_w0_118 DESC) VISIBILITY 0.06, INDEX (\"co\\\\U0000B125l112_w0_115\" DESC, col112_w0_116 ASC, lower(CAST(\"co\tl1�12 _w0_113\" AS STRING)) DESC), UNIQUE (col11😮2_w0_118 DESC) STORING (\"co\tl1�12 _w0_113\", col112_w0_114, \"co'l112_w0_117\"), INDEX (col11😮2_w0_118 DESC), UNIQUE (lower(col112_w0_116)))"

fixed by #128240, but that doesn't yet appear in a 24.2 release, so this mixed-version test is hitting the old buggy behavior.

@rafiss rafiss changed the title roachtest: schemachange/mixed-versions failed roachtest: schemachange/mixed-versions failed [index contains stored column "" with unknown ID 0] Aug 21, 2024
@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ 18c4e23306bb99cc28c83bb3e5726f6f4279b798:

(mixedversion.go:710).Run: mixed-version test failure while running step 11 (run "run schemachange workload and validation in mixed version"): full command output in run_114157.173928783_n4_COCKROACHRANDOMSEED8.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ a8f64695f5d025a3347c27ed03ee0e36fbdaacd3:

(mixedversion.go:710).Run: mixed-version test failure while running step 7 (run "run schemachange workload and validation in mixed version"): full command output in run_064726.902607199_n4_COCKROACHRANDOMSEED5.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

  • ROACHTEST_arch=arm64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ 9e48858c6c8b22af4ec1159bcff6e233e7bfddff:

(mixedversion.go:710).Run: mixed-version test failure while running step 26 (run "run schemachange workload and validation after upgrade has finalized"): full command output in run_072022.384529363_n4_COCKROACHRANDOMSEED2.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

  • ROACHTEST_arch=arm64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ 9e48858c6c8b22af4ec1159bcff6e233e7bfddff:

(mixedversion.go:710).Run: mixed-version test failure while running step 13 (run "run schemachange workload and validation in mixed version"): full command output in run_064359.288895260_n4_COCKROACHRANDOMSEED8.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

  • ROACHTEST_arch=arm64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ 6866fbf2dd02a298362f888ee9dc95cb19709d3f:

(mixedversion.go:710).Run: mixed-version test failure while running step 18 (run "run schemachange workload and validation in mixed version"): full command output in run_060838.413114988_n4_COCKROACHRANDOMSEED6.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

  • ROACHTEST_arch=arm64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

This test on roachdash | Improve this report!

@rafiss rafiss self-assigned this Aug 27, 2024
@rafiss
Copy link
Collaborator

rafiss commented Aug 27, 2024

latest failure is

Error: ***UNEXPECTED ERROR; Received an unexpected execution error.: ERROR: column "nan" does not exist (SQLSTATE 42703)

it's fixed by #129087, but that needs to appear in a predecessor patch version to fix this mixed-version test.

@rafiss rafiss added P-2 Issues/test failures with a fix SLA of 3 months and removed release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. labels Aug 27, 2024
@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ 8551145a0c99c4c95a28ec470e699d0c20ca97ab:

(mixedversion.go:710).Run: mixed-version test failure while running step 14 (run "run schemachange workload and validation in mixed version"): full command output in run_062910.087079452_n4_COCKROACHRANDOMSEED6.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ 8551145a0c99c4c95a28ec470e699d0c20ca97ab:

(mixedversion.go:710).Run: mixed-version test failure while running step 18 (run "run schemachange workload and validation in mixed version"): full command output in run_073508.306106308_n4_COCKROACHRANDOMSEED4.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ fa9c0528fc0d06be1b4cfc534ec0501448111fbe:

(mixedversion.go:710).Run: mixed-version test failure while running step 29 (run "run schemachange workload and validation after upgrade has finalized"): full command output in run_064238.971315577_n4_COCKROACHRANDOMSEED7.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ 00edd9c46e7f3638846d0dc182a9dd50a0aa9cbc:

(mixedversion.go:710).Run: mixed-version test failure while running step 19 (run "run schemachange workload and validation in mixed version"): full command output in run_065647.235482212_n4_COCKROACHRANDOMSEED3.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ 66ff4329d380562ec95466ba108b72be721ff6c9:

(mixedversion.go:710).Run: mixed-version test failure while running step 10 (run "run schemachange workload and validation in mixed version"): full command output in run_080247.573730361_n4_COCKROACHRANDOMSEED3.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

  • ROACHTEST_arch=arm64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ 3f8226eb7f09eb93c26dda4cd47e023a8f56ea23:

(mixedversion.go:710).Run: mixed-version test failure while running step 17 (run "run schemachange workload and validation in mixed version"): full command output in run_070830.998445215_n4_COCKROACHRANDOMSEED4.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

  • ROACHTEST_arch=arm64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ 128fcab4c07413513a05aea1d1494943f4bc3092:

(mixedversion.go:710).Run: mixed-version test failure while running step 24 (run "run schemachange workload and validation in mixed version"): full command output in run_082545.617281560_n4_COCKROACHRANDOMSEED3.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ cba4e7f1fb6a3963c302cc82a58c42da67adc613:

(mixedversion.go:720).Run: mixed-version test failure while running step 11 (run "run schemachange workload and validation in mixed version"): full command output in run_083541.346825902_n4_COCKROACHRANDOMSEED8.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

  • ROACHTEST_arch=arm64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ d8f9982677c207b9fda6364c0e47d9618f686141:

(mixedversion.go:720).Run: mixed-version test failure while running step 14 (run "run schemachange workload and validation in mixed version"): full command output in run_070351.992790861_n4_COCKROACHRANDOMSEED2.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ a055dec86299452f1951416c16f5938e523f8559:

(mixedversion.go:720).Run: mixed-version test failure while running step 20 (run "run schemachange workload and validation in mixed version"): full command output in run_064517.179948104_n4_COCKROACHRANDOMSEED8.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ a055dec86299452f1951416c16f5938e523f8559:

(mixedversion.go:720).Run: mixed-version test failure while running step 19 (run "run schemachange workload and validation in mixed version"): full command output in run_082826.531768336_n4_COCKROACHRANDOMSEED8.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ a44a9b1ffce25f51026b494a1dcb393cfc5361f3:

(mixedversion.go:754).Run: mixed-version test failure while running step 40 (run "run schemachange workload and validation in mixed version"): full command output in run_105904.471082944_n4_COCKROACHRANDOMSEED5.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

Note: This build has runtime assertions enabled. If the same failure was hit in a run without assertions enabled, there should be a similar failure without this message. If there isn't one, then this failure is likely due to an assertion violation or (assertion) timeout.

roachtest.schemachange/mixed-versions failed with artifacts on master @ 688e82e8d015350fe3aa263484416d28b232a25d:

(mixedversion.go:754).Run: mixed-version test failure while running step 20 (run "run schemachange workload and validation in mixed version"): full command output in run_075917.271119332_n4_COCKROACHRANDOMSEED5.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=true
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ 8f5366d09e6cf2144ca43f9cdda7e1128a13fbf8:

(mixedversion.go:754).Run: mixed-version test failure while running step 12 (run "run schemachange workload and validation in mixed version"): full command output in run_081345.148047055_n4_COCKROACHRANDOMSEED8.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/cpu_arch=arm64/run_1

Parameters:

  • ROACHTEST_arch=arm64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ 8f5366d09e6cf2144ca43f9cdda7e1128a13fbf8:

(mixedversion.go:754).Run: mixed-version test failure while running step 10 (run "run schemachange workload and validation in mixed version"): full command output in run_080143.357061165_n4_COCKROACHRANDOMSEED2.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=azure
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ ea4644b040dd4503f2eb7292cfebc31a58fd16fb:

(mixedversion.go:754).Run: mixed-version test failure while running step 17 (run "run schemachange workload and validation in mixed version"): full command output in run_095627.512670950_n4_COCKROACHRANDOMSEED1.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

Note: This build has runtime assertions enabled. If the same failure was hit in a run without assertions enabled, there should be a similar failure without this message. If there isn't one, then this failure is likely due to an assertion violation or (assertion) timeout.

roachtest.schemachange/mixed-versions failed with artifacts on master @ 28e473bec7cb6f8b0a1c8147efce4a662bcdf124:

(mixedversion.go:754).Run: mixed-version test failure while running step 16 (run "run schemachange workload and validation in mixed version"): full command output in run_121240.400231339_n4_COCKROACHRANDOMSEED3.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_runtimeAssertionsBuild=true
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

Note: This build has runtime assertions enabled. If the same failure was hit in a run without assertions enabled, there should be a similar failure without this message. If there isn't one, then this failure is likely due to an assertion violation or (assertion) timeout.

roachtest.schemachange/mixed-versions failed with artifacts on master @ 39e43b85ec3b02bc760df10fce1c19d09419d6f2:

(mixedversion.go:759).Run: mixed-version test failure while running step 12 (run "run schemachange workload and validation in mixed version"): full command output in run_092804.917025778_n4_COCKROACHRANDOMSEED7.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

  • arch=amd64
  • cloud=gce
  • coverageBuild=false
  • cpu=4
  • encrypted=false
  • mvtDeploymentMode=separate-process
  • mvtVersions=v24.2.4 → master
  • runtimeAssertionsBuild=true
  • ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

Note: This build has runtime assertions enabled. If the same failure was hit in a run without assertions enabled, there should be a similar failure without this message. If there isn't one, then this failure is likely due to an assertion violation or (assertion) timeout.

roachtest.schemachange/mixed-versions failed with artifacts on master @ e83bc46aa42f2476b4b11b9703b8038c660dc980:

(mixedversion.go:759).Run: mixed-version test failure while running step 11 (run "run schemachange workload and validation in mixed version"): full command output in run_074813.114719607_n4_COCKROACHRANDOMSEED5.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

  • arch=amd64
  • cloud=gce
  • coverageBuild=false
  • cpu=4
  • encrypted=false
  • fs=ext4
  • localSSD=true
  • mvtDeploymentMode=shared-process
  • mvtVersions=v24.2.4 → master
  • runtimeAssertionsBuild=true
  • ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.schemachange/mixed-versions failed with artifacts on master @ a5ab06046e817627cd0b64390f4ede0c4a5d82ef:

(mixedversion.go:759).Run: mixed-version test failure while running step 18 (run "run schemachange workload and validation in mixed version"): full command output in run_075620.825436785_n4_COCKROACHRANDOMSEED3.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/schemachange/mixed-versions/run_1

Parameters:

  • arch=amd64
  • cloud=gce
  • coverageBuild=false
  • cpu=4
  • encrypted=false
  • mvtDeploymentMode=shared-process
  • mvtVersions=v24.2.4 → master
  • runtimeAssertionsBuild=false
  • ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

This test on roachdash | Improve this report!

@rafiss
Copy link
Collaborator

rafiss commented Nov 19, 2024

The latest failures are

{
 "workerId": 4,
 "clientTimestamp": "07:57:24.887059",
 "ops": [
  "BEGIN",
  {
   "sql": "ALTER TABLE schema_w0_662.table_w1_768 RENAME COLUMN col768_w1_770 TO col_w1_768_w4_842"
  },
  {
   "sql": "ALTER FUNCTION public.udf_w2_1109(public._composite_w1_326, public._composite_w4_1, public._enum_w1_60, public._enum_w3_225, public.composite_w1_326, public.composite_w4_1, public.enum_w1_60, public.enum_w3_225, schema_w3_70._enum_w2_337, schema_w3_70._enum_w3_840, schema_w3_70.enum_w2_337, schema_w3_70.enum_w3_840, schema_w4_127._composite_w2_402, schema_w4_127.composite_w2_402, schema_w1_93._composite_w0_143, schema_w1_93._enum_w2_558, schema_w1_93.composite_w0_143, schema_w1_93.enum_w2_558, schema_w1_265._composite_w0_409, schema_w1_265._composite_w2_511, schema_w1_265.composite_w0_409, schema_w1_265.composite_w2_511, \"char\", BOOL, BOX2D, BPCHAR, BYTES, STRING, DATE, DECIMAL, FLOAT8, GEOGRAPHY, GEOMETRY, INET, INT8, INT2, INT2VECTOR, INT8, INTERVAL, JSONB, NAME, OIDVECTOR) SET SCHEMA schema_w2_627"
  }
 ],
 "expectedExecErrors": "",
 "expectedCommitErrors": "",
 "message": "***UNEXPECTED ERROR; Received an unexpected execution error.: ERROR: function udf_w2_1109(composite_w1_326[],composite_w4_1[],enum_w1_60[],enum_w3_225[],composite_w1_326,composite_w4_1,enum_w1_60,enum_w3_225,enum_w2_337[],enum_w3_840[],enum_w2_337,enum_w3_840,composite_w2_402[],composite_w2_402,composite_w0_143[],enum_w2_558[],composite_w0_143,enum_w2_558,composite_w0_409[],composite_w2_511[],composite_w0_409,composite_w2_511,\"char\",bool,box2d,char,bytes,string,date,decimal,float,geography,geometry,inet,int,int2,int2vector,int,interval,jsonb,name,oidvector) does not exist (SQLSTATE 42883)",
 "errorState": {

This seems to be the same type of failure that @spilchen described in #133016 (comment).

The mixed-version-test.log shows:

[mixed-version-test] 2024/11/17 07:52:11 mixedversion.go:751: mixed-version test:
Seed:               401115961124498153
Upgrades:           v24.2.4 → master
Deployment mode:    shared-process

However, the related fix (#130889) first appears in v24.2.5, which was just released today. Going forwards, this mixed version test will use v24.2.5 and should not encounter this issue.

@rafiss rafiss closed this as completed Nov 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. P-2 Issues/test failures with a fix SLA of 3 months T-sql-foundations SQL Foundations Team (formerly SQL Schema + SQL Sessions)
Projects
No open projects
Status: Triage
Development

No branches or pull requests

2 participants