Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

server: TestClusterVersionUpgrade failed #99784

Closed
cockroach-teamcity opened this issue Mar 28, 2023 · 13 comments · Fixed by #100922
Closed

server: TestClusterVersionUpgrade failed #99784

cockroach-teamcity opened this issue Mar 28, 2023 · 13 comments · Fixed by #100922
Assignees
Labels
A-jobs branch-release-23.1 Used to mark GA and release blockers, technical advisories, and bugs for 23.1 C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. T-jobs
Milestone

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Mar 28, 2023

server.TestClusterVersionUpgrade failed with artifacts on release-23.1 @ 3551dc089ac3efcb3772df2109164dcb01e79d8f:

=== RUN   TestClusterVersionUpgrade
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade867280458
    test_log_scope.go:79: use -show-logs to present logs inline
    version_cluster_test.go:259: condition failed to evaluate within 45s: cluster version is still 1000022.2-90, should be 1000022.2-94
    panic.go:522: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade867280458
--- FAIL: TestClusterVersionUpgrade (48.63s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

/cc @cockroachdb/server

This test on roachdash | Improve this report!

Jira issue: CRDB-26077

@cockroach-teamcity cockroach-teamcity added branch-release-23.1 Used to mark GA and release blockers, technical advisories, and bugs for 23.1 C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. labels Mar 28, 2023
@cockroach-teamcity cockroach-teamcity added this to the 23.1 milestone Mar 28, 2023
@blathers-crl blathers-crl bot added the T-server-and-security DB Server & Security label Mar 28, 2023
@knz knz added GA-blocker T-jobs and removed T-server-and-security DB Server & Security labels Mar 28, 2023
@blathers-crl blathers-crl bot added the A-jobs label Mar 28, 2023
@cockroach-teamcity
Copy link
Member Author

server.TestClusterVersionUpgrade failed with artifacts on release-23.1 @ a34af06d8e7230e4052db80d55da21a06013f81b:

=== RUN   TestClusterVersionUpgrade
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade1766119000
    test_log_scope.go:79: use -show-logs to present logs inline
    version_cluster_test.go:259: condition failed to evaluate within 45s: cluster version is still 1000022.2-90, should be 1000022.2-94
    panic.go:522: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade1766119000
--- FAIL: TestClusterVersionUpgrade (48.36s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@knz
Copy link
Contributor

knz commented Mar 29, 2023

This is slowness due to the deadlock detector. Let's skip it in that case.

@cockroach-teamcity
Copy link
Member Author

server.TestClusterVersionUpgrade failed with artifacts on release-23.1 @ aec78f33d45a8376a0ecec885688bae60dbfb85c:

=== RUN   TestClusterVersionUpgrade
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade638750292
    test_log_scope.go:79: use -show-logs to present logs inline
    version_cluster_test.go:259: condition failed to evaluate within 45s: cluster version is still 1000022.2-90, should be 1000022.2-94
    panic.go:522: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade638750292
--- FAIL: TestClusterVersionUpgrade (48.52s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

server.TestClusterVersionUpgrade failed with artifacts on release-23.1 @ 7e72aae900c3ff4b44f1643c2d7ba55fbb2cbe23:

=== RUN   TestClusterVersionUpgrade
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade2602651846
    test_log_scope.go:79: use -show-logs to present logs inline
    version_cluster_test.go:259: condition failed to evaluate within 45s: cluster version is still 1000022.2-82, should be 1000022.2-94
    panic.go:522: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade2602651846
--- FAIL: TestClusterVersionUpgrade (48.43s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

server.TestClusterVersionUpgrade failed with artifacts on release-23.1 @ 5d5abe704b0551556c35d51aa673d3162f493aa8:

=== RUN   TestClusterVersionUpgrade
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade2495400002
    test_log_scope.go:79: use -show-logs to present logs inline
    version_cluster_test.go:259: condition failed to evaluate within 45s: cluster version is still 1000022.2-70, should be 1000022.2-96
    panic.go:522: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade2495400002
--- FAIL: TestClusterVersionUpgrade (48.72s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

server.TestClusterVersionUpgrade failed with artifacts on release-23.1 @ 63b683eab3e0ebfff812bb54fdac936c101d9383:

=== RUN   TestClusterVersionUpgrade
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade3759419551
    test_log_scope.go:79: use -show-logs to present logs inline
    version_cluster_test.go:259: condition failed to evaluate within 45s: cluster version is still 1000022.2-74, should be 1000022.2-98
    panic.go:522: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade3759419551
--- FAIL: TestClusterVersionUpgrade (49.03s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

server.TestClusterVersionUpgrade failed with artifacts on release-23.1 @ 63b683eab3e0ebfff812bb54fdac936c101d9383:

=== RUN   TestClusterVersionUpgrade
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade3289630894
    test_log_scope.go:79: use -show-logs to present logs inline
    version_cluster_test.go:259: condition failed to evaluate within 45s: cluster version is still 1000022.2-74, should be 1000022.2-98
    panic.go:522: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade3289630894
--- FAIL: TestClusterVersionUpgrade (48.96s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

server.TestClusterVersionUpgrade failed with artifacts on release-23.1 @ e847e4358c004d4a8977ae26749768ad1d417fba:

=== RUN   TestClusterVersionUpgrade
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade1590784602
    test_log_scope.go:79: use -show-logs to present logs inline
    version_cluster_test.go:259: condition failed to evaluate within 45s: cluster version is still 1000022.2-72, should be 1000022.2-98
    panic.go:522: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade1590784602
--- FAIL: TestClusterVersionUpgrade (49.14s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

server.TestClusterVersionUpgrade failed with artifacts on release-23.1 @ b432e8c20339de5cfa7c811a9ee6f5dc98d15a1e:

=== RUN   TestClusterVersionUpgrade
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade485808879
    test_log_scope.go:79: use -show-logs to present logs inline
    version_cluster_test.go:259: condition failed to evaluate within 45s: cluster version is still 1000022.2-52, should be 1000022.2-98
    panic.go:522: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade485808879
--- FAIL: TestClusterVersionUpgrade (49.79s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

server.TestClusterVersionUpgrade failed with artifacts on release-23.1 @ 571a1744c72415894dc0e742bd89e74938ea71f4:

=== RUN   TestClusterVersionUpgrade
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade1245085385
    test_log_scope.go:79: use -show-logs to present logs inline
    version_cluster_test.go:259: condition failed to evaluate within 45s: cluster version is still 22.2-66, should be 22.2-98
    panic.go:522: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade1245085385
--- FAIL: TestClusterVersionUpgrade (49.27s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

server.TestClusterVersionUpgrade failed with artifacts on release-23.1 @ de239a7438f44d382c9aefceb65d9c39911dabd2:

=== RUN   TestClusterVersionUpgrade
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade3817485600
    test_log_scope.go:79: use -show-logs to present logs inline
    version_cluster_test.go:259: condition failed to evaluate within 45s: cluster version is still 22.2-72, should be 22.2-98
    panic.go:522: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade3817485600
--- FAIL: TestClusterVersionUpgrade (49.16s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

server.TestClusterVersionUpgrade failed with artifacts on release-23.1 @ de239a7438f44d382c9aefceb65d9c39911dabd2:

=== RUN   TestClusterVersionUpgrade
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade576472633
    test_log_scope.go:79: use -show-logs to present logs inline
    version_cluster_test.go:259: condition failed to evaluate within 45s: cluster version is still 22.2-70, should be 22.2-98
    panic.go:522: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade576472633
--- FAIL: TestClusterVersionUpgrade (49.07s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

server.TestClusterVersionUpgrade failed with artifacts on release-23.1 @ 2f96695f75b07c872ec5f146acc1fa198135768f:

=== RUN   TestClusterVersionUpgrade
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade2436920118
    test_log_scope.go:79: use -show-logs to present logs inline
    version_cluster_test.go:259: condition failed to evaluate within 45s: cluster version is still 22.2-78, should be 22.2-98
    panic.go:522: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/5b2c9b3a394428c7572d34050aad8975/logTestClusterVersionUpgrade2436920118
--- FAIL: TestClusterVersionUpgrade (48.80s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-jobs branch-release-23.1 Used to mark GA and release blockers, technical advisories, and bugs for 23.1 C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. T-jobs
Projects
None yet
3 participants