Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bank: cluster-recovery and node-restart are throughly flaky or broken #57002

Closed
jordanlewis opened this issue Nov 22, 2020 · 1 comment · Fixed by #57003
Closed

bank: cluster-recovery and node-restart are throughly flaky or broken #57002

jordanlewis opened this issue Nov 22, 2020 · 1 comment · Fixed by #57003
Labels
C-test-failure Broken test (automatically or manually discovered).

Comments

@jordanlewis
Copy link
Member

These tests are consistently failing. Here are 2 separate, unrelated PRs that can't be merged because of the tests:

#56940
#56963

Here is the test history:

https://teamcity.cockroachdb.com/viewType.html?buildTypeId=Cockroach_UnitTests_Roachtest&branch_Cockroach_UnitTests=staging&tab=buildTypeHistoryList

It's clear that it got flaky very recently, but nothing is jumping out at me.

cc @yuzefovich @nvanbenschoten

@jordanlewis jordanlewis added the C-test-failure Broken test (automatically or manually discovered). label Nov 22, 2020
@jordanlewis
Copy link
Member Author

jordanlewis commented Nov 22, 2020

Actually, I'm fairly sure it's caused by #56437, so tagging @nkodali and @knz.

The reason that I think it's related is that all test failures have this in the logs:

* ERROR: ERROR: admin-set-ui-data: result is ambiguous (error=unable to dial n3: breaker open [exhausted])
* SQLSTATE: 40003
*
ERROR: admin-set-ui-data: result is ambiguous (error=unable to dial n3: breaker open [exhausted])
SQLSTATE: 40003
Failed running "start"

I'll send a PR to revert #56437 for now, since it's unfortunately seeming to be blocking a bunch of merges.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-test-failure Broken test (automatically or manually discovered).
Projects
None yet
1 participant