Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

storage: de-flake TestReplicateQueueDownReplicate #39630

Merged
merged 1 commit into from
Aug 13, 2019

Conversation

tbg
Copy link
Member

@tbg tbg commented Aug 13, 2019

Reproduced via

make stressrace PKG=./pkg/storage/ TESTS=TestReplicateQueueDownReplicate STRESSFLAGS='-stderr=false -p 12'

in a few minutes (on a gceworker).

The test would sometimes fail since the range log verification was
overly aggressive in the sense that it would fail on all but the
expected reasons. However we have learners now and sometimes they're
rolled back, which also causes events.

The range log checks were overly complicated to, so boil them down a
bunch to something more manageable.

Release note: None

Reproduced via

```
make stressrace PKG=./pkg/storage/ TESTS=TestReplicateQueueDownReplicate STRESSFLAGS='-stderr=false -p 12'
```

in a few minutes (on a gceworker).

The test would sometimes fail since the range log verification was
overly aggressive in the sense that it would fail on all but the
expected reasons. However we have learners now and sometimes they're
rolled back, which also causes events.

The range log checks were overly complicated to, so boil them down a
bunch to something more manageable.

Release note: None
@cockroach-teamcity
Copy link
Member

This change is Reviewable

@tbg tbg requested a review from danhhz August 13, 2019 16:35
@tbg
Copy link
Member Author

tbg commented Aug 13, 2019

TFTR!

bors r=danhhz

@craig
Copy link
Contributor

craig bot commented Aug 13, 2019

Build failed

@danhhz
Copy link
Contributor

danhhz commented Aug 13, 2019

bank.go:387,bank.go:502,acceptance.go:69,test_runner.go:691: after 2.7s: pq: cannot transfer lease to replica of type LEARNER

looks like the test tries to manually run EXPERIMENTAL_RELOCATE, so I could see us getting this error from there

@danhhz
Copy link
Contributor

danhhz commented Aug 13, 2019

I'll look into that flake separately, but it's not an issue introduced by this deflake

bors r+

craig bot pushed a commit that referenced this pull request Aug 13, 2019
39630: storage: de-flake TestReplicateQueueDownReplicate r=danhhz a=tbg

Reproduced via

```
make stressrace PKG=./pkg/storage/ TESTS=TestReplicateQueueDownReplicate STRESSFLAGS='-stderr=false -p 12'
```

in a few minutes (on a gceworker).

The test would sometimes fail since the range log verification was
overly aggressive in the sense that it would fail on all but the
expected reasons. However we have learners now and sometimes they're
rolled back, which also causes events.

The range log checks were overly complicated to, so boil them down a
bunch to something more manageable.

Release note: None

Co-authored-by: Tobias Schottdorf <[email protected]>
@craig
Copy link
Contributor

craig bot commented Aug 13, 2019

Build succeeded

@craig craig bot merged commit 58b49a0 into cockroachdb:master Aug 13, 2019
@tbg
Copy link
Member Author

tbg commented Aug 13, 2019 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants