Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kv/kvserver: TestNonVoterCatchesUpViaRaftSnapshotQueue failed #117064

Closed
cockroach-teamcity opened this issue Dec 24, 2023 · 2 comments
Closed

kv/kvserver: TestNonVoterCatchesUpViaRaftSnapshotQueue failed #117064

cockroach-teamcity opened this issue Dec 24, 2023 · 2 comments
Labels
A-testing Testing tools and infrastructure branch-release-23.2 Used to mark GA and release blockers, technical advisories, and bugs for 23.2 C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. C-test-failure Broken test (automatically or manually discovered). no-test-failure-activity O-robot Originated from a bot. P-3 Issues/test failures with no fix SLA T-kv KV Team X-stale
Milestone

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Dec 24, 2023

kv/kvserver.TestNonVoterCatchesUpViaRaftSnapshotQueue failed with artifacts on release-23.2 @ b1b23cd8e5df4c94cad31352183b50f6d3519b2a:

=== RUN   TestNonVoterCatchesUpViaRaftSnapshotQueue
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/33e1d369c27b9c01b2b6009c561815a3/logTestNonVoterCatchesUpViaRaftSnapshotQueue3522859625
    test_log_scope.go:81: use -show-logs to present logs inline
    replica_learner_test.go:1043: 
        	Error Trace:	github.com/cockroachdb/cockroach/pkg/kv/kvserver_test/pkg/kv/kvserver/replica_learner_test.go:1043
        	            				github.com/cockroachdb/cockroach/pkg/kv/kvserver_test/pkg/kv/kvserver/replica_learner_test.go:1114
        	Error:      	Not equal: 
        	            	expected: map[string]kvserver_test.snapshotBytesMetrics{"":kvserver_test.snapshotBytesMetrics{sentBytes:421, rcvdBytes:0}, ".rebalancing":kvserver_test.snapshotBytesMetrics{sentBytes:0, rcvdBytes:0}, ".recovery":kvserver_test.snapshotBytesMetrics{sentBytes:421, rcvdBytes:0}, ".unknown":kvserver_test.snapshotBytesMetrics{sentBytes:0, rcvdBytes:0}}
        	            	actual  : map[string]kvserver_test.snapshotBytesMetrics{"":kvserver_test.snapshotBytesMetrics{sentBytes:415, rcvdBytes:0}, ".rebalancing":kvserver_test.snapshotBytesMetrics{sentBytes:0, rcvdBytes:0}, ".recovery":kvserver_test.snapshotBytesMetrics{sentBytes:415, rcvdBytes:0}, ".unknown":kvserver_test.snapshotBytesMetrics{sentBytes:0, rcvdBytes:0}}
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -2,3 +2,3 @@
        	            	  (string) "": (kvserver_test.snapshotBytesMetrics) {
        	            	-  sentBytes: (int64) 421,
        	            	+  sentBytes: (int64) 415,
        	            	   rcvdBytes: (int64) 0
        	            	@@ -10,3 +10,3 @@
        	            	  (string) (len=9) ".recovery": (kvserver_test.snapshotBytesMetrics) {
        	            	-  sentBytes: (int64) 421,
        	            	+  sentBytes: (int64) 415,
        	            	   rcvdBytes: (int64) 0
        	Test:       	TestNonVoterCatchesUpViaRaftSnapshotQueue
    panic.go:541: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/33e1d369c27b9c01b2b6009c561815a3/logTestNonVoterCatchesUpViaRaftSnapshotQueue3522859625
--- FAIL: TestNonVoterCatchesUpViaRaftSnapshotQueue (17.86s)

Parameters:

  • TAGS=bazel,gss
  • stress=true
Help

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/kv

This test on roachdash | Improve this report!

Jira issue: CRDB-34950

@cockroach-teamcity cockroach-teamcity added branch-release-23.2 Used to mark GA and release blockers, technical advisories, and bugs for 23.2 C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-kv KV Team labels Dec 24, 2023
@cockroach-teamcity cockroach-teamcity added this to the 23.2 milestone Dec 24, 2023
@nvanbenschoten nvanbenschoten removed the release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. label Jan 17, 2024
@nvanbenschoten
Copy link
Member

Looks like a flake in the test's prediction of a metric. I can't reproduce under stress on this same SHA.

@nvanbenschoten nvanbenschoten added C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. A-testing Testing tools and infrastructure P-3 Issues/test failures with no fix SLA labels Jan 17, 2024
Copy link

We have marked this test failure issue as stale because it has been
inactive for 1 month. If this failure is still relevant, removing the
stale label or adding a comment will keep it active. Otherwise,
we'll close it in 5 days to keep the test failure queue tidy.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-testing Testing tools and infrastructure branch-release-23.2 Used to mark GA and release blockers, technical advisories, and bugs for 23.2 C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. C-test-failure Broken test (automatically or manually discovered). no-test-failure-activity O-robot Originated from a bot. P-3 Issues/test failures with no fix SLA T-kv KV Team X-stale
Projects
No open projects
Status: Closed
Development

No branches or pull requests

2 participants