Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

roachtest: acceptance/version-upgrade failed #54082

Closed
cockroach-teamcity opened this issue Sep 9, 2020 · 3 comments
Closed

roachtest: acceptance/version-upgrade failed #54082

cockroach-teamcity opened this issue Sep 9, 2020 · 3 comments
Labels
C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked.
Milestone

Comments

@cockroach-teamcity
Copy link
Member

(roachtest).acceptance/version-upgrade failed on release-20.2@c11b91b264734a4e422ddeabed00b8569f421b4c:

The test failed on branch=release-20.2, cloud=gce:
test artifacts and logs in: artifacts/acceptance/version-upgrade/run_1
	versionupgrade.go:261,versionupgrade.go:344,versionupgrade.go:190,versionupgrade.go:178,acceptance.go:58,acceptance.go:95,test_runner.go:754: EOF

	cluster.go:1651,context.go:135,cluster.go:1640,test_runner.go:823: dead node detection: /go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor local --oneshot --ignore-empty-nodes: exit status 1 3: dead
		1: 24467
		2: 24468
		4: 24465
		Error: UNCLASSIFIED_PROBLEM: 3: dead
		(1) UNCLASSIFIED_PROBLEM
		Wraps: (2) attached stack trace
		  -- stack trace:
		  | main.glob..func14
		  | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1143
		  | main.wrap.func1
		  | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:267
		  | github.com/spf13/cobra.(*Command).execute
		  | 	/go/pkg/mod/github.com/spf13/[email protected]/command.go:830
		  | github.com/spf13/cobra.(*Command).ExecuteC
		  | 	/go/pkg/mod/github.com/spf13/[email protected]/command.go:914
		  | github.com/spf13/cobra.(*Command).Execute
		  | 	/go/pkg/mod/github.com/spf13/[email protected]/command.go:864
		  | main.main
		  | 	/go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1839
		  | runtime.main
		  | 	/usr/local/go/src/runtime/proc.go:203
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1357
		Wraps: (3) 3: dead
		Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *errutil.leafError

More

Artifacts: /acceptance/version-upgrade
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

@cockroach-teamcity cockroach-teamcity added C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. branch-release-20.2 labels Sep 9, 2020
@cockroach-teamcity cockroach-teamcity added this to the 20.2 milestone Sep 9, 2020
@asubiotto
Copy link
Contributor

cc @ajwerner @tbg

job 588324901594431490: skipping: no liveness record for the job's node 2
(1) attached stack trace
  -- stack trace:
  | runtime.gopanic
  | 	/usr/local/go/src/runtime/panic.go:679
  | [...repeated from below...]
Wraps: (2) attached stack trace
  -- stack trace:
  | github.com/cockroachdb/cockroach/pkg/util/log.ReportOrPanic
  | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/log/crash_reporting.go:338
  | github.com/cockroachdb/cockroach/pkg/jobs.(*Registry).deprecatedMaybeAdoptJob
  | 	/go/src/github.com/cockroachdb/cockroach/pkg/jobs/deprecated.go:202
  | github.com/cockroachdb/cockroach/pkg/jobs.(*Registry).Start.func7
  | 	/go/src/github.com/cockroachdb/cockroach/pkg/jobs/registry.go:654
  | github.com/cockroachdb/cockroach/pkg/jobs.(*Registry).Start.func10
  | 	/go/src/github.com/cockroachdb/cockroach/pkg/jobs/registry.go:739
  | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask.func1
  | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:347
  | runtime.goexit
  | 	/usr/local/go/src/runtime/asm_amd64.s:1357
Wraps: (3) job 588324901594431490: skipping: no liveness record for the job's node 2
Error types: (1) *withstack.withStack (2) *withstack.withStack (3) *errutil.leafError

@tbg
Copy link
Member

tbg commented Sep 9, 2020

cc @ajwerner

@thoszhang
Copy link
Contributor

Closing as duplicate of #54079.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked.
Projects
None yet
Development

No branches or pull requests

4 participants