Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

roachtest: tpccbench/nodes=3/cpu=16/enc=true failed #99568

Closed
cockroach-teamcity opened this issue Mar 25, 2023 · 4 comments · Fixed by #100213
Closed

roachtest: tpccbench/nodes=3/cpu=16/enc=true failed #99568

cockroach-teamcity opened this issue Mar 25, 2023 · 4 comments · Fixed by #100213
Assignees
@erikgrinaker
Labels
A-kv-replication Relating to Raft, consensus, and coordination. branch-master Failures and bugs on the master branch. C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. C-test-failure Broken test (automatically or manually discovered). GA-blocker O-roachtest O-robot Originated from a bot.
Milestone
23.1

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Mar 25, 2023 •
edited by cockroach-jira-scripts
Loading

roachtest.tpccbench/nodes=3/cpu=16/enc=true failed with artifacts on master @ 0fcc33bc2870961b9387999d8a9fed97fccbb2ae:

test artifacts and logs in: /artifacts/tpccbench/nodes=3/cpu=16/enc=true/run_1
(cluster.go:1896).Start: ~ COCKROACH_CONNECT_TIMEOUT=0 ./cockroach sql --url 'postgres://root@localhost:26257?sslmode=disable' -e "CREATE SCHEDULE IF NOT EXISTS test_only_backup FOR BACKUP INTO 'gs://cockroachdb-backup-testing/roachprod-scheduled-backups/teamcity-9244147-1679721613-28-n4cpu16/1679742057356751592?AUTH=implicit' RECURRING '*/15 * * * *' FULL BACKUP '@hourly' WITH SCHEDULE OPTIONS first_run = 'now'"
ERROR: cannot dial server.
Is the server running?
If the server is running, check --host client-side and --advertise server-side.
dial tcp 127.0.0.1:26257: connect: connection refused
Failed running "sql": COMMAND_PROBLEM: ssh verbose log retained in ssh_110057.356781967_n1_init-backup-schedule.log: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_encrypted=true , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

/cc @cockroachdb/test-eng

This test on roachdash | Improve this report!

Jira issue: CRDB-25941
@cockroach-teamcity cockroach-teamcity added branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. labels Mar 25, 2023
@cockroach-teamcity cockroach-teamcity added this to the 23.1 milestone Mar 25, 2023
@blathers-crl blathers-crl bot added the T-testeng TestEng Team label Mar 25, 2023
@renatolabs
Copy link
Contributor

E230325 11:00:58.051553 1 1@cli/clierror/check.go:35 ⋮ [-] 122 server startup failed: cockroach server exited with error: result is ambiguous: error=ba: ‹Put [/Table/46/2/"\x80"/1/0,/Min), EndTxn(parallel commit) [/Table/46/2/"\x80"/1/0], [txn: 9519fe61], [can-forward-ts]› RPC error: grpc: ‹node waiting for init; /cockroach.roachpb.Internal/Batch not available› [code 14/Unavailable] [propagate]

Instance of #74714 (being handled in #97710).

@renatolabs renatolabs added GA-blocker and removed release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. labels Mar 28, 2023
@cockroach-teamcity
Copy link
Member Author

roachtest.tpccbench/nodes=3/cpu=16/enc=true failed with artifacts on master @ 1f8024bf14433ca169e5a8c3768c5d223dc5018c:

test artifacts and logs in: /artifacts/tpccbench/nodes=3/cpu=16/enc=true/run_1
(test_runner.go:1008).runTest: test timed out (5h0m0s)

Parameters: ROACHTEST_cloud=aws , ROACHTEST_cpu=16 , ROACHTEST_encrypted=true , ROACHTEST_fs=ext4 , ROACHTEST_localSSD=true , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.tpccbench/nodes=3/cpu=16/enc=true failed with artifacts on master @ 1f8024bf14433ca169e5a8c3768c5d223dc5018c:

test artifacts and logs in: /artifacts/tpccbench/nodes=3/cpu=16/enc=true/run_1
(test_runner.go:1008).runTest: test timed out (5h0m0s)

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_encrypted=true , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

This test on roachdash | Improve this report!

@erikgrinaker erikgrinaker mentioned this issue Mar 30, 2023
Closed
@erikgrinaker erikgrinaker self-assigned this Mar 30, 2023
@erikgrinaker erikgrinaker added T-kv-replication and removed T-testeng TestEng Team labels Mar 30, 2023
@blathers-crl
Copy link

blathers-crl bot commented Mar 30, 2023

cc @cockroachdb/replication

@erikgrinaker erikgrinaker mentioned this issue Mar 30, 2023
Merged
@craig craig bot closed this as completed in dc4b25b Mar 31, 2023
@blathers-crl blathers-crl bot mentioned this issue Mar 31, 2023
Merged
This was referenced Mar 31, 2023
Merged
Merged
@pav-kv pav-kv added A-kv-replication Relating to Raft, consensus, and coordination. C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. labels Mar 31, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@erikgrinaker erikgrinaker

Labels
A-kv-replication Relating to Raft, consensus, and coordination. branch-master Failures and bugs on the master branch. C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. C-test-failure Broken test (automatically or manually discovered). GA-blocker O-roachtest O-robot Originated from a bot.
Projects
None yet
Milestone
23.1
Development

Successfully merging a pull request may close this issue.

grpcutil: consider WaitingForInitError as unambiguous erikgrinaker/cockroach
4 participants
@erikgrinaker @pav-kv @cockroach-teamcity @renatolabs