Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

roachtest: backupFixture/tpce/15GB/aws failed #105952

Closed
cockroach-teamcity opened this issue Jul 1, 2023 · 1 comment · Fixed by #106216
Closed

roachtest: backupFixture/tpce/15GB/aws failed #105952

cockroach-teamcity opened this issue Jul 1, 2023 · 1 comment · Fixed by #106216
Assignees
@msbutler
Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-disaster-recovery
Milestone
23.2

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Jul 1, 2023 •
edited by cockroach-jira-scripts
Loading

roachtest.backupFixture/tpce/15GB/aws failed with artifacts on master @ df82b5306e945d396269f28874d98fa567f4ac32:

(assertions.go:333).Fail: 
	Error Trace:	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/backup_fixtures.go:188
	            				github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/backup_fixtures.go:302
	            				main/pkg/cmd/roachtest/test_runner.go:1060
	            				GOROOT/src/runtime/asm_amd64.s:1594
	Error:      	Received unexpected error:
	            	output in run_054642.618072983_n1_cockroach-sql-insecu: ./cockroach sql --insecure -e "RESTORE DATABASE tpce FROM LATEST IN 's3://cockroach-fixtures/backups/tpc-e/customers=1000/v22.2.1/inc-count=48?AUTH=implicit' AS OF SYSTEM TIME '2023-03-14T17:15:00Z' " returned: COMMAND_PROBLEM: exit status 127
	            	(1) attached stack trace
	            	  -- stack trace:
	            	  | main.(*clusterImpl).RunE
	            	  | 	main/pkg/cmd/roachtest/cluster.go:2323
	            	  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*restoreDriver).run
	            	  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/restore.go:831
	            	  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*backupDriver).initWorkload
	            	  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/backup_fixtures.go:188
	            	  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerBackupFixtures.func1
	            	  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/backup_fixtures.go:302
	            	  | main.(*testRunner).runTest.func2
	            	  | 	main/pkg/cmd/roachtest/test_runner.go:1060
	            	  | runtime.goexit
	            	  | 	GOROOT/src/runtime/asm_amd64.s:1594
	            	Wraps: (2) output in run_054642.618072983_n1_cockroach-sql-insecu
	            	Wraps: (3) ./cockroach sql --insecure -e "RESTORE DATABASE tpce FROM LATEST IN 's3://cockroach-fixtures/backups/tpc-e/customers=1000/v22.2.1/inc-count=48?AUTH=implicit' AS OF SYSTEM TIME '2023-03-14T17:15:00Z' " returned
	            	  | stderr:
	            	  | bash: ./cockroach: No such file or directory
	            	  |
	            	  | stdout:
	            	Wraps: (4) Node 1. Command with error:
	            	  | ``````
	            	  | ./cockroach sql --insecure -e "RESTORE DATABASE tpce FROM LATEST IN 's3://cockroach-fixtures/backups/tpc-e/customers=1000/v22.2.1/inc-count=48?AUTH=implicit' AS OF SYSTEM TIME '2023-03-14T17:15:00Z' "
	            	  | ``````
	            	Wraps: (5) COMMAND_PROBLEM
	            	Wraps: (6) exit status 127
	            	Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *hintdetail.withDetail (5) errors.Cmd (6) *exec.ExitError
	Test:       	backupFixture/tpce/15GB/aws
(require.go:1360).NoError: FailNow called
test artifacts and logs in: /artifacts/backupFixture/tpce/15GB/aws/run_1

Parameters: ROACHTEST_arch=amd64 , ROACHTEST_cloud=aws , ROACHTEST_cpu=4 , ROACHTEST_encrypted=true , ROACHTEST_fs=ext4 , ROACHTEST_localSSD=false , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

/cc @cockroachdb/disaster-recovery

This test on roachdash | Improve this report!

Jira issue: CRDB-29281
@cockroach-teamcity cockroach-teamcity added branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-disaster-recovery labels Jul 1, 2023
@cockroach-teamcity cockroach-teamcity added this to the 23.2 milestone Jul 1, 2023
@msbutler msbutler self-assigned this Jul 5, 2023
@msbutler
Copy link
Collaborator

msbutler commented Jul 5, 2023

this is an infra flake. will send out a patch in the next day or so.

@msbutler msbutler mentioned this issue Jul 5, 2023
Merged
craig bot pushed a commit that referenced this issue Jul 6, 2023
@gtr @msbutler
Merge #103786 #106216
e38486c 
103786: ui: add manual refresh option to the Active Executions in SQL Activity r=gtr a=gtr

Previously, the Active Executions views in the SQL Activity pages only
only supported automatic refresh at a rate of every 10 seconds. This
is a papercut which may lead to some queries disappearing before a user
is able to investigate it. This commit adds adds support for manual
refresh in the Active Executions page as well as a toggle to switch
between automatic and manual refresh.

A summary of changes:

- A new component `RefreshControl` which contains an auto-refresh
  toggle, a manual refresh button, and a timestamp indicating when the
  last refresh was performed..
- `ActiveStatementsView` and `ActiveTransactionsView` make use of this
  component to control when their data gets refreshed. The toggle
  defaults to ON for both pages.
- Analytics for the auto refresh toggle and the manual refresh button.
- A inline alert if the data hasn't been refreshed in over 10 minutes.

Loom (DB): https://www.loom.com/share/5bdab5a62a0c4bc694c9c5d7f936759a
Loom (CC): https://www.loom.com/share/de399300225540059bc7c4f156bc8270

Release note (ui change): the active executions views in the SQL
Activity pages now support toggling between automatic and manual
refresh. A manual refresh button is also added along with a timestamp
indicating when the last refresh was performed.

106216: roachtest: remove './cockroach sql' incantations from restore roachtests r=dt a=msbutler

The patch removes all './cockroach sql' incantations from the restore roachtest driver, which previously would cause the backupFixture test to fail if the user passed a binary not named 'cockroach'.

Fixes #105952

Release note: None

Co-authored-by: gtr <[email protected]>
Co-authored-by: Michael Butler <[email protected]>
@craig craig bot closed this as completed in adb9008 Jul 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@msbutler msbutler

Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-disaster-recovery
Projects
No open projects
Disaster Recovery Backlog
Archived in project
Milestone
23.2
Development

Successfully merging a pull request may close this issue.

roachtest: remove './cockroach sql' incantations from restore roachtests msbutler/cockroach
2 participants
@cockroach-teamcity @msbutler