Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

pkg/sql/logictest/tests/fakedist/fakedist_test: TestLogic_select_for_update failed #100171

Closed
cockroach-teamcity opened this issue Mar 30, 2023 · 2 comments
Closed

pkg/sql/logictest/tests/fakedist/fakedist_test: TestLogic_select_for_update failed #100171

cockroach-teamcity opened this issue Mar 30, 2023 · 2 comments
Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. T-sql-queries SQL Queries Team
Milestone
23.1

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Mar 30, 2023 •
edited by cockroach-jira-scripts
Loading

pkg/sql/logictest/tests/fakedist/fakedist_test.TestLogic_select_for_update failed with artifacts on master @ 56bb0027e990b408b629d281089f279b1569cab8:

github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftSchedulerShard).worker(0x4001dd79e0, {0x5d7b7e0, 0x4007aeb530}, {0x5d617f0, 0x4002932000}, 0x4004454000)
	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go:352 +0x2c8 fp=0x40057c26d0 sp=0x40057c2660 pc=0x3293ec8
github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2({0x5d7b7e0?, 0x4007aeb530?})
	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go:299 +0x48 fp=0x40057c2720 sp=0x40057c26d0 pc=0x32936d8
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x128 fp=0x40057c27d0 sp=0x40057c2720 pc=0x10b1c28
runtime.goexit()
	GOROOT/src/runtime/asm_arm64.s:1172 +0x4 fp=0x40057c27d0 sp=0x40057c27d0 pc=0x496804
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx
	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:461 +0x358

goroutine 55516 [semacquire]:
runtime.gopark(0x8aa1a80?, 0xffff5bb81810?, 0x80?, 0x56?, 0xffff6126e0f8?)
	GOROOT/src/runtime/proc.go:363 +0xe4 fp=0x4003d929e0 sp=0x4003d929c0 pc=0x464cf4
runtime.goparkunlock(...)
	GOROOT/src/runtime/proc.go:369
runtime.semacquire1(0x4004ecd9d0, 0xc8?, 0x1, 0x0)
	GOROOT/src/runtime/sema.go:150 +0x20c fp=0x4003d92a40 sp=0x4003d929e0 pc=0x47685c
sync.runtime_Semacquire(0x28?)
	GOROOT/src/runtime/sema.go:62 +0x28 fp=0x4003d92a70 sp=0x4003d92a40 pc=0x492158
sync.(*WaitGroup).Wait(0x4004ecd9c8)
	GOROOT/src/sync/waitgroup.go:139 +0x80 fp=0x4003d92a90 sp=0x4003d92a70 pc=0x4afce0
golang.org/x/sync/errgroup.(*Group).Wait(0x4004ecd9c0)
	golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:53 +0x2c fp=0x4003d92ab0 sp=0x4003d92a90 pc=0x15aa70c
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.Wait({0x4004ecd9c0?, {0x5d7b738?, 0x4004ecd980?}})
	github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:144 +0x48 fp=0x4003d92ae0 sp=0x4003d92ab0 pc=0x1be3d88
github.com/cockroachdb/cockroach/pkg/util/ctxgroup.GoAndWait({0x5d7b7e0?, 0x40095c5a10?}, {0x4003d92c58, 0x2, 0x4000000000000000?})
	github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:192 +0x88 fp=0x4003d92b30 sp=0x4003d92ae0 pc=0x1be4248
github.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).run(0x4003dfdb80, {0x5d7b7e0, 0x40095c5a10}, 0x4004ecd280)
	github.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:320 +0x6c4 fp=0x4003d92e50 sp=0x4003d92b30 pc=0x1c28aa4
github.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed.(*RangeFeed).Start.func2({0x5d7b7e0, 0x40095c4570})
	github.com/cockroachdb/cockroach/pkg/kv/kvclient/rangefeed/rangefeed.go:231 +0x29c fp=0x4003d92f20 sp=0x4003d92e50 pc=0x1c280dc
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x128 fp=0x4003d92fd0 sp=0x4003d92f20 pc=0x10b1c28
runtime.goexit()
	GOROOT/src/runtime/asm_arm64.s:1172 +0x4 fp=0x4003d92fd0 sp=0x4003d92fd0 pc=0x496804
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx
	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:461 +0x358

goroutine 57125 [select]:
runtime.gopark(0x40013697a0?, 0x2?, 0x48?, 0x96?, 0x4001369754?)
	GOROOT/src/runtime/proc.go:363 +0xe4 fp=0x40013695f0 sp=0x40013695d0 pc=0x464cf4
runtime.selectgo(0x40013697a0, 0x4001369750, 0x0?, 0x0, 0x5d7b7e0?, 0x1)
	GOROOT/src/runtime/select.go:328 +0x6b4 fp=0x4001369700 sp=0x40013695f0 pc=0x475934
github.com/cockroachdb/cockroach/pkg/util/hlc.(*Clock).StartMonitoringForwardClockJumps.func1()
	github.com/cockroachdb/cockroach/pkg/util/hlc/pkg/util/hlc/hlc.go:275 +0x114 fp=0x40013697d0 sp=0x4001369700 pc=0xd9cb94
runtime.goexit()
	GOROOT/src/runtime/asm_arm64.s:1172 +0x4 fp=0x40013697d0 sp=0x40013697d0 pc=0x496804
created by github.com/cockroachdb/cockroach/pkg/util/hlc.(*Clock).StartMonitoringForwardClockJumps
	github.com/cockroachdb/cockroach/pkg/util/hlc/pkg/util/hlc/hlc.go:267 +0x120
Help

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/sql-queries

This test on roachdash | Improve this report!

Jira issue: CRDB-26283
@cockroach-teamcity cockroach-teamcity added branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. labels Mar 30, 2023
@cockroach-teamcity cockroach-teamcity added this to the 23.1 milestone Mar 30, 2023
@blathers-crl blathers-crl bot added the T-sql-queries SQL Queries Team label Mar 30, 2023
@cockroach-teamcity cockroach-teamcity mentioned this issue Apr 1, 2023
Closed
@yuzefovich
Copy link
Member 

unexpected fault address 0x217a7e02450
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x1 addr=0x217a7e02450 pc=0x1fef7d0]

goroutine 59352 [running]:
runtime.throw({0x4970bfb?, 0x7fffffd2bf4eafff?})
	GOROOT/src/runtime/panic.go:1047 +0x40 fp=0x40095a1490 sp=0x40095a1460 pc=0x462330
runtime.sigpanic()
	GOROOT/src/runtime/signal_unix.go:842 +0x1a0 fp=0x40095a14c0 sp=0x40095a1490 pc=0x479a50
github.com/cockroachdb/cockroach/pkg/sql/physicalplan.(*fakeSpanResolverIterator).Seek(0x4003e099c0, {0x5d7b7e0, 0x40036c2240}, {{0x400465b1e8, 0x2, 0x8}, {0x400465b1f8, 0x2, 0x2}}, 0x0)
	github.com/cockroachdb/cockroach/pkg/sql/physicalplan/fake_span_resolver.go:174 +0x6e0 fp=0x40095a1730 sp=0x40095a14d0 pc=0x1fef7d0
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).partitionSpan(0x5e37908?, {0x5d7b7e0, 0x40036c2240}, 0x0?, {{0x400465b1e8, 0x2, 0x8}, {0x400465b1f8, 0x2, 0x2}}, ...)
	github.com/cockroachdb/cockroach/pkg/sql/distsql_physical_planner.go:1216 +0x1cc fp=0x40095a1af0 sp=0x40095a1730 pc=0x2f147ac
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).deprecatedPartitionSpansSystem(0x40095a8a00, {0x5d7b7e0, 0x40036c2240}, 0x4009aa5b80, {0x40036c2030, 0x1, 0x0?})
	github.com/cockroachdb/cockroach/pkg/sql/distsql_physical_planner.go:1295 +0x180 fp=0x40095a1c80 sp=0x40095a1af0 pc=0x2f151f0
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PartitionSpans(0x0?, {0x5d7b7e0?, 0x40036c2240?}, 0x0?, {0x40036c2030?, 0x0?, 0x0?})
	github.com/cockroachdb/cockroach/pkg/sql/distsql_physical_planner.go:1173 +0x4c fp=0x40095a1cd0 sp=0x40095a1c80 pc=0x2f144bc
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).planTableReaders(0x40095a8a00, {0x5d7b7e0, 0x40036c2240}, 0x0?, 0x40071dbd00, 0x40095a20b8)
	github.com/cockroachdb/cockroach/pkg/sql/distsql_physical_planner.go:1847 +0x68 fp=0x40095a1f70 sp=0x40095a1cd0 pc=0x2f17be8
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).createTableReaders(0x5453495441545320?, {0x5d7b7e0, 0x40036c2240}, 0x4009aa5b80, 0x4003e5efc0)
	github.com/cockroachdb/cockroach/pkg/sql/distsql_physical_planner.go:1682 +0x1e4 fp=0x40095a2160 sp=0x40095a1f70 pc=0x2f17544
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).createPhysPlanForPlanNode(0x40012bcc90?, {0x5d7b7e0, 0x40036c2240}, 0x4009aa5b80, {0x5d7ddb8?, 0x4003e5efc0?})
	github.com/cockroachdb/cockroach/pkg/sql/distsql_physical_planner.go:3501 +0x1cc fp=0x40095a2c40 sp=0x40095a2160 pc=0x2f20d2c
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).createPhysPlanForPlanNode(0x48471a0?, {0x5d7b7e0, 0x40036c2240}, 0x4009aa5b80, {0x5d7d680?, 0x40071db600?})
	github.com/cockroachdb/cockroach/pkg/sql/distsql_physical_planner.go:3408 +0x6a4 fp=0x40095a3720 sp=0x40095a2c40 pc=0x2f21204
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).createPhysPlanForPlanNode(0x4007b46278?, {0x5d7b7e0, 0x40036c2240}, 0x4009aa5b80, {0x5d7dc30?, 0x400014fe00?})
	github.com/cockroachdb/cockroach/pkg/sql/distsql_physical_planner.go:3469 +0x200 fp=0x40095a4200 sp=0x40095a3720 pc=0x2f20d60
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).createPlanForJoin(0x5d98420?, {0x5d7b7e0, 0x40036c2240}, 0x0?, 0x40084be640)
	github.com/cockroachdb/cockroach/pkg/sql/distsql_physical_planner.go:3244 +0x44 fp=0x40095a46d0 sp=0x40095a4200 pc=0x2f1fca4
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).createPhysPlanForPlanNode(0x4007b47308?, {0x5d7b7e0, 0x40036c2240}, 0x4009aa5b80, {0x5d7d840?, 0x40084be640?})
	github.com/cockroachdb/cockroach/pkg/sql/distsql_physical_planner.go:3444 +0x644 fp=0x40095a51b0 sp=0x40095a46d0 pc=0x2f211a4
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).createPhysPlanForPlanNode(0x4007b47cd8?, {0x5d7b7e0, 0x40036c2240}, 0x4009aa5b80, {0x5d7dc30?, 0x40084be6e0?})
	github.com/cockroachdb/cockroach/pkg/sql/distsql_physical_planner.go:3469 +0x200 fp=0x40095a5c90 sp=0x40095a51b0 pc=0x2f20d60
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).createPhysPlan(0x5d7b7e0?, {0x5d7b7e0?, 0x40036c2240?}, 0x1?, {{0x5d7dc30, 0x40084be6e0}, 0x0})
	github.com/cockroachdb/cockroach/pkg/sql/distsql_physical_planner.go:3376 +0x60 fp=0x40095a5cf0 sp=0x40095a5c90 pc=0x2f20ae0
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRun(0x4002dba610?, {0x5d7b7e0, 0x40036c2240}, 0x1fef034?, 0x4009aa5b80, 0x5d57130?, {{0x5d7dc30?, 0x40084be6e0?}, 0x0?}, 0x4005194380, ...)
	github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:1873 +0xd4 fp=0x40095a5db0 sp=0x40095a5cf0 pc=0x2f354f4
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRunAll.func2(0x4002dba610, 0x70?, {0x5d7b7e0, 0x40036c2240}, 0x0?, 0x47d2420?, 0x4007b47ec8?)
	github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:1632 +0x84 fp=0x40095a5e50 sp=0x40095a5db0 pc=0x2f34224
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRunAll(0x40095a8a00?, {0x5d7b7e0, 0x40036c2240}, 0x4002dbaa50, 0x4002dba610?, 0x4002dba610, 0x4005194380, 0x0)
	github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:1635 +0x148 fp=0x40095a5f60 sp=0x40095a5e50 pc=0x2f33fd8
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithDistSQLEngine(0x4002dba000, {0x5d7b7e0?, 0x40036c2240}, 0x4002dba610, 0x0?, {0x5dcdb60?, 0x4005979d40}, 0x4007b481e8?, 0x4001914c98)
	github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:1771 +0x4ac fp=0x40095a6070 sp=0x40095a5f60 pc=0x2e8f6ec
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).dispatchToExecutionEngine(0x4002dba000, {0x5d7b738, 0x4003e088c0}, 0x4002dba610, {0x5dcdb60, 0x4005979d40})
	github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:1351 +0x8b4 fp=0x40095a6500 sp=0x40095a6070 pc=0x2e8ce04
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmtInOpenState(0x4002dba000, {0x5d7b7e0?, 0x4005979530?}, {{0x5da5100, 0x4009c77540}, {0x0, 0x0, 0x0}, {0x400190ef01, 0x240}, ...}, ...)
	github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:770 +0x2044 fp=0x40095a7070 sp=0x40095a6500 pc=0x2e88cb4
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt.func1({0x5d7b7e0?, 0x4005979530?})
	github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:137 +0x8c fp=0x40095a7120 sp=0x40095a7070 pc=0x2e867dc
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithProfiling(0x5d7b7e0?, {0x5d7b7e0?, 0x4005979530?}, {0x5da5100?, 0x4009c77540?}, 0x0?, 0x4006c17328?)
	github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:2660 +0x280 fp=0x40095a7280 sp=0x40095a7120 pc=0x2e95120
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt(0x4002dba000, {0x5d7b7e0, 0x4005979530}, {{0x5da5100, 0x4009c77540}, {0x0, 0x0, 0x0}, {0x400190ef01, 0x240}, ...}, ...)
	github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:136 +0x36c fp=0x40095a7410 sp=0x40095a7280 pc=0x2e8626c
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execPortal(0x4002dba000, {0x5d7b7e0, 0x4005979530}, {{0x0, 0x0}, 0x40063dbd40, {0x40012bd5e0, 0x1, 0x1}, {0x0, ...}, ...}, ...)
	github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:226 +0x118 fp=0x40095a7570 sp=0x40095a7410 pc=0x2e869b8
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd.func2({{0x0, 0x0}, 0x0, {0xc1018dbb81425df2, 0x452c9da48, 0x0}, 0x1}, 0x4002dba000, 0x40095a7968, 0x40095a7958, ...)
	github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:2197 +0x454 fp=0x40095a7780 sp=0x40095a7570 pc=0x2e79af4
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd(0x4002dba000)
	github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:2199 +0x528 fp=0x40095a7e70 sp=0x40095a7780 pc=0x2e78258
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).run(0x4002dba000, {0x5d7b7e0, 0x4005978f90}, 0x400475f170?, 0x10b1da0?, 0x400331bc00?)
	github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:2038 +0x18c fp=0x40095a7f30 sp=0x40095a7e70 pc=0x2e77a2c
github.com/cockroachdb/cockroach/pkg/sql.(*InternalExecutor).runWithEx.func1()
	github.com/cockroachdb/cockroach/pkg/sql/internal.go:172 +0x90 fp=0x40095a7fd0 sp=0x40095a7f30 pc=0x2f8d4d0
runtime.goexit()
	GOROOT/src/runtime/asm_arm64.s:1172 +0x4 fp=0x40095a7fd0 sp=0x40095a7fd0 pc=0x496804
created by github.com/cockroachdb/cockroach/pkg/sql.(*InternalExecutor).runWithEx
	github.com/cockroachdb/cockroach/pkg/sql/internal.go:171 +0x150

so it's a dup of #100051, but the SHA doesn't yet contain the debugging change from #100204.

I'll try to reproduce it shortly.

@yuzefovich
Copy link
Member

Couldn't repro this either, let's wait until we get another occurrence on SHA that contains #100204.

@mgartner mgartner moved this to Done in SQL Queries Jul 24, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. T-sql-queries SQL Queries Team
Projects
SQL Queries
Archived in project
Milestone
23.1
Development

No branches or pull requests
2 participants
@yuzefovich @cockroach-teamcity