Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

sql/schemachanger: TestSchemaChangeWaitsForOtherSchemaChanges failed #72559

Closed
cockroach-teamcity opened this issue Nov 9, 2021 · 2 comments
Closed

sql/schemachanger: TestSchemaChangeWaitsForOtherSchemaChanges failed #72559

cockroach-teamcity opened this issue Nov 9, 2021 · 2 comments
Assignees
@fqazi
Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. T-sql-foundations SQL Foundations Team (formerly SQL Schema + SQL Sessions)

Comments

@cockroach-teamcity
Copy link
Member

sql/schemachanger.TestSchemaChangeWaitsForOtherSchemaChanges failed with artifacts on master @ 5d68dff8e52616ed92798c1a01b370e62f57c6a8:

Fatal error:

panic: unimplemented [recovered]
	panic: unimplemented

Stack:

goroutine 2512 [running]:
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).Recover(0xc0004886c0, 0x5a03290, 0xc0015c6280)
	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:254 +0x126
panic(0x3d9fa60, 0x59311b0)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scjob.(*newSchemaChangeResumer).OnFailOrCancel(0xc002861020, 0x5a03338, 0xc0021bec60, 0x42760e0, 0xc0000101e8, 0x3ebbfa0, 0x7bbf4a0)
	/go/src/github.com/cockroachdb/cockroach/pkg/sql/schemachanger/scjob/job.go:78 +0x39
github.com/cockroachdb/cockroach/pkg/jobs.(*Registry).stepThroughStateMachine.func3(0xc000ac9c40, 0x59c3b68, 0xc002861020, 0x5a03338, 0xc0021bec60, 0x42760e0, 0xc0000101e8, 0xc001a0b3b0)
	/go/src/github.com/cockroachdb/cockroach/pkg/jobs/registry.go:1280 +0xae
github.com/cockroachdb/cockroach/pkg/jobs.(*Registry).stepThroughStateMachine(0xc00021d000, 0x5a03338, 0xc002b3ea80, 0x42760e0, 0xc0000101e8, 0x59c3b68, 0xc002861020, 0xc0013f2420, 0x44d4a9d, 0x9, ...)
	/go/src/github.com/cockroachdb/cockroach/pkg/jobs/registry.go:1281 +0x1994
github.com/cockroachdb/cockroach/pkg/jobs.(*Registry).stepThroughStateMachine(0xc00021d000, 0x5a03338, 0xc002b3ea80, 0x42760e0, 0xc0000101e8, 0x59c3b68, 0xc002861020, 0xc0013f2420, 0xc000cc2758, 0x7, ...)
	/go/src/github.com/cockroachdb/cockroach/pkg/jobs/registry.go:1232 +0xe07
github.com/cockroachdb/cockroach/pkg/jobs.(*Registry).runJob(0xc00021d000, 0x5a03290, 0xc002b18e80, 0x59c3b68, 0xc002861020, 0xc0013f2420, 0xc000cc2758, 0x7, 0xc00161e000, 0x16, ...)
	/go/src/github.com/cockroachdb/cockroach/pkg/jobs/adopt.go:414 +0x4c9
github.com/cockroachdb/cockroach/pkg/jobs.(*Registry).resumeJob.func1(0x5a03290, 0xc0015c6280)
	/go/src/github.com/cockroachdb/cockroach/pkg/jobs/adopt.go:336 +0x165
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2(0xc0004886c0, 0x5a03290, 0xc0015c6280, 0xc000ac8000, 0x0, 0xc000bfc460)
	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:491 +0x103
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx
	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:481 +0x2ad
Log preceding fatal error 

I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder.(*Builder).buildDataSource
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder/select.go:220
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder.(*Builder).buildDataSource
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder/select.go:60
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder.(*Builder).buildFromTablesRightDeep
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder/select.go:1157
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder.(*Builder).buildFromTables
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder/select.go:1134
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder.(*Builder).buildFrom
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder/select.go:1061
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder.(*Builder).buildSelectClause
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder/select.go:982
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder.(*Builder).buildSelectStmtWithoutParens
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder/select.go:930
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder.(*Builder).buildSelect.func1
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder/select.go:903
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder.(*Builder).processWiths
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder/with.go:115
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder.(*Builder).buildSelect
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder/select.go:902
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder.(*Builder).buildStmt
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder/builder.go:281
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder.(*Builder).buildStmtAtRoot
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder/builder.go:241
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder.(*Builder).Build
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder/builder.go:215
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql.(*optPlanningCtx).buildExecMemo
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/plan_opt.go:521
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql.(*planner).makeOptimizerPlan
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/plan_opt.go:194
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).makeExecPlan
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:1265
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).dispatchToExecutionEngine
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:963
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmtInOpenState
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:701
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:129
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd.func1
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:1737
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:1739
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).run
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:1661
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | github.com/cockroachdb/cockroach/pkg/sql.(*InternalExecutor).initConnEx.func1
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/internal.go:210
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | runtime.goexit
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +  | 	/usr/local/go/src/runtime/asm_amd64.s:1371
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +Wraps: (5) index [4] not found
I211109 09:54:37.820257 2512 jobs/registry.go:1168  [n1] 140 +Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *pgerror.withCandidateCode (4) *withstack.withStack (5) *errutil.leafError

Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)Parameters in this failure:

  • GOFLAGS=-parallel=4

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!
@cockroach-teamcity cockroach-teamcity added branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. labels Nov 9, 2021
@blathers-crl blathers-crl bot added the T-sql-schema-deprecated Use T-sql-foundations instead label Nov 9, 2021
@cockroach-teamcity
Copy link
Member Author

sql/schemachanger.TestSchemaChangeWaitsForOtherSchemaChanges failed with artifacts on master @ 5d68dff8e52616ed92798c1a01b370e62f57c6a8:

I211109 09:55:27.738488 5058 sql/backfill.go:1775  [n1,job=709038333663215617] 243  validation: index t/new_primary_key row count = 0, time so far 29.249962ms
I211109 09:55:27.757155 4761 sql/schemachanger/scexec/executor.go:26  [n1,job=709038333663215617] 244  executing 3 ops of type MutationType
I211109 09:55:27.810898 4972 sql/catalog/lease/descriptor_state.go:139  [n1] 245  new lease: tabledesc.immutable: {ID: 53, Version: 4, ModificationTime: "1636451727.757405785,1", ParentID: 52, ParentSchemaID: 29, State: PUBLIC, NextColumnID: 3, Columns: [{ID: 1, TypeID: 20, Null: false}, {ID: 2, TypeID: 20, Null: true, HasDefault: true}], NextFamilyID: 1, Families: [{ID: 0, Columns: [1, 2]}], Mutations: [{MutationID: 2, Direction: DROP, State: DELETE_AND_WRITE_ONLY, Index: {ID: 1, Unique: true, KeyColumns: [{ID: 1, Dir: ASC}], State: DROP, MutationID: 2}}], PrimaryIndex: 2, NextIndexID: 3, Indexes: [{ID: 2, Unique: true, KeyColumns: [{ID: 1, Dir: ASC}], StoreColumns: [2]}]}
I211109 09:55:27.814180 4761 sql/catalog/lease/lease.go:141  [n1,job=709038333663215617] 246  waiting for 1 leases to expire: desc=[{t 53 3}]
I211109 09:55:27.876357 4761 sql/schemachanger/scexec/executor.go:26  [n1,job=709038333663215617] 247  executing 1 ops of type MutationType
I211109 09:55:27.932249 4941 sql/catalog/lease/descriptor_state.go:139  [n1] 248  new lease: tabledesc.immutable: {ID: 53, Version: 5, ModificationTime: "1636451727.876572157,1", ParentID: 52, ParentSchemaID: 29, State: PUBLIC, NextColumnID: 3, Columns: [{ID: 1, TypeID: 20, Null: false}, {ID: 2, TypeID: 20, Null: true, HasDefault: true}], NextFamilyID: 1, Families: [{ID: 0, Columns: [1, 2]}], Mutations: [{MutationID: 2, Direction: DROP, State: DELETE_ONLY, Index: {ID: 1, Unique: true, KeyColumns: [{ID: 1, Dir: ASC}], State: DROP, MutationID: 2}}], PrimaryIndex: 2, NextIndexID: 3, Indexes: [{ID: 2, Unique: true, KeyColumns: [{ID: 1, Dir: ASC}], StoreColumns: [2]}]}
I211109 09:55:27.934816 4761 sql/catalog/lease/lease.go:141  [n1,job=709038333663215617] 249  waiting for 1 leases to expire: desc=[{t 53 4}]
I211109 09:55:27.995224 4761 sql/schemachanger/scexec/executor.go:26  [n1,job=709038333663215617] 250  executing 1 ops of type MutationType
I211109 09:55:28.043408 4842 sql/schema_change_plan_node.go:116  [n1,client=127.0.0.1:50598,hostssl,user=root] 251  done waiting for concurrent schema changes on descriptor 53
I211109 09:55:28.045000 4842 sql/schema_change_plan_node.go:88  [n1,client=127.0.0.1:50598,hostssl,user=root] 252  schema change waiting for concurrent schema changes on descriptor 53
I211109 09:55:28.051562 4842 sql/schema_change_plan_node.go:116  [n1,client=127.0.0.1:50598,hostssl,user=root] 253  done waiting for concurrent schema changes on descriptor 53
I211109 09:55:28.061105 4761 sql/catalog/lease/lease.go:141  [n1,job=709038333663215617] 254  waiting for 1 leases to expire: desc=[{t 53 5}]
I211109 09:55:28.067778 4842 sql/schemachanger/scexec/executor.go:26  [n1,client=127.0.0.1:50598,hostssl,user=root] 255  executing 2 ops of type MutationType
I211109 09:55:28.081572 4842 sql/conn_executor.go:2959  [n1,client=127.0.0.1:50598,hostssl,user=root] 256  queued new schema change job 709038335830294529 using the new schema changer
I211109 09:55:28.114139 4842 sql/schemachanger/scexec/executor.go:26  [n1,client=127.0.0.1:50598,hostssl,user=root] 257  executing 2 ops of type MutationType
I211109 09:55:28.118659 4761 jobs/registry.go:1168  [n1] 258  NEW SCHEMA CHANGE job 709038333663215617: stepping through state succeeded with error: <nil>
I211109 09:55:28.129466 4842 sql/conn_executor.go:2959  [n1,client=127.0.0.1:50598,hostssl,user=root] 259  queued new schema change job 709038335980961793 using the new schema changer
I211109 09:55:28.151559 4842 jobs/registry.go:345  [n1,client=127.0.0.1:50598,hostssl,user=root] 260  scheduled jobs [709038335980961793]
I211109 09:55:28.164288 5474 jobs/adopt.go:247  [-] 261  job 709038335980961793: resuming execution
I211109 09:55:28.166840 5201 sql/catalog/lease/descriptor_state.go:139  [n1] 262  new lease: tabledesc.immutable: {ID: 53, Version: 7, ModificationTime: "1636451728.106753482,0", ParentID: 52, ParentSchemaID: 29, State: PUBLIC, NextColumnID: 4, Columns: [{ID: 1, TypeID: 20, Null: false}, {ID: 2, TypeID: 20, Null: true, HasDefault: true}], NextFamilyID: 1, Families: [{ID: 0, Columns: [1, 2, 3]}], Mutations: [{MutationID: 3, Direction: ADD, State: DELETE_ONLY, Column: {ID: 3, TypeID: 20, Null: true, HasDefault: true, State: ADD, MutationID: 3}}, {MutationID: 3, Direction: ADD, State: DELETE_ONLY, Index: {ID: 3, Unique: true, KeyColumns: [{ID: 1, Dir: ASC}], StoreColumns: [2, 3], State: ADD, MutationID: 3}}], PrimaryIndex: 2, NextIndexID: 4, Indexes: [{ID: 2, Unique: true, KeyColumns: [{ID: 1, Dir: ASC}], StoreColumns: [2]}]}
I211109 09:55:28.176021 5494 jobs/registry.go:1168  [n1] 263  NEW SCHEMA CHANGE job 709038335980961793: stepping through state running with error: <nil>
I211109 09:55:28.210849 5494 sql/schemachanger/scexec/executor.go:26  [n1,job=709038335980961793] 264  executing 2 ops of type MutationType
I211109 09:55:28.266410 5371 sql/catalog/lease/descriptor_state.go:139  [n1] 265  new lease: tabledesc.immutable: {ID: 53, Version: 8, ModificationTime: "1636451728.211183180,1", ParentID: 52, ParentSchemaID: 29, State: PUBLIC, NextColumnID: 4, Columns: [{ID: 1, TypeID: 20, Null: false}, {ID: 2, TypeID: 20, Null: true, HasDefault: true}], NextFamilyID: 1, Families: [{ID: 0, Columns: [1, 2, 3]}], Mutations: [{MutationID: 3, Direction: ADD, State: DELETE_AND_WRITE_ONLY, Column: {ID: 3, TypeID: 20, Null: true, HasDefault: true, State: ADD, MutationID: 3}}, {MutationID: 3, Direction: ADD, State: DELETE_AND_WRITE_ONLY, Index: {ID: 3, Unique: true, KeyColumns: [{ID: 1, Dir: ASC}], StoreColumns: [2, 3], State: ADD, MutationID: 3}}], PrimaryIndex: 2, NextIndexID: 4, Indexes: [{ID: 2, Unique: true, KeyColumns: [{ID: 1, Dir: ASC}], StoreColumns: [2]}]}
I211109 09:55:28.269818 5494 sql/catalog/lease/lease.go:141  [n1,job=709038335980961793] 266  waiting for 1 leases to expire: desc=[{t 53 7}]
I211109 09:55:28.327845 5494 sql/schemachanger/scexec/executor.go:26  [n1,job=709038335980961793] 267  executing 1 ops of type BackfillType
I211109 09:55:28.333719 5494 kv/kvserver/replica_command.go:395  [n1,s1,r45/1:/{Table/53/2-Max}] 268  initiating a split of this range at key /Table/53/3 [r46] (manual)
I211109 09:55:28.360634 5494 sql/index_backfiller.go:80  [n1,job=709038335980961793] 269  got update: &{[] <nil> [] <nil> <nil> <nil> completed_spans:<key:"\275\212" end_key:"\275\213" > progress_details:<> bulk_summary:<> <nil>}
I211109 09:55:28.380480 5494 sql/schemachanger/scexec/executor.go:26  [n1,job=709038335980961793] 270  executing 1 ops of type ValidationType
I211109 09:55:28.393328 5667 sql/backfill.go:1775  [n1,job=709038335980961793] 271  validation: index t/new_primary_key_1 row count = 0, time so far 7.180785ms
I211109 09:55:28.393380 5668 sql/backfill.go:1868  [n1,job=709038335980961793] 272  validation: table t row count = 0, took 7.242477ms
I211109 09:55:28.414197 5494 sql/schemachanger/scexec/executor.go:26  [n1,job=709038335980961793] 273  executing 3 ops of type MutationType
I211109 09:55:28.471012 5626 sql/catalog/lease/descriptor_state.go:139  [n1] 274  new lease: tabledesc.immutable: {ID: 53, Version: 9, ModificationTime: "1636451728.414435057,1", ParentID: 52, ParentSchemaID: 29, State: PUBLIC, NextColumnID: 4, Columns: [{ID: 1, TypeID: 20, Null: false}, {ID: 2, TypeID: 20, Null: true, HasDefault: true}, {ID: 3, TypeID: 20, Null: true, HasDefault: true}], NextFamilyID: 1, Families: [{ID: 0, Columns: [1, 2, 3]}], Mutations: [{MutationID: 4, Direction: DROP, State: DELETE_AND_WRITE_ONLY, Index: {ID: 2, Unique: true, KeyColumns: [{ID: 1, Dir: ASC}], StoreColumns: [2], State: DROP, MutationID: 4}}], PrimaryIndex: 3, NextIndexID: 4, Indexes: [{ID: 3, Unique: true, KeyColumns: [{ID: 1, Dir: ASC}], StoreColumns: [2, 3]}]}
I211109 09:55:28.475127 5494 sql/catalog/lease/lease.go:141  [n1,job=709038335980961793] 275  waiting for 1 leases to expire: desc=[{t 53 8}]
I211109 09:55:28.539990 5494 sql/schemachanger/scexec/executor.go:26  [n1,job=709038335980961793] 276  executing 1 ops of type MutationType
I211109 09:55:28.599638 5784 sql/catalog/lease/descriptor_state.go:139  [n1] 277  new lease: tabledesc.immutable: {ID: 53, Version: 10, ModificationTime: "1636451728.540290010,1", ParentID: 52, ParentSchemaID: 29, State: PUBLIC, NextColumnID: 4, Columns: [{ID: 1, TypeID: 20, Null: false}, {ID: 2, TypeID: 20, Null: true, HasDefault: true}, {ID: 3, TypeID: 20, Null: true, HasDefault: true}], NextFamilyID: 1, Families: [{ID: 0, Columns: [1, 2, 3]}], Mutations: [{MutationID: 4, Direction: DROP, State: DELETE_ONLY, Index: {ID: 2, Unique: true, KeyColumns: [{ID: 1, Dir: ASC}], StoreColumns: [2], State: DROP, MutationID: 4}}], PrimaryIndex: 3, NextIndexID: 4, Indexes: [{ID: 3, Unique: true, KeyColumns: [{ID: 1, Dir: ASC}], StoreColumns: [2, 3]}]}
I211109 09:55:28.603444 5494 sql/catalog/lease/lease.go:141  [n1,job=709038335980961793] 278  waiting for 1 leases to expire: desc=[{t 53 9}]
I211109 09:55:28.613371 3499 3@vendor/github.com/cockroachdb/pebble/event.go:664  [n1,pebble,s1] 279  [JOB 4] WAL created 000005
I211109 09:55:28.662066 5494 sql/schemachanger/scexec/executor.go:26  [n1,job=709038335980961793] 280  executing 1 ops of type MutationType
I211109 09:55:28.678426 3474 1@gossip/gossip.go:1488  [n1] 281  node has connected to cluster via gossip
I211109 09:55:28.679186 3474 kv/kvserver/stores.go:269  [n1] 282  wrote 0 node addresses to persistent storage
I211109 09:55:28.724593 5905 sql/catalog/lease/descriptor_state.go:139  [n1] 283  new lease: tabledesc.immutable: {ID: 53, Version: 11, ModificationTime: "1636451728.662272717,1", ParentID: 52, ParentSchemaID: 29, State: PUBLIC, NextColumnID: 4, Columns: [{ID: 1, TypeID: 20, Null: false}, {ID: 2, TypeID: 20, Null: true, HasDefault: true}, {ID: 3, TypeID: 20, Null: true, HasDefault: true}], NextFamilyID: 1, Families: [{ID: 0, Columns: [1, 2, 3]}], PrimaryIndex: 3, NextIndexID: 4, Indexes: [{ID: 3, Unique: true, KeyColumns: [{ID: 1, Dir: ASC}], StoreColumns: [2, 3]}]}
I211109 09:55:28.728591 5494 sql/catalog/lease/lease.go:141  [n1,job=709038335980961793] 284  waiting for 1 leases to expire: desc=[{t 53 10}]
I211109 09:55:28.795759 5494 jobs/registry.go:1168  [n1] 285  NEW SCHEMA CHANGE job 709038335980961793: stepping through state succeeded with error: <nil>
W211109 09:55:29.131154 3734 jobs/registry.go:840  [-] 286  canceling all adopted jobs due to stopper quiescing
I211109 09:55:29.131274 4771 2@rpc/context.go:688  [n1] 287  closing [{n1: 127.0.0.1:43801 (default)} {n0: 127.0.0.1:43801 (default)}]
W211109 09:55:29.132114 3586 sql/sqlliveness/slinstance/slinstance.go:220  [n1] 288  exiting heartbeat loop
W211109 09:55:29.132818 5634 kv/kvserver/intentresolver/intent_resolver.go:790  [-] 289  failed to gc transaction record: could not GC completed transaction anchored at /Local/Range/Table/53/2/RangeDescriptor: node unavailable; try another peer
I211109 09:55:29.134339 3339 kv/kvclient/kvcoord/transport_race.go:107  [-] 290  transport race promotion: ran 29 iterations on up to 1031 requests
    testing.go:1092: race detected during execution of test
    --- FAIL: TestSchemaChangeWaitsForOtherSchemaChanges/wait_for_new-style_schema_changes (3.46s)
Help

See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)Parameters in this failure:

  • GOFLAGS=-race -parallel=4

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

@ajwerner
Copy link
Contributor

Fixed by #72584 / #72610.

@exalate-issue-sync exalate-issue-sync bot added T-sql-foundations SQL Foundations Team (formerly SQL Schema + SQL Sessions) and removed T-sql-schema-deprecated Use T-sql-foundations instead labels May 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@fqazi fqazi

Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. T-sql-foundations SQL Foundations Team (formerly SQL Schema + SQL Sessions)
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@fqazi @ajwerner @cockroach-teamcity