sql/catalog: v22.2.9: referenced descriptor ID 105: descriptor not found #105257

cockroach-sentry · 2023-06-21T05:14:56Z

This issue was auto filed by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry Link: https://cockroach-labs.sentry.io/issues/4264555061/?referrer=webhooks_plugin

Panic Message:

errors.go:83: referenced descriptor ID 105: descriptor not found
(1)
Wraps: (2) assertion failure
Wraps: (3) attached stack trace
  -- stack trace:
  | github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv.wrapError
  | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv/catalog_query.go:128
  | github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv.catalogQuery.processDescriptorResultRow
  | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv/catalog_query.go:111
  | github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv.catalogQuery.query
  | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv/catalog_query.go:73
  | github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv.catalogReader.GetDescriptorEntries
  | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv/catalog_reader.go:224
  | github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv.(*StoredCatalog).EnsureFromStorageByIDs
  | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv/stored_catalog.go:308
  | github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.getDescriptorsByID
  | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/descriptor.go:191
  | github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.(*Collection).getDescriptorByID
  | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/descriptor.go:88
  | github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.(*Collection).getDescriptorByName
  | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/descriptor.go:336
  | github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.(*Collection).getSchemaByName
  | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/schema.go:73
  | github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.(*Collection).GetImmutableSchemaByName
  | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/schema.go:61
  | github.com/cockroachdb/cockroach/pkg/sql.(*schemaResolver).LookupSchema
  | 	github.com/cockroachdb/cockroach/pkg/sql/schema_resolver.go:132
  | github.com/cockroachdb/cockroach/pkg/sql.(*schemaResolver).ResolveFunction
  | 	github.com/cockroachdb/cockroach/pkg/sql/schema_resolver.go:402
  | github.com/cockroachdb/cockroach/pkg/sql.(*planner).matchUDF
  | 	github.com/cockroachdb/cockroach/pkg/sql/drop_function.go:109
  | github.com/cockroachdb/cockroach/pkg/sql.(*planner).mustGetMutableFunctionForAlter
  | 	github.com/cockroachdb/cockroach/pkg/sql/alter_function.go:383
  | github.com/cockroachdb/cockroach/pkg/sql.(*alterFunctionSetOwnerNode).startExec
  | 	github.com/cockroachdb/cockroach/pkg/sql/alter_function.go:199
  | github.com/cockroachdb/cockroach/pkg/sql.startExec.func2
  | 	github.com/cockroachdb/cockroach/pkg/sql/plan.go:518
  | github.com/cockroachdb/cockroach/pkg/sql.(*planVisitor).visitInternal.func1
  | 	github.com/cockroachdb/cockroach/pkg/sql/walk.go:112
  | github.com/cockroachdb/cockroach/pkg/sql.(*planVisitor).visitInternal
  | 	github.com/cockroachdb/cockroach/pkg/sql/walk.go:297
  | github.com/cockroachdb/cockroach/pkg/sql.(*planVisitor).visit
  | 	github.com/cockroachdb/cockroach/pkg/sql/walk.go:79
  | github.com/cockroachdb/cockroach/pkg/sql.walkPlan
  | 	github.com/cockroachdb/cockroach/pkg/sql/walk.go:43
  | github.com/cockroachdb/cockroach/pkg/sql.startExec
  | 	github.com/cockroachdb/cockroach/pkg/sql/plan.go:521
  | github.com/cockroachdb/cockroach/pkg/sql.(*planNodeToRowSource).Start
  | 	github.com/cockroachdb/cockroach/pkg/sql/plan_node_to_row_source.go:166
  | github.com/cockroachdb/cockroach/pkg/sql/colexec.(*Columnarizer).Init
  | 	github.com/cockroachdb/cockroach/pkg/sql/colexec/columnarizer.go:187
  | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*batchInfoCollector).init
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/stats.go:92
  | github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError
  | 	github.com/cockroachdb/cockroach/pkg/sql/colexecerror/error.go:92
  | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*batchInfoCollector).Init
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/stats.go:101
  | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*BatchFlowCoordinator).init.func1
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/flow_coordinator.go:247
  | github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError
  | 	github.com/cockroachdb/cockroach/pkg/sql/colexecerror/error.go:92
  | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*BatchFlowCoordinator).init
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/flow_coordinator.go:246
  | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*BatchFlowCoordinator).Run
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/flow_coordinator.go:291
  | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*vectorizedFlow).Run
  | 	github.com/cockroachdb/cockroach/pkg/sql/colflow/vectorized_flow.go:320
Wraps: (4) referenced descriptor ID 105
Wraps: (5) secondary error attachment
  | failed to find descriptor [105]
  | (1) attached stack trace
  |   -- stack trace:
  |   | github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv.requiredError
  |   | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv/catalog_query.go:172
  |   | github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv.build
  |   | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv/catalog_query.go:142
  |   | github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv.catalogQuery.processDescriptorResultRow
  |   | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv/catalog_query.go:109
  |   | github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv.catalogQuery.query
  |   | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv/catalog_query.go:73
  |   | github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv.catalogReader.GetDescriptorEntries
  |   | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv/catalog_reader.go:224
  |   | github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv.(*StoredCatalog).EnsureFromStorageByIDs
  |   | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv/stored_catalog.go:308
  |   | github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.getDescriptorsByID
  |   | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/descriptor.go:191
  |   | github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.(*Collection).getDescriptorByID
  |   | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/descriptor.go:88
  |   | github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.(*Collection).getDescriptorByName
  |   | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/descriptor.go:336
  |   | github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.(*Collection).getSchemaByName
  |   | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/schema.go:73
  |   | github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.(*Collection).GetImmutableSchemaByName
  |   | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/schema.go:61
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*schemaResolver).LookupSchema
  |   | 	github.com/cockroachdb/cockroach/pkg/sql/schema_resolver.go:132
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*schemaResolver).ResolveFunction
  |   | 	github.com/cockroachdb/cockroach/pkg/sql/schema_resolver.go:402
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*planner).matchUDF
  |   | 	github.com/cockroachdb/cockroach/pkg/sql/drop_function.go:109
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*planner).mustGetMutableFunctionForAlter
  |   | 	github.com/cockroachdb/cockroach/pkg/sql/alter_function.go:383
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*alterFunctionSetOwnerNode).startExec
  |   | 	github.com/cockroachdb/cockroach/pkg/sql/alter_function.go:199
  |   | github.com/cockroachdb/cockroach/pkg/sql.startExec.func2
  |   | 	github.com/cockroachdb/cockroach/pkg/sql/plan.go:518
  |   | github.com/cockroachdb/cockroach/pkg/sql.(*planVisitor).visitInternal.func1
  |   | 	github.com/cockroachdb/cockroach/pkg/sql/walk.go:112
  |   | github.com/cockroachdb/cockroa...

Stacktrace (expand for inline code snippets):

pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).Run at line 757
pkg/sql/colflow/vectorized_flow.go in pkg/sql/colflow.(*vectorizedFlow).Run at line 320
pkg/sql/colflow/flow_coordinator.go in pkg/sql/colflow.(*BatchFlowCoordinator).Run at line 291
pkg/sql/colflow/flow_coordinator.go in pkg/sql/colflow.(*BatchFlowCoordinator).init at line 246
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError at line 92
pkg/sql/colflow/flow_coordinator.go in pkg/sql/colflow.(*BatchFlowCoordinator).init.func1 at line 247
pkg/sql/colflow/stats.go in pkg/sql/colflow.(*batchInfoCollector).Init at line 101
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError at line 92
pkg/sql/colflow/stats.go in pkg/sql/colflow.(*batchInfoCollector).init at line 92
pkg/sql/colexec/columnarizer.go in pkg/sql/colexec.(*Columnarizer).Init at line 187
pkg/sql/plan_node_to_row_source.go in pkg/sql.(*planNodeToRowSource).Start at line 166
pkg/sql/plan.go in pkg/sql.startExec at line 521
pkg/sql/walk.go in pkg/sql.walkPlan at line 43
pkg/sql/walk.go in pkg/sql.(*planVisitor).visit at line 79
pkg/sql/walk.go in pkg/sql.(*planVisitor).visitInternal at line 297
pkg/sql/walk.go in pkg/sql.(*planVisitor).visitInternal.func1 at line 112
pkg/sql/plan.go in pkg/sql.startExec.func2 at line 518
pkg/sql/alter_function.go in pkg/sql.(*alterFunctionSetOwnerNode).startExec at line 199
pkg/sql/alter_function.go in pkg/sql.(*planner).mustGetMutableFunctionForAlter at line 383
pkg/sql/drop_function.go in pkg/sql.(*planner).matchUDF at line 109
pkg/sql/schema_resolver.go in pkg/sql.(*schemaResolver).ResolveFunction at line 402
pkg/sql/schema_resolver.go in pkg/sql.(*schemaResolver).LookupSchema at line 132
pkg/sql/catalog/descs/schema.go in pkg/sql/catalog/descs.(*Collection).GetImmutableSchemaByName at line 61
pkg/sql/catalog/descs/schema.go in pkg/sql/catalog/descs.(*Collection).getSchemaByName at line 73
pkg/sql/catalog/descs/descriptor.go in pkg/sql/catalog/descs.(*Collection).getDescriptorByName at line 336
pkg/sql/catalog/descs/descriptor.go in pkg/sql/catalog/descs.(*Collection).getDescriptorByID at line 88
pkg/sql/catalog/descs/descriptor.go in pkg/sql/catalog/descs.getDescriptorsByID at line 191
pkg/sql/catalog/internal/catkv/stored_catalog.go in pkg/sql/catalog/internal/catkv.(*StoredCatalog).EnsureFromStorageByIDs at line 308
pkg/sql/catalog/internal/catkv/catalog_reader.go in pkg/sql/catalog/internal/catkv.catalogReader.GetDescriptorEntries at line 224
pkg/sql/catalog/internal/catkv/catalog_query.go in pkg/sql/catalog/internal/catkv.catalogQuery.query at line 73
pkg/sql/catalog/internal/catkv/catalog_query.go in pkg/sql/catalog/internal/catkv.catalogQuery.processDescriptorResultRow at line 111
pkg/sql/catalog/internal/catkv/catalog_query.go in pkg/sql/catalog/internal/catkv.wrapError at line 128
GOROOT/src/runtime/asm_amd64.s in runtime.goexit at line 1594
GOROOT/src/runtime/proc.go in runtime.main at line 233
GOROOT/src/runtime/proc.go in runtime.doInit at line 6325
GOROOT/src/runtime/proc.go in runtime.doInit at line 6325
GOROOT/src/runtime/proc.go in runtime.doInit at line 6325
GOROOT/src/runtime/proc.go in runtime.doInit at line 6325
GOROOT/src/runtime/proc.go in runtime.doInit at line 6325
GOROOT/src/runtime/proc.go in runtime.doInit at line 6325
GOROOT/src/runtime/proc.go in runtime.doInit at line 6325
GOROOT/src/runtime/proc.go in runtime.doInit at line 6325
GOROOT/src/runtime/proc.go in runtime.doInit at line 6325
GOROOT/src/runtime/proc.go in runtime.doInit at line 6348
pkg/sql/catalog/errors.go in pkg/sql/catalog.init at line 83

Tags

Tag	Value
Command	mt start-sql
Environment	v22.2.9
Go Version	go1.19.6
Platform	linux amd64
Distribution	CCL
Cockroach Release	v22.2.9
Cockroach SHA	`1b11ca6`
# of CPUs	16
# of Goroutines	274

Jira issue: CRDB-28944

The text was updated successfully, but these errors were encountered:

blathers-crl · 2023-06-21T05:15:06Z

Hello, I am Blathers. I am here to help you get the issue triaged.

It looks like you have not filled out the issue in the format of any of our templates. To best assist you, we advise you to use one of these templates.

I have CC'd a few people who may be able to assist you:

@cockroachdb/sql-queries (found keywords: Vectorized,distsql,plan)
@cockroachdb/cdc (found keywords: webhook)
@nvanbenschoten (author of sql: Redirect all type checking through parser.PerformTypeChecking #6325)
@petermattis (commented on sql: Redirect all type checking through parser.PerformTypeChecking #6325, author of Integrate the bootstrap.sh functionality into the Makefile. #402, author of Provide our own C interface to rocksdb. #128, author of Fix up clean target. Need to explicitly clean etcd. #320, commented on Golang implementation of Time Series Merge #518, author of Don't use '-r' for 'go clean'. #336, commented on Use curl instead of wget #112)
@bdarnell (author of Update etcd subrepo and update WriteableGroupStorage interface. #233, commented on Integrate the bootstrap.sh functionality into the Makefile. #402, author of Add _vendor to the end of GOPATH instead of the beginning. #297, commented on Provide our own C interface to rocksdb. #128, author of Update multiraft for raft.Storage interface and MultiNode.Advance. #166, commented on Test failure in CI build 4362 #1594, commented on Fix up clean target. Need to explicitly clean etcd. #320, author of Pass proposals by reference, not value. #308, author of Improve reliability of gossip convergence test. #383, author of Replace the GroupID typedef with plain uint64. #132, commented on Don't use '-r' for 'go clean'. #336)
@RaduBerinde (assigned to sql: Redirect all type checking through parser.PerformTypeChecking #6325)
@tbg (commented on Update C-* repos #6348, assigned to rest ui: use default value instead of confusing placeholder #291, commented on Add _vendor to the end of GOPATH instead of the beginning. #297, commented on Add basic KV REST html UI #224, commented on kv rest api: add remaining range tests #111, author of Test failure in CI build 4362 #1594, author of provide and use compiled in test certs (only) in tests #757, author of run bench in CircleCI deploy; run only benchmarks in make bench #191, commented on Pass proposals by reference, not value. #308, commented on Since we're now using random values, we are triggering snappy to disable #101, commented on Introduce ConditionFailedError #247)
@spencerkimball (commented on Update etcd subrepo and update WriteableGroupStorage interface. #233, commented on Simple StoreFinder and new capacity gossiping #187, assigned to Add basic KV REST html UI #224, assigned to kv rest api: add remaining range tests #111, commented on Provide our own C interface to rocksdb. #128, commented on Update multiraft for raft.Storage interface and MultiNode.Advance. #166, commented on Golang implementation of Time Series Merge #518, author of WIP range splitting; #109, author of Since we're now using random values, we are triggering snappy to disable #101, commented on Two tiny comment fixes to the gossip package #521, commented on Improve reliability of gossip convergence test. #383, commented on Replace the GroupID typedef with plain uint64. #132, commented on Introduce ConditionFailedError #247)

If we have not gotten back to your issue within a few business days, you can try the following:

Join our community slack channel and ask on #cockroachdb.
Try find someone from here if you know they worked closely on the area and CC them.

_{🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.}

blathers-crl · 2023-06-21T05:15:11Z

cc @cockroachdb/cdc

chengxiong-ruan · 2023-06-21T12:59:55Z

This is odd... looks like it tried to resolve a schema does not exists. The namespace record exists but the descriptor was not found.

rafiss · 2023-06-27T18:05:06Z

Could it happen if a schema was dropped concurrently with altering the function?

For now, since we don't have enough information to reproduce it, we'll backlog this.

rafiss · 2024-02-05T16:51:34Z

closing due to staleness

BuonOmo · 2024-09-05T07:01:22Z

I'm having a similar error when interacting with my db:

ERROR: referenced descriptor ID 28208: looking up ID 28208: descriptor not found

And I can't even drop it (same error).

blathers-crl bot added A-cdc Change Data Capture O-community Originated from the community X-blathers-triaged blathers was able to find an owner T-cdc labels Jun 21, 2023

blathers-crl bot added the T-sql-foundations SQL Foundations Team (formerly SQL Schema + SQL Sessions) label Jun 21, 2023

chengxiong-ruan removed A-cdc Change Data Capture T-cdc labels Jun 21, 2023

rafiss added O-sentry Originated from an in-the-wild panic report. and removed O-community Originated from the community labels Jun 27, 2023

yuzefovich mentioned this issue Nov 18, 2023

Sentry: errors.go:91: referenced descriptor ID 1268: looking up ID 1268: descriptor not found (1) assertion failure Wraps: (2) attached stack trace -- stack trace: | github.com/cockroachdb/cockroa... #112802

Closed

yuzefovich mentioned this issue Jan 23, 2024

Sentry: errors.go:91: referenced descriptor ID 113: looking up ID 113: descriptor not found (1) assertion failure Wraps: (2) attached stack trace -- stack trace: | github.com/cockroachdb/cockroach... #117800

Closed

rafiss closed this as completed Feb 5, 2024

github-project-automation bot added this to SQL Foundations Aug 28, 2024

github-project-automation bot moved this to Done in SQL Foundations Aug 28, 2024

yuzefovich mentioned this issue Nov 13, 2024

Sentry: errors.go:91: referenced descriptor ID 1: looking up ID 1: descriptor not found (1) Wraps: (2) assertion failure Wraps: (3) attached stack trace -- stack trace: | github.com/cockroachdb/co... #133401

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

sql/catalog: v22.2.9: referenced descriptor ID 105: descriptor not found #105257

sql/catalog: v22.2.9: referenced descriptor ID 105: descriptor not found #105257

cockroach-sentry commented Jun 21, 2023 •

edited by cockroach-jira-scripts

Loading

blathers-crl bot commented Jun 21, 2023

blathers-crl bot commented Jun 21, 2023

chengxiong-ruan commented Jun 21, 2023

rafiss commented Jun 27, 2023

rafiss commented Feb 5, 2024

BuonOmo commented Sep 5, 2024

sql/catalog: v22.2.9: referenced descriptor ID 105: descriptor not found #105257

sql/catalog: v22.2.9: referenced descriptor ID 105: descriptor not found #105257

Comments

cockroach-sentry commented Jun 21, 2023 • edited by cockroach-jira-scripts Loading

Tags

blathers-crl bot commented Jun 21, 2023

blathers-crl bot commented Jun 21, 2023

chengxiong-ruan commented Jun 21, 2023

rafiss commented Jun 27, 2023

rafiss commented Feb 5, 2024

BuonOmo commented Sep 5, 2024

cockroach-sentry commented Jun 21, 2023 •

edited by cockroach-jira-scripts

Loading