Sentry: leased_descriptors.go:169: log.Fatal: bad descriptor for T=1733576401.789523000,60102, expiration=1733570407.144156475,0 (1) attached stack trace -- stack trace: | github.com/cockroachdb/c...

[cockroach-sentry]

This issue was auto filed by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry Link: https://cockroach-labs.sentry.io/issues/6117877189/?referrer=webhooks_plugin

Panic Message:

leased_descriptors.go:169: log.Fatal: bad descriptor for T=1733576401.789523000,60102, expiration=1733570407.144156475,0
(1) attached stack trace
  -- stack trace:
  | github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.(*leasedDescriptors).getResult
  | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/leased_descriptors.go:169
  | github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.(*leasedDescriptors).getByName
  | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/leased_descriptors.go:108
  | github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.(*Collection).getNonVirtualDescriptorID.func6
  | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/descriptor.go:580
  | github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.(*Collection).getNonVirtualDescriptorID
  | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/descriptor.go:620
  | github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.getDescriptorByName
  | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/descriptor.go:398
  | github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.ByNameGetter.Table
  | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/getters.go:301
  | github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.PrefixAndTable
  | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/helpers.go:138
  | github.com/cockroachdb/cockroach/pkg/sql.(*schemaResolver).LookupObject
  | 	github.com/cockroachdb/cockroach/pkg/sql/schema_resolver.go:174
  | github.com/cockroachdb/cockroach/pkg/sql/catalog/resolver.ResolveExisting
  | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/resolver/resolver.go:368
  | github.com/cockroachdb/cockroach/pkg/sql/catalog/resolver.ResolveExistingObject
  | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/resolver/resolver.go:184
  | github.com/cockroachdb/cockroach/pkg/sql/catalog/resolver.ResolveExistingTableObject
  | 	github.com/cockroachdb/cockroach/pkg/sql/catalog/resolver/resolver.go:108
  | github.com/cockroachdb/cockroach/pkg/sql.(*optCatalog).ResolveDataSource
  | 	github.com/cockroachdb/cockroach/pkg/sql/opt_catalog.go:260
  | github.com/cockroachdb/cockroach/pkg/sql/opt.(*Metadata).CheckDependencies
  | 	github.com/cockroachdb/cockroach/pkg/sql/opt/metadata.go:393
  | github.com/cockroachdb/cockroach/pkg/sql/opt/memo.(*Memo).IsStale
  | 	github.com/cockroachdb/cockroach/pkg/sql/opt/memo/memo.go:457
  | github.com/cockroachdb/cockroach/pkg/sql.(*optPlanningCtx).buildExecMemo
  | 	github.com/cockroachdb/cockroach/pkg/sql/plan_opt.go:832
  | github.com/cockroachdb/cockroach/pkg/sql.(*planner).makeOptimizerPlan
  | 	github.com/cockroachdb/cockroach/pkg/sql/plan_opt.go:251
  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).makeExecPlan
  | 	github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:2291
  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).dispatchToExecutionEngine
  | 	github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:1841
  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmtInOpenState
  | 	github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:1174
  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt.func1
  | 	github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:146
  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithProfiling
  | 	github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:3429
  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt
  | 	github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:145
  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd.func1
  | 	github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:2316
  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd
  | 	github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:2321
  | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).run
  | 	github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:2238
  | github.com/cockroachdb/cockroach/pkg/sql.(*InternalExecutor).runWithEx.func2
  | 	github.com/cockroachdb/cockroach/pkg/sql/internal.go:254
  | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2
  | 	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:485
  | runtime.goexit
  | 	src/runtime/asm_amd64.s:1695
Wraps: (2) log.Fatal: bad descriptor for T=1733576401.789523000,60102, expiration=1733570407.144156475,0
Error types: (1) *withstack.withStack (2) *errutil.leafError
-- report composition:
*errutil.leafError: log.Fatal: bad descriptor for T=1733576401.789523000,60102, expiration=1733570407.144156475,0
leased_descriptors.go:169: *withstack.withStack (top exception)

Stacktrace (expand for inline code snippets):

src/runtime/asm_amd64.s#L1694-L1696

cockroach/pkg/util/stop/stopper.go

Lines 484 to 486 in 8fb18e7

	sp.UpdateGoroutineIDToCurrent()
	f(ctx)
	}()

cockroach/pkg/sql/internal.go

Lines 253 to 255 in 8fb18e7

	}
	if err := ex.run(
	ctx,

cockroach/pkg/sql/conn_executor.go

Lines 2237 to 2239 in 8fb18e7

	var err error
	if err = ex.execCmd(); err != nil {
	// Both of these errors are normal ways for the connExecutor to exit.

cockroach/pkg/sql/conn_executor.go

Lines 2320 to 2322 in 8fb18e7

	return err
	}()
	// Note: we write to ex.statsCollector.PhaseTimes, instead of ex.phaseTimes,

cockroach/pkg/sql/conn_executor.go

Lines 2315 to 2317 in 8fb18e7

	tcmd.LastInBatch || !implicitTxnForBatch)
	ev, payload, err = ex.execStmt(
	ctx, tcmd.Statement, nil /* portal */, nil /* pinfo */, stmtRes, canAutoCommit,

cockroach/pkg/sql/conn_executor_exec.go

Lines 144 to 146 in 8fb18e7

	}
	err = ex.execWithProfiling(ctx, ast, preparedStmt, func(ctx context.Context) error {
	ev, payload, err = ex.execStmtInOpenState(ctx, parserStmt, portal, pinfo, res, canAutoCommit)

cockroach/pkg/sql/conn_executor_exec.go

Lines 3428 to 3430 in 8fb18e7

	} else {
	err = op(ctx)
	}

cockroach/pkg/sql/conn_executor_exec.go

Lines 145 to 147 in 8fb18e7

	err = ex.execWithProfiling(ctx, ast, preparedStmt, func(ctx context.Context) error {
	ev, payload, err = ex.execStmtInOpenState(ctx, parserStmt, portal, pinfo, res, canAutoCommit)
	return err

cockroach/pkg/sql/conn_executor_exec.go

Lines 1173 to 1175 in 8fb18e7

	} else {
	if err := ex.dispatchToExecutionEngine(stmtCtx, p, res); err != nil {
	stmtThresholdSpan.Finish()

cockroach/pkg/sql/conn_executor_exec.go

Lines 1840 to 1842 in 8fb18e7

	// between here and there needs to happen even if there's an error.
	err = ex.makeExecPlan(ctx, planner)
	defer planner.curPlan.close(ctx)

cockroach/pkg/sql/conn_executor_exec.go

Lines 2290 to 2292 in 8fb18e7

	if err := planner.makeOptimizerPlan(ctx); err != nil {
	log.VEventf(ctx, 1, "optimizer plan failed: %v", err)

cockroach/pkg/sql/plan_opt.go

Lines 250 to 252 in 8fb18e7

	execMemo, err := opc.buildExecMemo(ctx)
	if err != nil {

cockroach/pkg/sql/plan_opt.go

Lines 831 to 833 in 8fb18e7

	if ok {
	if isStale, err := cachedData.Memo.IsStale(ctx, p.EvalContext(), opc.catalog); err != nil {
	return nil, err

cockroach/pkg/sql/opt/memo/memo.go

Lines 456 to 458 in 8fb18e7

	// access the object.
	if depsUpToDate, err := m.Metadata().CheckDependencies(ctx, evalCtx, catalog); err != nil {
	return true, err

cockroach/pkg/sql/opt/metadata.go

Lines 392 to 394 in 8fb18e7

	tableName := name.ToTableName()
	toCheck, _, err = optCatalog.ResolveDataSource(ctx, cat.Flags{}, &tableName)
	if err != nil || !dataSource.Equals(toCheck) {

cockroach/pkg/sql/opt_catalog.go

Lines 259 to 261 in 8fb18e7

	}
	prefix, desc, err := resolver.ResolveExistingTableObject(ctx, oc.planner, &oc.tn, lflags)
	if err != nil {

cockroach/pkg/sql/catalog/resolver/resolver.go

Lines 107 to 109 in 8fb18e7

	un := tn.ToUnresolvedObjectName()
	desc, prefix, err := ResolveExistingObject(ctx, sc, un, lookupFlags)
	if err != nil || desc == nil {

cockroach/pkg/sql/catalog/resolver/resolver.go

Lines 183 to 185 in 8fb18e7

	) (res catalog.Descriptor, _ catalog.ResolvedObjectPrefix, err error) {
	found, prefix, obj, err := ResolveExisting(ctx, un, sc, lookupFlags, sc.CurrentDatabase(), sc.CurrentSearchPath())
	if err != nil {

cockroach/pkg/sql/catalog/resolver/resolver.go

Lines 367 to 369 in 8fb18e7

	// No luck so far. Compatibility with CockroachDB v1.1: try D.public.T instead.
	found, prefix, result, err = r.LookupObject(ctx, lookupFlags, u.Schema(), catconstants.PublicSchemaName, u.Object())
	if found && err == nil {

cockroach/pkg/sql/schema_resolver.go

Lines 173 to 175 in 8fb18e7

	case tree.TableObject:
	prefix, desc, err = descs.PrefixAndTable(ctx, g, &tn)
	case tree.TypeObject:

cockroach/pkg/sql/catalog/descs/helpers.go

Lines 137 to 139 in 8fb18e7

	}
	tbl, err := g.Table(ctx, p.Database, p.Schema, name.Object())
	return p, tbl, err

cockroach/pkg/sql/catalog/descs/getters.go

Lines 300 to 302 in 8fb18e7

	) (catalog.TableDescriptor, error) {
	desc, err := getDescriptorByName(
	ctx, g.KV(), g.Descriptors(), db, sc, name, g.flags, catalog.Table,

cockroach/pkg/sql/catalog/descs/descriptor.go

Lines 397 to 399 in 8fb18e7

	}
	id, err := tc.getNonVirtualDescriptorID(ctx, txn, db, sc, name, flags)
	if err != nil || id == descpb.InvalidID {

cockroach/pkg/sql/catalog/descs/descriptor.go

Lines 619 to 621 in 8fb18e7

	} {
	isDone, id, err := fn()
	if err != nil {

cockroach/pkg/sql/catalog/descs/descriptor.go

Lines 579 to 581 in 8fb18e7

	}
	ld, shouldReadFromStore, err := tc.leased.getByName(
	ctx, tc.deadlineHolder(txn), parentID, parentSchemaID, name,

cockroach/pkg/sql/catalog/descs/leased_descriptors.go

Lines 107 to 109 in 8fb18e7

	const setTxnDeadline = true
	return ld.getResult(ctx, txn, setTxnDeadline, ldesc, err)
	}

cockroach/pkg/sql/catalog/descs/leased_descriptors.go

Lines 168 to 170 in 8fb18e7

	if expiration.LessEq(txn.ReadTimestamp()) {
	log.Fatalf(ctx, "bad descriptor for T=%s, expiration=%s", readTimestamp, expiration)
	}

src/runtime/asm_amd64.s in runtime.goexit at line 1695
pkg/util/stop/stopper.go in pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2 at line 485
pkg/sql/internal.go in pkg/sql.(*InternalExecutor).runWithEx.func2 at line 254
pkg/sql/conn_executor.go in pkg/sql.(*connExecutor).run at line 2238
pkg/sql/conn_executor.go in pkg/sql.(*connExecutor).execCmd at line 2321
pkg/sql/conn_executor.go in pkg/sql.(*connExecutor).execCmd.func1 at line 2316
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmt at line 145
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execWithProfiling at line 3429
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmt.func1 at line 146
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmtInOpenState at line 1174
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).dispatchToExecutionEngine at line 1841
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).makeExecPlan at line 2291
pkg/sql/plan_opt.go in pkg/sql.(*planner).makeOptimizerPlan at line 251
pkg/sql/plan_opt.go in pkg/sql.(*optPlanningCtx).buildExecMemo at line 832
pkg/sql/opt/memo/memo.go in pkg/sql/opt/memo.(*Memo).IsStale at line 457
pkg/sql/opt/metadata.go in pkg/sql/opt.(*Metadata).CheckDependencies at line 393
pkg/sql/opt_catalog.go in pkg/sql.(*optCatalog).ResolveDataSource at line 260
pkg/sql/catalog/resolver/resolver.go in pkg/sql/catalog/resolver.ResolveExistingTableObject at line 108
pkg/sql/catalog/resolver/resolver.go in pkg/sql/catalog/resolver.ResolveExistingObject at line 184
pkg/sql/catalog/resolver/resolver.go in pkg/sql/catalog/resolver.ResolveExisting at line 368
pkg/sql/schema_resolver.go in pkg/sql.(*schemaResolver).LookupObject at line 174
pkg/sql/catalog/descs/helpers.go in pkg/sql/catalog/descs.PrefixAndTable at line 138
pkg/sql/catalog/descs/getters.go in pkg/sql/catalog/descs.ByNameGetter.Table at line 301
pkg/sql/catalog/descs/descriptor.go in pkg/sql/catalog/descs.getDescriptorByName at line 398
pkg/sql/catalog/descs/descriptor.go in pkg/sql/catalog/descs.(*Collection).getNonVirtualDescriptorID at line 620
pkg/sql/catalog/descs/descriptor.go in pkg/sql/catalog/descs.(*Collection).getNonVirtualDescriptorID.func6 at line 580
pkg/sql/catalog/descs/leased_descriptors.go in pkg/sql/catalog/descs.(*leasedDescriptors).getByName at line 108
pkg/sql/catalog/descs/leased_descriptors.go in pkg/sql/catalog/descs.(*leasedDescriptors).getResult at line 169

Tags

Tag	Value
Command	start-single-node
Environment	v24.2.2
Go Version	go1.22.5 X:nocoverageredesign
Platform	darwin amd64
Distribution	CCL
Cockroach Release	v24.2.2
Cockroach SHA	8fb18e7
# of CPUs	12
# of Goroutines	465

Jira issue: CRDB-45319

[blathers-crl]

CC'ing via the CODEOWNERS-based sentry heuristic:

• @cockroachdb/sql-foundations

_{🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.}

[blathers-crl]

Based on the specified backports for linked PR #136978, I applied the following new label(s) to this issue: branch-release-23.2, branch-release-24.1, branch-release-24.3. Please adjust the labels as needed to match the branches actually affected by this issue, including adding any known older branches.

_{🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.}