Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

roachtest: sqlsmith/setup=seed-vec/setting=vec failed #70074

Closed
cockroach-teamcity opened this issue Sep 11, 2021 · 6 comments
Closed

roachtest: sqlsmith/setup=seed-vec/setting=vec failed #70074

cockroach-teamcity opened this issue Sep 11, 2021 · 6 comments
Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. T-sql-queries SQL Queries Team

Comments

@cockroach-teamcity
Copy link
Member

roachtest.sqlsmith/setup=seed-vec/setting=vec failed with artifacts on master @ 941011c4e582807b40dd03bbcbb8d05385c0638d:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/sqlsmith/setup=seed-vec/setting=vec/run_1
	sqlsmith.go:229,sqlsmith.go:258,test_runner.go:777: error: pq: inbox communication error: rpc error: code = Canceled desc = context canceled
		stmt:
		SELECT
			tab_33771._int4 AS col_122443, tab_33771._uuid AS col_122444, tab_33771._string AS col_122445
		FROM
			defaultdb.public.seed_vec@[0] AS tab_33771,
			defaultdb.public.seed_vec AS tab_33772
			JOIN defaultdb.public.seed_vec AS tab_33773 ON (tab_33772._int8) = (tab_33773._int8)
			JOIN defaultdb.public.seed_vec@seed_vec__int8__float8__date_idx AS tab_33774 ON
					(tab_33773._float8) = (tab_33774._float8)
		WHERE
			tab_33771._bool
		ORDER BY
			tab_33774._bytes DESC, tab_33774._bytes DESC;

	cluster.go:1249,context.go:89,cluster.go:1237,test_runner.go:866: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-3427568-1631341029-05-n4cpu4 --oneshot --ignore-empty-nodes: exit status 1 4: dead (exit status 134)
		1: 16219
		3: 16045
		2: 15620
		Error: UNCLASSIFIED_PROBLEM: 4: dead (exit status 134)
		(1) UNCLASSIFIED_PROBLEM
		Wraps: (2) attached stack trace
		  -- stack trace:
		  | main.glob..func14
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1173
		  | main.wrap.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:281
		  | github.com/spf13/cobra.(*Command).execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:856
		  | github.com/spf13/cobra.(*Command).ExecuteC
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:960
		  | github.com/spf13/cobra.(*Command).Execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:897
		  | main.main
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:2107
		  | runtime.main
		  | 	/usr/local/go/src/runtime/proc.go:225
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1371
		Wraps: (3) 4: dead (exit status 134)
		Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *errutil.leafError
Reproduce

See: roachtest README

Same failure on other branches

/cc @cockroachdb/sql-queries

This test on roachdash | Improve this report!
@cockroach-teamcity cockroach-teamcity added branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. labels Sep 11, 2021
@blathers-crl blathers-crl bot added the T-sql-queries SQL Queries Team label Sep 11, 2021
@cockroach-teamcity
Copy link
Member Author

roachtest.sqlsmith/setup=seed-vec/setting=vec failed with artifacts on master @ 6eb9df1f3d460f904b5254c3d32c745eecbedd3f:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/sqlsmith/setup=seed-vec/setting=vec/run_1
	sqlsmith.go:245,sqlsmith.go:258,test_runner.go:777: ping: dial tcp 35.185.113.234:26257: connect: connection refused
		previous sql:
		SELECT
			tab_8955.tableoid AS col_33464, tab_8955._int8 AS col_33465
		FROM
			defaultdb.public.seed_vec@seed_vec__int8__float8__date_idx AS tab_8952,
			defaultdb.public.seed_vec@seed_vec__int8__float8__date_idx AS tab_8953
			JOIN defaultdb.public.seed_vec@seed_vec__int8__float8__date_idx AS tab_8954 ON
					(tab_8953._interval) = (tab_8954._interval)
					AND (tab_8953._bytes) = (tab_8954._bytes)
					AND (tab_8953._int4) = (tab_8954._int2),
			defaultdb.public.seed_vec@seed_vec__int8__float8__date_idx AS tab_8955
		ORDER BY
			tab_8954._int8, tab_8953._uuid, tab_8952._decimal, tab_8953.tableoid DESC, tab_8955._float8 DESC;

	cluster.go:1249,context.go:89,cluster.go:1237,test_runner.go:866: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-3429354-1631428311-01-n4cpu4 --oneshot --ignore-empty-nodes: exit status 1 4: 10518
		3: 10710
		2: 10571
		1: dead (exit status 134)
		Error: UNCLASSIFIED_PROBLEM: 1: dead (exit status 134)
		(1) UNCLASSIFIED_PROBLEM
		Wraps: (2) attached stack trace
		  -- stack trace:
		  | main.glob..func14
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1173
		  | main.wrap.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:281
		  | github.com/spf13/cobra.(*Command).execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:856
		  | github.com/spf13/cobra.(*Command).ExecuteC
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:960
		  | github.com/spf13/cobra.(*Command).Execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:897
		  | main.main
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:2107
		  | runtime.main
		  | 	/usr/local/go/src/runtime/proc.go:225
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1371
		Wraps: (3) 1: dead (exit status 134)
		Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *errutil.leafError
Reproduce

See: roachtest README

Same failure on other branches

/cc @cockroachdb/sql-queries

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.sqlsmith/setup=seed-vec/setting=vec failed with artifacts on master @ 394e35cbbb7ae466383c3ee6f2bbcc76857afeed:

	sqlsmith.go:245,sqlsmith.go:258,test_runner.go:777: ping: dial tcp 34.139.193.241:26257: connect: connection refused
		previous sql:
		SELECT
			tab_12653.crdb_internal_mvcc_timestamp AS col_45611,
			tab_12652.tableoid AS col_45612,
			tab_12654._date AS col_45613,
			tab_12651._bool AS col_45614,
			(tab_12655._bool AND tab_12651._bool) AS col_45615
		FROM
			defaultdb.public.seed_vec@seed_vec__int8__float8__date_idx AS tab_12651,
			defaultdb.public.seed_vec@seed_vec__int8__float8__date_idx AS tab_12652,
			defaultdb.public.seed_vec@seed_vec__int8__float8__date_idx AS tab_12653
			JOIN defaultdb.public.seed_vec@[0] AS tab_12654 ON
					(tab_12653.crdb_internal_mvcc_timestamp) = (tab_12654.crdb_internal_mvcc_timestamp)
					AND (tab_12653._date) = (tab_12654._date)
					AND (tab_12653.tableoid) = (tab_12654.tableoid)
					AND (tab_12653._string) = (tab_12654._string)
			JOIN defaultdb.public.seed_vec@seed_vec__int8__float8__date_idx AS tab_12655 ON
					(tab_12653._int2) = (tab_12655._int8) AND (tab_12654._float8) = (tab_12655._float8)
		ORDER BY
			tab_12654.crdb_internal_mvcc_timestamp ASC
		LIMIT
			64:::INT8;

	cluster.go:1249,context.go:89,cluster.go:1237,test_runner.go:866: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-3431372-1631513463-08-n4cpu4 --oneshot --ignore-empty-nodes: exit status 1 2: 17139
		1: dead (exit status 134)
		3: 17959
		4: 16380
		Error: UNCLASSIFIED_PROBLEM: 1: dead (exit status 134)
		(1) UNCLASSIFIED_PROBLEM
		Wraps: (2) attached stack trace
		  -- stack trace:
		  | main.glob..func14
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1173
		  | main.wrap.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:281
		  | github.com/spf13/cobra.(*Command).execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:856
		  | github.com/spf13/cobra.(*Command).ExecuteC
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:960
		  | github.com/spf13/cobra.(*Command).Execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:897
		  | main.main
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:2107
		  | runtime.main
		  | 	/usr/local/go/src/runtime/proc.go:225
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1371
		Wraps: (3) 1: dead (exit status 134)
		Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *errutil.leafError
Reproduce

See: roachtest README

Same failure on other branches

/cc @cockroachdb/sql-queries

This test on roachdash | Improve this report!

@rytaft
Copy link
Collaborator

rytaft commented Sep 13, 2021

First failure is inbox communication error when vectorized panic injection is enabled, tracked in #66174

@rytaft rytaft mentioned this issue Sep 13, 2021
Closed
@rytaft
Copy link
Collaborator

rytaft commented Sep 13, 2021 •
edited
Loading

Second failure:

* ERROR: [n1,client=34.73.36.46:58678,hostnossl,user=root] a panic has occurred!
* runtime error: invalid memory address or nil pointer dereference
* (1) attached stack trace
*   -- stack trace:
*   | github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn.func1
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:668
*   | [...repeated from below...]
* Wraps: (2) while executing: SELECT _._ AS _, _._ AS _ FROM _@_ AS _, _@_ AS _ JOIN _@_ AS _ ON (((_._) = (_._)) AND ((_._) = (_._))) AND ((_._) = (_._)), _@_ AS _ ORDER BY _._, _._, _._, _._ DESC, _._ DESC
* Wraps: (3) attached stack trace
*   -- stack trace:
*   | github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn.func1
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:668
*   | runtime.gopanic
*   | 	/usr/local/go/src/runtime/panic.go:965
*   | runtime.panicmem
*   | 	/usr/local/go/src/runtime/panic.go:212
*   | runtime.sigpanic
*   | 	/usr/local/go/src/runtime/signal_unix.go:734
*   | github.com/cockroachdb/cockroach/pkg/util/tracing.SpanFromContext
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/util/tracing/context.go:25
*   | github.com/cockroachdb/cockroach/pkg/sql/execinfra.GetTraceData
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/execinfra/base.go:254
*   | github.com/cockroachdb/cockroach/pkg/sql/execinfra.GetScanStats
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/execinfra/stats.go:85
*   | github.com/cockroachdb/cockroach/pkg/sql/rowexec.(*joinReader).close
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/rowexec/joinreader.go:889
*   | github.com/cockroachdb/cockroach/pkg/sql/rowexec.(*joinReader).ConsumerClosed
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/rowexec/joinreader.go:882
*   | github.com/cockroachdb/cockroach/pkg/sql/execinfra.(*ProcessorBaseNoHelper).InternalClose
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/execinfra/processorsbase.go:904
*   | github.com/cockroachdb/cockroach/pkg/sql/colexec.(*Columnarizer).Close
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colexec/columnarizer.go:289
*   | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*BatchFlowCoordinator).close
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colflow/flow_coordinator.go:334
*   | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*BatchFlowCoordinator).Run.func1
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colflow/flow_coordinator.go:259
*   | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*BatchFlowCoordinator).Run
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colflow/flow_coordinator.go:278
*   | github.com/cockroachdb/cockroach/pkg/sql/colflow.(*vectorizedFlow).Run
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colflow/vectorized_flow.go:258
*   | github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).Run
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:535
*   | github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRun
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:1276
*   | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithDistSQLEngine
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:1394
*   | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).dispatchToExecutionEngine
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:1071
*   | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmtInOpenState
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:708
*   | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:129
*   | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd.func1
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:1722
*   | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:1724
*   | github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).run
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:1646
*   | github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:670
*   | github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*conn).processCommandsAsync.func1
*   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/pgwire/conn.go:639
*   | runtime.goexit
*   | 	/usr/local/go/src/runtime/asm_amd64.s:1371
* Wraps: (4) runtime error: invalid memory address or nil pointer dereference
* Error types: (1) *withstack.withStack (2) *safedetails.withSafeDetails (3) *withstack.withStack (4) runtime.errorString
*
cockroach exited with code 134: Sun Sep 12 06:46:47 UTC 2021

Third failure:

I210913 06:24:52.467508 1 util/log/flags.go:190  [-] 1  stderr capture started
panic: runtime error: invalid memory address or nil pointer dereference [recovered]
	panic: runtime error: invalid memory address or nil pointer dereference [recovered]
	panic: runtime error: invalid memory address or nil pointer dereference [recovered]
	panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x30 pc=0xdee362]

goroutine 2536 [running]:
panic(0x4d5d4c0, 0xc0034cec60)
	/usr/local/go/src/runtime/panic.go:1065 +0x565 fp=0xc003bb2708 sp=0xc003bb2640 pc=0x48b265
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).closeWrapper(0xc0024f2600, 0x8b1f928, 0xc002da7380, 0x4ad3aa0, 0xb100620)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:952 +0x3db fp=0xc003bb2798 sp=0xc003bb2708 pc=0x356a6db
github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn.func1(0xc0024f2600, 0x8b1f928, 0xc002da7380)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:668 +0x65 fp=0xc003bb27d0 sp=0xc003bb2798 pc=0x3767c25
runtime.call32(0x0, 0x7b1dc60, 0xc004d4e648, 0x1800000018)
	/usr/local/go/src/runtime/asm_amd64.s:551 +0x3e fp=0xc003bb2800 sp=0xc003bb27d0 pc=0x4c42fe
runtime.reflectcallSave(0xc003bb2938, 0x7b1dc60, 0xc004d4e648, 0xc000000018)
	/usr/local/go/src/runtime/panic.go:877 +0x58 fp=0xc003bb2830 sp=0xc003bb2800 pc=0x48ac38
runtime.runOpenDeferFrame(0xc001fdf680, 0xc004d4e600, 0x0)
	/usr/local/go/src/runtime/panic.go:851 +0x62d fp=0xc003bb28b8 sp=0xc003bb2830 pc=0x48a90d
panic(0x4ad3aa0, 0xb100620)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9 fp=0xc003bb2980 sp=0xc003bb28b8 pc=0x48aeb9
github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1(0xc003bb3bf0)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colexecerror/error.go:58 +0x6b0 fp=0xc003bb2b18 sp=0xc003bb2980 pc=0x200f570
runtime.call16(0x0, 0x7b1f240, 0xc0063b2cc8, 0x800000008)
	/usr/local/go/src/runtime/asm_amd64.s:550 +0x3e fp=0xc003bb2b38 sp=0xc003bb2b18 pc=0x4c425e
runtime.reflectcallSave(0xc003bb2c70, 0x7b1f240, 0xc0063b2cc8, 0x8)
	/usr/local/go/src/runtime/panic.go:877 +0x58 fp=0xc003bb2b68 sp=0xc003bb2b38 pc=0x48ac38
runtime.runOpenDeferFrame(0xc001fdf680, 0xc0063b2c80, 0x0)
	/usr/local/go/src/runtime/panic.go:851 +0x62d fp=0xc003bb2bf0 sp=0xc003bb2b68 pc=0x48a90d
panic(0x4ad3aa0, 0xb100620)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9 fp=0xc003bb2cb8 sp=0xc003bb2bf0 pc=0x48aeb9
github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1(0xc003bb3740)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colexecerror/error.go:58 +0x6b0 fp=0xc003bb2e50 sp=0xc003bb2cb8 pc=0x200f570
runtime.call16(0x0, 0x7b1f240, 0xc001387628, 0x800000008)
	/usr/local/go/src/runtime/asm_amd64.s:550 +0x3e fp=0xc003bb2e70 sp=0xc003bb2e50 pc=0x4c425e
runtime.reflectcallSave(0xc003bb2fa8, 0x7b1f240, 0xc001387628, 0x8)
	/usr/local/go/src/runtime/panic.go:877 +0x58 fp=0xc003bb2ea0 sp=0xc003bb2e70 pc=0x48ac38
runtime.runOpenDeferFrame(0xc001fdf680, 0xc0013875e0, 0xc003bb2ff0)
	/usr/local/go/src/runtime/panic.go:851 +0x62d fp=0xc003bb2f28 sp=0xc003bb2ea0 pc=0x48a90d
panic(0x4ad3aa0, 0xb100620)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9 fp=0xc003bb2ff0 sp=0xc003bb2f28 pc=0x48aeb9
runtime.panicmem()
	/usr/local/go/src/runtime/panic.go:212 +0x5b fp=0xc003bb3010 sp=0xc003bb2ff0 pc=0x4892bb
runtime.sigpanic()
	/usr/local/go/src/runtime/signal_unix.go:734 +0x173 fp=0xc003bb3048 sp=0xc003bb3010 pc=0x4a2fb3
github.com/cockroachdb/cockroach/pkg/util/tracing.SpanFromContext(0x0, 0x0, 0xd)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/util/tracing/context.go:25 +0x22 fp=0xc003bb3080 sp=0xc003bb3048 pc=0xdee362
github.com/cockroachdb/cockroach/pkg/sql/execinfra.GetTraceData(0x0, 0x0, 0xd, 0xc003f65903, 0xd)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/execinfra/base.go:254 +0x35 fp=0xc003bb30b0 sp=0xc003bb3080 pc=0x22d9e35
github.com/cockroachdb/cockroach/pkg/sql/execinfra.GetScanStats(0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/execinfra/stats.go:85 +0x4c fp=0xc003bb3120 sp=0xc003bb30b0 pc=0x22e33ac
github.com/cockroachdb/cockroach/pkg/sql/rowexec.(*joinReader).close(0xc002a4c800)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/rowexec/joinreader.go:889 +0x1be fp=0xc003bb3160 sp=0xc003bb3120 pc=0x2732b9e
github.com/cockroachdb/cockroach/pkg/sql/rowexec.(*joinReader).ConsumerClosed(0xc002a4c800)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/rowexec/joinreader.go:882 +0x2b fp=0xc003bb3178 sp=0xc003bb3160 pc=0x27329cb
github.com/cockroachdb/cockroach/pkg/sql/execinfra.(*ProcessorBaseNoHelper).InternalClose(0xc00669c400, 0xc000074088)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/execinfra/processorsbase.go:904 +0xac fp=0xc003bb31b8 sp=0xc003bb3178 pc=0x22e1d8c
github.com/cockroachdb/cockroach/pkg/sql/colexec.(*Columnarizer).Close(0xc00669c400, 0x0, 0x0)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colexec/columnarizer.go:289 +0x46 fp=0xc003bb31d8 sp=0xc003bb31b8 pc=0x2c72be6
github.com/cockroachdb/cockroach/pkg/sql/colexecop.Closers.CloseAndLogOnErr(0xc00462d470, 0x3, 0x3, 0x8b3b5e0, 0xc004d241b0, 0xc003f65903, 0xd)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colexecop/operator.go:160 +0xcc fp=0xc003bb3270 sp=0xc003bb31d8 pc=0x290454c
github.com/cockroachdb/cockroach/pkg/sql/colexec.(*Materializer).close(0xc002c82dc0)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colexec/materializer.go:317 +0x93 fp=0xc003bb32b8 sp=0xc003bb3270 pc=0x2c80953
github.com/cockroachdb/cockroach/pkg/sql/colexec.NewMaterializer.func1(0xc0037a2728, 0x27, 0x7f9879a58210)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colexec/materializer.go:203 +0x2a fp=0xc003bb32d0 sp=0xc003bb32b8 pc=0x2cf09ea
github.com/cockroachdb/cockroach/pkg/sql/execinfra.(*ProcessorBaseNoHelper).moveToTrailingMeta(0xc002c82dc0)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/execinfra/processorsbase.go:684 +0x22e fp=0xc003bb3400 sp=0xc003bb32d0 pc=0x22e08ee
github.com/cockroachdb/cockroach/pkg/sql/execinfra.(*ProcessorBaseNoHelper).DrainHelper(0xc002c82dc0, 0x0)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/execinfra/processorsbase.go:575 +0x118 fp=0xc003bb3460 sp=0xc003bb3400 pc=0x22e0438
github.com/cockroachdb/cockroach/pkg/sql/colexec.(*Materializer).Next(0xc002c82dc0, 0x22e1e93, 0xc002c92000, 0x0, 0x0)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colexec/materializer.go:304 +0xe5 fp=0xc003bb3498 sp=0xc003bb3460 pc=0x2c80885
github.com/cockroachdb/cockroach/pkg/sql/execinfra.(*ProcessorBaseNoHelper).DrainHelper(0xc002c92000, 0xf98fcc7e63f31)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/execinfra/processorsbase.go:571 +0xac fp=0xc003bb34f8 sp=0xc003bb3498 pc=0x22e03cc
github.com/cockroachdb/cockroach/pkg/sql/rowexec.(*joinReader).Next(0xc002c92000, 0x0, 0x0, 0xc003bb3600, 0x460efb)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/rowexec/joinreader.go:631 +0x28e fp=0xc003bb3560 sp=0xc003bb34f8 pc=0x273116e
github.com/cockroachdb/cockroach/pkg/sql/execinfra.(*ProcessorBaseNoHelper).DrainHelper(0xc00669d000, 0x0)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/execinfra/processorsbase.go:571 +0xac fp=0xc003bb35c0 sp=0xc003bb3560 pc=0x22e03cc
github.com/cockroachdb/cockroach/pkg/sql/colexec.(*Columnarizer).DrainMeta(0xc00669d000, 0xc0017180d0, 0x2, 0xc001718000)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colexec/columnarizer.go:275 +0x76 fp=0xc003bb3678 sp=0xc003bb35c0 pc=0x2c72996
github.com/cockroachdb/cockroach/pkg/sql/colexecop.MetadataSources.DrainMeta.func1()
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colexecop/operator.go:405 +0x7e fp=0xc003bb3708 sp=0xc003bb3678 pc=0x2904fbe
github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError(0xc003bb37a0, 0x0, 0x0)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colexecerror/error.go:91 +0x57 fp=0xc003bb3738 sp=0xc003bb3708 pc=0x200e9f7
github.com/cockroachdb/cockroach/pkg/sql/colexecop.MetadataSources.DrainMeta(0xc002efc140, 0x2, 0xa, 0x1, 0xc0049ce780, 0x7c1eadfcd)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colexecop/operator.go:403 +0xa7 fp=0xc003bb3840 sp=0xc003bb3738 pc=0x2904d67
github.com/cockroachdb/cockroach/pkg/sql/colexec.(*drainHelper).Next(0xc0028dff80, 0xc003bb38e8, 0xdfd720, 0xc003bb39b0, 0x455d85)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colexec/materializer.go:130 +0x265 fp=0xc003bb38b0 sp=0xc003bb3840 pc=0x2c7fac5
github.com/cockroachdb/cockroach/pkg/sql/execinfra.(*ProcessorBaseNoHelper).DrainHelper(0xc002c831e0, 0x0)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/execinfra/processorsbase.go:571 +0xac fp=0xc003bb3910 sp=0xc003bb38b0 pc=0x22e03cc
github.com/cockroachdb/cockroach/pkg/sql/colexec.(*Materializer).Next(0xc002c831e0, 0x22e1e93, 0xc002c93800, 0x0, 0x0)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colexec/materializer.go:304 +0xe5 fp=0xc003bb3948 sp=0xc003bb3910 pc=0x2c80885
github.com/cockroachdb/cockroach/pkg/sql/execinfra.(*ProcessorBaseNoHelper).DrainHelper(0xc002c93800, 0xc003bb39f0)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/execinfra/processorsbase.go:571 +0xac fp=0xc003bb39a8 sp=0xc003bb3948 pc=0x22e03cc
github.com/cockroachdb/cockroach/pkg/sql/rowexec.(*joinReader).Next(0xc002c93800, 0xc0006d53a8, 0x0, 0xc003bb3a00, 0x5093160)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/rowexec/joinreader.go:631 +0x28e fp=0xc003bb3a10 sp=0xc003bb39a8 pc=0x273116e
github.com/cockroachdb/cockroach/pkg/sql/execinfra.(*ProcessorBaseNoHelper).DrainHelper(0xc00299a800, 0x0)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/execinfra/processorsbase.go:571 +0xac fp=0xc003bb3a70 sp=0xc003bb3a10 pc=0x22e03cc
github.com/cockroachdb/cockroach/pkg/sql/colexec.(*Columnarizer).DrainMeta(0xc00299a800, 0xc003bb3bb8, 0x460efb, 0xc002844780)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colexec/columnarizer.go:275 +0x76 fp=0xc003bb3b28 sp=0xc003bb3a70 pc=0x2c72996
github.com/cockroachdb/cockroach/pkg/sql/colexecop.MetadataSources.DrainMeta.func1()
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colexecop/operator.go:405 +0x7e fp=0xc003bb3bb8 sp=0xc003bb3b28 pc=0x2904fbe
github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError(0xc003bb3c50, 0x0, 0x0)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colexecerror/error.go:91 +0x57 fp=0xc003bb3be8 sp=0xc003bb3bb8 pc=0x200e9f7
github.com/cockroachdb/cockroach/pkg/sql/colexecop.MetadataSources.DrainMeta(0xc002efca00, 0x1, 0xa, 0xc001da8340, 0x1, 0xc0053f4750)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colexecop/operator.go:403 +0xa7 fp=0xc003bb3cf0 sp=0xc003bb3be8 pc=0x2904d67
github.com/cockroachdb/cockroach/pkg/sql/colflow.(*BatchFlowCoordinator).Run(0xc0018ecbb0, 0x8b1f928, 0xc003a64380)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colflow/flow_coordinator.go:314 +0x373 fp=0xc003bb3e00 sp=0xc003bb3cf0 pc=0x33bc0f3
github.com/cockroachdb/cockroach/pkg/sql/colflow.(*vectorizedFlow).Run(0xc0066eaeb0, 0x8b1f928, 0xc003a64380, 0x7b1dbe8)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/colflow/vectorized_flow.go:258 +0x234 fp=0xc003bb3e98 sp=0xc003bb3e00 pc=0x33c0d34
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).Run(0xc00195bb00, 0xc005af3e00, 0xc0018ec0b0, 0xc0053c1c80, 0xc0066ece00, 0xc0024f2e18, 0x0, 0x0)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:535 +0x64f fp=0xc003bb45a0 sp=0xc003bb3e98 pc=0x35f79ef
github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRun(0xc00195bb00, 0x8b3b5e0, 0xc00580a570, 0xc0024f2e18, 0xc005af3e00, 0xc0018ec0b0, 0x8b21838, 0xc0024be960, 0x0, 0xc0066ece00, ...)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:1276 +0x1b1 fp=0xc003bb4628 sp=0xc003bb45a0 pc=0x35fb9f1
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithDistSQLEngine(0xc0024f2600, 0x8b3b5e0, 0xc00580a570, 0xc0024f2bd0, 0x3, 0x7f9878ffcc90, 0xc000ab2aa0, 0xc003bb4801, 0xc0065dd5b8, 0x0, ...)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:1394 +0x472 fp=0xc003bb4750 sp=0xc003bb4628 pc=0x3582b72
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).dispatchToExecutionEngine(0xc0024f2600, 0x8b3b5e0, 0xc00580a570, 0xc0024f2bd0, 0x7f9878ffcc90, 0xc000ab2aa0, 0x0, 0x0)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:1071 +0x90b fp=0xc003bb4a88 sp=0xc003bb4750 pc=0x35805ab
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmtInOpenState(0xc0024f2600, 0x8b3b5e0, 0xc00580a570, 0x8b48318, 0xc00386ea50, 0xc001d5070e, 0x3bc, 0x0, 0x5, 0x0, ...)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:708 +0x1186 fp=0xc003bb54a0 sp=0xc003bb4a88 pc=0x357c0e6
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt(0xc0024f2600, 0x8b1f928, 0xc00470e2c0, 0x8b48318, 0xc00386ea50, 0xc001d5070e, 0x3bc, 0x0, 0x5, 0x0, ...)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:129 +0xb0a fp=0xc003bb5730 sp=0xc003bb54a0 pc=0x357a6ca
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd.func1(0x8b48318, 0xc00386ea50, 0xc001d5070e, 0x3bc, 0x0, 0x5, 0x29de7b36, 0xed8d0e5d5, 0x0, 0x29de7e93, ...)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:1722 +0x28c fp=0xc003bb57f8 sp=0xc003bb5730 pc=0x37680cc
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd(0xc0024f2600, 0x8b1f928, 0xc00470e2c0, 0x0, 0x0)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:1724 +0x1751 fp=0xc003bb5cc0 sp=0xc003bb57f8 pc=0x356e511
github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).run(0xc0024f2600, 0x8b1f928, 0xc002da7380, 0xc001a7c0a0, 0x5400, 0x15000, 0xc001a7c320, 0xc002dac3b0, 0x0, 0x0)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:1646 +0x22f fp=0xc003bb5d60 sp=0xc003bb5cc0 pc=0x356cb4f
github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn(0xc001d36000, 0x8b1f928, 0xc002da7380, 0xc0024f2600, 0x5400, 0x15000, 0xc001a7c320, 0xc002dac3b0, 0x0, 0x0)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:670 +0xce fp=0xc003bb5de8 sp=0xc003bb5d60 pc=0x35685ee
github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*conn).processCommandsAsync.func1(0xc00274f75c, 0xc002d69f50, 0x8b1f928, 0xc002da7380, 0xc002dac3b0, 0xc001d36000, 0xc000ab2400, 0x8b84698, 0xc00303e080, 0xc00301e5a0, ...)
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/pgwire/conn.go:639 +0x3f1 fp=0xc003bb5f30 sp=0xc003bb5de8 pc=0x39ed9f1
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1371 +0x1 fp=0xc003bb5f38 sp=0xc003bb5f30 pc=0x4c5cc1
created by github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*conn).processCommandsAsync
	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/sql/pgwire/conn.go:567 +0x191

@rytaft
Copy link
Collaborator

rytaft commented Sep 13, 2021

Same issue as #70075

@rytaft
Copy link
Collaborator

rytaft commented Sep 13, 2021

Closing since all issues are tracked elsewhere.

@rytaft rytaft closed this as completed Sep 13, 2021
@rytaft rytaft removed the release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. label Sep 13, 2021
@mgartner mgartner moved this to Done in SQL Queries Jul 24, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. T-sql-queries SQL Queries Team
Projects
SQL Queries
Archived in project
Milestone
No milestone
Development

No branches or pull requests
3 participants
@jordanlewis @rytaft @cockroach-teamcity