Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

upgrade/upgrades: TestJSONForwardingIndexes failed #106365

Closed
cockroach-teamcity opened this issue Jul 7, 2023 · 3 comments
Closed

upgrade/upgrades: TestJSONForwardingIndexes failed #106365

cockroach-teamcity opened this issue Jul 7, 2023 · 3 comments
Assignees
@michae2
Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. T-sql-queries SQL Queries Team
Milestone
23.2

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Jul 7, 2023 •
edited by cockroach-jira-scripts
Loading

upgrade/upgrades.TestJSONForwardingIndexes failed with artifacts on master @ 1137aee0089fc2fe161bab0f1c899d2ddc997c90:

I230707 03:43:15.861009 37982 server/migration.go:150  [T1,n1,bump-cluster-version] 2971  active cluster version setting is now 1000023.1--1 (up from 1000022.2-102)
I230707 03:43:15.861219 15348 upgrade/upgrademanager/manager.go:657  [T1,n1,client=127.0.0.1:57806,hostssl,user=root,migration-mgr] 2972  executing operation validate-cluster-version=1000023.1
I230707 03:43:15.861422 15348 upgrade/upgradecluster/cluster.go:121  [T1,n1,client=127.0.0.1:57806,hostssl,user=root,migration-mgr] 2973  executing validate-cluster-version=1000023.1 on nodes n{1}
I230707 03:43:15.861774 15348 upgrade/upgrademanager/manager.go:657  [T1,n1,client=127.0.0.1:57806,hostssl,user=root,migration-mgr] 2974  executing operation bump-cluster-version=1000023.1
I230707 03:43:15.861987 15348 upgrade/upgradecluster/cluster.go:121  [T1,n1,client=127.0.0.1:57806,hostssl,user=root,migration-mgr] 2975  executing bump-cluster-version=1000023.1 on nodes n{1}
I230707 03:43:15.862161 37949 server/migration.go:150  [T1,n1,bump-cluster-version] 2976  active cluster version setting is now 1000023.1 (up from 1000023.1--1)
I230707 03:43:15.867952 15348 util/log/event_log.go:32  [T1,n1,client=127.0.0.1:57806,hostssl,user=root] 2977 ={"Timestamp":1688701384846790587,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING version = $1","Tag":"SET CLUSTER SETTING","User":"root","PlaceholderValues":["'1000023.1'"],"SettingName":"version","Value":"1000023.1"}
I230707 03:43:15.868325 15348 sql/schemachanger/scbuild/build.go:55  [T1,n1,client=127.0.0.1:57806,hostssl,user=root] 2978  building declarative schema change targets for CREATE INDEX
W230707 03:43:15.871564 15348 sql/schemachanger/scbuild/internal/scbuildstmt/create_index.go:393  [T1,n1,client=127.0.0.1:57806,hostssl,user=root] 2979  failed building declarative schema change targets for CREATE INDEX with error: unimplemented: column j is of type jsonb and thus is not indexable
W230707 03:43:15.871564 15348 sql/schemachanger/scbuild/internal/scbuildstmt/create_index.go:393  [T1,n1,client=127.0.0.1:57806,hostssl,user=root] 2979 +HINT: You have attempted to use a feature that is not yet implemented.
W230707 03:43:15.871564 15348 sql/schemachanger/scbuild/internal/scbuildstmt/create_index.go:393  [T1,n1,client=127.0.0.1:57806,hostssl,user=root] 2979 +See: https://go.crdb.dev/issue-v/35730/v23.2
I230707 03:43:15.871985 15348 sql/schemachanger/scbuild/build.go:55  [T1,n1,client=127.0.0.1:57806,hostssl,user=root] 2980  building declarative schema change targets for CREATE INDEX
W230707 03:43:15.875616 15348 sql/schemachanger/scbuild/internal/scbuildstmt/create_index.go:393  [T1,n1,client=127.0.0.1:57806,hostssl,user=root] 2981  failed building declarative schema change targets for CREATE INDEX with error: unimplemented: column crdb_internal_idx_expr is of type jsonb and thus is not indexable
W230707 03:43:15.875616 15348 sql/schemachanger/scbuild/internal/scbuildstmt/create_index.go:393  [T1,n1,client=127.0.0.1:57806,hostssl,user=root] 2981 +HINT: You have attempted to use a feature that is not yet implemented.
W230707 03:43:15.875616 15348 sql/schemachanger/scbuild/internal/scbuildstmt/create_index.go:393  [T1,n1,client=127.0.0.1:57806,hostssl,user=root] 2981 +See: https://go.crdb.dev/issue-v/35730/v23.2
I230707 03:43:15.879522 15265 9@sql/pgwire/conn.go:367  [T1,n1,client=127.0.0.1:57806,hostssl,user=root] 2982  could not parse simple query: CREATE TABLE test.tbl_json_secondary_unique(
I230707 03:43:15.879522 15265 9@sql/pgwire/conn.go:367  [T1,n1,client=127.0.0.1:57806,hostssl,user=root] 2982 +    j JSONB,
I230707 03:43:15.879522 15265 9@sql/pgwire/conn.go:367  [T1,n1,client=127.0.0.1:57806,hostssl,user=root] 2982 +    UNIQUE tbl_json_secondary_uidx (j)
I230707 03:43:15.879522 15265 9@sql/pgwire/conn.go:367  [T1,n1,client=127.0.0.1:57806,hostssl,user=root] 2982 +)
I230707 03:43:15.887742 15348 upgrade/upgrademanager/manager.go:397  [T1,n1,client=127.0.0.1:57806,hostssl,user=root,migration-mgr] 2983  migrating cluster from 1000023.1 to 1000023.1-14 (stepping through [1000023.1-2 1000023.1-4 1000023.1-6 1000023.1-8 1000023.1-10 1000023.1-12 1000023.1-14])
I230707 03:43:15.887803 15348 upgrade/upgrademanager/manager.go:657  [T1,n1,client=127.0.0.1:57806,hostssl,user=root,migration-mgr] 2984  executing operation validate-cluster-version=1000023.1-14
I230707 03:43:15.888048 15348 upgrade/upgradecluster/cluster.go:121  [T1,n1,client=127.0.0.1:57806,hostssl,user=root,migration-mgr] 2985  executing validate-cluster-version=1000023.1-14 on nodes n{1}
W230707 03:43:15.908880 15348 upgrade/upgrademanager/manager.go:370  [T1,n1,client=127.0.0.1:57806,hostssl,user=root,migration-mgr] 2986  error encountered during version upgrade: verifying precondition for version 1000023.1-2: query-invalid_objects: crdb-internal-jobs-table: system-jobs-scan: column "job_type" does not exist
    json_forward_indexes_test.go:147: 
        	Error Trace:	github.com/cockroachdb/cockroach/pkg/upgrade/upgrades_test/pkg/upgrade/upgrades/json_forward_indexes_test.go:147
        	Error:      	Received unexpected error:
        	            	pq: verifying precondition for version 1000023.1-2: query-invalid_objects: crdb-internal-jobs-table: system-jobs-scan: column "job_type" does not exist
        	Test:       	TestJSONForwardingIndexes
I230707 03:43:15.909908 13718 testutils/testcluster/testcluster.go:145  [-] 2987  TestCluster quiescing nodes
W230707 03:43:15.910120 35736 kv/kvserver/intentresolver/intent_resolver.go:826  [-] 2988  failed to gc transaction record: could not GC completed transaction anchored at /Table/109/1/880250046202445825/"legacy_progress": node unavailable; try another peer
I230707 03:43:15.910249 14472 sql/stats/automatic_stats.go:624  [T1,n1] 2989  quiescing stats garbage collector
I230707 03:43:15.910291 14471 sql/stats/automatic_stats.go:572  [T1,n1] 2990  quiescing auto stats refresher
I230707 03:43:15.910593 13982 server/start_listen.go:103  [T1,n1] 2991  server shutting down: instructing cmux to stop accepting
I230707 03:43:15.911457 13551 jobs/registry.go:1606  [T1,n1] 2992  AUTO SPAN CONFIG RECONCILIATION job 880250010184613889: stepping through state succeeded
W230707 03:43:15.911528 14405 sql/sqlliveness/slinstance/slinstance.go:334  [T1,n1] 2993  exiting heartbeat loop
W230707 03:43:15.911547 14405 sql/sqlliveness/slinstance/slinstance.go:321  [T1,n1] 2994  exiting heartbeat loop with error: node unavailable; try another peer
E230707 03:43:15.911571 14405 server/server_sql.go:514  [T1,n1] 2995  failed to run update of instance with new session ID: node unavailable; try another peer
E230707 03:43:15.911593 35282 jobs/registry.go:1004  [T1,n1] 2996  error getting live session: node unavailable; try another peer
W230707 03:43:15.933740 36246 jobs/adopt.go:531  [T1,n1] 2997  could not clear job claim: clear-job-claim: node unavailable; try another peer
W230707 03:43:15.933751 33565 jobs/adopt.go:531  [T1,n1] 2998  could not clear job claim: clear-job-claim: node unavailable; try another peer
W230707 03:43:15.935371 29917 jobs/adopt.go:531  [T1,n1] 2999  could not clear job claim: clear-job-claim: failed to send RPC: sending to all replicas failed; last error: ba: Scan [/Table/15/1/880250033877778433,/Table/15/1/880250033877778434), [txn: 53c302a8], [can-forward-ts] RPC error: node unavailable; try another peer
W230707 03:43:15.937009 34435 jobs/adopt.go:531  [T1,n1] 3000  could not clear job claim: clear-job-claim: failed to send RPC: sending to all replicas failed; last error: routing information detected to be stale: ba: Scan [/Table/15/1/880250040747687937,/Table/15/1/880250040747687938), [txn: 26fc0a46], [can-forward-ts] RPC error: node unavailable; try another peer
W230707 03:43:15.937022 27269 jobs/adopt.go:531  [T1,n1] 3001  could not clear job claim: clear-job-claim: failed to send RPC: sending to all replicas failed; last error: routing information detected to be stale: ba: Scan [/Table/15/1/102,/Table/15/1/103), [txn: b3b5b91b], [can-forward-ts] RPC error: node unavailable; try another peer
W230707 03:43:15.938049 29529 jobs/adopt.go:531  [T1,n1] 3002  could not clear job claim: clear-job-claim: node unavailable; try another peer
W230707 03:43:15.940610 28782 jobs/adopt.go:531  [T1,n1] 3003  could not clear job claim: clear-job-claim: node unavailable; try another peer
W230707 03:43:15.942564 28038 jobs/adopt.go:531  [T1,n1] 3004  could not clear job claim: clear-job-claim: failed to send RPC: sending to all replicas failed; last error: routing information detected to be stale: ba: Scan [/Table/15/1/880250029837058049,/Table/15/1/880250029837058050), [txn: 409f8b0f], [can-forward-ts] RPC error: node unavailable; try another peer
I230707 03:43:15.948237 13718 server/server_controller_orchestration.go:263  [T1,n1] 3005  server controller shutting down ungracefully
I230707 03:43:15.948280 13718 server/server_controller_orchestration.go:274  [T1,n1] 3006  waiting for tenant servers to report stopped
W230707 03:43:15.948358 13718 server/server_sql.go:1712  [T1,n1] 3007  server shutdown without a prior graceful drain
--- FAIL: TestJSONForwardingIndexes (11.50s)
Help

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/sql-foundations

This test on roachdash | Improve this report!

Jira issue: CRDB-29531
@cockroach-teamcity cockroach-teamcity added branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. T-sql-foundations SQL Foundations Team (formerly SQL Schema + SQL Sessions) labels Jul 7, 2023
@cockroach-teamcity cockroach-teamcity added this to the 23.2 milestone Jul 7, 2023
@cockroach-teamcity
Copy link
Member Author

upgrade/upgrades.TestJSONForwardingIndexes failed with artifacts on master @ 1137aee0089fc2fe161bab0f1c899d2ddc997c90:

I230707 03:43:33.799727 15102 jobs/wait.go:145  [T1,n1,client=127.0.0.1:42658,hostssl,user=root,migration-mgr] 2918  waited for 1 [880250105723224065] queued jobs to complete 40.712838ms
I230707 03:43:33.799781 15102 upgrade/upgrademanager/manager.go:657  [T1,n1,client=127.0.0.1:42658,hostssl,user=root,migration-mgr] 2919  executing operation bump-cluster-version=1000022.2-102
I230707 03:43:33.800022 15102 upgrade/upgradecluster/cluster.go:121  [T1,n1,client=127.0.0.1:42658,hostssl,user=root,migration-mgr] 2920  executing bump-cluster-version=1000022.2-102 on nodes n{1}
I230707 03:43:33.800280 37225 server/migration.go:150  [T1,n1,bump-cluster-version] 2921  active cluster version setting is now 1000022.2-102 (up from 1000022.2-101(fence))
I230707 03:43:33.804816 15102 upgrade/upgrademanager/manager.go:517  [T1,n1,client=127.0.0.1:42658,hostssl,user=root,migration-mgr] 2922  stepping through 1000023.1
I230707 03:43:33.804882 15102 upgrade/upgrademanager/manager.go:657  [T1,n1,client=127.0.0.1:42658,hostssl,user=root,migration-mgr] 2923  executing operation bump-cluster-version=1000023.1--1
I230707 03:43:33.805125 15102 upgrade/upgradecluster/cluster.go:121  [T1,n1,client=127.0.0.1:42658,hostssl,user=root,migration-mgr] 2924  executing bump-cluster-version=1000023.1--1 on nodes n{1}
I230707 03:43:33.805368 37250 server/migration.go:150  [T1,n1,bump-cluster-version] 2925  active cluster version setting is now 1000023.1--1 (up from 1000022.2-102)
I230707 03:43:33.805653 15102 upgrade/upgrademanager/manager.go:657  [T1,n1,client=127.0.0.1:42658,hostssl,user=root,migration-mgr] 2926  executing operation validate-cluster-version=1000023.1
I230707 03:43:33.805881 15102 upgrade/upgradecluster/cluster.go:121  [T1,n1,client=127.0.0.1:42658,hostssl,user=root,migration-mgr] 2927  executing validate-cluster-version=1000023.1 on nodes n{1}
I230707 03:43:33.806233 15102 upgrade/upgrademanager/manager.go:657  [T1,n1,client=127.0.0.1:42658,hostssl,user=root,migration-mgr] 2928  executing operation bump-cluster-version=1000023.1
I230707 03:43:33.806452 15102 upgrade/upgradecluster/cluster.go:121  [T1,n1,client=127.0.0.1:42658,hostssl,user=root,migration-mgr] 2929  executing bump-cluster-version=1000023.1 on nodes n{1}
I230707 03:43:33.806631 37266 server/migration.go:150  [T1,n1,bump-cluster-version] 2930  active cluster version setting is now 1000023.1 (up from 1000023.1--1)
I230707 03:43:33.812235 15102 util/log/event_log.go:32  [T1,n1,client=127.0.0.1:42658,hostssl,user=root] 2931 ={"Timestamp":1688701403725407452,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING version = $1","Tag":"SET CLUSTER SETTING","User":"root","PlaceholderValues":["'1000023.1'"],"SettingName":"version","Value":"1000023.1"}
I230707 03:43:33.812619 15102 sql/schemachanger/scbuild/build.go:55  [T1,n1,client=127.0.0.1:42658,hostssl,user=root] 2932  building declarative schema change targets for CREATE INDEX
W230707 03:43:33.815903 15102 sql/schemachanger/scbuild/internal/scbuildstmt/create_index.go:393  [T1,n1,client=127.0.0.1:42658,hostssl,user=root] 2933  failed building declarative schema change targets for CREATE INDEX with error: unimplemented: column j is of type jsonb and thus is not indexable
W230707 03:43:33.815903 15102 sql/schemachanger/scbuild/internal/scbuildstmt/create_index.go:393  [T1,n1,client=127.0.0.1:42658,hostssl,user=root] 2933 +HINT: You have attempted to use a feature that is not yet implemented.
W230707 03:43:33.815903 15102 sql/schemachanger/scbuild/internal/scbuildstmt/create_index.go:393  [T1,n1,client=127.0.0.1:42658,hostssl,user=root] 2933 +See: https://go.crdb.dev/issue-v/35730/v23.2
I230707 03:43:33.816293 15102 sql/schemachanger/scbuild/build.go:55  [T1,n1,client=127.0.0.1:42658,hostssl,user=root] 2934  building declarative schema change targets for CREATE INDEX
W230707 03:43:33.819747 15102 sql/schemachanger/scbuild/internal/scbuildstmt/create_index.go:393  [T1,n1,client=127.0.0.1:42658,hostssl,user=root] 2935  failed building declarative schema change targets for CREATE INDEX with error: unimplemented: column crdb_internal_idx_expr is of type jsonb and thus is not indexable
W230707 03:43:33.819747 15102 sql/schemachanger/scbuild/internal/scbuildstmt/create_index.go:393  [T1,n1,client=127.0.0.1:42658,hostssl,user=root] 2935 +HINT: You have attempted to use a feature that is not yet implemented.
W230707 03:43:33.819747 15102 sql/schemachanger/scbuild/internal/scbuildstmt/create_index.go:393  [T1,n1,client=127.0.0.1:42658,hostssl,user=root] 2935 +See: https://go.crdb.dev/issue-v/35730/v23.2
I230707 03:43:33.823264 15170 9@sql/pgwire/conn.go:367  [T1,n1,client=127.0.0.1:42658,hostssl,user=root] 2936  could not parse simple query: CREATE TABLE test.tbl_json_secondary_unique(
I230707 03:43:33.823264 15170 9@sql/pgwire/conn.go:367  [T1,n1,client=127.0.0.1:42658,hostssl,user=root] 2936 +    j JSONB,
I230707 03:43:33.823264 15170 9@sql/pgwire/conn.go:367  [T1,n1,client=127.0.0.1:42658,hostssl,user=root] 2936 +    UNIQUE tbl_json_secondary_uidx (j)
I230707 03:43:33.823264 15170 9@sql/pgwire/conn.go:367  [T1,n1,client=127.0.0.1:42658,hostssl,user=root] 2936 +)
I230707 03:43:33.831115 15102 upgrade/upgrademanager/manager.go:397  [T1,n1,client=127.0.0.1:42658,hostssl,user=root,migration-mgr] 2937  migrating cluster from 1000023.1 to 1000023.1-14 (stepping through [1000023.1-2 1000023.1-4 1000023.1-6 1000023.1-8 1000023.1-10 1000023.1-12 1000023.1-14])
I230707 03:43:33.831173 15102 upgrade/upgrademanager/manager.go:657  [T1,n1,client=127.0.0.1:42658,hostssl,user=root,migration-mgr] 2938  executing operation validate-cluster-version=1000023.1-14
I230707 03:43:33.831421 15102 upgrade/upgradecluster/cluster.go:121  [T1,n1,client=127.0.0.1:42658,hostssl,user=root,migration-mgr] 2939  executing validate-cluster-version=1000023.1-14 on nodes n{1}
W230707 03:43:33.851361 15102 upgrade/upgrademanager/manager.go:370  [T1,n1,client=127.0.0.1:42658,hostssl,user=root,migration-mgr] 2940  error encountered during version upgrade: verifying precondition for version 1000023.1-2: query-invalid_objects: crdb-internal-jobs-table: system-jobs-scan: relation "system.job_info" does not exist
    json_forward_indexes_test.go:147: 
        	Error Trace:	github.com/cockroachdb/cockroach/pkg/upgrade/upgrades_test/pkg/upgrade/upgrades/json_forward_indexes_test.go:147
        	Error:      	Received unexpected error:
        	            	pq: verifying precondition for version 1000023.1-2: query-invalid_objects: crdb-internal-jobs-table: system-jobs-scan: relation "system.job_info" does not exist
        	Test:       	TestJSONForwardingIndexes
I230707 03:43:33.852245 13500 testutils/testcluster/testcluster.go:145  [-] 2941  TestCluster quiescing nodes
W230707 03:43:33.852381 37210 kv/kvserver/intentresolver/intent_resolver.go:826  [-] 2942  failed to gc transaction record: could not GC completed transaction anchored at /Table/6/1/"version"/0: node unavailable; try another peer
I230707 03:43:33.852382 14307 sql/stats/automatic_stats.go:624  [T1,n1] 2943  quiescing stats garbage collector
I230707 03:43:33.852485 14306 sql/stats/automatic_stats.go:572  [T1,n1] 2944  quiescing auto stats refresher
W230707 03:43:33.852549 14274 sql/sqlliveness/slinstance/slinstance.go:334  [T1,n1] 2945  exiting heartbeat loop
W230707 03:43:33.852559 14274 sql/sqlliveness/slinstance/slinstance.go:321  [T1,n1] 2946  exiting heartbeat loop with error: node unavailable; try another peer
E230707 03:43:33.852582 14274 server/server_sql.go:514  [T1,n1] 2947  failed to run update of instance with new session ID: node unavailable; try another peer
E230707 03:43:33.852621 29202 jobs/registry.go:1004  [T1,n1] 2948  error getting live session: node unavailable; try another peer
I230707 03:43:33.852642 13541 server/start_listen.go:103  [T1,n1] 2949  server shutting down: instructing cmux to stop accepting
I230707 03:43:33.852753 14636 jobs/registry.go:1606  [T1,n1] 2950  AUTO SPAN CONFIG RECONCILIATION job 880250071929454593: stepping through state succeeded
W230707 03:43:33.856017 29933 jobs/adopt.go:531  [T1,n1] 2951  could not clear job claim: clear-job-claim: failed to send RPC: sending to all replicas failed; last error: ba: Scan [/Table/15/1/880250093603782657,/Table/15/1/880250093603782658), [txn: 80986b04], [can-forward-ts] RPC error: node unavailable; try another peer
I230707 03:43:33.858964 13500 server/server_controller_orchestration.go:263  [T1,n1] 2952  server controller shutting down ungracefully
I230707 03:43:33.858997 13500 server/server_controller_orchestration.go:274  [T1,n1] 2953  waiting for tenant servers to report stopped
W230707 03:43:33.859068 13500 server/server_sql.go:1712  [T1,n1] 2954  server shutdown without a prior graceful drain
--- FAIL: TestJSONForwardingIndexes (10.60s)
Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@exalate-issue-sync exalate-issue-sync bot added branch-master Failures and bugs on the master branch. and removed branch-master Failures and bugs on the master branch. labels Jul 7, 2023
@rafiss rafiss added T-sql-queries SQL Queries Team and removed T-sql-foundations SQL Foundations Team (formerly SQL Schema + SQL Sessions) labels Jul 7, 2023
@cockroach-teamcity
Copy link
Member Author

upgrade/upgrades.TestJSONForwardingIndexes failed with artifacts on master @ c3a0838f566035ea485abd6e9551658fcffaecd4:

I230711 15:44:02.714600 36878 jobs/registry.go:1606  [T1,n1] 2918  MIGRATION job 881524220357640193: stepping through state succeeded
I230711 15:44:02.729848 15181 jobs/wait.go:145  [T1,n1,client=127.0.0.1:53066,hostssl,user=root,migration-mgr] 2919  waited for 1 [881524220357640193] queued jobs to complete 39.587312ms
I230711 15:44:02.729904 15181 upgrade/upgrademanager/manager.go:657  [T1,n1,client=127.0.0.1:53066,hostssl,user=root,migration-mgr] 2920  executing operation bump-cluster-version=1000022.2-102
I230711 15:44:02.730178 15181 upgrade/upgradecluster/cluster.go:121  [T1,n1,client=127.0.0.1:53066,hostssl,user=root,migration-mgr] 2921  executing bump-cluster-version=1000022.2-102 on nodes n{1}
I230711 15:44:02.730441 37174 server/migration.go:150  [T1,n1,bump-cluster-version] 2922  active cluster version setting is now 1000022.2-102 (up from 1000022.2-101(fence))
I230711 15:44:02.732719 15181 upgrade/upgrademanager/manager.go:517  [T1,n1,client=127.0.0.1:53066,hostssl,user=root,migration-mgr] 2923  stepping through 1000023.1
I230711 15:44:02.732762 15181 upgrade/upgrademanager/manager.go:657  [T1,n1,client=127.0.0.1:53066,hostssl,user=root,migration-mgr] 2924  executing operation bump-cluster-version=1000023.1--1
I230711 15:44:02.733005 15181 upgrade/upgradecluster/cluster.go:121  [T1,n1,client=127.0.0.1:53066,hostssl,user=root,migration-mgr] 2925  executing bump-cluster-version=1000023.1--1 on nodes n{1}
I230711 15:44:02.733231 37163 server/migration.go:150  [T1,n1,bump-cluster-version] 2926  active cluster version setting is now 1000023.1--1 (up from 1000022.2-102)
I230711 15:44:02.733440 15181 upgrade/upgrademanager/manager.go:657  [T1,n1,client=127.0.0.1:53066,hostssl,user=root,migration-mgr] 2927  executing operation validate-cluster-version=1000023.1
I230711 15:44:02.733662 15181 upgrade/upgradecluster/cluster.go:121  [T1,n1,client=127.0.0.1:53066,hostssl,user=root,migration-mgr] 2928  executing validate-cluster-version=1000023.1 on nodes n{1}
I230711 15:44:02.734005 15181 upgrade/upgrademanager/manager.go:657  [T1,n1,client=127.0.0.1:53066,hostssl,user=root,migration-mgr] 2929  executing operation bump-cluster-version=1000023.1
I230711 15:44:02.734218 15181 upgrade/upgradecluster/cluster.go:121  [T1,n1,client=127.0.0.1:53066,hostssl,user=root,migration-mgr] 2930  executing bump-cluster-version=1000023.1 on nodes n{1}
I230711 15:44:02.734385 37168 server/migration.go:150  [T1,n1,bump-cluster-version] 2931  active cluster version setting is now 1000023.1 (up from 1000023.1--1)
I230711 15:44:02.736918 15181 util/log/event_log.go:32  [T1,n1,client=127.0.0.1:53066,hostssl,user=root] 2932 ={"Timestamp":1689090231250163245,"EventType":"set_cluster_setting","Statement":"SET CLUSTER SETTING version = $1","Tag":"SET CLUSTER SETTING","User":"root","PlaceholderValues":["'1000023.1'"],"SettingName":"version","Value":"1000023.1"}
I230711 15:44:02.738732 15181 sql/schemachanger/scbuild/build.go:55  [T1,n1,client=127.0.0.1:53066,hostssl,user=root] 2933  building declarative schema change targets for CREATE INDEX
W230711 15:44:02.742087 15181 sql/schemachanger/scbuild/internal/scbuildstmt/create_index.go:393  [T1,n1,client=127.0.0.1:53066,hostssl,user=root] 2934  failed building declarative schema change targets for CREATE INDEX with error: unimplemented: column j is of type jsonb and thus is not indexable
W230711 15:44:02.742087 15181 sql/schemachanger/scbuild/internal/scbuildstmt/create_index.go:393  [T1,n1,client=127.0.0.1:53066,hostssl,user=root] 2934 +HINT: You have attempted to use a feature that is not yet implemented.
W230711 15:44:02.742087 15181 sql/schemachanger/scbuild/internal/scbuildstmt/create_index.go:393  [T1,n1,client=127.0.0.1:53066,hostssl,user=root] 2934 +See: https://go.crdb.dev/issue-v/35730/v23.2
I230711 15:44:02.742457 15181 sql/schemachanger/scbuild/build.go:55  [T1,n1,client=127.0.0.1:53066,hostssl,user=root] 2935  building declarative schema change targets for CREATE INDEX
W230711 15:44:02.746003 15181 sql/schemachanger/scbuild/internal/scbuildstmt/create_index.go:393  [T1,n1,client=127.0.0.1:53066,hostssl,user=root] 2936  failed building declarative schema change targets for CREATE INDEX with error: unimplemented: column crdb_internal_idx_expr is of type jsonb and thus is not indexable
W230711 15:44:02.746003 15181 sql/schemachanger/scbuild/internal/scbuildstmt/create_index.go:393  [T1,n1,client=127.0.0.1:53066,hostssl,user=root] 2936 +HINT: You have attempted to use a feature that is not yet implemented.
W230711 15:44:02.746003 15181 sql/schemachanger/scbuild/internal/scbuildstmt/create_index.go:393  [T1,n1,client=127.0.0.1:53066,hostssl,user=root] 2936 +See: https://go.crdb.dev/issue-v/35730/v23.2
I230711 15:44:02.749667 15223 9@sql/pgwire/conn.go:367  [T1,n1,client=127.0.0.1:53066,hostssl,user=root] 2937  could not parse simple query: CREATE TABLE test.tbl_json_secondary_unique(
I230711 15:44:02.749667 15223 9@sql/pgwire/conn.go:367  [T1,n1,client=127.0.0.1:53066,hostssl,user=root] 2937 +    j JSONB,
I230711 15:44:02.749667 15223 9@sql/pgwire/conn.go:367  [T1,n1,client=127.0.0.1:53066,hostssl,user=root] 2937 +    UNIQUE tbl_json_secondary_uidx (j)
I230711 15:44:02.749667 15223 9@sql/pgwire/conn.go:367  [T1,n1,client=127.0.0.1:53066,hostssl,user=root] 2937 +)
I230711 15:44:02.758188 15181 upgrade/upgrademanager/manager.go:397  [T1,n1,client=127.0.0.1:53066,hostssl,user=root,migration-mgr] 2938  migrating cluster from 1000023.1 to 1000023.1-14 (stepping through [1000023.1-2 1000023.1-4 1000023.1-6 1000023.1-8 1000023.1-10 1000023.1-12 1000023.1-14])
I230711 15:44:02.758260 15181 upgrade/upgrademanager/manager.go:657  [T1,n1,client=127.0.0.1:53066,hostssl,user=root,migration-mgr] 2939  executing operation validate-cluster-version=1000023.1-14
I230711 15:44:02.758541 15181 upgrade/upgradecluster/cluster.go:121  [T1,n1,client=127.0.0.1:53066,hostssl,user=root,migration-mgr] 2940  executing validate-cluster-version=1000023.1-14 on nodes n{1}
W230711 15:44:02.779658 15181 upgrade/upgrademanager/manager.go:370  [T1,n1,client=127.0.0.1:53066,hostssl,user=root,migration-mgr] 2941  error encountered during version upgrade: verifying precondition for version 1000023.1-2: query-invalid_objects: crdb-internal-jobs-table: system-jobs-scan: column "job_type" does not exist
    json_forward_indexes_test.go:147: 
        	Error Trace:	github.com/cockroachdb/cockroach/pkg/upgrade/upgrades_test/pkg/upgrade/upgrades/json_forward_indexes_test.go:147
        	Error:      	Received unexpected error:
        	            	pq: verifying precondition for version 1000023.1-2: query-invalid_objects: crdb-internal-jobs-table: system-jobs-scan: column "job_type" does not exist
        	Test:       	TestJSONForwardingIndexes
I230711 15:44:02.780631 13613 testutils/testcluster/testcluster.go:145  [-] 2942  TestCluster quiescing nodes
W230711 15:44:02.780742 36716 kv/kvserver/intentresolver/intent_resolver.go:826  [-] 2943  failed to gc transaction record: could not GC completed transaction anchored at /Table/15/1/881524219241496577: node unavailable; try another peer
I230711 15:44:02.780813 14367 sql/stats/automatic_stats.go:624  [T1,n1] 2944  quiescing stats garbage collector
I230711 15:44:02.780843 13880 server/start_listen.go:103  [T1,n1] 2946  server shutting down: instructing cmux to stop accepting
I230711 15:44:02.780825 14366 sql/stats/automatic_stats.go:572  [T1,n1] 2945  quiescing auto stats refresher
W230711 15:44:02.780897 14328 sql/sqlliveness/slinstance/slinstance.go:334  [T1,n1] 2947  exiting heartbeat loop
W230711 15:44:02.780929 14328 sql/sqlliveness/slinstance/slinstance.go:321  [T1,n1] 2948  exiting heartbeat loop with error: node unavailable; try another peer
E230711 15:44:02.780944 14328 server/server_sql.go:514  [T1,n1] 2949  failed to run update of instance with new session ID: node unavailable; try another peer
E230711 15:44:02.780970 35429 jobs/registry.go:1004  [T1,n1] 2950  error getting live session: node unavailable; try another peer
I230711 15:44:02.781123 14711 jobs/registry.go:1606  [T1,n1] 2951  AUTO SPAN CONFIG RECONCILIATION job 881524181872082945: stepping through state succeeded
I230711 15:44:02.787446 13613 server/server_controller_orchestration.go:263  [T1,n1] 2952  server controller shutting down ungracefully
I230711 15:44:02.787478 13613 server/server_controller_orchestration.go:274  [T1,n1] 2953  waiting for tenant servers to report stopped
W230711 15:44:02.787556 13613 server/server_sql.go:1679  [T1,n1] 2954  server shutdown without a prior graceful drain
--- FAIL: TestJSONForwardingIndexes (12.00s)
Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@michae2
Copy link
Collaborator

michae2 commented Jul 12, 2023

This is a dupe of #103239

@michae2 michae2 closed this as completed Jul 12, 2023
@mgartner mgartner moved this to Done in SQL Queries Jul 24, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@michae2 michae2

Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. T-sql-queries SQL Queries Team
Projects
SQL Queries
Archived in project
Milestone
23.2
Development

No branches or pull requests
3 participants
@rafiss @cockroach-teamcity @michae2