Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Materialized Views Regression] Drop Materailized view fails in databases with PITR schedule setup #12496

Closed
kripasreenivasan opened this issue May 13, 2022 · 1 comment
Closed

[Materialized Views Regression] Drop Materailized view fails in databases with PITR schedule setup #12496

kripasreenivasan opened this issue May 13, 2022 · 1 comment
Assignees
@fizaaluthra
Labels
kind/bug This issue is a bug priority/high High Priority

Comments

@kripasreenivasan
Copy link
Contributor

kripasreenivasan commented May 13, 2022 •
edited
Loading

Jira Link: [DB-331](https://yugabyte.atlassian.net/browse/DB-331)

Description

CC: @vkulichenko , @m-iancu , @bmatican

This issue is observed in branch 2.13.2.0-b131 onwards
This issue can also be reproduced in master.

Steps:

  • Create a database
  • Create a snapshot schedule on the database
  • Create a table
  • Insert rows
  • Create a materialized view
  • Insert more rows
  • Refresh the materialized view
  • Drop the materialized view
    Issue:
    The drop command fails-
no_pitr=# drop materialized view mv_orders ;
ERROR:  Service unavailable: The object '0000407b000030008000000000000000.mv_orders' is not running: OBJECT_NOT_FOUND

Logs when the drop command was fired:

  1. INFO Logs:
I0513 07:28:30.231648 19375 cluster_balance.cc:379] Skipping load balancing for table 0000406d000030008000000000004078 as its placement information is not available yet
I0513 07:28:33.243248 19375 cluster_balance.cc:379] Skipping load balancing for table 0000407b000030008000000000004090 as its placement information is not available yet
I0513 07:28:36.254998 19375 cluster_balance.cc:379] Skipping load balancing for table 0000407b000030008000000000004094 as its placement information is not available yet
I0513 07:28:37.300328 19351 master_snapshot_coordinator.cc:787] Cleanup of snapshot ad0915b3-b7a5-4210-9398-2ea81dd0b2c4 started.
I0513 07:28:37.302323 19603 master_snapshot_coordinator.cc:938] Finished cleanup of object ad0915b3-b7a5-4210-9398-2ea81dd0b2c4
I0513 07:28:37.310119 19599 db_impl.cc:5471] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [I]: [default] New memtable created with log file: #3
I0513 07:28:37.310144 19599 db_impl.cc:5471] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [R]: [default] New memtable created with log file: #16
I0513 07:28:37.310153 19599 tablet_snapshots.cc:369] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762: Complete snapshot deletion on tablet in folder: /mnt/d0/yb-data/master/data/rocksdb/table-sys.catalog.uuid/tablet-00000000000000000000000000000000.snapshots/2978ddab-2697-436f-adc3-854aa345b8af
I0513 07:28:37.310149 21522 db_impl.cc:3328] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [I]: Calling FlushMemTableToOutputFile with column family [default], flush slots scheduled 1, total flush slots 1, compaction slots scheduled 0, compaction tasks [], total compaction slots 1
I0513 07:28:37.310209 19599 master_snapshot_coordinator.cc:726] Number of snapshot operations to be executed 3
I0513 07:28:37.310228 21522 flush_job.cc:251] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [I]: [default] [JOB 25] Flushing memtable with next log file: 3
I0513 07:28:37.310248 21522 event_logger.cc:66] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [I]: EVENT_LOG_v1 {"time_micros": 1652426917310242, "job": 25, "event": "flush_started", "num_memtables": 1, "num_entries": 242, "num_deletes": 0, "memory_usage": 25560}
I0513 07:28:37.310253 21522 flush_job.cc:279] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [I]: [default] [JOB 25] Level-0 flush table #34: started
W0513 07:28:37.310273 21522 env.cc:87] Failed to cleanup /mnt/d0/yb-data/master/data/rocksdb/table-sys.catalog.uuid/tablet-00000000000000000000000000000000.intents/000034.sst: IO error (yb/rocksdb/util/env_posix.cc:238): /mnt/d0/yb-data/master/data/rocksdb/table-sys.catalog.uuid/tablet-00000000000000000000000000000000.intents/000034.sst: No such file or directory
W0513 07:28:37.310287 21522 env.cc:87] Failed to cleanup /mnt/d0/yb-data/master/data/rocksdb/table-sys.catalog.uuid/tablet-00000000000000000000000000000000.intents/000034.sst.sblock.0: IO error (yb/rocksdb/util/env_posix.cc:238): /mnt/d0/yb-data/master/data/rocksdb/table-sys.catalog.uuid/tablet-00000000000000000000000000000000.intents/000034.sst.sblock.0: No such file or directory
I0513 07:28:37.310319 21522 flush_job.cc:311] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [I]: [default] [JOB 25] Level-0 flush table #34: 0 bytes OK frontiers: { smallest: { op_id: 1.4136 hybrid_time: { physical: 1652426890745401 } history_cutoff: <invalid> hybrid_time_filter: <invalid> max_value_level_ttl_expiration_time: <invalid> primary_schema_version: <NULL> cotable_schema_versions: [{df040000-0000-0080-0030-00007b400000, 0}, {850a0000-0000-0080-0030-00007b400000, 0}, {720a0000-0000-0080-0030-00007b400000, 0}, {710a0000-0000-0080-0030-00007b400000, 0}, {900a0000-0000-0080-0030-00007b400000, 0}, {300a0000-0000-0080-0030-00007b400000, 0}, {3a0a0000-0000-0080-0030-00007b400000, 0}] } largest: { op_id: 1.4147 hybrid_time: { physical: 1652426912732864 } history_cutoff: <invalid> hybrid_time_filter: <invalid> max_value_level_ttl_expiration_time: <initial> primary_schema_version: <NULL> cotable_schema_versions: [{df040000-0000-0080-0030-00007b400000, 0}, {850a0000-0000-0080-0030-00007b400000, 0}, {720a0000-0000-0080-0030-00007b400000, 0}, {710a0000-0000-0080-0030-00007b400000, 0}, {900a0000-0000-0080-0030-00007b400000, 0}, {300a0000-0000-0080-0030-00007b400000, 0}, {3a0a0000-0000-0080-0030-00007b400000, 0}] } }
I0513 07:28:37.310335 21522 event_logger.cc:66] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [I]: EVENT_LOG_v1 {"time_micros": 1652426917310326, "cf_name": "default", "job": 25, "event": "table_file_creation", "file_number": 34, "file_size": 0, "table_properties": {"data_size": 0, "data_index_size": 0, "filter_size": 0, "filter_index_size": 0, "raw_key_size": 0, "raw_average_key_size": 0, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 0, "num_entries": 0, "num_filter_blocks": 0, "num_data_index_blocks": 0, "filter_policy_name": ""}}
I0513 07:28:37.310425 19599 snapshot_operation.cc:220] Forcing modify flushed frontier to 1.4149
I0513 07:28:37.310501 21522 db_impl.cc:1967] [default] Level summary: files[0] max score 0.00
I0513 07:28:37.310523 21522 memtable_list.cc:385] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [I]: [default] Level-0 commit table #34 started
I0513 07:28:37.310530 21522 memtable_list.cc:401] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [I]: [default] Level-0 commit table #34: memtable #1 done
I0513 07:28:37.310536 21522 event_logger.cc:76] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [I]: EVENT_LOG_v1 {"time_micros": 1652426917310485, "job": 25, "event": "flush_finished", "lsm_state": [0]}
I0513 07:28:37.310560 21522 flush_job.cc:251] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [R]: [default] [JOB 906] Flushing memtable with next log file: 16
I0513 07:28:37.310575 21522 event_logger.cc:66] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [R]: EVENT_LOG_v1 {"time_micros": 1652426917310570, "job": 906, "event": "flush_started", "num_memtables": 1, "num_entries": 2, "num_deletes": 0, "memory_usage": 6336}
I0513 07:28:37.310581 21522 flush_job.cc:279] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [R]: [default] [JOB 906] Level-0 flush table #928: started
I0513 07:28:37.310781 19599 db_impl.cc:5471] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [R]: [default] New memtable created with log file: #16
W0513 07:28:37.310796 19599 column_family.cc:590] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [R]: [default] Stopping writes because we have 2 immutable memtables (waiting for flush), max_write_buffer_number is set to 2
I0513 07:28:37.310950 21522 flush_job.cc:311] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [R]: [default] [JOB 906] Level-0 flush table #928: 2102 bytes OK frontiers: { smallest: { op_id: 1.4135 hybrid_time: { physical: 1652426882313948 } history_cutoff: <invalid> hybrid_time_filter: <invalid> max_value_level_ttl_expiration_time: <invalid> primary_schema_version: <NULL> cotable_schema_versions: [] } largest: { op_id: 1.4148 hybrid_time: { physical: 1652426917300417 } history_cutoff: <invalid> hybrid_time_filter: <invalid> max_value_level_ttl_expiration_time: <initial> primary_schema_version: <NULL> cotable_schema_versions: [] } }
I0513 07:28:37.310977 21522 event_logger.cc:66] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [R]: EVENT_LOG_v1 {"time_micros": 1652426917310967, "cf_name": "default", "job": 906, "event": "table_file_creation", "file_number": 928, "file_size": 2102, "table_properties": {"data_size": 1308, "data_index_size": 28, "filter_size": 0, "filter_index_size": 0, "raw_key_size": 92, "raw_average_key_size": 46, "raw_value_size": 4153, "raw_average_value_size": 2076, "num_data_blocks": 1, "num_entries": 2, "num_filter_blocks": 0, "num_data_index_blocks": 1, "filter_policy_name": "", "kDeletedKeys": "0"}}
I0513 07:28:37.311198 21522 memtable_list.cc:385] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [R]: [default] Level-0 commit table #928 started
I0513 07:28:37.311204 21522 memtable_list.cc:401] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [R]: [default] Level-0 commit table #928: memtable #1 done
I0513 07:28:37.311208 21522 event_logger.cc:76] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [R]: EVENT_LOG_v1 {"time_micros": 1652426917311176, "job": 906, "event": "flush_finished", "lsm_state": [2]}
I0513 07:28:37.311230 21522 flush_job.cc:251] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [R]: [default] [JOB 907] Flushing memtable with next log file: 16
I0513 07:28:37.311239 21522 event_logger.cc:66] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [R]: EVENT_LOG_v1 {"time_micros": 1652426917311237, "job": 907, "event": "flush_started", "num_memtables": 1, "num_entries": 1, "num_deletes": 0, "memory_usage": 8344}
I0513 07:28:37.311244 21522 flush_job.cc:279] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [R]: [default] [JOB 907] Level-0 flush table #929: started
I0513 07:28:37.311429 21522 flush_job.cc:311] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [R]: [default] [JOB 907] Level-0 flush table #929: 2504 bytes OK frontiers: { smallest: { op_id: 1.4149 hybrid_time: { physical: 1652426917300552 } history_cutoff: <invalid> hybrid_time_filter: <invalid> max_value_level_ttl_expiration_time: <invalid> primary_schema_version: <NULL> cotable_schema_versions: [] } largest: { op_id: 1.4149 hybrid_time: { physical: 1652426917300552 } history_cutoff: <invalid> hybrid_time_filter: <invalid> max_value_level_ttl_expiration_time: <initial> primary_schema_version: <NULL> cotable_schema_versions: [] } }
I0513 07:28:37.311446 21522 event_logger.cc:66] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [R]: EVENT_LOG_v1 {"time_micros": 1652426917311438, "cf_name": "default", "job": 907, "event": "table_file_creation", "file_number": 929, "file_size": 2504, "table_properties": {"data_size": 1710, "data_index_size": 28, "filter_size": 0, "filter_index_size": 0, "raw_key_size": 46, "raw_average_key_size": 46, "raw_value_size": 6230, "raw_average_value_size": 6230, "num_data_blocks": 1, "num_entries": 1, "num_filter_blocks": 0, "num_data_index_blocks": 1, "filter_policy_name": "", "kDeletedKeys": "0"}}
I0513 07:28:37.311612 21522 memtable_list.cc:385] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [R]: [default] Level-0 commit table #929 started
I0513 07:28:37.311617 21522 memtable_list.cc:401] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [R]: [default] Level-0 commit table #929: memtable #1 done
I0513 07:28:37.311621 21522 event_logger.cc:76] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762 [R]: EVENT_LOG_v1 {"time_micros": 1652426917311594, "job": 907, "event": "flush_finished", "lsm_state": [3]}
I0513 07:28:37.313289 19604 state_with_tablets.cc:162] Snapshot[2978ddab-2697-436f-adc3-854aa345b8af/721ed3c0-afff-4913-8824-a8b254e66072]: Finished DELETING at b1b6ee11e06a4c739f877e95fa2e32ee, 9 was running
I0513 07:28:37.314175 19605 state_with_tablets.cc:162] Snapshot[2978ddab-2697-436f-adc3-854aa345b8af/721ed3c0-afff-4913-8824-a8b254e66072]: Finished DELETING at 20e00382d3fa4f118c39509d0444e5d3, 8 was running
I0513 07:28:37.314898 19604 state_with_tablets.cc:162] Snapshot[2978ddab-2697-436f-adc3-854aa345b8af/721ed3c0-afff-4913-8824-a8b254e66072]: Finished DELETING at e59cded6767a4045b6b34be860445557, 7 was running
I0513 07:28:37.314915 19354 master_snapshot_coordinator.cc:1098] Rescheduling Snapshot RPCs out of band.
I0513 07:28:37.314957 19354 master_snapshot_coordinator.cc:726] Number of snapshot operations to be executed 3
I0513 07:28:37.315109 19354 catalog_manager_ent.cc:2074] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762: Cleanup hidden tablets: [0x0000000008538c80 -> 89e8fa05b9584fce94f207b4d4a6c8f5 (table mv_orders [id=0000407b000030008000000000004090]), 0x0000000008252780 -> b85c98c66c56433e8fc594d775b9478b (table mv_orders [id=0000407b000030008000000000004090]), 0x0000000008253900 -> d86543007c004c48aaacf19d55f9c767 (table mv_orders [id=0000407b000030008000000000004090])]
I0513 07:28:37.315143 19354 catalog_manager.cc:9121] Deleting tablet 89e8fa05b9584fce94f207b4d4a6c8f5
I0513 07:28:37.315167 19354 catalog_manager.cc:9121] Deleting tablet b85c98c66c56433e8fc594d775b9478b
I0513 07:28:37.315174 19354 catalog_manager.cc:9121] Deleting tablet d86543007c004c48aaacf19d55f9c767
I0513 07:28:37.317399 19354 catalog_manager.cc:9138] Deleted tablet 89e8fa05b9584fce94f207b4d4a6c8f5
I0513 07:28:37.317414 19354 catalog_manager.cc:9018] Sending DeleteTablet for 3 replicas of tablet 89e8fa05b9584fce94f207b4d4a6c8f5
I0513 07:28:37.317421 19354 catalog_manager.cc:9162] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762: Deleting tablet 89e8fa05b9584fce94f207b4d4a6c8f5 on peer 2eaaaea11b6b48378c8c8c1c34cc0da6 with delete type TABLET_DATA_DELETED (Cleanup hidden tablets)
I0513 07:28:37.317443 19354 catalog_manager.cc:9162] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762: Deleting tablet 89e8fa05b9584fce94f207b4d4a6c8f5 on peer 8c1ad5fe340a44c1bedf554624feddd3 with delete type TABLET_DATA_DELETED (Cleanup hidden tablets)
I0513 07:28:37.317452 19354 catalog_manager.cc:9162] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762: Deleting tablet 89e8fa05b9584fce94f207b4d4a6c8f5 on peer 3146662dab664b8d812e49b8e2a83172 with delete type TABLET_DATA_DELETED (Cleanup hidden tablets)
I0513 07:28:37.317466 19354 catalog_manager.cc:9138] Deleted tablet b85c98c66c56433e8fc594d775b9478b
I0513 07:28:37.317469 19354 catalog_manager.cc:9018] Sending DeleteTablet for 3 replicas of tablet b85c98c66c56433e8fc594d775b9478b
I0513 07:28:37.317473 19354 catalog_manager.cc:9162] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762: Deleting tablet b85c98c66c56433e8fc594d775b9478b on peer 2eaaaea11b6b48378c8c8c1c34cc0da6 with delete type TABLET_DATA_DELETED (Cleanup hidden tablets)
I0513 07:28:37.317485 19354 catalog_manager.cc:9162] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762: Deleting tablet b85c98c66c56433e8fc594d775b9478b on peer 8c1ad5fe340a44c1bedf554624feddd3 with delete type TABLET_DATA_DELETED (Cleanup hidden tablets)
I0513 07:28:37.317497 19354 catalog_manager.cc:9162] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762: Deleting tablet b85c98c66c56433e8fc594d775b9478b on peer 3146662dab664b8d812e49b8e2a83172 with delete type TABLET_DATA_DELETED (Cleanup hidden tablets)
I0513 07:28:37.317507 19354 catalog_manager.cc:9138] Deleted tablet d86543007c004c48aaacf19d55f9c767
I0513 07:28:37.317512 19354 catalog_manager.cc:9018] Sending DeleteTablet for 3 replicas of tablet d86543007c004c48aaacf19d55f9c767
I0513 07:28:37.317515 19354 catalog_manager.cc:9162] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762: Deleting tablet d86543007c004c48aaacf19d55f9c767 on peer 2eaaaea11b6b48378c8c8c1c34cc0da6 with delete type TABLET_DATA_DELETED (Cleanup hidden tablets)
I0513 07:28:37.317530 19354 catalog_manager.cc:9162] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762: Deleting tablet d86543007c004c48aaacf19d55f9c767 on peer 8c1ad5fe340a44c1bedf554624feddd3 with delete type TABLET_DATA_DELETED (Cleanup hidden tablets)
I0513 07:28:37.317538 19354 catalog_manager.cc:9162] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762: Deleting tablet d86543007c004c48aaacf19d55f9c767 on peer 3146662dab664b8d812e49b8e2a83172 with delete type TABLET_DATA_DELETED (Cleanup hidden tablets)
I0513 07:28:37.317564 19354 catalog_manager_ent.cc:2144] T 00000000000000000000000000000000 P e5744fa283d5451085062c62ab32d762: Should delete table: 0x0000000009537680 -> mv_orders [id=0000407b000030008000000000004090]
I0513 07:28:37.318868 19604 state_with_tablets.cc:162] Snapshot[2978ddab-2697-436f-adc3-854aa345b8af/721ed3c0-afff-4913-8824-a8b254e66072]: Finished DELETING at 3e617add6c6e4354852d0e6fd25215b6, 6 was running
I0513 07:28:37.319388 19609 state_with_tablets.cc:162] Snapshot[2978ddab-2697-436f-adc3-854aa345b8af/721ed3c0-afff-4913-8824-a8b254e66072]: Finished DELETING at 373e6fa0c9e9478ebe4b8d3beb7d331f, 5 was running
I0513 07:28:37.319551 19605 state_with_tablets.cc:162] Snapshot[2978ddab-2697-436f-adc3-854aa345b8af/721ed3c0-afff-4913-8824-a8b254e66072]: Finished DELETING at e33129a6ab874298a64b490e070970fa, 4 was running
I0513 07:28:37.319573 19352 master_snapshot_coordinator.cc:1098] Rescheduling Snapshot RPCs out of band.
I0513 07:28:37.319602 19352 master_snapshot_coordinator.cc:726] Number of snapshot operations to be executed 3
I0513 07:28:37.324430 19605 state_with_tablets.cc:162] Snapshot[2978ddab-2697-436f-adc3-854aa345b8af/721ed3c0-afff-4913-8824-a8b254e66072]: Finished DELETING at b8e5a806f50e4a55a0c19e0d8389e86c, 3 was running
I0513 07:28:37.324453 19604 state_with_tablets.cc:162] Snapshot[2978ddab-2697-436f-adc3-854aa345b8af/721ed3c0-afff-4913-8824-a8b254e66072]: Finished DELETING at 994aeb5b9117416ebb8f08502849fc03, 2 was running
I0513 07:28:37.324470 19609 state_with_tablets.cc:162] Snapshot[2978ddab-2697-436f-adc3-854aa345b8af/721ed3c0-afff-4913-8824-a8b254e66072]: Finished DELETING at f599bfa7511640a1aa5aaf0e4ca3f475, 1 was running
I0513 07:28:37.327946 19605 async_rpc_tasks.cc:708] DeleteTablet RPC for tablet 89e8fa05b9584fce94f207b4d4a6c8f5 (mv_orders [id=0000407b000030008000000000004090]) on TS=8c1ad5fe340a44c1bedf554624feddd3 (task=0x000000000635f198, state=kRunning): TS 8c1ad5fe340a44c1bedf554624feddd3: tablet 89e8fa05b9584fce94f207b4d4a6c8f5 (table mv_orders [id=0000407b000030008000000000004090]) successfully done
I0513 07:28:37.327946 19604 async_rpc_tasks.cc:708] DeleteTablet RPC for tablet b85c98c66c56433e8fc594d775b9478b (mv_orders [id=0000407b000030008000000000004090]) on TS=8c1ad5fe340a44c1bedf554624feddd3 (task=0x000000000628ba58, state=kRunning): TS 8c1ad5fe340a44c1bedf554624feddd3: tablet b85c98c66c56433e8fc594d775b9478b (table mv_orders [id=0000407b000030008000000000004090]) successfully done
I0513 07:28:37.327984 19605 catalog_manager.cc:6382] Clearing pending delete for tablet 89e8fa05b9584fce94f207b4d4a6c8f5 in ts 8c1ad5fe340a44c1bedf554624feddd3
I0513 07:28:37.327987 19604 catalog_manager.cc:6382] Clearing pending delete for tablet b85c98c66c56433e8fc594d775b9478b in ts 8c1ad5fe340a44c1bedf554624feddd3
I0513 07:28:37.327998 19605 async_rpc_tasks.cc:708] DeleteTablet RPC for tablet 89e8fa05b9584fce94f207b4d4a6c8f5 (mv_orders [id=0000407b000030008000000000004090]) on TS=2eaaaea11b6b48378c8c8c1c34cc0da6 (task=0x000000000635fc18, state=kRunning): TS 2eaaaea11b6b48378c8c8c1c34cc0da6: tablet 89e8fa05b9584fce94f207b4d4a6c8f5 (table mv_orders [id=0000407b000030008000000000004090]) successfully done
I0513 07:28:37.328009 19605 catalog_manager.cc:6382] Clearing pending delete for tablet 89e8fa05b9584fce94f207b4d4a6c8f5 in ts 2eaaaea11b6b48378c8c8c1c34cc0da6
I0513 07:28:37.328305 19604 async_rpc_tasks.cc:708] DeleteTablet RPC for tablet d86543007c004c48aaacf19d55f9c767 (mv_orders [id=0000407b000030008000000000004090]) on TS=8c1ad5fe340a44c1bedf554624feddd3 (task=0x0000000006b4c558, state=kRunning): TS 8c1ad5fe340a44c1bedf554624feddd3: tablet d86543007c004c48aaacf19d55f9c767 (table mv_orders [id=0000407b000030008000000000004090]) successfully done
I0513 07:28:37.328325 19604 catalog_manager.cc:6382] Clearing pending delete for tablet d86543007c004c48aaacf19d55f9c767 in ts 8c1ad5fe340a44c1bedf554624feddd3
I0513 07:28:37.328966 19605 async_rpc_tasks.cc:708] DeleteTablet RPC for tablet d86543007c004c48aaacf19d55f9c767 (mv_orders [id=0000407b000030008000000000004090]) on TS=2eaaaea11b6b48378c8c8c1c34cc0da6 (task=0x0000000006b4c1d8, state=kRunning): TS 2eaaaea11b6b48378c8c8c1c34cc0da6: tablet d86543007c004c48aaacf19d55f9c767 (table mv_orders [id=0000407b000030008000000000004090]) successfully done
I0513 07:28:37.328979 19605 catalog_manager.cc:6382] Clearing pending delete for tablet d86543007c004c48aaacf19d55f9c767 in ts 2eaaaea11b6b48378c8c8c1c34cc0da6
I0513 07:28:37.328982 19609 async_rpc_tasks.cc:708] DeleteTablet RPC for tablet b85c98c66c56433e8fc594d775b9478b (mv_orders [id=0000407b000030008000000000004090]) on TS=2eaaaea11b6b48378c8c8c1c34cc0da6 (task=0x000000000628ae18, state=kRunning): TS 2eaaaea11b6b48378c8c8c1c34cc0da6: tablet b85c98c66c56433e8fc594d775b9478b (table mv_orders [id=0000407b000030008000000000004090]) successfully done
I0513 07:28:37.328996 19609 catalog_manager.cc:6382] Clearing pending delete for tablet b85c98c66c56433e8fc594d775b9478b in ts 2eaaaea11b6b48378c8c8c1c34cc0da6
I0513 07:28:37.329074 19604 async_rpc_tasks.cc:708] DeleteTablet RPC for tablet d86543007c004c48aaacf19d55f9c767 (mv_orders [id=0000407b000030008000000000004090]) on TS=3146662dab664b8d812e49b8e2a83172 (task=0x0000000006b4c8d8, state=kRunning): TS 3146662dab664b8d812e49b8e2a83172: tablet d86543007c004c48aaacf19d55f9c767 (table mv_orders [id=0000407b000030008000000000004090]) successfully done
I0513 07:28:37.329083 19604 catalog_manager.cc:6382] Clearing pending delete for tablet d86543007c004c48aaacf19d55f9c767 in ts 3146662dab664b8d812e49b8e2a83172
I0513 07:28:37.329473 19605 async_rpc_tasks.cc:708] DeleteTablet RPC for tablet 89e8fa05b9584fce94f207b4d4a6c8f5 (mv_orders [id=0000407b000030008000000000004090]) on TS=3146662dab664b8d812e49b8e2a83172 (task=0x000000000635e8d8, state=kRunning): TS 3146662dab664b8d812e49b8e2a83172: tablet 89e8fa05b9584fce94f207b4d4a6c8f5 (table mv_orders [id=0000407b000030008000000000004090]) successfully done
I0513 07:28:37.329494 19605 catalog_manager.cc:6382] Clearing pending delete for tablet 89e8fa05b9584fce94f207b4d4a6c8f5 in ts 3146662dab664b8d812e49b8e2a83172
I0513 07:28:37.330158 19609 async_rpc_tasks.cc:708] DeleteTablet RPC for tablet b85c98c66c56433e8fc594d775b9478b (mv_orders [id=0000407b000030008000000000004090]) on TS=3146662dab664b8d812e49b8e2a83172 (task=0x000000000628b6d8, state=kRunning): TS 3146662dab664b8d812e49b8e2a83172: tablet b85c98c66c56433e8fc594d775b9478b (table mv_orders [id=0000407b000030008000000000004090]) successfully done
I0513 07:28:37.330171 19609 catalog_manager.cc:6382] Clearing pending delete for tablet b85c98c66c56433e8fc594d775b9478b in ts 3146662dab664b8d812e49b8e2a83172
I0513 07:28:40.271114 19375 cluster_balance_util.cc:414] tablet server 2eaaaea11b6b48378c8c8c1c34cc0da6 has invalid placement info. Not allowing it to take more tablets.
I0513 07:28:41.274330 19375 cluster_balance.cc:379] Skipping load balancing for table 0000406d000030008000000000004078 as its placement information is not available yet
W0513 07:28:43.190881 19619 catalog_manager.cc:2146] Refreshing table->tablespace info failed for namespace 00004000000030008000000000000000 with error: Not found (yb/tablet/tablet_metadata.cc:414): Table <unknown_table_name> (000040000000300080000000000004eb) not found in Raft group 00000000000000000000000000000000
W0513 07:28:43.190919 19619 catalog_manager.cc:2164] Refreshing tablegroup->tablespace info failed for namespace 00004000000030008000000000000000 with error: Not found (yb/tablet/tablet_metadata.cc:414): Table <unknown_table_name> (00004000000030008000000000001f64) not found in Raft group 00000000000000000000000000000000
W0513 07:28:43.191215 19619 catalog_manager.cc:2146] Refreshing table->tablespace info failed for namespace 00004046000030008000000000000000 with error: Not found (yb/tablet/tablet_metadata.cc:414): Table <unknown_table_name> (000040460000300080000000000004eb) not found in Raft group 00000000000000000000000000000000
W0513 07:28:43.191231 19619 catalog_manager.cc:2164] Refreshing tablegroup->tablespace info failed for namespace 00004046000030008000000000000000 with error: Not found (yb/tablet/tablet_metadata.cc:414): Table <unknown_table_name> (00004046000030008000000000001f64) not found in Raft group 00000000000000000000000000000000

2. WARNING logs

004eb) not found in Raft group 00000000000000000000000000000000
W0513 07:26:13.185308 18943 catalog_manager.cc:2164] Refreshing tablegroup->tablespace info failed for namespace 00004046000030008000000000000000 with error: Not found (yb/tablet/tablet_metadata.cc:414): Table <unknown_table_name> (00004046000030008000000000001f64) not found in Raft group 00000000000000000000000000000000
W0513 07:26:43.186017 18967 catalog_manager.cc:2146] Refreshing table->tablespace info failed for namespace 00004000000030008000000000000000 with error: Not found (yb/tablet/tablet_metadata.cc:414): Table <unknown_table_name> (000040000000300080000000000004eb) not found in Raft group 00000000000000000000000000000000
W0513 07:26:43.186070 18967 catalog_manager.cc:2164] Refreshing tablegroup->tablespace info failed for namespace 00004000000030008000000000000000 with error: Not found (yb/tablet/tablet_metadata.cc:414): Table <unknown_table_name> (00004000000030008000000000001f64) not found in Raft group 00000000000000000000000000000000
W0513 07:26:43.186353 18967 catalog_manager.cc:2146] Refreshing table->tablespace info failed for namespace 00004046000030008000000000000000 with error: Not found (yb/tablet/tablet_metadata.cc:414): Table <unknown_table_name> (000040460000300080000000000004eb) not found in Raft group 00000000000000000000000000000000
W0513 07:26:43.186370 18967 catalog_manager.cc:2164] Refreshing tablegroup->tablespace info failed for namespace 00004046000030008000000000000000 with error: Not found (yb/tablet/tablet_metadata.cc:414): Table <unknown_table_name> (00004046000030008000000000001f64) not found in Raft group 00000000000000000000000000000000
W0513 07:27:13.187065 19200 catalog_manager.cc:2146] Refreshing table->tablespace info failed for namespace 00004000000030008000000000000000 with error: Not found (yb/tablet/tablet_metadata.cc:414): Table <unknown_table_name> (000040000000300080000000000004eb) not found in Raft group 00000000000000000000000000000000
W0513 07:27:13.187110 19200 catalog_manager.cc:2164] Refreshing tablegroup->tablespace info failed for namespace 00004000000030008000000000000000 with error: Not found (yb/tablet/tablet_metadata.cc:414): Table <unknown_table_name> (00004000000030008000000000001f64) not found in Raft group 00000000000000000000000000000000
W0513 07:27:13.187379 19200 catalog_manager.cc:2146] Refreshing table->tablespace info failed for namespace 00004046000030008000000000000000 with error: Not found (yb/tablet/tablet_metadata.cc:414): Table <unknown_table_name> (000040460000300080000000000004eb) not found in Raft group 00000000000000000000000000000000
W0513 07:27:13.187393 19200 catalog_manager.cc:2164] Refreshing tablegroup->tablespace info failed for namespace 00004046000030008000000000000000 with error: Not found (yb/tablet/tablet_metadata.cc:414): Table <unknown_table_name> (00004046000030008000000000001f64) not found in Raft group 00000000000000000000000000000000
W0513 07:27:43.188103 19230 catalog_manager.cc:2146] Refreshing table->tablespace info failed for namespace 00004000000030008000000000000000 with error: Not found (yb/tablet/tablet_metadata.cc:414): Table <unknown_table_name> (000040000000300080000000000004eb) not found in Raft group 00000000000000000000000000000000
W0513 07:27:43.188133 19230 catalog_manager.cc:2164] Refreshing tablegroup->tablespace info failed for namespace 00004000000030008000000000000000 with error: Not found (yb/tablet/tablet_metadata.cc:414): Table <unknown_table_name> (00004000000030008000000000001f64) not found in Raft group 00000000000000000000000000000000
W0513 07:27:43.188403 19230 catalog_manager.cc:2146] Refreshing table->tablespace info failed for namespace 00004046000030008000000000000000 with error: Not found (yb/tablet/tablet_metadata.cc:414): Table <unknown_table_name> (000040460000300080000000000004eb) not found in Raft group 00000000000000000000000000000000
W0513 07:27:43.188417 19230 catalog_manager.cc:2164] Refreshing tablegroup->tablespace info failed for namespace 00004046000030008000000000000000 with error: Not found (yb/tablet/tablet_metadata.cc:414): Table <unknown_table_name> (00004046000030008000000000001f64) not found in Raft group 00000000000000000000000000000000
@kripasreenivasan kripasreenivasan added area/docdb YugabyteDB core features status/awaiting-triage Issue awaiting triage labels May 13, 2022
@yugabyte-ci yugabyte-ci added kind/bug This issue is a bug priority/medium Medium priority issue labels May 13, 2022
@yugabyte-ci yugabyte-ci added area/ysql Yugabyte SQL (YSQL) and removed status/awaiting-triage Issue awaiting triage area/docdb YugabyteDB core features labels May 24, 2022
fizaaluthra added a commit that referenced this issue Jun 3, 2022
@fizaaluthra
[#12496] YSQL: Fix DROP MATVIEW failure after snapshot schedule cre…
22e93d9 
…ation

Summary:
Upon creating a snapshot schedule, `DROP MATVIEW` began failing after tablegroups/colocation were refactored.
The failure was due to not using the `YbGetStorageRelid()` when checking if the table is colocated before a drop.

Test Plan: Run `TestPgRegressMatview`

Reviewers: myang

Reviewed By: myang

Subscribers: myang, yql

Differential Revision: https://phabricator.dev.yugabyte.com/D17315
fizaaluthra added a commit that referenced this issue Jun 3, 2022
@fizaaluthra
[BACKPORT 2.14][#12496] YSQL: Fix DROP MATVIEW failure after snapsh…
46ec13a 
…ot schedule creation

Summary:
Upon creating a snapshot schedule, `DROP MATVIEW` began failing after tablegroups/colocation were refactored.
The failure was due to not using the `YbGetStorageRelid()` when checking if the table is colocated before a drop.

Test Plan: Run `TestPgRegressMatview`

Reviewers: myang

Reviewed By: myang

Subscribers: myang, yql

Differential Revision: https://phabricator.dev.yugabyte.com/D17316
@yugabyte-ci yugabyte-ci added priority/high High Priority and removed priority/medium Medium priority issue labels Jun 7, 2022
@fizaaluthra
Copy link
Member

Fixed by 22e93d9

@yugabyte-ci yugabyte-ci removed the area/ysql Yugabyte SQL (YSQL) label Jun 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@fizaaluthra fizaaluthra

Labels
kind/bug This issue is a bug priority/high High Priority
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@sanketkedia @yugabyte-ci @fizaaluthra @kripasreenivasan