Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Compaction via SQL command #34749

Closed
breezewish opened this issue May 17, 2022 · 1 comment
Closed

Support Compaction via SQL command #34749

breezewish opened this issue May 17, 2022 · 1 comment
Labels
type/enhancement The issue or PR belongs to an enhancement.

Comments

@breezewish
Copy link
Member

breezewish commented May 17, 2022

Enhancement

Recently the PageStorage v3 engine was introduced to TiFlash. By allowing users to manually trigger the compaction, the migration from PageStorage v2 to PageStorage v3 can be done easily, as a compaction command will merge and clear all delta layer data (which was stored in v2) into the stable layer, while new delta layer data will be stored in PageStorage v3.
As a bonus, even when the Delta layer is already stored in PageStorage v3, users can also benefit from this manual compaction command, considering that compaction will rewrite the stored data into a better organized state.

Consider providing SQL which can execute directly from TiDB:

alter table T compact tiflash replica; 

Related TiFlash issue: pingcap/tiflash#4145 pingcap/tiflash#4897

@breezewish breezewish added the type/enhancement The issue or PR belongs to an enhancement. label May 17, 2022
@breezewish breezewish mentioned this issue May 18, 2022
12 tasks
@breezewish
Copy link
Member Author

Implemented in #34741

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/enhancement The issue or PR belongs to an enhancement.
Projects
None yet
Development

No branches or pull requests

1 participant