Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Make TiCDC igonre irrelevant DDLs. #6447

Closed
2 tasks done
asddongmen opened this issue Jul 24, 2022 · 0 comments
Closed
2 tasks done

Make TiCDC igonre irrelevant DDLs. #6447

asddongmen opened this issue Jul 24, 2022 · 0 comments
Assignees
@asddongmen
Labels
area/ticdc Issues or PRs related to TiCDC. component/ddl DDL component. type/feature Issues about a new feature

Comments

@asddongmen
Copy link
Contributor

asddongmen commented Jul 24, 2022 •
edited
Loading

Is your feature request related to a problem?

Now TiCDC will pulls all DDLs excuted in upstrem TiDB and applies them to a SchemaStorage that stored in memory to make sure all table infos are up to date.
If there is a huge amount of tables exist in upstream and DDLs are executed frequenty in upstream TiDB, then SchemaStorage my consume a lot of time to apply those DDLs and and memory to keep the table infos.

ref: https://asktug.com/t/topic/813099

Describe the feature you'd like

Describe alternatives you've considered

No response

Teachability, Documentation, Adoption, Migration Strategy

No response
@asddongmen asddongmen added the type/feature Issues about a new feature label Jul 24, 2022
@asddongmen asddongmen mentioned this issue Jul 24, 2022
Merged
3 tasks
@3AceShowHand 3AceShowHand added component/ddl DDL component. area/ticdc Issues or PRs related to TiCDC. labels Jul 27, 2022
@asddongmen asddongmen changed the title Make TiCDC igonre unrelated DDLs. Make TiCDC igonre irrelevant DDLs. Jul 27, 2022
ti-chi-bot pushed a commit that referenced this issue Sep 2, 2022
@asddongmen
ddl_puller(ticdc): discard DDLs that irrelevant with changefeed (#6446)
e2d1f6e 
ref #3607, ref #6447
3AceShowHand pushed a commit to 3AceShowHand/tiflow that referenced this issue Sep 5, 2022
@asddongmen @3AceShowHand
ddl_puller(ticdc): discard DDLs that irrelevant with changefeed (ping…
5bcbec5 
…cap#6446)

ref pingcap#3607, ref pingcap#6447
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@asddongmen asddongmen

Labels
area/ticdc Issues or PRs related to TiCDC. component/ddl DDL component. type/feature Issues about a new feature
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@3AceShowHand @asddongmen