Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TiCDC changefeed skip lightning physical mode imported data #11801

Closed
2 tasks done
3AceShowHand opened this issue Nov 26, 2024 · 1 comment
Closed
2 tasks done

TiCDC changefeed skip lightning physical mode imported data #11801

3AceShowHand opened this issue Nov 26, 2024 · 1 comment
Assignees
Labels
area/ticdc Issues or PRs related to TiCDC. type/feature Issues about a new feature

Comments

@3AceShowHand
Copy link
Contributor

3AceShowHand commented Nov 26, 2024

Is your feature request related to a problem?

At this stage, users are allowed to import data into the upstream TiDB cluster using Lightning's physical import mode while a Changefeed is active, and Lightning configuration check-requirement must be set to false, otherwise report error to Lightning. From the perspective of Changefeed, the data imported by Lightning's physical import mode can be captured through incremental scanning.
TiCDC and Lightning's physical import mode are claimed to be incompatible, but there is no clear definition of what this "incompatibility" entails. The high data import rate of Lightning's physical import mode often leads to significant latency in Changefeed. Some users have expressed a preference for Changefeed to exclude data imported via Lightning's physical import mode from synchronization.

Describe the feature you'd like

TiCDC Changefeed does not synchronize data imported via Lightning's physical import mode.

Describe alternatives you've considered

No response

Teachability, Documentation, Adoption, Migration Strategy

Action items

@3AceShowHand 3AceShowHand added the type/feature Issues about a new feature label Nov 26, 2024
@3AceShowHand 3AceShowHand self-assigned this Nov 26, 2024
@3AceShowHand 3AceShowHand added the area/ticdc Issues or PRs related to TiCDC. label Nov 26, 2024
@3AceShowHand
Copy link
Contributor Author

close since the feature supported on the Lightning and TiKV-CDC

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/ticdc Issues or PRs related to TiCDC. type/feature Issues about a new feature
Projects
None yet
Development

No branches or pull requests

1 participant