New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Kafka source optimization #157

Open

2 tasks

wey-gu opened this issue Sep 21, 2023 · 1 comment

Labels

type/enhancement

Contributor

wey-gu commented Sep 21, 2023

If we wire upstream CDC sources to Kafka, we could have streaming data with different schema, and change mode(delete, insert, update).

We may be improving exchange Kafka on:

configuration could map data to multiple edge types?

I could relate to the limitation now it seems it's already doable from the conf structure. @salahaz could you please help provide more context?

Insert/update/delete mode could be handled automatically?

@salahaz could you help provide more ideas on this pain point?

wey-gu added the type/enhancement label

wey-gu mentioned this issue

Weekly Report 2023-09-22 vesoft-inc/nebula-community#409

Closed

Contributor

Nicole00 commented Dec 5, 2023

the requirement looks like more suitable for flink connector, which is already supported.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment