Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

coproc: Server side check for multiple scripts producing on exact same materialized topics #378

Closed
graphcareful opened this issue Jan 6, 2021 · 2 comments
Assignees

Comments

@graphcareful
Copy link
Contributor

A materialized topic schema is <input_topic>.$<destination_topic>$ , so if two different coprocessors produce on the same destination_topic for which those records originated from the same input_topic, those two writes will race to the same underlying log and crash redpanda.

Long term solution would be to namespace the materialized_topic schema with the script_id.

Short term proposal is to perform a possibly expensive check before writing to a materialized log

@emaxerrno
Copy link
Contributor

Hmm. I don't follow. This is a bug on coproc then. Why would semantics change

@graphcareful
Copy link
Contributor Author

Gotcha, this is expected behavior, closing this and opening a bug report instead

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants