Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mechanism to allow a user to unsubscribe from individual topics #28

Open
cmccarthy1 opened this issue Jun 5, 2020 · 1 comment
Open

Comments

@cmccarthy1
Copy link
Contributor

Internal Feature Request

Is your feature request related to a problem? Please describe.
The addition of the ability to subscribe to multiple topics in v1.4.0 of this interface, however the unsubscribe functionality is asymmetric to this allowing for subscriptions from all topics to be completed only.

Describe the solution you'd like
The underlying functionality which controls unsubscriptions within the current api calls the librdkafka function rd_kafka_unsubscribe to achieve unsubscriptions. This is essentially the same as calling subscribe with no topics which doesn't provide sufficient granularity.

This is outlined here.

Describe alternatives you've considered
Exposure of the assignment interface appears to allow a level of granularity that would begin to allow this to be achieved. This allows a user to remove the consumption of data from particular topic/partition pairs and could form the basis for a solution.

Additional resource
Prototypes for the C code which may be useful for exposure of the Assignment function calls are available here

@mshimizu-kx
Copy link
Contributor

consume_start/stop is not feasible because index of a topic is not visible for consumer unless the topic is created in the same process. So the deleting the assignment might be the only way to do this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants