Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kafka ingestion source ingests schemas for all topics and ignores topic_patterns #11907

Open
guentherhackl-wgs opened this issue Nov 20, 2024 · 0 comments
Labels
bug Bug report ingestion PR or Issue related to the ingestion of metadata

Comments

@guentherhackl-wgs
Copy link

Describe the bug
When i load kafka topics and use topic_patterns it filters all the topics but correctly but still produces events for schemas for all topics on the cluster.

To Reproduce

  1. have a broker with 2 topics, both having a schema in confluent schema registry
  2. make a recipe that excludes one of the topics
  3. see all the schemas ingested anyway

Expected behavior
the schemas schould also be filtered

Desktop (please complete the following information):

  • OS: Any
  • Browser Any
  • Datahub CLI Version 0.13.3
@guentherhackl-wgs guentherhackl-wgs added the bug Bug report label Nov 20, 2024
@RyanHolstien RyanHolstien added the ingestion PR or Issue related to the ingestion of metadata label Nov 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Bug report ingestion PR or Issue related to the ingestion of metadata
Projects
None yet
Development

No branches or pull requests

2 participants