Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disable automatic topic creation #221

Merged
merged 3 commits into from
Nov 28, 2018
Merged

Disable automatic topic creation #221

merged 3 commits into from
Nov 28, 2018

Conversation

solsson
Copy link
Contributor

@solsson solsson commented Nov 28, 2018

See the commit comment for why.

so we want to undo #107.
It was partially based on a false assumption, as pointed out in
#101 (comment)

Topics are created not only at produce but also at for example kafkacat -C.
Typos cost us more time than it would take to automate topic creation
and run ./bin/kafka-topics.sh in a temporary pod when we haven't automated.
@solsson solsson added this to the 5.0 - Java 11 milestone Nov 28, 2018
@solsson solsson requested a review from atamon November 28, 2018 08:25
@atamon
Copy link
Contributor

atamon commented Nov 28, 2018

LGTM! 👍

Also: 🍰 🍾

Scope creep: Is our topic automation generic/useful enough to include in this open-source project? Maybe a sample job that describes how we do it?

solsson added a commit that referenced this pull request Nov 28, 2018
@solsson
Copy link
Contributor Author

solsson commented Nov 28, 2018

#121 has quite good examples of topic creation

@solsson
Copy link
Contributor Author

solsson commented Nov 28, 2018

Just found #3 :)

@solsson
Copy link
Contributor Author

solsson commented Nov 28, 2018

It's worth noting here that release notes for 2.1.0 mention "Admin script and admin client API improvements to simplify admin operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)"

now that we're running Java 11.

Chosen based on trial and error: 80Mi got OOMKilled, 100m cpu took >twice the time to complete.
solsson added a commit that referenced this pull request Nov 28, 2018
@solsson
Copy link
Contributor Author

solsson commented Nov 28, 2018

There's a standalone topic creation example, with resource limits, now in events-kube.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants