Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Topics now get 12 partitions by default #222

Merged
merged 1 commit into from
Nov 28, 2018
Merged

Conversation

solsson
Copy link
Contributor

@solsson solsson commented Nov 28, 2018

The number 12 was chosen to support an even load.
Counts of 2, 3, 4 and 6 are reasonable for both replicas and consumer group members.
At the same time we didn't want a high default number because the sample config file
mentions "more files across the brokers".

The reason for doing this change is that clients should not assume ordering guarantees unless designed for.

With #221 we won't use this default a lot, but maybe in the "not designed for" cases.

The number 12 was chosen to support even load.
Counts of 2, 3, 4 and 6 are reasonable for both replicas and consumer group members.
At the same time we didn't want a high default number because the sample config file
mentions "more files across the brokers".

The reason for doing this change is that clients should not assume ordering guarantees unless designed for.
@solsson solsson added this to the 5.0 - Java 11 milestone Nov 28, 2018
@solsson solsson requested a review from atamon November 28, 2018 12:07
Copy link
Contributor

@atamon atamon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

With auto.create.topics=false this feels safe to introduce.

@solsson solsson merged commit 0c70c12 into master Nov 28, 2018
solsson added a commit that referenced this pull request Oct 8, 2019
I though that the feature would be neat for development (with replication factor 1, see #222)
but it causes just as much confusion and useless troubleshooting there,
for example race conditions between intentional topic creation and a container
starting up to produce to the topic. You actually never know which topic config you're getting.

Related: #107

The duplication is a workaround for kubernetes-sigs/kustomize#642
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants