Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[v23.1.x] c/partition_allocator: make _highest_group updates monotonic #14465

Merged
merged 1 commit into from
Oct 26, 2023

Conversation

ztlpn
Copy link
Contributor

@ztlpn ztlpn commented Oct 26, 2023

Backport of PR #14375

Previously, in case of failed allocation of partitions for new topics,
we tried to revert _highest_group value as well. When a large number of
topics were allocated in a single request concurrently (e.g. when MirrorMaker
creates required topics on the destination cluster) and some of these
requests bump into partition allocation limits, this could lead to
duplicate group_ids.

As there is no reason to try to reuse group_ids, simply remove the code
moving _highest_group backwards.

Fixes redpanda-data#12610

(cherry picked from commit 3f96297)

Conflicts:
	src/v/cluster/scheduling/allocation_state.cc
	src/v/cluster/scheduling/partition_allocator.h
@ztlpn ztlpn added this to the v23.1.x-next milestone Oct 26, 2023
@ztlpn ztlpn added the kind/backport PRs targeting a stable branch label Oct 26, 2023
@ztlpn ztlpn requested a review from bharathv October 26, 2023 18:01
@ztlpn ztlpn marked this pull request as ready for review October 26, 2023 18:02
@ztlpn
Copy link
Contributor Author

ztlpn commented Oct 26, 2023

test error is an instance of #14174

@ztlpn ztlpn merged commit a0aba07 into redpanda-data:v23.1.x Oct 26, 2023
22 checks passed
@piyushredpanda piyushredpanda modified the milestones: v23.1.x-next, v23.1.20 Oct 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/redpanda kind/backport PRs targeting a stable branch
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants