Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

KAFKA-8779 Fix flaky tests introduced by dynamic log levels #4

Closed
wants to merge 46 commits into from

Conversation

brandboat
Copy link
Owner

No description provided.

@github-actions github-actions bot added the core label Oct 6, 2024
mimaison and others added 27 commits October 8, 2024 14:22
With EOSv1 removal, we don't have producer-per-task any longer,
and thus can remove the corresponding code which handles task producers.

Reviewers: Chia-Ping Tsai <[email protected]>, Bill Bejeck <[email protected]>
Previously, Apache Kafka was uploading release candidate (RC) artifacts
to users' home directories on home.apache.org. However, since this
resource has been decommissioned, we need to follow the standard
approach of putting release candidate artifacts into the appropriate
subversion directory, at https://dist.apache.org/repos/dist/dev/kafka/.

Reviewers: Justine Olshan <[email protected]>
The patch adds integration tests for kip-848 online protocol migration.

Reviewers: David Jacot <[email protected]>
This patch fixes a few things:
* Typos.
* Merge the tests for fetchOffsets and fetchAllOffsets together into parameterized tests since they share the same structure.
* Use Topic.GROUP_METADATA_TOPIC_NAME instead of __consumer_offsets in new group coordinator tests.

Reviewers: Ken Huang <[email protected]>, David Jacot <[email protected]>
…che#17380)

Move ActionQueue outside DelayedShareFetch class to SharePartitionManager where SharePartitionManager has the ability to add a delayed action to the ActionQueue.

Add TopicPartition as a key for delayed share fetch along with SharePartition (that is already present right now). This will be utilized later when we add the code to know if new data has been added to the topic partition.

Reviewers: Apoorv Mittal <[email protected]>, Jun Rao <[email protected]>
…he#17434)

KAFKA-16534 introduced a change to send UpdateVoterRequest every "3 * fetchTimeoutMs" if the voter's configure endpoints are different from the endpoints persisted in the KRaft log. It also introduced a regression where if the voter nodes do not need an update then updateVoterTimer wasn't reset. This resulted in a busy-loop in KafkaRaftClient#poll method resulting in high CPU usage.

This PR modifies the conditions in pollFollowerAsVoter to reset updateVoterTimer appropriately.

Reviewers: José Armando García Sancio <[email protected]>
…ation.ms to dynamic configs (apache#17331)

This PR is the first series in the attempt to add share.record.lock.duration.ms to dynamic group configs. As part of this PR, the ShareGroupConfig has been moved to org.apache.kafka.coordinator.group.modern.share

Reviewers:  Andrew Schofield <[email protected]>,  Apoorv Mittal <[email protected]>, Abhinav Dixit <[email protected]>, Chia-Ping Tsai <[email protected]>, Manikumar Reddy <[email protected]>
dajac and others added 16 commits October 10, 2024 05:26
…quired.acks` (apache#17446)

This patch updates the upgrades note about the removal of `offsets.commit.required.acks` configuration in 4.0.

Reviewers: Lianet Magrans <[email protected]>
…e#17283)

Simplified Share Partition Acquire API to not include CompletableFuture. The records do not need a future handling rather can be just acquired while updating internal data structure hence now need to of CompletableFuture.

Reviewers: Andrew Schofield <[email protected]>, Chia-Ping Tsai <[email protected]>, Jun Rao <[email protected]>
…atch aligned (apache#17398)

When MetadataBatchLoader handles a BeginTransactionRecord, it will publish the metadata that has seen so far and not publish again until the transaction is ended or aborted. This means a partial record batch can be published. If a snapshot is generated during this time, the currently published metadata may not align with the end of a record batch. This causes problems with Raft replication which expects a snapshot's offset to exactly precede a record batch boundary.

This patch enhances SnapshotGenerator to refuse to generate a snapshot if the metadata is not batch aligned.

Reviewers: David Arthur <[email protected]>
KIP-932 used ignorable annotations in some RPC schemas when they are not applicable in situations where there is only a single version of the RPC in existence. This PR removes the unnecessary annotations. The KIP has been updated accordingly.

Reviewers: Jun Rao <[email protected]>, Chia-Ping Tsai <[email protected]>
…nceBrokers(Set<Integer>) from ReplicationControlManagerTest (apache#17466)

Reviewers: Chia-Ping Tsai <[email protected]>
…ocessor and DistributedHerder) for JDK 23 (apache#17417)

Reviewers: Chia-Ping Tsai <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.