Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

roachtest: add order validation to CDC Kafka roachtests #124195

Merged
merged 4 commits into from
May 17, 2024

Conversation

andyyang890
Copy link
Collaborator

@andyyang890 andyyang890 commented May 15, 2024

This patch adds order validation to CDC Kafka roachtests so that we
can build more confidence in our ordering guarantees. It can be enabled
for a roachtest either by directly setting the validateOrder flag on a
kafkaManager before creating consumers, or indirectly by setting the
validateOrder flag on kafkaFeedArgs for tests that use cdcTester.

Informs #124148

Release note: None

@cockroach-teamcity
Copy link
Member

This change is Reviewable

This patch eliminates unnecessary nesting in orderValidator's
NoteRow method.

Release note: None
@andyyang890 andyyang890 force-pushed the kafka_order_validator branch from f3d2d1b to 577eed7 Compare May 15, 2024 02:08
@andyyang890 andyyang890 marked this pull request as ready for review May 15, 2024 03:38
@andyyang890 andyyang890 requested review from a team as code owners May 15, 2024 03:38
@andyyang890 andyyang890 requested review from nameisbhaskar, vidit-bhat, rharding6373, wenyihu6 and a team and removed request for a team May 15, 2024 03:38
@andyyang890 andyyang890 force-pushed the kafka_order_validator branch 4 times, most recently from f295738 to 583cb04 Compare May 15, 2024 14:54
This patch renames `MakeCountValidator` to `NewCountValidator` to
reflect that it returns a pointer, not a struct.

Release note: None
This patch renames the `cdc/sink-chaos` test to `cdc/kafka-chaos` to
more accurately reflect that it is a Kafka-only test. It also adds
logging for the Kafka chaos loop iteration number so that we can tell
when the Kafka cluster is restarting from the logs.

Release note: None
@andyyang890 andyyang890 force-pushed the kafka_order_validator branch from 971d9a3 to f162051 Compare May 15, 2024 15:49
This patch adds order validation to CDC Kafka roachtests so that we
can build more confidence in our ordering guarantees. It can be enabled
for a roachtest either by directly setting the `validateOrder` flag on a
`kafkaManager` before creating consumers, or indirectly by setting the
`validateOrder` flag on `kafkaFeedArgs` for tests that use `cdcTester`.

Release note: None
@andyyang890 andyyang890 force-pushed the kafka_order_validator branch 2 times, most recently from 0bd0c44 to 3428726 Compare May 17, 2024 00:02
Copy link
Collaborator

@rharding6373 rharding6373 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:lgtm: Nice!

Reviewed 1 of 1 files at r1, 4 of 4 files at r5, 1 of 1 files at r6.
Reviewable status: :shipit: complete! 1 of 0 LGTMs obtained (waiting on @nameisbhaskar, @vidit-bhat, and @wenyihu6)

@andyyang890
Copy link
Collaborator Author

TFTR!

bors r=rharding6373

@craig craig bot merged commit d8073b5 into cockroachdb:master May 17, 2024
35 of 37 checks passed
@andyyang890 andyyang890 deleted the kafka_order_validator branch May 17, 2024 03:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants