Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[LI-CHERRY-PICK] KAFKA-13776: Upgrade RocksDB from 6.27.3 to 6.29.4.1 (#11967) #351

Merged
merged 1 commit into from
Jun 8, 2022

Conversation

hshi2022
Copy link

@hshi2022 hshi2022 commented Jun 7, 2022

RocksDB 6.27.3 does not run on arm64 M1 Macs which would prevent people on this platform to run Kafka Streams. Thus, this PR upgrades RocksDB to 6.29.4.1 which contains the following fix to allow to run RocksDB on arm64 M1 Macs:

facebook/rocksdb#7720

The source compatibility report between 6.27.3 and 6.29.4.1 (attached to the ticket) reports a couple of incompatibilities. However, the incompatibilities do not seem to affect Kafka Streams' backwards compatibility.

The changes to class RocksDB only apply when inheriting from RocksDB. RocksDB is not exposed to users in Streams.
The changes to class WriteBatch and class WriteBatchInterface also only apply with inheritance. Both classes are not exposed to users in Streams.
-The change to enum SanityLevel seem also not to apply to Streams since SanityLevel is only used in ConfigOptions which is only used to load options from files and properties objects. Loading options from files or properties is not exposed to users in Streams.

Reviewers: Bill Bejeck [email protected], Matthias J. Sax [email protected], A. Sophie Blee-Goldman [email protected]

More detailed description of your change,
if necessary. The PR title and PR message become
the squashed commit message, so use a separate
comment to ping reviewers.

Summary of testing strategy (including rationale)
for the feature or bug fix. Unit and/or integration
tests are expected for any behaviour change and
system tests should be considered for larger changes.

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

RocksDB 6.27.3 does not run on arm64 M1 Macs which would prevent people on this platform to run Kafka Streams. Thus, this PR upgrades RocksDB to 6.29.4.1 which contains the following fix to allow to run RocksDB on arm64 M1 Macs:

facebook/rocksdb#7720

The source compatibility report between 6.27.3 and 6.29.4.1 (attached to the ticket) reports a couple of incompatibilities. However, the incompatibilities do not seem to affect Kafka Streams' backwards compatibility.

    The changes to class RocksDB only apply when inheriting from RocksDB. RocksDB is not exposed to users in Streams.
    The changes to class WriteBatch and class WriteBatchInterface also only apply with inheritance. Both classes are not exposed to users in Streams.
    -The change to enum SanityLevel seem also not to apply to Streams since SanityLevel is only used in ConfigOptions which is only used to load options from files and properties objects. Loading options from files or properties is not exposed to users in Streams.

Reviewers: Bill Bejeck <[email protected]>, Matthias J. Sax <[email protected]>, A. Sophie Blee-Goldman <[email protected]>
@hshi2022 hshi2022 requested review from wyuka and lmr3796 June 7, 2022 23:51
Copy link

@lmr3796 lmr3796 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@hshi2022 the original title has a ticket number for upstream kafka, can you move it back?

@hshi2022 hshi2022 changed the title [LI-CHERRYPICK] Upgrade RocksDB from 6.27.3 to 6.29.4.1 (#11967) [LI-CHERRY-PICK] KAFKA-13776: Upgrade RocksDB from 6.27.3 to 6.29.4.1 (#11967) Jun 8, 2022
@hshi2022
Copy link
Author

hshi2022 commented Jun 8, 2022

@hshi2022 the original title has a ticket number for upstream kafka, can you move it back?

updated as suggested

@hshi2022 hshi2022 merged commit 7551b21 into linkedin:3.0-li Jun 8, 2022
@hshi2022 hshi2022 deleted the fix_rockdb_version branch June 8, 2022 17:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants