Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE REQUEST] Upgrade Kafka #2871

Closed
11 of 13 tasks
rafzei opened this issue Jan 14, 2022 · 1 comment
Closed
11 of 13 tasks

[FEATURE REQUEST] Upgrade Kafka #2871

rafzei opened this issue Jan 14, 2022 · 1 comment
Assignees
Labels
priority/high Task with high priority type/upgrade Task related to component upgrade

Comments

@rafzei
Copy link
Contributor

rafzei commented Jan 14, 2022

Is your feature request related to a problem? Please describe.
Currently the version of Kafka we use is 2.6.0. Newer versions have been released which fix a bunch of issues.

Describe the solution you'd like
Upgrade Kafka to 2.8.1 to resolve some of these bugs and issues.

Describe alternatives you've considered
Upgrade to Kafka 3.x, however this introduces a number of breaking changes over Kafka 2.x which we currently don't want to introduce as this would require teams to upgrade there existing code to this newer version.

Additional context
Add any other context or screenshots about the feature request here.


DoD checklist

  • Changelog updated
  • COMPONENTS.md updated / doesn't need to be updated
  • Schema updated / doesn't need to be updated
  • Feature has automated tests
  • Automated tests passed (QA pipelines)
    • apply
    • upgrade
  • Idempotency tested
  • Documentation added / updated / doesn't need to be updated
  • All conversations in PR resolved
  • Solution meets requirements and is done according to design doc
  • Usage compliant with license
  • Backport tasks created / doesn't need to be backported
@seriva seriva added priority/high Task with high priority type/upgrade Task related to component upgrade labels Jan 20, 2022
@atsikham
Copy link
Contributor

atsikham commented Feb 1, 2022

Do not forget: Kafka/Zookeeper are the components that for now require openjdk-8-jre-headless/java-1.8.0-openjdk-headless packages. It might be removed during upgrade.

@cicharka cicharka self-assigned this Feb 18, 2022
@przemyslavic przemyslavic self-assigned this Mar 23, 2022
cicharka added a commit that referenced this issue Mar 28, 2022
Kafka: 
* upgrade to 2.8.1 version
* move upgrade tasks to Kafka role
* refactor installation and upgrade tasks
* refactor: rename 'kafka_var' setting

Zookeeper:
* refactor installation and upgrade
* move upgrade tasks to Zookeeper role

Kafka-exporter:
* verify if service definition needs to be updated even if exporter itself was not updated
* remove `kafka.version` from configuration
@seriva seriva closed this as completed Mar 29, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
priority/high Task with high priority type/upgrade Task related to component upgrade
Projects
None yet
Development

No branches or pull requests

5 participants