0.7.2: Bug fixes

This minor release contains important fixes to remedy CVEs.

Security

• BE: Chore: CVEs fixes, Apr 2024 @Vladysl (#4426, #4427)

Full Changelog: v0.7.1...v0.7.2

Contributors

@Vladysl

0.7.1: Bug fixes

This minor release contains different important fixes and periodical dependencies bumps to remedy external CVEs.

🪛Enhancements

• BE: RBAC: Implement an LDAP authorities extractor to support subject-level role matching @Haarolean (#3979)

🔨Bug Fixes

• FE: RBAC: Fix KC restart permissions @Haarolean (#3891)
• BE: RBAC: Fix viewable topics filter @Haarolean (#3946)
• FE: Fix version display with a tag @David-DB88 (#3827)
• FE: Messages: Reset timestamp value w/ Clear all filters @vikasrajputin (#3923)
• BE: Fix CORS once again @Haarolean (#3957)
• FE: Ignore expected 404 on topic statistics page @Haarolean (#3964)
• FE: Fix latest version is null @David-DB88 (#3833)
• FE: Wizard: Fix permissions check for cluster edit @Haarolean (#3862)
• FE: Fix reach query not initiating requests for local host @Haarolean (#3915)
• BE: Make webclient use system proxy @Haarolean (#3881)

Security

• BE: Chore: CVEs fixes, May 2023 @iliax (#3840)

Full Changelog: v0.7.0...v0.7.1

Contributors

@AndreyNenashev, @David-DB88, @Haarolean, @Narekmat, @Ppojin, @VladSenyuta, @abelgibayev, @ankitverma10203, @dependabot, @dependabot[bot], @dshubhadeep, @iliax, @michal-cesek, @nbouron, @nisanohana3, @omnipresent07, @seono, @sukanth and @vikasrajputin

0.7: ACLs, LDAP & Generic OAuth support for RBAC

Release 0.7 with ACLs, LDAP & Generic OAuth support for RBAC

¡Hola! We're excited to announce the latest release of UI for Apache Kafka!
This new version comes packed with a range of new features, enhancements, and bug fixes to improve your experience.
Here's a closer look at some of the highlights:

New Features

• ACL Lists: UI for Apache Kafka now gives you access to your Kafka's ACL lists in read-only mode, allowing you to monitor and review them in greater detail. This feature lays the groundwork for more advanced functionality in the upcoming 0.8 release, where we plan to introduce full ACL editing capabilities.

• UI Dark Theme: Take a break from the bright lights with the dark theme. You can even activate the auto-mode feature to have the interface switch automatically between light and dark modes depending on your system settings.

• RBAC: LDAP Support: We've added support for fetching roles via LDAP, enabling you to authenticate and manage users' roles across your organization more efficiently.

• RBAC: Generic OAuth2 Support: UI for Apache Kafka now supports fetching roles with any generic OAuth2 provider.

Significant Enhancements

• RBAC: Separate KC Restart Permission: Managing Kafka Connect permissions just got easier with the new KC Restart permission, providing a more granular approach to managing your roles.

• Broker Skew Displayed in UI: You can now monitor broker skew directly in UI, providing deeper insights into the state of your Kafka cluster.

• Data Masking: Regex Support for Field Names: We've introduced support for regular expressions in field names for data masking, providing more powerful masking capabilities.

• Opt-Out of Version Check: To support air-gap environments further, we got rid of version check requests on frontend. Since they're performed on the backend now, from now on, your frontend won't fail if there's no internet connection.

User Experience (UX) Improvements

• Kafka Connect Quick Actions: Accessing Kafka Connect actions is now easier with the new quick actions feature in the sandwich menu.

• Keep Contents Switch: We've added a new "keep contents" switch on message produce, allowing you to retain message content after production for a smoother and more efficient workflow.

BREAKING CHANGES

Of course, there are some!

• LDAP users: Replace your spring.ldap.dn.pattern property name with spring.ldap.base. That's made to better match spring properties.
• Data masking: Within mask action, replaced pattern with fieldsNamePattern.

---

We hope you enjoy using UI for Apache Kafka and find these new features and enhancements useful. As always, we welcome your feedback and suggestions for future releases. Thank you for choosing UI for Apache Kafka, and we look forward to bringing you more exciting updates in the future!

Best regards,
Provectus & Contributors

---

Issues closed: https://github.com/provectus/kafka-ui/milestone/11?closed=1
All changes in a formatted way: https://gist.github.com/Haarolean/29a7040382a5386a01ecc3cf34fa3f04
Full Changelog: v0.6.0...v0.7.0

Contributors

@David-DB88, @Haarolean, @NeiruBugz, @RaajuKanuri, @VladSenyuta, @a1tair6, @blacktower88, @dependabot, @dependabot[bot], @iliax, @inanc-can, @michal-cesek, @nisanohana3 and @winnie-chiu

v0.6.2

This minor release contains CVE fixes (dependencies bumps) and some functional fixes as well.

🔨Bug Fixes

FE: Fix HTTP 400 for clusters with special symbols (#3591)
FE: Messages filtering by offset & timestamp doesn't work (#3582)
BE: Exempt appconfig from rbac check (#3647)
BE: Fix loading freezes in case one of the brokers is down (#3618)
FE: Fix config param source nullability (#3661)

Security

CVE fixes, Upgrade Spring Boot (#3624)

Full Changelog: v0.6.1...v0.6.2

Contributors

@Haarolean, @NeiruBugz, @iliax

0.6.1

Changes

⚙️Features

• Dark theme in UI

🪛Enhancements

• Config wizard: Add a proper UI handling for image restart on Cluster config update

🔨Bug Fixes

• UI: Fix broken timestamp filter and partition selection
• BE: Improved support for Azure Events Hub (#3540)
• BE: Polling timeouts made configurable (#3513)
• BE: Implemented an internal topic name prefix (#3505)
• UI: Add RBAC actions for copy topic button
• BE: Topic deletion fixed for MSK Serverless
• UI: Wizard: Fix cluster config validator isn't switching focus to first field failing validation
• UI: Bypass key & value serde null cases
• UI: Fix message count updating upon clearing messages for a partition

Contributors

@David-DB88, @Haarolean, @Narekmat, @NeiruBugz, @ShubhamKumar89, @VladSenyuta, @dependabot, @dependabot[bot], @iliax, @p-eye, @vict-o-ria, @winnie-chiu, @workshur and @yardenshoham

0.6.0

Within this release, we introduced new features like a cluster configuration wizard and integration with the OpenDataDiscovery Platform.

New Features

Cluster configuration wizard

With DYNAMIC_CONFIG_ENABLED property enabled you can add and/or modify your clusters right in UI.
This behavior is enabled by default within our AWS AMI image. Check out the image at AWS Marketplace.
We're planning on implementing different storage providers to make it possible for importing and exporting your config file.
Currently, you can save it if you mount /etc/kafkaui/dynamic_config.yaml file from inside the container to an external volume.

Integration with Open Data Discovery

Leveraging the OpenDataDiscovery Platform, topics and associated Kafka Connect metadata can now be exported for comprehensive monitoring. You'll have visibility into how data platform components interact with Kafka, receive notifications regarding critical schema changes, and more - all to ensure a streamlined connection experience.
Learn more about ODD here: https://github.com/opendatadiscovery/odd-platform

Enhancements

• Implemented support for protobuf imports & file references
• Suppress auth errors. Allows to work around kafka ACL permission issues instead of failing to render the whole pages.
• Implemented Avro Embedded serde
• Switched to using JRE instead of JDK in docker image, leads to huge image size improvements
• Implemented per partition In Sync Replicas display in the topic overview
• Implemented basic authentication for prometheus metrics backend
• Implement full support for custom context path on frontend

BREAKING CHANGES

If you've been using SSL for any component (Clusters, SR, KSQL, KC, etc.), you have to migrate your properties a bit;
Now we supply just one truststore per cluster, keystore stays the same way, one per component:

      KAFKA_CLUSTERS_0_SSL_TRUSTSTORELOCATION: /kafka.truststore.jks
      KAFKA_CLUSTERS_0_SSL_TRUSTSTOREPASSWORD: "secret"

All other truststore-related properties have been deprecated.

---

Thanks to everyone who just started and continued to contribute!
In the next release, we'll focus a bit on expanding our RBAC possibilities (support for LDAP and universal OAuth providers) and some Wizard features!

Issues closed: https://github.com/provectus/kafka-ui/milestone/7?closed=1
All changes in a formatted way: https://gist.github.com/Haarolean/f60150dbe31c3074c02b55cc486a6f5d
Full Changelog: v0.5.0...v0.6.0

Contributors

@ArthurNiedial, @BatuhanKucukali, @BulatKha, @David-DB88, @Haarolean, @Mgrdich, @Narekmat, @Snowfox0618, @VladSenyuta, @anezboretskiy, @cpapad, @dependabot, @dependabot[bot], @iliax, @kristi-dev, @m-kay, @mkuts12, @wanisfahmyDE, @winnie-chiu, @workshur and @yardenshoham

0.5.0

This release comes with new feature like role-based access control, pluggable serde plugins and data masking.

New Features

• Role-based Access Control — Manage permissions for your groups and users via various authentication methods, including GitHub, Google, Cognito, etc.
• Pluggable SerDe API — Use UI for Apache Kafka’s built-in plugins, or code your own, to serialize and deserialize custom data types in your topic messages. We also implemented plugins for AWS Glue and Smile!
• Data Masking — Easily mask any sensitive data in topic messages with predefined patterns and data types.
• Preview of Message Fields — Quickly view fields of nested topic messages in list format via JSON paths.
• Topic Analysis — Analyze your topic messages, distribution of messages, message size, and more.
• Per-cluster Polling Rate Limits — Set up polling limits to avoid I/O spikes on your Apache Kafka, and high loads and flood in live mode.
• Managing broker configs — Edit broker configs values within UI

Enhancements

• Improved support for AWS MSK Serverless, some tweaks to support MSK and other serverless platforms .
• Support prometheus as metrics interface, can be used for retrieving kafka metrics if you prefer it over JMX (e.g. you use MSK)
• mTLS support for KSQL, SR, KC
• Support for multiple protobuf files
• Active Directory support for LDAP authentication
• Support basic auth for KSQL server
• A view to display broker metrics
• A view to display broker log dirs

Bug fixes

A lot of bug fixes happened for various areas. We're planning to rehaul messages view in the next release and fix all the related bugs.

UI/UX improvements

There also been a bunch of ux improvements in general, take a closer look! Let us know if you have any feedback on UI/UX.

BREAKING CHANGES

If you've previously used OAuth2 authentication, please reformat your config in this way:
Before: authentication properties were placed on the level spring.security.oauth2.client.[registration|provider].<provider>.<property>
Now: auth.oauth2.client.<provider>.<property>
An example:

Please refer to this article for examples for different oauth providers.

Issues closed: https://github.com/provectus/kafka-ui/milestone/6?closed=1
All changes in a formatted way: https://gist.github.com/Haarolean/b97a74fef36d607ac352d9ee07b93223
Full Changelog: v0.4.0...v0.5.0

Thanks everyone who contributed in this release, we've got a lot of contributions during Hacktoberfest, we'd be glad to see your PRs even in other months of the year :)

Contributors

@ArthurNiedial, @BobDu, @BulatKha, @ChristinaKristane, @David-DB88, @Evilong, @Haarolean, @JIBIN-P, @MaratGumarov, @Mgrdich, @MichaelGonzalezMurillo, @Narekmat, @PatTheSilent, @Pranav-yadav, @Redbutton18, @Sergiy-provectus, @ValentinPrischepa, @VladSenyuta, @adityabhattad2021, @akazlanzhy, @anezboretskiy, @azatsafin, @daching-provectus, @dependabot, @dependabot[bot], @devils2ndself, @djboris9, @doomcrewinc, @habrahamyanpro, @harrison-kim, @iliax, @joschi, @joseacl, @kamsharipova, @kristi-dev, @kshpilchyna, @lazzy-panda, @occidere, @puzzlewell, @rAzizbekyan, @sbritprovectus, @sherifkayad, @shubhwip, @simonyandev, @sleeping-barber, @ssiradeghyan, @sujin0970, @vitalymatyushik, @vj-codes, @vrnsky, @vsoch, @winnie-chiu, @workshur, @ymlai87416, @yvaeltercero and Ilya Kuramshin

0.4.0

This new version comes with new features for smart filtering, live message tailing, and handling functionality of topics.

New Features

• Smart filters
• Live message tailing
• Ability to clone topic functionality
• Ability to recreate topic functionality
• Support of local environments without internet access

Based on community feedback, the KSQL functionality has been overhauled. A lot of refactoring happened, now all the query types should work just fine.

Enhancements

Kafka Connect — Added basic authentication support
Zookeeper — Dropped Zookeeper support as it's no longer required by Kafka itself
Schema registry — Added a view for comparing schema versions
LDAP — Admin authentication and search filters implemented
Schema registry — Search and pagination implemented
Consumers — Sorting and pagination implemented
Topics — Sorting by size implemented

Bug fixes

From a QA perspective, in this release we prioritized fixing bugs related to topics and messages, including: pagination fixes; message viewing, and duplication.

UI/UX improvements

The “restart failed tasks” button for connectors has been split into three different ones: "restart connector", "restart failed tasks", and "restart all tasks".

Issues closed: https://github.com/provectus/kafka-ui/milestone/5?closed=1
Full Changelog: v0.3.0...v0.4.0

Thanks everyone who contributed in any way. We greatly appreciate that ❤️

Contributors

@5hin0bi, @Anifahb, @Corlobin, @Dekshut, @Haarolean, @Hurenka, @IndeedSi, @Matan-Tzuberi, @Mgrdich, @Motherships, @NelyDavtyan, @ValentinPrischepa, @Zorii4, @abelgibayev, @agolosen, @aizerin, @azatsafin, @dependabot, @dependabot[bot], @gaddam1987, @germanosin, @iliax, @jdechicchis, @jonasgeiregat, @keeperUA, @lazzy-panda, @lucasprograms, @mchoukairprov, @omh1280, @piermotte, @rAzizbekyan, @sasunprov, @simonyandev, @workshur and @yvaeltercero

v0.3.3

🔨Bug Fixes

• Fixed a bug with inability to create a topic @NelyDavtyan (#1467)
• fix missing pathType in ingress.yaml for kube cluster version 1.22+ @5hin0bi (#1450)

Other changes

• [Fixes #1410] Edited using colors in styled components using our Theme @Dekshut (#1442)
• Bump eslint-config-airbnb-typescript from 12.3.1 to 14.0.2 in /kafka-ui-react-app @dependabot (#1294)
• Change the way of release workflow @5hin0bi (#1434)
• ISSUE-1444: Additional params added to connector restart endpoint to be able to… @iliax (#1445)

Contributors

@5hin0bi, @Dekshut, @NelyDavtyan, @dependabot, @dependabot[bot] and @iliax

0.3.2

This release is aimed to fix the rest of problems left after the redesign.
Also we've got some backend fixes as well.

Bugfixes

• Readonly UI label is back (#1364)
• Empty screen upon editing protobuf schema (#1411)
• Protobuf schema is not formatted properly (#1426)
• URL decoding for cluster names (#1378)
• Added support for all compression types (#1350)

And oher various fixes

• Space sensitive syntax for Create Connector (#1430)
• Clusters"s table styles was fixed, added hyphens to breadcrumbs (#1384)
• Tmp volume declaration removed to prevent unnecessary anonymous volumes creation (#1401)
• Updated topic URP status color. (#1336)
• Added a popup warning about deleting topic messages. (#1324)
• Unclear parameters for Consumers' Search. Inconsistency of Search line on Consumers page. (#1429)
• Incorrect topic message content type (avro -> json) (#1422)
• Topic Creation: Inconsistency in Deleted parameters (#1395)
• Confusing sorting UI in Topics (#1389)

K8s/Helm

• Enhancement to support ingress api 1.22+ (#1345) (addition to #1337)
• Support for ingressClassName in helm chart (#1370)

Security

• Bumped versions for a bunch of frontend dependencies to fix known CVEs