Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[improve][offload] Extend the offload policies to allow specifying more conf #20804

Merged

Conversation

zymap
Copy link
Member

@zymap zymap commented Jul 14, 2023

Fixes #xyz

Main Issue: #xyz

PIP: #xyz

Motivation

The offload policies have limited the configurations for the offloaders. That means if the offloader needs more configurations, we need to extend more fields in the OffloadPoliciesImpl. That doesn't make sense. We should make it extendable easily. Add a configuration map support to allow it to set more configurations.

Modifications

Verifying this change

  • Make sure that the change passes the CI checks.

(Please pick either of the following options)

This change is a trivial rework / code cleanup without any test coverage.

(or)

This change is already covered by existing tests, such as (please describe tests).

(or)

This change added tests and can be verified as follows:

(example:)

  • Added integration tests for end-to-end deployment with large payloads (10MB)
  • Extended integration test for recovery after broker failure

Does this pull request potentially affect one of the following parts:

If the box was checked, please highlight the changes

  • Dependencies (add or upgrade a dependency)
  • The public API
  • The schema
  • The default values of configurations
  • The threading model
  • The binary protocol
  • The REST endpoints
  • The admin CLI options
  • The metrics
  • Anything that affects deployment

Documentation

  • doc
  • doc-required
  • doc-not-needed
  • doc-complete

Matching PR in forked repository

PR in forked repository:

… conf

---

### Motivation

The offload policies have limited the configurations for
the offloaders.  That means if the offloader needs more
configurations, we need to extend more fields in the OffloadPoliciesImpl.
That doesn't make sense. We should make it extendable easily.
Add a configuration map support to allow it to set more configurations.
@zymap zymap added type/enhancement The enhancements for the existing features or docs. e.g. reduce memory usage of the delayed messages area/tieredstorage doc-not-needed Your PR changes do not impact docs ready-to-test labels Jul 14, 2023
@zymap zymap added this to the 3.1.0 milestone Jul 14, 2023
@zymap zymap self-assigned this Jul 14, 2023
@dave2wave dave2wave changed the title [improve][offload] Extend the offload police to allow specifying more conf [improve][offload] Extend the offload policies to allow specifying more conf Jul 14, 2023
@zymap zymap merged commit 1687244 into apache:master Jul 18, 2023
Technoboy- pushed a commit that referenced this pull request Jul 24, 2023
…re conf (#20804)

### Motivation

The offload policies have limited the configurations for the offloaders.  That means if the offloader needs more configurations, we need to extend more fields in the OffloadPoliciesImpl. That doesn't make sense. We should make it extendable easily. Add a configuration map support to allow it to set more configurations.
Technoboy- pushed a commit that referenced this pull request Aug 17, 2023
…re conf (#20804)

### Motivation

The offload policies have limited the configurations for the offloaders.  That means if the offloader needs more configurations, we need to extend more fields in the OffloadPoliciesImpl. That doesn't make sense. We should make it extendable easily. Add a configuration map support to allow it to set more configurations.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/tieredstorage cherry-picked/branch-2.11 cherry-picked/branch-3.0 doc-not-needed Your PR changes do not impact docs ready-to-test release/2.11.3 release/3.0.2 type/enhancement The enhancements for the existing features or docs. e.g. reduce memory usage of the delayed messages
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants