[improve][broker] PIP-192: Define new load manager base interfaces #4
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Demogorgon314
changed the title
Demogorgon314
force-pushed
the
PIP-192-New_Load_Manager_Base_Classes
branch
from
f116925 to
f13c655
Compare
4 tasks
Demogorgon314
force-pushed
the
PIP-192-New_Load_Manager_Base_Classes
branch
from
5e7dad5 to
2458fbe
Compare
* Allow to use io_uring instead of epoll * fix pom
…duled (apache#18360) Motivation The variable `expireChunkMessageTaskScheduled` could be accessed by multi thread concurrently. Need to make it thread safe. Modification * Use AtomicBoolean and CAS operation to access the `expireChunkMessageTaskScheduled`
Allow users to override the default `-Djava.net.preferIPv4Stack=true` config to run Pulsar in IPv6 environment.
Signed-off-by: Zixuan Liu <[email protected]>
…2-42003 (apache#18394) * [fix][sec] Upgrade jackson-databind to 2.13.4.2 to get rid of CVE-2022-42003 * Fix IO jackson dependencies * Fix IO http * revert unrelated change
Signed-off-by: tison <[email protected]>
…to the deployment chapter (apache#18015)
… in `FunctionDetails` (apache#18111)
Signed-off-by: tison <[email protected]>
…pache#17522) * [improve][transactions] Add command to list transaction coordinators url * Address pr's comment and rebase * checkstyle * remove debug * Remove useless call and fix style * style
…m storage/cache to the write to the consumer channel) (apache#18245) * InflightReadsLimiter - limit the memory used by reads end-to-end (from storage/cache to the write to the consumer channel) Motivation: Broker can go out of memory due to many reads enqueued on the PersistentDispatcherMultipleConsumers dispatchMessagesThread (that is used in case of dispatcherDispatchMessagesInSubscriptionThread set to true, that is the default value) The limit of the amount of memory retained due to reads MUST take into account also the entries coming from the Cache. When dispatcherDispatchMessagesInSubscriptionThread is false (the behaviour of Pulsar 2.10) there is some kind of natural (but still unpredictable!!) back pressure mechanism because the thread that receives the entries from BK of the cache dispatches immediately and synchronously the entries to the consumer and releases them Modifications: - Add a new component (InflightReadsLimiter) that keeps track of the overall amount of memory retained due to inflight reads. - Add a new configuration entry managedLedgerMaxReadsInFlightSizeInMB - The feature is disabled by default - Add new metrics to track the values * Change error message * checkstyle * Fix license * remove duplicate method after cherry-pick * Rename onDeallocate
Signed-off-by: tison <[email protected]>
…e#18325) Co-authored-by: huangzegui <[email protected]>
The repo halted doesn't mean we don't provide related functionality :)
Demogorgon314
force-pushed
the
PIP-192-New_Load_Manager_Base_Classes
branch
from
2458fbe to
07e8ab9
Compare
reason: https://lists.apache.org/thread/jcrq9q0k6kh9rvb71dwb9s3mvo5c5dk5 branch-2.9 has reset to commit `5ed247de3a5e0ff67f181b4805fd6140d8174994`, so close force-push - [x] `doc-not-needed` <!-- Your PR changes do not impact docs -->
…pache#18603) This PR is a supplement to apache#18369. - `AbstractTopic.isSameAddressProducersExceeded()` - `AbstractBaseDispatcher.isConsumersExceededOnSubscription()`
… to cache the string hashing (apache#18566)
Signed-off-by: tison <[email protected]>
…erSingleActiveConsumer (apache#18648)
…ce usage(>100%) in load balancer (apache#18645)
### Motivation Now we only use caffeine in broker module. *caffeine* has a jdk11+ version, which is more proper for jdk11+ project to integrated with.(Spring3.0 uses caffeine 3.X too.) So I think it's worth for us to update caffeine to 3.x ### Modifications Update caffeine from 2.9.1 to 3.1.2 - [ ] Anything that affects deployment ### Documentation <!-- DO NOT REMOVE THIS SECTION. CHECK THE PROPER BOX ONLY. --> - [ ] `doc` <!-- Your PR contains doc changes. Please attach the local preview screenshots (run `sh start.sh` at `pulsar/site2/website`) to your PR description, or else your PR might not get merged. --> - [ ] `doc-required` <!-- Your PR changes impact docs and you will update later --> - [x] `doc-not-needed` <!-- Your PR changes do not impact docs --> - [ ] `doc-complete` <!-- Docs have been already added --> ### Matching PR in forked repository apache#18647
…red storage (apache#18595) Co-authored-by: druidliu <[email protected]>
Signed-off-by: Zike Yang <[email protected]>
…e string hashing (apache#18078) Co-authored-by: Jiwe Guo <[email protected]> Co-authored-by: houxiaoyu <[email protected]>
Demogorgon314
force-pushed
the
PIP-192-New_Load_Manager_Base_Classes
branch
from
6534ce0 to
8e2240e
Compare
|
The pr had no activity for 30 days, mark with Stale label. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.