[fix][client] Reserve allocated buffer in BatchMessageContainer on client memory limitation.

[AnonHxy]

Motivation

We should reserve the allocated buffer in BatchMessageContainer on client memory limitation.

Modifications

In this patch, we only take care of the buffer init size and final size

• Added a variable batchAllocatedSize in BatchMessageContainer to record the current allocated buffer size. It is used to release the allocated buffer size from memory limit controller

• Added a method reserveBatchAllocatedSizeWhenInit() in BatchMessageContainer, will be call when init the allocated buffer. This method will initiliaze the batchAllocatedSize and reserve memory to the memory limit controller.

• Added a method updateBatchAllocatedSizeWhenLeave() in BatchMessageContainer, will be call when the batch leaving the BatchMessageContainer. This method will update the final batchAllocatedSize as the size after compress.

• Then the value of batchAllocatedSize will be added to OpSendMsg#uncompressedSize for release the batchAllocatedSize memory from memory limit controller when send succesfully or failed.

• The following diagram could be helpful to understand this patch

Verifying this change

• Make sure that the change passes the CI checks.
• The following tests have covered this change:
  • org.apache.pulsar.client.api.MemoryLimitTest
  • org.apache.pulsar.client.impl.ProducerMemoryLimitTest

Documentation

• doc
• doc-required
• doc-not-needed
• doc-complete

Matching PR in forked repository

PR in forked repository: AnonHxy#9

[AnonHxy]

@codelipenghui @Jason918 @merlimat @HQebupt @Technoboy- PTAL

[AnonHxy]

@codelipenghui @Jason918 @merlimat PTAL :)

[AnonHxy]

/pulsarbot run-failure-checks

[codecov-commenter]

Codecov Report

❗ No coverage uploaded for pull request base (master@2b5b92c). Click here to learn what that means.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master   #17936   +/-   ##
=========================================
  Coverage          ?   49.39%           
  Complexity        ?     6908           
=========================================
  Files             ?      393           
  Lines             ?    43424           
  Branches          ?     4464           
=========================================
  Hits              ?    21451           
  Misses            ?    19595           
  Partials          ?     2378           

Flag	Coverage Δ
unittests	49.39% <0.00%> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

[Jason918]

LGTM, left a minor comment.