[improve][broker] PIP-215 added StrategicTwoPhaseCompactor

[heesung-sn]

Master Issue: apache#18099

Motivation

This PR implements StrategicTwoPhaseCompactor as proposed in pip-215.

Modifications

This PR adds the following classes to implement StrategicTwoPhaseCompactor.

• Added StrategicTwoPhaseCompactor that extends TwoPhaseCompactor.
• Added TopicCompactionStrategy interface that is passed in StrategicTwoPhaseCompactor and TableViewImpl.
• Added CompactionReaderImpl to scan messages in StrategicTwoPhaseCompactor. It cumulatively acknowledges the read messages at the end of StrategicTwoPhaseCompactor.
• Added SubscriptionMode and SubscriptionInitialPosition parameters in ReaderConfigurationData since the CompactionReaderImpl reader's subscription needs to be durable and needs to read from the earliest position.
• Added RawBatchMessageContainerImpl to batch and serialize messages in StrategicTwoPhaseCompactor.

This PR updates the TableViewImpl to use TopicCompactionStrategy in its data K,V map update logic.

• Added the topicCompactionStrategy member variable in TableViewConfigurationData
• Added the listen() interface in TableView to provide an option to call the listener actions only for the new future messages.
• Updated TableViewImpl and its handleMessage() function to consider TopicCompactionStrategy when updating the data K,V map.

This PR updated the compaction test classes to reuse the test cases.

This PR updated the modifiers of the parent classes of the added classes to access the member variables and member functions.

Verifying this change

• Make sure that the change passes the CI checks.

This change added tests and can be verified as follows:

(example:)

• Extended the compaction tests to cover the same logic passes with the StrategicTwoPhaseCompactor.
• Added other unit tests for the added classes.

Does this pull request potentially affect one of the following parts:

If the box was checked, please highlight the changes

• [] Dependencies (add or upgrade a dependency)
• The public API (table-view.listen() addition and reader and table-view configuration update)
• The schema
• The default values of configurations
• The threading model
• The binary protocol
• The REST endpoints
• The admin CLI options
• Anything that affects deployment

Documentation

• doc
• doc-required
• doc-not-needed
• doc-complete

This PR does not enable strategic compaction for the customer topics. We will update the doc when enabling this compaction for the customer topics.

Matching PR in forked repository

PR in forked repository: #12

[github-actions]

The pr had no activity for 30 days, mark with Stale label.