[feat][broker] PIP-264: Add transaction metrics

[dragosvictor]

PIP-264

Motivation

Adds the transaction metrics as described by https://pulsar.apache.org/docs/next/reference-metrics/#pulsar-transaction to the OpenTelemetry pipeline.

Modifications

• Adds the metrics described in [feat][doc] PIP-264: Add transaction metrics reference pulsar-site#925 to the collector runs.
• Topic transaction buffer statistics are added under the pulsar.broker.topic metric prefix, as they relate closely to the topic metrics. Class PersistentTopicAttributes is updated to reflect this change.

Verifying this change

• Make sure that the change passes the CI checks.

This change updated tests and can be verified as follows:

• Updated test TransactionTest#testTopicTransactionMetrics
• Updated test TopicTransactionBufferTest#testTransactionBufferAppendMarkerWriteFailState
• Updated test PendingAckPersistentTest#testPendingAckMetrics

Does this pull request potentially affect one of the following parts:

• Dependencies (add or upgrade a dependency)
• The public API
• The schema
• The default values of configurations
• The threading model
• The binary protocol
• The REST endpoints
• The admin CLI options
• The metrics: As described in [feat][doc] PIP-264: Add transaction metrics reference pulsar-site#925
• Anything that affects deployment

Documentation

• doc
• doc-required [feat][doc] PIP-264: Add transaction metrics reference pulsar-site#925
• doc-not-needed
• doc-complete

Matching PR in forked repository

PR in forked repository: dragosvictor#37

[lhotari]

LGTM, left one question

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 92.45283% with 20 lines in your changes missing coverage. Please review.

Project coverage is 73.37%. Comparing base (bbc6224) to head (34aae58).
Report is 603 commits behind head on master.

Files with missing lines	Patch %	Lines
.../buffer/impl/TransactionBufferClientStatsImpl.java	81.48%	3 Missing and 2 partials ⚠️
...ion/pendingack/impl/PendingAckHandleStatsImpl.java	81.81%	2 Missing and 2 partials ⚠️
...oordinator/impl/InMemTransactionMetadataStore.java	33.33%	4 Missing ⚠️
...n/java/org/apache/pulsar/broker/PulsarService.java	80.00%	2 Missing ⚠️
.../OpenTelemetryTransactionPendingAckStoreStats.java	93.33%	0 Missing and 2 partials ⚠️
...tats/OpenTelemetryTransactionCoordinatorStats.java	96.77%	0 Missing and 1 partial ⚠️
...nsaction/coordinator/TransactionMetadataStore.java	0.00%	1 Missing ⚠️
...n/coordinator/impl/MLTransactionMetadataStore.java	83.33%	0 Missing and 1 partial ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##             master   #22970      +/-   ##
============================================
- Coverage     73.57%   73.37%   -0.21%     
- Complexity    32624    33236     +612     
============================================
  Files          1877     1905      +28     
  Lines        139502   142763    +3261     
  Branches      15299    15579     +280     
============================================
+ Hits         102638   104751    +2113     
- Misses        28908    29993    +1085     
- Partials       7956     8019      +63     

Flag	Coverage Δ
inttests	27.42% <47.16%> (+2.84%)	⬆️
systests	24.66% <6.41%> (+0.33%)	⬆️
unittests	72.41% <92.45%> (-0.43%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines	Coverage Δ
...lsar/broker/service/PersistentTopicAttributes.java	100.00% <100.00%> (ø)
...ker/service/persistent/PersistentSubscription.java	76.90% <100.00%> (+0.21%)	⬆️
...ker/service/persistent/PersistentTopicMetrics.java	100.00% <100.00%> (ø)
...e/pulsar/broker/stats/OpenTelemetryTopicStats.java	99.56% <100.00%> (ø)
...ansaction/buffer/TransactionBufferClientStats.java	25.00% <100.00%> (ø)
...ction/buffer/impl/TransactionBufferClientImpl.java	83.72% <100.00%> (ø)
...saction/pendingack/PendingAckHandleAttributes.java	100.00% <100.00%> (ø)
.../transaction/pendingack/PendingAckHandleStats.java	100.00% <ø> (ø)
...tion/pendingack/impl/PendingAckHandleDisabled.java	33.33% <100.00%> (+3.92%)	⬆️
...nsaction/pendingack/impl/PendingAckHandleImpl.java	72.63% <100.00%> (+1.78%)	⬆️
... and 10 more

... and 456 files with indirect coverage changes