[fix] [broker] Fix cursor recover ignored batch ack index #23

lifepuzzlefun · 2023-06-16T02:44:20Z

Fixes #xyz

Master Issue: #xyz

PIP: #xyz

Motivation

Modifications

Verifying this change

Make sure that the change passes the CI checks.

(Please pick either of the following options)

This change is a trivial rework / code cleanup without any test coverage.

(or)

This change is already covered by existing tests, such as (please describe tests).

(or)

This change added tests and can be verified as follows:

(example:)

Added integration tests for end-to-end deployment with large payloads (10MB)
Extended integration test for recovery after broker failure

Does this pull request potentially affect one of the following parts:

If the box was checked, please highlight the changes

Documentation

doc
doc-required
doc-not-needed
doc-complete

Matching PR in forked repository

PR in forked repository:

github-actions · 2023-07-16T02:59:08Z

The pr had no activity for 30 days, mark with Stale label.

…ted in healthcheck every time (apache#22916)

…el (apache#22378)

…s in Functions and Connectors (apache#22950)

…pache#22947) Signed-off-by: Zixuan Liu <[email protected]>

…mmon dependency (apache#22951)

…he#22941)

…ed (apache#22954)

apache#22965)

…ing with maven-shade-plugin (apache#22957)

…oncurrency executing (apache#22958)

…onnectors (apache#22945)

… and topic policy is set (apache#22971)

…stallation (apache#22973) Signed-off-by: Zixuan Liu <[email protected]>

…pache#22972)

… by RoaringBitmap (apache#22908)" (apache#22968)

## Motivation The document states that `ackTimeoutRedeliveryBackoff` cannot be used with `consumer.negativeAcknowledge(MessageId messageId)`. However, this is confusing. The `ackTimeoutRedeliveryBackoff` should not relate to the nack. ## Modification - Fix the doc for the `ackTimeoutRedeliveryBackoff` - Improve the doc for `negativeAckRedeliveryBackoff` and `ackTimeoutRedeliveryBackoff`

…e#22952)

… requests (apache#22977)

…edder (apache#22946)

Signed-off-by: Zixuan Liu <[email protected]>

… check (apache#22974)

…k and epoch time (apache#23345)

…he#22913)

…egistry (ExtensibleLoadManagerImpl only) (apache#23382)

Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Matteo Merli <[email protected]>

…3394)

…ble errors (apache#21759)

…he#22938)

…pache#23397)

…chema ledger (apache#23395)

…ge Ordering (apache#23309)

…pache#23401)

…ache#23399)

apache#20147)

…gerStorage and enable multiple ManagedLedgerFactory instances (apache#23313)

… 3.3.2 (apache#23410)

…tiple topics (apache#23355)

…oup until they are fixed (apache#23414)

…ssage Ordering (apache#23352)

…TO_SPLIT ordered mode (apache#23423)

…23415)

…on of Key_Shared / Shared with feature flag (apache#23424)

…s true (apache#23426)

github-actions bot added the Stale label Jul 16, 2023

yyj8 and others added 28 commits June 20, 2024 03:43

[fix] [broker] broker log a full thread dump when a deadlock is detec…

ca64505

…ted in healthcheck every time (apache#22916)

[feat][broker] PIP-321 Introduce allowed-cluster at the namespace lev…

36bae69

…el (apache#22378)

[fix][fn] Support compression type and crypto config for all producer…

ada47a3

…s in Functions and Connectors (apache#22950)

[fix][broker] Check the markDeletePosition and calculate the backlog (a…

82b8d98

…pache#22947) Signed-off-by: Zixuan Liu <[email protected]>

[cleanup][misc] Remove classifier from netty-transport-native-unix-co…

6692bc8

…mmon dependency (apache#22951)

[improve][misc] Set Alpine base image to 3.20 instead of 3.19.1 (apac…

1517e63

…he#22941)

[fix][misc] Rename netty native libraries in pulsar-client-admin-shad…

ddb03bb

…ed (apache#22954)

[improve] [broker] make system topic distribute evenly. (apache#22953)

263c694

[fix][ci] Replace removed macos-11 with macos-latest in GitHub Actions (

10eeacc

apache#22965)

[improve][misc] Replace rename-netty-native-libs.sh script with renam…

f728b2e

…ing with maven-shade-plugin (apache#22957)

[improve][misc] Upgrade Bookkeeper to 4.17.1 (apache#22962)

c78585a

[fix][ci] Fix jacoco code coverage report aggregation (apache#22964)

aa03c0e

[fix][client] Fix orphan consumer when reconnection and closing are c…

69b2739

…oncurrency executing (apache#22958)

[improve][fn] Make producer cache bounded and expiring in Functions/C…

6fe8100

…onnectors (apache#22945)

[fix][broker] Fix updatePartitionedTopic when replication at ns level…

1c44fbb

… and topic policy is set (apache#22971)

[improve][build] Use amazoncorretto:21-alpine image instead of apk in…

7dba98b

…stallation (apache#22973) Signed-off-by: Zixuan Liu <[email protected]>

[feat][broker] PIP-264: Add OpenTelemetry broker replicator metrics (a…

f323342

…pache#22972)

[revert] "[improve][broker] Optimize ConcurrentOpenLongPairRangeSet…

2da4ee8

… by RoaringBitmap (apache#22908)" (apache#22968)

[fix][broker] Partitioned shadow topic not work properly (apache#22797)

2c6fcc7

[feat][broker] PIP-264: Add OpenTelemetry metadata store stats (apach…

243ad5a

…e#22952)

[feat][broker] PIP-264: Add managed ledger cache metrics (apache#22898)

fe726db

[fix][broker] Ensure that PulsarService is ready for serving incoming…

53df683

… requests (apache#22977)

[improve] [pip] PIP-364: Introduce a new load balance algorithm AvgSh…

4ac9bc4

…edder (apache#22946)

[feat][broker] PIP-264: Add transaction metrics (apache#22970)

4e535cb

[Fix][broker] Limit replication rate based on bytes (apache#22674)

7f4c0c5

Signed-off-by: Zixuan Liu <[email protected]>

[improve][broker] Improve exception for topic does not have schema to…

4c84788

… check (apache#22974)

[fix][broker] Fix broker OOM when upload a large package. (apache#22989)

da2a191

rdhabalia and others added 29 commits October 2, 2024 10:12

[fix][client] Fix failover consumer-listener stuck with cumulative ac…

53e996c

…k and epoch time (apache#23345)

[improve][pip] PIP-360 Add admin API to display Schema metadata (apac…

e49d9ad

…he#22913)

[fix][sec] Upgrade protobuf-java to 3.25.5 (apache#23356)

ab684a0

[fix][broker] timeout when broker registry hangs and monitor broker r…

eee9283

…egistry (ExtensibleLoadManagerImpl only) (apache#23382)

[fix] Bump commons-io:commons-io from 2.8.0 to 2.14.0 (apache#23393)

c2128dc

Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Matteo Merli <[email protected]>

[fix][sec] Upgrade Avro to 1.11.4 to address CVE-2024-47561 (apache#2…

fad6761

…3394)

[improve][broker] PIP-327: Support force topic loading for unrecovera…

38322a6

…ble errors (apache#21759)

[improve][pip] PIP-360 Add admin API to display Schema metadata (apac…

1e93677

…he#22938)

[improve][ci] Continue Pulsar CI build even when Trivy scanner fails (a…

56200aa

…pache#23397)

[fix][broker] Fix Broker was failing to create producer with broken s…

aa12561

…chema ledger (apache#23395)

[improve][pip] PIP-379: Key_Shared Draining Hashes for Improved Messa…

64e9687

…ge Ordering (apache#23309)

[fix][client] Add more info while throwing reader creation exception (a…

6bca70b

…pache#23401)

[fix][broker] Fix delivery-test with unnecessary invocation-count (ap…

b9ededc

…ache#23399)

[feat] [broker] Add broker health check status into prometheus metrics (

6c7ec4c

apache#20147)

[improve][misc] Upgrade Jetty to 9.4.56.v20240826 (apache#23405)

806fdf8

[improve] PIP-384: ManagedLedger interface decoupling (apache#23363)

5451921

[improve][broker][PIP-384] Decouple Bookkeeper client from ManagedLed…

731ec83

…gerStorage and enable multiple ManagedLedgerFactory instances (apache#23313)

[improve][build] Update maven-wrapper (mvnw) to recent stable version…

06fc259

… 3.3.2 (apache#23410)

[improve][PIP] PIP-383: Support granting/revoking permissions for mul…

c598974

…tiple topics (apache#23355)

[improve][ci] Move some flaky ExtensibleLoadManager tests to flaky gr…

4efcc15

…oup until they are fixed (apache#23414)

[improve][broker] PIP-379: Key_Shared Draining Hashes for Improved Me…

3d0625b

…ssage Ordering (apache#23352)

[fix][ml] Remove unnecessary return in ManagedLedgerImpl (apache#23418)

4d6dee4

[improve][ci] Upgrade/Downgrade test (apache#22988)

9579c4d

[improve][broker] PIP-379: Snapshot hash range assignments only in AU…

84b834f

…TO_SPLIT ordered mode (apache#23423)

[fix][broker] Fix typos in pulsar-broker and tiered-storage. (apache#…

5aadec0

…23415)

[improve][broker] PIP-379: Enable the use of the classic implementati…

676fdb1

…on of Key_Shared / Shared with feature flag (apache#23424)

[fix][doc] Fix some typos in pip (apache#23288)

1d83a53

[fix][ml][PIP-327] fix recover from ledger when ledgerForceRecovery i…

ed01b0e

…s true (apache#23426)

Merge branch 'master' into fix_cursor_recover_ignored_batch_ack_index

40b9638

github-actions bot added the PIP label Oct 9, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[fix] [broker] Fix cursor recover ignored batch ack index #23

[fix] [broker] Fix cursor recover ignored batch ack index #23

lifepuzzlefun commented Jun 16, 2023

github-actions bot commented Jul 16, 2023

[fix] [broker] Fix cursor recover ignored batch ack index #23

Are you sure you want to change the base?

[fix] [broker] Fix cursor recover ignored batch ack index #23

Conversation

lifepuzzlefun commented Jun 16, 2023

Motivation

Modifications

Verifying this change

Does this pull request potentially affect one of the following parts:

Documentation

Matching PR in forked repository

github-actions bot commented Jul 16, 2023