Skip to content

[fix] [broker] Geo Replication lost messages or frequently fails due to Deduplication is not aprropriate for Geo-Replication #22301

[fix] [broker] Geo Replication lost messages or frequently fails due to Deduplication is not aprropriate for Geo-Replication

[fix] [broker] Geo Replication lost messages or frequently fails due to Deduplication is not aprropriate for Geo-Replication #22301

Triggered via pull request December 20, 2024 14:24
Status Failure
Total duration 1h 1m 23s
Artifacts 43

pulsar-ci.yaml

on: pull_request
Preconditions
9s
Preconditions
Build and License check
9m 30s
Build and License check
Matrix: unit-tests
Build Pulsar docker image
16m 31s
Build Pulsar docker image
Matrix: Build Pulsar java-test-image docker image
CI - Unit - Upload Coverage
0s
CI - Unit - Upload Coverage
Run CodeQL Analysis
0s
Run CodeQL Analysis
Matrix: system-tests
Matrix: flaky-system-tests
Matrix: integration-tests
CI - System - Upload Coverage
0s
CI - System - Upload Coverage
CI - Integration - Upload Coverage
0s
CI - Integration - Upload Coverage
Build Pulsar on MacOS
0s
Build Pulsar on MacOS
OWASP dependency check
0s
OWASP dependency check
Delete system test docker image artifact
0s
Delete system test docker image artifact
Delete integration test docker image artifact
0s
Delete integration test docker image artifact
Pulsar CI checks completed
6s
Pulsar CI checks completed
Fit to window
Zoom out
Zoom in

Annotations

11 errors and 62 warnings
CI - Unit - Brokers - Client Impl
Process completed with exit code 1.
BrokerMessageDeduplicationTest.markerMessageNotDeduplicated: pulsar-broker/src/test/java/org/apache/pulsar/broker/BrokerMessageDeduplicationTest.java#L45
Cannot invoke "io.netty.buffer.ByteBuf.readerIndex()" because "headersAndPayload" is null
CI - Unit - Brokers - Broker Group 2
Process completed with exit code 1.
CI - Integration - Shade on Java 17
Process completed with exit code 1.
ClusterMetadataTearDownTest.cleanup: tests/integration/src/test/java/org/apache/pulsar/tests/integration/cli/ClusterMetadataTearDownTest.java#L124
Cannot invoke "org.apache.bookkeeper.meta.LedgerManager.close()" because "this.ledgerManager" is null
CI - Integration - Cli
Process completed with exit code 1.
PulsarFunctionsJavaProcessTest.testTumblingCountWindowTest: tests/integration/src/test/java/org/apache/pulsar/tests/integration/functions/java/PulsarFunctionsJavaProcessTest.java#L1
/pulsar/bin/pulsar-admin functions status --tenant public --namespace default --name test-tumbling-window-fn-qxadakiv failed on e53cda764afe476ea847238b1ded4f4ba45ef2cba7dc543663a3c13988992d9c with error code 1
CI - System - Pulsar Connectors - Process
Process completed with exit code 1.
Pulsar CI checks completed
Process completed with exit code 1.
CI - Unit - Brokers - Client Impl
Summary: Tests in class org.apache.pulsar.client.impl.MessageRedeliveryTest created 59 new threads. There are now 68 threads in total.
CI - Unit - Brokers - Client Impl
Summary: Tests in class org.apache.pulsar.client.impl.KeyStoreTlsProducerConsumerTestWithAuthTest created 45 new threads. There are now 54 threads in total.
CI - Unit - Brokers - Client Impl
Summary: Tests in class org.apache.pulsar.client.impl.UnAcknowledgedMessagesTimeoutTest created 66 new threads. There are now 75 threads in total.
CI - Unit - Proxy
Summary: Tests in class org.apache.pulsar.proxy.server.ProxyStuckConnectionTest created 1 new threads. There are now 10 threads in total.
CI - Unit - Proxy
Summary: Tests in class org.apache.pulsar.proxy.server.ProxyIsAHttpProxyTest created 1 new threads. There are now 10 threads in total.
CI - Unit - Proxy
Summary: Tests in class org.apache.pulsar.proxy.server.ProxyDisableZeroCopyTest created 1070 new threads. There are now 1079 threads in total.
CI - Unit - Proxy
Summary: Tests in class org.apache.pulsar.proxy.server.ProxyTest created 1030 new threads. There are now 1039 threads in total.
CI - Unit - Brokers - Broker Group 4
Summary: Tests in class org.apache.pulsar.broker.service.ClusterMigrationTest created 2 new threads. There are now 11 threads in total.
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.ElasticSearchBWCTests created 6 new threads. There are now 15 threads in total.
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.v8.ElasticSearch8ClientTests created 10 new threads. There are now 25 threads in total.
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.v8.ElasticSearch8AuthTests created 11 new threads. There are now 33 threads in total.
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.v8.ElasticSearch8SinkTests created 1 new threads. There are now 34 threads in total.
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.v8.ElasticSearch8SinkRawDataTests created 3 new threads. There are now 37 threads in total.
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.ElasticSearchRawRecordTests created 96 new threads. There are now 133 threads in total.
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.v7.ElasticSearch7ClientTests created 3 new threads. There are now 136 threads in total.
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.opensearch.OpenSearchClientTests created 1 new threads. There are now 134 threads in total.
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.opensearch.OpenSearchClientSslTests created 18 new threads. There are now 151 threads in total.
CI - Unit - Brokers - Broker Group 2
Summary: Tests in class org.apache.pulsar.zookeeper.LocalBookkeeperEnsembleTest created 41 new threads. There are now 50 threads in total.
CI - Unit - Brokers - Broker Group 2
Summary: Tests in class org.apache.pulsar.broker.zookeeper.ZKReconnectTest created 3 new threads. There are now 12 threads in total.
CI - Unit - Brokers - Broker Group 2
Summary: Tests in class org.apache.pulsar.broker.SameAuthParamsLookupAutoClusterFailoverTest created 5 new threads. There are now 14 threads in total.
CI - Unit - Brokers - Broker Group 2
Summary: Tests in class org.apache.pulsar.broker.delayed.DelayedDeliveryTrackerFactoryTest created 1 new threads. There are now 13 threads in total.
CI - Unit - Brokers - Broker Group 2
Summary: Tests in class org.apache.pulsar.broker.EndToEndMetadataTest created 1 new threads. There are now 48 threads in total.
CI - Unit - Brokers - Broker Group 2
Summary: Tests in class org.apache.pulsar.broker.transaction.buffer.TopicTransactionBufferTest created 91 new threads. There are now 138 threads in total.
CI - Unit - Brokers - Broker Group 2
Summary: Tests in class org.apache.pulsar.broker.resourcegroup.ResourceGroupConfigListenerTest created 1 new threads. There are now 10 threads in total.
CI - Unit - Brokers - Broker Group 2
Summary: Tests in class org.apache.pulsar.broker.transaction.TopicTransactionBufferRecoverTest created 94 new threads. There are now 107 threads in total.
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.http.HttpSinkTest created 78 new threads. There are now 87 threads in total.
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.kinesis.KinesisSinkTest created 9 new threads. There are now 19 threads in total.
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.hdfs3.sink.text.HdfsStringSinkTests created 1 new threads. There are now 10 threads in total.
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.hdfs3.sink.seq.HdfsSequentialSinkTests created 1 new threads. There are now 10 threads in total.
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.hdfs3.sink.seq.HdfsTextSinkTests created 1 new threads. There are now 10 threads in total.
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.flume.node.TestPollingZooKeeperConfigurationProvider created 4 new threads. There are now 13 threads in total.
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.flume.source.StringSourceTests created 20 new threads. There are now 29 threads in total.
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.flume.sink.StringSinkTests created 16 new threads. There are now 25 threads in total.
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.redis.sink.RedisSinkTest created 11 new threads. There are now 21 threads in total.
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.solr.SolrGenericRecordSinkTest created 1 new threads. There are now 11 threads in total.
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.pulsar.metadata.MetadataStoreTest created 8 new threads. There are now 18 threads in total.
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.AuditorCheckAllLedgersTaskTest created 1 new threads. There are now 11 threads in total.
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.BookieAutoRecoveryTest created 15 new threads. There are now 25 threads in total.
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.TestReplicationWorker created 43 new threads. There are now 53 threads in total.
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.AuditorBookieTest created 28 new threads. There are now 38 threads in total.
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.AuditorRollingRestartTest created 47 new threads. There are now 57 threads in total.
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.AutoRecoveryMainTest created 18 new threads. There are now 28 threads in total.
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.AuditorPeriodicCheckTest created 11 new threads. There are now 21 threads in total.
CI - Unit - Brokers - Broker Group 3
Summary: Tests in class org.apache.pulsar.broker.admin.TenantEndpointsAuthorizationTest created 8 new threads. There are now 17 threads in total.
CI - Unit - Brokers - Broker Group 3
Summary: Tests in class org.apache.pulsar.broker.admin.ClusterEndpointsAuthorizationTest created 12 new threads. There are now 29 threads in total.
CI - Unit - Brokers - Broker Group 3
Summary: Tests in class org.apache.pulsar.broker.admin.BrokerEndpointsAuthorizationTest created 12 new threads. There are now 21 threads in total.
CI - Unit - Brokers - Broker Group 3
Summary: Tests in class org.apache.pulsar.broker.admin.AdminRestTest created 1 new threads. There are now 22 threads in total.
CI - Unit - Brokers - Broker Group 3
Summary: Tests in class org.apache.pulsar.broker.admin.AdminApiTest created 1 new threads. There are now 30 threads in total.
CI - Integration - Shade on Java 17
No files were found with the provided path: tests/integration/target/container-logs. No artifacts will be uploaded.
CI - Unit - Other
Summary: Tests in class org.apache.pulsar.bookie.rackawareness.BookieRackAffinityMappingTest created 1 new threads. There are now 11 threads in total.
CI - Unit - Other
Summary: Tests in class org.apache.bookkeeper.mledger.impl.ManagedLedgerFactoryChangeLedgerPathTest created 16 new threads. There are now 26 threads in total.
CI - Unit - Other
Summary: Tests in class org.apache.bookkeeper.mledger.impl.ManagedCursorTest created 5 new threads. There are now 15 threads in total.
CI - Unit - Other
Summary: Tests in class org.apache.bookkeeper.mledger.impl.OffloadPrefixTest created 8 new threads. There are now 30 threads in total.
CI - Unit - Other
Summary: Tests in class org.apache.bookkeeper.mledger.offload.filesystem.impl.FileSystemOffloaderLocalFileTest created 3 new threads. There are now 14 threads in total.
CI - Unit - Other
Summary: Tests in class org.apache.bookkeeper.mledger.offload.filesystem.impl.FileSystemManagedLedgerOffloaderTest created 6 new threads. There are now 16 threads in total.
CI - Unit - Other
Summary: Tests in class org.apache.pulsar.functions.utils.FunctionCommonTest created 1 new threads. There are now 10 threads in total.
CI - Unit - Other
Summary: Tests in class org.apache.pulsar.functions.worker.rest.api.v3.FunctionApiV3ResourceTest created 1 new threads. There are now 11 threads in total.
CI - Unit - Other
Summary: Tests in class org.apache.pulsar.functions.worker.rest.api.v2.FunctionApiV2ResourceTest created 1 new threads. There are now 11 threads in total.
CI - Unit - Other
Summary: Tests in class org.apache.pulsar.testclient.PerformanceProducerTest created 8 new threads. There are now 18 threads in total.
CI - Unit - Brokers - Broker Group 1
Summary: Tests in class org.apache.pulsar.PulsarBrokerStarterTest created 4 new threads. There are now 13 threads in total.
CI - Unit - Brokers - Broker Group 1
Summary: Tests in class org.apache.pulsar.broker.stats.TransactionBatchWriterMetricsTest created 1 new threads. There are now 10 threads in total.
CI - Unit - Brokers - Broker Group 1
Summary: Tests in class org.apache.pulsar.broker.service.BrokerServiceTest created 2 new threads. There are now 11 threads in total.

Artifacts

Produced during runtime
Name Size
Integration-CLI-container-logs Expired
1.09 MB
Integration-CLI-surefire-reports Expired
864 KB
Integration-SHADE_RUN-surefire-reports Expired
68.4 KB
System-PULSAR_CONNECTORS_PROCESS-container-logs Expired
566 KB
System-Pulsar Connectors - Process-surefire-reports Expired
466 KB
Unit-BROKER_CLIENT_IMPL-dumps Expired
26.1 KB
Unit-BROKER_CLIENT_IMPL-surefire-reports Expired
10.5 MB
Unit-BROKER_GROUP_1-dumps Expired
12.2 KB
Unit-BROKER_GROUP_2-dumps Expired
55.9 KB
Unit-BROKER_GROUP_2-surefire-reports Expired
20.4 MB
Unit-BROKER_GROUP_3-dumps Expired
24.6 KB
Unit-BROKER_GROUP_4-dumps Expired
4.18 KB
Unit-METADATA-dumps Expired
48 KB
Unit-OTHER-dumps Expired
66.6 KB
Unit-PROXY-dumps Expired
119 KB
Unit-PULSAR_IO-dumps Expired
60.7 KB
Unit-PULSAR_IO_ELASTIC-dumps Expired
73.2 KB
coverage_and_deps_inttest_MESSAGING.tar.zst Expired
360 KB
coverage_and_deps_inttest_METRICS.tar.zst Expired
303 KB
coverage_and_deps_inttest_STANDALONE.tar.zst Expired
297 KB
coverage_and_deps_inttest_TRANSACTION.tar.zst Expired
305 KB
coverage_and_deps_inttest_UPGRADE.tar.zst Expired
298 KB
coverage_and_deps_systest_FUNCTION.tar.zst Expired
306 KB
coverage_and_deps_systest_PULSAR_CONNECTORS_THREAD.tar.zst Expired
326 KB
coverage_and_deps_systest_PULSAR_IO.tar.zst Expired
328 KB
coverage_and_deps_systest_SCHEMA.tar.zst Expired
310 KB
coverage_and_deps_systest_TIERED_FILESYSTEM.tar.zst Expired
89.8 MB
coverage_and_deps_systest_TIERED_JCLOUD.tar.zst Expired
302 KB
coverage_and_deps_unittest_BROKER_CLIENT_API.tar.zst Expired
2.25 MB
coverage_and_deps_unittest_BROKER_GROUP_1.tar.zst Expired
2.5 MB
coverage_and_deps_unittest_BROKER_GROUP_3.tar.zst Expired
2.27 MB
coverage_and_deps_unittest_BROKER_GROUP_4.tar.zst Expired
2.15 MB
coverage_and_deps_unittest_CLIENT.tar.zst Expired
664 KB
coverage_and_deps_unittest_METADATA.tar.zst Expired
263 KB
coverage_and_deps_unittest_OTHER.tar.zst Expired
10.1 MB
coverage_and_deps_unittest_PROXY.tar.zst Expired
210 KB
coverage_and_deps_unittest_PULSAR_IO.tar.zst Expired
361 KB
coverage_and_deps_unittest_PULSAR_IO_ELASTIC.tar.zst Expired
91.1 KB
coverage_and_deps_unittest_PULSAR_IO_KAFKA_CONNECT.tar.zst Expired
205 KB
pulsar-java-test-image.zst Expired
301 MB
pulsar-maven-repository-binaries.tar.zst Expired
318 MB
pulsar-server-distribution.tar.zst Expired
228 MB
pulsar-test-latest-version-image.zst Expired
1.73 GB