[fix] [broker] Geo Replication lost messages or frequently fails due to Deduplication is not aprropriate for Geo-Replication #22301
pulsar-ci.yaml
on: pull_request
Preconditions
9s
Matrix: unit-tests
Matrix: Build Pulsar java-test-image docker image
CI - Unit - Upload Coverage
0s
Run CodeQL Analysis
0s
Matrix: system-tests
Matrix: flaky-system-tests
Matrix: integration-tests
Delete system test docker image artifact
0s
Delete integration test docker image artifact
0s
Pulsar CI checks completed
6s
Annotations
11 errors and 62 warnings
CI - Unit - Brokers - Client Impl
Process completed with exit code 1.
|
|
BrokerMessageDeduplicationTest.markerMessageNotDeduplicated:
pulsar-broker/src/test/java/org/apache/pulsar/broker/BrokerMessageDeduplicationTest.java#L45
Cannot invoke "io.netty.buffer.ByteBuf.readerIndex()" because "headersAndPayload" is null
|
CI - Unit - Brokers - Broker Group 2
Process completed with exit code 1.
|
CI - Integration - Shade on Java 17
Process completed with exit code 1.
|
ClusterMetadataTearDownTest.cleanup:
tests/integration/src/test/java/org/apache/pulsar/tests/integration/cli/ClusterMetadataTearDownTest.java#L124
Cannot invoke "org.apache.bookkeeper.meta.LedgerManager.close()" because "this.ledgerManager" is null
|
ClusterMetadataTearDownTest.setup:
tests/integration/src/test/java/org/apache/pulsar/tests/integration/cli/ClusterMetadataTearDownTest.java#L106
Failed to initialized ledger manager factory
|
CI - Integration - Cli
Process completed with exit code 1.
|
PulsarFunctionsJavaProcessTest.testTumblingCountWindowTest:
tests/integration/src/test/java/org/apache/pulsar/tests/integration/functions/java/PulsarFunctionsJavaProcessTest.java#L1
/pulsar/bin/pulsar-admin functions status --tenant public --namespace default --name test-tumbling-window-fn-qxadakiv failed on e53cda764afe476ea847238b1ded4f4ba45ef2cba7dc543663a3c13988992d9c with error code 1
|
CI - System - Pulsar Connectors - Process
Process completed with exit code 1.
|
Pulsar CI checks completed
Process completed with exit code 1.
|
CI - Unit - Brokers - Client Impl
Summary: Tests in class org.apache.pulsar.client.impl.MessageRedeliveryTest created 59 new threads. There are now 68 threads in total.
|
CI - Unit - Brokers - Client Impl
Summary: Tests in class org.apache.pulsar.client.impl.KeyStoreTlsProducerConsumerTestWithAuthTest created 45 new threads. There are now 54 threads in total.
|
CI - Unit - Brokers - Client Impl
Summary: Tests in class org.apache.pulsar.client.impl.UnAcknowledgedMessagesTimeoutTest created 66 new threads. There are now 75 threads in total.
|
CI - Unit - Proxy
Summary: Tests in class org.apache.pulsar.proxy.server.ProxyStuckConnectionTest created 1 new threads. There are now 10 threads in total.
|
CI - Unit - Proxy
Summary: Tests in class org.apache.pulsar.proxy.server.ProxyIsAHttpProxyTest created 1 new threads. There are now 10 threads in total.
|
CI - Unit - Proxy
Summary: Tests in class org.apache.pulsar.proxy.server.ProxyDisableZeroCopyTest created 1070 new threads. There are now 1079 threads in total.
|
CI - Unit - Proxy
Summary: Tests in class org.apache.pulsar.proxy.server.ProxyTest created 1030 new threads. There are now 1039 threads in total.
|
CI - Unit - Brokers - Broker Group 4
Summary: Tests in class org.apache.pulsar.broker.service.ClusterMigrationTest created 2 new threads. There are now 11 threads in total.
|
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.ElasticSearchBWCTests created 6 new threads. There are now 15 threads in total.
|
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.v8.ElasticSearch8ClientTests created 10 new threads. There are now 25 threads in total.
|
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.v8.ElasticSearch8AuthTests created 11 new threads. There are now 33 threads in total.
|
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.v8.ElasticSearch8SinkTests created 1 new threads. There are now 34 threads in total.
|
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.v8.ElasticSearch8SinkRawDataTests created 3 new threads. There are now 37 threads in total.
|
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.ElasticSearchRawRecordTests created 96 new threads. There are now 133 threads in total.
|
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.v7.ElasticSearch7ClientTests created 3 new threads. There are now 136 threads in total.
|
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.opensearch.OpenSearchClientTests created 1 new threads. There are now 134 threads in total.
|
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.opensearch.OpenSearchClientSslTests created 18 new threads. There are now 151 threads in total.
|
CI - Unit - Brokers - Broker Group 2
Summary: Tests in class org.apache.pulsar.zookeeper.LocalBookkeeperEnsembleTest created 41 new threads. There are now 50 threads in total.
|
CI - Unit - Brokers - Broker Group 2
Summary: Tests in class org.apache.pulsar.broker.zookeeper.ZKReconnectTest created 3 new threads. There are now 12 threads in total.
|
CI - Unit - Brokers - Broker Group 2
Summary: Tests in class org.apache.pulsar.broker.SameAuthParamsLookupAutoClusterFailoverTest created 5 new threads. There are now 14 threads in total.
|
CI - Unit - Brokers - Broker Group 2
Summary: Tests in class org.apache.pulsar.broker.delayed.DelayedDeliveryTrackerFactoryTest created 1 new threads. There are now 13 threads in total.
|
CI - Unit - Brokers - Broker Group 2
Summary: Tests in class org.apache.pulsar.broker.EndToEndMetadataTest created 1 new threads. There are now 48 threads in total.
|
CI - Unit - Brokers - Broker Group 2
Summary: Tests in class org.apache.pulsar.broker.transaction.buffer.TopicTransactionBufferTest created 91 new threads. There are now 138 threads in total.
|
CI - Unit - Brokers - Broker Group 2
Summary: Tests in class org.apache.pulsar.broker.resourcegroup.ResourceGroupConfigListenerTest created 1 new threads. There are now 10 threads in total.
|
CI - Unit - Brokers - Broker Group 2
Summary: Tests in class org.apache.pulsar.broker.transaction.TopicTransactionBufferRecoverTest created 94 new threads. There are now 107 threads in total.
|
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.http.HttpSinkTest created 78 new threads. There are now 87 threads in total.
|
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.kinesis.KinesisSinkTest created 9 new threads. There are now 19 threads in total.
|
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.hdfs3.sink.text.HdfsStringSinkTests created 1 new threads. There are now 10 threads in total.
|
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.hdfs3.sink.seq.HdfsSequentialSinkTests created 1 new threads. There are now 10 threads in total.
|
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.hdfs3.sink.seq.HdfsTextSinkTests created 1 new threads. There are now 10 threads in total.
|
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.flume.node.TestPollingZooKeeperConfigurationProvider created 4 new threads. There are now 13 threads in total.
|
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.flume.source.StringSourceTests created 20 new threads. There are now 29 threads in total.
|
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.flume.sink.StringSinkTests created 16 new threads. There are now 25 threads in total.
|
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.redis.sink.RedisSinkTest created 11 new threads. There are now 21 threads in total.
|
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.solr.SolrGenericRecordSinkTest created 1 new threads. There are now 11 threads in total.
|
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.pulsar.metadata.MetadataStoreTest created 8 new threads. There are now 18 threads in total.
|
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.AuditorCheckAllLedgersTaskTest created 1 new threads. There are now 11 threads in total.
|
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.BookieAutoRecoveryTest created 15 new threads. There are now 25 threads in total.
|
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.TestReplicationWorker created 43 new threads. There are now 53 threads in total.
|
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.AuditorBookieTest created 28 new threads. There are now 38 threads in total.
|
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.AuditorRollingRestartTest created 47 new threads. There are now 57 threads in total.
|
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.AutoRecoveryMainTest created 18 new threads. There are now 28 threads in total.
|
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.AuditorPeriodicCheckTest created 11 new threads. There are now 21 threads in total.
|
CI - Unit - Brokers - Broker Group 3
Summary: Tests in class org.apache.pulsar.broker.admin.TenantEndpointsAuthorizationTest created 8 new threads. There are now 17 threads in total.
|
CI - Unit - Brokers - Broker Group 3
Summary: Tests in class org.apache.pulsar.broker.admin.ClusterEndpointsAuthorizationTest created 12 new threads. There are now 29 threads in total.
|
CI - Unit - Brokers - Broker Group 3
Summary: Tests in class org.apache.pulsar.broker.admin.BrokerEndpointsAuthorizationTest created 12 new threads. There are now 21 threads in total.
|
CI - Unit - Brokers - Broker Group 3
Summary: Tests in class org.apache.pulsar.broker.admin.AdminRestTest created 1 new threads. There are now 22 threads in total.
|
CI - Unit - Brokers - Broker Group 3
Summary: Tests in class org.apache.pulsar.broker.admin.AdminApiTest created 1 new threads. There are now 30 threads in total.
|
CI - Integration - Shade on Java 17
No files were found with the provided path: tests/integration/target/container-logs. No artifacts will be uploaded.
|
CI - Unit - Other
Summary: Tests in class org.apache.pulsar.bookie.rackawareness.BookieRackAffinityMappingTest created 1 new threads. There are now 11 threads in total.
|
CI - Unit - Other
Summary: Tests in class org.apache.bookkeeper.mledger.impl.ManagedLedgerFactoryChangeLedgerPathTest created 16 new threads. There are now 26 threads in total.
|
CI - Unit - Other
Summary: Tests in class org.apache.bookkeeper.mledger.impl.ManagedCursorTest created 5 new threads. There are now 15 threads in total.
|
CI - Unit - Other
Summary: Tests in class org.apache.bookkeeper.mledger.impl.OffloadPrefixTest created 8 new threads. There are now 30 threads in total.
|
CI - Unit - Other
Summary: Tests in class org.apache.bookkeeper.mledger.offload.filesystem.impl.FileSystemOffloaderLocalFileTest created 3 new threads. There are now 14 threads in total.
|
CI - Unit - Other
Summary: Tests in class org.apache.bookkeeper.mledger.offload.filesystem.impl.FileSystemManagedLedgerOffloaderTest created 6 new threads. There are now 16 threads in total.
|
CI - Unit - Other
Summary: Tests in class org.apache.pulsar.functions.utils.FunctionCommonTest created 1 new threads. There are now 10 threads in total.
|
CI - Unit - Other
Summary: Tests in class org.apache.pulsar.functions.worker.rest.api.v3.FunctionApiV3ResourceTest created 1 new threads. There are now 11 threads in total.
|
CI - Unit - Other
Summary: Tests in class org.apache.pulsar.functions.worker.rest.api.v2.FunctionApiV2ResourceTest created 1 new threads. There are now 11 threads in total.
|
CI - Unit - Other
Summary: Tests in class org.apache.pulsar.testclient.PerformanceProducerTest created 8 new threads. There are now 18 threads in total.
|
CI - Unit - Brokers - Broker Group 1
Summary: Tests in class org.apache.pulsar.PulsarBrokerStarterTest created 4 new threads. There are now 13 threads in total.
|
CI - Unit - Brokers - Broker Group 1
Summary: Tests in class org.apache.pulsar.broker.stats.TransactionBatchWriterMetricsTest created 1 new threads. There are now 10 threads in total.
|
CI - Unit - Brokers - Broker Group 1
Summary: Tests in class org.apache.pulsar.broker.service.BrokerServiceTest created 2 new threads. There are now 11 threads in total.
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
Integration-CLI-container-logs
Expired
|
1.09 MB |
|
Integration-CLI-surefire-reports
Expired
|
864 KB |
|
Integration-SHADE_RUN-surefire-reports
Expired
|
68.4 KB |
|
System-PULSAR_CONNECTORS_PROCESS-container-logs
Expired
|
566 KB |
|
System-Pulsar Connectors - Process-surefire-reports
Expired
|
466 KB |
|
Unit-BROKER_CLIENT_IMPL-dumps
Expired
|
26.1 KB |
|
Unit-BROKER_CLIENT_IMPL-surefire-reports
Expired
|
10.5 MB |
|
Unit-BROKER_GROUP_1-dumps
Expired
|
12.2 KB |
|
Unit-BROKER_GROUP_2-dumps
Expired
|
55.9 KB |
|
Unit-BROKER_GROUP_2-surefire-reports
Expired
|
20.4 MB |
|
Unit-BROKER_GROUP_3-dumps
Expired
|
24.6 KB |
|
Unit-BROKER_GROUP_4-dumps
Expired
|
4.18 KB |
|
Unit-METADATA-dumps
Expired
|
48 KB |
|
Unit-OTHER-dumps
Expired
|
66.6 KB |
|
Unit-PROXY-dumps
Expired
|
119 KB |
|
Unit-PULSAR_IO-dumps
Expired
|
60.7 KB |
|
Unit-PULSAR_IO_ELASTIC-dumps
Expired
|
73.2 KB |
|
coverage_and_deps_inttest_MESSAGING.tar.zst
Expired
|
360 KB |
|
coverage_and_deps_inttest_METRICS.tar.zst
Expired
|
303 KB |
|
coverage_and_deps_inttest_STANDALONE.tar.zst
Expired
|
297 KB |
|
coverage_and_deps_inttest_TRANSACTION.tar.zst
Expired
|
305 KB |
|
coverage_and_deps_inttest_UPGRADE.tar.zst
Expired
|
298 KB |
|
coverage_and_deps_systest_FUNCTION.tar.zst
Expired
|
306 KB |
|
coverage_and_deps_systest_PULSAR_CONNECTORS_THREAD.tar.zst
Expired
|
326 KB |
|
coverage_and_deps_systest_PULSAR_IO.tar.zst
Expired
|
328 KB |
|
coverage_and_deps_systest_SCHEMA.tar.zst
Expired
|
310 KB |
|
coverage_and_deps_systest_TIERED_FILESYSTEM.tar.zst
Expired
|
89.8 MB |
|
coverage_and_deps_systest_TIERED_JCLOUD.tar.zst
Expired
|
302 KB |
|
coverage_and_deps_unittest_BROKER_CLIENT_API.tar.zst
Expired
|
2.25 MB |
|
coverage_and_deps_unittest_BROKER_GROUP_1.tar.zst
Expired
|
2.5 MB |
|
coverage_and_deps_unittest_BROKER_GROUP_3.tar.zst
Expired
|
2.27 MB |
|
coverage_and_deps_unittest_BROKER_GROUP_4.tar.zst
Expired
|
2.15 MB |
|
coverage_and_deps_unittest_CLIENT.tar.zst
Expired
|
664 KB |
|
coverage_and_deps_unittest_METADATA.tar.zst
Expired
|
263 KB |
|
coverage_and_deps_unittest_OTHER.tar.zst
Expired
|
10.1 MB |
|
coverage_and_deps_unittest_PROXY.tar.zst
Expired
|
210 KB |
|
coverage_and_deps_unittest_PULSAR_IO.tar.zst
Expired
|
361 KB |
|
coverage_and_deps_unittest_PULSAR_IO_ELASTIC.tar.zst
Expired
|
91.1 KB |
|
coverage_and_deps_unittest_PULSAR_IO_KAFKA_CONNECT.tar.zst
Expired
|
205 KB |
|
pulsar-java-test-image.zst
Expired
|
301 MB |
|
pulsar-maven-repository-binaries.tar.zst
Expired
|
318 MB |
|
pulsar-server-distribution.tar.zst
Expired
|
228 MB |
|
pulsar-test-latest-version-image.zst
Expired
|
1.73 GB |
|