Skip to content

[test] Generate test CI report for E2E tests in local fork (#1269) #362

[test] Generate test CI report for E2E tests in local fork (#1269)

[test] Generate test CI report for E2E tests in local fork (#1269) #362

GitHub Actions / IntegrationTests_1050 Test Reports succeeded Nov 5, 2024 in 1s

26 passed, 4 failed and 0 skipped

Tests failed

Report Passed Failed Skipped Time
IntegrationTests_1050-artifacts/internal/venice-test-common/build/test-results/integrationTests_1050/TEST-com.linkedin.venice.endToEnd.TestActiveActiveIngestion.xml 5✅ 146s
IntegrationTests_1050-artifacts/internal/venice-test-common/build/test-results/integrationTests_1050/TEST-com.linkedin.venice.endToEnd.TestActiveActiveIngestionWithReadWriteLeaderCompactionTuningAndParallelProcessing.xml 5✅ 150s
IntegrationTests_1050-artifacts/internal/venice-test-common/build/test-results/integrationTests_1050/TEST-com.linkedin.venice.endToEnd.TestActiveActiveReplicationForIncPush.xml 2✅ 2❌ 226s
IntegrationTests_1050-artifacts/internal/venice-test-common/build/test-results/integrationTests_1050/TEST-com.linkedin.venice.endToEnd.TestActiveActiveReplicationWithDelayedLeaderPromotion.xml 1✅ 44s
internal/venice-test-common/build/test-results/integrationTests_1050/TEST-com.linkedin.venice.endToEnd.TestActiveActiveIngestion.xml 5✅ 146s
internal/venice-test-common/build/test-results/integrationTests_1050/TEST-com.linkedin.venice.endToEnd.TestActiveActiveIngestionWithReadWriteLeaderCompactionTuningAndParallelProcessing.xml 5✅ 150s
internal/venice-test-common/build/test-results/integrationTests_1050/TEST-com.linkedin.venice.endToEnd.TestActiveActiveReplicationForIncPush.xml 2✅ 2❌ 226s
internal/venice-test-common/build/test-results/integrationTests_1050/TEST-com.linkedin.venice.endToEnd.TestActiveActiveReplicationWithDelayedLeaderPromotion.xml 1✅ 44s

✅ IntegrationTests_1050-artifacts/internal/venice-test-common/build/test-results/integrationTests_1050/TEST-com.linkedin.venice.endToEnd.TestActiveActiveIngestion.xml

5 tests were completed in 146s with 5 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.endToEnd.TestActiveActiveIngestion 5✅ 146s

✅ com.linkedin.venice.endToEnd.TestActiveActiveIngestion

✅ testActiveActiveStoreRestart
✅ testBatchPushWithSeparateDrainer
✅ testKIFRepushActiveActiveStore[0](false)
✅ testKIFRepushActiveActiveStore[2](true)
✅ testLeaderLagWithIgnoredData

✅ IntegrationTests_1050-artifacts/internal/venice-test-common/build/test-results/integrationTests_1050/TEST-com.linkedin.venice.endToEnd.TestActiveActiveIngestionWithReadWriteLeaderCompactionTuningAndParallelProcessing.xml

5 tests were completed in 150s with 5 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.endToEnd.TestActiveActiveIngestionWithReadWriteLeaderCompactionTuningAndParallelProcessing 5✅ 150s

✅ com.linkedin.venice.endToEnd.TestActiveActiveIngestionWithReadWriteLeaderCompactionTuningAndParallelProcessing

✅ testActiveActiveStoreRestart
✅ testBatchPushWithSeparateDrainer
✅ testKIFRepushActiveActiveStore[0](false)
✅ testKIFRepushActiveActiveStore[2](true)
✅ testLeaderLagWithIgnoredData

❌ IntegrationTests_1050-artifacts/internal/venice-test-common/build/test-results/integrationTests_1050/TEST-com.linkedin.venice.endToEnd.TestActiveActiveReplicationForIncPush.xml

4 tests were completed in 226s with 2 passed, 2 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.endToEnd.TestActiveActiveReplicationForIncPush 2✅ 2❌ 226s

❌ com.linkedin.venice.endToEnd.TestActiveActiveReplicationForIncPush

❌ testAAReplicationForIncrementalPushToRT[0](false)
	java.lang.AssertionError: Controller error: An error occurred during controller request. controller = http://localhost:36407, route = /new_store, params = [owner=owner, key_schema="string", cluster_name=venice-cluster0, hostname=localhost, store_name=store_8455ec13e0_ce2b3cb1, value_schema="string"], timeout = 600000. Exception type: class com.linkedin.venice.exceptions.VeniceHttpException. Detailed message: Http Status 500 - Failed to add version: -1 to store: venice_system_store_meta_store_store_8455ec13e0_ce2b3cb1 in cluster: venice-cluster0. Detailed stack trace: com.linkedin.venice.exceptions.VeniceException: Store: venice_system_store_meta_store_store_8455ec13e0_ce2b3cb1 is not initialized with a version yet
❌ testAAReplicationForIncrementalPushToRT[2](true)
	java.lang.AssertionError: Controller error: An error occurred during controller request. controller = http://localhost:36407, route = /new_store, params = [owner=owner, key_schema="string", cluster_name=venice-cluster0, hostname=localhost, store_name=store_84a3002588_6c8b0c2, value_schema="string"], timeout = 600000. Exception type: class com.linkedin.venice.exceptions.VeniceHttpException. Detailed message: Http Status 500 - Failed to add version: -1 to store: venice_system_store_meta_store_store_84a3002588_6c8b0c2 in cluster: venice-cluster0. Detailed stack trace: com.linkedin.venice.exceptions.VeniceException: Store: venice_system_store_meta_store_store_84a3002588_6c8b0c2 is not initialized with a version yet
✅ testAAReplicationForIncrementalPushToRT[0](false)
✅ testAAReplicationForIncrementalPushToRT[2](true)

✅ IntegrationTests_1050-artifacts/internal/venice-test-common/build/test-results/integrationTests_1050/TEST-com.linkedin.venice.endToEnd.TestActiveActiveReplicationWithDelayedLeaderPromotion.xml

1 tests were completed in 44s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.endToEnd.TestActiveActiveReplicationWithDelayedLeaderPromotion 1✅ 44s

✅ com.linkedin.venice.endToEnd.TestActiveActiveReplicationWithDelayedLeaderPromotion

✅ testLeaderShouldCalculateRewindDuringPromotion

✅ internal/venice-test-common/build/test-results/integrationTests_1050/TEST-com.linkedin.venice.endToEnd.TestActiveActiveIngestion.xml

5 tests were completed in 146s with 5 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.endToEnd.TestActiveActiveIngestion 5✅ 146s

✅ com.linkedin.venice.endToEnd.TestActiveActiveIngestion

✅ testActiveActiveStoreRestart
✅ testBatchPushWithSeparateDrainer
✅ testKIFRepushActiveActiveStore[0](false)
✅ testKIFRepushActiveActiveStore[2](true)
✅ testLeaderLagWithIgnoredData

✅ internal/venice-test-common/build/test-results/integrationTests_1050/TEST-com.linkedin.venice.endToEnd.TestActiveActiveIngestionWithReadWriteLeaderCompactionTuningAndParallelProcessing.xml

5 tests were completed in 150s with 5 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.endToEnd.TestActiveActiveIngestionWithReadWriteLeaderCompactionTuningAndParallelProcessing 5✅ 150s

✅ com.linkedin.venice.endToEnd.TestActiveActiveIngestionWithReadWriteLeaderCompactionTuningAndParallelProcessing

✅ testActiveActiveStoreRestart
✅ testBatchPushWithSeparateDrainer
✅ testKIFRepushActiveActiveStore[0](false)
✅ testKIFRepushActiveActiveStore[2](true)
✅ testLeaderLagWithIgnoredData

❌ internal/venice-test-common/build/test-results/integrationTests_1050/TEST-com.linkedin.venice.endToEnd.TestActiveActiveReplicationForIncPush.xml

4 tests were completed in 226s with 2 passed, 2 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.endToEnd.TestActiveActiveReplicationForIncPush 2✅ 2❌ 226s

❌ com.linkedin.venice.endToEnd.TestActiveActiveReplicationForIncPush

❌ testAAReplicationForIncrementalPushToRT[0](false)
	java.lang.AssertionError: Controller error: An error occurred during controller request. controller = http://localhost:36407, route = /new_store, params = [owner=owner, key_schema="string", cluster_name=venice-cluster0, hostname=localhost, store_name=store_8455ec13e0_ce2b3cb1, value_schema="string"], timeout = 600000. Exception type: class com.linkedin.venice.exceptions.VeniceHttpException. Detailed message: Http Status 500 - Failed to add version: -1 to store: venice_system_store_meta_store_store_8455ec13e0_ce2b3cb1 in cluster: venice-cluster0. Detailed stack trace: com.linkedin.venice.exceptions.VeniceException: Store: venice_system_store_meta_store_store_8455ec13e0_ce2b3cb1 is not initialized with a version yet
❌ testAAReplicationForIncrementalPushToRT[2](true)
	java.lang.AssertionError: Controller error: An error occurred during controller request. controller = http://localhost:36407, route = /new_store, params = [owner=owner, key_schema="string", cluster_name=venice-cluster0, hostname=localhost, store_name=store_84a3002588_6c8b0c2, value_schema="string"], timeout = 600000. Exception type: class com.linkedin.venice.exceptions.VeniceHttpException. Detailed message: Http Status 500 - Failed to add version: -1 to store: venice_system_store_meta_store_store_84a3002588_6c8b0c2 in cluster: venice-cluster0. Detailed stack trace: com.linkedin.venice.exceptions.VeniceException: Store: venice_system_store_meta_store_store_84a3002588_6c8b0c2 is not initialized with a version yet
✅ testAAReplicationForIncrementalPushToRT[0](false)
✅ testAAReplicationForIncrementalPushToRT[2](true)

✅ internal/venice-test-common/build/test-results/integrationTests_1050/TEST-com.linkedin.venice.endToEnd.TestActiveActiveReplicationWithDelayedLeaderPromotion.xml

1 tests were completed in 44s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.endToEnd.TestActiveActiveReplicationWithDelayedLeaderPromotion 1✅ 44s

✅ com.linkedin.venice.endToEnd.TestActiveActiveReplicationWithDelayedLeaderPromotion

✅ testLeaderShouldCalculateRewindDuringPromotion

Annotations

Check failure on line 3176 in services/venice-controller/src/main/java/com/linkedin/venice/controller/VeniceHelixAdmin.java

See this annotation in the file changed.

@github-actions github-actions / IntegrationTests_1050 Test Reports

com.linkedin.venice.endToEnd.TestActiveActiveReplicationForIncPush ► testAAReplicationForIncrementalPushToRT[0](false)

Failed test found in:
  IntegrationTests_1050-artifacts/internal/venice-test-common/build/test-results/integrationTests_1050/TEST-com.linkedin.venice.endToEnd.TestActiveActiveReplicationForIncPush.xml
  internal/venice-test-common/build/test-results/integrationTests_1050/TEST-com.linkedin.venice.endToEnd.TestActiveActiveReplicationForIncPush.xml
Error:
  java.lang.AssertionError: Controller error: An error occurred during controller request. controller = http://localhost:36407, route = /new_store, params = [owner=owner, key_schema="string", cluster_name=venice-cluster0, hostname=localhost, store_name=store_8455ec13e0_ce2b3cb1, value_schema="string"], timeout = 600000. Exception type: class com.linkedin.venice.exceptions.VeniceHttpException. Detailed message: Http Status 500 - Failed to add version: -1 to store: venice_system_store_meta_store_store_8455ec13e0_ce2b3cb1 in cluster: venice-cluster0. Detailed stack trace: com.linkedin.venice.exceptions.VeniceException: Store: venice_system_store_meta_store_store_8455ec13e0_ce2b3cb1 is not initialized with a version yet
Raw output
java.lang.AssertionError: Controller error: An error occurred during controller request. controller = http://localhost:36407, route = /new_store, params = [owner=owner, key_schema="string", cluster_name=venice-cluster0, hostname=localhost, store_name=store_8455ec13e0_ce2b3cb1, value_schema="string"], timeout = 600000. Exception type: class com.linkedin.venice.exceptions.VeniceHttpException. Detailed message: Http Status 500 - Failed to add version: -1 to store: venice_system_store_meta_store_store_8455ec13e0_ce2b3cb1 in cluster: venice-cluster0. Detailed stack trace: com.linkedin.venice.exceptions.VeniceException: Store: venice_system_store_meta_store_store_8455ec13e0_ce2b3cb1 is not initialized with a version yet
	at com.linkedin.venice.controller.VeniceHelixAdmin.ensureRealTimeTopicIsReady(VeniceHelixAdmin.java:3176)
	at com.linkedin.venice.controller.VeniceHelixAdmin.getRealTimeTopic(VeniceHelixAdmin.java:3136)
	at com.linkedin.venice.controller.VeniceHelixAdmin.setUpMetaStoreAndMayProduceSnapshot(VeniceHelixAdmin.java:7968)
	at com.linkedin.venice.controller.VeniceHelixAdmin.addVersion(VeniceHelixAdmin.java:2641)
	at com.linkedin.venice.controller.VeniceHelixAdmin.addVersionAndTopicOnly(VeniceHelixAdmin.java:2188)
	at com.linkedin.venice.controller.VeniceParentHelixAdmin.addVersionAndTopicOnly(VeniceParentHelixAdmin.java:1604)
	at com.linkedin.venice.controller.VeniceParentHelixAdmin.incrementVersionIdempotent(VeniceParentHelixAdmin.java:1533)
	at com.linkedin.venice.controller.Admin.incrementVersionIdempotent(Admin.java:219)
	at com.linkedin.venice.controller.UserSystemStoreLifeCycleHelper.materializeSystemStore(UserSystemStoreLifeCycleHelper.java:91)
	at com.linkedin.venice.controller.UserSystemStoreLifeCycleHelper.materializeSystemStoresForUserStore(UserSystemStoreLifeCycleHelper.java:71)
	at com.linkedin.venice.controller.VeniceParentHelixAdmin.createStore(VeniceParentHelixAdmin.java:857)
	at com.linkedin.venice.controller.server.CreateStore$1.internalHandle(CreateStore.java:60)
	at com.linkedin.venice.controller.server.CreateStore$1.internalHandle(CreateStore.java:35)
	at com.linkedin.venice.controller.server.VeniceRouteHandler.handle(VeniceRouteHandler.java:34)
	at com.linkedin.venice.controller.server.VeniceParentControllerRegionStateHandler.handle(VeniceParentControllerRegionStateHandler.java:41)
	at spark.RouteImpl$1.handle(RouteImpl.java:72)
	at spark.http.matching.Routes.execute(Routes.java:61)
	at spark.http.matching.MatcherFilter.doFilter(MatcherFilter.java:134)
	at spark.embeddedserver.jetty.JettyHandler.doHandle(JettyHandler.java:50)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1598)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.server.Server.handle(Server.java:516)
	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
	at java.base/java.lang.Thread.run(Thread.java:840)
 expected [false] but found [true]
	at org.testng.Assert.fail(Assert.java:96)
	at org.testng.Assert.failNotEquals(Assert.java:776)
	at org.testng.Assert.assertFalse(Assert.java:65)
	at com.linkedin.venice.utils.TestUtils.assertCommand(TestUtils.java:594)
	at com.linkedin.venice.utils.TestUtils.assertCommand(TestUtils.java:590)
	at com.linkedin.venice.endToEnd.TestActiveActiveReplicationForIncPush.testAAReplicationForIncrementalPushToRT(TestActiveActiveReplicationForIncPush.java:168)

Check failure on line 3176 in services/venice-controller/src/main/java/com/linkedin/venice/controller/VeniceHelixAdmin.java

See this annotation in the file changed.

@github-actions github-actions / IntegrationTests_1050 Test Reports

com.linkedin.venice.endToEnd.TestActiveActiveReplicationForIncPush ► testAAReplicationForIncrementalPushToRT[2](true)

Failed test found in:
  IntegrationTests_1050-artifacts/internal/venice-test-common/build/test-results/integrationTests_1050/TEST-com.linkedin.venice.endToEnd.TestActiveActiveReplicationForIncPush.xml
  internal/venice-test-common/build/test-results/integrationTests_1050/TEST-com.linkedin.venice.endToEnd.TestActiveActiveReplicationForIncPush.xml
Error:
  java.lang.AssertionError: Controller error: An error occurred during controller request. controller = http://localhost:36407, route = /new_store, params = [owner=owner, key_schema="string", cluster_name=venice-cluster0, hostname=localhost, store_name=store_84a3002588_6c8b0c2, value_schema="string"], timeout = 600000. Exception type: class com.linkedin.venice.exceptions.VeniceHttpException. Detailed message: Http Status 500 - Failed to add version: -1 to store: venice_system_store_meta_store_store_84a3002588_6c8b0c2 in cluster: venice-cluster0. Detailed stack trace: com.linkedin.venice.exceptions.VeniceException: Store: venice_system_store_meta_store_store_84a3002588_6c8b0c2 is not initialized with a version yet
Raw output
java.lang.AssertionError: Controller error: An error occurred during controller request. controller = http://localhost:36407, route = /new_store, params = [owner=owner, key_schema="string", cluster_name=venice-cluster0, hostname=localhost, store_name=store_84a3002588_6c8b0c2, value_schema="string"], timeout = 600000. Exception type: class com.linkedin.venice.exceptions.VeniceHttpException. Detailed message: Http Status 500 - Failed to add version: -1 to store: venice_system_store_meta_store_store_84a3002588_6c8b0c2 in cluster: venice-cluster0. Detailed stack trace: com.linkedin.venice.exceptions.VeniceException: Store: venice_system_store_meta_store_store_84a3002588_6c8b0c2 is not initialized with a version yet
	at com.linkedin.venice.controller.VeniceHelixAdmin.ensureRealTimeTopicIsReady(VeniceHelixAdmin.java:3176)
	at com.linkedin.venice.controller.VeniceHelixAdmin.getRealTimeTopic(VeniceHelixAdmin.java:3136)
	at com.linkedin.venice.controller.VeniceHelixAdmin.setUpMetaStoreAndMayProduceSnapshot(VeniceHelixAdmin.java:7968)
	at com.linkedin.venice.controller.VeniceHelixAdmin.addVersion(VeniceHelixAdmin.java:2641)
	at com.linkedin.venice.controller.VeniceHelixAdmin.addVersionAndTopicOnly(VeniceHelixAdmin.java:2188)
	at com.linkedin.venice.controller.VeniceParentHelixAdmin.addVersionAndTopicOnly(VeniceParentHelixAdmin.java:1604)
	at com.linkedin.venice.controller.VeniceParentHelixAdmin.incrementVersionIdempotent(VeniceParentHelixAdmin.java:1533)
	at com.linkedin.venice.controller.Admin.incrementVersionIdempotent(Admin.java:219)
	at com.linkedin.venice.controller.UserSystemStoreLifeCycleHelper.materializeSystemStore(UserSystemStoreLifeCycleHelper.java:91)
	at com.linkedin.venice.controller.UserSystemStoreLifeCycleHelper.materializeSystemStoresForUserStore(UserSystemStoreLifeCycleHelper.java:71)
	at com.linkedin.venice.controller.VeniceParentHelixAdmin.createStore(VeniceParentHelixAdmin.java:857)
	at com.linkedin.venice.controller.server.CreateStore$1.internalHandle(CreateStore.java:60)
	at com.linkedin.venice.controller.server.CreateStore$1.internalHandle(CreateStore.java:35)
	at com.linkedin.venice.controller.server.VeniceRouteHandler.handle(VeniceRouteHandler.java:34)
	at com.linkedin.venice.controller.server.VeniceParentControllerRegionStateHandler.handle(VeniceParentControllerRegionStateHandler.java:41)
	at spark.RouteImpl$1.handle(RouteImpl.java:72)
	at spark.http.matching.Routes.execute(Routes.java:61)
	at spark.http.matching.MatcherFilter.doFilter(MatcherFilter.java:134)
	at spark.embeddedserver.jetty.JettyHandler.doHandle(JettyHandler.java:50)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1598)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.server.Server.handle(Server.java:516)
	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
	at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
	at java.base/java.lang.Thread.run(Thread.java:840)
 expected [false] but found [true]
	at org.testng.Assert.fail(Assert.java:96)
	at org.testng.Assert.failNotEquals(Assert.java:776)
	at org.testng.Assert.assertFalse(Assert.java:65)
	at com.linkedin.venice.utils.TestUtils.assertCommand(TestUtils.java:594)
	at com.linkedin.venice.utils.TestUtils.assertCommand(TestUtils.java:590)
	at com.linkedin.venice.endToEnd.TestActiveActiveReplicationForIncPush.testAAReplicationForIncrementalPushToRT(TestActiveActiveReplicationForIncPush.java:168)