Skip to content

[test] Add test reporter in E2E CI workflow

Sourav Maji 0a3f0b0
Sign in for the full log view
GitHub Actions / IntegrationTests_1410 Test Reports succeeded Oct 30, 2024 in 0s

136 passed, 2 failed and 0 skipped

Tests failed

Report Passed Failed Skipped Time
IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest.xml 2✅ 91s
IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.migration.TestMigrationPushStrategyZKAccessor.xml 2✅ 343ms
IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServer.xml 37✅ 1❌ 434s
IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerAcl.xml 2✅ 1s
IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerGetLeader.xml 1✅ 397ms
IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerWithMultiServers.xml 9✅ 18s
IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkWithMocks.xml 14✅ 3s
IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestBackupControllerResponse.xml 1✅ 29s
internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest.xml 2✅ 91s
internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.migration.TestMigrationPushStrategyZKAccessor.xml 2✅ 343ms
internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServer.xml 37✅ 1❌ 434s
internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerAcl.xml 2✅ 1s
internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerGetLeader.xml 1✅ 397ms
internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerWithMultiServers.xml 9✅ 18s
internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkWithMocks.xml 14✅ 3s
internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestBackupControllerResponse.xml 1✅ 29s

✅ IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest.xml

2 tests were completed in 91s with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest 2✅ 91s

✅ com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest

✅ testParallelAdminExecutionTasks
✅ testSkipMessageEndToEnd

✅ IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.migration.TestMigrationPushStrategyZKAccessor.xml

2 tests were completed in 343ms with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.migration.TestMigrationPushStrategyZKAccessor 2✅ 343ms

✅ com.linkedin.venice.controller.migration.TestMigrationPushStrategyZKAccessor

✅ testCreateAndUpdatePushStrategy
✅ testSetInvalidStrategy

❌ IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServer.xml

38 tests were completed in 434s with 37 passed, 1 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestAdminSparkServer 37✅ 1❌ 434s

❌ com.linkedin.venice.controller.server.TestAdminSparkServer

✅ canCreateAHybridStore
✅ controllerCanGetDeletableStoreTopics
✅ controllerCanHandleLargePayload
✅ controllerClientCanCreateNewStore
✅ controllerClientCanDeleteAllVersion
✅ controllerClientCanDeleteOldVersion
✅ controllerClientCanDeleteStore
✅ controllerClientCanDisableStoresRead
✅ controllerClientCanDisableStoresReadWrite
✅ controllerClientCanDisableStoresWrite
✅ controllerClientCanDiscoverCluster
✅ controllerClientCanEnableMaxCapacityProtection
✅ controllerClientCanEnableThrottling
✅ controllerClientCanGetExecutionOfDeleteAllVersions
✅ controllerClientCanGetExecutionOfDeleteStore
✅ controllerClientCanGetLastSucceedExecutionId
✅ controllerClientCanGetStorageEngineOverheadRatio
❌ controllerClientCanGetStoreInfo
	java.lang.AssertionError: An error occurred during controller request. controller = http://localhost:38061, route = /store, params = [cluster_name=venice-cluster0, hostname=localhost, store_name=test-store_500b2dbc7d_85a83450], timeout = 600000. Exception type: class com.linkedin.venice.exceptions.VeniceHttpException. Detailed message: Http Status 404 - Store: test-store_500b2dbc7d_85a83450 does not exist. expected [false] but found [true]
✅ controllerClientCanListFutureStoreVersions
✅ controllerClientCanListStoresStatuses
✅ controllerClientCanQueryInstanceStatusInCluster
✅ controllerClientCanQueryNodesInCluster
✅ controllerClientCanQueryRemovability
✅ controllerClientCanQueryReplicasForTopic
✅ controllerClientCanQueryReplicasOnAStorageNode
✅ controllerClientCanSetStore
✅ controllerClientCanSetStoreMetadata
✅ controllerClientCanSetStoreMissingSomeFields
✅ controllerClientCanUpdateAllowList
✅ controllerClientGetKeySchema
✅ controllerClientManageValueSchema
✅ controllerClientProvidesErrorWhenRequestingTopicForStoreThatDoesNotExist
✅ controllerClientReturns404ForNonexistentStoreQuery
✅ controllerClientSchemaOperationsAgainstInvalidStore
✅ testAggregatedHealthStatusCall
✅ testCleanupInstanceCustomizedStates
✅ testDeleteKafkaTopic
✅ controllerClientCanGetStoreInfo

✅ IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerAcl.xml

2 tests were completed in 1s with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestAdminSparkServerAcl 2✅ 1s

✅ com.linkedin.venice.controller.server.TestAdminSparkServerAcl

✅ testAclRestApiException
✅ testAclRestApis

✅ IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerGetLeader.xml

1 tests were completed in 397ms with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestAdminSparkServerGetLeader 1✅ 397ms

✅ com.linkedin.venice.controller.server.TestAdminSparkServerGetLeader

✅ testGetLeaderController

✅ IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerWithMultiServers.xml

9 tests were completed in 18s with 9 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestAdminSparkServerWithMultiServers 9✅ 18s

✅ com.linkedin.venice.controller.server.TestAdminSparkServerWithMultiServers

✅ controllerClientCanRemoveNodeFromCluster
✅ controllerClientShouldCreateStoreWithParameters
✅ controllerClientShouldCreateStoreWithParametersAndNotDeleteItIfItExists
✅ controllerClientShouldListStores
✅ controllerClientShouldSendEmptyPushAndWait
✅ endOfPushEndpointTriggersVersionSwap
✅ requestTopicIsIdempotent
✅ requestTopicIsIdempotentWithConcurrency
✅ testListStoreWithConfigFilter

✅ IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkWithMocks.xml

14 tests were completed in 3s with 14 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestAdminSparkWithMocks 14✅ 3s

✅ com.linkedin.venice.controller.server.TestAdminSparkWithMocks

✅ testAAIncrementalPushRTSourceRegion[0](false, false)
✅ testAAIncrementalPushRTSourceRegion[1](true, false)
✅ testAAIncrementalPushRTSourceRegion[2](false, true)
✅ testAAIncrementalPushRTSourceRegion[3](true, true)
✅ testBannedRoutesAreRejected
✅ testGetRealTimeTopicUsesAdmin
✅ testSamzaReplicationPolicyMode[0](false, false, false)
✅ testSamzaReplicationPolicyMode[1](true, false, false)
✅ testSamzaReplicationPolicyMode[2](false, true, false)
✅ testSamzaReplicationPolicyMode[3](true, true, false)
✅ testSamzaReplicationPolicyMode[4](false, false, true)
✅ testSamzaReplicationPolicyMode[5](true, false, true)
✅ testSamzaReplicationPolicyMode[6](false, true, true)
✅ testSamzaReplicationPolicyMode[7](true, true, true)

✅ IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestBackupControllerResponse.xml

1 tests were completed in 29s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestBackupControllerResponse 1✅ 29s

✅ com.linkedin.venice.controller.server.TestBackupControllerResponse

✅ backupControllerThrows421

✅ internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest.xml

2 tests were completed in 91s with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest 2✅ 91s

✅ com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest

✅ testParallelAdminExecutionTasks
✅ testSkipMessageEndToEnd

✅ internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.migration.TestMigrationPushStrategyZKAccessor.xml

2 tests were completed in 343ms with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.migration.TestMigrationPushStrategyZKAccessor 2✅ 343ms

✅ com.linkedin.venice.controller.migration.TestMigrationPushStrategyZKAccessor

✅ testCreateAndUpdatePushStrategy
✅ testSetInvalidStrategy

❌ internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServer.xml

38 tests were completed in 434s with 37 passed, 1 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestAdminSparkServer 37✅ 1❌ 434s

❌ com.linkedin.venice.controller.server.TestAdminSparkServer

✅ canCreateAHybridStore
✅ controllerCanGetDeletableStoreTopics
✅ controllerCanHandleLargePayload
✅ controllerClientCanCreateNewStore
✅ controllerClientCanDeleteAllVersion
✅ controllerClientCanDeleteOldVersion
✅ controllerClientCanDeleteStore
✅ controllerClientCanDisableStoresRead
✅ controllerClientCanDisableStoresReadWrite
✅ controllerClientCanDisableStoresWrite
✅ controllerClientCanDiscoverCluster
✅ controllerClientCanEnableMaxCapacityProtection
✅ controllerClientCanEnableThrottling
✅ controllerClientCanGetExecutionOfDeleteAllVersions
✅ controllerClientCanGetExecutionOfDeleteStore
✅ controllerClientCanGetLastSucceedExecutionId
✅ controllerClientCanGetStorageEngineOverheadRatio
❌ controllerClientCanGetStoreInfo
	java.lang.AssertionError: An error occurred during controller request. controller = http://localhost:38061, route = /store, params = [cluster_name=venice-cluster0, hostname=localhost, store_name=test-store_500b2dbc7d_85a83450], timeout = 600000. Exception type: class com.linkedin.venice.exceptions.VeniceHttpException. Detailed message: Http Status 404 - Store: test-store_500b2dbc7d_85a83450 does not exist. expected [false] but found [true]
✅ controllerClientCanListFutureStoreVersions
✅ controllerClientCanListStoresStatuses
✅ controllerClientCanQueryInstanceStatusInCluster
✅ controllerClientCanQueryNodesInCluster
✅ controllerClientCanQueryRemovability
✅ controllerClientCanQueryReplicasForTopic
✅ controllerClientCanQueryReplicasOnAStorageNode
✅ controllerClientCanSetStore
✅ controllerClientCanSetStoreMetadata
✅ controllerClientCanSetStoreMissingSomeFields
✅ controllerClientCanUpdateAllowList
✅ controllerClientGetKeySchema
✅ controllerClientManageValueSchema
✅ controllerClientProvidesErrorWhenRequestingTopicForStoreThatDoesNotExist
✅ controllerClientReturns404ForNonexistentStoreQuery
✅ controllerClientSchemaOperationsAgainstInvalidStore
✅ testAggregatedHealthStatusCall
✅ testCleanupInstanceCustomizedStates
✅ testDeleteKafkaTopic
✅ controllerClientCanGetStoreInfo

✅ internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerAcl.xml

2 tests were completed in 1s with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestAdminSparkServerAcl 2✅ 1s

✅ com.linkedin.venice.controller.server.TestAdminSparkServerAcl

✅ testAclRestApiException
✅ testAclRestApis

✅ internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerGetLeader.xml

1 tests were completed in 397ms with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestAdminSparkServerGetLeader 1✅ 397ms

✅ com.linkedin.venice.controller.server.TestAdminSparkServerGetLeader

✅ testGetLeaderController

✅ internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerWithMultiServers.xml

9 tests were completed in 18s with 9 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestAdminSparkServerWithMultiServers 9✅ 18s

✅ com.linkedin.venice.controller.server.TestAdminSparkServerWithMultiServers

✅ controllerClientCanRemoveNodeFromCluster
✅ controllerClientShouldCreateStoreWithParameters
✅ controllerClientShouldCreateStoreWithParametersAndNotDeleteItIfItExists
✅ controllerClientShouldListStores
✅ controllerClientShouldSendEmptyPushAndWait
✅ endOfPushEndpointTriggersVersionSwap
✅ requestTopicIsIdempotent
✅ requestTopicIsIdempotentWithConcurrency
✅ testListStoreWithConfigFilter

✅ internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkWithMocks.xml

14 tests were completed in 3s with 14 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestAdminSparkWithMocks 14✅ 3s

✅ com.linkedin.venice.controller.server.TestAdminSparkWithMocks

✅ testAAIncrementalPushRTSourceRegion[0](false, false)
✅ testAAIncrementalPushRTSourceRegion[1](true, false)
✅ testAAIncrementalPushRTSourceRegion[2](false, true)
✅ testAAIncrementalPushRTSourceRegion[3](true, true)
✅ testBannedRoutesAreRejected
✅ testGetRealTimeTopicUsesAdmin
✅ testSamzaReplicationPolicyMode[0](false, false, false)
✅ testSamzaReplicationPolicyMode[1](true, false, false)
✅ testSamzaReplicationPolicyMode[2](false, true, false)
✅ testSamzaReplicationPolicyMode[3](true, true, false)
✅ testSamzaReplicationPolicyMode[4](false, false, true)
✅ testSamzaReplicationPolicyMode[5](true, false, true)
✅ testSamzaReplicationPolicyMode[6](false, true, true)
✅ testSamzaReplicationPolicyMode[7](true, true, true)

✅ internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestBackupControllerResponse.xml

1 tests were completed in 29s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestBackupControllerResponse 1✅ 29s

✅ com.linkedin.venice.controller.server.TestBackupControllerResponse

✅ backupControllerThrows421

Annotations

Check failure on line 424 in internal/venice-test-common/src/integrationTest/java/com/linkedin/venice/controller/server/TestAdminSparkServer.java

See this annotation in the file changed.

@github-actions github-actions / IntegrationTests_1410 Test Reports

com.linkedin.venice.controller.server.TestAdminSparkServer ► controllerClientCanGetStoreInfo

Failed test found in:
  IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServer.xml
  internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServer.xml
Error:
  java.lang.AssertionError: An error occurred during controller request. controller = http://localhost:38061, route = /store, params = [cluster_name=venice-cluster0, hostname=localhost, store_name=test-store_500b2dbc7d_85a83450], timeout = 600000. Exception type: class com.linkedin.venice.exceptions.VeniceHttpException. Detailed message: Http Status 404 - Store: test-store_500b2dbc7d_85a83450 does not exist. expected [false] but found [true]
Raw output
java.lang.AssertionError: An error occurred during controller request. controller = http://localhost:38061, route = /store, params = [cluster_name=venice-cluster0, hostname=localhost, store_name=test-store_500b2dbc7d_85a83450], timeout = 600000. Exception type: class com.linkedin.venice.exceptions.VeniceHttpException. Detailed message: Http Status 404 - Store: test-store_500b2dbc7d_85a83450 does not exist. expected [false] but found [true]
	at org.testng.Assert.fail(Assert.java:96)
	at org.testng.Assert.failNotEquals(Assert.java:776)
	at org.testng.Assert.assertFalse(Assert.java:65)
	at com.linkedin.venice.controller.server.TestAdminSparkServer.controllerClientCanGetStoreInfo(TestAdminSparkServer.java:424)