[test] Generate test CI report for E2E tests in local fork (#1269) #362
GitHub Actions / IntegrationTests_1230 Test Reports
succeeded
Nov 5, 2024 in 0s
82 passed, 2 failed and 0 skipped
❌ IntegrationTests_1230-artifacts/internal/venice-test-common/build/test-results/integrationTests_1230/TEST-com.linkedin.venice.endToEnd.TestBatchForRocksDB.xml
41 tests were completed in 571s with 40 passed, 1 failed and 0 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| com.linkedin.venice.endToEnd.TestBatchForRocksDB | 40✅ | 1❌ | 571s |
❌ com.linkedin.venice.endToEnd.TestBatchForRocksDB
✅ testBatchFromETL
✅ testBatchFromETLForUnionWithNullSchema
✅ testBatchFromETLForUnionWithoutNullSchema
✅ testBatchFromETLWithNullDefaultValue
✅ testBatchJobSnapshots[0](false)
✅ testBatchJobSnapshots[2](true)
✅ testCompressingRecord[0](false, false)
✅ testCompressingRecord[2](true, false)
✅ testCompressingRecord[4](false, true)
✅ testCompressingRecord[6](true, true)
✅ testDataPushWithSchemaWithAWrongDefault
✅ testDuplicateKey
✅ testEarlyDeleteBackupStore
✅ testEmptyPush
✅ testIncrementalPush
✅ testIncrementalPushWithCompression[0](false, false)
✅ testIncrementalPushWithCompression[2](true, false)
✅ testIncrementalPushWithCompression[4](false, true)
✅ testIncrementalPushWithCompression[6](true, true)
❌ testIncrementalPushWritesToRealTimeTopicWithPolicy
java.lang.AssertionError: expected [test_name_51] but found [test_name_102]
✅ testKafkaInputAAStore
✅ testKafkaInputBatchJob
✅ testKafkaInputBatchJobSucceedsWhenSourceTopicIsEmpty
✅ testKafkaInputBatchJobWithLargeValues[0](false)
✅ testKafkaInputBatchJobWithLargeValues[2](true)
✅ testKafkaInputBatchJobWithZstdCompression[0](false)
✅ testKafkaInputBatchJobWithZstdCompression[2](true)
✅ testLargeValues
✅ testMetaStoreSchemaValidation
✅ testReducerCountValidation
✅ testRunJobWithSchemaThatContainsUnknownField
✅ testStoreWithNoVersionThrows400
✅ testStoreWithTooLargeValues[0](false)
✅ testStoreWithTooLargeValues[2](true)
✅ testZstdCompressingAvroRecordCanFailWhenNoFallbackAvailable
✅ testZstdCompressingAvroRecordWhenFallbackAvailable[0](false, false)
✅ testZstdCompressingAvroRecordWhenFallbackAvailable[2](true, false)
✅ testZstdCompressingAvroRecordWhenFallbackAvailable[4](false, true)
✅ testZstdCompressingAvroRecordWhenFallbackAvailable[6](true, true)
✅ testZstdCompressingAvroRecordWhenNoFallbackAvailableWithSleep
✅ testIncrementalPushWritesToRealTimeTopicWithPolicy
✅ IntegrationTests_1230-artifacts/internal/venice-test-common/build/test-results/integrationTests_1230/TEST-com.linkedin.venice.endToEnd.TestBatchReportIncrementalPush.xml
1 tests were completed in 48s with 1 passed, 0 failed and 0 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| com.linkedin.venice.endToEnd.TestBatchReportIncrementalPush | 1✅ | 48s |
✅ com.linkedin.venice.endToEnd.TestBatchReportIncrementalPush
✅ testBatchReportIncrementalPush
❌ internal/venice-test-common/build/test-results/integrationTests_1230/TEST-com.linkedin.venice.endToEnd.TestBatchForRocksDB.xml
41 tests were completed in 571s with 40 passed, 1 failed and 0 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| com.linkedin.venice.endToEnd.TestBatchForRocksDB | 40✅ | 1❌ | 571s |
❌ com.linkedin.venice.endToEnd.TestBatchForRocksDB
✅ testBatchFromETL
✅ testBatchFromETLForUnionWithNullSchema
✅ testBatchFromETLForUnionWithoutNullSchema
✅ testBatchFromETLWithNullDefaultValue
✅ testBatchJobSnapshots[0](false)
✅ testBatchJobSnapshots[2](true)
✅ testCompressingRecord[0](false, false)
✅ testCompressingRecord[2](true, false)
✅ testCompressingRecord[4](false, true)
✅ testCompressingRecord[6](true, true)
✅ testDataPushWithSchemaWithAWrongDefault
✅ testDuplicateKey
✅ testEarlyDeleteBackupStore
✅ testEmptyPush
✅ testIncrementalPush
✅ testIncrementalPushWithCompression[0](false, false)
✅ testIncrementalPushWithCompression[2](true, false)
✅ testIncrementalPushWithCompression[4](false, true)
✅ testIncrementalPushWithCompression[6](true, true)
❌ testIncrementalPushWritesToRealTimeTopicWithPolicy
java.lang.AssertionError: expected [test_name_51] but found [test_name_102]
✅ testKafkaInputAAStore
✅ testKafkaInputBatchJob
✅ testKafkaInputBatchJobSucceedsWhenSourceTopicIsEmpty
✅ testKafkaInputBatchJobWithLargeValues[0](false)
✅ testKafkaInputBatchJobWithLargeValues[2](true)
✅ testKafkaInputBatchJobWithZstdCompression[0](false)
✅ testKafkaInputBatchJobWithZstdCompression[2](true)
✅ testLargeValues
✅ testMetaStoreSchemaValidation
✅ testReducerCountValidation
✅ testRunJobWithSchemaThatContainsUnknownField
✅ testStoreWithNoVersionThrows400
✅ testStoreWithTooLargeValues[0](false)
✅ testStoreWithTooLargeValues[2](true)
✅ testZstdCompressingAvroRecordCanFailWhenNoFallbackAvailable
✅ testZstdCompressingAvroRecordWhenFallbackAvailable[0](false, false)
✅ testZstdCompressingAvroRecordWhenFallbackAvailable[2](true, false)
✅ testZstdCompressingAvroRecordWhenFallbackAvailable[4](false, true)
✅ testZstdCompressingAvroRecordWhenFallbackAvailable[6](true, true)
✅ testZstdCompressingAvroRecordWhenNoFallbackAvailableWithSleep
✅ testIncrementalPushWritesToRealTimeTopicWithPolicy
✅ internal/venice-test-common/build/test-results/integrationTests_1230/TEST-com.linkedin.venice.endToEnd.TestBatchReportIncrementalPush.xml
1 tests were completed in 48s with 1 passed, 0 failed and 0 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| com.linkedin.venice.endToEnd.TestBatchReportIncrementalPush | 1✅ | 48s |
✅ com.linkedin.venice.endToEnd.TestBatchReportIncrementalPush
✅ testBatchReportIncrementalPush
Annotations
github-actions / IntegrationTests_1230 Test Reports
com.linkedin.venice.endToEnd.TestBatchForRocksDB ► testIncrementalPushWritesToRealTimeTopicWithPolicy
Failed test found in:
IntegrationTests_1230-artifacts/internal/venice-test-common/build/test-results/integrationTests_1230/TEST-com.linkedin.venice.endToEnd.TestBatchForRocksDB.xml
internal/venice-test-common/build/test-results/integrationTests_1230/TEST-com.linkedin.venice.endToEnd.TestBatchForRocksDB.xml
Error:
java.lang.AssertionError: expected [test_name_51] but found [test_name_102]
Raw output
java.lang.AssertionError: expected [test_name_51] but found [test_name_102]
at org.testng.Assert.fail(Assert.java:96)
at org.testng.Assert.failNotEquals(Assert.java:776)
at org.testng.Assert.assertEqualsImpl(Assert.java:137)
at org.testng.Assert.assertEquals(Assert.java:118)
at org.testng.Assert.assertEquals(Assert.java:453)
at org.testng.Assert.assertEquals(Assert.java:463)
at com.linkedin.venice.endToEnd.TestBatch.lambda$testIncrementalPushWritesToRealTimeTopicWithPolicy$50(TestBatch.java:565)
at com.linkedin.venice.utils.TestUtils.waitForNonDeterministicAssertion(TestUtils.java:240)
at com.linkedin.venice.utils.TestUtils.waitForNonDeterministicAssertion(TestUtils.java:225)
at com.linkedin.venice.endToEnd.TestBatch.lambda$testIncrementalPushWritesToRealTimeTopicWithPolicy$51(TestBatch.java:563)
at com.linkedin.venice.endToEnd.TestBatch.testBatchStore(TestBatch.java:943)
at com.linkedin.venice.endToEnd.TestBatch.testBatchStore(TestBatch.java:881)
at com.linkedin.venice.endToEnd.TestBatch.testBatchStore(TestBatch.java:871)
at com.linkedin.venice.endToEnd.TestBatch.testIncrementalPushWritesToRealTimeTopicWithPolicy(TestBatch.java:559)
Loading