Swtich to list from walk as it seems more stble for S3. #88
104 passed, 5 failed and 60 skipped
✅ drivers/build/test-results/integrationTest/TEST-org.gorpipe.googlecloudstorage.driver.ITestGSSource.xml
19 tests were completed in 20ms with 0 passed, 0 failed and 19 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.gorpipe.googlecloudstorage.driver.ITestGSSource | 19⚪ | 20ms |
✅ org.gorpipe.googlecloudstorage.driver.ITestGSSource
⚪ testGetTimestamp
⚪ testDriver
⚪ testMoreSizes
⚪ testFullStream
⚪ testMetadataOnEmpty
⚪ testRangeStream
⚪ testNor
⚪ testRandomSeeks
⚪ testNorz
⚪ testGetDataType
⚪ testGetNamedUrl
⚪ testPartialStream
⚪ testBackwardSeeks
⚪ testGetName
⚪ testGetSourceMetadata
⚪ testGetSourceType
⚪ testContinousSeeks
⚪ testExists
⚪ testGetAttributes
✅ drivers/build/test-results/integrationTest/TEST-org.gorpipe.gorsat.UIntegrationTestGorpipe.xml
2 tests were completed in 3ms with 0 passed, 0 failed and 2 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.gorpipe.gorsat.UIntegrationTestGorpipe | 2⚪ | 3ms |
✅ org.gorpipe.gorsat.UIntegrationTestGorpipe
⚪ testFileClosingOnParseError
⚪ testLargeVcfGzFileGenomeGroupCount
✅ drivers/build/test-results/integrationTest/TEST-org.gorpipe.oci.driver.ITestOCIBvlTestSuite.xml
6 tests were completed in 12s with 6 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.gorpipe.oci.driver.ITestOCIBvlTestSuite | 6✅ | 12s |
✅ org.gorpipe.oci.driver.ITestOCIBvlTestSuite
✅ testUnknownSourceProvidesFileInfo
✅ testBam
✅ testGor
✅ testVcf
✅ testVcfGz
✅ testGorz
✅ drivers/build/test-results/integrationTest/TEST-org.gorpipe.oci.driver.ITestOCICommonFilesTests.xml
4 tests were completed in 0ms with 0 passed, 0 failed and 4 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.gorpipe.oci.driver.ITestOCICommonFilesTests | 4⚪ | 0ms |
✅ org.gorpipe.oci.driver.ITestOCICommonFilesTests
⚪ testCreateDeleteListEmtpyDirectory
⚪ testList
⚪ testIsDirectory
⚪ testExists
✅ drivers/build/test-results/integrationTest/TEST-org.gorpipe.oci.driver.ITestOCICommonStreamTests.xml
26 tests were completed in 6s with 21 passed, 0 failed and 5 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.gorpipe.oci.driver.ITestOCICommonStreamTests | 21✅ | 5⚪ | 6s |
✅ org.gorpipe.oci.driver.ITestOCICommonStreamTests
✅ testOCIWrite
⚪ testOCIWriteLargeFile
⚪ testOCIWritePgorGord
⚪ testOCIMetaWithMetafile
⚪ testOCIMeta
✅ testOCIWriteServerMode
⚪ testOCIWriteMoreThanMaxChunks
✅ testMoreSizes
✅ testFullStream
✅ testMetadataOnEmpty
✅ testRangeStream
✅ testNor
✅ testRandomSeeks
✅ testNorz
✅ testGetDataType
✅ testGetNamedUrl
✅ testPartialStream
✅ testBackwardSeeks
✅ testGetName
✅ testGetSourceMetadata
✅ testGetSourceType
✅ testContinousSeeks
✅ testGetTimestamp
✅ testDriver
✅ testExists
✅ testGetAttributes
✅ drivers/build/test-results/integrationTest/TEST-org.gorpipe.oci.driver.ITestOCISource.xml
2 tests were completed in 102ms with 2 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.gorpipe.oci.driver.ITestOCISource | 2✅ | 102ms |
✅ org.gorpipe.oci.driver.ITestOCISource
✅ testWithoutContext
✅ testOCIWriteServerMode
✅ drivers/build/test-results/integrationTest/TEST-org.gorpipe.s3.driver.ITestBvlMinOnS3.xml
12 tests were completed in 8s with 8 passed, 0 failed and 4 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.gorpipe.s3.driver.ITestBvlMinOnS3 | 8✅ | 4⚪ | 8s |
✅ org.gorpipe.s3.driver.ITestBvlMinOnS3
⚪ testWithoutContext
✅ testWithDefaultCredentials
⚪ testWithProviderCredentialsAndEndpoint
⚪ testWithProviderCredentialsAndBadEndpoint
⚪ testWithKeysInProperties
✅ testWithTemporaryCredentials
✅ testUnknownSourceProvidesFileInfo
✅ testBam
✅ testGor
✅ testVcf
✅ testVcfGz
✅ testGorz
❌ drivers/build/test-results/integrationTest/TEST-org.gorpipe.s3.driver.ITestFilesS3Source.xml
4 tests were completed in 4s with 3 passed, 1 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.gorpipe.s3.driver.ITestFilesS3Source | 3✅ | 1❌ | 4s |
❌ org.gorpipe.s3.driver.ITestFilesS3Source
❌ testCreateDeleteListEmtpyDirectory
java.lang.AssertionError
✅ testList
✅ testIsDirectory
✅ testExists
❌ drivers/build/test-results/integrationTest/TEST-org.gorpipe.s3.driver.ITestS3Source.xml
28 tests were completed in 30s with 24 passed, 1 failed and 3 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.gorpipe.s3.driver.ITestS3Source | 24✅ | 1❌ | 3⚪ | 30s |
❌ org.gorpipe.s3.driver.ITestS3Source
✅ testS3MetaWithMetafile
❌ testS3WritePgorGord
org.gorpipe.exceptions.GorResourceException: Dictionary file '/tmp/c82c75pf9jo3ce14p1hi8olj552.gord.link' was not found
⚪ testS3WriteLargeFile
✅ testS3NotAllBytesEx
✅ testS3WriteServerMode
✅ testS3Write
⚪ testS3SecurityContext
⚪ testS3WriteMoreThanMaxChunks
✅ testS3Meta
✅ testMoreSizes
✅ testFullStream
✅ testMetadataOnEmpty
✅ testRangeStream
✅ testNor
✅ testRandomSeeks
✅ testNorz
✅ testGetDataType
✅ testGetNamedUrl
✅ testPartialStream
✅ testBackwardSeeks
✅ testGetName
✅ testGetSourceMetadata
✅ testGetSourceType
✅ testContinousSeeks
✅ testGetTimestamp
✅ testDriver
✅ testExists
✅ testGetAttributes
✅ drivers/build/test-results/integrationTest/TEST-org.gorpipe.s3.driver.UTestS3SeekableFile.xml
5 tests were completed in 5s with 4 passed, 0 failed and 1 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.gorpipe.s3.driver.UTestS3SeekableFile | 4✅ | 1⚪ | 5s |
✅ org.gorpipe.s3.driver.UTestS3SeekableFile
⚪ testFilePositionCache
✅ testBasicGorz
✅ testBasicBam
✅ testBasicGor
✅ testBasicSeekStream
✅ drivers/build/test-results/integrationTest/TEST-org.gorpipe.s3.shared.ITestS3Shared.xml
28 tests were completed in 20s with 22 passed, 0 failed and 6 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.gorpipe.s3.shared.ITestS3Shared | 22✅ | 6⚪ | 20s |
✅ org.gorpipe.s3.shared.ITestS3Shared
✅ testProjectWriteUserDataServer
⚪ testProjectWriteUserDataServerPgorGord
✅ testProjectSharedFileRead
✅ testProjectWriteUserDataCLI
✅ testGlobalSharedFileRead
✅ testProjectRead
✅ testProjectFileRead
⚪ testReadServer
✅ testRegionSharedRead
⚪ testReadingExistingS3GordFolderWithDirectLinkToGord
✅ testWriteExplicitWrite
⚪ testReadingExistingS3GordFolderWithDirectLinkToFolder
✅ testProjecSharedProjecttWriteUserDataServer
✅ testFallBackThrough
✅ testProjectReadUserData
✅ testRegionSharedFileRead
⚪ testProjectWriteUserDataServerPgorGordSlash
✅ testReadWithUnaccessableLinkFile
⚪ testFallBackThroughWithException
✅ testProjectSharedRead
✅ testFallBackProjectToSharedProject
✅ testReadWithLinkFile
✅ testProjectWriteRootServer
✅ testProjectWriteRootCLI
✅ testProjectWriteUserDataWithIndexServer
✅ testSharedWriteUserDataServer
✅ testGlobalSharedRead
✅ testSharedWriteRootServer
❌ drivers/build/test-results/integrationTest/TEST-org.gorpipe.s3.table.ITestS3Table.xml
8 tests were completed in 5s with 2 passed, 3 failed and 3 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.gorpipe.s3.table.ITestS3Table | 2✅ | 3❌ | 3⚪ | 5s |
❌ org.gorpipe.s3.table.ITestS3Table
❌ testBucketizeLocalTableS3DataS3DataBuckets
org.gorpipe.exceptions.GorResourceException: Amazon SDK client exception
❌ testBucketizeLocalTableS3DataS3DataBucketsRelative
org.gorpipe.exceptions.GorSystemException: Bucket dirs must exists, directory s3data://project/.dict/b is not found!
✅ testInsertLocalTableS3DataBasic
⚪ testBucketizeS3TableFolderS3DataS3BucketUsingLink
✅ testBucketizeLocalTableS3DataLocalBuckets
⚪ testBucketizeS3TableS3DataS3Buckets
⚪ testBucketizeS3TableFolderS3DataS3Bucket
❌ testBucketizeLocalTableS3DataS3Buckets
org.gorpipe.exceptions.GorResourceException: Amazon SDK client exception
✅ gorscripts/build/test-results/integrationTest/TEST-org.gorpipe.gor.manager.ITestTableManager.xml
4 tests were completed in 16s with 2 passed, 0 failed and 2 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.gorpipe.gor.manager.ITestTableManager | 2✅ | 2⚪ | 16s |
✅ org.gorpipe.gor.manager.ITestTableManager
⚪ testManS3DictionaryBucketize
✅ testS3DictionaryReadLocalLink
⚪ testManCreateS3Dictionary
✅ testS3DictionaryRead
✅ gorscripts/build/test-results/integrationTest/TEST-org.gorpipe.gor.manager.UTestTableManagerCLI.xml
7 tests were completed in 64s with 7 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.gorpipe.gor.manager.UTestTableManagerCLI | 7✅ | 64s |
✅ org.gorpipe.gor.manager.UTestTableManagerCLI
✅ testLockTimeoutOptionPassing
✅ testFlagTagskeyValueCLI
✅ testBasicCLI
✅ testDirectCLI
✅ testErrorHandlingCLI
✅ testFlagTagskeyListCLI
✅ testMultiInsertCLI
✅ model/build/test-results/integrationTest/TEST-org.gorpipe.gor.driver.providers.mdr.UTestMDR.xml
7 tests were completed in 35ms with 0 passed, 0 failed and 7 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.gorpipe.gor.driver.providers.mdr.UTestMDR | 7⚪ | 35ms |
✅ org.gorpipe.gor.driver.providers.mdr.UTestMDR
⚪ testNonExistingDocumentId
⚪ test1000EntryDictionary
⚪ testReadDocument
⚪ testDictionaryWithInvalidEntry
⚪ testReadDocuments
⚪ testReadDocumentWithNor
⚪ testReadDocumentThroughLinkFile
✅ model/build/test-results/integrationTest/TEST-org.gorpipe.gor.table.lock.UTestTableLock.xml
7 tests were completed in 39s with 3 passed, 0 failed and 4 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.gorpipe.gor.table.lock.UTestTableLock | 3✅ | 4⚪ | 39s |
✅ org.gorpipe.gor.table.lock.UTestTableLock
✅ testMultiProcessUpdateExclusiveFileTableLock
✅ testThreadExclusiveFileTableLock
⚪ testProcessExclusiveFileTableLock
⚪ testProcessNoTableLock
⚪ testCleanUpExclusiveFileTableLock
✅ testRenewExclusiveFileTableLock
⚪ testThreadNoTableLock
Annotations
github-actions / Junit Tests - integrationTest
org.gorpipe.s3.driver.ITestFilesS3Source ► testCreateDeleteListEmtpyDirectory
Failed test found in:
drivers/build/test-results/integrationTest/TEST-org.gorpipe.s3.driver.ITestFilesS3Source.xml
Error:
java.lang.AssertionError
Raw output
java.lang.AssertionError
at org.junit.Assert.fail(Assert.java:87)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.junit.Assert.assertFalse(Assert.java:65)
at org.junit.Assert.assertFalse(Assert.java:75)
at org.gorpipe.gor.driver.providers.stream.sources.CommonFilesTests.testCreateDeleteListEmtpyDirectory(CommonFilesTests.java:87)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at org.junit.contrib.java.lang.system.internal.LogPrintStream$1$1.evaluate(LogPrintStream.java:30)
at org.junit.contrib.java.lang.system.internal.PrintStreamHandler$3.evaluate(PrintStreamHandler.java:48)
at org.junit.contrib.java.lang.system.internal.LogPrintStream$1.evaluate(LogPrintStream.java:26)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.runTestClass(JUnitTestClassExecutor.java:112)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:58)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:40)
at org.gradle.api.internal.tasks.testing.junit.AbstractJUnitTestClassProcessor.processTestClass(AbstractJUnitTestClassProcessor.java:54)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:53)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)
at org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:92)
at jdk.proxy2/jdk.proxy2.$Proxy6.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker$2.run(TestWorker.java:183)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.executeAndMaintainThreadName(TestWorker.java:132)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:103)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:63)
at org.gradle.process.internal.worker.child.ActionExecutionWorker.execute(ActionExecutionWorker.java:56)
at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:121)
at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:71)
at worker.org.gradle.process.internal.worker.GradleWorkerMain.run(GradleWorkerMain.java:69)
at worker.org.gradle.process.internal.worker.GradleWorkerMain.main(GradleWorkerMain.java:74)
Check failure on line 746 in model/src/main/java/org/gorpipe/gor/model/GorOptions.java
github-actions / Junit Tests - integrationTest
org.gorpipe.s3.driver.ITestS3Source ► testS3WritePgorGord
Failed test found in:
drivers/build/test-results/integrationTest/TEST-org.gorpipe.s3.driver.ITestS3Source.xml
Error:
org.gorpipe.exceptions.GorResourceException: Dictionary file '/tmp/c82c75pf9jo3ce14p1hi8olj552.gord.link' was not found
Raw output
org.gorpipe.exceptions.GorResourceException: Dictionary file '/tmp/c82c75pf9jo3ce14p1hi8olj552.gord.link' was not found
URI: /tmp/c82c75pf9jo3ce14p1hi8olj552.gord.link
Request ID: cf87ddf4-73e1-4d59-bde6-1b46509652fe
Cause: /tmp/c82c75pf9jo3ce14p1hi8olj552.gord.link
Query:
pgor -split 2 ../tests/data/gor/genes.gor | top 2 | write s3://gdb-unit-test-data/s3write/9d3737d7-a02a-4df3-a21a-3d8766c64db0-genes.gord
Command Step: GOR /tmp/c82c75pf9jo3ce14p1hi8olj552.gord.link
Command Name: GOR
Command Index: 1
Extra info: Hostname=fv-az985-866
at app//org.gorpipe.gor.model.GorOptions.addSourceRef(GorOptions.java:746)
at app//org.gorpipe.gor.model.GorOptions.addSourceRef(GorOptions.java:719)
at app//org.gorpipe.gor.model.GorOptions.createStandardSources(GorOptions.java:589)
at app//org.gorpipe.gor.model.GorOptions.resolveSources(GorOptions.java:578)
at app//org.gorpipe.gor.model.GorOptions.<init>(GorOptions.java:382)
at app//org.gorpipe.gor.model.GorOptions.createGorOptions(GorOptions.java:298)
at app//gorsat.Iterators.FastGorSource.openSource(FastGorSource.scala:76)
at app//org.gorpipe.model.gor.iterators.TimedRowSource.openSource(TimedRowSource.scala:81)
at app//org.gorpipe.model.gor.iterators.TimedRowSource.openSource(TimedRowSource.scala:83)
at app//gorsat.Iterators.FastGorSource.getHeader(FastGorSource.scala:109)
at app//gorsat.Iterators.SingleRowIteratorSource.getHeader(SingleRowIteratorSource.scala:76)
at app//gorsat.process.PipeInstance.checkHeader(PipeInstance.scala:479)
at app//gorsat.process.PipeInstance.$anonfun$preparePipeStep$1(PipeInstance.scala:334)
at app//gorsat.process.PipeInstance.$anonfun$preparePipeStep$1$adapted(PipeInstance.scala:310)
at app//scala.collection.immutable.Range.foreach(Range.scala:190)
at app//gorsat.process.PipeInstance.preparePipeStep(PipeInstance.scala:310)
at app//gorsat.process.PipeInstance.init(PipeInstance.scala:290)
at app//gorsat.process.PipeInstance.processArguments(PipeInstance.scala:215)
at app//gorsat.process.PipeInstance.scalaInit(PipeInstance.scala:172)
at app//gorsat.process.PipeInstance.init(PipeInstance.scala:143)
at app//gorsat.TestUtils.runGorPipeWithOptions(TestUtils.java:273)
at app//gorsat.TestUtils.runGorPipeWithOptions(TestUtils.java:267)
at app//gorsat.TestUtils.runGorPipeWithOptions(TestUtils.java:263)
at app//gorsat.TestUtils.runGorPipe(TestUtils.java:85)
at app//org.gorpipe.s3.driver.ITestS3Source.testS3WritePgorGord(ITestS3Source.java:160)
at [email protected]/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at [email protected]/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at [email protected]/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at [email protected]/java.lang.reflect.Method.invoke(Method.java:569)
at app//org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at app//org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at app//org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at app//org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at app//org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at app//org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at app//org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at app//org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at app//org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at app//org.junit.contrib.java.lang.system.internal.LogPrintStream$1$1.evaluate(LogPrintStream.java:30)
at app//org.junit.contrib.java.lang.system.internal.PrintStreamHandler$3.evaluate(PrintStreamHandler.java:48)
at app//org.junit.contrib.java.lang.system.internal.LogPrintStream$1.evaluate(LogPrintStream.java:26)
at app//org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at app//org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at app//org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
at app//org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at app//org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at app//org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at app//org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at app//org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at app//org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at app//org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at app//org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at app//org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at app//org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.runTestClass(JUnitTestClassExecutor.java:112)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:58)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:40)
at org.gradle.api.internal.tasks.testing.junit.AbstractJUnitTestClassProcessor.processTestClass(AbstractJUnitTestClassProcessor.java:54)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:53)
at [email protected]/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at [email protected]/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at [email protected]/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at [email protected]/java.lang.reflect.Method.invoke(Method.java:569)
at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)
at org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:92)
at jdk.proxy2/jdk.proxy2.$Proxy6.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker$2.run(TestWorker.java:183)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.executeAndMaintainThreadName(TestWorker.java:132)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:103)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:63)
at org.gradle.process.internal.worker.child.ActionExecutionWorker.execute(ActionExecutionWorker.java:56)
at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:121)
at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:71)
at app//worker.org.gradle.process.internal.worker.GradleWorkerMain.run(GradleWorkerMain.java:69)
at app//worker.org.gradle.process.internal.worker.GradleWorkerMain.main(GradleWorkerMain.java:74)
Caused by: java.nio.file.NoSuchFileException: /tmp/c82c75pf9jo3ce14p1hi8olj552.gord.link
at org.gorpipe.gor.table.TableCache.getTable(TableCache.java:47)
at org.gorpipe.gor.table.TableCache.getTable(TableCache.java:40)
at org.gorpipe.gor.model.GorOptions.processDictionary(GorOptions.java:797)
at org.gorpipe.gor.model.GorOptions.addSourceRef(GorOptions.java:743)
... 76 more
Check failure on line 45 in drivers/src/main/java/org/gorpipe/s3/driver/S3RetryHandler.java
github-actions / Junit Tests - integrationTest
org.gorpipe.s3.table.ITestS3Table ► testBucketizeLocalTableS3DataS3DataBuckets
Failed test found in:
drivers/build/test-results/integrationTest/TEST-org.gorpipe.s3.table.ITestS3Table.xml
Error:
org.gorpipe.exceptions.GorResourceException: Amazon SDK client exception
Raw output
org.gorpipe.exceptions.GorResourceException: Amazon SDK client exception
URI: s3://gdb-unit-test-data/projects/some_project/user_data/buckets/
Cause: List failed for s3://gdb-unit-test-data/projects/some_project/user_data/buckets/, region: eu-west-1, access key: AKIA4IY3JGTGNS2PE2KA, secret key: Has secret
URI: s3://gdb-unit-test-data/projects/some_project/user_data/buckets/
Unable to load credentials from system settings. Access key must be specified either via environment variable (AWS_ACCESS_KEY_ID) or system property (aws.accessKeyId).
at app//org.gorpipe.s3.driver.S3RetryHandler.checkIfShouldRetryException(S3RetryHandler.java:45)
at app//org.gorpipe.gor.driver.utils.RetryHandlerWithFixedWait.perform(RetryHandlerWithFixedWait.java:38)
at app//org.gorpipe.gor.driver.providers.stream.sources.wrappers.RetryStreamSourceWrapper.list(RetryStreamSourceWrapper.java:141)
at app//org.gorpipe.gor.driver.providers.stream.sources.wrappers.WrappedDataSource.list(WrappedDataSource.java:129)
at app//org.gorpipe.gor.model.DriverBackedFileReader.list(DriverBackedFileReader.java:248)
at app//org.gorpipe.gor.manager.BucketManager.collectBucketsToClean(BucketManager.java:687)
at app//org.gorpipe.gor.manager.BucketManager.cleanOldBucketFiles(BucketManager.java:663)
at app//org.gorpipe.gor.manager.BucketManager.bucketize(BucketManager.java:182)
at app//org.gorpipe.gor.manager.TableManager.bucketize(TableManager.java:304)
at app//org.gorpipe.s3.table.ITestS3Table.testBucketizeLocalTableS3DataS3DataBuckets(ITestS3Table.java:176)
at [email protected]/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at [email protected]/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at [email protected]/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at [email protected]/java.lang.reflect.Method.invoke(Method.java:569)
at app//org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at app//org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at app//org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at app//org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at app//org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at app//org.junit.contrib.java.lang.system.EnvironmentVariables$EnvironmentVariablesStatement.evaluate(EnvironmentVariables.java:122)
at app//org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at app//org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at app//org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at app//org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at app//org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
at app//org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at app//org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at app//org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at app//org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at app//org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at app//org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at app//org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at app//org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at app//org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at app//org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.runTestClass(JUnitTestClassExecutor.java:112)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:58)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:40)
at org.gradle.api.internal.tasks.testing.junit.AbstractJUnitTestClassProcessor.processTestClass(AbstractJUnitTestClassProcessor.java:54)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:53)
at jdk.internal.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
at [email protected]/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at [email protected]/java.lang.reflect.Method.invoke(Method.java:569)
at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)
at org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:92)
at jdk.proxy2/jdk.proxy2.$Proxy6.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker$2.run(TestWorker.java:183)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.executeAndMaintainThreadName(TestWorker.java:132)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:103)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:63)
at org.gradle.process.internal.worker.child.ActionExecutionWorker.execute(ActionExecutionWorker.java:56)
at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:121)
at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:71)
at app//worker.org.gradle.process.internal.worker.GradleWorkerMain.run(GradleWorkerMain.java:69)
at app//worker.org.gradle.process.internal.worker.GradleWorkerMain.main(GradleWorkerMain.java:74)
Caused by: org.gorpipe.exceptions.GorResourceException: List failed for s3://gdb-unit-test-data/projects/some_project/user_data/buckets/, region: eu-west-1, access key: AKIA4IY3JGTGNS2PE2KA, secret key: Has secret
URI: s3://gdb-unit-test-data/projects/some_project/user_data/buckets/
Cause: Unable to load credentials from system settings. Access key must be specified either via environment variable (AWS_ACCESS_KEY_ID) or system property (aws.accessKeyId).
at app//org.gorpipe.s3.driver.S3Source.list(S3Source.java:355)
at app//org.gorpipe.gor.driver.providers.stream.sources.wrappers.WrappedDataSource.list(WrappedDataSource.java:129)
at app//org.gorpipe.gor.driver.providers.stream.sources.wrappers.RetryStreamSourceWrapper.lambda$list$14(RetryStreamSourceWrapper.java:141)
at app//org.gorpipe.gor.driver.utils.RetryHandlerWithFixedWait.perform(RetryHandlerWithFixedWait.java:33)
... 55 more
Caused by: software.amazon.awssdk.core.exception.SdkClientException: Unable to load credentials from system settings. Access key must be specified either via environment variable (AWS_ACCESS_KEY_ID) or system property (aws.accessKeyId).
at app//software.amazon.awssdk.core.exception.SdkClientException$BuilderImpl.build(SdkClientException.java:111)
at app//software.amazon.awssdk.auth.credentials.internal.SystemSettingsCredentialsProvider.resolveCredentials(SystemSettingsCredentialsProvider.java:60)
at app//software.amazon.awssdk.auth.credentials.AwsCredentialsProvider.resolveIdentity(AwsCredentialsProvider.java:54)
at app//software.amazon.awssdk.identity.spi.IdentityProvider.resolveIdentity(IdentityProvider.java:60)
at app//software.amazon.awssdk.auth.credentials.AwsCredentialsProviderChain.resolveCredentials(AwsCredentialsProviderChain.java:103)
at app//software.amazon.awssdk.auth.credentials.internal.LazyAwsCredentialsProvider.resolveCredentials(LazyAwsCredentialsProvider.java:45)
at app//software.amazon.awssdk.auth.credentials.DefaultCredentialsProvider.resolveCredentials(DefaultCredentialsProvider.java:129)
at app//software.amazon.awssdk.auth.credentials.AwsCredentialsProvider.resolveIdentity(AwsCredentialsProvider.java:54)
at app//software.amazon.awssdk.services.s3.auth.scheme.internal.S3AuthSchemeInterceptor.lambda$trySelectAuthScheme$4(S3AuthSchemeInterceptor.java:163)
at app//software.amazon.awssdk.core.internal.util.MetricUtils.reportDuration(MetricUtils.java:80)
at app//software.amazon.awssdk.services.s3.auth.scheme.internal.S3AuthSchemeInterceptor.trySelectAuthScheme(S3AuthSchemeInterceptor.java:163)
at app//software.amazon.awssdk.services.s3.auth.scheme.internal.S3AuthSchemeInterceptor.selectAuthScheme(S3AuthSchemeInterceptor.java:84)
at app//software.amazon.awssdk.services.s3.auth.scheme.internal.S3AuthSchemeInterceptor.beforeExecution(S3AuthSchemeInterceptor.java:64)
at app//software.amazon.awssdk.core.interceptor.ExecutionInterceptorChain.lambda$beforeExecution$1(ExecutionInterceptorChain.java:59)
at [email protected]/java.util.ArrayList.forEach(ArrayList.java:1511)
at app//software.amazon.awssdk.core.interceptor.ExecutionInterceptorChain.beforeExecution(ExecutionInterceptorChain.java:59)
at app//software.amazon.awssdk.awscore.internal.AwsExecutionContextBuilder.runInitialInterceptors(AwsExecutionContextBuilder.java:248)
at app//software.amazon.awssdk.awscore.internal.AwsExecutionContextBuilder.invokeInterceptorsAndCreateExecutionContext(AwsExecutionContextBuilder.java:138)
at app//software.amazon.awssdk.awscore.client.handler.AwsSyncClientHandler.invokeInterceptorsAndCreateExecutionContext(AwsSyncClientHandler.java:67)
at app//software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.lambda$execute$1(BaseSyncClientHandler.java:76)
at app//software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.measureApiCallSuccess(BaseSyncClientHandler.java:182)
at app//software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.execute(BaseSyncClientHandler.java:74)
at app//software.amazon.awssdk.core.client.handler.SdkSyncClientHandler.execute(SdkSyncClientHandler.java:45)
at app//software.amazon.awssdk.awscore.client.handler.AwsSyncClientHandler.execute(AwsSyncClientHandler.java:53)
at app//software.amazon.awssdk.services.s3.DefaultS3Client.listObjectsV2(DefaultS3Client.java:8081)
at app//org.carlspring.cloud.storage.s3fs.S3Iterator.<init>(S3Iterator.java:79)
at app//org.carlspring.cloud.storage.s3fs.S3Iterator.<init>(S3Iterator.java:66)
at app//org.carlspring.cloud.storage.s3fs.S3Iterator.<init>(S3Iterator.java:61)
at app//org.carlspring.cloud.storage.s3fs.S3FilteredIterator.<init>(S3FilteredIterator.java:24)
at app//org.carlspring.cloud.storage.s3fs.S3FileSystemProvider$1.iterator(S3FileSystemProvider.java:453)
at [email protected]/java.nio.file.Files.list(Files.java:3794)
at app//org.gorpipe.s3.driver.S3Source.list(S3Source.java:347)
... 58 more
Check failure on line 320 in gortools/src/main/java/org/gorpipe/gor/manager/BucketManager.java
github-actions / Junit Tests - integrationTest
org.gorpipe.s3.table.ITestS3Table ► testBucketizeLocalTableS3DataS3DataBucketsRelative
Failed test found in:
drivers/build/test-results/integrationTest/TEST-org.gorpipe.s3.table.ITestS3Table.xml
Error:
org.gorpipe.exceptions.GorSystemException: Bucket dirs must exists, directory s3data://project/.dict/b is not found!
Raw output
org.gorpipe.exceptions.GorSystemException: Bucket dirs must exists, directory s3data://project/.dict/b is not found!
at app//org.gorpipe.gor.manager.BucketManager.checkBucketDirExistence(BucketManager.java:320)
at app//org.gorpipe.gor.manager.BucketManager.doBucketizeForBucketDir(BucketManager.java:463)
at app//org.gorpipe.gor.manager.BucketManager.doBucketize(BucketManager.java:425)
at app//org.gorpipe.gor.manager.BucketManager.bucketize(BucketManager.java:185)
at app//org.gorpipe.gor.manager.TableManager.bucketize(TableManager.java:304)
at app//org.gorpipe.s3.table.ITestS3Table.testBucketizeLocalTableS3DataS3DataBucketsRelative(ITestS3Table.java:210)
at [email protected]/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at [email protected]/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at [email protected]/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at [email protected]/java.lang.reflect.Method.invoke(Method.java:569)
at app//org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at app//org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at app//org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at app//org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at app//org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at app//org.junit.contrib.java.lang.system.EnvironmentVariables$EnvironmentVariablesStatement.evaluate(EnvironmentVariables.java:122)
at app//org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at app//org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at app//org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at app//org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at app//org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
at app//org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at app//org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at app//org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at app//org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at app//org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at app//org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at app//org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at app//org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at app//org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at app//org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.runTestClass(JUnitTestClassExecutor.java:112)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:58)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:40)
at org.gradle.api.internal.tasks.testing.junit.AbstractJUnitTestClassProcessor.processTestClass(AbstractJUnitTestClassProcessor.java:54)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:53)
at jdk.internal.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
at [email protected]/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at [email protected]/java.lang.reflect.Method.invoke(Method.java:569)
at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)
at org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:92)
at jdk.proxy2/jdk.proxy2.$Proxy6.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker$2.run(TestWorker.java:183)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.executeAndMaintainThreadName(TestWorker.java:132)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:103)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:63)
at org.gradle.process.internal.worker.child.ActionExecutionWorker.execute(ActionExecutionWorker.java:56)
at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:121)
at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:71)
at app//worker.org.gradle.process.internal.worker.GradleWorkerMain.run(GradleWorkerMain.java:69)
at app//worker.org.gradle.process.internal.worker.GradleWorkerMain.main(GradleWorkerMain.java:74)
Check failure on line 45 in drivers/src/main/java/org/gorpipe/s3/driver/S3RetryHandler.java
github-actions / Junit Tests - integrationTest
org.gorpipe.s3.table.ITestS3Table ► testBucketizeLocalTableS3DataS3Buckets
Failed test found in:
drivers/build/test-results/integrationTest/TEST-org.gorpipe.s3.table.ITestS3Table.xml
Error:
org.gorpipe.exceptions.GorResourceException: Amazon SDK client exception
Raw output
org.gorpipe.exceptions.GorResourceException: Amazon SDK client exception
URI: s3://gdb-unit-test-data/tmp/buckets/
Cause: List failed for s3://gdb-unit-test-data/tmp/buckets/, region: eu-west-1, access key: AKIA4IY3JGTGNS2PE2KA, secret key: Has secret
URI: s3://gdb-unit-test-data/tmp/buckets/
Unable to load credentials from system settings. Access key must be specified either via environment variable (AWS_ACCESS_KEY_ID) or system property (aws.accessKeyId).
at app//org.gorpipe.s3.driver.S3RetryHandler.checkIfShouldRetryException(S3RetryHandler.java:45)
at app//org.gorpipe.gor.driver.utils.RetryHandlerWithFixedWait.perform(RetryHandlerWithFixedWait.java:38)
at app//org.gorpipe.gor.driver.providers.stream.sources.wrappers.RetryStreamSourceWrapper.list(RetryStreamSourceWrapper.java:141)
at app//org.gorpipe.gor.driver.providers.stream.sources.wrappers.WrappedDataSource.list(WrappedDataSource.java:129)
at app//org.gorpipe.gor.model.DriverBackedFileReader.list(DriverBackedFileReader.java:248)
at app//org.gorpipe.gor.manager.BucketManager.collectBucketsToClean(BucketManager.java:687)
at app//org.gorpipe.gor.manager.BucketManager.cleanOldBucketFiles(BucketManager.java:663)
at app//org.gorpipe.gor.manager.BucketManager.bucketize(BucketManager.java:182)
at app//org.gorpipe.gor.manager.TableManager.bucketize(TableManager.java:304)
at app//org.gorpipe.s3.table.ITestS3Table.testBucketizeLocalTableS3DataS3Buckets(ITestS3Table.java:143)
at [email protected]/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at [email protected]/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at [email protected]/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at [email protected]/java.lang.reflect.Method.invoke(Method.java:569)
at app//org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at app//org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at app//org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at app//org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at app//org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at app//org.junit.contrib.java.lang.system.EnvironmentVariables$EnvironmentVariablesStatement.evaluate(EnvironmentVariables.java:122)
at app//org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at app//org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at app//org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at app//org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at app//org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
at app//org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at app//org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at app//org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at app//org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at app//org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at app//org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at app//org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at app//org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at app//org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at app//org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.runTestClass(JUnitTestClassExecutor.java:112)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:58)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:40)
at org.gradle.api.internal.tasks.testing.junit.AbstractJUnitTestClassProcessor.processTestClass(AbstractJUnitTestClassProcessor.java:54)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:53)
at jdk.internal.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
at [email protected]/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at [email protected]/java.lang.reflect.Method.invoke(Method.java:569)
at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)
at org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:92)
at jdk.proxy2/jdk.proxy2.$Proxy6.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker$2.run(TestWorker.java:183)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.executeAndMaintainThreadName(TestWorker.java:132)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:103)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:63)
at org.gradle.process.internal.worker.child.ActionExecutionWorker.execute(ActionExecutionWorker.java:56)
at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:121)
at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:71)
at app//worker.org.gradle.process.internal.worker.GradleWorkerMain.run(GradleWorkerMain.java:69)
at app//worker.org.gradle.process.internal.worker.GradleWorkerMain.main(GradleWorkerMain.java:74)
Caused by: org.gorpipe.exceptions.GorResourceException: List failed for s3://gdb-unit-test-data/tmp/buckets/, region: eu-west-1, access key: AKIA4IY3JGTGNS2PE2KA, secret key: Has secret
URI: s3://gdb-unit-test-data/tmp/buckets/
Cause: Unable to load credentials from system settings. Access key must be specified either via environment variable (AWS_ACCESS_KEY_ID) or system property (aws.accessKeyId).
at app//org.gorpipe.s3.driver.S3Source.list(S3Source.java:355)
at app//org.gorpipe.gor.driver.providers.stream.sources.wrappers.WrappedDataSource.list(WrappedDataSource.java:129)
at app//org.gorpipe.gor.driver.providers.stream.sources.wrappers.RetryStreamSourceWrapper.lambda$list$14(RetryStreamSourceWrapper.java:141)
at app//org.gorpipe.gor.driver.utils.RetryHandlerWithFixedWait.perform(RetryHandlerWithFixedWait.java:33)
... 55 more
Caused by: software.amazon.awssdk.core.exception.SdkClientException: Unable to load credentials from system settings. Access key must be specified either via environment variable (AWS_ACCESS_KEY_ID) or system property (aws.accessKeyId).
at app//software.amazon.awssdk.core.exception.SdkClientException$BuilderImpl.build(SdkClientException.java:111)
at app//software.amazon.awssdk.auth.credentials.internal.SystemSettingsCredentialsProvider.resolveCredentials(SystemSettingsCredentialsProvider.java:60)
at app//software.amazon.awssdk.auth.credentials.AwsCredentialsProvider.resolveIdentity(AwsCredentialsProvider.java:54)
at app//software.amazon.awssdk.identity.spi.IdentityProvider.resolveIdentity(IdentityProvider.java:60)
at app//software.amazon.awssdk.auth.credentials.AwsCredentialsProviderChain.resolveCredentials(AwsCredentialsProviderChain.java:103)
at app//software.amazon.awssdk.auth.credentials.internal.LazyAwsCredentialsProvider.resolveCredentials(LazyAwsCredentialsProvider.java:45)
at app//software.amazon.awssdk.auth.credentials.DefaultCredentialsProvider.resolveCredentials(DefaultCredentialsProvider.java:129)
at app//software.amazon.awssdk.auth.credentials.AwsCredentialsProvider.resolveIdentity(AwsCredentialsProvider.java:54)
at app//software.amazon.awssdk.services.s3.auth.scheme.internal.S3AuthSchemeInterceptor.lambda$trySelectAuthScheme$4(S3AuthSchemeInterceptor.java:163)
at app//software.amazon.awssdk.core.internal.util.MetricUtils.reportDuration(MetricUtils.java:80)
at app//software.amazon.awssdk.services.s3.auth.scheme.internal.S3AuthSchemeInterceptor.trySelectAuthScheme(S3AuthSchemeInterceptor.java:163)
at app//software.amazon.awssdk.services.s3.auth.scheme.internal.S3AuthSchemeInterceptor.selectAuthScheme(S3AuthSchemeInterceptor.java:84)
at app//software.amazon.awssdk.services.s3.auth.scheme.internal.S3AuthSchemeInterceptor.beforeExecution(S3AuthSchemeInterceptor.java:64)
at app//software.amazon.awssdk.core.interceptor.ExecutionInterceptorChain.lambda$beforeExecution$1(ExecutionInterceptorChain.java:59)
at [email protected]/java.util.ArrayList.forEach(ArrayList.java:1511)
at app//software.amazon.awssdk.core.interceptor.ExecutionInterceptorChain.beforeExecution(ExecutionInterceptorChain.java:59)
at app//software.amazon.awssdk.awscore.internal.AwsExecutionContextBuilder.runInitialInterceptors(AwsExecutionContextBuilder.java:248)
at app//software.amazon.awssdk.awscore.internal.AwsExecutionContextBuilder.invokeInterceptorsAndCreateExecutionContext(AwsExecutionContextBuilder.java:138)
at app//software.amazon.awssdk.awscore.client.handler.AwsSyncClientHandler.invokeInterceptorsAndCreateExecutionContext(AwsSyncClientHandler.java:67)
at app//software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.lambda$execute$1(BaseSyncClientHandler.java:76)
at app//software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.measureApiCallSuccess(BaseSyncClientHandler.java:182)
at app//software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.execute(BaseSyncClientHandler.java:74)
at app//software.amazon.awssdk.core.client.handler.SdkSyncClientHandler.execute(SdkSyncClientHandler.java:45)
at app//software.amazon.awssdk.awscore.client.handler.AwsSyncClientHandler.execute(AwsSyncClientHandler.java:53)
at app//software.amazon.awssdk.services.s3.DefaultS3Client.listObjectsV2(DefaultS3Client.java:8081)
at app//org.carlspring.cloud.storage.s3fs.S3Iterator.<init>(S3Iterator.java:79)
at app//org.carlspring.cloud.storage.s3fs.S3Iterator.<init>(S3Iterator.java:66)
at app//org.carlspring.cloud.storage.s3fs.S3Iterator.<init>(S3Iterator.java:61)
at app//org.carlspring.cloud.storage.s3fs.S3FilteredIterator.<init>(S3FilteredIterator.java:24)
at app//org.carlspring.cloud.storage.s3fs.S3FileSystemProvider$1.iterator(S3FileSystemProvider.java:453)
at [email protected]/java.nio.file.Files.list(Files.java:3794)
at app//org.gorpipe.s3.driver.S3Source.list(S3Source.java:347)
... 58 more