Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SSL verification step got executed even after disabled it. #340

Open
vinoth-ayyavu-git opened this issue Sep 13, 2024 · 0 comments
Open

Comments

@vinoth-ayyavu-git
Copy link

vinoth-ayyavu-git commented Sep 13, 2024

Code reference :

spark-shell --jars C:\bigdata\cos_jar\hadoop-common-3.4.0.jar,C:\bigdata\cos_jar\stocator-1.1.5.jar,C:\bigdata\cos_jar\hadoop-aws-3.3.6.jar,C:\bigdata\cos_jar\aws-java-sdk-bundle-1.12.769.jar

spark.sparkContext.hadoopConfiguration.set("fs.cos.service.endpoint", "XXXX")
spark.sparkContext.hadoopConfiguration.set("fs.cos.service.access.key","XXX")
spark.sparkContext.hadoopConfiguration.set("fs.cos.service.secret.key","XXXX")
spark.sparkContext.hadoopConfiguration.set("fs.cos.connection.ssl.enabled", "false")

spark.range(5).write.format("parquet").save("cos://BucketName.service/icos_spark_test")

Even after setting this ssl verification flag as false, it is verifying ssl and getting below error

com.amazonaws.SdkClientException: Unable to execute HTTP request: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleRetryableException(AmazonHttpClient.java:1134)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1080)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:745)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant