Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SNOW-1322004: Upgrade to Arrow 15.0.2 in snowflake-jdbc #1848

Closed
wants to merge 6 commits into from

Conversation

sfc-gh-ext-simba-jy
Copy link
Collaborator

@sfc-gh-ext-simba-jy sfc-gh-ext-simba-jy commented Jul 30, 2024

Overview

SNOW-1322004

  • Upgrade the Arrow to 15.0.2 in JDBC with AIX fix.

Pre-review self checklist

  • PR branch is updated with all the changes from master branch
  • The code is correctly formatted (run mvn -P check-style validate)
  • New public API is not unnecessary exposed (run mvn verify and inspect target/japicmp/japicmp.html)
  • The pull request name is prefixed with SNOW-XXXX:
  • Code is in compliance with internal logging requirements

External contributors - please answer these questions before submitting a pull request. Thanks!

  1. What GitHub issue is this PR addressing? Make sure that there is an accompanying issue to your PR.

    Issue: #NNNN

  2. Fill out the following pre-review checklist:

    • I am adding a new automated test(s) to verify correctness of my new code
    • I am adding new logging messages
    • I am modifying authorization mechanisms
    • I am adding new credentials
    • I am modifying OCSP code
    • I am adding a new dependency or upgrading an existing one
    • I am adding new public/protected component not marked with @SnowflakeJdbcInternalApi (note that public/protected methods/fields in classes marked with this annotation are already internal)
  3. Please describe how your code solves the related issue.

    Please write a short description of how your code change solves the related issue.

@sfc-gh-ext-simba-jy sfc-gh-ext-simba-jy marked this pull request as ready for review July 31, 2024 01:45
@sfc-gh-ext-simba-jy sfc-gh-ext-simba-jy requested a review from a team as a code owner July 31, 2024 01:45
@@ -477,6 +477,10 @@
<pattern>org.threeten</pattern>
<shadedPattern>${shadeBase}.threeten</shadedPattern>
</relocation>
<relocation>
<pattern>org.slf4j</pattern>
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let's not shade slf4j - arrow should not need this dependency

@@ -553,6 +561,9 @@
<exclude>arrow-git.properties</exclude>
<exclude>google-http-client.properties</exclude>
<exclude>pipes-fork-server-default-log4j2.xml</exclude>
<exclude>about.html</exclude>
<exclude>LICENSE-EDL-1.0.txt</exclude>
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

according to the licence we should include this files?

@@ -14,7 +14,7 @@
<parent>
<groupId>org.apache.arrow</groupId>
<artifactId>arrow-java-root</artifactId>
<version>10.0.1</version>
<version>15.0.2</version>
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let's update also dependencies/README.md

@@ -385,7 +386,6 @@
<groupId>org.slf4j</groupId>
<artifactId>slf4j-api</artifactId>
<version>${slf4j.version}</version>
<scope>provided</scope>
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let's keep it provided

@@ -927,6 +931,10 @@
<pattern>org.codehaus</pattern>
<shadedPattern>${shadeBase}.org.codehaus</shadedPattern>
</relocation>
<relocation>
<pattern>org.slf4j</pattern>
<shadedPattern>${shadeBase}.org.slf4j</shadedPattern>
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let's not shade slf4j

@@ -967,6 +975,9 @@
<exclude>arrow-git.properties</exclude>
<exclude>google-http-client.properties</exclude>
<exclude>storage.v1.json</exclude>
<exclude>about.html</exclude>
<exclude>LICENSE-EDL-1.0.txt</exclude>
<exclude>LICENSE-EPL-1.0.txt</exclude>
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we should include licenses?

<google.cloud.core.version>2.21.0</google.cloud.core.version>
<google.cloud.storage.version>2.22.6</google.cloud.storage.version>
<google.flatbuffers.version>1.12.0</google.flatbuffers.version>
<google.flatbuffers.version>23.5.26</google.flatbuffers.version>
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

don't we need to change any other google library?

@github-actions github-actions bot locked and limited conversation to collaborators Aug 1, 2024
@sfc-gh-ext-simba-jy
Copy link
Collaborator Author

We are able to upgrade Arrow Version to 17.0.0. I made a different PR for that. Let's move on #1854

@sfc-gh-ext-simba-jy sfc-gh-ext-simba-jy deleted the arrowupdate branch August 1, 2024 15:39
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants