Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BigQuery native compilation fails due to unresolved field io.netty.buffer.PoolArena.chunkSize #5641

Closed
jamesnetherton opened this issue Jan 8, 2024 · 3 comments
Assignees
Labels
area/native bug Something isn't working native
Milestone

Comments

@jamesnetherton
Copy link
Contributor

Bug description

Quarkus has upgraded Netty to 4.1.103.Final. The version of Apache Arrow used by google-cloud-biqqueryis not compatible with this. See apache/arrow#39265.

@jamesnetherton jamesnetherton added the bug Something isn't working label Jan 8, 2024
jamesnetherton added a commit to jamesnetherton/camel-quarkus that referenced this issue Jan 17, 2024
jamesnetherton added a commit to jamesnetherton/camel-quarkus that referenced this issue Jan 17, 2024
@jamesnetherton jamesnetherton changed the title [quarkus-main] BigQuery native compilation fails due to unresolved field io.netty.buffer.PoolArena.chunkSize BigQuery native compilation fails due to unresolved field io.netty.buffer.PoolArena.chunkSize Jan 17, 2024
@jamesnetherton
Copy link
Contributor Author

jamesnetherton commented Jan 17, 2024

The workaround for now was to copy the updated Arrow Netty classes to the BigQuery extension. However, given the simple nature of the original fix:

apache/arrow@a4a3d3f

I wonder if we could have a BuildStep to do some bytecode hackery and avoid having to carry the additional sources. It could even be activated conditionally based on the version of arrow that we detect.

@zhfeng
Copy link
Contributor

zhfeng commented Jan 25, 2024

@jamesnetherton any hint to create a tranformer of bytecode? I tried such things before but it seems hard to work.

@jamesnetherton
Copy link
Contributor Author

@jamesnetherton any hint to create a tranformer of bytecode? I tried such things before but it seems hard to work.

Yeah, it's tricky. I was actually just thinking about this and whether it's worth trying to do it.

java-bigquery has upgraded to Arrow 15.x now:

googleapis/java-bigquery@4d4cbae

So maybe we'll get a release with that change incorporated soon and we could remove the hacks.

@jamesnetherton jamesnetherton self-assigned this Feb 14, 2024
@jamesnetherton jamesnetherton added this to the 3.8.0 milestone Feb 14, 2024
jamesnetherton added a commit to jamesnetherton/camel-quarkus that referenced this issue Feb 19, 2024
jamesnetherton added a commit to jamesnetherton/camel-quarkus that referenced this issue Feb 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/native bug Something isn't working native
Projects
None yet
Development

No branches or pull requests

2 participants