Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Extension Proposal] Snappy compressor native #37510

Closed
MarcAnB opened this issue Dec 5, 2023 · 5 comments · Fixed by quarkiverse/quarkiverse-devops#195
Closed

[Extension Proposal] Snappy compressor native #37510

MarcAnB opened this issue Dec 5, 2023 · 5 comments · Fixed by quarkiverse/quarkiverse-devops#195
Labels
area/native-image area/quarkiverse This issue/PR is part of the Quarkiverse organization kind/extension-proposal Discuss and Propose new extensions

Comments

@MarcAnB
Copy link

MarcAnB commented Dec 5, 2023

Description

I wrote this extension to enable the use of Snappy compressor in native environment.
Snappy compressor can be use in Mongo, Kafka or Parquet for example.

Repository name

quarkus-snappy

Short description

Snappy compressor in native environment

Repository Homepage URL

https://quarkiverse.github.io/quarkiverse-docs/quarkus-snappy/dev/

Repository Topics

  • quarkus-extension
  • snappy-native

Team Members

Additional context

Sources are here for now:
https://github.com/MarcAnB/quarkus-snappy

I am already using it and it works for me.

@MarcAnB MarcAnB added area/quarkiverse This issue/PR is part of the Quarkiverse organization kind/extension-proposal Discuss and Propose new extensions labels Dec 5, 2023
Copy link

quarkus-bot bot commented Dec 5, 2023

/cc @aloubyansky (extension-proposal), @gastaldi (extension-proposal), @gsmet (extension-proposal), @maxandersen (extension-proposal), @zakkak (native-image)

@gastaldi
Copy link
Contributor

gastaldi commented Dec 5, 2023

There is already support for Snappy in Kafka as in https://quarkus.io/guides/kafka#using-snappy-for-message-compression, but I believe this extension is for other use cases, right?

gastaldi added a commit to quarkiverse/quarkiverse-devops that referenced this issue Dec 5, 2023
gastaldi added a commit to quarkiverse/quarkiverse-devops that referenced this issue Dec 5, 2023
@gastaldi
Copy link
Contributor

gastaldi commented Dec 5, 2023

@MarcAnB repository created in https://github.com/quarkiverse/quarkus-snappy. For the next steps, see https://hub.quarkiverse.io/checklist/#after-the-repository-is-created.

@MarcAnB
Copy link
Author

MarcAnB commented Dec 10, 2023

There is already support for Snappy in Kafka as in https://quarkus.io/guides/kafka#using-snappy-for-message-compression, but I believe this extension is for other use cases, right?

Yep I use it in parquet files for example
https://www.javadoc.io/doc/org.apache.parquet/parquet-hadoop/1.10.1/org/apache/parquet/hadoop/codec/SnappyCodec.html

@MarcAnB
Copy link
Author

MarcAnB commented Dec 12, 2023

I got code from Kafka extension to enable snappy but the integration tests are failing, not sure it is the right place to ask..

In Kafka extension there is a property that disable snappy for tests I think, how should I do here? Introducing a property doesn't really make sense to me since, if you use the extension, it is implicit that we want to load snappy.

code: quarkiverse/quarkus-snappy#6

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/native-image area/quarkiverse This issue/PR is part of the Quarkiverse organization kind/extension-proposal Discuss and Propose new extensions
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants