Skip to content
This repository has been archived by the owner on Feb 18, 2024. It is now read-only.

Cannot use Snappy decompression #626

Closed
mdrach opened this issue Nov 23, 2021 · 4 comments · Fixed by #632
Closed

Cannot use Snappy decompression #626

mdrach opened this issue Nov 23, 2021 · 4 comments · Fixed by #632
Labels
documentation Improvements or additions to documentation no-changelog Issues whose changes are covered by a PR and thus should not be shown in the changelog

Comments

@mdrach
Copy link
Contributor

mdrach commented Nov 23, 2021

Apologies if this is a silly question; if so point me to the docs that have the answer. I'm trying to run the example that reads a parquet file with snappy decompression. I get the following error.

Error: External("", General("Compression Snappy is not installed"))

I'm on OSX 11.6.1 and I've installed snappy though I'm not sure this is even necessary given that parquet2 uses snap.

I've attached a minimal project that produces this error: test_parquet_snappy.zip

Any pointers here? Thanks.

@jorgecarleitao
Copy link
Owner

Hi, you need to use the feature io_parquet_compression - essentially we offer the possibility to not drag dependencies if the user does not want them and these are some of them. Note that you do not need snappy installed on your machine.

@houqp
Copy link
Collaborator

houqp commented Nov 23, 2021

Perhaps the error message could be more actionable? Like something along the lines of Feature compression Snappy is not enabled

@jorgecarleitao
Copy link
Owner

jorgecarleitao commented Nov 23, 2021

I agree. This requires a small surgery to parquet2: jorgecarleitao/parquet2#69 so that we can match the error and propagate it on our end.

@jorgecarleitao
Copy link
Owner

Ok, there is now a PR to fix this :)

@jorgecarleitao jorgecarleitao added documentation Improvements or additions to documentation no-changelog Issues whose changes are covered by a PR and thus should not be shown in the changelog labels Nov 24, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
documentation Improvements or additions to documentation no-changelog Issues whose changes are covered by a PR and thus should not be shown in the changelog
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants