You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Reading the code over it doesn't look too difficult to implement is needed (we do this for Snappy)
That said, Hadoop has it's own framing format for LZ4 which isn't compatible with anything else. Does Hive or Spark support these files directly? If so, what compresson codec are you specifying? In the past Hadoop would introduce a second codec when there is a conflict between the built in framing and one provided by compression project (normally happens when the framing comes out after hadoop has created its own).
Is there any plan to support lz4 framing support while decompression.
https://android.googlesource.com/platform/external/lz4/+/HEAD/doc/lz4_Frame_format.md
Currently Trino queries are failing if such compressed files are provided.
The text was updated successfully, but these errors were encountered: