Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Supporting additional compression formats #12

Open
fairingrey opened this issue May 10, 2019 · 3 comments
Open

Supporting additional compression formats #12

fairingrey opened this issue May 10, 2019 · 3 comments
Labels
enhancement New feature or request

Comments

@fairingrey
Copy link
Contributor

fairingrey commented May 10, 2019

Just an idea that was fishing around in my head lately, but I think it would be awesome to support additional crates for use between the newest async types/traits.

One in particular that stands out to me (and could be useful for the near future) is the zstd crate. In particular, we could apply the same kind of byte-stream encoding/decoding logic that we use for Deflate/Zlib to the zstd raw compresser/decompressers here. Also another thing to note is while it does support AsyncRead/AsyncWrite through a feature gate tokio-io, that is still on futures 0.1.

For zstd, it shouldn't take too long -- I might actually start work on it soon!

@fairingrey
Copy link
Contributor Author

fairingrey commented May 13, 2019

Now that Zstd is supported over streams, it'd be nice to aggregate some resources for anyone wishing to provide more support over different encoding schemes.

This likely won't be worked on unless there's a hotter compression algorithm in town I suppose, but it's here for anyone that wants to give one of them a try.

@fairingrey fairingrey added the enhancement New feature or request label May 16, 2019
@PSeitz
Copy link

PSeitz commented Jan 24, 2023

Async support has been requested for lz4_flex PSeitz/lz4_flex#15. It's not a http compression encoding though.

@droundy
Copy link

droundy commented Jul 2, 2023

I'll point out that lz4 is the default compression for clickhouse over http, which would make lz4 support very appealing to me.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants