Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

can add parquet as destination? #627

Open
wonb168 opened this issue Aug 23, 2022 · 4 comments
Open

can add parquet as destination? #627

wonb168 opened this issue Aug 23, 2022 · 4 comments
Labels
Feature A nice to have thing that we don't have yet Help Wanted We are volunteers. We'll be happy if you join us.

Comments

@wonb168
Copy link

wonb168 commented Aug 23, 2022

now have many destinations, ex. tocsv, todb...
can add toparquet in next version?
@juarezr
Copy link
Member

juarezr commented Aug 29, 2022

Maybe Apache Arrow could help.

@juarezr juarezr added Feature A nice to have thing that we don't have yet Help Wanted We are volunteers. We'll be happy if you join us. labels Aug 29, 2022
@wonb168
Copy link
Author

wonb168 commented Aug 30, 2022

I used connector-x to export pg table into arrow，but is so slowly，10* slower than csv export

@blais
Copy link
Contributor

blais commented Sep 24, 2023

+1 to Parquet output. Really surprised it's not here.

@juarezr
Copy link
Member

juarezr commented May 4, 2024

Parquet implementations available:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Feature A nice to have thing that we don't have yet Help Wanted We are volunteers. We'll be happy if you join us.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@blais @juarezr @wonb168