-
Notifications
You must be signed in to change notification settings - Fork 3.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ARROW-15040: [R] Enable write_csv_arrow to take a Dataset or arrow_dplyr_query as input #11971
Conversation
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Oh, this is exciting! One comment about types. It also looks like there are some(?) related segfaults in the CI
It may be worth rebasing this and seeing if it still segfaults! I know there were some updates to the Scanner that fixed some segfaults for me when I was writing tests for the Python bridge (from the Python side). Another way to write this test that would be independent of that is to Scan a I'm also a fan of the "allow a general record batch reader" approach, which might also make this easier to test. |
Also linking ARROW-15128 since it seems like a blocker for this PR. |
b45f9e6
to
43f08f3
Compare
Thanks for the suggestion @paleolimbot but the segfault is still happening after a rebase. |
ff62a45
to
01e1ae5
Compare
Have now updated this and removed the blocker ticket which isn't a blocker! |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should also write a test for accepting RecordBatchReader, and need to update the docs too
Co-authored-by: Neal Richardson <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
A couple of final suggestions
Co-authored-by: Neal Richardson <[email protected]>
Co-authored-by: Neal Richardson <[email protected]>
Benchmark runs are scheduled for baseline = 676b49f and contender = 13045f4. 13045f4 is a master commit associated with this PR. Results will be available as each benchmark for each run completes. |
No description provided.