Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ARROW-17256 [Python] Can't call combine_chunks on empty ChunkedArray #13757

Conversation

0x26res
Copy link
Contributor

@0x26res 0x26res commented Jul 30, 2022

https://issues.apache.org/jira/browse/ARROW-17256

Not 100% sure it should be fixed at this level. Should combine_chunks receive a DataType instead?

@github-actions
Copy link

@github-actions
Copy link

⚠️ Ticket has not been started in JIRA, please click 'Start Progress'.

@lidavidm
Copy link
Member

lidavidm commented Aug 1, 2022

IMO: yes, combine_chunks (which boils down to Concatenate in C++) should just take a datatype, though that would be a larger change

Copy link
Member

@pitrou pitrou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM on the principle.

@@ -3192,3 +3192,13 @@ def test_to_pandas_timezone():
arr = pa.chunked_array([arr])
s = arr.to_pandas()
assert s.dt.tz is not None


def test_chunked_array_can_combine_chunks_with_no_chunks():
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

combine_chunks is tested in test_table.py, could you move your test there too?

aandres added 2 commits August 8, 2022 18:48
@pitrou pitrou merged commit 210cf06 into apache:master Aug 8, 2022
@ursabot
Copy link

ursabot commented Aug 9, 2022

Benchmark runs are scheduled for baseline = d171b6c and contender = 210cf06. 210cf06 is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Finished ⬇️0.0% ⬆️0.0%] ec2-t3-xlarge-us-east-2
[Failed ⬇️0.2% ⬆️0.0%] test-mac-arm
[Finished ⬇️0.27% ⬆️0.0%] ursa-i9-9960x
[Finished ⬇️0.18% ⬆️0.0%] ursa-thinkcentre-m75q
Buildkite builds:
[Finished] 210cf061 ec2-t3-xlarge-us-east-2
[Failed] 210cf061 test-mac-arm
[Finished] 210cf061 ursa-i9-9960x
[Finished] 210cf061 ursa-thinkcentre-m75q
[Finished] d171b6c3 ec2-t3-xlarge-us-east-2
[Finished] d171b6c3 test-mac-arm
[Finished] d171b6c3 ursa-i9-9960x
[Finished] d171b6c3 ursa-thinkcentre-m75q
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants