-
Notifications
You must be signed in to change notification settings - Fork 3.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[C#] ArrowArrayConcatenator doesn't handle non-zero offsets #41164
Comments
### Rationale for this change Makes array concatenation work correctly when the input arrays have been sliced. ### What changes are included in this PR? * Updates the array concatenation tests so that the `TestDataGenerator` can generate test cases with sliced input arrays. To avoid too much duplicated logic, I've added a new `GenerateTestData<TArray, TArrayBuilder>` method that works with builders that are not `IArrowArrayBuilder<T, TArray, TArrayBuilder>`, and simplified a lot of the data generation by using this new method. Only struct and union array test data generation still needs to duplicate the logic in `GenerateTestData`. * Fixes `ArrayDataConcatenator` logic to handle sliced input arrays ### Are these changes tested? Yes, I've added a new test for this. ### Are there any user-facing changes? Yes, this is a user-facing bug fix. * GitHub Issue: #41164 Authored-by: Adam Reeve <[email protected]> Signed-off-by: Curt Hagenlocher <[email protected]>
Issue resolved by pull request 41245 |
### Rationale for this change Makes array concatenation work correctly when the input arrays have been sliced. ### What changes are included in this PR? * Updates the array concatenation tests so that the `TestDataGenerator` can generate test cases with sliced input arrays. To avoid too much duplicated logic, I've added a new `GenerateTestData<TArray, TArrayBuilder>` method that works with builders that are not `IArrowArrayBuilder<T, TArray, TArrayBuilder>`, and simplified a lot of the data generation by using this new method. Only struct and union array test data generation still needs to duplicate the logic in `GenerateTestData`. * Fixes `ArrayDataConcatenator` logic to handle sliced input arrays ### Are these changes tested? Yes, I've added a new test for this. ### Are there any user-facing changes? Yes, this is a user-facing bug fix. * GitHub Issue: apache#41164 Authored-by: Adam Reeve <[email protected]> Signed-off-by: Curt Hagenlocher <[email protected]>
### Rationale for this change Makes array concatenation work correctly when the input arrays have been sliced. ### What changes are included in this PR? * Updates the array concatenation tests so that the `TestDataGenerator` can generate test cases with sliced input arrays. To avoid too much duplicated logic, I've added a new `GenerateTestData<TArray, TArrayBuilder>` method that works with builders that are not `IArrowArrayBuilder<T, TArray, TArrayBuilder>`, and simplified a lot of the data generation by using this new method. Only struct and union array test data generation still needs to duplicate the logic in `GenerateTestData`. * Fixes `ArrayDataConcatenator` logic to handle sliced input arrays ### Are these changes tested? Yes, I've added a new test for this. ### Are there any user-facing changes? Yes, this is a user-facing bug fix. * GitHub Issue: apache#41164 Authored-by: Adam Reeve <[email protected]> Signed-off-by: Curt Hagenlocher <[email protected]>
### Rationale for this change Makes array concatenation work correctly when the input arrays have been sliced. ### What changes are included in this PR? * Updates the array concatenation tests so that the `TestDataGenerator` can generate test cases with sliced input arrays. To avoid too much duplicated logic, I've added a new `GenerateTestData<TArray, TArrayBuilder>` method that works with builders that are not `IArrowArrayBuilder<T, TArray, TArrayBuilder>`, and simplified a lot of the data generation by using this new method. Only struct and union array test data generation still needs to duplicate the logic in `GenerateTestData`. * Fixes `ArrayDataConcatenator` logic to handle sliced input arrays ### Are these changes tested? Yes, I've added a new test for this. ### Are there any user-facing changes? Yes, this is a user-facing bug fix. * GitHub Issue: apache#41164 Authored-by: Adam Reeve <[email protected]> Signed-off-by: Curt Hagenlocher <[email protected]>
### Rationale for this change Makes array concatenation work correctly when the input arrays have been sliced. ### What changes are included in this PR? * Updates the array concatenation tests so that the `TestDataGenerator` can generate test cases with sliced input arrays. To avoid too much duplicated logic, I've added a new `GenerateTestData<TArray, TArrayBuilder>` method that works with builders that are not `IArrowArrayBuilder<T, TArray, TArrayBuilder>`, and simplified a lot of the data generation by using this new method. Only struct and union array test data generation still needs to duplicate the logic in `GenerateTestData`. * Fixes `ArrayDataConcatenator` logic to handle sliced input arrays ### Are these changes tested? Yes, I've added a new test for this. ### Are there any user-facing changes? Yes, this is a user-facing bug fix. * GitHub Issue: apache#41164 Authored-by: Adam Reeve <[email protected]> Signed-off-by: Curt Hagenlocher <[email protected]>
### Rationale for this change Makes array concatenation work correctly when the input arrays have been sliced. ### What changes are included in this PR? * Updates the array concatenation tests so that the `TestDataGenerator` can generate test cases with sliced input arrays. To avoid too much duplicated logic, I've added a new `GenerateTestData<TArray, TArrayBuilder>` method that works with builders that are not `IArrowArrayBuilder<T, TArray, TArrayBuilder>`, and simplified a lot of the data generation by using this new method. Only struct and union array test data generation still needs to duplicate the logic in `GenerateTestData`. * Fixes `ArrayDataConcatenator` logic to handle sliced input arrays ### Are these changes tested? Yes, I've added a new test for this. ### Are there any user-facing changes? Yes, this is a user-facing bug fix. * GitHub Issue: apache#41164 Authored-by: Adam Reeve <[email protected]> Signed-off-by: Curt Hagenlocher <[email protected]>
Can this be backported to a bugfix |
The Arrow release process is fairly labor-intensive, so bugfix releases are typically reserved for regressions. This fix is for a longstanding bug and not a regression, so on its own it wouldn't be a candidate for a point release. If it turns out that we need a 16.2 release for some other reason, I'll investigate the possibility of porting this set of fixes alongside it. The next regular release will be roughly at the beginning of August. |
Describe the bug, including details regarding any error messages, version, and platform.
Example unit test to reproduce:
This fails with:
Component(s)
C#
The text was updated successfully, but these errors were encountered: