Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New functions for working with arrays #6119

Closed
14 tasks done
izveigor opened this issue Apr 25, 2023 · 6 comments · Fixed by #6384
Closed
14 tasks done

New functions for working with arrays #6119

izveigor opened this issue Apr 25, 2023 · 6 comments · Fixed by #6384
Labels
enhancement New feature or request

Comments

@izveigor
Copy link
Contributor

izveigor commented Apr 25, 2023

Is your feature request related to a problem or challenge?

Arrow-DataFusion can support creating an array of a certain data type (make_array), but there are no functions to work with them.
In my opinion, the documentation of the database PostgreSQL can serve as a reference for working on arrays.

Array functions:

  • array_append
  • array_concat
  • array_ndims
  • array_dims
  • array_fill
  • array_length
  • array_position
  • array_positions
  • array_prepend
  • array_remove
  • array_replace
  • array_to_string
  • cardinality
  • string_to_array

Describe the solution you'd like

Series of PR, active discussion of features.

Describe alternatives you've considered

The significance of some features can be disproven as a result of conversations.

Additional context

Sources:
The array documentation: PostgreSQL
#6073
#6075

@izveigor izveigor added the enhancement New feature or request label Apr 25, 2023
@mustafaakin
Copy link

mustafaakin commented May 11, 2023

We have a lot of nested data at Resmo and currently using PartiQL but we were exploring to switch to datafusion. We make use a lot of unnest.

@izveigor
Copy link
Contributor Author

Hello, @mustafaakin!
I think I can create PR with the implementation unnest soon

@alamb
Copy link
Contributor

alamb commented Jun 1, 2023

Thank you @izveigor -- I have added this ticket to the tracking epic for working with lists in DataFusion: #2326

@bubbajoe
Copy link

bubbajoe commented Jun 7, 2023

@alamb Isn't there still some functions/operators that need to be finished (or issued created)?

@alamb alamb reopened this Jun 8, 2023
@alamb
Copy link
Contributor

alamb commented Jun 8, 2023

I agree -- thanks @bubbajoe . @izveigor FYI I reopened this one. Perhaps it would be good to file a follow on ticket with what is not yet implemented and then we can close this ticket

@izveigor izveigor changed the title New functions and operations for working with arrays New functions for working with arrays Jun 8, 2023
@izveigor
Copy link
Contributor Author

izveigor commented Jun 8, 2023

@alamb @bubbajoe Yes, I created two additional tickets for the remaining cases.
So, I think I can close this ticket now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants