Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

platform aware partition parsing #1867

Merged
merged 1 commit into from
Feb 20, 2022

Conversation

korowa
Copy link
Contributor

@korowa korowa commented Feb 19, 2022

Which issue does this PR close?

Closes #1536.

Rationale for this change

Currently there is an issue with parsing partition values while building listing table on local Windows filesystem which leads to underlying files being ignored. It caused by usage of fixed slash sepatator in partition parsing function, while inputs may contain backslash as default Windows separator.

What changes are included in this PR?

Splitting file path by char replaced with building std::path::Path on it and iterating through its components

Are there any user-facing changes?

Fixed partitioned listing tables scanning on Windows

@github-actions github-actions bot added the datafusion Changes in the datafusion crate label Feb 19, 2022
@houqp houqp merged commit 72baa9d into apache:master Feb 20, 2022
@houqp houqp added the bug Something isn't working label Feb 20, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working datafusion Changes in the datafusion crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Not able to get the table from register_listing_table
3 participants