Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] CSV Parseing Inf, -Inf, and NaN not supported #125

Open
revans2 opened this issue Jun 8, 2020 · 3 comments
Open

[BUG] CSV Parseing Inf, -Inf, and NaN not supported #125

revans2 opened this issue Jun 8, 2020 · 3 comments
Labels
bug Something isn't working P2 Not required for release SQL part of the SQL/Dataframe plugin

Comments

@revans2
Copy link
Collaborator

revans2 commented Jun 8, 2020

Describe the bug
Parsing these values results in a null.

Steps/Code to reproduce bug
There are integration tests added .

Expected behavior
Ideally we would be able to support positiveInf, negativeInf, and nanValue CSV parser options.
@revans2 revans2 added bug Something isn't working ? - Needs Triage Need team to review and classify SQL part of the SQL/Dataframe plugin labels Jun 8, 2020
@sameerz sameerz added P2 Not required for release and removed ? - Needs Triage Need team to review and classify labels Aug 18, 2020
@revans2
Copy link
Collaborator Author

revans2 commented Apr 1, 2021 •
edited
Loading

Inf and -Inf are now partially supported, but they are not configurable.

@revans2 revans2 mentioned this issue Apr 1, 2021
Open
38 tasks
@wbo4958
Copy link
Collaborator

wbo4958 commented Jan 12, 2022

JSON also can't parse NaN.

@andygrove andygrove mentioned this issue Jan 26, 2022
Merged
7 tasks
@andygrove
Copy link
Contributor

I filed #4644 for supporting positiveInf, negativeInf, and nanValue CSV parser options to reduce the scope of this issue.

@andygrove andygrove self-assigned this Jan 27, 2022
@andygrove andygrove removed their assignment Feb 10, 2022
@sameerz sameerz removed this from the Jan 31 - Feb 11 milestone Feb 15, 2022
tgravescs pushed a commit to tgravescs/spark-rapids that referenced this issue Nov 30, 2023
@nvauto
Update submodule cudf to 76c772e (NVIDIA#125)
0ccf6c7 
Signed-off-by: spark-rapids automation <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working P2 Not required for release SQL part of the SQL/Dataframe plugin
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@andygrove @wbo4958 @revans2 @sameerz