Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Write pandas extension types to parquet file metadata #8749

Merged

Conversation

devavret
Copy link
Contributor

Prevents nullable columns to be read as float columns with NaNs when reading with pandas.

Fixes #8688

Writing pandas extension types to parquet file
Prevents nullable columns to be read as float columns with NaNs
@devavret devavret requested a review from a team as a code owner July 15, 2021 11:27
@devavret devavret requested review from charlesbluca, rgsl888prabhu and galipremsagar and removed request for rgsl888prabhu July 15, 2021 11:27
@github-actions github-actions bot added the Python Affects Python cuDF API. label Jul 15, 2021
@devavret devavret added 3 - Ready for Review Ready for review by team bug Something isn't working cuIO cuIO issue non-breaking Non-breaking change labels Jul 15, 2021
@codecov
Copy link

codecov bot commented Jul 15, 2021

Codecov Report

❗ No coverage uploaded for pull request base (branch-21.08@ceb3922). Click here to learn what that means.
The diff coverage is n/a.

Impacted file tree graph

@@               Coverage Diff               @@
##             branch-21.08    #8749   +/-   ##
===============================================
  Coverage                ?   10.53%           
===============================================
  Files                   ?      116           
  Lines                   ?    18916           
  Branches                ?        0           
===============================================
  Hits                    ?     1993           
  Misses                  ?    16923           
  Partials                ?        0           

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ceb3922...f87c67e. Read the comment docs.

python/cudf/cudf/_lib/utils.pyx Outdated Show resolved Hide resolved
@galipremsagar galipremsagar added 5 - Ready to Merge Testing and reviews complete, ready to merge and removed 3 - Ready for Review Ready for review by team labels Jul 16, 2021
@galipremsagar
Copy link
Contributor

@gpucibot merge

1 similar comment
@galipremsagar
Copy link
Contributor

@gpucibot merge

@rapids-bot rapids-bot bot merged commit 4d7ad4f into rapidsai:branch-21.08 Jul 16, 2021
rapids-bot bot pushed a commit that referenced this pull request Jul 19, 2021
Not sure if it was the timing of the gpuCI `isort` bump relative to the updated pre-commit hooks here, but #8749 introduced a sorting error in `utils.pyx` that wasn't caught by gpuCI at the time of merging.

Authors:
  - Charles Blackmon-Luca (https://github.com/charlesbluca)

Approvers:
  - GALI PREM SAGAR (https://github.com/galipremsagar)
  - Nghia Truong (https://github.com/ttnghia)

URL: #8771
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
5 - Ready to Merge Testing and reviews complete, ready to merge bug Something isn't working cuIO cuIO issue non-breaking Non-breaking change Python Affects Python cuDF API.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Unable to retrieve nulls in float column when reading a cudf created parquet file
2 participants