Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Expose delimiter character in JSON reader options to JSON reader APIs #17266

Merged
merged 10 commits into from
Nov 9, 2024
Merged

Expose delimiter character in JSON reader options to JSON reader APIs #17266

merged 10 commits into from
Nov 9, 2024

Conversation

shrshi
Copy link
Contributor

@shrshi shrshi commented Nov 7, 2024 •
edited by karthikeyann
Loading

Description

Fixes #17261
Removes delimiter symbol group from whitespace normalization FST since it is run post-tokenization.

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

@github-actions github-actions bot added the libcudf Affects libcudf (C++/CUDA) code. label Nov 7, 2024
@shrshi shrshi added bug Something isn't working cuIO cuIO issue non-breaking Non-breaking change labels Nov 7, 2024
@shrshi shrshi marked this pull request as ready for review November 7, 2024 14:17
@shrshi shrshi requested a review from a team as a code owner November 7, 2024 14:17
@shrshi shrshi requested review from vyasr and ttnghia November 7, 2024 14:17
@ttnghia ttnghia linked an issue Nov 7, 2024 that may be closed by this pull request
[BUG] cudf::io::json::detail::normalize_single_quotes outputs incorrect result when the input has \n character #17261
Closed
@ttnghia ttnghia mentioned this pull request Nov 7, 2024
Merged
@shrshi shrshi requested review from a team, davidwendt, karthikeyann and ttnghia and removed request for a team November 8, 2024 02:18
@ttnghia ttnghia removed their assignment Nov 8, 2024
@ttnghia ttnghia removed their assignment Nov 8, 2024
@karthikeyann
Copy link
Contributor

/merge

@karthikeyann karthikeyann added the 5 - Ready to Merge Testing and reviews complete, ready to merge label Nov 9, 2024
@rapids-bot rapids-bot bot merged commit 5cbdcd0 into rapidsai:branch-24.12 Nov 9, 2024
107 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@karthikeyann karthikeyann karthikeyann approved these changes

@davidwendt davidwendt davidwendt approved these changes

@ttnghia ttnghia ttnghia approved these changes

@vyasr vyasr Awaiting requested review from vyasr vyasr is a code owner automatically assigned from rapidsai/cudf-cpp-codeowners

Assignees

@karthikeyann karthikeyann

@shrshi shrshi

Labels
5 - Ready to Merge Testing and reviews complete, ready to merge bug Something isn't working cuIO cuIO issue libcudf Affects libcudf (C++/CUDA) code. non-breaking Non-breaking change
Projects
cuDF/Dask/Numba/UCX
Status: Done
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

[BUG] cudf::io::json::detail::normalize_single_quotes outputs incorrect result when the input has \n character
4 participants
@shrshi @karthikeyann @ttnghia @davidwendt