You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This was an audit for Spark 3.5 apache/spark#29516 where the CSV parser was changed to not consider lines that start with a null character as comments.
Likely this falls under the corner case category, but something we should at least investigate.
The text was updated successfully, but these errors were encountered:
Yes this is probably a corner case, but we use the "null" character to turn off comments in CUDF. So it might be more relevant than we think. At least we should test it and document any differences.
This was an audit for Spark 3.5 apache/spark#29516 where the CSV parser was changed to not consider lines that start with a null character as comments.
Likely this falls under the corner case category, but something we should at least investigate.
The text was updated successfully, but these errors were encountered: