-
Notifications
You must be signed in to change notification settings - Fork 78
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Empty line at the end causes cobrix to create 1 more record #397
Comments
Can I ask you to attach the test file? |
I've noticed something interesting. Try removing |
Bug confirmed. It happens when |
For example we have file like this with empty line at the end :
fdhfhdsfsdff
dfdhjfwdsdd
dsfddkkfkgk
And if I read it by specifying
spark.read
.format("cobol")
.option("is_record_sequence", "true")
.option("is_text", "true")
.option("encoding", "ascii")
.option("copybook", path_to_copybook)
.load(path_to_file)
I get 4 records instead of 3, so is that a bug or it can be fixed by some option?
The text was updated successfully, but these errors were encountered: