-
Notifications
You must be signed in to change notification settings - Fork 207
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
-Support for Source Codecs #2519
-Support for Source Codecs #2519
Conversation
Signed-off-by: umairofficial <[email protected]>
@@ -61,22 +62,12 @@ private void parseBufferedReader(final BufferedReader reader, final Consumer<Rec | |||
} | |||
|
|||
MappingIterator<Map<String, String>> parsingIterator = mapper.readerFor(Map.class).with(schema).readValues(reader); | |||
boolean hasNextValue; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@umayr-codes , You have reverted some changes in your most recent rebase. See this commit: bc75494
I believe you can resolve this issue by changing all the code from this line through the end of this file back. Basically, we should not see any diffs after line 41.
You may also need to check the imports above.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Its done David!
@@ -282,7 +280,7 @@ void test_when_manualHeaderTooManyColumns_then_omitsExtraColumnsOnParsedEvents(f | |||
|
|||
@ParameterizedTest | |||
@ValueSource(ints = {2, 10, 100}) | |||
void test_when_autoDetectHeaderWrongNumberColumnsAndJaggedRows_then_skipsRemainingRows(final int numberOfRows) throws IOException { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Similar to my comment above about bc75494, this PR currently is reverting changes in main that need to remain.
You should revert back the changes starting at this line. There should be no diffs from this point forward.
Also, please check the imports.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done! Thanks for pointing out.
Signed-off-by: umairofficial <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Removing accidental approval
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Removing accidental approval
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good.
Looks good Umair |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @umayr-codes ! We should be able to merge once all the checks pass.
Signed-off-by: umairofficial [email protected]
Description
InputCodec
interface added indata-prepper-api
packages3-source
toparse-json-processor
s3-source
tocsv-processor
s3-source
tonewline-codecs
Issues Resolved
Resolves #1532
Check List
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.