Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for source codecs | Avro Codec #2397

Closed
wants to merge 13 commits into from

Conversation

umairofficial
Copy link
Contributor

Description

Avro Codec implementation added with 100% unit test case coverage.

Issues Resolved

Resolves #1532 : Avro rows now parsed correctly into Event objects, is proper key value pair format.

Check List

  • New functionality includes testing.
  • New functionality has been documented.
    • New functionality has javadoc added
  • Commits are signed with a real name per the DCO

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

mahesh724 and others added 13 commits January 23, 2023 13:47
-Repository Restructured
-JSONCodec moved from S3Source Plugin to parse-json-processor package
-CSVCodec moved from SESource Plugin to csv-processor package
-NewLine Codec moved from SESource Plugin to NewLine-Codecs package
Description:
- Package naming convention changed
- @tempdir used in ParquetInputCodecTest class
- Gradle build files updated
- Wildcard imports removed

Signed-off-by: Mahesh Kariya [email protected]
-Deleted all unwanted files

Signed-off-by: Mahesh Kariya <[email protected]>
-Unit test cases added
Signed-off-by: umairofficial <[email protected]>
-Unit test cases added
Signed-off-by: umairofficial <[email protected]>
@umairofficial umairofficial requested a review from a team as a code owner March 23, 2023 07:53

@Test
public void test_when_nullInputStream_then_throwsException(){
avroInputCodec=new AvroInputCodec();
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This statement is not needed because setup() is doing the initialization of avroInputCodec


@Test
public void parse_with_Invalid_InputStream_then_catches_exception() {
avroInputCodec=new AvroInputCodec();
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same here and in all the test cases below.

for (final Record<Event> actualRecord : actualRecords) {

assertThat(actualRecord, notNullValue());
assertThat(actualRecord.getData(), notNullValue());
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please verify that the events in the records have person, age and name are present and have expected values.

@umairofficial
Copy link
Contributor Author

Closing this PR is favour of #2414.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support generic parsers/codecs
3 participants