Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[receiver/pulsarreceiver] enhance pulsar receiver #28681

Closed

Conversation

dao-jun
Copy link
Member

@dao-jun dao-jun commented Oct 28, 2023

Fixes: #28685
Description:

  1. Remove topic,subscription,encoding,consumer_name configuration items
  2. Introduce trace,metric,log items
  3. Code refactor
  4. Introduce otlp_json unmarshaler for traces,logs and metrics

Link to tracking Issue:

Testing:
unit tests

Documentation:
Update README.md

@VihasMakwana
Copy link
Contributor

Also, now that we support OTLP Json and Protobuf, you might wanna tweak the test cases to make CI green.

- `zipkin_json`: the payload is deserialized into a list of Zipkin V2 JSON spans.
- `zipkin_thrift`: the payload is deserialized into a list of Zipkin Thrift spans.
- `consumer_name`: specifies the consumer name.
- `trace`
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why do we need to make this breaking change if we still want to migrate to the encoding extensions after that? I think it's better to avoid introducing this intermediary config interface.

Also, we need to try to avoid such breaking changes. Ideally, we need to keep the old interface functioning for some time with deprecation warning logs.

If you have any other changes not breaking the user config like refactoring, feel free to submit other PRs.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The introduction of new encoding methods is only a small part of the reason, I created an issue for the PR #28685, please take a look.

The component currently in the Alpha phase, I think the configuration changes comply with the agreement.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Even for alpha, we should try to avoid breaking changes if possible.

Copy link
Contributor

This PR was marked stale due to lack of activity. It will be closed in 14 days.

@github-actions github-actions bot added the Stale label Nov 16, 2023
Copy link
Contributor

Closed as inactive. Feel free to reopen if this PR is still being worked on.

@github-actions github-actions bot closed this Nov 30, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[receiver/pulsar] Make pulsar_receiver more configurable
4 participants