Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[exporter/pulsar] Make pulsarexporter configuration more configurable #28684

Closed
dao-jun opened this issue Oct 29, 2023 · 3 comments
Closed

[exporter/pulsar] Make pulsarexporter configuration more configurable #28684

dao-jun opened this issue Oct 29, 2023 · 3 comments

Comments

@dao-jun
Copy link
Member

dao-jun commented Oct 29, 2023

Component(s)

exporter/pulsar

Is your feature request related to a problem? Please describe.

Currently, in pulsar_exporter, configuration items only supports specify a single topic name for traces/metrics/logs.

And traces/metrics/logs exporter has default topic name(otlp_spans for traces, otlp_logs for logs and otlp_metrics for metrics), say, if users specify a topic for traces, but couldn't specify topic for logs and metrics. If users want to start a metrics exporter pipeline, it will be failed, because otlp_spans otlp_logs and otlp_metrics is not pulsar topic name pattern.

A topic name pattern must comply with a certain patter(pulsar://tenant/namespace/topic_name, example: pulsar://public/default/otlp_spans).

Also, pulsar_exporter only provide a single encoding configuration for logs,traces and metrics. Say, users want to use jaeger_proto for traces, but it couldn't apply to metrics and logs.

In this conditions, users have to config as below:

exporters:
  pulsar/trace:
    encoding: jaeger_json
    topic: pulsar://public/default/otlp_spans
    #ignore other items...

  pulsar/log:
    encoding: otlp_proto
    topic: pulsar://public/default/otlp_logs
    #ignore other items...

  pulsar/metric:
    encoding: otlp_proto
    topic: pulsar://public/default/otlp_metrics
    #ignore other items...

service:
  pipeline:
    traces:
      receivers: [otlp]
      processors: [batch]
      exporters: [pulsar/trace]

    logs:
      receivers: [otlp]
      processors: [batch]
      exporters: [pulsar/log]

    metrics:
      receivers: [otlp]
      processors: [batch]
      exporters: [pulsar/metric]

This is relatively complex, so I hope to make pulsar_exporter more configurable.

Describe the solution you'd like

Provide extra configuration items:

trace:
  topic:
  encoding:
log:
  topic:
  encoding:
metric:
  topic:
  encoding:

Describe alternatives you've considered

No response

Additional context

No response

@github-actions
Copy link
Contributor

Pinging code owners for exporter/pulsar: @dmitryax @dao-jun. See Adding Labels via Comments if you do not have permissions to add labels yourself.

Copy link
Contributor

github-actions bot commented Jan 1, 2024

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

@github-actions github-actions bot added the Stale label Jan 1, 2024
Copy link
Contributor

github-actions bot commented Mar 2, 2024

This issue has been closed as inactive because it has been stale for 120 days with no activity.

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Mar 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants