Receive logs in normal JSON or plain text from Kafka.

[h0cheung]

Component(s)

receiver/kafka

Is your feature request related to a problem? Please describe.

Some tools and cloud services may send logs to Kafka in JSON format or even as plain text. We don't have a way to receive them yet. The raw unmarshaler can only receive them as bytes, and we can't even find any component to decode them into strings. Also, it doesn't add ObservedTime to the logs, which should be added.

Describe the solution you'd like

We should add a text unmarshaler to decode the logs from Kafka messages into strings, and add ObservedTime to them. For compatibility, encodings rather than UTF-8, such as GBK, BIG5, SHIFT_JIS, etc. should be supported.

Describe alternatives you've considered

No response

Additional context

No response

[github-actions]

Pinging code owners:

• receiver/kafka: @pavolloffay @MovieStoreGuy

See Adding Labels via Comments if you do not have permissions to add labels yourself.

[atoulme]

That sounds like a good enhancement to me (I implemented raw support, maybe raw should move from byte array to string).

[github-actions]

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

• receiver/kafka: @pavolloffay @MovieStoreGuy

See Adding Labels via Comments if you do not have permissions to add labels yourself.

[github-actions]

This issue has been closed as inactive because it has been stale for 120 days with no activity.

[crobert-1]

It looks like this was actually resolved by #20857 and #24028, I'll mark it as such.