[Feature][Sort] Provides a method to add openTelemetryAppender for the sort connector

[qy-liuhuo]

Description

• parent issue [Umbrella] Tencent Rhino-bird: Integrate Sort with OpenTelemetry #10798

Since the sort task will be run on different TaskManager nodes, in order to more conveniently view the log output, we can consider using OpenTelemetry to achieve centralized log reporting.

Use case

To achieve the above function, we needs to configure an OpenTelemetryAppender for log4j:

When submitting tasks in the form of jobGraph, TaskManager uses log4j2-console.properties for configuration by default. However, this method will cause the OpenTelemetryAppender in the connector to be inconsistent with the OpenTelemetryAppender instance loaded when Flink is initialized, resulting in the appender not being able to be used normally.

For this reason, consider dynamically adding openTelemetryAppender in connect based on log4j-api, developing OpenTelemetryLogger class, and providing initial, install and ubinstall functions for OpenTelemetryAppender.

The way to integrate OpenTelemetryAppender for connectors that comply with the FLIP-27 standard is as follows:

1. Create a new OpenTelemetryLogger object in the corresponding SourceReader construction method and configure relevant parameters(log-collector endpoint，logLevel，layout and so on)
2. Call the install method of the openTelemetryLogger object in the start method of SourceReader
3. Call the uninstall method of the openTelemetryLogger object in the close method of SourceReader

Are you willing to submit PR?

• Yes, I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct