Add 'data.stream.namespace' configuration property

[srishti-saraswat]

Problem

Original PR - #742
PR to expose this config on cloud - https://github.com/confluentinc/kafka-connect-elasticsearch-private/pull/43

Solution

Does this solution apply anywhere else?

• yes
• no

If yes, where?

Test Strategy

Tested using docker playground
Case 1: correct data stream namespace
connector configs -

{
     "connector.class": "io.confluent.connect.elasticsearch.ElasticsearchSinkConnector",
     "tasks.max": "1",
     "topics": "test-elasticsearch-sink",
     "key.ignore": "true",
     "connection.url": "*********",
     "connection.username": "********",
     "connection.password": "********",
     "data.stream.namespace": "ssaraswat${topic}"
}

result -

12:46:10 ℹ️ ####################################################
12:46:10 ℹ️ ✅ RESULT: SUCCESS for elasticsearch-sink.sh (took: 2min 10sec - )
12:46:10 ℹ️ ####################################################

12:46:15 ℹ️ 🧩 Displaying status for 🌎onprem connector elasticsearch-sink
Name                           Status       Tasks                                                        Stack Trace                                       
-------------------------------------------------------------------------------------------------------------
elasticsearch-sink             ✅ RUNNING  0:🟢 RUNNING[connect]        -                                                 
-------------------------------------------------------------------------------------------------------------

Case 2: incorrect data stream namespace
connector configs -

{
     "connector.class": "io.confluent.connect.elasticsearch.ElasticsearchSinkConnector",
     "tasks.max": "1",
     "topics": "test-elasticsearch-sink",
     "key.ignore": "true",
     "connection.url": "*********",
     "connection.username": "********",
     "connection.password": "********",
     "data.stream.namespace": "ssaraswat$-{topic}"
}

result -

12:56:43 🔥 Command failed with error code 400
12:56:43 🔥 Connector configuration is invalid and contains the following 1 error(s):
Invalid value ssaraswat- for configuration data.stream.namespace: The specified namespace must not contain any spaces or invalid characters \/*?"<>|,#-:
You can also find the above list of errors at the endpoint `/connector-plugins/{connectorType}/config/validate`

Testing done:

• Unit tests
• Integration tests
• System tests
• Manual tests

Release Plan

[confluent-cla-assistant]

🎉 All Contributor License Agreements have been signed. Ready to merge.
_{Please push an empty commit if you would like to re-run the checks to verify CLA status for all contributors.}

The base branch was changed.

[sonarqube-confluent]

• 70.40% Coverage on New Code (is less than 80.00%)

Analysis Details

4 Issues

• 0 Bugs
• 1 Vulnerability
• 3 Code Smells

Coverage and Duplications

• 70.40% Coverage (58.40% Estimated after merge)
• No duplication information (1.20% Estimated after merge)

Project ID: kafka-connect-elasticsearch

View in SonarQube