Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert "[Remove] MainResponse version override cluster setting (#3031) (#3032)" #3530

Merged

Conversation

nknize
Copy link
Collaborator

@nknize nknize commented Jun 7, 2022

This reverts commit 199fbb8 which removed the opensearch.http.override_main_response_version cluster setting.

The setting was originally added so users of legacy clients would not have to upgrade their client to begin using OpenSearch 1.x.
With 2.0 the REST API is further fragmented from legacy clients such that users are forced to upgrade to the latest OpenSearch client.
To reduce this friction OpenSearch is working on a REST API Versioning mechanism to support API compatibility with at least the legacy 7.x line; but this will not be ready until 2.2 at the earliest.

The immediate problem is that there is no OpenSearch version of Beats and Logstash and the upstream maintainers of these projects have no plans to support OpenSearch.
This has already lead to user pain regarding document type removal in beats which is alleviated by ignoring type removal in the bulk API and temporarily adding the docType endpoints back for certain REST APIs.
It is also leading to pain for users of different pipeline processor types in filebeat as these processors have explicit version checks for compatibility only with Elasticsearch.

To alleviate this pain, OpenSearch adds back the opensearch.http.override_main_response_version setting so users of Beats and logstash can continue to function by spoofing the OpenSearch cluster version to 7.10.2.

@nknize nknize added backwards-compatibility Clients Clients within the Core repository such as High level Rest client and low level client v2.1.0 Issues and PRs related to version 2.1.0 backport 2.0 Backport to 2.0 branch labels Jun 7, 2022
@nknize nknize requested review from a team and reta as code owners June 7, 2022 17:50
@nknize nknize force-pushed the revert/mainResponseVersionSpoof2.x branch from f9a154b to 61403f0 Compare June 7, 2022 17:50
@opensearch-ci-bot
Copy link
Collaborator

✅   Gradle Check success 61403f0
Log 5826

Reports 5826

Copy link
Member

@dreamer-89 dreamer-89 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@saratvemulapalli
Copy link
Member

@nknize thanks for this PR.
We removed the documentation opensearch-project/documentation-website#517
We should add it back if intend to support it.
cc: @alicejw-aws

nknize pushed a commit that referenced this pull request Jun 9, 2022
#3032)" (#3530) (#3536)

This reverts commit 199fbb8.

Signed-off-by: Nicholas Walter Knize <[email protected]>
(cherry picked from commit 069948a)
@dreamer-89
Copy link
Member

@saratvemulapalli @alicejw-aws: Looks like https://opensearch.org/docs/latest/clients/agents-and-ingestion-tools/index/ is still not updated.

@mannukalra
Copy link

compatibility.override_main_response_version: true is supported v2.1.0 onwards
wazuh/wazuh-dashboard-plugins#4160 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport 2.0 Backport to 2.0 branch backwards-compatibility Clients Clients within the Core repository such as High level Rest client and low level client v2.1.0 Issues and PRs related to version 2.1.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants