From b7e6efb8a9e62422d8d7a3f0df4a62bdbfab613e Mon Sep 17 00:00:00 2001 From: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com> Date: Fri, 1 Dec 2023 13:30:35 -0500 Subject: [PATCH 1/6] Resolved merge conflicts (#5737) Signed-off-by: Fanit Kolchina --- version-history.md | 1 + 1 file changed, 1 insertion(+) diff --git a/version-history.md b/version-history.md index f09517c56c..712fb4be1d 100644 --- a/version-history.md +++ b/version-history.md @@ -10,6 +10,7 @@ permalink: /version-history/ OpenSearch version | Release highlights | Release date :--- | :--- | :--- +[2.11.1](https://github.com/opensearch-project/opensearch-build/blob/main/release-notes/opensearch-release-notes-2.11.1.md) | Includes maintenance changes and bug fixes for cross-cluster replication, alerting, observability, OpenSearch Dashboards, index management, machine learning, security, and security analytics. For a full list of release highlights, see the Release Notes. | 30 November 2023 [2.11.0](https://github.com/opensearch-project/opensearch-build/blob/main/release-notes/opensearch-release-notes-2.11.0.md) | Adds multimodal and sparse neural search capability and the ability to take shallow snapshots that refer to data stored in remote-backed storage. Makes the search comparison tool generally available. Includes a simplified workflow to create threat detectors in Security Analytics and improved security in OpenSearch Dashboards. Experimental features include a new framework and toolset for distributed tracing and updates to conversational search. For a full list of release highlights, see the Release Notes. | 16 October 2023 [2.10.0](https://github.com/opensearch-project/opensearch-build/blob/main/release-notes/opensearch-release-notes-2.10.0.md) | Makes remote-backed storage generally available. Adds hybrid search capability, custom log types for Security Analytics, IP2Geo ingest processor, and delimited term frequency token filter. Includes a new look and feel for OpenSearch Dashboards and updates the Discover tool. Adds Microsoft Teams webhook support for notifications. Experimental features include concurrent segment search and conversational search. For a full list of release highlights, see the Release Notes. | 25 September 2023 [2.9.0](https://github.com/opensearch-project/opensearch-build/blob/main/release-notes/opensearch-release-notes-2.9.0.md) | Makes search pipelines and the Neural Search plugin generally available. Adds ML model access control and integration with external ML tools. Implements k-NN byte vectors and efficient filtering with the Faiss engine. Integrates alerting and anomaly detection with OpenSearch Dashboards and adds composite monitors. Adds two new index codec algorithm options. Includes a new ingestion schema for Security Analytics, geoshape aggregations, and extensions---a new mechanism for extending OpenSearch functionality. For a full list of release highlights, see the Release Notes. | 24 July 2023 From 9593de62366355fc060b7d327245e3f961fcfdee Mon Sep 17 00:00:00 2001 From: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com> Date: Fri, 1 Dec 2023 13:32:50 -0500 Subject: [PATCH 2/6] Updated doc_values for fields (#5619) (#5746) Signed-off-by: Harsha Vamsi Kalluri (cherry picked from commit ddbb16599b96e3d242d8bcb14eb908030622e10a) Co-authored-by: Harsha Vamsi Kalluri --- _opensearch/supported-field-types/binary.md | 2 +- _opensearch/supported-field-types/boolean.md | 2 +- _opensearch/supported-field-types/ip.md | 2 +- _opensearch/supported-field-types/numeric.md | 2 +- 4 files changed, 4 insertions(+), 4 deletions(-) diff --git a/_opensearch/supported-field-types/binary.md b/_opensearch/supported-field-types/binary.md index 2bc95c31ab..a87cb7306e 100644 --- a/_opensearch/supported-field-types/binary.md +++ b/_opensearch/supported-field-types/binary.md @@ -47,5 +47,5 @@ The following table lists the parameters accepted by binary field types. All par Parameter | Description :--- | :--- -`doc_values` | A Boolean value that specifies whether the field should be stored on disk so that it can be used for aggregations, sorting, or scripting. Optional. Default is `false`. +`doc_values` | A Boolean value that specifies whether the field should be stored on disk so that it can be used for aggregations, sorting, or scripting. Optional. Default is `true`. `store` | A Boolean value that specifies whether the field value should be stored and can be retrieved separately from the _source field. Optional. Default is `false`. \ No newline at end of file diff --git a/_opensearch/supported-field-types/boolean.md b/_opensearch/supported-field-types/boolean.md index 40affbde38..57580c806a 100644 --- a/_opensearch/supported-field-types/boolean.md +++ b/_opensearch/supported-field-types/boolean.md @@ -69,7 +69,7 @@ The following table lists the parameters accepted by Boolean field types. All pa Parameter | Description :--- | :--- `boost` | A floating-point value that specifies the weight of this field toward the relevance score. Values above 1.0 increase the field's relevance. Values between 0.0 and 1.0 decrease the field's relevance. Default is 1.0. -`doc_values` | A Boolean value that specifies whether the field should be stored on disk so that it can be used for aggregations, sorting or scripting. Default is `false`. +`doc_values` | A Boolean value that specifies whether the field should be stored on disk so that it can be used for aggregations, sorting or scripting. Default is `true`. `index` | A Boolean value that specifies whether the field should be searchable. Default is `true`. `meta` | Accepts metadata for this field. [`null_value`]({{site.url}}{{site.baseurl}}/opensearch/supported-field-types/index#null-value) | A value to be used in place of `null`. Must be of the same type as the field. If this parameter is not specified, the field is treated as missing when its value is `null`. Default is `null`. diff --git a/_opensearch/supported-field-types/ip.md b/_opensearch/supported-field-types/ip.md index 250e2da6a0..86f980a9ab 100644 --- a/_opensearch/supported-field-types/ip.md +++ b/_opensearch/supported-field-types/ip.md @@ -108,7 +108,7 @@ The following table lists the parameters accepted by ip field types. All paramet Parameter | Description :--- | :--- `boost` | A floating-point value that specifies the weight of this field toward the relevance score. Values above 1.0 increase the field's relevance. Values between 0.0 and 1.0 decrease the field's relevance. Default is 1.0. -`doc_values` | A Boolean value that specifies if the field should be stored on disk so that it can be used for aggregations, sorting, or scripting. Default is `false`. +`doc_values` | A Boolean value that specifies if the field should be stored on disk so that it can be used for aggregations, sorting, or scripting. Default is `true`. `ignore_malformed` | A Boolean value that specifies to ignore malformed values and not to throw an exception. Default is `false`. `index` | A Boolean value that specifies whether the field should be searchable. Default is `true`. [`null_value`]({{site.url}}{{site.baseurl}}/opensearch/supported-field-types/index#null-value) | A value to be used in place of `null`. Must be of the same type as the field. If this parameter is not specified, the field is treated as missing when its value is `null`. Default is `null`. diff --git a/_opensearch/supported-field-types/numeric.md b/_opensearch/supported-field-types/numeric.md index c12326e172..2b515d2fc7 100644 --- a/_opensearch/supported-field-types/numeric.md +++ b/_opensearch/supported-field-types/numeric.md @@ -103,7 +103,7 @@ Parameter | Description :--- | :--- `boost` | A floating-point value that specifies the weight of this field toward the relevance score. Values above 1.0 increase the field's relevance. Values between 0.0 and 1.0 decrease the field's relevance. Default is 1.0. `coerce` | A Boolean value that signals to truncate decimals for integer values and to convert strings to numeric values. Default is `true`. -`doc_values` | A Boolean value that specifies whether the field should be stored on disk so that it can be used for aggregations, sorting, or scripting. Default is `false`. +`doc_values` | A Boolean value that specifies whether the field should be stored on disk so that it can be used for aggregations, sorting, or scripting. Default is `true`. `ignore_malformed` | A Boolean value that specifies to ignore malformed values and not to throw an exception. Default is `false`. `index` | A Boolean value that specifies whether the field should be searchable. Default is `true`. `meta` | Accepts metadata for this field. From 86e9295b0572997bc7c376ab1b67036c1c009e6c Mon Sep 17 00:00:00 2001 From: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com> Date: Fri, 1 Dec 2023 16:02:57 -0500 Subject: [PATCH 3/6] Update link-checker.rb (#5756) Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com> --- _plugins/link-checker.rb | 1 + 1 file changed, 1 insertion(+) diff --git a/_plugins/link-checker.rb b/_plugins/link-checker.rb index 7db6976ad5..0a31edd686 100644 --- a/_plugins/link-checker.rb +++ b/_plugins/link-checker.rb @@ -54,6 +54,7 @@ module Jekyll::LinkChecker 'localhost', 'playground.opensearch.org', # inifite redirect, https://github.com/opensearch-project/dashboards-anywhere/issues/172 'crates.io', # 404s on bots + 'platform.openai.com', # 403s on bots 'www.cloudflare.com', # 403s on bots ] From 0db0828b124250435c3d921f5060138abfa82d79 Mon Sep 17 00:00:00 2001 From: "opensearch-trigger-bot[bot]" <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com> Date: Tue, 12 Dec 2023 15:11:30 -0500 Subject: [PATCH 4/6] Add 1.3.14 to version history (#5844) (#5850) (cherry picked from commit 365d536da79eb88dff3901ab9d37d473d1b76011) Signed-off-by: Fanit Kolchina Signed-off-by: github-actions[bot] Co-authored-by: github-actions[bot] --- version-history.md | 1 + 1 file changed, 1 insertion(+) diff --git a/version-history.md b/version-history.md index 712fb4be1d..7a8b42f396 100644 --- a/version-history.md +++ b/version-history.md @@ -27,6 +27,7 @@ OpenSearch version | Release highlights | Release date [2.0.1](https://github.com/opensearch-project/opensearch-build/blob/main/release-notes/opensearch-release-notes-2.0.1.md) | Includes bug fixes and maintenance updates for Alerting and Anomaly Detection. | 16 June 2022 [2.0.0](https://github.com/opensearch-project/opensearch-build/blob/main/release-notes/opensearch-release-notes-2.0.0.md) | Includes document-level monitors for alerting, OpenSearch Notifications plugins, and Geo Map Tiles in OpenSearch Dashboards. Also adds support for Lucene 9 and bug fixes for all OpenSearch plugins. For a full list of release highlights, see the Release Notes. | 26 May 2022 [2.0.0-rc1](https://github.com/opensearch-project/opensearch-build/blob/main/release-notes/opensearch-release-notes-2.0.0-rc1.md) | The Release Candidate for 2.0.0. This version allows you to preview the upcoming 2.0.0 release before the GA release. The preview release adds document-level alerting, support for Lucene 9, and the ability to use term lookup queries in document level security. | 03 May 2022 +[1.3.14](https://github.com/opensearch-project/opensearch-build/blob/main/release-notes/opensearch-release-notes-1.3.14.md) | Includes bug fixes and maintenance updates for OpenSearch security and OpenSearch Dashboards security. | 12 December 2023 [1.3.13](https://github.com/opensearch-project/opensearch-build/blob/main/release-notes/opensearch-release-notes-1.3.13.md) | Includes bug fixes for Anomaly Detection, adds maintenance updates and infrastructure enhancements. | 21 September 2023 [1.3.12](https://github.com/opensearch-project/opensearch-build/blob/main/release-notes/opensearch-release-notes-1.3.12.md) | Adds maintenance updates for OpenSearch security and OpenSearch Dashboards observability. Includes bug fixes for observability, OpenSearch Dashboards visualizations, and OpenSearch security. | 10 August 2023 [1.3.11](https://github.com/opensearch-project/opensearch-build/blob/main/release-notes/opensearch-release-notes-1.3.11.md) | Adds maintenance updates for OpenSearch security, OpenSearch Dashboards security, and ML Commons. | 29 June 2023 From 7520c3a6ed5a6621c3f3f62c4a03e62c6a313df5 Mon Sep 17 00:00:00 2001 From: "opensearch-trigger-bot[bot]" <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com> Date: Fri, 15 Dec 2023 15:02:07 -0800 Subject: [PATCH 5/6] Fixing OpenSearch operator helm install (#5865) (#5905) (cherry picked from commit d248daa73609b81dded65398654df5a5ffce7d69) Signed-off-by: David Tippett <17506770+dtaivpp@users.noreply.github.com> Signed-off-by: github-actions[bot] Co-authored-by: github-actions[bot] --- _clients/k8s-operator.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/_clients/k8s-operator.md b/_clients/k8s-operator.md index 1461b182cd..0cfeca10eb 100644 --- a/_clients/k8s-operator.md +++ b/_clients/k8s-operator.md @@ -21,7 +21,7 @@ If you use Helm to manage your Kubernetes cluster, you can use the OpenSearch Ku To begin, log in to your Kubernetes cluster and add the Helm repository (repo) from [Artifact Hub](https://artifacthub.io/packages/helm/opensearch-operator/opensearch-operator/). ``` -helm repo add opensearch-operator https://opster.github.io/opensearch-k8s-operator/ +helm repo add opensearch-operator https://opensearch-project.github.io/opensearch-k8s-operator/ ``` Make sure that the repo is included in your Kubernetes cluster. From e8052525c63c30f854fccfe5a0c2a5308805a2d5 Mon Sep 17 00:00:00 2001 From: "opensearch-trigger-bot[bot]" <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com> Date: Wed, 20 Dec 2023 13:34:03 -0500 Subject: [PATCH 6/6] Fix default doc values for keyword field type (#5924) (#5930) (cherry picked from commit 20f45b88f45c021e9408db3f3d9e2288f08b37c2) Signed-off-by: Fanit Kolchina Signed-off-by: github-actions[bot] Co-authored-by: github-actions[bot] --- _opensearch/supported-field-types/keyword.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/_opensearch/supported-field-types/keyword.md b/_opensearch/supported-field-types/keyword.md index cfa522f599..e74d08d397 100644 --- a/_opensearch/supported-field-types/keyword.md +++ b/_opensearch/supported-field-types/keyword.md @@ -39,7 +39,7 @@ The following table lists the parameters accepted by keyword field types. All pa Parameter | Description :--- | :--- `boost` | A floating-point value that specifies the weight of this field toward the relevance score. Values above 1.0 increase the field's relevance. Values between 0.0 and 1.0 decrease the field's relevance. Default is 1.0. -`doc_values` | A Boolean value that specifies whether the field should be stored on disk so that it can be used for aggregations, sorting, or scripting. Default is `false`. +`doc_values` | A Boolean value that specifies whether the field should be stored on disk so that it can be used for aggregations, sorting, or scripting. Default is `true`. `eager_global_ordinals` | Specifies whether global ordinals should be loaded eagerly on refresh. If the field is often used for aggregations, this parameter should be set to `true`. Default is `false`. `fields` | To index the same string in several ways (for example, as a keyword and text), provide the fields parameter. You can specify one version of the field to be used for search and another to be used for sorting and aggregations. `ignore_above` | Any string longer than this integer value should not be indexed. Default is 2147483647. Default dynamic mapping creates a keyword subfield for which `ignore_above` is set to 256.