Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disallowing compression level for lz4 and best_compression codec #8737

Merged

Conversation

sarthakaggarwal97
Copy link
Contributor

@sarthakaggarwal97 sarthakaggarwal97 commented Jul 18, 2023

Description

This PR will disallow the compression level to be set for default and best_compression codec. Compression level does not hold any impact on these two codecs

Related Issues

Resolves #8677

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • Commits are signed per the DCO using --signoff
  • Commit changes are listed out in CHANGELOG.md file (See: Changelog)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@codecov
Copy link

codecov bot commented Jul 18, 2023

Codecov Report

Merging #8737 (3d58641) into main (a3aab67) will increase coverage by 0.07%.
The diff coverage is 80.00%.

@@             Coverage Diff              @@
##               main    #8737      +/-   ##
============================================
+ Coverage     71.00%   71.08%   +0.07%     
- Complexity    57166    57266     +100     
============================================
  Files          4763     4763              
  Lines        270003   270022      +19     
  Branches      39508    39512       +4     
============================================
+ Hits         191713   191932     +219     
+ Misses        62139    61976     -163     
+ Partials      16151    16114      -37     
Files Changed Coverage Δ
...java/org/opensearch/index/engine/EngineConfig.java 96.05% <77.77%> (-2.47%) ⬇️
...opensearch/index/codec/customcodecs/ZstdCodec.java 100.00% <100.00%> (ø)
...arch/index/codec/customcodecs/ZstdNoDictCodec.java 100.00% <100.00%> (ø)

... and 462 files with indirect coverage changes

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@sarthakaggarwal97 sarthakaggarwal97 force-pushed the comp-level-update branch 2 times, most recently from 5509c12 to f9c024c Compare July 28, 2023 09:28
@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@sarthakaggarwal97
Copy link
Contributor Author

@reta thanks for the review! The build is green now, please have a look!

Copy link
Contributor

@backslasht backslasht left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@sarthakaggarwal97
Copy link
Contributor Author

@shwetathareja please review and hit merge if it looks good!

@shwetathareja
Copy link
Member

Helping with the merge as there are 2 approvals already from @backslasht & @reta

@shwetathareja shwetathareja merged commit 82b5f3c into opensearch-project:main Aug 2, 2023
9 checks passed
@shwetathareja shwetathareja added the backport 2.x Backport to 2.x branch label Aug 2, 2023
opensearch-trigger-bot bot pushed a commit that referenced this pull request Aug 2, 2023
* Disallowing compression level for lz4 and best_compression codec
* setting up codec settings interface for validation

Signed-off-by: Sarthak Aggarwal <[email protected]>
(cherry picked from commit 82b5f3c)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
reta pushed a commit that referenced this pull request Aug 2, 2023
…) (#9060)

* Disallowing compression level for lz4 and best_compression codec
* setting up codec settings interface for validation


(cherry picked from commit 82b5f3c)

Signed-off-by: Sarthak Aggarwal <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
kaushalmahi12 pushed a commit to kaushalmahi12/OpenSearch that referenced this pull request Sep 12, 2023
…nsearch-project#8737)

* Disallowing compression level for lz4 and best_compression codec
* setting up codec settings interface for validation

Signed-off-by: Sarthak Aggarwal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>
brusic pushed a commit to brusic/OpenSearch that referenced this pull request Sep 25, 2023
…nsearch-project#8737)

* Disallowing compression level for lz4 and best_compression codec
* setting up codec settings interface for validation

Signed-off-by: Sarthak Aggarwal <[email protected]>
Signed-off-by: Ivan Brusic <[email protected]>
github-merge-queue bot referenced this pull request in camunda/camunda Apr 10, 2024
#17405)

[![Mend
Renovate](https://app.renovatebot.com/images/banner.svg)](https://renovatebot.com)

This PR contains the following updates:

| Package | Update | Change |
|---|---|---|
|
[opensearchproject/opensearch](https://togithub.com/opensearch-project/OpenSearch)
| minor | `2.5.0` -> `2.13.0` |

---

> [!WARNING]
> Some dependencies could not be looked up. Check the Dependency
Dashboard for more information.

---

### Release Notes

<details>
<summary>opensearch-project/OpenSearch
(opensearchproject/opensearch)</summary>

###
[`v2.13.0`](https://togithub.com/opensearch-project/OpenSearch/releases/tag/2.13.0)

[Compare
Source](https://togithub.com/opensearch-project/OpenSearch/compare/2.12.0...2.13.0)

##### 2024-03-21 Version 2.13.0 Release Notes

##### \[2.13.0]

##### Added

- \[Tiered caching] Introducing cache plugins and exposing Ehcache as
one of the pluggable disk cache option
([#&#8203;11874](https://togithub.com/opensearch-project/OpenSearch/pull/11874))
- Add support for dependencies in plugin descriptor properties with
semver range
([#&#8203;11441](https://togithub.com/opensearch-project/OpenSearch/pull/11441))
- Add community_id ingest processor
([#&#8203;12121](https://togithub.com/opensearch-project/OpenSearch/pull/12121))
- Introduce query level setting `index.query.max_nested_depth` limiting
nested queries
([#&#8203;3268](https://togithub.com/opensearch-project/OpenSearch/issues/3268)
- Add toString methods to MultiSearchRequest, MultiGetRequest and
CreateIndexRequest
([#&#8203;12163](https://togithub.com/opensearch-project/OpenSearch/pull/12163))
- Fix error in RemoteSegmentStoreDirectory when debug logging is enabled
([#&#8203;12328](https://togithub.com/opensearch-project/OpenSearch/pull/12328))
- Support for returning scores in matched queries
([#&#8203;11626](https://togithub.com/opensearch-project/OpenSearch/pull/11626))
- Add shard id property to SearchLookup for use in field types provided
by plugins
([#&#8203;1063](https://togithub.com/opensearch-project/OpenSearch/pull/1063))
- \[Tiered caching] Make IndicesRequestCache implementation configurable
\[EXPERIMENTAL]
([#&#8203;12533](https://togithub.com/opensearch-project/OpenSearch/pull/12533))
- Force merge API supports performing on primary shards only
([#&#8203;11269](https://togithub.com/opensearch-project/OpenSearch/pull/11269))
- Add kuromoji_completion analyzer and filter
([#&#8203;4835](https://togithub.com/opensearch-project/OpenSearch/issues/4835))
- \[Admission Control] Integrate IO Usage Tracker to the Resource Usage
Collector Service and Emit IO Usage Stats
([#&#8203;11880](https://togithub.com/opensearch-project/OpenSearch/pull/11880))
- The org.opensearch.bootstrap.Security should support codebase for JAR
files with classifiers
([#&#8203;12586](https://togithub.com/opensearch-project/OpenSearch/issues/12586))
- Remote reindex: Add support for configurable retry mechanism
([#&#8203;12561](https://togithub.com/opensearch-project/OpenSearch/pull/12561))
- Tracing for deep search path
([#&#8203;12103](https://togithub.com/opensearch-project/OpenSearch/pull/12103))
- \[Metrics Framework] Adds support for asynchronous gauge metric type.
([#&#8203;12642](https://togithub.com/opensearch-project/OpenSearch/issues/12642))
- \[Tiered caching] Add Stale keys Management and CacheCleaner to
IndicesRequestCache
([#&#8203;12625](https://togithub.com/opensearch-project/OpenSearch/pull/12625))
- Make search query counters dynamic to support all query types
([#&#8203;12601](https://togithub.com/opensearch-project/OpenSearch/pull/12601))
- \[Tiered caching] Add policies controlling which values can enter
pluggable caches \[EXPERIMENTAL]
([#&#8203;12542](https://togithub.com/opensearch-project/OpenSearch/pull/12542))
- \[Tiered caching] Add serializer integration to allow ehcache disk
cache to use non-primitive values
([#&#8203;12709](https://togithub.com/opensearch-project/OpenSearch/pull/12709))
- \[Admission Control] Integrated IO Based AdmissionController to
AdmissionControl Framework
([#&#8203;12583](https://togithub.com/opensearch-project/OpenSearch/pull/12583))
- Add Remote Store Migration Experimental flag and allow mixed mode
clusters under same
([#&#8203;11986](https://togithub.com/opensearch-project/OpenSearch/pull/11986))
- Built-in secure transports support
([#&#8203;12435](https://togithub.com/opensearch-project/OpenSearch/pull/12435))
- Lightweight Transport action to verify local term before fetching
cluster-state from remote
([#&#8203;12252](https://togithub.com/opensearch-project/OpenSearch/pull/12252/))
- Integrate with admission controller for cluster-manager Read API.
([#&#8203;12496](https://togithub.com/opensearch-project/OpenSearch/pull/12496))
- Introduce a new setting `index.check_pending_flush.enabled` to expose
the ability to disable the check for pending flushes by write threads
([#&#8203;12710](https://togithub.com/opensearch-project/OpenSearch/pull/12710))

##### Dependencies

- Bump `com.squareup.okio:okio` from 3.7.0 to 3.8.0
([#&#8203;12290](https://togithub.com/opensearch-project/OpenSearch/pull/12290))
- Bump `org.bouncycastle:bcprov-jdk15to18` to
`org.bouncycastle:bcprov-jdk18on` version 1.77
([#&#8203;12326](https://togithub.com/opensearch-project/OpenSearch/pull/12326))
- Bump `org.bouncycastle:bcmail-jdk15to18` to
`org.bouncycastle:bcmail-jdk18on` version 1.77
([#&#8203;12326](https://togithub.com/opensearch-project/OpenSearch/pull/12326))
- Bump `org.bouncycastle:bcpkix-jdk15to18` to
`org.bouncycastle:bcpkix-jdk18on` version 1.77
([#&#8203;12326](https://togithub.com/opensearch-project/OpenSearch/pull/12326))
- Bump `gradle/wrapper-validation-action` from 1 to 2
([#&#8203;12367](https://togithub.com/opensearch-project/OpenSearch/pull/12367))
- Bump `netty` from 4.1.106.Final to 4.1.107.Final
([#&#8203;12372](https://togithub.com/opensearch-project/OpenSearch/pull/12372))
- Bump `opentelemetry` from 1.34.1 to 1.36.0
([#&#8203;12388](https://togithub.com/opensearch-project/OpenSearch/pull/12388),
[#&#8203;12618](https://togithub.com/opensearch-project/OpenSearch/pull/12618))
- Bump Apache Lucene from 9.9.2 to 9.10.0
([#&#8203;12392](https://togithub.com/opensearch-project/OpenSearch/pull/12392))
- Bump `org.apache.logging.log4j:log4j-core` from 2.22.1 to 2.23.1
([#&#8203;12464](https://togithub.com/opensearch-project/OpenSearch/pull/12464),
[#&#8203;12587](https://togithub.com/opensearch-project/OpenSearch/pull/12587))
- Bump `antlr4` from 4.11.1 to 4.13.1
([#&#8203;12445](https://togithub.com/opensearch-project/OpenSearch/pull/12445))
- Bump `com.netflix.nebula.ospackage-base` from 11.8.0 to 11.8.1
([#&#8203;12461](https://togithub.com/opensearch-project/OpenSearch/pull/12461))
- Bump `peter-evans/create-or-update-comment` from 3 to 4
([#&#8203;12462](https://togithub.com/opensearch-project/OpenSearch/pull/12462))
- Bump `lycheeverse/lychee-action` from 1.9.1 to 1.9.3
([#&#8203;12521](https://togithub.com/opensearch-project/OpenSearch/pull/12521))
- Bump `com.azure:azure-core` from 1.39.0 to 1.47.0
([#&#8203;12520](https://togithub.com/opensearch-project/OpenSearch/pull/12520))
- Bump `ch.qos.logback:logback-core` from 1.2.13 to 1.5.3
([#&#8203;12519](https://togithub.com/opensearch-project/OpenSearch/pull/12519))
- Bump `codecov/codecov-action` from 3 to 4
([#&#8203;12585](https://togithub.com/opensearch-project/OpenSearch/pull/12585))
- Bump `org.apache.zookeeper:zookeeper` from 3.9.1 to 3.9.2
([#&#8203;12580](https://togithub.com/opensearch-project/OpenSearch/pull/12580))
- Bump `org.codehaus.woodstox:stax2-api` from 4.2.1 to 4.2.2
([#&#8203;12579](https://togithub.com/opensearch-project/OpenSearch/pull/12579))
- Bump Jackson version from 2.16.1 to 2.17.0
([#&#8203;12611](https://togithub.com/opensearch-project/OpenSearch/pull/12611),
[#&#8203;12662](https://togithub.com/opensearch-project/OpenSearch/pull/12662))
- Bump `reactor-netty` from 1.1.15 to 1.1.17
([#&#8203;12633](https://togithub.com/opensearch-project/OpenSearch/pull/12633))
- Bump `reactor` from 3.5.14 to 3.5.15
([#&#8203;12633](https://togithub.com/opensearch-project/OpenSearch/pull/12633))
- Bump `aws-sdk-java` from 2.20.55 to 2.20.86
([#&#8203;12251](https://togithub.com/opensearch-project/OpenSearch/pull/12251))

##### Changed

- Allow composite aggregation to run under a parent filter aggregation
([#&#8203;11499](https://togithub.com/opensearch-project/OpenSearch/pull/11499))
- Quickly compute terms aggregations when the top-level query is
functionally match-all for a segment
([#&#8203;11643](https://togithub.com/opensearch-project/OpenSearch/pull/11643))
- Mark fuzzy filter GA and remove experimental setting
([12631](https://togithub.com/opensearch-project/OpenSearch/pull/12631))
- Keep the election scheduler open until cluster state has been applied
([#&#8203;11699](https://togithub.com/opensearch-project/OpenSearch/pull/11699))

##### Fixed

- \[Revert] \[Bug] Check phase name before
SearchRequestOperationsListener onPhaseStart
([#&#8203;12035](https://togithub.com/opensearch-project/OpenSearch/pull/12035))
- Add support of special WrappingSearchAsyncActionPhase so the
onPhaseStart() will always be followed by onPhaseEnd() within
AbstractSearchAsyncAction
([#&#8203;12293](https://togithub.com/opensearch-project/OpenSearch/pull/12293))
- Add a system property to configure YamlParser codepoint limits
([#&#8203;12298](https://togithub.com/opensearch-project/OpenSearch/pull/12298))
- Prevent read beyond slice boundary in ByteArrayIndexInput
([#&#8203;10481](https://togithub.com/opensearch-project/OpenSearch/issues/10481))
- Fix the "highlight.max_analyzer_offset" request parameter with "plain"
highlighter
([#&#8203;10919](https://togithub.com/opensearch-project/OpenSearch/pull/10919))
- Prevent unnecessary fetch sub phase processor initialization during
fetch phase execution
([#&#8203;12503](https://togithub.com/opensearch-project/OpenSearch/pull/12503))
- Fix `terms` query on `float` field when `doc_values` are turned off by
reverting back to `FloatPoint` from `FloatField`
([#&#8203;12499](https://togithub.com/opensearch-project/OpenSearch/pull/12499))
- Fix get task API does not refresh resource stats
([#&#8203;11531](https://togithub.com/opensearch-project/OpenSearch/pull/11531))
- Fix for deserilization bug in weighted round-robin metadata
([#&#8203;11679](https://togithub.com/opensearch-project/OpenSearch/pull/11679))
- onShardResult and onShardFailure are executed on one shard causes
opensearch jvm crashed
([#&#8203;12158](https://togithub.com/opensearch-project/OpenSearch/pull/12158))
- Avoid overflow when sorting missing last on `epoch_millis` datetime
field
([#&#8203;12676](https://togithub.com/opensearch-project/OpenSearch/pull/12676))

###
[`v2.12.0`](https://togithub.com/opensearch-project/OpenSearch/releases/tag/2.12.0)

[Compare
Source](https://togithub.com/opensearch-project/OpenSearch/compare/2.11.1...2.12.0)

#### 2024-02-09 Version 2.12.0 Release Notes

#### \[2.12.0]

##### Added

- \[Admission control] Add Resource usage collector service and resource
usage tracker
([#&#8203;9890](https://togithub.com/opensearch-project/OpenSearch/pull/9890))
- \[Admission control] Add enhancements to FS stats to include
read/write time, queue size and IO time
([#&#8203;10541](https://togithub.com/opensearch-project/OpenSearch/pull/10541))
- \[Remote cluster state] Change file names for remote cluster state
([#&#8203;10557](https://togithub.com/opensearch-project/OpenSearch/pull/10557))
- \[Search Pipelines] Add request-scoped state shared between processors
(and three new processors)
([#&#8203;9405](https://togithub.com/opensearch-project/OpenSearch/pull/9405))
- Per request phase latency
([#&#8203;10351](https://togithub.com/opensearch-project/OpenSearch/issues/10351))
- \[Remote Store] Add repository stats for remote
store([#&#8203;10567](https://togithub.com/opensearch-project/OpenSearch/pull/10567))
- \[Remote cluster state] Upload global metadata in cluster state to
remote
store([#&#8203;10404](https://togithub.com/opensearch-project/OpenSearch/pull/10404))
- \[Remote cluster state] Download functionality of global metadata from
remote store
([#&#8203;10535](https://togithub.com/opensearch-project/OpenSearch/pull/10535))
- \[Remote cluster state] Restore global metadata from remote store when
local state is lost after quorum loss
([#&#8203;10404](https://togithub.com/opensearch-project/OpenSearch/pull/10404))
- \[Remote cluster state] Make index and global metadata upload timeout
dynamic cluster settings
([#&#8203;10814](https://togithub.com/opensearch-project/OpenSearch/pull/10814))
- Add search query categorizer
([#&#8203;10255](https://togithub.com/opensearch-project/OpenSearch/pull/10255))
- Per request phase latency
([#&#8203;10351](https://togithub.com/opensearch-project/OpenSearch/issues/10351))
- Add cluster state stats
([#&#8203;10670](https://togithub.com/opensearch-project/OpenSearch/pull/10670))
- Remove ingest processor supports excluding fields
([#&#8203;10967](https://togithub.com/opensearch-project/OpenSearch/pull/10967),
[#&#8203;11983](https://togithub.com/opensearch-project/OpenSearch/pull/11983))
- \[Tiered caching] Enabling serialization for IndicesRequestCache key
object
([#&#8203;10275](https://togithub.com/opensearch-project/OpenSearch/pull/10275))
- \[Tiered caching] Defining interfaces, listeners and extending
IndicesRequestCache with Tiered cache support
([#&#8203;10753](https://togithub.com/opensearch-project/OpenSearch/pull/10753))
- \[Remote cluster state] Restore cluster state version during remote
state auto restore
([#&#8203;10853](https://togithub.com/opensearch-project/OpenSearch/pull/10853))
- Update the indexRandom function to create more segments for concurrent
search tests
([10247](https://togithub.com/opensearch-project/OpenSearch/pull/10247))
- Add support for query profiler with concurrent aggregation
([#&#8203;9248](https://togithub.com/opensearch-project/OpenSearch/pull/9248))
- Introduce ConcurrentQueryProfiler to profile query using concurrent
segment search path and support concurrency during rewrite and create
weight
([10352](https://togithub.com/opensearch-project/OpenSearch/pull/10352))
- Implement on behalf of token passing for extensions
([#&#8203;8679](https://togithub.com/opensearch-project/OpenSearch/pull/8679))
- Provide service accounts tokens to extensions
([#&#8203;9618](https://togithub.com/opensearch-project/OpenSearch/pull/9618))
- \[Streaming Indexing] Introduce new experimental server HTTP transport
based on Netty 4 and Project Reactor (Reactor Netty)
([#&#8203;9672](https://togithub.com/opensearch-project/OpenSearch/pull/9672))
- Enable must_exist parameter for update aliases API
([#&#8203;11210](https://togithub.com/opensearch-project/OpenSearch/pull/11210))
- Add back half_float BKD based sort query optimization
([#&#8203;11024](https://togithub.com/opensearch-project/OpenSearch/pull/11024))
- Request level coordinator slow logs
([#&#8203;10650](https://togithub.com/opensearch-project/OpenSearch/pull/10650))
- Add template snippets support for field and target_field in KV ingest
processor
([#&#8203;10040](https://togithub.com/opensearch-project/OpenSearch/pull/10040))
- Allowing pipeline processors to access index mapping info by passing
ingest service ref as part of the processor factory parameters
([#&#8203;10307](https://togithub.com/opensearch-project/OpenSearch/pull/10307))
- Add experimental SIMD implementation of B-tree to round down dates
([#&#8203;11194](https://togithub.com/opensearch-project/OpenSearch/issues/11194))
- Make number of segment metadata files in remote segment store
configurable
([#&#8203;11329](https://togithub.com/opensearch-project/OpenSearch/pull/11329))
- Allow changing number of replicas of searchable snapshot index
([#&#8203;11317](https://togithub.com/opensearch-project/OpenSearch/pull/11317))
- Adding slf4j license header to LoggerMessageFormat.java
([#&#8203;11069](https://togithub.com/opensearch-project/OpenSearch/pull/11069))
- \[BWC and API enforcement] Introduce checks for enforcing the API
restrictions
([#&#8203;11175](https://togithub.com/opensearch-project/OpenSearch/pull/11175))
- Maintainer approval check
([#&#8203;11378](https://togithub.com/opensearch-project/OpenSearch/pull/11378))
- Create separate transport action for render search template action
([#&#8203;11170](https://togithub.com/opensearch-project/OpenSearch/pull/11170))
- Add additional handling in SearchTemplateRequest when simulate is set
to true
([#&#8203;11591](https://togithub.com/opensearch-project/OpenSearch/pull/11591))
- Introduce cluster level setting
`cluster.index.restrict.replication.type` to prevent replication type
setting override during index
creations([#&#8203;11583](https://togithub.com/opensearch-project/OpenSearch/pull/11583))
- Add match_only_text field that is optimized for storage by trading off
positional queries performance
([#&#8203;6836](https://togithub.com/opensearch-project/OpenSearch/pull/11039))
- Add copy ingest processor
([#&#8203;11870](https://togithub.com/opensearch-project/OpenSearch/pull/11870))
- Introduce new feature flag "WRITEABLE_REMOTE_INDEX" to gate the
writeable remote index functionality
([#&#8203;11717](https://togithub.com/opensearch-project/OpenSearch/pull/11170))
- Bump OpenTelemetry from 1.32.0 to 1.34.1
([#&#8203;11891](https://togithub.com/opensearch-project/OpenSearch/pull/11891))
- Add remove_by_pattern ingest processor
([#&#8203;11920](https://togithub.com/opensearch-project/OpenSearch/pull/11920))
- Support index level allocation filtering for searchable snapshot index
([#&#8203;11563](https://togithub.com/opensearch-project/OpenSearch/pull/11563))
- Add `org.opensearch.rest.MethodHandlers` and
`RestController#getAllHandlers`
([11876](https://togithub.com/opensearch-project/OpenSearch/pull/11876))
- New DateTime format for RFC3339 compatible date fields
([#&#8203;11465](https://togithub.com/opensearch-project/OpenSearch/pull/11465))
- Add community_id ingest processor
([#&#8203;12121](https://togithub.com/opensearch-project/OpenSearch/pull/12121))
- Add support for Google Application Default Credentials in
repository-gcs
([#&#8203;8394](https://togithub.com/opensearch-project/OpenSearch/pull/8394))
- Remove concurrent segment search feature flag for GA launch
([#&#8203;12074](https://togithub.com/opensearch-project/OpenSearch/pull/12074))
- Enable Fuzzy codec for doc id fields using a bloom filter
([#&#8203;11022](https://togithub.com/opensearch-project/OpenSearch/pull/11022))
- \[Metrics Framework] Adds support for Histogram metric
([#&#8203;12062](https://togithub.com/opensearch-project/OpenSearch/pull/12062))
- Support for returning scores in matched queries
([#&#8203;11626](https://togithub.com/opensearch-project/OpenSearch/pull/11626))

##### Dependencies

- Bumps jetty version to 9.4.52.v20230823 to fix GMS-2023-1857
([#&#8203;9822](https://togithub.com/opensearch-project/OpenSearch/pull/9822))
- Bump Lucene from 9.7.0 to 9.8.0
([10276](https://togithub.com/opensearch-project/OpenSearch/pull/10276))
- Bump `commons-io:commons-io` from 2.13.0 to 2.15.1
([#&#8203;10294](https://togithub.com/opensearch-project/OpenSearch/pull/10294),
[#&#8203;11001](https://togithub.com/opensearch-project/OpenSearch/pull/11001),
[#&#8203;11002](https://togithub.com/opensearch-project/OpenSearch/pull/11002),
[#&#8203;11446](https://togithub.com/opensearch-project/OpenSearch/pull/11446),
[#&#8203;11554](https://togithub.com/opensearch-project/OpenSearch/pull/11554),
[#&#8203;11560](https://togithub.com/opensearch-project/OpenSearch/pull/11560),
[#&#8203;11796](https://togithub.com/opensearch-project/OpenSearch/pull/11796))
- Bump `com.google.api.grpc:proto-google-common-protos` from 2.10.0 to
2.25.1
([#&#8203;10208](https://togithub.com/opensearch-project/OpenSearch/pull/10208),
[#&#8203;10298](https://togithub.com/opensearch-project/OpenSearch/pull/10298))
- Bump `com.netflix.nebula.ospackage-base` from 11.4.0 to 11.8.0
([#&#8203;10295](https://togithub.com/opensearch-project/OpenSearch/pull/10295),
[#&#8203;11630](https://togithub.com/opensearch-project/OpenSearch/pull/11630),
[#&#8203;12167](https://togithub.com/opensearch-project/OpenSearch/pull/12167))
- Bump `org.apache.zookeeper:zookeeper` from 3.9.0 to 3.9.1
([#&#8203;10506](https://togithub.com/opensearch-project/OpenSearch/pull/10506))
- Bump `de.thetaphi:forbiddenapis` from 3.5.1 to 3.6
([#&#8203;10508](https://togithub.com/opensearch-project/OpenSearch/pull/10508))
- Bump `org.codehaus.woodstox:stax2-api` from 4.2.1 to 4.2.2
([#&#8203;10639](https://togithub.com/opensearch-project/OpenSearch/pull/10639))
- Bump `org.bouncycastle:bc-fips` from 1.0.2.3 to 1.0.2.4
([#&#8203;10297](https://togithub.com/opensearch-project/OpenSearch/pull/10297))
- Bump `com.google.http-client:google-http-client` from 1.43.2 to 1.43.3
([#&#8203;10635](https://togithub.com/opensearch-project/OpenSearch/pull/10635))
- Bump `com.squareup.okio:okio` from 3.5.0 to 3.7.0
([#&#8203;10637](https://togithub.com/opensearch-project/OpenSearch/pull/10637),
[#&#8203;11632](https://togithub.com/opensearch-project/OpenSearch/pull/11632))
- Bump `org.apache.logging.log4j:log4j-core` from 2.20.0 to 2.22.1
([#&#8203;10858](https://togithub.com/opensearch-project/OpenSearch/pull/10858),
[#&#8203;11000](https://togithub.com/opensearch-project/OpenSearch/pull/11000),
[#&#8203;11270](https://togithub.com/opensearch-project/OpenSearch/pull/11270),
[#&#8203;11695](https://togithub.com/opensearch-project/OpenSearch/pull/11695))
- Bump `aws-actions/configure-aws-credentials` from 2 to 4
([#&#8203;10504](https://togithub.com/opensearch-project/OpenSearch/pull/10504))
- Bump `stefanzweifel/git-auto-commit-action` from 4 to 5
([#&#8203;11171](https://togithub.com/opensearch-project/OpenSearch/pull/11171))
- Bump `actions/github-script` from 6 to 7.0.1
([#&#8203;11271](https://togithub.com/opensearch-project/OpenSearch/pull/11271),
[#&#8203;12166](https://togithub.com/opensearch-project/OpenSearch/pull/12166))
- Bump `jackson` and `jackson_databind` from 2.15.2 to 2.16.0
([#&#8203;11273](https://togithub.com/opensearch-project/OpenSearch/pull/11273))
- Bump `netty` from 4.1.100.Final to 4.1.106.Final
([#&#8203;11294](https://togithub.com/opensearch-project/OpenSearch/pull/11294),
[#&#8203;11775](https://togithub.com/opensearch-project/OpenSearch/pull/11775)),
[#&#8203;12034](https://togithub.com/opensearch-project/OpenSearch/pull/12034))
- Bump `com.avast.gradle:gradle-docker-compose-plugin` from 0.16.12 to
0.17.6
([#&#8203;10163](https://togithub.com/opensearch-project/OpenSearch/pull/10163),
[#&#8203;11692](https://togithub.com/opensearch-project/OpenSearch/pull/11692))
- Bump `com.squareup.okhttp3:okhttp` from 4.11.0 to 4.12.0
([#&#8203;10861](https://togithub.com/opensearch-project/OpenSearch/pull/10861))
- Bump `org.apache.commons:commons-text` from 1.10.0 to 1.11.0
([#&#8203;11344](https://togithub.com/opensearch-project/OpenSearch/pull/11344))
- Bump `reactor-netty-core` from 1.1.12 to 1.1.15
([#&#8203;11350](https://togithub.com/opensearch-project/OpenSearch/pull/11350)),
([#&#8203;12042](https://togithub.com/opensearch-project/OpenSearch/pull/12042))
- Bump `com.gradle.enterprise` from 3.14.1 to 3.16.2
([#&#8203;11339](https://togithub.com/opensearch-project/OpenSearch/pull/11339),
[#&#8203;11629](https://togithub.com/opensearch-project/OpenSearch/pull/11629),
[#&#8203;12056](https://togithub.com/opensearch-project/OpenSearch/pull/12056))
- Bump `actions/setup-java` from 3 to 4
([#&#8203;11447](https://togithub.com/opensearch-project/OpenSearch/pull/11447))
- Bump `commons-net:commons-net` from 3.9.0 to 3.10.0
([#&#8203;11450](https://togithub.com/opensearch-project/OpenSearch/pull/11450))
- Bump `org.apache.maven:maven-model` from 3.9.4 to 3.9.6
([#&#8203;11445](https://togithub.com/opensearch-project/OpenSearch/pull/11445))
- Bump `org.apache.xmlbeans:xmlbeans` from 5.1.1 to 5.2.0
([#&#8203;11448](https://togithub.com/opensearch-project/OpenSearch/pull/11448))
- Bump `logback-core` and `logback-classic` to 1.2.13
([#&#8203;11521](https://togithub.com/opensearch-project/OpenSearch/pull/11521))
- Bumps `jetty` version from 9.4.52.v20230823 to 9.4.53.v20231009
([#&#8203;11539](https://togithub.com/opensearch-project/OpenSearch/pull/11539))
- Bump `org.wiremock:wiremock-standalone` from 3.1.0 to 3.3.1
([#&#8203;11555](https://togithub.com/opensearch-project/OpenSearch/pull/11555))
- Bump `org.apache.commons:commons-compress` from 1.24.0 to 1.25.0
([#&#8203;11556](https://togithub.com/opensearch-project/OpenSearch/pull/11556))
- Bump `actions/stale` from 8 to 9
([#&#8203;11557](https://togithub.com/opensearch-project/OpenSearch/pull/11557))
- Bump `com.netflix.nebula:nebula-publishing-plugin` from 20.3.0 to
21.0.0
([#&#8203;11671](https://togithub.com/opensearch-project/OpenSearch/pull/11671))
- Bump `commons-cli:commons-cli` from 1.5.0 to 1.6.0
([#&#8203;10996](https://togithub.com/opensearch-project/OpenSearch/pull/10996))
- Bump `com.maxmind.geoip2:geoip2` from 4.1.0 to 4.2.0
([#&#8203;11559](https://togithub.com/opensearch-project/OpenSearch/pull/11559))
- Bump `org.apache.commons:commons-lang3` from 3.13.0 to 3.14.0
([#&#8203;11691](https://togithub.com/opensearch-project/OpenSearch/pull/11691))
- Bump `com.maxmind.db:maxmind-db` from 3.0.0 to 3.1.0
([#&#8203;11693](https://togithub.com/opensearch-project/OpenSearch/pull/11693))
- Bump `net.java.dev.jna:jna` from 5.13.0 to 5.14.0
([#&#8203;11798](https://togithub.com/opensearch-project/OpenSearch/pull/11798))
- Bump `lycheeverse/lychee-action` from 1.8.0 to 1.9.1
([#&#8203;11795](https://togithub.com/opensearch-project/OpenSearch/pull/11795),
[#&#8203;11887](https://togithub.com/opensearch-project/OpenSearch/pull/11887))
- Bump `Lucene` from 9.8.0 to 9.9.2
([#&#8203;11421](https://togithub.com/opensearch-project/OpenSearch/pull/11421)),
([#&#8203;12063](https://togithub.com/opensearch-project/OpenSearch/pull/12063))
- Bump `com.networknt:json-schema-validator` from 1.0.86 to 1.2.0
([#&#8203;11886](https://togithub.com/opensearch-project/OpenSearch/pull/11886),
[#&#8203;11963](https://togithub.com/opensearch-project/OpenSearch/pull/11963))
- Bump `com.google.api:gax-httpjson` from 0.103.1 to 2.42.0
([#&#8203;11794](https://togithub.com/opensearch-project/OpenSearch/pull/11794),
[#&#8203;12165](https://togithub.com/opensearch-project/OpenSearch/pull/12165))
- Bump `com.google.oauth-client:google-oauth-client` from 1.34.1 to
1.35.0
([#&#8203;11960](https://togithub.com/opensearch-project/OpenSearch/pull/11960))
- Bump `com.diffplug.spotless` from 6.23.2 to 6.25.0
([#&#8203;11962](https://togithub.com/opensearch-project/OpenSearch/pull/11962),
[#&#8203;12055](https://togithub.com/opensearch-project/OpenSearch/pull/12055))
- Bump `com.google.cloud:google-cloud-core` from 2.5.10 to 2.30.0
([#&#8203;11961](https://togithub.com/opensearch-project/OpenSearch/pull/11961))
- Bump `reactor-core` from 3.5.11 to 3.5.14
([#&#8203;12042](https://togithub.com/opensearch-project/OpenSearch/pull/12042))
- Bump `org.apache.shiro:shiro-core` from 1.11.0 to 1.13.0
([#&#8203;12200](https://togithub.com/opensearch-project/OpenSearch/pull/12200))
- Bump `com.google.http-client:google-http-client-jackson2` from 1.43.3
to 1.44.1
([#&#8203;12059](https://togithub.com/opensearch-project/OpenSearch/pull/12059))
- Bump `peter-evans/create-issue-from-file` from 4 to 5
([#&#8203;12057](https://togithub.com/opensearch-project/OpenSearch/pull/12057))
- Bump `org.gradle.test-retry` from 1.5.4 to 1.5.8
([#&#8203;12168](https://togithub.com/opensearch-project/OpenSearch/pull/12168))
- Bump `org.apache.kerby:kerb-admin` from 1.0.1 to 2.0.3
([#&#8203;12194](https://togithub.com/opensearch-project/OpenSearch/pull/12194))

##### Changed

- Mute the query profile IT with concurrent execution
([#&#8203;9840](https://togithub.com/opensearch-project/OpenSearch/pull/9840))
- Force merge with `only_expunge_deletes` honors max segment size
([#&#8203;10036](https://togithub.com/opensearch-project/OpenSearch/pull/10036))
- Add the means to extract the contextual properties from HttpChannel,
TcpCChannel and TrasportChannel without excessive typecasting
([#&#8203;10562](https://togithub.com/opensearch-project/OpenSearch/pull/10562)),
([#&#8203;11751](https://togithub.com/opensearch-project/OpenSearch/pull/11751))
- Introduce new dynamic cluster setting to control slice computation for
concurrent segment search
([#&#8203;9107](https://togithub.com/opensearch-project/OpenSearch/pull/9107))
- Search pipelines now support asynchronous request and response
processors to avoid blocking on a transport thread
([#&#8203;10598](https://togithub.com/opensearch-project/OpenSearch/pull/10598))
- \[Remote Store] Add Remote Store backpressure rejection stats to
`_nodes/stats`
([#&#8203;10524](https://togithub.com/opensearch-project/OpenSearch/pull/10524))
- \[BUG] Fix java.lang.SecurityException in repository-gcs plugin
([#&#8203;10642](https://togithub.com/opensearch-project/OpenSearch/pull/10642))
- Add telemetry tracer/metric enable flag and integ test.
([#&#8203;10395](https://togithub.com/opensearch-project/OpenSearch/pull/10395))
- Performance improvement for Datetime field caching
([#&#8203;4558](https://togithub.com/opensearch-project/OpenSearch/issues/4558))
- Add instrumentation for indexing in transport bulk action and
transport shard bulk action.
([#&#8203;10273](https://togithub.com/opensearch-project/OpenSearch/pull/10273))
- Disallow removing some metadata fields by remove ingest processor
([#&#8203;10895](https://togithub.com/opensearch-project/OpenSearch/pull/10895),
[#&#8203;11607](https://togithub.com/opensearch-project/OpenSearch/pull/11607))
- Performance improvement for MultiTerm Queries on Keyword fields
([#&#8203;7057](https://togithub.com/opensearch-project/OpenSearch/issues/7057))
- Refactor common parts from the Rounding class into a separate 'round'
package
([#&#8203;11023](https://togithub.com/opensearch-project/OpenSearch/issues/11023))
- Performance improvement for date histogram aggregations without
sub-aggregations
([#&#8203;11083](https://togithub.com/opensearch-project/OpenSearch/pull/11083))
- Apply the fast filter optimization to composite aggregation of date
histogram source
([#&#8203;11505](https://togithub.com/opensearch-project/OpenSearch/pull/11083))
- Disable concurrent aggs for Diversified Sampler and Sampler aggs
([#&#8203;11087](https://togithub.com/opensearch-project/OpenSearch/issues/11087))
- Made leader/follower check timeout setting dynamic
([#&#8203;10528](https://togithub.com/opensearch-project/OpenSearch/pull/10528))
- Improved performance of numeric exact-match queries
([#&#8203;11209](https://togithub.com/opensearch-project/OpenSearch/pull/11209))
- Change error message when per shard document limit is breached
([#&#8203;11312](https://togithub.com/opensearch-project/OpenSearch/pull/11312))
- Improve boolean parsing performance
([#&#8203;11308](https://togithub.com/opensearch-project/OpenSearch/pull/11308))
- Interpret byte array as primitive using VarHandles
([#&#8203;11362](https://togithub.com/opensearch-project/OpenSearch/pull/11362))
- Automatically add scheme to discovery.ec2.endpoint
([#&#8203;11512](https://togithub.com/opensearch-project/OpenSearch/pull/11512))
- Restore support for Java 8 for RestClient
([#&#8203;11562](https://togithub.com/opensearch-project/OpenSearch/pull/11562))
- Add deleted doc count in \_cat/shards
([#&#8203;11678](https://togithub.com/opensearch-project/OpenSearch/pull/11678))
- Capture information for additional query types and aggregation types
([#&#8203;11582](https://togithub.com/opensearch-project/OpenSearch/pull/11582))
- Use slice_size == shard_size heuristic in terms aggs for concurrent
segment search and properly calculate the doc_count_error
([#&#8203;11732](https://togithub.com/opensearch-project/OpenSearch/pull/11732))
- Added Support for dynamically adding SearchRequestOperationsListeners
with SearchRequestOperationsCompositeListenerFactory
([#&#8203;11526](https://togithub.com/opensearch-project/OpenSearch/pull/11526))
- Ensure Jackson default maximums introduced in 2.16.0 do not conflict
with OpenSearch settings
([#&#8203;11890](https://togithub.com/opensearch-project/OpenSearch/pull/11890))
- Extract cluster management for integration tests into JUnit test rule
out of OpenSearchIntegTestCase
([#&#8203;11877](https://togithub.com/opensearch-project/OpenSearch/pull/11877)),
([#&#8203;12000](https://togithub.com/opensearch-project/OpenSearch/pull/12000))
- Workaround for https://bugs.openjdk.org/browse/JDK-8323659 regression,
introduced in JDK-21.0.2
([#&#8203;11968](https://togithub.com/opensearch-project/OpenSearch/pull/11968))
- Updates IpField to be searchable when only `doc_values` are enabled
([#&#8203;11508](https://togithub.com/opensearch-project/OpenSearch/pull/11508))
- \[Query Insights] Query Insights Framework which currently supports
retrieving the most time-consuming queries within the last configured
time window
([#&#8203;11903](https://togithub.com/opensearch-project/OpenSearch/pull/11903))
- \[Query Insights] Implement Top N Queries feature to collect and
gather information about high latency queries in a window
([#&#8203;11904](https://togithub.com/opensearch-project/OpenSearch/pull/11904))
- Add override support for sampling based on action
([#&#8203;9621](https://togithub.com/opensearch-project/OpenSearch/issues/9621))
- Added custom sampler support based on transport action in request
([#&#8203;9621](https://togithub.com/opensearch-project/OpenSearch/issues/9621))
- Disable concurrent search for composite
aggregation([#&#8203;12375](https://togithub.com/opensearch-project/OpenSearch/pull/12375))

##### Removed

- Remove deprecated classes for Rounding
([#&#8203;10956](https://togithub.com/opensearch-project/OpenSearch/issues/10956))

##### Fixed

- Fix failure in dissect ingest processor parsing empty brackets
([#&#8203;9225](https://togithub.com/opensearch-project/OpenSearch/pull/9255))
- Fix `class_cast_exception` when passing int to `_version` and other
metadata fields in ingest simulate API
([#&#8203;10101](https://togithub.com/opensearch-project/OpenSearch/pull/10101))
- Fix Segment Replication ShardLockObtainFailedException bug during
index corruption
([10370](https://togithub.com/opensearch-project/OpenSearch/pull/10370))
- Fix some test methods in SimulatePipelineRequestParsingTests never run
and fix test failure
([#&#8203;10496](https://togithub.com/opensearch-project/OpenSearch/pull/10496))
- Fix passing wrong parameter when calling newConfigurationException()
in DotExpanderProcessor
([#&#8203;10737](https://togithub.com/opensearch-project/OpenSearch/pull/10737))
- Delegating CachingWeightWrapper#count to internal weight object
([#&#8203;10543](https://togithub.com/opensearch-project/OpenSearch/pull/10543))
- Fix per request latency last phase not tracked
([#&#8203;10934](https://togithub.com/opensearch-project/OpenSearch/pull/10934))
- Fix SuggestSearch.testSkipDuplicates by forcing refresh when indexing
its test documents
([#&#8203;11068](https://togithub.com/opensearch-project/OpenSearch/pull/11068))
- \[BUG] Fix the thread context that is not properly cleared and messes
up the traces
([#&#8203;10873](https://togithub.com/opensearch-project/OpenSearch/pull/10873))
- Handle canMatchSearchAfter for frozen context scenario
([#&#8203;11249](https://togithub.com/opensearch-project/OpenSearch/pull/11249))
- Fix the issue with DefaultSpanScope restoring wrong span in the
TracerContextStorage upon detach
([#&#8203;11316](https://togithub.com/opensearch-project/OpenSearch/issues/11316))
- Remove shadowJar from `lang-painless` module publication
([#&#8203;11369](https://togithub.com/opensearch-project/OpenSearch/issues/11369))
- Fix remote shards balancer and remove unused variables
([#&#8203;11167](https://togithub.com/opensearch-project/OpenSearch/pull/11167))
- Fix parsing of flat object fields with dots in keys
([#&#8203;11425](https://togithub.com/opensearch-project/OpenSearch/pull/11425))
- Fix bug where replication lag grows post primary relocation
([#&#8203;11238](https://togithub.com/opensearch-project/OpenSearch/pull/11238))
- Fix noop_update_total metric in indexing stats cannot be updated by
bulk API
([#&#8203;11485](https://togithub.com/opensearch-project/OpenSearch/pull/11485),[#&#8203;11917](https://togithub.com/opensearch-project/OpenSearch/pull/11917))
- Fix for stuck update action in a bulk with `retry_on_conflict`
property
([#&#8203;11152](https://togithub.com/opensearch-project/OpenSearch/issues/11152))
- Fix template setting override for replication type
([#&#8203;11417](https://togithub.com/opensearch-project/OpenSearch/pull/11417))
- Fix Automatic addition of protocol broken in
[#&#8203;11512](https://togithub.com/opensearch-project/OpenSearch/issues/11512)
([#&#8203;11609](https://togithub.com/opensearch-project/OpenSearch/pull/11609))
- Fix issue when calling Delete PIT endpoint and no PITs exist
([#&#8203;11711](https://togithub.com/opensearch-project/OpenSearch/pull/11711))
- Fix tracing context propagation for local transport instrumentation
([#&#8203;11490](https://togithub.com/opensearch-project/OpenSearch/pull/11490))
- Fix parsing of single line comments in `lang-painless`
([#&#8203;11815](https://togithub.com/opensearch-project/OpenSearch/issues/11815))
- Fix memory leak issue in ReorganizingLongHash
([#&#8203;11953](https://togithub.com/opensearch-project/OpenSearch/issues/11953))
- Prevent setting remote_snapshot store type on index creation
([#&#8203;11867](https://togithub.com/opensearch-project/OpenSearch/pull/11867))
- \[BUG] Fix remote shards balancer when filtering throttled nodes
([#&#8203;11724](https://togithub.com/opensearch-project/OpenSearch/pull/11724))
- Add advance(int) for numeric values in order to allow point based
optimization to kick in
([#&#8203;12089](https://togithub.com/opensearch-project/OpenSearch/pull/12089))

###
[`v2.11.1`](https://togithub.com/opensearch-project/OpenSearch/releases/tag/2.11.1)

[Compare
Source](https://togithub.com/opensearch-project/OpenSearch/compare/2.11.0...2.11.1)

##### 2023-11-20 Version 2.11.1 Release Notes

##### \[2.11.1]

##### Changed

- Use iterative approach to evaluate Regex.simpleMatch
([#&#8203;11060](https://togithub.com/opensearch-project/OpenSearch/pull/11060))

##### Fixed

- \[BUG] Disable sort optimization for HALF_FLOAT
([#&#8203;10999](https://togithub.com/opensearch-project/OpenSearch/pull/10999))
- Adding version condition while adding geoshape doc values to the
index, to ensure backward
compatibility.([#&#8203;11095](https://togithub.com/opensearch-project/OpenSearch/pull/11095))
- Remove shadowJar from `lang-painless` module publication
([#&#8203;11369](https://togithub.com/opensearch-project/OpenSearch/issues/11369))

###
[`v2.11.0`](https://togithub.com/opensearch-project/OpenSearch/releases/tag/2.11.0)

[Compare
Source](https://togithub.com/opensearch-project/OpenSearch/compare/2.10.0...2.11.0)

##### 2023-10-12 Version 2.11.0 Release Notes

##### \[2.11]

##### Added

- Add coordinator level stats for search latency
([#&#8203;8386](https://togithub.com/opensearch-project/OpenSearch/issues/8386))
- Add metrics for thread_pool task wait time
([#&#8203;9681](https://togithub.com/opensearch-project/OpenSearch/pull/9681))
- Async blob read support for S3 plugin
([#&#8203;9694](https://togithub.com/opensearch-project/OpenSearch/pull/9694))
- \[Telemetry-Otel] Added support for OtlpGrpcSpanExporter exporter
([#&#8203;9666](https://togithub.com/opensearch-project/OpenSearch/pull/9666))
- Async blob read support for encrypted containers
([#&#8203;10131](https://togithub.com/opensearch-project/OpenSearch/pull/10131))
- Implement Visitor Design pattern in QueryBuilder to enable the
capability to traverse through the complex QueryBuilder tree.
([#&#8203;10110](https://togithub.com/opensearch-project/OpenSearch/pull/10110))
- Add capability to restrict async durability mode for remote indexes
([#&#8203;10189](https://togithub.com/opensearch-project/OpenSearch/pull/10189))
- Add Doc Status Counter for Indexing Engine
([#&#8203;4562](https://togithub.com/opensearch-project/OpenSearch/issues/4562))
- Add unreferenced file cleanup count to merge stats
([#&#8203;10204](https://togithub.com/opensearch-project/OpenSearch/pull/10204))
- Configurable merge policy for index with an option to choose from
LogByteSize and Tiered merge policy
([#&#8203;9992](https://togithub.com/opensearch-project/OpenSearch/pull/9992))
- \[Remote Store] Add support to restrict creation & deletion if system
repository and mutation of immutable settings of system repository
([#&#8203;9839](https://togithub.com/opensearch-project/OpenSearch/pull/9839))
- Improve compressed request handling
([#&#8203;10261](https://togithub.com/opensearch-project/OpenSearch/pull/10261))

##### Dependencies

- Bump JNA version from 5.5 to 5.13
([#&#8203;9963](https://togithub.com/opensearch-project/OpenSearch/pull/9963))
- Bump `peter-evans/create-or-update-comment` from 2 to 3
([#&#8203;9575](https://togithub.com/opensearch-project/OpenSearch/pull/9575))
- Bump `actions/checkout` from 2 to 4
([#&#8203;9968](https://togithub.com/opensearch-project/OpenSearch/pull/9968))
- Bump OpenTelemetry from 1.26.0 to 1.30.1
([#&#8203;9950](https://togithub.com/opensearch-project/OpenSearch/pull/9950))
- Bump `org.apache.commons:commons-compress` from 1.23.0 to 1.24.0
(\[[#&#8203;9973](https://togithub.com/opensearch-project/OpenSearch/issues/9973),
[#&#8203;9972](https://togithub.com/opensearch-project/OpenSearch/issues/9972)]\[https://github.com/opensearch-project/OpenSearch/pull/9973](https://togithub.com/opensearch-project/OpenSearch/pull/9973)3,[https://github.com/opensearch-project/OpenSearch/pull/9972](https://togithub.com/opensearch-project/OpenSearch/pull/9972)2))
- Bump `com.google.cloud:google-cloud-core-http` from 2.21.1 to 2.23.0
([#&#8203;9971](https://togithub.com/opensearch-project/OpenSearch/pull/9971))
- Bump `mockito` from 5.4.0 to 5.5.0
([#&#8203;10022](https://togithub.com/opensearch-project/OpenSearch/pull/10022))
- Bump `bytebuddy` from 1.14.3 to 1.14.7
([#&#8203;10022](https://togithub.com/opensearch-project/OpenSearch/pull/10022))
- Bump `com.zaxxer:SparseBitSet` from 1.2 to 1.3
([#&#8203;10098](https://togithub.com/opensearch-project/OpenSearch/pull/10098))
- Bump `tibdex/github-app-token` from 1.5.0 to 2.1.0
([#&#8203;10125](https://togithub.com/opensearch-project/OpenSearch/pull/10125))
- Bump `org.wiremock:wiremock-standalone` from 2.35.0 to 3.1.0
([#&#8203;9752](https://togithub.com/opensearch-project/OpenSearch/pull/9752))
- Bump `org.eclipse.jgit` from 6.5.0 to 6.7.0
([#&#8203;10147](https://togithub.com/opensearch-project/OpenSearch/pull/10147))
- Bump `codecov/codecov-action` from 2 to 3
([#&#8203;10209](https://togithub.com/opensearch-project/OpenSearch/pull/10209))
- Bump `com.google.http-client:google-http-client-jackson2` from 1.43.2
to 1.43.3
([#&#8203;10126](https://togithub.com/opensearch-project/OpenSearch/pull/10126))
- Bump `org.xerial.snappy:snappy-java` from 1.1.10.3 to 1.1.10.5
([#&#8203;10206](https://togithub.com/opensearch-project/OpenSearch/pull/10206),
[#&#8203;10299](https://togithub.com/opensearch-project/OpenSearch/pull/10299))
- Bump `org.bouncycastle:bcpkix-jdk15to18` from 1.75 to 1.76
([10219](https://togithub.com/opensearch-project/OpenSearch/pull/10219))\`
- Bump `org.bouncycastle:bcprov-jdk15to18` from 1.75 to 1.76
([10219](https://togithub.com/opensearch-project/OpenSearch/pull/10219))\`
- Bump `org.bouncycastle:bcmail-jdk15to18` from 1.75 to 1.76
([10219](https://togithub.com/opensearch-project/OpenSearch/pull/10219))\`
- Bump asm from 9.5 to 9.6
([#&#8203;10302](https://togithub.com/opensearch-project/OpenSearch/pull/10302))
- Bump netty from 4.1.97.Final to 4.1.99.Final
([#&#8203;10303](https://togithub.com/opensearch-project/OpenSearch/pull/10303))
- Bump `peter-evans/create-pull-request` from 3 to 5
([#&#8203;10301](https://togithub.com/opensearch-project/OpenSearch/pull/10301))
- Bump `org.apache.avro:avro` from 1.11.2 to 1.11.3
([#&#8203;10210](https://togithub.com/opensearch-project/OpenSearch/pull/10210))
- Bump `netty` from 4.1.99.Final to 4.1.100.Final
([#&#8203;10564](https://togithub.com/opensearch-project/OpenSearch/pull/10564))

##### Changed

- Add instrumentation in rest and network layer.
([#&#8203;9415](https://togithub.com/opensearch-project/OpenSearch/pull/9415))
- Allow parameterization of tests with
OpenSearchIntegTestCase.SuiteScopeTestCase annotation
([#&#8203;9916](https://togithub.com/opensearch-project/OpenSearch/pull/9916))
- Add instrumentation in transport service.
([#&#8203;10042](https://togithub.com/opensearch-project/OpenSearch/pull/10042))
- \[Tracing Framework] Add support for SpanKind.
([#&#8203;10122](https://togithub.com/opensearch-project/OpenSearch/pull/10122))
- Pass parent filter to inner query in nested query
([#&#8203;10246](https://togithub.com/opensearch-project/OpenSearch/pull/10246))
- Disable concurrent segment search when terminate_after is used
([#&#8203;10200](https://togithub.com/opensearch-project/OpenSearch/pull/10200))
- Add instrumentation in Inbound Handler.
([#&#8203;100143](https://togithub.com/opensearch-project/OpenSearch/pull/10143))
- Enable remote segment upload backpressure by default
([#&#8203;10356](https://togithub.com/opensearch-project/OpenSearch/pull/10356))
- \[Remote Store] Add support to reload repository metadata inplace
([#&#8203;9569](https://togithub.com/opensearch-project/OpenSearch/pull/9569))
- \[Metrics Framework] Add Metrics framework.
([#&#8203;10241](https://togithub.com/opensearch-project/OpenSearch/pull/10241))
- Updating the separator for RemoteStoreLockManager since underscore is
allowed in base64UUID url charset
([#&#8203;10379](https://togithub.com/opensearch-project/OpenSearch/pull/10379))

##### Removed

- Remove spurious SGID bit on directories
([#&#8203;9447](https://togithub.com/opensearch-project/OpenSearch/pull/9447))

##### Fixed

- Fix ignore_missing parameter has no effect when using template snippet
in rename ingest processor
([#&#8203;9725](https://togithub.com/opensearch-project/OpenSearch/pull/9725))
- Fix broken backward compatibility from 2.7 for IndexSorted field
indices
([#&#8203;10045](https://togithub.com/opensearch-project/OpenSearch/pull/10045))
- Fix concurrent search NPE when track_total_hits, terminate_after and
size=0 are used
([#&#8203;10082](https://togithub.com/opensearch-project/OpenSearch/pull/10082))
- Fix remove ingest processor handing ignore_missing parameter not
correctly
([10089](https://togithub.com/opensearch-project/OpenSearch/pull/10089))
- Fix registration and initialization of multiple extensions
([10256](https://togithub.com/opensearch-project/OpenSearch/pull/10256))
- Fix circular dependency in Settings initialization
([10194](https://togithub.com/opensearch-project/OpenSearch/pull/10194))
- Fix Segment Replication ShardLockObtainFailedException bug during
index corruption
([10370](https://togithub.com/opensearch-project/OpenSearch/pull/10370))

###
[`v2.10.0`](https://togithub.com/opensearch-project/OpenSearch/releases/tag/2.10.0)

[Compare
Source](https://togithub.com/opensearch-project/OpenSearch/compare/2.9.0...2.10.0)

#### 2023-09-08 Version 2.10.0 Release Notes

#### \[2.10]

##### Added

- Add server version as REST response header
[#&#8203;6583](https://togithub.com/opensearch-project/OpenSearch/issues/6583)
- Start replication checkpointTimers on primary before segments upload
to remote store.
([#&#8203;8221]()[https://github.com/opensearch-project/OpenSearch/pull/8221](https://togithub.com/opensearch-project/OpenSearch/pull/8221))
- Introduce new static cluster setting to control slice computation for
concurrent segment search.
([#&#8203;8847](https://togithub.com/opensearch-project/OpenSearch/pull/8884))
- Add configuration for file cache size to max remote data ratio to
prevent oversubscription of file cache
([#&#8203;8606](https://togithub.com/opensearch-project/OpenSearch/pull/8606))
- Disallow compression level to be set for default and best_compression
index codecs
([#&#8203;8737]()[https://github.com/opensearch-project/OpenSearch/pull/8737](https://togithub.com/opensearch-project/OpenSearch/pull/8737))
- \[distribution/archives] \[Linux] \[x64] Provide the variant of the
distributions bundled with JRE
([#&#8203;8195]()[https://github.com/opensearch-project/OpenSearch/pull/8195](https://togithub.com/opensearch-project/OpenSearch/pull/8195))
- Prioritize replica shard movement during shard relocation
([#&#8203;8875](https://togithub.com/opensearch-project/OpenSearch/pull/8875))
- Introducing Default and Best Compression codecs as their algorithm
name
([#&#8203;9123](https://togithub.com/opensearch-project/OpenSearch/pull/9123))
- Make SearchTemplateRequest implement IndicesRequest.Replaceable
([#&#8203;9122](https://togithub.com/opensearch-project/OpenSearch/pull/9122))
- \[BWC and API enforcement] Define the initial set of annotations,
their meaning and relations between them
([#&#8203;9223](https://togithub.com/opensearch-project/OpenSearch/pull/9223))
- \[Remote Store] Add Segment download stats to remotestore stats API
([#&#8203;8718](https://togithub.com/opensearch-project/OpenSearch/pull/8718))
- \[Remote Store] Add remote segment transfer stats on NodesStats API
([#&#8203;9168](https://togithub.com/opensearch-project/OpenSearch/pull/9168)
[#&#8203;9393](https://togithub.com/opensearch-project/OpenSearch/pull/9393)
[#&#8203;9454](https://togithub.com/opensearch-project/OpenSearch/pull/9454))
- \[Segment Replication] Support realtime reads for GET requests
([#&#8203;9212](https://togithub.com/opensearch-project/OpenSearch/pull/9212))
- Allow test clusters to run with TLS
([#&#8203;8900](https://togithub.com/opensearch-project/OpenSearch/pull/8900))
- Add jdk.incubator.vector module support for JDK 20+
([#&#8203;8601](https://togithub.com/opensearch-project/OpenSearch/pull/8601))
- \[Feature] Expose term frequency in Painless script score context
([#&#8203;9081](https://togithub.com/opensearch-project/OpenSearch/pull/9081))
- Add support for reading partial files to HDFS repository
([#&#8203;9513](https://togithub.com/opensearch-project/OpenSearch/issues/9513))
- \[Remote Store] Rate limiter integration for remote store uploads and
downloads([#&#8203;9448](https://togithub.com/opensearch-project/OpenSearch/pull/9448/))
- \[BWC and API enforcement] Decorate the existing APIs with proper
annotations (part 1)
([#&#8203;9520](https://togithub.com/opensearch-project/OpenSearch/pull/9520))
- Add support for extensions to search responses using SearchExtBuilder
([#&#8203;9379](https://togithub.com/opensearch-project/OpenSearch/pull/9379))
- \[Remote State] Create service to publish cluster state to remote
store
([#&#8203;9160](https://togithub.com/opensearch-project/OpenSearch/pull/9160))
- Core crypto library to perform encryption and decryption of source
content
([#&#8203;8466](https://togithub.com/opensearch-project/OpenSearch/pull/8466))
- Expose DelimitedTermFrequencyTokenFilter to allow providing term
frequencies along with terms
([#&#8203;9479](https://togithub.com/opensearch-project/OpenSearch/pull/9479))
- APIs for performing async blob reads and async downloads from the
repository using multiple streams
([#&#8203;9592](https://togithub.com/opensearch-project/OpenSearch/issues/9592))
- Add concurrent segment search related metrics to node and index stats
([#&#8203;9622](https://togithub.com/opensearch-project/OpenSearch/issues/9622))
- Add average concurrency metric for concurrent segment search
([#&#8203;9670](https://togithub.com/opensearch-project/OpenSearch/issues/9670))
- Introduce cluster default remote translog buffer interval setting
([#&#8203;9584](https://togithub.com/opensearch-project/OpenSearch/pull/9584))
- Added encryption-sdk lib to provide encryption and decryption
capabilities
([#&#8203;8466](https://togithub.com/opensearch-project/OpenSearch/pull/8466)
[#&#8203;9289](https://togithub.com/opensearch-project/OpenSearch/pull/9289))
- \[Segment Replication] Adding segment replication statistics rolled up
at index, node and cluster level
([#&#8203;9709](https://togithub.com/opensearch-project/OpenSearch/pull/9709))
- Added crypto-kms plugin to provide AWS KMS based key providers for
encryption/decryption.
([#&#8203;8465](https://togithub.com/opensearch-project/OpenSearch/pull/8465))
- \[Remote state] Integrate remote cluster state in publish/commit flow
([#&#8203;9665](https://togithub.com/opensearch-project/OpenSearch/pull/9665))
- \[Remote Store] Changes to introduce repository registration during
bootstrap via node attributes.
([#&#8203;9105](https://togithub.com/opensearch-project/OpenSearch/pull/9105))
- \[Remote state] Auto restore index metadata from last known cluster
state
([#&#8203;9831](https://togithub.com/opensearch-project/OpenSearch/pull/9831))

##### Dependencies

- Bump `org.apache.logging.log4j:log4j-core` from 2.17.1 to 2.20.0
([#&#8203;8307](https://togithub.com/opensearch-project/OpenSearch/pull/8307))
- Bump `io.grpc:grpc-context` from 1.46.0 to 1.57.1
([#&#8203;8726](https://togithub.com/opensearch-project/OpenSearch/pull/8726),
[#&#8203;9145](https://togithub.com/opensearch-project/OpenSearch/pull/9145))
- Bump `com.netflix.nebula:gradle-info-plugin` from 12.1.5 to 12.1.6
([#&#8203;8724](https://togithub.com/opensearch-project/OpenSearch/pull/8724))
- Bump `commons-codec:commons-codec` from 1.15 to 1.16.0
([#&#8203;8725](https://togithub.com/opensearch-project/OpenSearch/pull/8725))
- Bump `org.apache.zookeeper:zookeeper` from 3.8.1 to 3.9.0
([#&#8203;8844](https://togithub.com/opensearch-project/OpenSearch/pull/8844),
[#&#8203;9146](https://togithub.com/opensearch-project/OpenSearch/pull/9146))
- Bump `org.gradle.test-retry` from 1.5.3 to 1.5.4
([#&#8203;8842](https://togithub.com/opensearch-project/OpenSearch/pull/8842))
- Bump `com.netflix.nebula.ospackage-base` from 11.3.0 to 11.4.0
([#&#8203;8838](https://togithub.com/opensearch-project/OpenSearch/pull/8838))
- Bump `com.google.http-client:google-http-client-gson` from 1.43.2 to
1.43.3
([#&#8203;8840](https://togithub.com/opensearch-project/OpenSearch/pull/8840))
- OpenJDK Update (July 2023 Patch releases)
([#&#8203;8869](https://togithub.com/opensearch-project/OpenSearch/pull/8869))
- Bump `hadoop` libraries from 3.3.4 to 3.3.6
([#&#8203;6995](https://togithub.com/opensearch-project/OpenSearch/pull/6995))
- Bump `com.gradle.enterprise` from 3.13.3 to 3.14.1
([#&#8203;8996](https://togithub.com/opensearch-project/OpenSearch/pull/8996))
- Bump `org.apache.commons:commons-lang3` from 3.12.0 to 3.13.0
([#&#8203;8995](https://togithub.com/opensearch-project/OpenSearch/pull/8995))
- Bump `com.google.cloud:google-cloud-core-http` from 2.21.0 to 2.21.1
([#&#8203;8999](https://togithub.com/opensearch-project/OpenSearch/pull/8999))
- Bump `com.maxmind.geoip2:geoip2` from 4.0.1 to 4.1.0
([#&#8203;8998](https://togithub.com/opensearch-project/OpenSearch/pull/8998))
- Bump `org.apache.commons:commons-lang3` from 3.12.0 to 3.13.0 in
/plugins/repository-hdfs
([#&#8203;8997](https://togithub.com/opensearch-project/OpenSearch/pull/8997))
- Bump `netty` from 4.1.94.Final to 4.1.96.Final
([#&#8203;9030](https://togithub.com/opensearch-project/OpenSearch/pull/9030))
- Bump `com.google.jimfs:jimfs` from 1.2 to 1.3.0
([#&#8203;9080](https://togithub.com/opensearch-project/OpenSearch/pull/9080))
- Bump `io.projectreactor.netty:reactor-netty-http` from 1.1.8 to 1.1.9
([#&#8203;9147](https://togithub.com/opensearch-project/OpenSearch/pull/9147))
- Bump `org.apache.maven:maven-model` from 3.9.3 to 3.9.4
([#&#8203;9148](https://togithub.com/opensearch-project/OpenSearch/pull/9148))
- Bump `com.azure:azure-storage-blob` from 12.22.3 to 12.23.0
([#&#8203;9231](https://togithub.com/opensearch-project/OpenSearch/pull/9231))
- Bump `com.diffplug.spotless` from 6.19.0 to 6.20.0
([#&#8203;9227](https://togithub.com/opensearch-project/OpenSearch/pull/9227))
- Bump `org.xerial.snappy:snappy-java` from 1.1.8.2 to 1.1.10.3
([#&#8203;9252](https://togithub.com/opensearch-project/OpenSearch/pull/9252))
- Bump `com.squareup.okhttp3:okhttp` from 4.9.3 to 4.11.0
([#&#8203;9252](https://togithub.com/opensearch-project/OpenSearch/pull/9252))
- Bump `com.squareup.okio:okio` from 2.8.0 to 3.5.0
([#&#8203;9252](https://togithub.com/opensearch-project/OpenSearch/pull/9252))
- Bump `com.google.code.gson:gson` from 2.9.0 to 2.10.1
([#&#8203;9230](https://togithub.com/opensearch-project/OpenSearch/pull/9230))
- Bump `lycheeverse/lychee-action` from 1.2.0 to 1.8.0
([#&#8203;9228](https://togithub.com/opensearch-project/OpenSearch/pull/9228))
- Bump `snakeyaml` from 2.0 to 2.1
([#&#8203;9269](https://togithub.com/opensearch-project/OpenSearch/pull/9269))
- Bump `aws-actions/configure-aws-credentials` from 1 to 2
([#&#8203;9302](https://togithub.com/opensearch-project/OpenSearch/pull/9302))
- Bump `com.github.luben:zstd-jni` from 1.5.5-3 to 1.5.5-5
([#&#8203;9431](https://togithub.com/opensearch-project/OpenSearch/pull/9431)
- Bump `netty` from 4.1.96.Final to 4.1.97.Final
([#&#8203;9553](https://togithub.com/opensearch-project/OpenSearch/pull/9553))
- Bump `io.grpc:grpc-api` from 1.57.1 to 1.57.2
([#&#8203;9578](https://togithub.com/opensearch-project/OpenSearch/pull/9578))
- Add Encryption SDK dependencies
([#&#8203;8466](https://togithub.com/opensearch-project/OpenSearch/pull/8466))

##### Changed

- Default to mmapfs within hybridfs
([#&#8203;8508](https://togithub.com/opensearch-project/OpenSearch/pull/8508))
- Perform aggregation postCollection in ContextIndexSearcher after
searching leaves
([#&#8203;8303](https://togithub.com/opensearch-project/OpenSearch/pull/8303))
- Make Span exporter configurable
([#&#8203;8620](https://togithub.com/opensearch-project/OpenSearch/issues/8620))
- Perform aggregation postCollection in ContextIndexSearcher after
searching leaves
([#&#8203;8303](https://togithub.com/opensearch-project/OpenSearch/pull/8303))
- \[Refactor] StreamIO from common to core.common namespace in core lib
([#&#8203;8157](https://togithub.com/opensearch-project/OpenSearch/pull/8157))
- \[Refactor] Remaining HPPC to java.util collections
([#&#8203;8730](https://togithub.com/opensearc

</details>

---

### Configuration

📅 **Schedule**: Branch creation - "after 10pm every weekday,before 6am
every weekday" (UTC), Automerge - At any time (no schedule defined).

🚦 **Automerge**: Disabled by config. Please merge this manually once you
are satisfied.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about this update
again.

---

- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check
this box

---

This PR has been generated by [Mend
Renovate](https://www.mend.io/free-developer-tools/renovate/). View
repository job log
[here](https://developer.mend.io/github/camunda/zeebe).

<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy4yNjkuMiIsInVwZGF0ZWRJblZlciI6IjM3LjI2OS4yIiwidGFyZ2V0QnJhbmNoIjoibWFpbiJ9-->
github-merge-queue bot referenced this pull request in camunda/camunda Apr 10, 2024
#17405)

[![Mend
Renovate](https://app.renovatebot.com/images/banner.svg)](https://renovatebot.com)

This PR contains the following updates:

| Package | Update | Change |
|---|---|---|
|
[opensearchproject/opensearch](https://togithub.com/opensearch-project/OpenSearch)
| minor | `2.5.0` -> `2.13.0` |

---

> [!WARNING]
> Some dependencies could not be looked up. Check the Dependency
Dashboard for more information.

---

### Release Notes

<details>
<summary>opensearch-project/OpenSearch
(opensearchproject/opensearch)</summary>

###
[`v2.13.0`](https://togithub.com/opensearch-project/OpenSearch/releases/tag/2.13.0)

[Compare
Source](https://togithub.com/opensearch-project/OpenSearch/compare/2.12.0...2.13.0)

##### 2024-03-21 Version 2.13.0 Release Notes

##### \[2.13.0]

##### Added

- \[Tiered caching] Introducing cache plugins and exposing Ehcache as
one of the pluggable disk cache option
([#&#8203;11874](https://togithub.com/opensearch-project/OpenSearch/pull/11874))
- Add support for dependencies in plugin descriptor properties with
semver range
([#&#8203;11441](https://togithub.com/opensearch-project/OpenSearch/pull/11441))
- Add community_id ingest processor
([#&#8203;12121](https://togithub.com/opensearch-project/OpenSearch/pull/12121))
- Introduce query level setting `index.query.max_nested_depth` limiting
nested queries
([#&#8203;3268](https://togithub.com/opensearch-project/OpenSearch/issues/3268)
- Add toString methods to MultiSearchRequest, MultiGetRequest and
CreateIndexRequest
([#&#8203;12163](https://togithub.com/opensearch-project/OpenSearch/pull/12163))
- Fix error in RemoteSegmentStoreDirectory when debug logging is enabled
([#&#8203;12328](https://togithub.com/opensearch-project/OpenSearch/pull/12328))
- Support for returning scores in matched queries
([#&#8203;11626](https://togithub.com/opensearch-project/OpenSearch/pull/11626))
- Add shard id property to SearchLookup for use in field types provided
by plugins
([#&#8203;1063](https://togithub.com/opensearch-project/OpenSearch/pull/1063))
- \[Tiered caching] Make IndicesRequestCache implementation configurable
\[EXPERIMENTAL]
([#&#8203;12533](https://togithub.com/opensearch-project/OpenSearch/pull/12533))
- Force merge API supports performing on primary shards only
([#&#8203;11269](https://togithub.com/opensearch-project/OpenSearch/pull/11269))
- Add kuromoji_completion analyzer and filter
([#&#8203;4835](https://togithub.com/opensearch-project/OpenSearch/issues/4835))
- \[Admission Control] Integrate IO Usage Tracker to the Resource Usage
Collector Service and Emit IO Usage Stats
([#&#8203;11880](https://togithub.com/opensearch-project/OpenSearch/pull/11880))
- The org.opensearch.bootstrap.Security should support codebase for JAR
files with classifiers
([#&#8203;12586](https://togithub.com/opensearch-project/OpenSearch/issues/12586))
- Remote reindex: Add support for configurable retry mechanism
([#&#8203;12561](https://togithub.com/opensearch-project/OpenSearch/pull/12561))
- Tracing for deep search path
([#&#8203;12103](https://togithub.com/opensearch-project/OpenSearch/pull/12103))
- \[Metrics Framework] Adds support for asynchronous gauge metric type.
([#&#8203;12642](https://togithub.com/opensearch-project/OpenSearch/issues/12642))
- \[Tiered caching] Add Stale keys Management and CacheCleaner to
IndicesRequestCache
([#&#8203;12625](https://togithub.com/opensearch-project/OpenSearch/pull/12625))
- Make search query counters dynamic to support all query types
([#&#8203;12601](https://togithub.com/opensearch-project/OpenSearch/pull/12601))
- \[Tiered caching] Add policies controlling which values can enter
pluggable caches \[EXPERIMENTAL]
([#&#8203;12542](https://togithub.com/opensearch-project/OpenSearch/pull/12542))
- \[Tiered caching] Add serializer integration to allow ehcache disk
cache to use non-primitive values
([#&#8203;12709](https://togithub.com/opensearch-project/OpenSearch/pull/12709))
- \[Admission Control] Integrated IO Based AdmissionController to
AdmissionControl Framework
([#&#8203;12583](https://togithub.com/opensearch-project/OpenSearch/pull/12583))
- Add Remote Store Migration Experimental flag and allow mixed mode
clusters under same
([#&#8203;11986](https://togithub.com/opensearch-project/OpenSearch/pull/11986))
- Built-in secure transports support
([#&#8203;12435](https://togithub.com/opensearch-project/OpenSearch/pull/12435))
- Lightweight Transport action to verify local term before fetching
cluster-state from remote
([#&#8203;12252](https://togithub.com/opensearch-project/OpenSearch/pull/12252/))
- Integrate with admission controller for cluster-manager Read API.
([#&#8203;12496](https://togithub.com/opensearch-project/OpenSearch/pull/12496))
- Introduce a new setting `index.check_pending_flush.enabled` to expose
the ability to disable the check for pending flushes by write threads
([#&#8203;12710](https://togithub.com/opensearch-project/OpenSearch/pull/12710))

##### Dependencies

- Bump `com.squareup.okio:okio` from 3.7.0 to 3.8.0
([#&#8203;12290](https://togithub.com/opensearch-project/OpenSearch/pull/12290))
- Bump `org.bouncycastle:bcprov-jdk15to18` to
`org.bouncycastle:bcprov-jdk18on` version 1.77
([#&#8203;12326](https://togithub.com/opensearch-project/OpenSearch/pull/12326))
- Bump `org.bouncycastle:bcmail-jdk15to18` to
`org.bouncycastle:bcmail-jdk18on` version 1.77
([#&#8203;12326](https://togithub.com/opensearch-project/OpenSearch/pull/12326))
- Bump `org.bouncycastle:bcpkix-jdk15to18` to
`org.bouncycastle:bcpkix-jdk18on` version 1.77
([#&#8203;12326](https://togithub.com/opensearch-project/OpenSearch/pull/12326))
- Bump `gradle/wrapper-validation-action` from 1 to 2
([#&#8203;12367](https://togithub.com/opensearch-project/OpenSearch/pull/12367))
- Bump `netty` from 4.1.106.Final to 4.1.107.Final
([#&#8203;12372](https://togithub.com/opensearch-project/OpenSearch/pull/12372))
- Bump `opentelemetry` from 1.34.1 to 1.36.0
([#&#8203;12388](https://togithub.com/opensearch-project/OpenSearch/pull/12388),
[#&#8203;12618](https://togithub.com/opensearch-project/OpenSearch/pull/12618))
- Bump Apache Lucene from 9.9.2 to 9.10.0
([#&#8203;12392](https://togithub.com/opensearch-project/OpenSearch/pull/12392))
- Bump `org.apache.logging.log4j:log4j-core` from 2.22.1 to 2.23.1
([#&#8203;12464](https://togithub.com/opensearch-project/OpenSearch/pull/12464),
[#&#8203;12587](https://togithub.com/opensearch-project/OpenSearch/pull/12587))
- Bump `antlr4` from 4.11.1 to 4.13.1
([#&#8203;12445](https://togithub.com/opensearch-project/OpenSearch/pull/12445))
- Bump `com.netflix.nebula.ospackage-base` from 11.8.0 to 11.8.1
([#&#8203;12461](https://togithub.com/opensearch-project/OpenSearch/pull/12461))
- Bump `peter-evans/create-or-update-comment` from 3 to 4
([#&#8203;12462](https://togithub.com/opensearch-project/OpenSearch/pull/12462))
- Bump `lycheeverse/lychee-action` from 1.9.1 to 1.9.3
([#&#8203;12521](https://togithub.com/opensearch-project/OpenSearch/pull/12521))
- Bump `com.azure:azure-core` from 1.39.0 to 1.47.0
([#&#8203;12520](https://togithub.com/opensearch-project/OpenSearch/pull/12520))
- Bump `ch.qos.logback:logback-core` from 1.2.13 to 1.5.3
([#&#8203;12519](https://togithub.com/opensearch-project/OpenSearch/pull/12519))
- Bump `codecov/codecov-action` from 3 to 4
([#&#8203;12585](https://togithub.com/opensearch-project/OpenSearch/pull/12585))
- Bump `org.apache.zookeeper:zookeeper` from 3.9.1 to 3.9.2
([#&#8203;12580](https://togithub.com/opensearch-project/OpenSearch/pull/12580))
- Bump `org.codehaus.woodstox:stax2-api` from 4.2.1 to 4.2.2
([#&#8203;12579](https://togithub.com/opensearch-project/OpenSearch/pull/12579))
- Bump Jackson version from 2.16.1 to 2.17.0
([#&#8203;12611](https://togithub.com/opensearch-project/OpenSearch/pull/12611),
[#&#8203;12662](https://togithub.com/opensearch-project/OpenSearch/pull/12662))
- Bump `reactor-netty` from 1.1.15 to 1.1.17
([#&#8203;12633](https://togithub.com/opensearch-project/OpenSearch/pull/12633))
- Bump `reactor` from 3.5.14 to 3.5.15
([#&#8203;12633](https://togithub.com/opensearch-project/OpenSearch/pull/12633))
- Bump `aws-sdk-java` from 2.20.55 to 2.20.86
([#&#8203;12251](https://togithub.com/opensearch-project/OpenSearch/pull/12251))

##### Changed

- Allow composite aggregation to run under a parent filter aggregation
([#&#8203;11499](https://togithub.com/opensearch-project/OpenSearch/pull/11499))
- Quickly compute terms aggregations when the top-level query is
functionally match-all for a segment
([#&#8203;11643](https://togithub.com/opensearch-project/OpenSearch/pull/11643))
- Mark fuzzy filter GA and remove experimental setting
([12631](https://togithub.com/opensearch-project/OpenSearch/pull/12631))
- Keep the election scheduler open until cluster state has been applied
([#&#8203;11699](https://togithub.com/opensearch-project/OpenSearch/pull/11699))

##### Fixed

- \[Revert] \[Bug] Check phase name before
SearchRequestOperationsListener onPhaseStart
([#&#8203;12035](https://togithub.com/opensearch-project/OpenSearch/pull/12035))
- Add support of special WrappingSearchAsyncActionPhase so the
onPhaseStart() will always be followed by onPhaseEnd() within
AbstractSearchAsyncAction
([#&#8203;12293](https://togithub.com/opensearch-project/OpenSearch/pull/12293))
- Add a system property to configure YamlParser codepoint limits
([#&#8203;12298](https://togithub.com/opensearch-project/OpenSearch/pull/12298))
- Prevent read beyond slice boundary in ByteArrayIndexInput
([#&#8203;10481](https://togithub.com/opensearch-project/OpenSearch/issues/10481))
- Fix the "highlight.max_analyzer_offset" request parameter with "plain"
highlighter
([#&#8203;10919](https://togithub.com/opensearch-project/OpenSearch/pull/10919))
- Prevent unnecessary fetch sub phase processor initialization during
fetch phase execution
([#&#8203;12503](https://togithub.com/opensearch-project/OpenSearch/pull/12503))
- Fix `terms` query on `float` field when `doc_values` are turned off by
reverting back to `FloatPoint` from `FloatField`
([#&#8203;12499](https://togithub.com/opensearch-project/OpenSearch/pull/12499))
- Fix get task API does not refresh resource stats
([#&#8203;11531](https://togithub.com/opensearch-project/OpenSearch/pull/11531))
- Fix for deserilization bug in weighted round-robin metadata
([#&#8203;11679](https://togithub.com/opensearch-project/OpenSearch/pull/11679))
- onShardResult and onShardFailure are executed on one shard causes
opensearch jvm crashed
([#&#8203;12158](https://togithub.com/opensearch-project/OpenSearch/pull/12158))
- Avoid overflow when sorting missing last on `epoch_millis` datetime
field
([#&#8203;12676](https://togithub.com/opensearch-project/OpenSearch/pull/12676))

###
[`v2.12.0`](https://togithub.com/opensearch-project/OpenSearch/releases/tag/2.12.0)

[Compare
Source](https://togithub.com/opensearch-project/OpenSearch/compare/2.11.1...2.12.0)

#### 2024-02-09 Version 2.12.0 Release Notes

#### \[2.12.0]

##### Added

- \[Admission control] Add Resource usage collector service and resource
usage tracker
([#&#8203;9890](https://togithub.com/opensearch-project/OpenSearch/pull/9890))
- \[Admission control] Add enhancements to FS stats to include
read/write time, queue size and IO time
([#&#8203;10541](https://togithub.com/opensearch-project/OpenSearch/pull/10541))
- \[Remote cluster state] Change file names for remote cluster state
([#&#8203;10557](https://togithub.com/opensearch-project/OpenSearch/pull/10557))
- \[Search Pipelines] Add request-scoped state shared between processors
(and three new processors)
([#&#8203;9405](https://togithub.com/opensearch-project/OpenSearch/pull/9405))
- Per request phase latency
([#&#8203;10351](https://togithub.com/opensearch-project/OpenSearch/issues/10351))
- \[Remote Store] Add repository stats for remote
store([#&#8203;10567](https://togithub.com/opensearch-project/OpenSearch/pull/10567))
- \[Remote cluster state] Upload global metadata in cluster state to
remote
store([#&#8203;10404](https://togithub.com/opensearch-project/OpenSearch/pull/10404))
- \[Remote cluster state] Download functionality of global metadata from
remote store
([#&#8203;10535](https://togithub.com/opensearch-project/OpenSearch/pull/10535))
- \[Remote cluster state] Restore global metadata from remote store when
local state is lost after quorum loss
([#&#8203;10404](https://togithub.com/opensearch-project/OpenSearch/pull/10404))
- \[Remote cluster state] Make index and global metadata upload timeout
dynamic cluster settings
([#&#8203;10814](https://togithub.com/opensearch-project/OpenSearch/pull/10814))
- Add search query categorizer
([#&#8203;10255](https://togithub.com/opensearch-project/OpenSearch/pull/10255))
- Per request phase latency
([#&#8203;10351](https://togithub.com/opensearch-project/OpenSearch/issues/10351))
- Add cluster state stats
([#&#8203;10670](https://togithub.com/opensearch-project/OpenSearch/pull/10670))
- Remove ingest processor supports excluding fields
([#&#8203;10967](https://togithub.com/opensearch-project/OpenSearch/pull/10967),
[#&#8203;11983](https://togithub.com/opensearch-project/OpenSearch/pull/11983))
- \[Tiered caching] Enabling serialization for IndicesRequestCache key
object
([#&#8203;10275](https://togithub.com/opensearch-project/OpenSearch/pull/10275))
- \[Tiered caching] Defining interfaces, listeners and extending
IndicesRequestCache with Tiered cache support
([#&#8203;10753](https://togithub.com/opensearch-project/OpenSearch/pull/10753))
- \[Remote cluster state] Restore cluster state version during remote
state auto restore
([#&#8203;10853](https://togithub.com/opensearch-project/OpenSearch/pull/10853))
- Update the indexRandom function to create more segments for concurrent
search tests
([10247](https://togithub.com/opensearch-project/OpenSearch/pull/10247))
- Add support for query profiler with concurrent aggregation
([#&#8203;9248](https://togithub.com/opensearch-project/OpenSearch/pull/9248))
- Introduce ConcurrentQueryProfiler to profile query using concurrent
segment search path and support concurrency during rewrite and create
weight
([10352](https://togithub.com/opensearch-project/OpenSearch/pull/10352))
- Implement on behalf of token passing for extensions
([#&#8203;8679](https://togithub.com/opensearch-project/OpenSearch/pull/8679))
- Provide service accounts tokens to extensions
([#&#8203;9618](https://togithub.com/opensearch-project/OpenSearch/pull/9618))
- \[Streaming Indexing] Introduce new experimental server HTTP transport
based on Netty 4 and Project Reactor (Reactor Netty)
([#&#8203;9672](https://togithub.com/opensearch-project/OpenSearch/pull/9672))
- Enable must_exist parameter for update aliases API
([#&#8203;11210](https://togithub.com/opensearch-project/OpenSearch/pull/11210))
- Add back half_float BKD based sort query optimization
([#&#8203;11024](https://togithub.com/opensearch-project/OpenSearch/pull/11024))
- Request level coordinator slow logs
([#&#8203;10650](https://togithub.com/opensearch-project/OpenSearch/pull/10650))
- Add template snippets support for field and target_field in KV ingest
processor
([#&#8203;10040](https://togithub.com/opensearch-project/OpenSearch/pull/10040))
- Allowing pipeline processors to access index mapping info by passing
ingest service ref as part of the processor factory parameters
([#&#8203;10307](https://togithub.com/opensearch-project/OpenSearch/pull/10307))
- Add experimental SIMD implementation of B-tree to round down dates
([#&#8203;11194](https://togithub.com/opensearch-project/OpenSearch/issues/11194))
- Make number of segment metadata files in remote segment store
configurable
([#&#8203;11329](https://togithub.com/opensearch-project/OpenSearch/pull/11329))
- Allow changing number of replicas of searchable snapshot index
([#&#8203;11317](https://togithub.com/opensearch-project/OpenSearch/pull/11317))
- Adding slf4j license header to LoggerMessageFormat.java
([#&#8203;11069](https://togithub.com/opensearch-project/OpenSearch/pull/11069))
- \[BWC and API enforcement] Introduce checks for enforcing the API
restrictions
([#&#8203;11175](https://togithub.com/opensearch-project/OpenSearch/pull/11175))
- Maintainer approval check
([#&#8203;11378](https://togithub.com/opensearch-project/OpenSearch/pull/11378))
- Create separate transport action for render search template action
([#&#8203;11170](https://togithub.com/opensearch-project/OpenSearch/pull/11170))
- Add additional handling in SearchTemplateRequest when simulate is set
to true
([#&#8203;11591](https://togithub.com/opensearch-project/OpenSearch/pull/11591))
- Introduce cluster level setting
`cluster.index.restrict.replication.type` to prevent replication type
setting override during index
creations([#&#8203;11583](https://togithub.com/opensearch-project/OpenSearch/pull/11583))
- Add match_only_text field that is optimized for storage by trading off
positional queries performance
([#&#8203;6836](https://togithub.com/opensearch-project/OpenSearch/pull/11039))
- Add copy ingest processor
([#&#8203;11870](https://togithub.com/opensearch-project/OpenSearch/pull/11870))
- Introduce new feature flag "WRITEABLE_REMOTE_INDEX" to gate the
writeable remote index functionality
([#&#8203;11717](https://togithub.com/opensearch-project/OpenSearch/pull/11170))
- Bump OpenTelemetry from 1.32.0 to 1.34.1
([#&#8203;11891](https://togithub.com/opensearch-project/OpenSearch/pull/11891))
- Add remove_by_pattern ingest processor
([#&#8203;11920](https://togithub.com/opensearch-project/OpenSearch/pull/11920))
- Support index level allocation filtering for searchable snapshot index
([#&#8203;11563](https://togithub.com/opensearch-project/OpenSearch/pull/11563))
- Add `org.opensearch.rest.MethodHandlers` and
`RestController#getAllHandlers`
([11876](https://togithub.com/opensearch-project/OpenSearch/pull/11876))
- New DateTime format for RFC3339 compatible date fields
([#&#8203;11465](https://togithub.com/opensearch-project/OpenSearch/pull/11465))
- Add community_id ingest processor
([#&#8203;12121](https://togithub.com/opensearch-project/OpenSearch/pull/12121))
- Add support for Google Application Default Credentials in
repository-gcs
([#&#8203;8394](https://togithub.com/opensearch-project/OpenSearch/pull/8394))
- Remove concurrent segment search feature flag for GA launch
([#&#8203;12074](https://togithub.com/opensearch-project/OpenSearch/pull/12074))
- Enable Fuzzy codec for doc id fields using a bloom filter
([#&#8203;11022](https://togithub.com/opensearch-project/OpenSearch/pull/11022))
- \[Metrics Framework] Adds support for Histogram metric
([#&#8203;12062](https://togithub.com/opensearch-project/OpenSearch/pull/12062))
- Support for returning scores in matched queries
([#&#8203;11626](https://togithub.com/opensearch-project/OpenSearch/pull/11626))

##### Dependencies

- Bumps jetty version to 9.4.52.v20230823 to fix GMS-2023-1857
([#&#8203;9822](https://togithub.com/opensearch-project/OpenSearch/pull/9822))
- Bump Lucene from 9.7.0 to 9.8.0
([10276](https://togithub.com/opensearch-project/OpenSearch/pull/10276))
- Bump `commons-io:commons-io` from 2.13.0 to 2.15.1
([#&#8203;10294](https://togithub.com/opensearch-project/OpenSearch/pull/10294),
[#&#8203;11001](https://togithub.com/opensearch-project/OpenSearch/pull/11001),
[#&#8203;11002](https://togithub.com/opensearch-project/OpenSearch/pull/11002),
[#&#8203;11446](https://togithub.com/opensearch-project/OpenSearch/pull/11446),
[#&#8203;11554](https://togithub.com/opensearch-project/OpenSearch/pull/11554),
[#&#8203;11560](https://togithub.com/opensearch-project/OpenSearch/pull/11560),
[#&#8203;11796](https://togithub.com/opensearch-project/OpenSearch/pull/11796))
- Bump `com.google.api.grpc:proto-google-common-protos` from 2.10.0 to
2.25.1
([#&#8203;10208](https://togithub.com/opensearch-project/OpenSearch/pull/10208),
[#&#8203;10298](https://togithub.com/opensearch-project/OpenSearch/pull/10298))
- Bump `com.netflix.nebula.ospackage-base` from 11.4.0 to 11.8.0
([#&#8203;10295](https://togithub.com/opensearch-project/OpenSearch/pull/10295),
[#&#8203;11630](https://togithub.com/opensearch-project/OpenSearch/pull/11630),
[#&#8203;12167](https://togithub.com/opensearch-project/OpenSearch/pull/12167))
- Bump `org.apache.zookeeper:zookeeper` from 3.9.0 to 3.9.1
([#&#8203;10506](https://togithub.com/opensearch-project/OpenSearch/pull/10506))
- Bump `de.thetaphi:forbiddenapis` from 3.5.1 to 3.6
([#&#8203;10508](https://togithub.com/opensearch-project/OpenSearch/pull/10508))
- Bump `org.codehaus.woodstox:stax2-api` from 4.2.1 to 4.2.2
([#&#8203;10639](https://togithub.com/opensearch-project/OpenSearch/pull/10639))
- Bump `org.bouncycastle:bc-fips` from 1.0.2.3 to 1.0.2.4
([#&#8203;10297](https://togithub.com/opensearch-project/OpenSearch/pull/10297))
- Bump `com.google.http-client:google-http-client` from 1.43.2 to 1.43.3
([#&#8203;10635](https://togithub.com/opensearch-project/OpenSearch/pull/10635))
- Bump `com.squareup.okio:okio` from 3.5.0 to 3.7.0
([#&#8203;10637](https://togithub.com/opensearch-project/OpenSearch/pull/10637),
[#&#8203;11632](https://togithub.com/opensearch-project/OpenSearch/pull/11632))
- Bump `org.apache.logging.log4j:log4j-core` from 2.20.0 to 2.22.1
([#&#8203;10858](https://togithub.com/opensearch-project/OpenSearch/pull/10858),
[#&#8203;11000](https://togithub.com/opensearch-project/OpenSearch/pull/11000),
[#&#8203;11270](https://togithub.com/opensearch-project/OpenSearch/pull/11270),
[#&#8203;11695](https://togithub.com/opensearch-project/OpenSearch/pull/11695))
- Bump `aws-actions/configure-aws-credentials` from 2 to 4
([#&#8203;10504](https://togithub.com/opensearch-project/OpenSearch/pull/10504))
- Bump `stefanzweifel/git-auto-commit-action` from 4 to 5
([#&#8203;11171](https://togithub.com/opensearch-project/OpenSearch/pull/11171))
- Bump `actions/github-script` from 6 to 7.0.1
([#&#8203;11271](https://togithub.com/opensearch-project/OpenSearch/pull/11271),
[#&#8203;12166](https://togithub.com/opensearch-project/OpenSearch/pull/12166))
- Bump `jackson` and `jackson_databind` from 2.15.2 to 2.16.0
([#&#8203;11273](https://togithub.com/opensearch-project/OpenSearch/pull/11273))
- Bump `netty` from 4.1.100.Final to 4.1.106.Final
([#&#8203;11294](https://togithub.com/opensearch-project/OpenSearch/pull/11294),
[#&#8203;11775](https://togithub.com/opensearch-project/OpenSearch/pull/11775)),
[#&#8203;12034](https://togithub.com/opensearch-project/OpenSearch/pull/12034))
- Bump `com.avast.gradle:gradle-docker-compose-plugin` from 0.16.12 to
0.17.6
([#&#8203;10163](https://togithub.com/opensearch-project/OpenSearch/pull/10163),
[#&#8203;11692](https://togithub.com/opensearch-project/OpenSearch/pull/11692))
- Bump `com.squareup.okhttp3:okhttp` from 4.11.0 to 4.12.0
([#&#8203;10861](https://togithub.com/opensearch-project/OpenSearch/pull/10861))
- Bump `org.apache.commons:commons-text` from 1.10.0 to 1.11.0
([#&#8203;11344](https://togithub.com/opensearch-project/OpenSearch/pull/11344))
- Bump `reactor-netty-core` from 1.1.12 to 1.1.15
([#&#8203;11350](https://togithub.com/opensearch-project/OpenSearch/pull/11350)),
([#&#8203;12042](https://togithub.com/opensearch-project/OpenSearch/pull/12042))
- Bump `com.gradle.enterprise` from 3.14.1 to 3.16.2
([#&#8203;11339](https://togithub.com/opensearch-project/OpenSearch/pull/11339),
[#&#8203;11629](https://togithub.com/opensearch-project/OpenSearch/pull/11629),
[#&#8203;12056](https://togithub.com/opensearch-project/OpenSearch/pull/12056))
- Bump `actions/setup-java` from 3 to 4
([#&#8203;11447](https://togithub.com/opensearch-project/OpenSearch/pull/11447))
- Bump `commons-net:commons-net` from 3.9.0 to 3.10.0
([#&#8203;11450](https://togithub.com/opensearch-project/OpenSearch/pull/11450))
- Bump `org.apache.maven:maven-model` from 3.9.4 to 3.9.6
([#&#8203;11445](https://togithub.com/opensearch-project/OpenSearch/pull/11445))
- Bump `org.apache.xmlbeans:xmlbeans` from 5.1.1 to 5.2.0
([#&#8203;11448](https://togithub.com/opensearch-project/OpenSearch/pull/11448))
- Bump `logback-core` and `logback-classic` to 1.2.13
([#&#8203;11521](https://togithub.com/opensearch-project/OpenSearch/pull/11521))
- Bumps `jetty` version from 9.4.52.v20230823 to 9.4.53.v20231009
([#&#8203;11539](https://togithub.com/opensearch-project/OpenSearch/pull/11539))
- Bump `org.wiremock:wiremock-standalone` from 3.1.0 to 3.3.1
([#&#8203;11555](https://togithub.com/opensearch-project/OpenSearch/pull/11555))
- Bump `org.apache.commons:commons-compress` from 1.24.0 to 1.25.0
([#&#8203;11556](https://togithub.com/opensearch-project/OpenSearch/pull/11556))
- Bump `actions/stale` from 8 to 9
([#&#8203;11557](https://togithub.com/opensearch-project/OpenSearch/pull/11557))
- Bump `com.netflix.nebula:nebula-publishing-plugin` from 20.3.0 to
21.0.0
([#&#8203;11671](https://togithub.com/opensearch-project/OpenSearch/pull/11671))
- Bump `commons-cli:commons-cli` from 1.5.0 to 1.6.0
([#&#8203;10996](https://togithub.com/opensearch-project/OpenSearch/pull/10996))
- Bump `com.maxmind.geoip2:geoip2` from 4.1.0 to 4.2.0
([#&#8203;11559](https://togithub.com/opensearch-project/OpenSearch/pull/11559))
- Bump `org.apache.commons:commons-lang3` from 3.13.0 to 3.14.0
([#&#8203;11691](https://togithub.com/opensearch-project/OpenSearch/pull/11691))
- Bump `com.maxmind.db:maxmind-db` from 3.0.0 to 3.1.0
([#&#8203;11693](https://togithub.com/opensearch-project/OpenSearch/pull/11693))
- Bump `net.java.dev.jna:jna` from 5.13.0 to 5.14.0
([#&#8203;11798](https://togithub.com/opensearch-project/OpenSearch/pull/11798))
- Bump `lycheeverse/lychee-action` from 1.8.0 to 1.9.1
([#&#8203;11795](https://togithub.com/opensearch-project/OpenSearch/pull/11795),
[#&#8203;11887](https://togithub.com/opensearch-project/OpenSearch/pull/11887))
- Bump `Lucene` from 9.8.0 to 9.9.2
([#&#8203;11421](https://togithub.com/opensearch-project/OpenSearch/pull/11421)),
([#&#8203;12063](https://togithub.com/opensearch-project/OpenSearch/pull/12063))
- Bump `com.networknt:json-schema-validator` from 1.0.86 to 1.2.0
([#&#8203;11886](https://togithub.com/opensearch-project/OpenSearch/pull/11886),
[#&#8203;11963](https://togithub.com/opensearch-project/OpenSearch/pull/11963))
- Bump `com.google.api:gax-httpjson` from 0.103.1 to 2.42.0
([#&#8203;11794](https://togithub.com/opensearch-project/OpenSearch/pull/11794),
[#&#8203;12165](https://togithub.com/opensearch-project/OpenSearch/pull/12165))
- Bump `com.google.oauth-client:google-oauth-client` from 1.34.1 to
1.35.0
([#&#8203;11960](https://togithub.com/opensearch-project/OpenSearch/pull/11960))
- Bump `com.diffplug.spotless` from 6.23.2 to 6.25.0
([#&#8203;11962](https://togithub.com/opensearch-project/OpenSearch/pull/11962),
[#&#8203;12055](https://togithub.com/opensearch-project/OpenSearch/pull/12055))
- Bump `com.google.cloud:google-cloud-core` from 2.5.10 to 2.30.0
([#&#8203;11961](https://togithub.com/opensearch-project/OpenSearch/pull/11961))
- Bump `reactor-core` from 3.5.11 to 3.5.14
([#&#8203;12042](https://togithub.com/opensearch-project/OpenSearch/pull/12042))
- Bump `org.apache.shiro:shiro-core` from 1.11.0 to 1.13.0
([#&#8203;12200](https://togithub.com/opensearch-project/OpenSearch/pull/12200))
- Bump `com.google.http-client:google-http-client-jackson2` from 1.43.3
to 1.44.1
([#&#8203;12059](https://togithub.com/opensearch-project/OpenSearch/pull/12059))
- Bump `peter-evans/create-issue-from-file` from 4 to 5
([#&#8203;12057](https://togithub.com/opensearch-project/OpenSearch/pull/12057))
- Bump `org.gradle.test-retry` from 1.5.4 to 1.5.8
([#&#8203;12168](https://togithub.com/opensearch-project/OpenSearch/pull/12168))
- Bump `org.apache.kerby:kerb-admin` from 1.0.1 to 2.0.3
([#&#8203;12194](https://togithub.com/opensearch-project/OpenSearch/pull/12194))

##### Changed

- Mute the query profile IT with concurrent execution
([#&#8203;9840](https://togithub.com/opensearch-project/OpenSearch/pull/9840))
- Force merge with `only_expunge_deletes` honors max segment size
([#&#8203;10036](https://togithub.com/opensearch-project/OpenSearch/pull/10036))
- Add the means to extract the contextual properties from HttpChannel,
TcpCChannel and TrasportChannel without excessive typecasting
([#&#8203;10562](https://togithub.com/opensearch-project/OpenSearch/pull/10562)),
([#&#8203;11751](https://togithub.com/opensearch-project/OpenSearch/pull/11751))
- Introduce new dynamic cluster setting to control slice computation for
concurrent segment search
([#&#8203;9107](https://togithub.com/opensearch-project/OpenSearch/pull/9107))
- Search pipelines now support asynchronous request and response
processors to avoid blocking on a transport thread
([#&#8203;10598](https://togithub.com/opensearch-project/OpenSearch/pull/10598))
- \[Remote Store] Add Remote Store backpressure rejection stats to
`_nodes/stats`
([#&#8203;10524](https://togithub.com/opensearch-project/OpenSearch/pull/10524))
- \[BUG] Fix java.lang.SecurityException in repository-gcs plugin
([#&#8203;10642](https://togithub.com/opensearch-project/OpenSearch/pull/10642))
- Add telemetry tracer/metric enable flag and integ test.
([#&#8203;10395](https://togithub.com/opensearch-project/OpenSearch/pull/10395))
- Performance improvement for Datetime field caching
([#&#8203;4558](https://togithub.com/opensearch-project/OpenSearch/issues/4558))
- Add instrumentation for indexing in transport bulk action and
transport shard bulk action.
([#&#8203;10273](https://togithub.com/opensearch-project/OpenSearch/pull/10273))
- Disallow removing some metadata fields by remove ingest processor
([#&#8203;10895](https://togithub.com/opensearch-project/OpenSearch/pull/10895),
[#&#8203;11607](https://togithub.com/opensearch-project/OpenSearch/pull/11607))
- Performance improvement for MultiTerm Queries on Keyword fields
([#&#8203;7057](https://togithub.com/opensearch-project/OpenSearch/issues/7057))
- Refactor common parts from the Rounding class into a separate 'round'
package
([#&#8203;11023](https://togithub.com/opensearch-project/OpenSearch/issues/11023))
- Performance improvement for date histogram aggregations without
sub-aggregations
([#&#8203;11083](https://togithub.com/opensearch-project/OpenSearch/pull/11083))
- Apply the fast filter optimization to composite aggregation of date
histogram source
([#&#8203;11505](https://togithub.com/opensearch-project/OpenSearch/pull/11083))
- Disable concurrent aggs for Diversified Sampler and Sampler aggs
([#&#8203;11087](https://togithub.com/opensearch-project/OpenSearch/issues/11087))
- Made leader/follower check timeout setting dynamic
([#&#8203;10528](https://togithub.com/opensearch-project/OpenSearch/pull/10528))
- Improved performance of numeric exact-match queries
([#&#8203;11209](https://togithub.com/opensearch-project/OpenSearch/pull/11209))
- Change error message when per shard document limit is breached
([#&#8203;11312](https://togithub.com/opensearch-project/OpenSearch/pull/11312))
- Improve boolean parsing performance
([#&#8203;11308](https://togithub.com/opensearch-project/OpenSearch/pull/11308))
- Interpret byte array as primitive using VarHandles
([#&#8203;11362](https://togithub.com/opensearch-project/OpenSearch/pull/11362))
- Automatically add scheme to discovery.ec2.endpoint
([#&#8203;11512](https://togithub.com/opensearch-project/OpenSearch/pull/11512))
- Restore support for Java 8 for RestClient
([#&#8203;11562](https://togithub.com/opensearch-project/OpenSearch/pull/11562))
- Add deleted doc count in \_cat/shards
([#&#8203;11678](https://togithub.com/opensearch-project/OpenSearch/pull/11678))
- Capture information for additional query types and aggregation types
([#&#8203;11582](https://togithub.com/opensearch-project/OpenSearch/pull/11582))
- Use slice_size == shard_size heuristic in terms aggs for concurrent
segment search and properly calculate the doc_count_error
([#&#8203;11732](https://togithub.com/opensearch-project/OpenSearch/pull/11732))
- Added Support for dynamically adding SearchRequestOperationsListeners
with SearchRequestOperationsCompositeListenerFactory
([#&#8203;11526](https://togithub.com/opensearch-project/OpenSearch/pull/11526))
- Ensure Jackson default maximums introduced in 2.16.0 do not conflict
with OpenSearch settings
([#&#8203;11890](https://togithub.com/opensearch-project/OpenSearch/pull/11890))
- Extract cluster management for integration tests into JUnit test rule
out of OpenSearchIntegTestCase
([#&#8203;11877](https://togithub.com/opensearch-project/OpenSearch/pull/11877)),
([#&#8203;12000](https://togithub.com/opensearch-project/OpenSearch/pull/12000))
- Workaround for https://bugs.openjdk.org/browse/JDK-8323659 regression,
introduced in JDK-21.0.2
([#&#8203;11968](https://togithub.com/opensearch-project/OpenSearch/pull/11968))
- Updates IpField to be searchable when only `doc_values` are enabled
([#&#8203;11508](https://togithub.com/opensearch-project/OpenSearch/pull/11508))
- \[Query Insights] Query Insights Framework which currently supports
retrieving the most time-consuming queries within the last configured
time window
([#&#8203;11903](https://togithub.com/opensearch-project/OpenSearch/pull/11903))
- \[Query Insights] Implement Top N Queries feature to collect and
gather information about high latency queries in a window
([#&#8203;11904](https://togithub.com/opensearch-project/OpenSearch/pull/11904))
- Add override support for sampling based on action
([#&#8203;9621](https://togithub.com/opensearch-project/OpenSearch/issues/9621))
- Added custom sampler support based on transport action in request
([#&#8203;9621](https://togithub.com/opensearch-project/OpenSearch/issues/9621))
- Disable concurrent search for composite
aggregation([#&#8203;12375](https://togithub.com/opensearch-project/OpenSearch/pull/12375))

##### Removed

- Remove deprecated classes for Rounding
([#&#8203;10956](https://togithub.com/opensearch-project/OpenSearch/issues/10956))

##### Fixed

- Fix failure in dissect ingest processor parsing empty brackets
([#&#8203;9225](https://togithub.com/opensearch-project/OpenSearch/pull/9255))
- Fix `class_cast_exception` when passing int to `_version` and other
metadata fields in ingest simulate API
([#&#8203;10101](https://togithub.com/opensearch-project/OpenSearch/pull/10101))
- Fix Segment Replication ShardLockObtainFailedException bug during
index corruption
([10370](https://togithub.com/opensearch-project/OpenSearch/pull/10370))
- Fix some test methods in SimulatePipelineRequestParsingTests never run
and fix test failure
([#&#8203;10496](https://togithub.com/opensearch-project/OpenSearch/pull/10496))
- Fix passing wrong parameter when calling newConfigurationException()
in DotExpanderProcessor
([#&#8203;10737](https://togithub.com/opensearch-project/OpenSearch/pull/10737))
- Delegating CachingWeightWrapper#count to internal weight object
([#&#8203;10543](https://togithub.com/opensearch-project/OpenSearch/pull/10543))
- Fix per request latency last phase not tracked
([#&#8203;10934](https://togithub.com/opensearch-project/OpenSearch/pull/10934))
- Fix SuggestSearch.testSkipDuplicates by forcing refresh when indexing
its test documents
([#&#8203;11068](https://togithub.com/opensearch-project/OpenSearch/pull/11068))
- \[BUG] Fix the thread context that is not properly cleared and messes
up the traces
([#&#8203;10873](https://togithub.com/opensearch-project/OpenSearch/pull/10873))
- Handle canMatchSearchAfter for frozen context scenario
([#&#8203;11249](https://togithub.com/opensearch-project/OpenSearch/pull/11249))
- Fix the issue with DefaultSpanScope restoring wrong span in the
TracerContextStorage upon detach
([#&#8203;11316](https://togithub.com/opensearch-project/OpenSearch/issues/11316))
- Remove shadowJar from `lang-painless` module publication
([#&#8203;11369](https://togithub.com/opensearch-project/OpenSearch/issues/11369))
- Fix remote shards balancer and remove unused variables
([#&#8203;11167](https://togithub.com/opensearch-project/OpenSearch/pull/11167))
- Fix parsing of flat object fields with dots in keys
([#&#8203;11425](https://togithub.com/opensearch-project/OpenSearch/pull/11425))
- Fix bug where replication lag grows post primary relocation
([#&#8203;11238](https://togithub.com/opensearch-project/OpenSearch/pull/11238))
- Fix noop_update_total metric in indexing stats cannot be updated by
bulk API
([#&#8203;11485](https://togithub.com/opensearch-project/OpenSearch/pull/11485),[#&#8203;11917](https://togithub.com/opensearch-project/OpenSearch/pull/11917))
- Fix for stuck update action in a bulk with `retry_on_conflict`
property
([#&#8203;11152](https://togithub.com/opensearch-project/OpenSearch/issues/11152))
- Fix template setting override for replication type
([#&#8203;11417](https://togithub.com/opensearch-project/OpenSearch/pull/11417))
- Fix Automatic addition of protocol broken in
[#&#8203;11512](https://togithub.com/opensearch-project/OpenSearch/issues/11512)
([#&#8203;11609](https://togithub.com/opensearch-project/OpenSearch/pull/11609))
- Fix issue when calling Delete PIT endpoint and no PITs exist
([#&#8203;11711](https://togithub.com/opensearch-project/OpenSearch/pull/11711))
- Fix tracing context propagation for local transport instrumentation
([#&#8203;11490](https://togithub.com/opensearch-project/OpenSearch/pull/11490))
- Fix parsing of single line comments in `lang-painless`
([#&#8203;11815](https://togithub.com/opensearch-project/OpenSearch/issues/11815))
- Fix memory leak issue in ReorganizingLongHash
([#&#8203;11953](https://togithub.com/opensearch-project/OpenSearch/issues/11953))
- Prevent setting remote_snapshot store type on index creation
([#&#8203;11867](https://togithub.com/opensearch-project/OpenSearch/pull/11867))
- \[BUG] Fix remote shards balancer when filtering throttled nodes
([#&#8203;11724](https://togithub.com/opensearch-project/OpenSearch/pull/11724))
- Add advance(int) for numeric values in order to allow point based
optimization to kick in
([#&#8203;12089](https://togithub.com/opensearch-project/OpenSearch/pull/12089))

###
[`v2.11.1`](https://togithub.com/opensearch-project/OpenSearch/releases/tag/2.11.1)

[Compare
Source](https://togithub.com/opensearch-project/OpenSearch/compare/2.11.0...2.11.1)

##### 2023-11-20 Version 2.11.1 Release Notes

##### \[2.11.1]

##### Changed

- Use iterative approach to evaluate Regex.simpleMatch
([#&#8203;11060](https://togithub.com/opensearch-project/OpenSearch/pull/11060))

##### Fixed

- \[BUG] Disable sort optimization for HALF_FLOAT
([#&#8203;10999](https://togithub.com/opensearch-project/OpenSearch/pull/10999))
- Adding version condition while adding geoshape doc values to the
index, to ensure backward
compatibility.([#&#8203;11095](https://togithub.com/opensearch-project/OpenSearch/pull/11095))
- Remove shadowJar from `lang-painless` module publication
([#&#8203;11369](https://togithub.com/opensearch-project/OpenSearch/issues/11369))

###
[`v2.11.0`](https://togithub.com/opensearch-project/OpenSearch/releases/tag/2.11.0)

[Compare
Source](https://togithub.com/opensearch-project/OpenSearch/compare/2.10.0...2.11.0)

##### 2023-10-12 Version 2.11.0 Release Notes

##### \[2.11]

##### Added

- Add coordinator level stats for search latency
([#&#8203;8386](https://togithub.com/opensearch-project/OpenSearch/issues/8386))
- Add metrics for thread_pool task wait time
([#&#8203;9681](https://togithub.com/opensearch-project/OpenSearch/pull/9681))
- Async blob read support for S3 plugin
([#&#8203;9694](https://togithub.com/opensearch-project/OpenSearch/pull/9694))
- \[Telemetry-Otel] Added support for OtlpGrpcSpanExporter exporter
([#&#8203;9666](https://togithub.com/opensearch-project/OpenSearch/pull/9666))
- Async blob read support for encrypted containers
([#&#8203;10131](https://togithub.com/opensearch-project/OpenSearch/pull/10131))
- Implement Visitor Design pattern in QueryBuilder to enable the
capability to traverse through the complex QueryBuilder tree.
([#&#8203;10110](https://togithub.com/opensearch-project/OpenSearch/pull/10110))
- Add capability to restrict async durability mode for remote indexes
([#&#8203;10189](https://togithub.com/opensearch-project/OpenSearch/pull/10189))
- Add Doc Status Counter for Indexing Engine
([#&#8203;4562](https://togithub.com/opensearch-project/OpenSearch/issues/4562))
- Add unreferenced file cleanup count to merge stats
([#&#8203;10204](https://togithub.com/opensearch-project/OpenSearch/pull/10204))
- Configurable merge policy for index with an option to choose from
LogByteSize and Tiered merge policy
([#&#8203;9992](https://togithub.com/opensearch-project/OpenSearch/pull/9992))
- \[Remote Store] Add support to restrict creation & deletion if system
repository and mutation of immutable settings of system repository
([#&#8203;9839](https://togithub.com/opensearch-project/OpenSearch/pull/9839))
- Improve compressed request handling
([#&#8203;10261](https://togithub.com/opensearch-project/OpenSearch/pull/10261))

##### Dependencies

- Bump JNA version from 5.5 to 5.13
([#&#8203;9963](https://togithub.com/opensearch-project/OpenSearch/pull/9963))
- Bump `peter-evans/create-or-update-comment` from 2 to 3
([#&#8203;9575](https://togithub.com/opensearch-project/OpenSearch/pull/9575))
- Bump `actions/checkout` from 2 to 4
([#&#8203;9968](https://togithub.com/opensearch-project/OpenSearch/pull/9968))
- Bump OpenTelemetry from 1.26.0 to 1.30.1
([#&#8203;9950](https://togithub.com/opensearch-project/OpenSearch/pull/9950))
- Bump `org.apache.commons:commons-compress` from 1.23.0 to 1.24.0
(\[[#&#8203;9973](https://togithub.com/opensearch-project/OpenSearch/issues/9973),
[#&#8203;9972](https://togithub.com/opensearch-project/OpenSearch/issues/9972)]\[https://github.com/opensearch-project/OpenSearch/pull/9973](https://togithub.com/opensearch-project/OpenSearch/pull/9973)3,[https://github.com/opensearch-project/OpenSearch/pull/9972](https://togithub.com/opensearch-project/OpenSearch/pull/9972)2))
- Bump `com.google.cloud:google-cloud-core-http` from 2.21.1 to 2.23.0
([#&#8203;9971](https://togithub.com/opensearch-project/OpenSearch/pull/9971))
- Bump `mockito` from 5.4.0 to 5.5.0
([#&#8203;10022](https://togithub.com/opensearch-project/OpenSearch/pull/10022))
- Bump `bytebuddy` from 1.14.3 to 1.14.7
([#&#8203;10022](https://togithub.com/opensearch-project/OpenSearch/pull/10022))
- Bump `com.zaxxer:SparseBitSet` from 1.2 to 1.3
([#&#8203;10098](https://togithub.com/opensearch-project/OpenSearch/pull/10098))
- Bump `tibdex/github-app-token` from 1.5.0 to 2.1.0
([#&#8203;10125](https://togithub.com/opensearch-project/OpenSearch/pull/10125))
- Bump `org.wiremock:wiremock-standalone` from 2.35.0 to 3.1.0
([#&#8203;9752](https://togithub.com/opensearch-project/OpenSearch/pull/9752))
- Bump `org.eclipse.jgit` from 6.5.0 to 6.7.0
([#&#8203;10147](https://togithub.com/opensearch-project/OpenSearch/pull/10147))
- Bump `codecov/codecov-action` from 2 to 3
([#&#8203;10209](https://togithub.com/opensearch-project/OpenSearch/pull/10209))
- Bump `com.google.http-client:google-http-client-jackson2` from 1.43.2
to 1.43.3
([#&#8203;10126](https://togithub.com/opensearch-project/OpenSearch/pull/10126))
- Bump `org.xerial.snappy:snappy-java` from 1.1.10.3 to 1.1.10.5
([#&#8203;10206](https://togithub.com/opensearch-project/OpenSearch/pull/10206),
[#&#8203;10299](https://togithub.com/opensearch-project/OpenSearch/pull/10299))
- Bump `org.bouncycastle:bcpkix-jdk15to18` from 1.75 to 1.76
([10219](https://togithub.com/opensearch-project/OpenSearch/pull/10219))\`
- Bump `org.bouncycastle:bcprov-jdk15to18` from 1.75 to 1.76
([10219](https://togithub.com/opensearch-project/OpenSearch/pull/10219))\`
- Bump `org.bouncycastle:bcmail-jdk15to18` from 1.75 to 1.76
([10219](https://togithub.com/opensearch-project/OpenSearch/pull/10219))\`
- Bump asm from 9.5 to 9.6
([#&#8203;10302](https://togithub.com/opensearch-project/OpenSearch/pull/10302))
- Bump netty from 4.1.97.Final to 4.1.99.Final
([#&#8203;10303](https://togithub.com/opensearch-project/OpenSearch/pull/10303))
- Bump `peter-evans/create-pull-request` from 3 to 5
([#&#8203;10301](https://togithub.com/opensearch-project/OpenSearch/pull/10301))
- Bump `org.apache.avro:avro` from 1.11.2 to 1.11.3
([#&#8203;10210](https://togithub.com/opensearch-project/OpenSearch/pull/10210))
- Bump `netty` from 4.1.99.Final to 4.1.100.Final
([#&#8203;10564](https://togithub.com/opensearch-project/OpenSearch/pull/10564))

##### Changed

- Add instrumentation in rest and network layer.
([#&#8203;9415](https://togithub.com/opensearch-project/OpenSearch/pull/9415))
- Allow parameterization of tests with
OpenSearchIntegTestCase.SuiteScopeTestCase annotation
([#&#8203;9916](https://togithub.com/opensearch-project/OpenSearch/pull/9916))
- Add instrumentation in transport service.
([#&#8203;10042](https://togithub.com/opensearch-project/OpenSearch/pull/10042))
- \[Tracing Framework] Add support for SpanKind.
([#&#8203;10122](https://togithub.com/opensearch-project/OpenSearch/pull/10122))
- Pass parent filter to inner query in nested query
([#&#8203;10246](https://togithub.com/opensearch-project/OpenSearch/pull/10246))
- Disable concurrent segment search when terminate_after is used
([#&#8203;10200](https://togithub.com/opensearch-project/OpenSearch/pull/10200))
- Add instrumentation in Inbound Handler.
([#&#8203;100143](https://togithub.com/opensearch-project/OpenSearch/pull/10143))
- Enable remote segment upload backpressure by default
([#&#8203;10356](https://togithub.com/opensearch-project/OpenSearch/pull/10356))
- \[Remote Store] Add support to reload repository metadata inplace
([#&#8203;9569](https://togithub.com/opensearch-project/OpenSearch/pull/9569))
- \[Metrics Framework] Add Metrics framework.
([#&#8203;10241](https://togithub.com/opensearch-project/OpenSearch/pull/10241))
- Updating the separator for RemoteStoreLockManager since underscore is
allowed in base64UUID url charset
([#&#8203;10379](https://togithub.com/opensearch-project/OpenSearch/pull/10379))

##### Removed

- Remove spurious SGID bit on directories
([#&#8203;9447](https://togithub.com/opensearch-project/OpenSearch/pull/9447))

##### Fixed

- Fix ignore_missing parameter has no effect when using template snippet
in rename ingest processor
([#&#8203;9725](https://togithub.com/opensearch-project/OpenSearch/pull/9725))
- Fix broken backward compatibility from 2.7 for IndexSorted field
indices
([#&#8203;10045](https://togithub.com/opensearch-project/OpenSearch/pull/10045))
- Fix concurrent search NPE when track_total_hits, terminate_after and
size=0 are used
([#&#8203;10082](https://togithub.com/opensearch-project/OpenSearch/pull/10082))
- Fix remove ingest processor handing ignore_missing parameter not
correctly
([10089](https://togithub.com/opensearch-project/OpenSearch/pull/10089))
- Fix registration and initialization of multiple extensions
([10256](https://togithub.com/opensearch-project/OpenSearch/pull/10256))
- Fix circular dependency in Settings initialization
([10194](https://togithub.com/opensearch-project/OpenSearch/pull/10194))
- Fix Segment Replication ShardLockObtainFailedException bug during
index corruption
([10370](https://togithub.com/opensearch-project/OpenSearch/pull/10370))

###
[`v2.10.0`](https://togithub.com/opensearch-project/OpenSearch/releases/tag/2.10.0)

[Compare
Source](https://togithub.com/opensearch-project/OpenSearch/compare/2.9.0...2.10.0)

#### 2023-09-08 Version 2.10.0 Release Notes

#### \[2.10]

##### Added

- Add server version as REST response header
[#&#8203;6583](https://togithub.com/opensearch-project/OpenSearch/issues/6583)
- Start replication checkpointTimers on primary before segments upload
to remote store.
([#&#8203;8221]()[https://github.com/opensearch-project/OpenSearch/pull/8221](https://togithub.com/opensearch-project/OpenSearch/pull/8221))
- Introduce new static cluster setting to control slice computation for
concurrent segment search.
([#&#8203;8847](https://togithub.com/opensearch-project/OpenSearch/pull/8884))
- Add configuration for file cache size to max remote data ratio to
prevent oversubscription of file cache
([#&#8203;8606](https://togithub.com/opensearch-project/OpenSearch/pull/8606))
- Disallow compression level to be set for default and best_compression
index codecs
([#&#8203;8737]()[https://github.com/opensearch-project/OpenSearch/pull/8737](https://togithub.com/opensearch-project/OpenSearch/pull/8737))
- \[distribution/archives] \[Linux] \[x64] Provide the variant of the
distributions bundled with JRE
([#&#8203;8195]()[https://github.com/opensearch-project/OpenSearch/pull/8195](https://togithub.com/opensearch-project/OpenSearch/pull/8195))
- Prioritize replica shard movement during shard relocation
([#&#8203;8875](https://togithub.com/opensearch-project/OpenSearch/pull/8875))
- Introducing Default and Best Compression codecs as their algorithm
name
([#&#8203;9123](https://togithub.com/opensearch-project/OpenSearch/pull/9123))
- Make SearchTemplateRequest implement IndicesRequest.Replaceable
([#&#8203;9122](https://togithub.com/opensearch-project/OpenSearch/pull/9122))
- \[BWC and API enforcement] Define the initial set of annotations,
their meaning and relations between them
([#&#8203;9223](https://togithub.com/opensearch-project/OpenSearch/pull/9223))
- \[Remote Store] Add Segment download stats to remotestore stats API
([#&#8203;8718](https://togithub.com/opensearch-project/OpenSearch/pull/8718))
- \[Remote Store] Add remote segment transfer stats on NodesStats API
([#&#8203;9168](https://togithub.com/opensearch-project/OpenSearch/pull/9168)
[#&#8203;9393](https://togithub.com/opensearch-project/OpenSearch/pull/9393)
[#&#8203;9454](https://togithub.com/opensearch-project/OpenSearch/pull/9454))
- \[Segment Replication] Support realtime reads for GET requests
([#&#8203;9212](https://togithub.com/opensearch-project/OpenSearch/pull/9212))
- Allow test clusters to run with TLS
([#&#8203;8900](https://togithub.com/opensearch-project/OpenSearch/pull/8900))
- Add jdk.incubator.vector module support for JDK 20+
([#&#8203;8601](https://togithub.com/opensearch-project/OpenSearch/pull/8601))
- \[Feature] Expose term frequency in Painless script score context
([#&#8203;9081](https://togithub.com/opensearch-project/OpenSearch/pull/9081))
- Add support for reading partial files to HDFS repository
([#&#8203;9513](https://togithub.com/opensearch-project/OpenSearch/issues/9513))
- \[Remote Store] Rate limiter integration for remote store uploads and
downloads([#&#8203;9448](https://togithub.com/opensearch-project/OpenSearch/pull/9448/))
- \[BWC and API enforcement] Decorate the existing APIs with proper
annotations (part 1)
([#&#8203;9520](https://togithub.com/opensearch-project/OpenSearch/pull/9520))
- Add support for extensions to search responses using SearchExtBuilder
([#&#8203;9379](https://togithub.com/opensearch-project/OpenSearch/pull/9379))
- \[Remote State] Create service to publish cluster state to remote
store
([#&#8203;9160](https://togithub.com/opensearch-project/OpenSearch/pull/9160))
- Core crypto library to perform encryption and decryption of source
content
([#&#8203;8466](https://togithub.com/opensearch-project/OpenSearch/pull/8466))
- Expose DelimitedTermFrequencyTokenFilter to allow providing term
frequencies along with terms
([#&#8203;9479](https://togithub.com/opensearch-project/OpenSearch/pull/9479))
- APIs for performing async blob reads and async downloads from the
repository using multiple streams
([#&#8203;9592](https://togithub.com/opensearch-project/OpenSearch/issues/9592))
- Add concurrent segment search related metrics to node and index stats
([#&#8203;9622](https://togithub.com/opensearch-project/OpenSearch/issues/9622))
- Add average concurrency metric for concurrent segment search
([#&#8203;9670](https://togithub.com/opensearch-project/OpenSearch/issues/9670))
- Introduce cluster default remote translog buffer interval setting
([#&#8203;9584](https://togithub.com/opensearch-project/OpenSearch/pull/9584))
- Added encryption-sdk lib to provide encryption and decryption
capabilities
([#&#8203;8466](https://togithub.com/opensearch-project/OpenSearch/pull/8466)
[#&#8203;9289](https://togithub.com/opensearch-project/OpenSearch/pull/9289))
- \[Segment Replication] Adding segment replication statistics rolled up
at index, node and cluster level
([#&#8203;9709](https://togithub.com/opensearch-project/OpenSearch/pull/9709))
- Added crypto-kms plugin to provide AWS KMS based key providers for
encryption/decryption.
([#&#8203;8465](https://togithub.com/opensearch-project/OpenSearch/pull/8465))
- \[Remote state] Integrate remote cluster state in publish/commit flow
([#&#8203;9665](https://togithub.com/opensearch-project/OpenSearch/pull/9665))
- \[Remote Store] Changes to introduce repository registration during
bootstrap via node attributes.
([#&#8203;9105](https://togithub.com/opensearch-project/OpenSearch/pull/9105))
- \[Remote state] Auto restore index metadata from last known cluster
state
([#&#8203;9831](https://togithub.com/opensearch-project/OpenSearch/pull/9831))

##### Dependencies

- Bump `org.apache.logging.log4j:log4j-core` from 2.17.1 to 2.20.0
([#&#8203;8307](https://togithub.com/opensearch-project/OpenSearch/pull/8307))
- Bump `io.grpc:grpc-context` from 1.46.0 to 1.57.1
([#&#8203;8726](https://togithub.com/opensearch-project/OpenSearch/pull/8726),
[#&#8203;9145](https://togithub.com/opensearch-project/OpenSearch/pull/9145))
- Bump `com.netflix.nebula:gradle-info-plugin` from 12.1.5 to 12.1.6
([#&#8203;8724](https://togithub.com/opensearch-project/OpenSearch/pull/8724))
- Bump `commons-codec:commons-codec` from 1.15 to 1.16.0
([#&#8203;8725](https://togithub.com/opensearch-project/OpenSearch/pull/8725))
- Bump `org.apache.zookeeper:zookeeper` from 3.8.1 to 3.9.0
([#&#8203;8844](https://togithub.com/opensearch-project/OpenSearch/pull/8844),
[#&#8203;9146](https://togithub.com/opensearch-project/OpenSearch/pull/9146))
- Bump `org.gradle.test-retry` from 1.5.3 to 1.5.4
([#&#8203;8842](https://togithub.com/opensearch-project/OpenSearch/pull/8842))
- Bump `com.netflix.nebula.ospackage-base` from 11.3.0 to 11.4.0
([#&#8203;8838](https://togithub.com/opensearch-project/OpenSearch/pull/8838))
- Bump `com.google.http-client:google-http-client-gson` from 1.43.2 to
1.43.3
([#&#8203;8840](https://togithub.com/opensearch-project/OpenSearch/pull/8840))
- OpenJDK Update (July 2023 Patch releases)
([#&#8203;8869](https://togithub.com/opensearch-project/OpenSearch/pull/8869))
- Bump `hadoop` libraries from 3.3.4 to 3.3.6
([#&#8203;6995](https://togithub.com/opensearch-project/OpenSearch/pull/6995))
- Bump `com.gradle.enterprise` from 3.13.3 to 3.14.1
([#&#8203;8996](https://togithub.com/opensearch-project/OpenSearch/pull/8996))
- Bump `org.apache.commons:commons-lang3` from 3.12.0 to 3.13.0
([#&#8203;8995](https://togithub.com/opensearch-project/OpenSearch/pull/8995))
- Bump `com.google.cloud:google-cloud-core-http` from 2.21.0 to 2.21.1
([#&#8203;8999](https://togithub.com/opensearch-project/OpenSearch/pull/8999))
- Bump `com.maxmind.geoip2:geoip2` from 4.0.1 to 4.1.0
([#&#8203;8998](https://togithub.com/opensearch-project/OpenSearch/pull/8998))
- Bump `org.apache.commons:commons-lang3` from 3.12.0 to 3.13.0 in
/plugins/repository-hdfs
([#&#8203;8997](https://togithub.com/opensearch-project/OpenSearch/pull/8997))
- Bump `netty` from 4.1.94.Final to 4.1.96.Final
([#&#8203;9030](https://togithub.com/opensearch-project/OpenSearch/pull/9030))
- Bump `com.google.jimfs:jimfs` from 1.2 to 1.3.0
([#&#8203;9080](https://togithub.com/opensearch-project/OpenSearch/pull/9080))
- Bump `io.projectreactor.netty:reactor-netty-http` from 1.1.8 to 1.1.9
([#&#8203;9147](https://togithub.com/opensearch-project/OpenSearch/pull/9147))
- Bump `org.apache.maven:maven-model` from 3.9.3 to 3.9.4
([#&#8203;9148](https://togithub.com/opensearch-project/OpenSearch/pull/9148))
- Bump `com.azure:azure-storage-blob` from 12.22.3 to 12.23.0
([#&#8203;9231](https://togithub.com/opensearch-project/OpenSearch/pull/9231))
- Bump `com.diffplug.spotless` from 6.19.0 to 6.20.0
([#&#8203;9227](https://togithub.com/opensearch-project/OpenSearch/pull/9227))
- Bump `org.xerial.snappy:snappy-java` from 1.1.8.2 to 1.1.10.3
([#&#8203;9252](https://togithub.com/opensearch-project/OpenSearch/pull/9252))
- Bump `com.squareup.okhttp3:okhttp` from 4.9.3 to 4.11.0
([#&#8203;9252](https://togithub.com/opensearch-project/OpenSearch/pull/9252))
- Bump `com.squareup.okio:okio` from 2.8.0 to 3.5.0
([#&#8203;9252](https://togithub.com/opensearch-project/OpenSearch/pull/9252))
- Bump `com.google.code.gson:gson` from 2.9.0 to 2.10.1
([#&#8203;9230](https://togithub.com/opensearch-project/OpenSearch/pull/9230))
- Bump `lycheeverse/lychee-action` from 1.2.0 to 1.8.0
([#&#8203;9228](https://togithub.com/opensearch-project/OpenSearch/pull/9228))
- Bump `snakeyaml` from 2.0 to 2.1
([#&#8203;9269](https://togithub.com/opensearch-project/OpenSearch/pull/9269))
- Bump `aws-actions/configure-aws-credentials` from 1 to 2
([#&#8203;9302](https://togithub.com/opensearch-project/OpenSearch/pull/9302))
- Bump `com.github.luben:zstd-jni` from 1.5.5-3 to 1.5.5-5
([#&#8203;9431](https://togithub.com/opensearch-project/OpenSearch/pull/9431)
- Bump `netty` from 4.1.96.Final to 4.1.97.Final
([#&#8203;9553](https://togithub.com/opensearch-project/OpenSearch/pull/9553))
- Bump `io.grpc:grpc-api` from 1.57.1 to 1.57.2
([#&#8203;9578](https://togithub.com/opensearch-project/OpenSearch/pull/9578))
- Add Encryption SDK dependencies
([#&#8203;8466](https://togithub.com/opensearch-project/OpenSearch/pull/8466))

##### Changed

- Default to mmapfs within hybridfs
([#&#8203;8508](https://togithub.com/opensearch-project/OpenSearch/pull/8508))
- Perform aggregation postCollection in ContextIndexSearcher after
searching leaves
([#&#8203;8303](https://togithub.com/opensearch-project/OpenSearch/pull/8303))
- Make Span exporter configurable
([#&#8203;8620](https://togithub.com/opensearch-project/OpenSearch/issues/8620))
- Perform aggregation postCollection in ContextIndexSearcher after
searching leaves
([#&#8203;8303](https://togithub.com/opensearch-project/OpenSearch/pull/8303))
- \[Refactor] StreamIO from common to core.common namespace in core lib
([#&#8203;8157](https://togithub.com/opensearch-project/OpenSearch/pull/8157))
- \[Refactor] Remaining HPPC to java.util collections
([#&#8203;8730](https://togithub.com/opensearc

</details>

---

### Configuration

📅 **Schedule**: Branch creation - "after 10pm every weekday,before 6am
every weekday" (UTC), Automerge - At any time (no schedule defined).

🚦 **Automerge**: Disabled by config. Please merge this manually once you
are satisfied.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about this update
again.

---

- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check
this box

---

This PR has been generated by [Mend
Renovate](https://www.mend.io/free-developer-tools/renovate/). View
repository job log
[here](https://developer.mend.io/github/camunda/zeebe).

<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy4yNjkuMiIsInVwZGF0ZWRJblZlciI6IjM3LjI2OS4yIiwidGFyZ2V0QnJhbmNoIjoibWFpbiJ9-->
shiv0408 pushed a commit to Gaurav614/OpenSearch that referenced this pull request Apr 25, 2024
…nsearch-project#8737)

* Disallowing compression level for lz4 and best_compression codec
* setting up codec settings interface for validation

Signed-off-by: Sarthak Aggarwal <[email protected]>
Signed-off-by: Shivansh Arora <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport 2.x Backport to 2.x branch
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Compression level to not be set for default or best_compression codec
6 participants