From ec921092c13134f4095bdbfb06aee7e0d57955c1 Mon Sep 17 00:00:00 2001 From: Prudhvi Godithi Date: Mon, 24 Jul 2023 11:50:58 -0700 Subject: [PATCH] [Release 2.9.0] Consolidated release notes (#3803) Signed-off-by: Prudhvi Godithi --- .../opensearch-release-notes-2.9.0.md | 630 ++++++++++++++++++ 1 file changed, 630 insertions(+) create mode 100644 release-notes/opensearch-release-notes-2.9.0.md diff --git a/release-notes/opensearch-release-notes-2.9.0.md b/release-notes/opensearch-release-notes-2.9.0.md new file mode 100644 index 0000000000..c81725b951 --- /dev/null +++ b/release-notes/opensearch-release-notes-2.9.0.md @@ -0,0 +1,630 @@ +# OpenSearch and OpenSearch Dashboards 2.9.0 Release Notes + +## Release Highlights +OpenSearch 2.9.0 includes a range of new features and enhancements to support search, analytics, observability, and security workloads, along with new codecs that offer performance improvements and increased index compression. A new experimental SDK lets you build your own extensions for OpenSearch. + +### New Features +* Search pipelines functionality is now generally available. Now, you can configure processors to transform search requests and responses and integrate functions like query rewriters and results rerankers. +* The neural search plugin is now generally available. These tools can help you build applications like semantic search more easily and take advantage of OpenSearch’s vector database capabilities. +* The machine learning (ML) framework is generally available in this release. This makes it easier to operationalize and integrate ML models by enabling users to upload their own models to OpenSearch. +* You can now integrate externally managed ML models with OpenSearch using new connectors. Connectors to external models can be created by defining a blueprint in JSON. +* Vector database functionality is enhanced with pre-filtering for queries using the Facebook AI Similarity Search (FAISS) engine, enabling the use of metadata to filter queries prior to performing nearest neighbors searches on k-NN indexes. +* Support for Lucene byte-sized vectors allows the use of vectors that have been quantized to the size of one byte per dimension instead of four for reduced storage and memory requirements. +* You can now view alerts and anomalies directly overlaid with the primary dashboards you use to monitor your environments and create alerting monitors or anomaly detectors directly from OpenSearch Dashboards. +* New composite monitors allow users to chain alerts generated by multiple individual monitors into a single workflow, enabling users to analyze data sources based on multiple criteria, create targeted notifications, and reduce alert volume. +* A new index compression codec enables performance improvements and reduced index sizes. The new codecs, zstd and zstd_no_dict, use the Zstandard compression algorithm for balanced compression and performance. +* Security Analytics supports a new ingestion schema for log data that follows the Open Cybersecurity Schema Framework (OCSF). A new correlation engine lets you create custom correlation rules to produce findings across different log sources. +* Geospatial tools add support for three types of aggregations using geoshapes data: geo_bounds, geo_hash, and geo_tile. +* CAT shards and CAT indices are added to the cluster health monitor metrics, allowing you to monitor the state of all primary and replica shards along with information related to index health and resource usage to support operational uptime. + + +### Experimental Features + +OpenSearch 2.9.0 release introduces an experimental SDK that gives developers the tools to build extensions for OpenSearch. The SDK provides interfaces for communicating with OpenSearch, allows extensions to be decoupled from OpenSearch versions, and other changes designed to make it easier for developers to build, and users to deploy, extensions of OpenSearch’s functionality. + + +## Release Details + +[OpenSearch and OpenSearch Dashboards 2.9.0](https://opensearch.org/versions/opensearch-2-9-0.html) includes the following feature, enhancement, bug fixes, infrastructure, documentation, maintenance and refactoring updates. + +OpenSearch [Release Notes](https://github.com/opensearch-project/OpenSearch/blob/main/release-notes/opensearch.release-notes-2.9.0.md). + +OpenSearch Dashboards [Release Notes](https://github.com/opensearch-project/OpenSearch-Dashboards/blob/main/release-notes/opensearch-dashboards.release-notes-2.9.0.md). + + + +## FEATURES + + +### OpenSearch Alerting +* Adds transport layer actions for CRUD workflows. ([#934](https://github.com/opensearch-project/alerting/pull/934)) +* Added rest layer for the workflow. ([#963](https://github.com/opensearch-project/alerting/pull/963)) +* [BucketLevelMonitor] Multi-term agg support. ([#964](https://github.com/opensearch-project/alerting/pull/964)) +* Check if AD backend role is enabled. ([#968](https://github.com/opensearch-project/alerting/pull/968)) +* Add workflow_id field in alert mapping json. ([#969](https://github.com/opensearch-project/alerting/pull/969)) +* Adds chained alerts. ([#976](https://github.com/opensearch-project/alerting/pull/976)) +* Implemented support for configuring a cluster metrics monitor to call cat/indices, and cat/shards. ([#992](https://github.com/opensearch-project/alerting/pull/992)) + +### OpenSearch Alerting Dashboards +* Integrate with Vis Augmenter to augment Dashboard visualizations. ([#596](https://github.com/opensearch-project/alerting-dashboards-plugin/pull/596)) +* Implemented support for configuring a cluster metrics monitor to call cat/indices, and cat/shards. ([#609](https://github.com/opensearch-project/alerting-dashboards-plugin/pull/609)) +* Implemented composite monitors. ([#611](https://github.com/opensearch-project/alerting-dashboards-plugin/pull/611)) + + + +### OpenSearch Anomaly Detection Dashboards +* Merge featureAnywhere branch into main ([#539](https://github.com/opensearch-project/anomaly-detection-dashboards-plugin/pull/539)) +* Pick changes from featureAnywhere branch into main ([#542](https://github.com/opensearch-project/anomaly-detection-dashboards-plugin/pull/542)) + + + +### OpenSearch Common Utils +* Adds Chained alerts triggers for workflows. ([#456](https://github.com/opensearch-project/common-utils/pull/456)) +* Acknowledge chained alert request for workflow. ([#459](https://github.com/opensearch-project/common-utils/pull/459)) +* Adds audit state in Alert. ([#461](https://github.com/opensearch-project/common-utils/pull/461)) +* Add workflowId field in alert. (([#463](https://github.com/opensearch-project/common-utils/pull/463)) +* APIs for get workflow alerts and acknowledge chained alerts. ([#472](https://github.com/opensearch-project/common-utils/pull/472)) +* Add auditDelegateMonitorAlerts flag. ([#476](https://github.com/opensearch-project/common-utils/pull/476)) +* Implemented support for configuring a cluster metrics monitor to call cat/indices, and cat/shards. ([#479](https://github.com/opensearch-project/common-utils/pull/479)) + +### OpenSearch Job Scheduler +* Add MacOS CI Workflow([#412](https://github.com/opensearch-project/job-scheduler/pull/412)) + + +### OpenSearch Dashboards Notifications +* Move notification plugin into management section on left navigation menu ([#46](https://github.com/opensearch-project/dashboards-notifications/pull/46)) + + + +### OpenSearch Dashboards Observability +* Integrations Plugin ([#317](https://github.com/opensearch-project/dashboards-observability/issues/317)) + + + +### OpenSearch Index Management +* Support for system index interface. ([#789](https://github.com/opensearch-project/index-management/pull/789)) + + + +### OpenSearch Index Management Dashboards +* Implemented alias action UX. ([#754](https://github.com/opensearch-project/index-management-dashboards-plugin/pull/754)) + + + +### OpenSearch K-NN +* Added support for Efficient Pre-filtering for Faiss Engine ([#936](https://github.com/opensearch-project/k-NN/pull/936)) +* Add Support for Lucene Byte Sized Vector ([#971](https://github.com/opensearch-project/k-NN/pull/971)) + + +### OpenSearch ML Commons + +* Remote inference: add connector; fine tune ML model and tensor class ([#1051](https://github.com/opensearch-project/ml-commons/pull/1051)) +* Remote inference: add connector executor ([#1052](https://github.com/opensearch-project/ml-commons/pull/1052)) +* Connector transport actions, requests and responses ([#1053](https://github.com/opensearch-project/ml-commons/pull/1053)) +* Refactor predictable: add method to check if model is ready ([#1057](https://github.com/opensearch-project/ml-commons/pull/1057)) +* Add basic connector access control classes ([#1055](https://github.com/opensearch-project/ml-commons/pull/1055)) +* Connector transport actions and disable native memory CB ([#1056](https://github.com/opensearch-project/ml-commons/pull/1056)) +* Restful connector actions and UT ([#1065](https://github.com/opensearch-project/ml-commons/pull/1065)) +* Change connector access control creation allow empty list ([#1069](https://github.com/opensearch-project/ml-commons/pull/1069)) + + + +### OpenSearch ML Commons Dashboards + +* Exclude remote models in admin UI overview page. ([#225](https://github.com/opensearch-project/ml-commons-dashboards/pull/225)) +* Remove experiment banner and enable plugin by default. ([#229](https://github.com/opensearch-project/ml-commons-dashboards/pull/229)) + + + +### OpenSearch Security Analytics +* New Log Type JSON format. ([#465](https://github.com/opensearch-project/security-analytics/pull/465)) +* Correlation rule search, delete and edit API. ([#476](https://github.com/opensearch-project/security-analytics/pull/476)) +* Logtypes PR v2. ([#482](https://github.com/opensearch-project/security-analytics/pull/482)) + + + +### OpenSearch Security Analytics Dashboards +* Rules UI/UX improvements. ([#592](https://github.com/opensearch-project/security-analytics-dashboards-plugin/pull/592)) +* Added support for editing correlation rule. ([#643](https://github.com/opensearch-project/security-analytics-dashboards-plugin/pull/643)) + +### OpenSearch Sql + +* Enable Table Function and PromQL function ([#1719](https://github.com/opensearch-project/sql/pull/1719)) +* Add Spark connector ([#1780](https://github.com/opensearch-project/sql/pull/1780)) + +## ENHANCEMENTS + + +### OpenSearch Anomaly Detection + +* Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards ([#948](https://github.com/opensearch-project/anomaly-detection/pull/948)) + + + +### OpenSearch Anomaly Detection Dashboards +* Remove invalid link ([#470](https://github.com/opensearch-project/anomaly-detection-dashboards-plugin/pull/470)) +* Remove global OUI style override ([#511](https://github.com/opensearch-project/anomaly-detection-dashboards-plugin/pull/511)) +* Fixing unit tests plus ran prettier ([#546](https://github.com/opensearch-project/anomaly-detection-dashboards-plugin/pull/546)) + + + +### OpenSearch ML Commons + +* Create model group automatically with first model version ([#1063](https://github.com/opensearch-project/ml-commons/pull/1063)) +* Init master key automatically ([#1075](https://github.com/opensearch-project/ml-commons/pull/1075))) + + +### OpenSearch ML Commons Dashboards + +* Open external link in new blank page. (#211) + +### OpenSearch Performance Analyzer +* Remove heap allocation rate as the input metric to HotShardClusterRca [#411](https://github.com/opensearch-project/performance-analyzer-rca/pull/411) +* Set ThreadMetricsRca evaluation period from 12 seconds to 5 seconds [#410](https://github.com/opensearch-project/performance-analyzer-rca/pull/410) +* Add unit tests for the REST layer in RCA Agent [#436](https://github.com/opensearch-project/performance-analyzer-rca/pull/436) + + + +### OpenSearch Security + +* Use boucycastle PEM reader instead of reg expression ([#2877](https://github.com/opensearch-project/security/pull/2877)) +* Adding field level security test cases for FlatFields ([#2876](https://github.com/opensearch-project/security/pull/2876)) ([#2893](https://github.com/opensearch-project/security/pull/2893)) +* Add password message to /dashboardsinfo endpoint ([#2949](https://github.com/opensearch-project/security/pull/2949)) ([#2955](https://github.com/opensearch-project/security/pull/2955)) +* Add .plugins-ml-connector to system index ([#2947](https://github.com/opensearch-project/security/pull/2947)) ([#2954](https://github.com/opensearch-project/security/pull/2954)) +* Parallel test jobs for CI ([#2861](https://github.com/opensearch-project/security/pull/2861)) ([#2936](https://github.com/opensearch-project/security/pull/2936)) +* Adds a check to skip serialization-deserialization if request is for same node ([#2765](https://github.com/opensearch-project/security/pull/2765)) ([#2973](https://github.com/opensearch-project/security/pull/2973)) +* Add workflow cluster permissions to alerting roles and add .plugins-ml-config in the system index ([#2996](https://github.com/opensearch-project/security/pull/2996)) + + + +### OpenSearch Security Dashboards + +* Add RESTAPI permissions and ISM control center permissions to dropdown ([#1473](https://github.com/opensearch-project/security-dashboards-plugin/pull/1473)) +* Move security plugin from Plugin to Management section on left navigation menu ([#1495](https://github.com/opensearch-project/security-dashboards-plugin/pull/1495)) +* Filter high level groups and action groups by cluster and index ([#1508](https://github.com/opensearch-project/security-dashboards-plugin/pull/1508)) +* Use password message from /dashboardsinfo ([#1509](https://github.com/opensearch-project/security-dashboards-plugin/pull/1509)) + + + +### OpenSearch Sql + +* Pagination: Support WHERE clause, column list in SELECT clause and for functions and expressions in the query ([#1500](https://github.com/opensearch-project/sql/pull/1500)) +* Pagination: Support ORDER BY clauses and queries without FROM clause ([#1599](https://github.com/opensearch-project/sql/pull/1599)) +* Remove backticks on by field in stats ([#1728](https://github.com/opensearch-project/sql/pull/1728)) +* Support Array and ExprValue Parsing With Inner Hits ([#1737](https://github.com/opensearch-project/sql/pull/1737)) +* Add Support for Nested Function in Order By Clause ([#1789](https://github.com/opensearch-project/sql/pull/1789)) +* Add Support for Field Star in Nested Function ([#1773](https://github.com/opensearch-project/sql/pull/1773)) +* Guarantee datasource read api is strong consistent read (compatibility with segment replication) ([#1815](https://github.com/opensearch-project/sql/pull/1815)) +* Added new datetime functions and aliases to PPL ([#1807](https://github.com/opensearch-project/sql/pull/1807)) +* Support user-defined and incomplete date formats ([#1821](https://github.com/opensearch-project/sql/pull/1821)) +* Add _routing to SQL includes list ([#1771](https://github.com/opensearch-project/sql/pull/1771)) +* Disable read of plugins.query.datasources.encryption.masterkey from cluster settings GET API ([#1825](https://github.com/opensearch-project/sql/pull/1825)) +* Add EMR client to spark connector ([#1790](https://github.com/opensearch-project/sql/pull/1790)) +* Improved error codes in case of data source API security exception ([#1753](https://github.com/opensearch-project/sql/pull/1753)) +* Remove Default master encryption key from settings ([#1851](https://github.com/opensearch-project/sql/pull/1851)) + + +## BUG FIXES + + +### Alerting +* Fix schema version in tests and delegate monitor metadata construction in tests. ([#948](https://github.com/opensearch-project/alerting/pull/948)) +* Fixed search monitor API to return alert counts. ([#978](https://github.com/opensearch-project/alerting/pull/978)) +* Resolve string issues from core. ([#987](https://github.com/opensearch-project/alerting/pull/987)) +* Fix getAlerts RBAC problem. ([#991](https://github.com/opensearch-project/alerting/pull/991)) +* Fix alert constructor with noop trigger to use execution id and workflow id. ([#994](https://github.com/opensearch-project/alerting/pull/994)) + + + +### OpenSearch Alerting Dashboards +* Fixed a bug impacting data filter configuration through the visual editor. ([#574](https://github.com/opensearch-project/alerting-dashboards-plugin/pull/574)) +* Fixed a unit test. ([#576](https://github.com/opensearch-project/alerting-dashboards-plugin/pull/576)) +* Temporary fix for blank monitor name on Monitors page issue. ([#593](https://github.com/opensearch-project/alerting-dashboards-plugin/pull/593)) + + + +### OpenSearch Common Utils +* OpenSearch commons strings library dependency import. ([#474](https://github.com/opensearch-project/common-utils/pull/474)) + +### OpenSearch Job Scheduler +* Update job details mapping ([#391](https://github.com/opensearch-project/job-scheduler/pull/391)) +* Force DOCUMENT replication on lock index ([#417](https://github.com/opensearch-project/job-scheduler/pull/417)) +* Fix bug time out of range ([#409](https://github.com/opensearch-project/job-scheduler/pull/409)) +* Update packages according to a change in OpenSearch core ([#422](https://github.com/opensearch-project/job-scheduler/pull/422)) + + +### OpenSearch Cross Cluster Replication +* Handle bug in Shard replication task assignment ([#881](https://github.com/opensearch-project/cross-cluster-replication/pull/881)) +* Update Leader checkpoint when shard replication task is reinitialized ([#904](https://github.com/opensearch-project/cross-cluster-replication/pull/904)) +* Correctly handle retention lease renewal (if the lease already exists) during bootstrap ([#904](https://github.com/opensearch-project/cross-cluster-replication/pull/904)) +* Clear persistent tasks from cluster state after STOP API is triggered ([#905](https://github.com/opensearch-project/cross-cluster-replication/pull/905)) +* Handle OpenSearchRejectExecuteException Exception during replay ([#1004](https://github.com/opensearch-project/cross-cluster-replication/pull/1004)) +* Fix Resume replication flow in dedicated master node configuration ([#1030](https://github.com/opensearch-project/cross-cluster-replication/pull/1030)) + +### OpenSearch Dashboards Notifications +* Add missing LICENSE file on 2.x branch ([#68](https://github.com/opensearch-project/dashboards-notifications/pull/68))) + + + +### OpenSearch Dashboards Observability +- Fix Log patterns UI regressions ([#530](https://github.com/opensearch-project/dashboards-observability/issues/530)) +- [BugFix] Application Analytics - Panels not displaying availability ([#607](https://github.com/opensearch-project/dashboards-observability/pull/607)) +- Upgrade tough-cookie and semver ([#627](https://github.com/opensearch-project/dashboards-observability/pull/627)) + + + +### OpenSearch Dashboards Query Workbench +* Upgrade tough-cookie and semver ([#91](https://github.com/opensearch-project/dashboards-query-workbench/pull/91)) + + + +### OpenSearch Dashboards Reporting +* Upgrade tough-cookie and semver ([#135](https://github.com/opensearch-project/dashboards-reporting/pull/135)) + + +### OpenSearch Dashboards Visualizations +* Bump semver from 5.7.1 to 5.7.2 ([#199](https://github.com/opensearch-project/dashboards-visualizations/pull/199)) +* Upgrade tough-cookie to fix CVE-2023-26136 ([#198](https://github.com/opensearch-project/dashboards-visualizations/pull/198)) + + + +### OpenSearch Index Management +* Bugfix/202 transform date add date conversion. ([#622](https://github.com/opensearch-project/index-management/pull/622)) +* Fix build errors after refactoring of Strings class in core. ([#786](https://github.com/opensearch-project/index-management/pull/786)) +* Fix LRON concurrent indexing throw ResourceAlreadyExists. ([#831](https://github.com/opensearch-project/index-management/pull/831)) +* ImmutableOpenMap to j.u.Map. ([#838](https://github.com/opensearch-project/index-management/pull/838)) +* Remove runtime notification settings. ([#839](https://github.com/opensearch-project/index-management/pull/839)) + + + +### OpenSearch Index Management Dashboards +* Fix: add validation on data.method when using transport.request. ([#801](https://github.com/opensearch-project/index-management-dashboards-plugin/pull/801)) + + + +### OpenSearch ML Commons + +* Add missing codes from pen test fix ([#1060](https://github.com/opensearch-project/ml-commons/pull/1060)) +* Fix cannot specify model access control parameters error ([#1068](https://github.com/opensearch-project/ml-commons/pull/1068)) +* Fix memory circuit breaker ([#1072](https://github.com/opensearch-project/ml-commons/pull/1072)) +* PenTest fixes: error codes and update model group fix ([#1074](https://github.com/opensearch-project/ml-commons/pull/1074)) +* Fix rare private ip address bypass SSRF issue ([#1070](https://github.com/opensearch-project/ml-commons/pull/1070)) +* Leftover in the 404 Not Found return error ([#1079](https://github.com/opensearch-project/ml-commons/pull/1079)) +* Modify error message when model group not unique is provided ([#1078](https://github.com/opensearch-project/ml-commons/pull/1078)) +* Stash context before accessing ml config index ([#1092](https://github.com/opensearch-project/ml-commons/pull/1092)) +* Fix init master key bug ([#1094](https://github.com/opensearch-project/ml-commons/pull/1094)) +* Delete connector successfully if model index is missing ([#1106](https://github.com/opensearch-project/ml-commons/pull/1106)) +* Fix encoding US-ASCII error ([#1126](https://github.com/opensearch-project/ml-commons/pull/1126)) + + + +### OpenSearch ML Commons Dashboards + +* Remove refresh interval background in dark mode. ([#209](https://github.com/opensearch-project/ml-commons-dashboards/pull/209)) +* Update to correct machine learning document address for experiment banner and empty screen. ([#210](https://github.com/opensearch-project/ml-commons-dashboards/pull/210)) + +### OpenSearch Neural Search +* Fix update document with knnn_vector size not matching issue ([#208](https://github.com/opensearch-project/neural-search/pull/208)) + + +### OpenSearch Performance Analyzer +* Fix NPE issue in ShardStateCollector, which was impacted by changes from upstream core [#489](https://github.com/opensearch-project/performance-analyzer/pull/489) +* Fix Mockito initialization issue [#443](https://github.com/opensearch-project/performance-analyzer-rca/pull/443) + + + +### OpenSearch Reporting +* Removing guava dependency to fix jarhell ([#709](https://github.com/opensearch-project/reporting/pull/709)) + + + +### OpenSearch Security Analytics +* Fixed compile issues related to latest OS core repo changes. ([#412](https://github.com/opensearch-project/security-analytics/pull/412)) + + + +### OpenSearch Security Dashboards + +* Switch to new tenant after loading a copied long URL ([#1450](https://github.com/opensearch-project/security-dashboards-plugin/pull/1450)) ([#1477](https://github.com/opensearch-project/security-dashboards-plugin/pull/1477)) +* Fix a bad import path ([#1498](https://github.com/opensearch-project/security-dashboards-plugin/pull/1498)) ([#1499](https://github.com/opensearch-project/security-dashboards-plugin/pull/1499)) + + + +### OpenSearch Sql + +* Fixed bug of byte/short not handling 0 denominator in divide/modulus equations ([#1716](https://github.com/opensearch-project/sql/pull/1716)) +* Fix CSV/RAW output header being application/json rather than plain/text ([#1779](https://github.com/opensearch-project/sql/pull/1779)) + + +## INFRASTRUCTURE + + +### OpenSearch Anomaly Detection + +* Updated Maintainers and CODE_OWNERS list ([#926](https://github.com/opensearch-project/anomaly-detection/pull/926)) +* Bump guava version to 32.0.1 ([#933](https://github.com/opensearch-project/anomaly-detection/pull/933)) +* Bump scipy from 1.8.0 to 1.10.0 in /dataGeneration ([#943](https://github.com/opensearch-project/anomaly-detection/pull/943)) +* Fix main build - update import of Releasable and remove reference to BaseExceptionsHelper ([#930](https://github.com/opensearch-project/anomaly-detection/pull/930)) + + + +### OpenSearch Anomaly Detection Dashboards + +* Merge featureAnywhere branch into main ([#539](https://github.com/opensearch-project/anomaly-detection-dashboards-plugin/pull/539)) + + +### OpenSearch Dashboards Search Relevance +* [CI/CD] Rolling back to anomaly-detection for OS dependency in workflow ([#230](https://github.com/opensearch-project/dashboards-search-relevance/pull/230))([#236](https://github.com/opensearch-project/dashboards-search-relevance/pull/236)) + + +### OpenSearch ML Commons + +* Adding an integration test for redeploying a model ([#1016](https://github.com/opensearch-project/ml-commons/pull/1016)) +* Add unit test for connector class in commons ([#1058](https://github.com/opensearch-project/ml-commons/pull/1058)) +* Remote inference: add unit test for model and register model input ([#1059](https://github.com/opensearch-project/ml-commons/pull/1059)) +* Remote inference: add unit test for StringUtils and remote inference input ([#1061](https://github.com/opensearch-project/ml-commons/pull/1061)) +* More UT for rest and trasport actions ([#1066](https://github.com/opensearch-project/ml-commons/pull/1066)) +* Remote inference: add unit test for create connector request/response ([#1067](https://github.com/opensearch-project/ml-commons/pull/1067)) +* Add more UT for remote inference classes ([#1077](https://github.com/opensearch-project/ml-commons/pull/1077)) +* IT Security Tests for model access control ([#1095](https://github.com/opensearch-project/ml-commons/pull/1095)) +* Add integration tests for the remote inference feature ([#1073](https://github.com/opensearch-project/ml-commons/pull/1073)) +* Temporarily ignore OpenAI Tests ([#1118](https://github.com/opensearch-project/ml-commons/pull/1118)) +* Increase sleep time on remote inference integration tests ([#1124](https://github.com/opensearch-project/ml-commons/pull/1124)) +* Fix remote inference it: update job interval ([#1129](https://github.com/opensearch-project/ml-commons/pull/1129)) +* Add null key check for remote inference integration tests ([#1113](https://github.com/opensearch-project/ml-commons/pull/1113)) +* Reenable OpenAI Remote Inference Tests ([#1127](https://github.com/opensearch-project/ml-commons/pull/1127)) + + + +### OpenSearch Notifications +* Run publish maven snapshots on all branches matching pattern ([#698](https://github.com/opensearch-project/notifications/pull/698)) +* Strings compile fix due to core package change([#680](https://github.com/opensearch-project/notifications/pull/680)) + + + +### OpenSearch Performance Analyzer +* Update the BWC version to 2.8.0 [#446](https://github.com/opensearch-project/performance-analyzer/pull/446) +* Upgrade bcprov to bcprov-jdk15to18 in performance-analyzer [#493](https://github.com/opensearch-project/performance-analyzer/pull/493) +* Upgrade bcprov to bcprov-jdk15to18 in performance-analyzer-rca [439](https://github.com/opensearch-project/performance-analyzer-rca/pull/439) +* Upgrade bcpkix to bcpkix-jdk15to18 in performance-analyzer-rca [446](https://github.com/opensearch-project/performance-analyzer-rca/pull/446) +* Upgrade checkstyle version from 9.3 to 10.3.3 [#495](https://github.com/opensearch-project/performance-analyzer/pull/495) + + + +### OpenSearch Sql + +* StopPrometheus task in doctest build.gradle now runs upon project failure in startOpenSearch ([#1747](https://github.com/opensearch-project/sql/pull/1747)) +* Bump guava to 32.0.1 ([#1829](https://github.com/opensearch-project/sql/pull/1829)) +* Disable CrossClusterSearchIT test ([#1814](https://github.com/opensearch-project/sql/pull/1814)) +* Fix flakytest when tests.locale=tr ([#1827](https://github.com/opensearch-project/sql/pull/1827)) + + +## DOCUMENTENTATION + + +### OpenSearch Alerting +* Added 2.9 release notes. ([#1010](https://github.com/opensearch-project/alerting/pull/1010)) + +### OpenSearch Alerting Dashboards +* Added 2.9.0 release notes. ([#621](https://github.com/opensearch-project/alerting-dashboards-plugin/pull/621)) + +### OpenSearch Anomaly Detection + +* Updated Maintainers and CODE_OWNERS list ([#926](https://github.com/opensearch-project/anomaly-detection/pull/926)) + + +### OpenSearch Common Utils +* Added 2.9 release notes. ([#482](https://github.com/opensearch-project/common-utils/pull/482)) + +### OpenSearch Dashboards Notifications +* Drafted 2.9 release notes. ([#71](https://github.com/opensearch-project/dashboards-notifications/pull/71)) + +### OpenSearch Dashboards Observability +- Integraions Plugin Design RFC ([#644](https://github.com/opensearch-project/dashboards-observability/issues/644)) + + +### OpenSearch Index Management +* Added 2.9 release notes. ([#851](https://github.com/opensearch-project/index-management/pull/851)) + +### OpenSearch Index Management Dashboards +* Added 2.9 release notes. ([#808](https://github.com/opensearch-project/index-management-dashboards-plugin/pull/808)) + +### OpenSearch ML Commons + +* Model access control documentation ([#966](https://github.com/opensearch-project/ml-commons/pull/966)) +* Updating docs for model group id ([#980](https://github.com/opensearch-project/ml-commons/pull/980)) + + + +### OpenSearch Notifications +* Add 2.9.0 release notes ([#702](https://github.com/opensearch-project/notifications/pull/702)) + + +### OpenSearch Security Analytics +* Added 2.9.0 release notes. ([#486](https://github.com/opensearch-project/security-analytics/pull/486)) + +### OpenSearch Security Analytics Dashboards +* Added 2.9 release notes. ([#650](https://github.com/opensearch-project/security-analytics-dashboards-plugin/pull/650)) + +### OpenSearch Sql + +* Updated documentation of round function return type ([#1725](https://github.com/opensearch-project/sql/pull/1725)) +* Updated `protocol.rst` with new wording for error message ([#1662](https://github.com/opensearch-project/sql/pull/1662)) +* Updated documentation for temporal data types ([#1826](https://github.com/opensearch-project/sql/pull/1826)) + +### OpenSearch Documentation Website +* Added 2.9.0 [release notes](https://github.com/opensearch-project/documentation-website/blob/main/release-notes/opensearch-documentation-release-notes-2.9.0.md). + +## MAINTENANCE + + +### OpenSearch Alerting +* Increment version to 2.9.0-SNAPSHOT. ([#950](https://github.com/opensearch-project/alerting/pull/950)) + + + +### OpenSearch Alerting Dashboards +* Increment version to 2.9.0.0. ([#580](https://github.com/opensearch-project/alerting-dashboards-plugin/pull/580)) + + + +### OpenSearch Asynchronous Search +* Increment version to 2.9.0 ([300](https://github.com/opensearch-project/asynchronous-search/pull/300)) + + +### OpenSearch Common Utils +* Increment version to 2.9.0-SNAPSHOT. ([#444](https://github.com/opensearch-project/common-utils/pull/444)) +* Modify triggers to push snapshots on all branches. ([#454](https://github.com/opensearch-project/common-utils/pull/454)) + +### OpenSearch Job Scheduler +* Upgrade gradle version to 8.1.1 ([#402](https://github.com/opensearch-project/job-scheduler/pull/402)) +* Upgrade guava from 31.0.1-jre to latest 32.0.1-jre ([#411](https://github.com/opensearch-project/job-scheduler/pull/411)) + + + +### OpenSearch Dashboards Maps +Increment version to 2.9.0.0 ([#426](https://github.com/opensearch-project/dashboards-maps/pull/426)) +Bump semver from 7.3.8 to 7.5.3 ([#431](https://github.com/opensearch-project/dashboards-maps/pull/431)) +Bump tough cookie to ^4.1.3 ([#439](https://github.com/opensearch-project/dashboards-maps/pull/439)) + + +### OpenSearch Dashboards Notifications +* [AUTO] Increment version to 2.9.0.0 ([#61](https://github.com/opensearch-project/dashboards-notifications/pull/61)) + + + +### OpenSearch Dashboards Query Workbench +* Increment version to 2.9.0.0 ([#85](https://github.com/opensearch-project/dashboards-query-workbench/pull/85)) + +### OpenSearch Dashboards Reporting +* Increment version to 2.9.0.0 ([#129](https://github.com/opensearch-project/dashboards-reporting/pull/129)) + + + +### OpenSearch Dashboards Visualizations +* Increment version to 2.9.0.0 ([#192](https://github.com/opensearch-project/dashboards-visualizations/pull/192)) + + +### OpenSearch Geospatial +Increment version to 2.9.0-SNAPSHOT ([#329](https://github.com/opensearch-project/geospatial/pull/329)) + + + +### OpenSearch Index Management +* Increment version to 2.9.0-SNAPSHOT. ([#805](https://github.com/opensearch-project/index-management/pull/805)) +* Added to CODEOWNERS and MAINTAINERS files. ([#810](https://github.com/opensearch-project/index-management/pull/810)) +* Upgrade httpcomponent version after OpenSearch core's upgrade. ([#847](https://github.com/opensearch-project/index-management/pull/847)) + + + +### OpenSearch Index Management Dashboards +* Increment version to 2.9.0.0. ([#795](https://github.com/opensearch-project/index-management-dashboards-plugin/pull/795)) +* Move index management from plugin section to management section. ([#741](https://github.com/opensearch-project/index-management-dashboards-plugin/pull/741)) + + + +### OpenSearch ML Commons + +* Increment version to 2.9.0-SNAPSHOT ([#955](https://github.com/opensearch-project/ml-commons/pull/955)) +* Manual CVE backport ([#1008](https://github.com/opensearch-project/ml-commons/pull/1008)) +* Fix build. ([#1018](https://github.com/opensearch-project/ml-commons/pull/1018)) +* Fix the refactor change brought by core backport ([#1047](https://github.com/opensearch-project/ml-commons/pull/1047)) +* Change to compileOnly to avoid jarhell ([#1062](https://github.com/opensearch-project/ml-commons/pull/1062)) +* Update ml CI workflow checkout ref to be PR commit ([#1114](https://github.com/opensearch-project/ml-commons/pull/1114)) +* Add shell bash settings for windows github actions to export credentials ([#1116](https://github.com/opensearch-project/ml-commons/pull/1116)) + + + +### OpenSearch Neural Search +Increment version to 2.9.0-SNAPSHOT ([#191](https://github.com/opensearch-project/neural-search/pull/191)) + + + +### OpenSearch Notifications +* [AUTO] Increment version to 2.9.0-SNAPSHOT ([#690](https://github.com/opensearch-project/notifications/pull/690)) + + + +### OpenSearch Performance Analyzer +* Update build.gradle and github workflow to support 2.9 version [#499](https://github.com/opensearch-project/performance-analyzer/pull/499) +* Update licenses files for 2.9 [#501](https://github.com/opensearch-project/performance-analyzer/pull/501) +* Swap jboss annotation dependency for jakarta annotations [#407](https://github.com/opensearch-project/performance-analyzer-rca/pull/407) +* Ensures compatibility check readiness [#438](https://github.com/opensearch-project/performance-analyzer-rca/pull/438) + + +### OpenSearch Reporting +* Increment version to 2.9.0-SNAPSHOT ([#712](https://github.com/opensearch-project/reporting/pull/712)) + + +### OpenSearch Security + +* Match version of zstd-jni from core ([#2835](https://github.com/opensearch-project/security/pull/2835)) +* Add Andrey Pleskach (Willyborankin) to Maintainers ([#2843](https://github.com/opensearch-project/security/pull/2843)) +* Updates bwc versions to latest release ([#2849](https://github.com/opensearch-project/security/pull/2849)) +* Add search model group permission to ml_read_access role ([#2855](https://github.com/opensearch-project/security/pull/2855)) ([#2858](https://github.com/opensearch-project/security/pull/2858)) +* Format 2.x ([#2878](https://github.com/opensearch-project/security/pull/2878)) +* Update snappy to 1.1.10.1 and guava to 32.0.1-jre ([#2886](https://github.com/opensearch-project/security/pull/2886)) ([#2889](https://github.com/opensearch-project/security/pull/2889)) +* Resolve ImmutableOpenMap issue from core refactor ([#2908](https://github.com/opensearch-project/security/pull/2908)) +* Misc changes ([#2902](https://github.com/opensearch-project/security/pull/2902)) ([#2904](https://github.com/opensearch-project/security/pull/2904)) +* Bump BouncyCastle from jdk15on to jdk15to18 ([#2901](https://github.com/opensearch-project/security/pull/2901)) ([#2917](https://github.com/opensearch-project/security/pull/2917)) +* Fix the import org.opensearch.core.common.Strings; and import org.opensearch.core.common.logging.LoggerMessageFormat; ([#2953](https://github.com/opensearch-project/security/pull/2953)) +* Remove commons-collections 3.2.2 ([#2924](https://github.com/opensearch-project/security/pull/2924)) ([#2957](https://github.com/opensearch-project/security/pull/2957)) +* Resolve CVE-2023-2976 by forcing use of Guava 32.0.1 ([#2937](https://github.com/opensearch-project/security/pull/2937)) ([#2974](https://github.com/opensearch-project/security/pull/2974)) +* Bump jaxb to 2.3.8 ([#2977](https://github.com/opensearch-project/security/pull/2977)) ([#2979](https://github.com/opensearch-project/security/pull/2979)) +* Update Gradle to 8.2.1 ([#2978](https://github.com/opensearch-project/security/pull/2978)) ([#2981](https://github.com/opensearch-project/security/pull/2981)) +* Changed maven repo location for compatibility check ([#2988](https://github.com/opensearch-project/security/pull/2988)) +* Bump guava to 32.1.1-jre ([#2976](https://github.com/opensearch-project/security/pull/2976)) ([#2990](https://github.com/opensearch-project/security/pull/2990)) + + +### OpenSearch Security Analytics +* Increment version to 2.9.0-SNAPSHOT. ([#466](https://github.com/opensearch-project/security-analytics/pull/466)) +* Gradle update. ([#437](https://github.com/opensearch-project/security-analytics/pull/437)) + + + +### OpenSearch Security Analytics Dashboards +* Increment version to 2.9.0.0. ([#636](https://github.com/opensearch-project/security-analytics-dashboards-plugin/pull/636)) +* Removed experimental banner. ([#647](https://github.com/opensearch-project/security-analytics-dashboards-plugin/pull/647)) + + + +### OpenSearch Security Dashboards + +* Use version from package.json for integration tests ([#1465](https://github.com/opensearch-project/security-dashboards-plugin/pull/1465)) +* Update permissions according to backend ([#1480](https://github.com/opensearch-project/security-dashboards-plugin/pull/1480)) ([#1484](https://github.com/opensearch-project/security-dashboards-plugin/pull/1484)) + +## REFACTORING + + +### OpenSearch Alerting +* Use strong password in security test. ([#933](https://github.com/opensearch-project/alerting/pull/933)) + + + +### OpenSearch Common Utils +* Pass workflow id in alert constructors. ([#465](https://github.com/opensearch-project/common-utils/pull/465)) + + + +### OpenSearch Geospatial +* Change package for Strings.hasText ([#314](https://github.com/opensearch-project/geospatial/pull/314)) + + +### OpenSearch Observability +* Add class for loading mapping templates in bulk ([#1550](https://github.com/opensearch-project/observability/pull/1550)) + + +### OpenSearch Security Analytics +* Use strong password in security test. ([#452](https://github.com/opensearch-project/security-analytics/pull/452)) + + + +### OpenSearch Security Analytics Dashboards +* UX updates for correlations. ([#619](https://github.com/opensearch-project/security-analytics-dashboards-plugin/pull/619)) +* Change the order of the sections. ([#622](https://github.com/opensearch-project/security-analytics-dashboards-plugin/pull/622)) + + + +### OpenSearch Sql + +* Simplify OpenSearchIndexScanBuilder ([#1738](https://github.com/opensearch-project/sql/pull/1738))