[RELEASE] Release version 1.3.2

[github-actions]

Release OpenSearch and OpenSearch Dashboards 1.3.2

I noticed that a manifest was automatically created in manifests/1.3.2. Please follow the following checklist to make a release.

How to use this issue

This Release Issue

This issue captures the state of the OpenSearch release, its assignee is responsible for driving the release. Please contact them or @mention them on this issue for help. There are linked issues on components of the release where individual components can be tracked. More details are included in the Maintainers Release owner section.

Release Steps

There are several steps to the release process, these steps are completed as the whole release and components that are behind present risk to the release. The release owner completes the tasks in this ticket, whereas component owners resolve tasks on their ticket in their repositories.

Steps have completion dates for coordinating efforts between the components of a release; components can start as soon as they are ready far in advance of a future release.

Component List

To aid in understanding the state of the release there is a table with status indicating each component state. This is updated based on the status of the component issues.

Preparation

• Assign this issue to a release owner.
• Declare a pencils down date for new features to be merged.
• April 29 2022 is pencils down date for feature freeze.
• Update the Campaigns section to include monitoring campaigns during this release.
• Update this issue so all __REPLACE_RELEASE-__ placeholders have actual dates.
• Document any new quality requirements or changes.
• Finalize scope and feature set and update the Public Roadmap.
• Create a release issue in every component repo that links back to this issue, update Components section with these links. (We don't create component issues for lightweight patch release)
• Ensure the label is created in each component repo for this new version, and the next minor release. Create a version label
• Ensure that all release issues created above are assigned to an owner in the component team.

CI/CD (Feature Freeze) - April 29 2022

• Create Jenkins workflows that run daily snapshot builds for OpenSearch and OpenSearch Dashboards.
• Increment each component version to 1.3.2 and ensure working CI in component repositories.
• Make pull requests to add each component to manifests/1.3.2/opensearch-1.3.2.yml and manifests/1.3.2/opensearch-dashboards-1.3.2.yml with the corresponding checks.
• OpenSearch / OpenSearch-Dashboards core and components teams finalize their features

Campaigns

REPLACE with OpenSearch wide initiatives to improve quality and consistency.

Code Complete - April 29 2022

• Code Complete: Make sure that the code for this specific version of the release is ready and the branch corresponding to this release has been added to this release version manifest.
• Verify pull requests to add each component to manifests/1.3.2/opensearch-1.3.2.yml and manifests/1.3.2/opensearch-dashboards-1.3.2.yml have been merged.
• Gather, review and combine the release notes from components repositories.
  • Add the consolidated release notes for 1.3.2 release #2088

Release testing - May 03 - May 04 2022

• Declare a release candidate build, and provide the instructions with the release candidates for teams on testing.
• Sanity Testing: Sanity testing and fixing of critical issues found by teams. Teams test their components within the distribution, ensuring integration, backwards compatibility, and perf tests pass.
• Publish all test results in the comments of this issue.

Release - May 05 2022

• Verify all issues labeled v1.3.2 in all projects have been resolved.
• Complete documentation for this release.
• Author blog post for this release.

• 1.3.2 Release - website changes project-website#796

• Publish this release on opensearch.org.
• Publish a blog post - release is launched!

Post Release

• Create release tags for each component.
• Replace refs in manifests/1.3.2 with tags and remove checks.
  • Add tags to 1.3.2 manifests after cutting tags #2089
• Helm / Ansible
  • Update charts to use 1.3.2 Version of OS/OSD helm-charts#258
  • Update 1.3.2 version for the ansible playbook ansible-playbook#57
• Generate distribution release notes reviewed by PM team for opensearch-build repository.
• Prepare for next patch release by incrementing patch versions for each component.
  • Bump version to 1.3.3 OpenSearch#3206
  • Bump version to 1.3.3 OpenSearch-Dashboards#1551
• Lower the frequency of builds for this version of OpenSearch and/or OpenSearch Dashboards.
• Update this template with any new or missed steps.
• Create an issue for a retrospective, solicit feedback, and publish a summary.
  • [Retrospective] Release version 1.3.2 #2093

Components

Replace with links to all component tracking issues.

Component	On track	Notes
{COMPONENT_ISSUE_LINK}	{INDICATOR}}	{STATUS}

Legend

Symbol	Meaning
🟢	On track with overall release
🟡	Missed last milestone
🔴	Missed multiple milestones

[peternied]

@zelinh There are many prepration items that are not complete, is this release still on target? What about the related component issues, are we all are ready for code freeze tomorrow?

[zelinh]

@peternied As I stated above in the preparation part, we don't create component release issue for patch release. We are still targeting the release for next Thursday since we assume there would be lightweight changes (e.g. CVE fix) for patch release.

[peternied]

@zelinh There are checklist items that are not checked off such as Update the Campaigns section to include monitoring campaigns during this release. it sounds like this is done so it should be checked off. It sounds like a major of this are done, but not recorded. Could we make sure this issue is up-to-date?

we don't create component release issue for patch release.

There are links on this issue like opensearch-project/security-dashboards-plugin#937 should these all be closed?

[zelinh]

Integ-test for OpenSearch arm64

2022-05-03 19:06:54 INFO     | alerting             | with-security        | PASS  |    0 |
2022-05-03 19:06:54 INFO     | alerting             | without-security     | PASS  |    0 |
2022-05-03 19:06:54 INFO     | anomaly-detection    | with-security        | PASS  |    0 |
2022-05-03 19:06:54 INFO     | anomaly-detection    | without-security     | PASS  |    0 |
2022-05-03 19:06:54 INFO     | asynchronous-search  | with-security        | PASS  |    0 |
2022-05-03 19:06:54 INFO     | asynchronous-search  | without-security     | PASS  |    0 |
2022-05-03 19:06:54 INFO     | dashboards-reports   | without-security     | PASS  |    0 |
2022-05-03 19:06:54 INFO     | index-management     | with-security        | PASS  |    0 |
2022-05-03 19:06:54 INFO     | index-management     | without-security     | PASS  |    0 |
2022-05-03 19:06:54 ERROR    | k-NN                 | with-security        | FAIL  |    1 |
2022-05-03 19:06:54 ERROR    | k-NN                 | without-security     | FAIL  |    1 |
2022-05-03 19:06:54 INFO     | ml-commons           | with-security        | PASS  |    0 |
2022-05-03 19:06:54 INFO     | ml-commons           | without-security     | PASS  |    0 |
2022-05-03 19:06:54 INFO     | sql                  | with-security        | PASS  |    0 |
2022-05-03 19:06:54 INFO     | sql                  | without-security     | PASS  |    0 |

[zelinh]

integ-test for OpenSearch x64

2022-05-03 05:11:54 INFO     | alerting             | with-security        | PASS  |    0 |
2022-05-03 05:11:54 INFO     | alerting             | without-security     | PASS  |    0 |
2022-05-03 05:11:54 INFO     | anomaly-detection    | with-security        | PASS  |    0 |
2022-05-03 05:11:54 INFO     | anomaly-detection    | without-security     | PASS  |    0 |
2022-05-03 05:11:54 INFO     | asynchronous-search  | with-security        | PASS  |    0 |
2022-05-03 05:11:54 INFO     | asynchronous-search  | without-security     | PASS  |    0 |
2022-05-03 05:11:54 INFO     | dashboards-reports   | without-security     | PASS  |    0 |
2022-05-03 05:11:54 INFO     | index-management     | with-security        | PASS  |    0 |
2022-05-03 05:11:54 INFO     | index-management     | without-security     | PASS  |    0 |
2022-05-03 05:11:54 ERROR    | k-NN                 | with-security        | FAIL  |    1 |
2022-05-03 05:11:54 ERROR    | k-NN                 | without-security     | FAIL  |    1 |
2022-05-03 05:11:54 INFO     | ml-commons           | with-security        | PASS  |    0 |
2022-05-03 05:11:54 INFO     | ml-commons           | without-security     | PASS  |    0 |
2022-05-03 05:11:54 INFO     | sql                  | with-security        | PASS  |    0 |
2022-05-03 05:11:54 INFO     | sql                  | without-security     | PASS  |    0 |

[zelinh]

With this backport PR in k-NN repo
New integ tests result for arm64

2022-05-04 06:21:51 INFO     | alerting             | with-security        | PASS  |    0 |
2022-05-04 06:21:51 INFO     | alerting             | without-security     | PASS  |    0 |
2022-05-04 06:21:51 INFO     | anomaly-detection    | with-security        | PASS  |    0 |
2022-05-04 06:21:51 INFO     | anomaly-detection    | without-security     | PASS  |    0 |
2022-05-04 06:21:51 INFO     | asynchronous-search  | with-security        | PASS  |    0 |
2022-05-04 06:21:51 INFO     | asynchronous-search  | without-security     | PASS  |    0 |
2022-05-04 06:21:51 INFO     | dashboards-reports   | without-security     | PASS  |    0 |
2022-05-04 06:21:51 INFO     | index-management     | with-security        | PASS  |    0 |
2022-05-04 06:21:51 INFO     | index-management     | without-security     | PASS  |    0 |
2022-05-04 06:21:51 INFO     | k-NN                 | with-security        | PASS  |    0 |
2022-05-04 06:21:51 INFO     | k-NN                 | without-security     | PASS  |    0 |
2022-05-04 06:21:51 INFO     | ml-commons           | with-security        | PASS  |    0 |
2022-05-04 06:21:51 INFO     | ml-commons           | without-security     | PASS  |    0 |
2022-05-04 06:21:51 INFO     | sql                  | with-security        | PASS  |    0 |
2022-05-04 06:21:51 INFO     | sql                  | without-security     | PASS  |    0 |

[zelinh]

Release testing

We have new Artifacts built and ready for testing.

---

• Use Docker-Compose to setup a cluster

  • Download this gist as docker-compose.yml on your machine
  • Get latest image versions docker-compose pull
  • Start the cluster docker-compose up

• OpenSearch docker

  • Start without security
    • Docker command docker pull opensearchstaging/opensearch:1.3.2 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:1.3.2
    • Connect command curl https://localhost:9200
  • Start with security
    • Docker command docker pull opensearchstaging/opensearch:1.3.2 && docker run -it -p 9200:9200 -e "discovery.type=single-node" opensearchstaging/opensearch:1.3.2
    • Connect command curl --insecure https://admin:admin@localhost:9200

• OpenSearch-Dashboards docker

  • Start without security
    • Docker command docker pull opensearchstaging/opensearch-dashboards:1.3.2 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:1.3.2
    • URL https://localhost:5601
  • Start without security
    • Docker command docker pull opensearchstaging/opensearch-dashboards:1.3.2 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:1.3.2
    • URL https://localhost:5601

• Use TARs to deploy OpenSearch Manually (Updated 05/04/2022 10:00 PDT)

  • OpenSearch - Build 2713

    • arm64 [manifest] [tar] [rpm]
    • x64 [manifest] [tar] [rpm]

  • OpenSearch Dashboards - Build 3032

    • arm64 [manifest] [tar][rpm]
    • x64 [manifest] [tar][rpm]

[zelinh]

Native plugin verified

-> Installing repository-s3
-> Downloading repository-s3 from opensearch
[=================================================] 100%
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@     WARNING: plugin requires additional permissions     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
* java.lang.RuntimePermission accessDeclaredMembers
* java.lang.RuntimePermission getClassLoader
* java.lang.reflect.ReflectPermission suppressAccessChecks
* java.net.NetPermission setDefaultAuthenticator
* java.net.SocketPermission * connect,resolve
* java.util.PropertyPermission opensearch.allow_insecure_settings read,write
See http://docs.oracle.com/javase/8/docs/technotes/guides/security/permissions.html
for descriptions of what these permissions allow and the associated risks.

Continue with installation? [y/N]y
-> Installed repository-s3 with folder name repository-s3

[zelinh]

Maven Central released:

https://repo1.maven.org/maven2/org/opensearch/opensearch/1.3.2

[bbarani]

Closing the 1.3.2 issue as we have released the distribution. Feel free to re-open this issue if needed.