Adds Multiple Datasources Support for Security Dashboards Plugin

[derek-ho]

Description

This PR merges the feature branch feature/supporting-multiple-datasources to main. It adds support for multiple datasources within the security dashboards plugin. This means that for each page (minus tenancy and service accounts which are both locked to the local cluster), users can choose between different clusters that they added as a datasource and perform CRUD operations on that cluster's security backend plugin. If multi datasources is not enabled, then the security dashboards plugin will behave in the same way as before.

Category

New feature

Why these changes are required?

To support multiple datasources in the security dashboards plugin.

What is the old behavior before changes and new behavior after changes?

Old behavior: no support for multiple datasources (all CRUD operations done on local cluster)
New behavior: support for multiple datasources (users can choose which cluster to do CRUD operations on)

Video of security plugin with these changes, with/without multi datasources feature enabled:

Screen.Recording.2024-04-22.at.5.03.07.PM.mov

Issues Resolved

Close: #1794

Testing

Adds unit tests where appropriate, adds cypress tests (currently flaky), adds integration tests against a matrix of prior versions of OpenSearch to ensure compatibility with linux and windows.

Check List

• New functionality includes testing
• New functionality has been documented
• Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[codecov]

Codecov Report

Attention: Patch coverage is 51.07296% with 114 lines in your changes are missing coverage. Please review.

Project coverage is 69.60%. Comparing base (a35d7c1) to head (ec0d269).

Files	Patch %	Lines
public/apps/configuration/app-router.tsx	12.76%	41 Missing ⚠️
public/apps/configuration/utils/request-utils.ts	45.45%	16 Missing and 2 partials ⚠️
...ublic/apps/configuration/utils/role-list-utils.tsx	0.00%	7 Missing ⚠️
...c/apps/configuration/utils/action-groups-utils.tsx	0.00%	5 Missing ⚠️
public/apps/configuration/utils/tenant-utils.tsx	44.44%	5 Missing ⚠️
public/apps/account/utils.tsx	0.00%	4 Missing ⚠️
public/apps/configuration/top-nav-menu.tsx	71.42%	2 Missing and 2 partials ⚠️
...c/apps/configuration/utils/audit-logging-utils.tsx	0.00%	4 Missing ⚠️
...lic/apps/configuration/utils/role-detail-utils.tsx	0.00%	4 Missing ⚠️
...configuration/utils/internal-user-detail-utils.tsx	0.00%	3 Missing ⚠️
... and 14 more

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1888      +/-   ##
==========================================
+ Coverage   68.37%   69.60%   +1.23%     
==========================================
  Files          94       96       +2     
  Lines        2416     2481      +65     
  Branches      330      332       +2     
==========================================
+ Hits         1652     1727      +75     
+ Misses        687      673      -14     
- Partials       77       81       +4     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[cwperks]

@derek-ho Can you please fill out the description of this PR?

What is remaining before it is flipped from Draft?

[derek-ho]

@derek-ho Can you please fill out the description of this PR?

What is remaining before it is flipped from Draft?

@cwperks working on cypress test stability - see draft PR: #1894. Cypress tests consistently working on @DarshitChanpura and I's local, but failing on github runner due to space issues, we are seeing if we can find the root case.

[cwperks]

Left some initial comments.

Would it be possible to capture a recording of the cypress tests that are run that test the MDS functionality?

[cwperks]

Took a second pass. This looks very close. Thanks for fixing the issues with the tests!

[derek-ho]

Cypress test failures resolved by: opensearch-project/opensearch-dashboards-functional-test#1239

[cwperks]

@derek-ho Is this blocked until opensearch-project/opensearch-dashboards-functional-test#1239 is merged?

[derek-ho]

@derek-ho Is this blocked until opensearch-project/opensearch-dashboards-functional-test#1239 is merged?

It was merged, and I also updated some of the datasource specific tests to incorporate upstream core changes, CI is green now, and ready for re-review 👍

[opensearch-trigger-bot]

The backport to 2.x failed:

The process '/usr/bin/git' failed with exit code 1

To backport manually, run these commands in your terminal:

# Fetch latest updates from GitHub
git fetch
# Create a new working tree
git worktree add .worktrees/backport-2.x 2.x
# Navigate to the new working tree
cd .worktrees/backport-2.x
# Create a new branch
git switch --create backport/backport-1888-to-2.x
# Cherry-pick the merged commit of this pull request and resolve the conflicts
git cherry-pick -x --mainline 1 154a3ba08828b36a8dae684651f25c8d72f584be
# Push it to GitHub
git push --set-upstream origin backport/backport-1888-to-2.x
# Go back to the original working tree
cd ../..
# Delete the working tree
git worktree remove .worktrees/backport-2.x

Then, create a pull request where the base branch is 2.x and the compare/head branch is backport/backport-1888-to-2.x.