Improves connection pooling support for AWSSigV4 clients in data sources.

[bandinib-amzn]

Description

As of today, both opensearch-js client and legacy client does not allow updating credentials for existing client. As a result, every HTTP request to AWS services entails the costly process of creating new client.

This PR solves exactly that problem. We have recently released opensearch-js 2.6.0 client to npm. 2.6.0 client has inherited AwsSigV4 in .child. This PR upgrades the opensearch-js 2.6.0 and refactor data source plugin to create child client if endpoint/node is same. Also this PR imports the HttpAmazonESConnector class and it's UT in OpenSearch-Dashboards repo. This will help us to maintain HttpAmazonESConnector proactively.

This PR

• Upgrade @opensearch/[email protected] which supports AwsSigV4 in .child
• Add support to create child client for AWS sigv4 auth type, similar to basic auth
• Modify client caching mechanism
• Copy HttpAmazonESConnector
• Add child support in HttpAmazonESConnector
• Add support to create child client for AWS sigv4 auth type, similar to basic auth
• Does not allow authentication to be registered with the same name as no_auth, username_password, sigv4.

Issues Resolved

#6114, #5932, partially resolves #5838

Screenshot

Testing the changes

Check List

• All tests pass
  • yarn test:jest
  • yarn test:jest_integration
• New functionality includes testing.
• New functionality has been documented.
• Update CHANGELOG.md
• Commits are signed per the DCO using --signoff

[codecov]

Codecov Report

Attention: Patch coverage is 77.68595% with 27 lines in your changes are missing coverage. Please review.

Project coverage is 67.26%. Comparing base (8c4f49a) to head (18af6c9).

Files	Patch %	Lines
...data_source/server/legacy/http_aws_es/connector.js	64.40%	21 Missing ⚠️
...r/auth_registry/authentication_methods_registry.ts	33.33%	1 Missing and 1 partial ⚠️
...ins/data_source/server/util/credential_provider.ts	0.00%	2 Missing ⚠️
...gins/data_source/server/client/configure_client.ts	95.23%	0 Missing and 1 partial ⚠️
...ta_source/server/legacy/configure_legacy_client.ts	95.83%	0 Missing and 1 partial ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #6135      +/-   ##
==========================================
+ Coverage   67.22%   67.26%   +0.03%     
==========================================
  Files        3333     3334       +1     
  Lines       64565    64639      +74     
  Branches    10391    10399       +8     
==========================================
+ Hits        43404    43478      +74     
- Misses      18628    18632       +4     
+ Partials     2533     2529       -4     

Flag	Coverage Δ
Linux_1	31.69% <ø> (ø)
Linux_2	55.45% <ø> (ø)
Linux_3	44.76% <77.68%> (+0.10%)	⬆️
Linux_4	34.99% <ø> (ø)
Windows_1	31.74% <ø> (+0.02%)	⬆️
Windows_2	55.41% <ø> (ø)
Windows_3	44.76% <77.68%> (+0.08%)	⬆️
Windows_4	34.99% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[Flyingliuhub]

It seem like that Config and Credentials were not used directly in the code. We may remove this. it is not block, we can do it later.

[opensearch-trigger-bot]

The backport to 2.x failed:

The process '/usr/bin/git' failed with exit code 128

To backport manually, run these commands in your terminal:

# Navigate to the root of your repository
cd $(git rev-parse --show-toplevel)
# Fetch latest updates from GitHub
git fetch
# Create a new working tree
git worktree add ../.worktrees/OpenSearch-Dashboards/backport-2.x 2.x
# Navigate to the new working tree
pushd ../.worktrees/OpenSearch-Dashboards/backport-2.x
# Create a new branch
git switch --create backport/backport-6135-to-2.x
# Cherry-pick the merged commit of this pull request and resolve the conflicts
git cherry-pick -x --mainline 1 09f55636e4370b003c42d5bcd8ae93535c230c00
# Push it to GitHub
git push --set-upstream origin backport/backport-6135-to-2.x
# Go back to the original working tree
popd
# Delete the working tree
git worktree remove ../.worktrees/OpenSearch-Dashboards/backport-2.x

Then, create a pull request where the base branch is 2.x and the compare/head branch is backport/backport-6135-to-2.x.