[Refactor] StreamIO and OpenSearchException foundation to core library

[nknize]

This PR refactors the Stream IO classes from the :server module to :opensearch-core library to support cloud native and serverless extensions.

The following classes are refactored:

• StreamInput
• StreamOutput
• Writeable
• NamedWriteable
• NamedWriteableRegistry
• Index
• ShardId
• BytesReference
• ByteArray
• BigArray
• SecureString
• Text
• ParsingException
• RestStatus

This is a predecessor PR to #7783 such that the namespace is left unchanged. The follow up #7783 PR refactors from the org.opensearch to org.opensearch.core namespace to avoid split package in support of jigsaw modularity. This is done to minimize the change surface area as much as possible.

relates #5910
relates #8110
dependency of #7783

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/17410/
• CommitID: 4cf598e
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: SUCCESS ✅
• URL: https://build.ci.opensearch.org/job/gradle-check/17454/
• CommitID: 691c082

[nknize]

One more commit coming. After quick review of this PR I've decided to eliminate the intermediate BaseOpenSearchException and refactor all of OpenSearchException. I will keep a OpenSearchServerExceptions utility class in the server package for registering the server specific exceptions. This will keep the exception framework more extensible without having to double inherit from OpenSearchException and BaseOpenSearchException

[codecov]

Codecov Report

Merging #8035 (2843bb2) into main (0b775e7) will decrease coverage by 0.13%.
The diff coverage is 88.97%.

@@             Coverage Diff              @@
##               main    #8035      +/-   ##
============================================
- Coverage     70.92%   70.80%   -0.13%     
+ Complexity    56664    56575      -89     
============================================
  Files          4722     4719       -3     
  Lines        267604   267551      -53     
  Branches      39214    39204      -10     
============================================
- Hits         189803   189439     -364     
- Misses        61826    62128     +302     
- Partials      15975    15984       +9     

Impacted Files	Coverage Δ
...n/src/main/java/org/opensearch/common/Classes.java	66.66% <ø> (ø)
.../src/main/java/org/opensearch/common/Explicit.java	63.63% <ø> (ø)
...rch/common/ExponentiallyWeightedMovingAverage.java	100.00% <ø> (ø)
...in/java/org/opensearch/common/LocalTimeOffset.java	88.26% <ø> (ø)
...java/org/opensearch/common/MacAddressProvider.java	40.62% <ø> (ø)
...main/java/org/opensearch/common/NamedRegistry.java	100.00% <ø> (ø)
...rg/opensearch/common/RandomBasedUUIDGenerator.java	100.00% <ø> (ø)
...java/org/opensearch/common/SecureRandomHolder.java	50.00% <ø> (ø)
...src/main/java/org/opensearch/common/StopWatch.java	48.33% <ø> (ø)
.../org/opensearch/common/TimeBasedUUIDGenerator.java	84.37% <ø> (ø)
... and 213 more

... and 428 files with indirect coverage changes

[dblock]

With the changes to hlrs, how badly is it going to mess up opensearch-java?

[mch2]

Took a few passes through, lgtm. Given size here should prob get a second set of eyes.

[nknize]

@andrross do you want to give it a quick pass?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: SUCCESS ✅
• URL: https://build.ci.opensearch.org/job/gradle-check/17914/
• CommitID: 2843bb2

[saratvemulapalli]

Doing a first pass.
Thanks for the changes, this decouples server from steamIO which @VachaShah has been trying to untangle for #6844

[nknize]

...this decouples server from steamIO which @VachaShah has been trying to untangle for #6844

Thanks @saratvemulapalli ... 💯 This makes it a lot easier for ProtoBuf to move to :libs:opensearch-xcontent alongside cbor, smile, yaml, etc and not be forced to land in :server. A great example of decoupling!

[saratvemulapalli]

Thanks @nknize!!

I am worried all downstream dependencies would break and we should provide enough time for them to consume these changes. Quick search shows 2.2k files[1]

[1] https://github.com/search?q=org%3Aopensearch-project+StreamInput+NOT+repo%3Aopensearch-project%2FOpenSearch+&type=code&p=1

[nknize]

I am worried all downstream dependencies would break...

For this PR, as long as the downstream is taking a dependencies { on opensearch-core the consumer should be happy (with the exception of StreamsUtil.readFully). Regarding the follow up namespace change, we discuss this on #8110

[vamsi-amazon]

@nknize There are failures in mocking Writable objects with NoClassFound Exception as mentioned in above two pull requests. Couldn't figure out the root cause. Any help would be appreciated.

Error details

Caused by: java.lang.NoClassDefFoundError: org/opensearch/core/common/io/stream/BaseStreamOutput
	at java.base/java.lang.Class.getDeclaredMethods0(Native Method)
	at java.base/java.lang.Class.privateGetDeclaredMethods(Class.java:3402)
	at java.base/java.lang.Class.getDeclaredMethods(Class.java:2504)
	at net.bytebuddy.description.method.MethodList$ForLoadedMethods.<init>(MethodList.java:152)
	at net.bytebuddy.description.type.TypeDescription$ForLoadedType.getDeclaredMethods(TypeDescription.java:8940)
	at net.bytebuddy.dynamic.scaffold.InstrumentedType$Factory$Default$1.represent(InstrumentedType.java:438)
	at net.bytebuddy.ByteBuddy.redefine(ByteBuddy.java:886)
	at net.bytebuddy.ByteBuddy.redefine(ByteBuddy.java:861)
	at org.mockito.internal.creation.bytebuddy.InlineBytecodeGenerator.transform(InlineBytecodeGenerator.java:390)
	at java.instrument/java.lang.instrument.ClassFileTransformer.transform(ClassFileTransformer.java:244)
	at java.instrument/sun.instrument.TransformerManager.transform(TransformerManager.java:188)
	at java.instrument/sun.instrument.InstrumentationImpl.transform(InstrumentationImpl.java:541)
	at java.instrument/sun.instrument.InstrumentationImpl.retransformClasses0(Native Method)
	at java.instrument/sun.instrument.InstrumentationImpl.retransformClasses(InstrumentationImpl.java:169)
	at org.mockito.internal.creation.bytebuddy.InlineBytecodeGenerator.triggerRetransformation(InlineBytecodeGenerator.java:281)
	... 113 more
	```

[nknize]

@vamsi-amazon looks like these were resolved due to artifact update lag? LMK

[vamsi-amazon]

@nknize seems like the issue got fixed itself after artifact update.
Thanks.

[opensearch-trigger-bot]

The backport to 2.x failed:

The process '/usr/bin/git' failed with exit code 128

To backport manually, run these commands in your terminal:

# Fetch latest updates from GitHub
git fetch
# Create a new working tree
git worktree add ../.worktrees/backport-2.x 2.x
# Navigate to the new working tree
pushd ../.worktrees/backport-2.x
# Create a new branch
git switch --create backport/backport-8035-to-2.x
# Cherry-pick the merged commit of this pull request and resolve the conflicts
git cherry-pick -x --mainline 1 5a968a8ec59926ce4b696c13473f88e4559f79c9
# Push it to GitHub
git push --set-upstream origin backport/backport-8035-to-2.x
# Go back to the original working tree
popd
# Delete the working tree
git worktree remove ../.worktrees/backport-2.x

Then, create a pull request where the base branch is 2.x and the compare/head branch is backport/backport-8035-to-2.x.