reimplement fix for akka/pekko cluster

[pjfanning]

Run I the tests locally they pass but the nightly tests were failing until I removed this change.

see #1590

sbt \
            -Dpekko.cluster.assert=on \
            -Dpekko.log.timestamps=true \
            -Dpekko.test.timefactor=2 \
            -Dpekko.actor.testkit.typed.timefactor=2 \
            -Dpekko.test.tags.exclude=gh-exclude,timing \
            -Dpekko.test.multi-in-test=false \
"cluster/testOnly *JoinConfigCompatCheckerRollingUpdateSpec"

[pjfanning]

@raboof @kerr @sadekmunawar

My changes have fixed most tests but the new ones in this PR are still broken. It looks like we need more changes in org.apache.pekko.remote.Remoting$.localAddressForRemote.

Error:  [12/16/2024 22:04:04.724] [MixedProtocolClusterSpec-pekko.actor.internal-dispatcher-4] [org.apache.pekko.cluster.ClusterActorRefProvider] No root guardian at [pekko.tcp://[email protected]:40819]
org.apache.pekko.remote.RemoteTransportException: No transport is loaded for protocol: [pekko.tcp], available protocols: [akka.tcp]
	at org.apache.pekko.remote.Remoting$.localAddressForRemote(Remoting.scala:125)
	at org.apache.pekko.remote.Remoting.localAddressForRemote(Remoting.scala:168)
	at org.apache.pekko.remote.RemoteActorRefProvider.rootGuardianAt(RemoteActorRefProvider.scala:488)

[pjfanning]

@raboof @He-Pin @sadekmunawar I think I have all the tests passing now. I will check again later. If these changes are approved, I can remove the temp change to run the nightly tests during CI build of this PR.

#1610 raised for a flaky test

[He-Pin]

I have not look into the details, but will it replay the akka node with akka protocol ?otherwise, it will not work. can a akka node sending ping-pong after joined？

And there are akka.tcp and akka protocols, which should be tested too.

[pjfanning]

@He-Pin this PR is based on #1567 but makes extra changes because the nightly tests failed with the 1567 changes. Specifically, the some nightly tests use pekko.tcp/akka.tcp transports. 1567 did not properly support the .tcp transports. These changes fix that.