服务端开启tls，集群服务间grpc通信报错：UNAVAILABLE: Network closed for unknown reason

[HUWEIWEI0105]

问题描述

服务端开启tls后，若nacos.remote.server.rpc.tls.compatibility=true无问题；若nacos.remote.server.rpc.tls.compatibility=false，集群服务间grpc通信9849端口报错，详细堆栈如下：

2023-11-30 23:59:56,080 ERROR Server check fail, please check server xxx ,port 9849 is available , error ={}

java.util.concurrent.ExecutionException: io.grpc.StatusRuntimeException: UNAVAILABLE: Network closed for unknown reason
        at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566)
        at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:445)
        at com.alibaba.nacos.common.remote.client.grpc.GrpcClient.serverCheck(GrpcClient.java:218)
        at com.alibaba.nacos.common.remote.client.grpc.GrpcClient.connectToServer(GrpcClient.java:329)
        at com.alibaba.nacos.common.remote.client.RpcClient.reconnect(RpcClient.java:502)
        at com.alibaba.nacos.common.remote.client.RpcClient.lambda$start$2(RpcClient.java:343)
        at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
        at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
        at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
        at java.base/java.lang.Thread.run(Unknown Source)
Caused by: io.grpc.StatusRuntimeException: UNAVAILABLE: Network closed for unknown reason
        at io.grpc.Status.asRuntimeException(Status.java:537)
        at io.grpc.stub.ClientCalls$UnaryStreamToFuture.onClose(ClientCalls.java:548)
        at io.grpc.internal.DelayedClientCall$DelayedListener$3.run(DelayedClientCall.java:489)
        at io.grpc.internal.DelayedClientCall$DelayedListener.delayOrExecute(DelayedClientCall.java:453)
        at io.grpc.internal.DelayedClientCall$DelayedListener.onClose(DelayedClientCall.java:486)
        at io.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:567)
        at io.grpc.internal.ClientCallImpl.access$300(ClientCallImpl.java:71)
        at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInternal(ClientCallImpl.java:735)
        at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:716)
        at io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
        at io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
        ... 3 common frames omitted

复现步骤

application.properties中增加配置
nacos.remote.server.rpc.tls.enableTls=true
nacos.remote.server.rpc.tls.compatibility=false
nacos.remote.server.rpc.tls.certChainFile=...
nacos.remote.server.rpc.tls.certPrivateKey=...
nacos.remote.server.rpc.tls.certPrivateKeyPassword=...

原因定位

集群服务间grpc通信client通过ClusterRpcClientProxy创建，在创建RpcClient时RpcClientTlsConfig为null，而此时服务器开启了tls，因此通信时报错。这里Rpc Client是不是应该根据配置传入TlsConfig。
ClusterRpcClientProxy

RpcClientFactory

[KomachiSion]

目前仅支持客户端和服务端之间的tls（即9848端口）

[stone-98]

@i will solve it@

[stone-98]

I've been a bit busy lately, so I'll submit the PR before next week.