[Bug]: jaeger-query connection refused on 4317 #4680
Comments
|
So the issue is with helm chart not registering the port correctly? |
|
sorry, didn't see it right, actually we still have the same connection being stablished on the only difference to previous versions of the jaeger-query is the additional grpc call to |
|
I see, I think what happened is that previously jaeger-query was using Jaeger SDK that defaulted to UDP exporter, which did not log errors if there was nothing listening on the corresponding UDP port. But now that we switched to the OTEL SDK it defaults to gRPC exporter which does fail when there is no received. We did not notice it before the release since all-in-one does have the receiver. If you have a jaeger-collector in your installation, you can pass its address via OTEL_EXPORTER_OTLP_TRACES_ENDPOINT. Perhaps by default jaeger-query should not be instantiating a real tracer unless the user has opted in. Also, OTEL_TRACES_EXPORTER allows |
## Which problem is this PR solving? Resolves #4680 ## Description of the changes - Add an opt-in option `--query.enable-tracing` to enable tracing for the jaeger-query component. - The jaeger all-in-one component does not expose this flag since traces are emitted to port 4317 by default, which all-in-one listens on. ## How was this change tested? ``` # Run jaeger-query component with tracing enabled and verify that the connection errors are appearing in stdout. $ SPAN_STORAGE_TYPE=memory go run -tags ui ./cmd/query/main.go --query.enable-tracing ... {"level":"info","ts":1692363754.9049716,"caller":"grpc/clientconn.go:1301","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to CONNECTING","system":"grpc","grpc_log":true} {"level":"info","ts":1692363754.9050152,"caller":"grpc/clientconn.go:1414","msg":"[core][Channel #1 SubChannel #2] Subchannel picks a new address \"localhost:4317\" to connect","system":"grpc","grpc_log":true} {"level":"warn","ts":1692363754.9058733,"caller":"grpc/clientconn.go:1476","msg":"[core][Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: \"localhost:4317\", ServerName: \"localhost:4317\", }. Err: connection error: desc = \"transport: Error while dialing: dial tcp 127.0.0.1:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692363754.9067123,"caller":"grpc/clientconn.go:1303","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to TRANSIENT_FAILURE, last error: connection error: desc = \"transport: Error while dialing: dial tcp 127.0.0.1:4317: connect: connection refused\"","system":"grpc","grpc_log":true} ... # Run jaeger-query component with tracing disabled and verify that the connection errors no longer appear. # Of course, we can't see traces in Jaeger UI because there's nothing to receive the traces. $ SPAN_STORAGE_TYPE=memory go run -tags ui ./cmd/query/main.go # Start an all-in-one instance just as a quick and dirty way to bring up an in-memory jaeger stack to # receive traces from jaeger-query $ make run-all-in-one # Run jaeger-query as a separate component, listening on different ports to all-in-one to avoid port binding collisions. $ SPAN_STORAGE_TYPE=memory go run -tags ui ./cmd/query/main.go --query.enable-tracing --query.grpc-server.host-port :17685 --query.http-server.host-port :17686 --admin.http.host-port :17687 # Open localhost:17686 in a browser and refresh a few times to emit traces to jaeger all-in-one. ``` Confirmed that `jaeger-query` is visible and contains traces: <img width="1572" alt="Screenshot 2023-08-18 at 11 45 26 pm" src="https://github.com/jaegertracing/jaeger/assets/26584478/a348e804-6d37-49f9-9d9f-f73854e9b6bc"> ## Checklist - [x] I have read https://github.com/jaegertracing/jaeger/blob/master/CONTRIBUTING_GUIDELINES.md - [x] I have signed all commits ~- [] I have added unit tests for the new functionality~ - [x] I have run lint and test steps successfully - for `jaeger`: `make lint test` - for `jaeger-ui`: `yarn lint` and `yarn test` --------- Signed-off-by: albertteoh <[email protected]>
What happened?
After upgrading to v1.48.0 noticed that jaeger-query is trying to connect to port
4317locally but this port is not exposed when running on a separate pod (not as part of the all-in-one setup).Steps to reproduce
4317Expected behavior
Compared to previous versions of jaeger-query there seems to be an additional grpc call to
4317which fails, but don't know exactly what's its purpose. It might be a default connection to a local OTEL collector to send traces, if that's the case it should be possible to provide a different endpoint or just disable it.Relevant log output
Jaeger-query logs:
2023/08/17 07:37:06 maxprocs: Leaving GOMAXPROCS=48: CPU quota undefined {"level":"info","ts":1692257826.5274322,"caller":"flags/service.go:119","msg":"Mounting metrics handler on admin server","route":"/metrics"} {"level":"info","ts":1692257826.5274704,"caller":"flags/service.go:125","msg":"Mounting expvar handler on admin server","route":"/debug/vars"} {"level":"info","ts":1692257826.5275674,"caller":"flags/admin.go:129","msg":"Mounting health check on admin server","route":"/"} {"level":"info","ts":1692257826.5275986,"caller":"flags/admin.go:143","msg":"Starting admin HTTP server","http-addr":":16687"} {"level":"info","ts":1692257826.5276134,"caller":"flags/admin.go:121","msg":"Admin server started","http.host-port":"[::]:16687","health-status":"unavailable"} {"level":"info","ts":1692257826.5276673,"caller":"[email protected]/clientconn.go:477","msg":"[core][Channel #1] Channel created","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.527702,"caller":"[email protected]/clientconn.go:1786","msg":"[core][Channel #1] original dial target is: \"localhost:4317\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5277145,"caller":"[email protected]/clientconn.go:1793","msg":"[core][Channel #1] parsed dial target is: {URL:{Scheme:localhost Opaque:4317 User: Host: Path: RawPath: OmitHost:false ForceQuery:false RawQuery: Fragment: RawFragment:}}","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5277233,"caller":"[email protected]/clientconn.go:1807","msg":"[core][Channel #1] fallback to scheme \"passthrough\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5277312,"caller":"[email protected]/clientconn.go:1815","msg":"[core][Channel #1] parsed dial target is: {URL:{Scheme:passthrough Opaque: User: Host: Path:/localhost:4317 RawPath: OmitHost:false ForceQuery:false RawQuery: Fragment: RawFragment:}}","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.52774,"caller":"[email protected]/clientconn.go:1948","msg":"[core][Channel #1] Channel authority set to \"localhost:4317\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5278387,"caller":"[email protected]/resolver_conn_wrapper.go:238","msg":"[core][Channel #1] Resolver state updated: {\n \"Addresses\": [\n {\n \"Addr\": \"localhost:4317\",\n \"ServerName\": \"\",\n \"Attributes\": null,\n \"BalancerAttributes\": null,\n \"Type\": 0,\n \"Metadata\": null\n }\n ],\n \"ServiceConfig\": null,\n \"Attributes\": null\n} (resolver returned new addresses)","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5278635,"caller":"[email protected]/balancer_conn_wrappers.go:192","msg":"[core][Channel #1] Channel switches to new LB policy \"pick_first\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.527879,"caller":"[email protected]/balancer_conn_wrappers.go:312","msg":"[core][Channel #1 SubChannel #2] Subchannel created","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5279026,"caller":"[email protected]/clientconn.go:565","msg":"[core][Channel #1] Channel Connectivity change to CONNECTING","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5279481,"caller":"[email protected]/clientconn.go:1301","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to CONNECTING","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5279865,"caller":"[email protected]/clientconn.go:1414","msg":"[core][Channel #1 SubChannel #2] Subchannel picks a new address \"localhost:4317\" to connect","system":"grpc","grpc_log":true} {"level":"warn","ts":1692257826.5283747,"caller":"[email protected]/clientconn.go:1476","msg":"[core][Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: \"localhost:4317\", ServerName: \"localhost:4317\", }. Err: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5284007,"caller":"[email protected]/clientconn.go:1303","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to TRANSIENT_FAILURE, last error: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5284188,"caller":"[email protected]/clientconn.go:565","msg":"[core][Channel #1] Channel Connectivity change to TRANSIENT_FAILURE","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5986502,"caller":"[email protected]/clientconn.go:477","msg":"[core][Channel #3] Channel created","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5987062,"caller":"[email protected]/clientconn.go:1786","msg":"[core][Channel #3] original dial target is: \"unused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5987306,"caller":"[email protected]/clientconn.go:1793","msg":"[core][Channel #3] parsed dial target is: {URL:{Scheme: Opaque: User: Host: Path:unused RawPath: OmitHost:false ForceQuery:false RawQuery: Fragment: RawFragment:}}","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5987396,"caller":"[email protected]/clientconn.go:1807","msg":"[core][Channel #3] fallback to scheme \"passthrough\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5987482,"caller":"[email protected]/clientconn.go:1815","msg":"[core][Channel #3] parsed dial target is: {URL:{Scheme:passthrough Opaque: User: Host: Path:/unused RawPath: OmitHost:false ForceQuery:false RawQuery: Fragment: RawFragment:}}","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5987585,"caller":"[email protected]/clientconn.go:1948","msg":"[core][Channel #3] Channel authority set to \"unused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.598809,"caller":"[email protected]/resolver_conn_wrapper.go:238","msg":"[core][Channel #3] Resolver state updated: {\n \"Addresses\": [\n {\n \"Addr\": \"unused\",\n \"ServerName\": \"\",\n \"Attributes\": null,\n \"BalancerAttributes\": null,\n \"Type\": 0,\n \"Metadata\": null\n }\n ],\n \"ServiceConfig\": null,\n \"Attributes\": null\n} (resolver returned new addresses)","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5988336,"caller":"[email protected]/balancer_conn_wrappers.go:192","msg":"[core][Channel #3] Channel switches to new LB policy \"pick_first\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5988505,"caller":"[email protected]/balancer_conn_wrappers.go:312","msg":"[core][Channel #3 SubChannel #4] Subchannel created","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5988698,"caller":"[email protected]/clientconn.go:565","msg":"[core][Channel #3] Channel Connectivity change to CONNECTING","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.598908,"caller":"[email protected]/clientconn.go:1301","msg":"[core][Channel #3 SubChannel #4] Subchannel Connectivity change to CONNECTING","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5989327,"caller":"[email protected]/clientconn.go:1414","msg":"[core][Channel #3 SubChannel #4] Subchannel picks a new address \"unused\" to connect","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5990772,"caller":"[email protected]/clientconn.go:1301","msg":"[core][Channel #3 SubChannel #4] Subchannel Connectivity change to READY","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5991,"caller":"[email protected]/clientconn.go:565","msg":"[core][Channel #3] Channel Connectivity change to READY","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.5995967,"caller":"grpc/factory.go:94","msg":"External plugin storage configuration","configuration":{"PluginBinary":"/bin/jaeger-mongodb","PluginConfigurationFile":"","PluginLogLevel":"warn","RemoteServerAddr":"","RemoteTLS":{"Enabled":false,"CAPath":"","CertPath":"","KeyPath":"","ServerName":"","ClientCAPath":"","CipherSuites":null,"MinVersion":"","MaxVersion":"","SkipHostVerify":false},"RemoteConnectTimeout":5000000000,"TenancyOpts":{"Enabled":false,"Header":"x-tenant","Tenants":[]}}} {"level":"info","ts":1692257826.600083,"caller":"querysvc/query_service.go:134","msg":"Archive storage not created","reason":"archive storage not supported"} {"level":"info","ts":1692257826.6000996,"caller":"app/flags.go:141","msg":"Archive storage not initialized"} {"level":"info","ts":1692257826.6001165,"caller":"[email protected]/server.go:652","msg":"[core][Server #6] Server created","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.6001604,"caller":"[email protected]/clientconn.go:477","msg":"[core][Channel #7] Channel created","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.6001694,"caller":"[email protected]/clientconn.go:1786","msg":"[core][Channel #7] original dial target is: \":16685\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.600179,"caller":"[email protected]/clientconn.go:1791","msg":"[core][Channel #7] dial target \":16685\" parse failed: parse \":16685\": missing protocol scheme","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.6001868,"caller":"[email protected]/clientconn.go:1807","msg":"[core][Channel #7] fallback to scheme \"passthrough\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.6001985,"caller":"[email protected]/clientconn.go:1815","msg":"[core][Channel #7] parsed dial target is: {URL:{Scheme:passthrough Opaque: User: Host: Path:/:16685 RawPath: OmitHost:false ForceQuery:false RawQuery: Fragment: RawFragment:}}","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.600208,"caller":"[email protected]/clientconn.go:1948","msg":"[core][Channel #7] Channel authority set to \"localhost:16685\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.6002424,"caller":"[email protected]/resolver_conn_wrapper.go:238","msg":"[core][Channel #7] Resolver state updated: {\n \"Addresses\": [\n {\n \"Addr\": \":16685\",\n \"ServerName\": \"\",\n \"Attributes\": null,\n \"BalancerAttributes\": null,\n \"Type\": 0,\n \"Metadata\": null\n }\n ],\n \"ServiceConfig\": null,\n \"Attributes\": null\n} (resolver returned new addresses)","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.6002643,"caller":"[email protected]/balancer_conn_wrappers.go:192","msg":"[core][Channel #7] Channel switches to new LB policy \"pick_first\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.600277,"caller":"[email protected]/balancer_conn_wrappers.go:312","msg":"[core][Channel #7 SubChannel #8] Subchannel created","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.6002927,"caller":"[email protected]/clientconn.go:565","msg":"[core][Channel #7] Channel Connectivity change to CONNECTING","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.6003299,"caller":"[email protected]/clientconn.go:1301","msg":"[core][Channel #7 SubChannel #8] Subchannel Connectivity change to CONNECTING","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.6003542,"caller":"[email protected]/clientconn.go:1414","msg":"[core][Channel #7 SubChannel #8] Subchannel picks a new address \":16685\" to connect","system":"grpc","grpc_log":true} {"level":"warn","ts":1692257826.6004653,"caller":"[email protected]/clientconn.go:1476","msg":"[core][Channel #7 SubChannel #8] grpc: addrConn.createTransport failed to connect to {Addr: \":16685\", ServerName: \"localhost:16685\", }. Err: connection error: desc = \"transport: Error while dialing: dial tcp :16685: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.6004882,"caller":"[email protected]/clientconn.go:1303","msg":"[core][Channel #7 SubChannel #8] Subchannel Connectivity change to TRANSIENT_FAILURE, last error: connection error: desc = \"transport: Error while dialing: dial tcp :16685: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.600503,"caller":"[email protected]/clientconn.go:565","msg":"[core][Channel #7] Channel Connectivity change to TRANSIENT_FAILURE","system":"grpc","grpc_log":true} {"level":"info","ts":1692257826.6006904,"caller":"app/server.go:215","msg":"Query server started","http_addr":"[::]:16686","grpc_addr":"[::]:16685"} {"level":"info","ts":1692257826.6007037,"caller":"healthcheck/handler.go:129","msg":"Health Check state change","status":"ready"} {"level":"info","ts":1692257826.6007152,"caller":"app/server.go:298","msg":"Starting GRPC server","port":16685,"addr":":16685"} {"level":"info","ts":1692257826.600732,"caller":"app/server.go:279","msg":"Starting HTTP server","port":16686,"addr":":16686"} {"level":"info","ts":1692257826.600727,"caller":"[email protected]/server.go:840","msg":"[core][Server #6 ListenSocket #9] ListenSocket created","system":"grpc","grpc_log":true} {"level":"info","ts":1692257827.5291452,"caller":"[email protected]/clientconn.go:1303","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to IDLE, last error: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257827.5292044,"caller":"[email protected]/clientconn.go:1301","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to CONNECTING","system":"grpc","grpc_log":true} {"level":"info","ts":1692257827.5292187,"caller":"[email protected]/clientconn.go:1414","msg":"[core][Channel #1 SubChannel #2] Subchannel picks a new address \"localhost:4317\" to connect","system":"grpc","grpc_log":true} {"level":"warn","ts":1692257827.529511,"caller":"[email protected]/clientconn.go:1476","msg":"[core][Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: \"localhost:4317\", ServerName: \"localhost:4317\", }. Err: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257827.5295355,"caller":"[email protected]/clientconn.go:1303","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to TRANSIENT_FAILURE, last error: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257827.600737,"caller":"[email protected]/clientconn.go:1303","msg":"[core][Channel #7 SubChannel #8] Subchannel Connectivity change to IDLE, last error: connection error: desc = \"transport: Error while dialing: dial tcp :16685: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257827.6007872,"caller":"[email protected]/clientconn.go:1301","msg":"[core][Channel #7 SubChannel #8] Subchannel Connectivity change to CONNECTING","system":"grpc","grpc_log":true} {"level":"info","ts":1692257827.600802,"caller":"[email protected]/clientconn.go:1414","msg":"[core][Channel #7 SubChannel #8] Subchannel picks a new address \":16685\" to connect","system":"grpc","grpc_log":true} {"level":"info","ts":1692257827.601635,"caller":"[email protected]/clientconn.go:1301","msg":"[core][Channel #7 SubChannel #8] Subchannel Connectivity change to READY","system":"grpc","grpc_log":true} {"level":"info","ts":1692257827.6016746,"caller":"[email protected]/clientconn.go:565","msg":"[core][Channel #7] Channel Connectivity change to READY","system":"grpc","grpc_log":true} {"level":"info","ts":1692257828.9231403,"caller":"[email protected]/clientconn.go:1303","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to IDLE, last error: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257828.9231994,"caller":"[email protected]/clientconn.go:1301","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to CONNECTING","system":"grpc","grpc_log":true} {"level":"info","ts":1692257828.9232118,"caller":"[email protected]/clientconn.go:1414","msg":"[core][Channel #1 SubChannel #2] Subchannel picks a new address \"localhost:4317\" to connect","system":"grpc","grpc_log":true} {"level":"warn","ts":1692257828.9235184,"caller":"[email protected]/clientconn.go:1476","msg":"[core][Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: \"localhost:4317\", ServerName: \"localhost:4317\", }. Err: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257828.9235418,"caller":"[email protected]/clientconn.go:1303","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to TRANSIENT_FAILURE, last error: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257831.1688876,"caller":"[email protected]/clientconn.go:1303","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to IDLE, last error: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257831.1689517,"caller":"[email protected]/clientconn.go:1301","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to CONNECTING","system":"grpc","grpc_log":true} {"level":"info","ts":1692257831.1689644,"caller":"[email protected]/clientconn.go:1414","msg":"[core][Channel #1 SubChannel #2] Subchannel picks a new address \"localhost:4317\" to connect","system":"grpc","grpc_log":true} {"level":"warn","ts":1692257831.1692743,"caller":"[email protected]/clientconn.go:1476","msg":"[core][Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: \"localhost:4317\", ServerName: \"localhost:4317\", }. Err: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257831.1692958,"caller":"[email protected]/clientconn.go:1303","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to TRANSIENT_FAILURE, last error: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257835.9161758,"caller":"[email protected]/clientconn.go:1303","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to IDLE, last error: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257835.9162319,"caller":"[email protected]/clientconn.go:1301","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to CONNECTING","system":"grpc","grpc_log":true} {"level":"info","ts":1692257835.9162393,"caller":"[email protected]/clientconn.go:1414","msg":"[core][Channel #1 SubChannel #2] Subchannel picks a new address \"localhost:4317\" to connect","system":"grpc","grpc_log":true} {"level":"warn","ts":1692257835.9165177,"caller":"[email protected]/clientconn.go:1476","msg":"[core][Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: \"localhost:4317\", ServerName: \"localhost:4317\", }. Err: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257835.9165478,"caller":"[email protected]/clientconn.go:1303","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to TRANSIENT_FAILURE, last error: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} 2023/08/17 07:37:21 traces export: context deadline exceeded: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused" {"level":"info","ts":1692257842.9922786,"caller":"[email protected]/clientconn.go:1303","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to IDLE, last error: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257842.9923375,"caller":"[email protected]/clientconn.go:1301","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to CONNECTING","system":"grpc","grpc_log":true} {"level":"info","ts":1692257842.9923491,"caller":"[email protected]/clientconn.go:1414","msg":"[core][Channel #1 SubChannel #2] Subchannel picks a new address \"localhost:4317\" to connect","system":"grpc","grpc_log":true} {"level":"warn","ts":1692257842.992632,"caller":"[email protected]/clientconn.go:1476","msg":"[core][Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: \"localhost:4317\", ServerName: \"localhost:4317\", }. Err: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257842.992667,"caller":"[email protected]/clientconn.go:1303","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to TRANSIENT_FAILURE, last error: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257855.0019822,"caller":"[email protected]/clientconn.go:1303","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to IDLE, last error: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257855.0020514,"caller":"[email protected]/clientconn.go:1301","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to CONNECTING","system":"grpc","grpc_log":true} {"level":"info","ts":1692257855.002064,"caller":"[email protected]/clientconn.go:1414","msg":"[core][Channel #1 SubChannel #2] Subchannel picks a new address \"localhost:4317\" to connect","system":"grpc","grpc_log":true} {"level":"warn","ts":1692257855.0023816,"caller":"[email protected]/clientconn.go:1476","msg":"[core][Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: \"localhost:4317\", ServerName: \"localhost:4317\", }. Err: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257855.0024161,"caller":"[email protected]/clientconn.go:1303","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to TRANSIENT_FAILURE, last error: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257871.2982996,"caller":"[email protected]/clientconn.go:1303","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to IDLE, last error: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257871.2983947,"caller":"[email protected]/clientconn.go:1301","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to CONNECTING","system":"grpc","grpc_log":true} {"level":"info","ts":1692257871.2984073,"caller":"[email protected]/clientconn.go:1414","msg":"[core][Channel #1 SubChannel #2] Subchannel picks a new address \"localhost:4317\" to connect","system":"grpc","grpc_log":true} {"level":"warn","ts":1692257871.2987669,"caller":"[email protected]/clientconn.go:1476","msg":"[core][Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: \"localhost:4317\", ServerName: \"localhost:4317\", }. Err: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257871.2988234,"caller":"[email protected]/clientconn.go:1303","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to TRANSIENT_FAILURE, last error: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} 2023/08/17 07:38:21 traces export: context deadline exceeded: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused" {"level":"info","ts":1692257902.6765707,"caller":"[email protected]/clientconn.go:1303","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to IDLE, last error: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257902.6766615,"caller":"[email protected]/clientconn.go:1301","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to CONNECTING","system":"grpc","grpc_log":true} {"level":"info","ts":1692257902.6766727,"caller":"[email protected]/clientconn.go:1414","msg":"[core][Channel #1 SubChannel #2] Subchannel picks a new address \"localhost:4317\" to connect","system":"grpc","grpc_log":true} {"level":"warn","ts":1692257902.676992,"caller":"[email protected]/clientconn.go:1476","msg":"[core][Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: \"localhost:4317\", ServerName: \"localhost:4317\", }. Err: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true} {"level":"info","ts":1692257902.6770453,"caller":"[email protected]/clientconn.go:1303","msg":"[core][Channel #1 SubChannel #2] Subchannel Connectivity change to TRANSIENT_FAILURE, last error: connection error: desc = \"transport: Error while dialing: dial tcp [::1]:4317: connect: connection refused\"","system":"grpc","grpc_log":true}Jaeger-query listening ports:
Screenshot
No response
Additional context
No response
Jaeger backend version
1.48.0
SDK
No response
Pipeline
No response
Stogage backend
No response
Operating system
Linux
Deployment model
Kubernetes
Deployment configs
The sample
values.yamlcould be used to deploy this setup and reproduce the issue:Steps to install:
The text was updated successfully, but these errors were encountered: