*: gRPC v1.4.1, gateway v1.2.2, metadata Incoming/OutgoingContext

[gyuho]

Fix #7888.

[gyuho]

fyi, still investigating the breaks:

go test -v -race -tags cluster_proxy -run TestV3ElectionObserve
=== RUN   TestV3ElectionObserve
--- PASS: TestV3ElectionObserve (0.33s)
PASS
Too many goroutines running after all test(s).
1 instances of:
google.golang.org/grpc/transport.(*recvBufferReader).Read(...)
	/Users/gyuho/go/src/google.golang.org/grpc/transport/transport.go:144 +0x70a
google.golang.org/grpc/transport.(*Stream).Read(...)
	/Users/gyuho/go/src/google.golang.org/grpc/transport/transport.go:332 +0x7f
io.ReadAtLeast(...)
	/usr/local/go/src/io/io.go:307 +0xb7
io.ReadFull(...)
	/usr/local/go/src/io/io.go:325 +0x73
google.golang.org/grpc.(*parser).recvMsg(...)
	/Users/gyuho/go/src/google.golang.org/grpc/rpc_util.go:219 +0xa0
google.golang.org/grpc.recv(0xc4201745a0, 0x2514520, 0x257e3a8, 0xc42045a480, 0x0, 0x0, 0x1ec92a0, 0xc420168560, 0x7fffffff, 0x0, ...)
	/Users/gyuho/go/src/google.golang.org/grpc/rpc_util.go:315 +0x61
google.golang.org/grpc.(*clientStream).RecvMsg(...)
	/Users/gyuho/go/src/google.golang.org/grpc/stream.go:376 +0x1d4
github.com/coreos/etcd/etcdserver/api/v3election/v3electionpb.(*electionObserveClient).Recv(...)
	/Users/gyuho/go/src/github.com/coreos/etcd/etcdserver/api/v3election/v3electionpb/v3election.pb.go:318 +0x86
github.com/coreos/etcd/proxy/grpcproxy.(*electionProxy).Observe(...)
	/Users/gyuho/go/src/github.com/coreos/etcd/proxy/grpcproxy/election.go:53 +0x1c4
github.com/coreos/etcd/proxy/grpcproxy/adapter.(*es2ec).Observe.func1(...)
	/Users/gyuho/go/src/github.com/coreos/etcd/proxy/grpcproxy/adapter/election_client_adapter.go:48 +0x138
github.com/coreos/etcd/proxy/grpcproxy/adapter.newPipeStream.func1(0xc42014dc40, 0xc4201ca3c0, 0xc4201ca420, 0x25129a0, 0xc420155bc0, 0x0, 0x0, 0x0, 0xc420155bc0, 0x3465400, ...)
	/Users/gyuho/go/src/github.com/coreos/etcd/proxy/grpcproxy/adapter/chan_stream.go:154 +0x7c
created by github.com/coreos/etcd/proxy/grpcproxy/adapter.newPipeStream
	/Users/gyuho/go/src/github.com/coreos/etcd/proxy/grpcproxy/adapter/chan_stream.go:163 +0x48c
exit status 1
FAIL	github.com/coreos/etcd/integration	0.381s

// blocks on v3election.pb.go
func (x *electionObserveClient) Recv() (*LeaderResponse, error) {
	m := new(LeaderResponse)
	fmt.Println("electionObserveClient electionObserveClient 1")
	if err := x.ClientStream.RecvMsg(m); err != nil {
		fmt.Println("electionObserveClient electionObserveClient 2", err)
		return nil, err
	}
	fmt.Println("electionObserveClient electionObserveClient 3")
	return m, nil
}

Bisect tells it breaks since grpc/grpc-go#1136.

Another failure:

go test -v -race -tags cluster_proxy -run TestSTM
=== RUN   TestSTMConflict
--- PASS: TestSTMConflict (0.85s)
=== RUN   TestSTMAbort
--- PASS: TestSTMAbort (0.19s)
PASS
Too many goroutines running after all test(s).
1 instances of:
context.propagateCancel.func1(...)
	/usr/local/go/src/context/context.go:262 +0x188
created by context.propagateCancel
	/usr/local/go/src/context/context.go:267 +0x298
1 instances of:
github.com/coreos/etcd/clientv3.(*watchGrpcStream).run(...)
	/Users/gyuho/go/src/github.com/coreos/etcd/clientv3/watch.go:430 +0x1f94
created by github.com/coreos/etcd/clientv3.(*watcher).newWatcherGrpcStream
	/Users/gyuho/go/src/github.com/coreos/etcd/clientv3/watch.go:228 +0x5b1
1 instances of:
google.golang.org/grpc/transport.(*recvBufferReader).Read(...)
	/Users/gyuho/go/src/google.golang.org/grpc/transport/transport.go:144 +0x70a
google.golang.org/grpc/transport.(*Stream).Read(...)
	/Users/gyuho/go/src/google.golang.org/grpc/transport/transport.go:332 +0x7f
io.ReadAtLeast(...)
	/usr/local/go/src/io/io.go:307 +0xb7
io.ReadFull(...)
	/usr/local/go/src/io/io.go:325 +0x73
google.golang.org/grpc.(*parser).recvMsg(...)
	/Users/gyuho/go/src/google.golang.org/grpc/rpc_util.go:219 +0xa0
google.golang.org/grpc.recv(0xc420183be0, 0x2514520, 0x257e3a8, 0xc422137680, 0x0, 0x0, 0x1ec9ca0, 0xc42030f8b0, 0x7fffffff, 0x0, ...)
	/Users/gyuho/go/src/google.golang.org/grpc/rpc_util.go:315 +0x61
google.golang.org/grpc.(*clientStream).RecvMsg(...)
	/Users/gyuho/go/src/google.golang.org/grpc/stream.go:376 +0x1d4
github.com/coreos/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(...)
	/Users/gyuho/go/src/github.com/coreos/etcd/etcdserver/etcdserverpb/rpc.pb.go:2473 +0x86
github.com/coreos/etcd/clientv3.(*watchGrpcStream).serveWatchClient(...)
	/Users/gyuho/go/src/github.com/coreos/etcd/clientv3/watch.go:557 +0x5d
created by github.com/coreos/etcd/clientv3.(*watchGrpcStream).newWatchClient
	/Users/gyuho/go/src/github.com/coreos/etcd/clientv3/watch.go:712 +0x79e
exit status 1
FAIL	github.com/coreos/etcd/integration	2.264s

[gyuho]

@heyitsanthony @xiang90 PTAL.

[codecov-io]

Codecov Report

❗ No coverage uploaded for pull request base (master@b9a53db). Click here to learn what that means.
The diff coverage is 100%.

@@            Coverage Diff            @@
##             master    #7896   +/-   ##
=========================================
  Coverage          ?   76.52%           
=========================================
  Files             ?      342           
  Lines             ?    26584           
  Branches          ?        0           
=========================================
  Hits              ?    20344           
  Misses            ?     4783           
  Partials          ?     1457

Impacted Files	Coverage Δ
proxy/grpcproxy/lease.go	88.57% <100%> (ø)
clientv3/lease.go	92.33% <100%> (ø)
auth/store.go	80.48% <100%> (ø)
proxy/grpcproxy/watch.go	94.44% <100%> (ø)
etcdserver/api/v3rpc/interceptor.go	92.98% <100%> (ø)
clientv3/client.go	84.17% <100%> (ø)

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b9a53db...5e059fd. Read the comment docs.