ccl/streamingccl/streamingest: TestStreamIngestionFrontierProcessor failed #75642

cockroach-teamcity · 2022-01-28T05:21:39Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ ba04380bfbca30bf16e15048786716bec510a263:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39440086776 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

/cc @cockroachdb/bulk-io _{This test on roachdash | Improve this report!}

The text was updated successfully, but these errors were encountered:

cockroach-teamcity · 2022-01-28T07:01:37Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 71becf337d9d2731298dc092f3ce9cf0f0eedb2c:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39440478576 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.07s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-race -parallel=4

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-28T09:13:01Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 71becf337d9d2731298dc092f3ce9cf0f0eedb2c:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39440440176 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-28T10:46:32Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 71becf337d9d2731298dc092f3ce9cf0f0eedb2c:

          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	github.com/cockroachdb/cockroach/pkg/rpc/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39440802504 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

TAGS=bazel,gss

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-28T12:59:52Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 71becf337d9d2731298dc092f3ce9cf0f0eedb2c:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39440752536 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.05s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-28T17:10:26Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 39d728b4b7ab335ff6617b250d8a53609195e07c:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39441127896 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.07s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-28T18:12:48Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 4a73be01b43b977e732bbe8f3bfc460c218a0799:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39441206688 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.05s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-29T07:08:27Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 5b871267b62d22854f8c7b92c7c5843100597976:

          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	github.com/cockroachdb/cockroach/pkg/rpc/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39442562040 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

TAGS=bazel,gss

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-29T10:37:32Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 5b871267b62d22854f8c7b92c7c5843100597976:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39442634136 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.07s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-29T13:27:29Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 75ba483e01a04e6ad707b3f0c00d645b6c92cb52:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39442871856 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.08s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-29T17:26:55Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 75ba483e01a04e6ad707b3f0c00d645b6c92cb52:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39443204520 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-29T20:30:29Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 323988fdbb0e7d3a3f90607811a9f657fb922f93:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39443465304 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-30T00:03:55Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 1e965832577673d0dd3bfb11b002e562751dd376:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39443777016 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-30T02:41:08Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ a5158c4c93e9dca858b38ef7e94321f0a0a2b5c5:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39444053928 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-30T06:22:05Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ a5158c4c93e9dca858b38ef7e94321f0a0a2b5c5:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39444343464 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.07s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-30T06:42:13Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ a5158c4c93e9dca858b38ef7e94321f0a0a2b5c5:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39444597864 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.05s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-race -parallel=4

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-30T09:25:51Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ a5158c4c93e9dca858b38ef7e94321f0a0a2b5c5:

          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	github.com/cockroachdb/cockroach/pkg/rpc/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39444833568 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

TAGS=bazel,gss

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-30T10:06:17Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ a5158c4c93e9dca858b38ef7e94321f0a0a2b5c5:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39444658032 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-30T13:51:50Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ a5158c4c93e9dca858b38ef7e94321f0a0a2b5c5:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39444979008 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-30T21:32:02Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ a5158c4c93e9dca858b38ef7e94321f0a0a2b5c5:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39445652568 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.07s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-31T01:05:18Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ a5158c4c93e9dca858b38ef7e94321f0a0a2b5c5:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39445964424 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.05s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-31T04:53:29Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ a5158c4c93e9dca858b38ef7e94321f0a0a2b5c5:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39446276472 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-31T08:51:50Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ a5158c4c93e9dca858b38ef7e94321f0a0a2b5c5:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39446603280 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-31T12:20:37Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ a5158c4c93e9dca858b38ef7e94321f0a0a2b5c5:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39446938536 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.05s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-31T22:00:50Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ baeba807b4c5eaecadfced511ebba0bac4a63476:

          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39447765528 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
I220131 19:21:37.869105 5421 3@vendor/github.com/cockroachdb/pebble/event.go:629  [n3,pebble,s3] 3312  [JOB 353] compacted(elision-only) L6 [000432] (1.0 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s (0.0s total), output rate 0 B/s
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-01-31T23:52:29Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 6a0bdec23578c10378766c675090dcf98d515504:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39447914928 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-01T23:05:06Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ ecab73938e98e1dbcc207a06eb8e61b7acc3c119:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39449918352 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.05s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-02T01:26:05Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ be1b6c4fd4778b784658459f77d28e6ed746c349:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39450113136 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-02T06:05:07Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 9f4ce34f845b6a04fa681761f0bc4544baf9ec9d:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39450528144 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.07s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-02T06:53:29Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ a434c8418c36dbeb64e73588bcd4dd5b248c3238:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39450834864 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-race -parallel=4

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-02T08:10:10Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 63988a409584865a75ba80c0f0c3a1ceab67d076:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39450705528 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.09s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-02T09:13:35Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 16859b99637d1adedb915a67998749dbfa4c0663:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39450796200 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-02T09:59:10Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ a434c8418c36dbeb64e73588bcd4dd5b248c3238:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39450875568 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.07s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-02T10:32:02Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ a434c8418c36dbeb64e73588bcd4dd5b248c3238:

          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	github.com/cockroachdb/cockroach/pkg/rpc/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39451149624 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.05s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

TAGS=bazel,gss

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-02T13:50:50Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ a434c8418c36dbeb64e73588bcd4dd5b248c3238:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:89
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39451193784 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.07s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-02T16:15:22Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 0e5eb08368020e7633142fd60f0f818fcd46510d:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:110
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39451413936 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-02T18:15:25Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 8a76b5916e5f6367572f1b2413704f82d82f3da6:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:110
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39451581528 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.07s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-02T19:25:46Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 39ca6aca0806fa1dc1e846c7014799fb71621587:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:110
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39451665480 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-02T20:41:29Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ d8693413c0149060bbf16353dd29bff7dae6f64c:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:110
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39451794456 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.10s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-02T21:43:02Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 577e9b0e078f66b4a0d6c8c73e3aa6c7bba297ec:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:110
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:190
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2021
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1569
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:910
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:893
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:803
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39451884168 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-02T23:35:40Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ a0f0df792704250649a09bbbbfa89c0a0ce1e75a:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:110
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:201
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2027
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1575
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:913
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:896
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:806
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39452051832 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-03T00:48:57Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 88522a3d6346e8302ce7a027b8b6a9184828ef13:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:110
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:201
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2027
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1575
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:913
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:896
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:806
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39452152152 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-03T05:32:37Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ a950be5e3399abfb02a05b665fd81b965cc58d11:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:110
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:201
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2027
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1575
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:913
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:896
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:806
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39452549904 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-03T07:06:57Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ f20c1a8d824f0d00f18c0d58ed8b4bc4955e0969:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:110
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:201
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2027
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1575
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:913
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:896
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:806
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39452927880 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.05s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-race -parallel=4

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-03T09:27:25Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ f20c1a8d824f0d00f18c0d58ed8b4bc4955e0969:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:110
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:201
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2027
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1575
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:913
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:896
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:806
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39452905008 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-03T10:38:27Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 5c0d5132ade6d2e30a9d414163851272750d8afa:

          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go:110
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_send.go:201
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	github.com/cockroachdb/cockroach/pkg/rpc/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2027
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1575
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	github.com/cockroachdb/cockroach/pkg/kv/db.go:913
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	github.com/cockroachdb/cockroach/pkg/kv/db.go:896
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	github.com/cockroachdb/cockroach/pkg/kv/db.go:806
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39453232488 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.05s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

TAGS=bazel,gss

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-03T11:32:03Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 5c0d5132ade6d2e30a9d414163851272750d8afa:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:110
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:201
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2027
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1575
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:913
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:896
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:806
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39453068832 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.07s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-03T15:15:39Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 5c0d5132ade6d2e30a9d414163851272750d8afa:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:110
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:201
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2027
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1575
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:913
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:896
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:806
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39453405768 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.08s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2022-02-03T15:52:07Z

ccl/streamingccl/streamingest.TestStreamIngestionFrontierProcessor failed with artifacts on master @ 61e2304e5c0fc448942a8659af129851b34a00f9:

          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_proposal.go:889
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_raft.go:110
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_write.go:153
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:517
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).sendWithoutRangeID
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:247
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/replica_send.go:96
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/store_send.go:201
          | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/stores.go:191
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal.func1
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:957
          | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:344
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:945
          | github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/server/node.go:1014
          | github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:565
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:209
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport.go:191
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.raceTransport.SendNext
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/transport_race.go:79
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:2027
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1575
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:1177
          | github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/dist_sender.go:798
          | github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:221
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).sendUsingSender
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:913
          | github.com/cockroachdb/cockroach/pkg/kv.(*DB).send
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:896
          | github.com/cockroachdb/cockroach/pkg/kv.sendAndFill
          | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:806
        Wraps: (7) SST stats are incorrect: diff(given, actual) = [GCBytesAge: 39453464112 != 0]
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *assert.withAssertionFailure (6) *errbase.opaqueWrapper (7) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
    --- FAIL: TestStreamIngestionFrontierProcessor/no-checkpoints (0.06s)

Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

GOFLAGS=-json

_{This test on roachdash | Improve this report!}

cockroach-teamcity added branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. labels Jan 28, 2022

blathers-crl bot added the T-disaster-recovery label Jan 28, 2022

erikgrinaker mentioned this issue Feb 3, 2022

batcheval: use same stats timestamp for AddSSTable assertions #75963

Merged

craig bot closed this as completed in #75963 Feb 3, 2022

craig bot closed this as completed in 513d468 Feb 3, 2022

github-project-automation bot added this to Disaster Recovery Backlog Aug 28, 2024

github-project-automation bot moved this to Done in Disaster Recovery Backlog Aug 28, 2024

ccl/streamingccl/streamingest: TestStreamIngestionFrontierProcessor failed #75642

ccl/streamingccl/streamingest: TestStreamIngestionFrontierProcessor failed #75642

Comments

cockroach-teamcity commented Jan 28, 2022

cockroach-teamcity commented Jan 28, 2022

cockroach-teamcity commented Jan 28, 2022

cockroach-teamcity commented Jan 28, 2022

cockroach-teamcity commented Jan 28, 2022

cockroach-teamcity commented Jan 28, 2022

cockroach-teamcity commented Jan 28, 2022

cockroach-teamcity commented Jan 29, 2022

cockroach-teamcity commented Jan 29, 2022

cockroach-teamcity commented Jan 29, 2022

cockroach-teamcity commented Jan 29, 2022

cockroach-teamcity commented Jan 29, 2022

cockroach-teamcity commented Jan 30, 2022

cockroach-teamcity commented Jan 30, 2022

cockroach-teamcity commented Jan 30, 2022

cockroach-teamcity commented Jan 30, 2022

cockroach-teamcity commented Jan 30, 2022

cockroach-teamcity commented Jan 30, 2022

cockroach-teamcity commented Jan 30, 2022

cockroach-teamcity commented Jan 30, 2022

cockroach-teamcity commented Jan 31, 2022

cockroach-teamcity commented Jan 31, 2022

cockroach-teamcity commented Jan 31, 2022

cockroach-teamcity commented Jan 31, 2022

cockroach-teamcity commented Jan 31, 2022

cockroach-teamcity commented Jan 31, 2022

cockroach-teamcity commented Feb 1, 2022

cockroach-teamcity commented Feb 2, 2022

cockroach-teamcity commented Feb 2, 2022

cockroach-teamcity commented Feb 2, 2022

cockroach-teamcity commented Feb 2, 2022

cockroach-teamcity commented Feb 2, 2022

cockroach-teamcity commented Feb 2, 2022

cockroach-teamcity commented Feb 2, 2022

cockroach-teamcity commented Feb 2, 2022

cockroach-teamcity commented Feb 2, 2022

cockroach-teamcity commented Feb 2, 2022

cockroach-teamcity commented Feb 2, 2022

cockroach-teamcity commented Feb 2, 2022

cockroach-teamcity commented Feb 2, 2022

cockroach-teamcity commented Feb 2, 2022

cockroach-teamcity commented Feb 3, 2022

cockroach-teamcity commented Feb 3, 2022

cockroach-teamcity commented Feb 3, 2022

cockroach-teamcity commented Feb 3, 2022

cockroach-teamcity commented Feb 3, 2022

cockroach-teamcity commented Feb 3, 2022

cockroach-teamcity commented Feb 3, 2022

cockroach-teamcity commented Feb 3, 2022