c2c: add top-level metrics to the replication job #92959
Assignees
Labels
A-disaster-recovery
C-enhancement
Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception)
T-disaster-recovery
Comments
adityamaru
added
C-enhancement
|
cc @cockroachdb/disaster-recovery |
|
cc @cockroachdb/disaster-recovery |
lidorcarmel
added a commit
to lidorcarmel/cockroach
that referenced
this issue
Jan 17, 2023
Add a metric to track the lag of the replication frontier, in seconds. Informs: cockroachdb#92959 Epic: CRDB-18752 Release note: None
lidorcarmel
added a commit
to lidorcarmel/cockroach
that referenced
this issue
Jan 18, 2023
Add a metric to track the lag of the replication frontier, in seconds. Informs: cockroachdb#92959 Epic: CRDB-18752 Release note: None
craig bot
pushed a commit
that referenced
this issue
Jan 18, 2023
95248: streamingest: add a replication lag metric r=lidorcarmel a=lidorcarmel Add a metric to track the lag of the replication frontier, in seconds. Informs: #92959 Epic: CRDB-18752 Release note: None 95406: sql: retry query requiring cluster setting propagation r=cucaroach a=cucaroach Fixes: #95359 Release note: None Epic: none 95453: changefeedccl: nilsafe kafkaSink.Close r=[miretskiy] a=HonoreDB We were tolerating nils in other parts of Close, but not here, which can create a race condition if a sink gets closed before being fully initialized resulting in a panic. Fixes #95278 Release note: None Co-authored-by: Lidor Carmel <[email protected]> Co-authored-by: Tommy Reilly <[email protected]> Co-authored-by: Aaron Zinger <[email protected]>
craig bot
pushed a commit
that referenced
this issue
Jan 23, 2023
95552: gossip: Remove creation time dependency on grpc r=rharding6373,erikgrinaker a=andrewbaptist
Create gossip objects without a grpc depencency. The rpcContext is
injected during Start instead. This removes some code tangles and
simplifies the usage of gossip in tests.
Epic: none
Release note: None
95591: docgen: update SQL diagrams for SQL docs refactor r=rytaft a=taroface
Updated existing & added some new SQL diagrams. These will be used in the SQL docs being refactored as per https://cockroachlabs.atlassian.net/browse/DOC-5850
Release note: none
95629: streamingest,bulk,roachpb: add a metric for bytes streamed, compressed r=lidorcarmel a=lidorcarmel
We currently have a mteric for the logical bytes written to SSTs, pre-compression, and this PR adds a metric for the "physical" bytes sent to KV in SSTs, post compression.
Epic: CRDB-18752
Fixes: #92959
Release note: None
For example:
<img width="1012" alt="Screenshot 2023-01-20 at 2 15 31 PM" src="https://user-images.githubusercontent.com/51982110/213814907-13ebdde1-82c4-4597-b9f9-d02a8bc1a112.png">
Co-authored-by: Andrew Baptist <[email protected]>
Co-authored-by: Ryan Kuo <[email protected]>
Co-authored-by: Lidor Carmel <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Replication Lag: Add a metric that tracks the difference between now() and the frontier timestamp on the destination cluster. This tracks how far behind the replication is from the current time on the destination cluster.
Replicated Physical Bytes: Add a metric that tracks the physical bytes ingested by the destination cluster.
Epic: CRDB-18752
Jira issue: CRDB-22068
The text was updated successfully, but these errors were encountered: