db: add method to compute statistics over a key span #1996
Assignees
Labels
Comments
|
This would have helped in https://github.com/cockroachlabs/support/issues/2107. See https://cockroachlabs.slack.com/archives/C04RXNF8THA/p1677782359190299 and earlier threads on the channel. |
|
We would want stats to count the internal keys (and bytes) and the keys covered by range tombstones (and classify them into whether they can be cheaply seeked over during iteration or not). And pace the scan, say 2MB/s (or configurable in the sql statement), so it does not impact foreground traffic. |
raggar
added a commit
to raggar/pebble
that referenced
this issue
Jul 21, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Jul 25, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Jul 25, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Jul 25, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Jul 25, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Jul 25, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Jul 27, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Jul 27, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Jul 27, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Jul 27, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Jul 27, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Jul 31, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Jul 31, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Aug 1, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Aug 1, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Aug 1, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Aug 1, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Aug 1, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Aug 2, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Aug 2, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Aug 2, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Aug 2, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Aug 3, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Aug 3, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
to raggar/pebble
that referenced
this issue
Aug 3, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: cockroachdb#1996
raggar
added a commit
that referenced
this issue
Aug 3, 2023
Created a new function `ScanStatistics` that returns counts of the different key kinds in Pebble (by level) as well as the number of snapshot keys. Also modified `ScanInternal` to surface the level of each key within each visitor function. Informs: #1996
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
In some issues (eg, cockroachlabs/support#1830) it would be useful to be able to get a better picture of the storage layer over a keyspan: eg, number of keys in each level, and what kinds. Maybe it could replace the specific
DB.EstimateDiskUsagefunction.See cockroachdb/cockroach#94659 for the cockroach companion issue.
The text was updated successfully, but these errors were encountered: