From e50f79ce9f822cabe36a44695927f02843a72d90 Mon Sep 17 00:00:00 2001 From: daojun Date: Sun, 14 Aug 2022 20:32:58 +0800 Subject: [PATCH 1/6] batch metadata store metrics doc --- site2/docs/reference-metrics.md | 16 ++++++++++++++++ 1 file changed, 16 insertions(+) diff --git a/site2/docs/reference-metrics.md b/site2/docs/reference-metrics.md index 91df1b88f3ab6..d939f9e784c49 100644 --- a/site2/docs/reference-metrics.md +++ b/site2/docs/reference-metrics.md @@ -579,6 +579,22 @@ All the offload metrics are labelled with the following labels: | brk_ledgeroffloader_read_ledger_latency | Summary | The latency of reading entries from BookKeeper. | | brk_ledgeroffloader_delete_offload_ops | Counter | The total number of successful and failed operations to delete offload ledgers. | +### Metadata store metrics + +All the offload metrics are labelled with the following labels: + +- *cluster*: `cluster=${pulsar_cluster}`. `${pulsar_cluster}` is the cluster name that you configured in `broker.conf`. +- *name*: `name=${metadata-store-x}`. `${name}` is the metadata store name. + +| Name | Type | Description | +|--------------------------------------------|-----------|---------------------------------------------------------------| +| pulsar_metadata_store_queueing_read | Gauge | The number of metadata store queueing read operations. | +| pulsar_metadata_store_queueing_write | Gauge | The number of metadata store queueing write operations. | +| pulsar_metadata_store_executor_queue_size | Gauge | The number of blocking operations in metadata store executor. | +| pulsar_metadata_store_read_overflow_total | Counter | The number of read operations can't be queued. | +| pulsar_metadata_store_write_overflow_total | Counter | The number of write operations can't be queued. | +| pulsar_metadata_store_waiting_ms | Histogram | The waiting time of batch operations. | + ### Web service executor metrics From 158202bec6c96bf7f7c541b9db8279808b8b3cfc Mon Sep 17 00:00:00 2001 From: daojun Date: Sun, 14 Aug 2022 20:37:48 +0800 Subject: [PATCH 2/6] batch metadata store metrics doc --- site2/docs/reference-metrics.md | 16 ---------------- 1 file changed, 16 deletions(-) diff --git a/site2/docs/reference-metrics.md b/site2/docs/reference-metrics.md index d939f9e784c49..91df1b88f3ab6 100644 --- a/site2/docs/reference-metrics.md +++ b/site2/docs/reference-metrics.md @@ -579,22 +579,6 @@ All the offload metrics are labelled with the following labels: | brk_ledgeroffloader_read_ledger_latency | Summary | The latency of reading entries from BookKeeper. | | brk_ledgeroffloader_delete_offload_ops | Counter | The total number of successful and failed operations to delete offload ledgers. | -### Metadata store metrics - -All the offload metrics are labelled with the following labels: - -- *cluster*: `cluster=${pulsar_cluster}`. `${pulsar_cluster}` is the cluster name that you configured in `broker.conf`. -- *name*: `name=${metadata-store-x}`. `${name}` is the metadata store name. - -| Name | Type | Description | -|--------------------------------------------|-----------|---------------------------------------------------------------| -| pulsar_metadata_store_queueing_read | Gauge | The number of metadata store queueing read operations. | -| pulsar_metadata_store_queueing_write | Gauge | The number of metadata store queueing write operations. | -| pulsar_metadata_store_executor_queue_size | Gauge | The number of blocking operations in metadata store executor. | -| pulsar_metadata_store_read_overflow_total | Counter | The number of read operations can't be queued. | -| pulsar_metadata_store_write_overflow_total | Counter | The number of write operations can't be queued. | -| pulsar_metadata_store_waiting_ms | Histogram | The waiting time of batch operations. | - ### Web service executor metrics From 82596a1cd7288e49485bb20e2dc4b4573c1b3e01 Mon Sep 17 00:00:00 2001 From: daojun Date: Sun, 14 Aug 2022 20:42:22 +0800 Subject: [PATCH 3/6] batch metadata store metrics doc --- site2/docs/reference-metrics.md | 16 ++++++++++++++++ 1 file changed, 16 insertions(+) diff --git a/site2/docs/reference-metrics.md b/site2/docs/reference-metrics.md index 91df1b88f3ab6..1dd78052c7aaa 100644 --- a/site2/docs/reference-metrics.md +++ b/site2/docs/reference-metrics.md @@ -596,6 +596,22 @@ All the web service executor metrics are labelled with the following labels: | pulsar_web_executor_active_threads | GAUGE | The number of threads performing tasks of pulsar-web thread pool | | pulsar_web_executor_current_threads | GAUGE | The number of threads in the pulsar-web thread pool | +### Metadata store metrics + +All the offload metrics are labelled with the following labels: + +- *cluster*: `cluster=${pulsar_cluster}`. `${pulsar_cluster}` is the cluster name that you configured in `broker.conf`. +- *name*: `name=${metadata-store-x}`. `${name}` is the metadata store name. + +| Name | Type | Description | +|--------------------------------------------|-----------|---------------------------------------------------------------| +| pulsar_metadata_store_queueing_read | Gauge | The number of metadata store queueing read operations. | +| pulsar_metadata_store_queueing_write | Gauge | The number of metadata store queueing write operations. | +| pulsar_metadata_store_executor_queue_size | Gauge | The number of blocking operations in metadata store executor. | +| pulsar_metadata_store_read_overflow_total | Counter | The number of read operations can't be queued. | +| pulsar_metadata_store_write_overflow_total | Counter | The number of write operations can't be queued. | +| pulsar_metadata_store_waiting_ms | Histogram | The waiting time of batch operations. | + ## Pulsar Functions All the Pulsar Functions metrics are labelled with the following labels: From 6949b0aa15d9136e751c8559ad71c036cb71c163 Mon Sep 17 00:00:00 2001 From: daojun Date: Thu, 3 Nov 2022 19:20:48 +0800 Subject: [PATCH 4/6] fix doc --- site2/docs/reference-metrics.md | 18 ++++++++---------- 1 file changed, 8 insertions(+), 10 deletions(-) diff --git a/site2/docs/reference-metrics.md b/site2/docs/reference-metrics.md index db6cc62bb234e..9b2ebf37ab76e 100644 --- a/site2/docs/reference-metrics.md +++ b/site2/docs/reference-metrics.md @@ -610,16 +610,14 @@ All the metadata store metrics are labeled with the following labels: - *cluster*: `cluster=${pulsar_cluster}`. `${pulsar_cluster}` is the cluster name that you configured in `broker.conf`. - *name*: `name=${metadata-store|configuration-metadata-store|state-metadata-store}`. `${name}` is the metadata store name. -| Name | Type | Description | -|----------------------------------------|-----------|----------------------------------------------------------------------------------------------| -| pulsar_metadata_store_ops_latency | Histogram | The latency of getting/deleting/putting data fail/success operations from/to metadata store. | -| pulsar_metadata_store_put_bytes_total | Counter | The number of data put to metadata store. | -| pulsar_metadata_store_queueing_read | Gauge | The number of metadata store queueing read operations. | -| pulsar_metadata_store_queueing_write | Gauge | The number of metadata store queueing write operations. | -| pulsar_metadata_store_executor_queue_size | Gauge | The number of blocking operations in metadata store executor. | -| pulsar_metadata_store_read_overflow_total | Counter | The number of read operations can't be queued. | -| pulsar_metadata_store_write_overflow_total | Counter | The number of write operations can't be queued. | -| pulsar_metadata_store_waiting_ms | Histogram | The waiting time of batch operations. | +| Name | Type | Description | +|----------------------------------------------------|-----------|----------------------------------------------------------------------------------------------| +| pulsar_metadata_store_ops_latency | Histogram | The latency of getting/deleting/putting data fail/success operations from/to metadata store. | +| pulsar_metadata_store_put_bytes_total | Counter | The number of data put to metadata store. | +| pulsar_batch_metadata_store_executor_queue_size | Gauge | The number of blocking operations in metadata store executor. | +| pulsar_batch_metadata_store_queue_wait_time_ms | Histogram | The waiting time of batch operations. | +| pulsar_batch_metadata_store_batch_execute_time_ms | Histogram | The time of the batch execution in milliseconds. | +| pulsar_batch_metadata_store_batch_size | Histogram | The number of read/write operations in the batch. | ## Pulsar Functions From cc7e06fd25c22e87eb57e9d130f13c79ed90fab9 Mon Sep 17 00:00:00 2001 From: daojun Date: Fri, 11 Nov 2022 10:11:59 +0800 Subject: [PATCH 5/6] review fix --- site2/docs/reference-metrics.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/site2/docs/reference-metrics.md b/site2/docs/reference-metrics.md index 9b2ebf37ab76e..7dc1e0537f06d 100644 --- a/site2/docs/reference-metrics.md +++ b/site2/docs/reference-metrics.md @@ -612,7 +612,7 @@ All the metadata store metrics are labeled with the following labels: | Name | Type | Description | |----------------------------------------------------|-----------|----------------------------------------------------------------------------------------------| -| pulsar_metadata_store_ops_latency | Histogram | The latency of getting/deleting/putting data fail/success operations from/to metadata store. | +| pulsar_metadata_store_ops_latency | Histogram | The latency of getting/deleting/putting data from/to metadata store. | | pulsar_metadata_store_put_bytes_total | Counter | The number of data put to metadata store. | | pulsar_batch_metadata_store_executor_queue_size | Gauge | The number of blocking operations in metadata store executor. | | pulsar_batch_metadata_store_queue_wait_time_ms | Histogram | The waiting time of batch operations. | From 42266bbbcbb72f8ddbc18cee7be69d22f63549d9 Mon Sep 17 00:00:00 2001 From: daojun Date: Tue, 15 Nov 2022 16:04:54 +0800 Subject: [PATCH 6/6] review fix --- site2/docs/reference-metrics.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/site2/docs/reference-metrics.md b/site2/docs/reference-metrics.md index 7dc1e0537f06d..cbbca2cf03da6 100644 --- a/site2/docs/reference-metrics.md +++ b/site2/docs/reference-metrics.md @@ -616,7 +616,7 @@ All the metadata store metrics are labeled with the following labels: | pulsar_metadata_store_put_bytes_total | Counter | The number of data put to metadata store. | | pulsar_batch_metadata_store_executor_queue_size | Gauge | The number of blocking operations in metadata store executor. | | pulsar_batch_metadata_store_queue_wait_time_ms | Histogram | The waiting time of batch operations. | -| pulsar_batch_metadata_store_batch_execute_time_ms | Histogram | The time of the batch execution in milliseconds. | +| pulsar_batch_metadata_store_batch_execute_time_ms | Histogram | The duration of the batch execution in milliseconds. | | pulsar_batch_metadata_store_batch_size | Histogram | The number of read/write operations in the batch. | ## Pulsar Functions