diff --git a/site/content/en/contributions/DEVELOP.md b/site/content/en/contributions/DEVELOP.md
index c9c4cbb2475..555bf3296cc 100644
--- a/site/content/en/contributions/DEVELOP.md
+++ b/site/content/en/contributions/DEVELOP.md
@@ -145,6 +145,34 @@ verify signature was copied to [JWK Creator][] for generating the JWK. The JWK C
settings, i.e. `Signing` public key use and the `RS256` algorithm. The generated JWK was wrapped in a JWKS structure
and is hosted in the repo.
+### Benchmarking
+
+Envoy Gateway uses [nighthawk][nighthawk] for benchmarking, and mainly concerned with
+its performance and scalability as a control-plane.
+
+The performance and scalability concerns come from several aspects for control-plane:
+
+- The consumption of memory and CPU.
+- The rate of configuration changes.
+
+The benchmark test is running on [Kind][Kind] cluster, you can run the following command
+to start a Kind cluster and run benchmark test on it.
+
+```shell
+make benchmark-test
+```
+
+By default, a benchmark report will be generated under `test/benchmark` after test finished.
+
+#### Brief benchmark report
+
+You can browse the detailed benchmark report in `test/benchmark/benchmark-report.md`.
+
+Here are some brief benchmark reports about Envoy Gateway:
+
+- It will take up nearly 1.3GiB memory and 11s total CPU time for (1 GatewayClass + 1 Gateway + 500 HTTRoutes) settings
+
+
[Quickstart]: https://github.com/envoyproxy/gateway/blob/main/docs/latest/user/quickstart.md
[make]: https://www.gnu.org/software/make/
[Github Actions]: https://docs.github.com/en/actions
@@ -161,3 +189,4 @@ and is hosted in the repo.
[request authentication]: ../latest/tasks/security/jwt-authentication
[JWT Debugger]: https://jwt.io/
[JWK Creator]: https://russelldavies.github.io/jwk-creator/
+[nighthawk]: https://github.com/envoyproxy/nighthawk
diff --git a/test/benchmark/benchmark_report.md b/test/benchmark/benchmark_report.md
index 4d6d57da1a0..5821d67840f 100644
--- a/test/benchmark/benchmark_report.md
+++ b/test/benchmark/benchmark_report.md
@@ -2,9 +2,9 @@
Benchmark test settings:
-|RPS |Connections|Duration (Seconds)|CPU Limits (m)|Memory Limits (MiB)|
-|- |- |- |- |- |
-|1000|100 |90 |1000 |2048 |
+|RPS |Connections|Duration (Seconds)|CPU Limits (m)|Memory Limits (MiB)|
+|- |- |- |- |- |
+|10000|100 |90 |1000 |2048 |
## Test: ScaleHTTPRoute
@@ -20,94 +20,104 @@ Click to see the full results.
scale-up-httproutes-10
```plaintext
-[2024-06-25 14:23:36.545][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override.
-[14:23:36.545677][1][I] Detected 4 (v)CPUs with affinity..
-[14:23:36.545689][1][I] Starting 4 threads / event loops. Time limit: 90 seconds.
-[14:23:36.545691][1][I] Global targets: 400 connections and 4000 calls per second.
-[14:23:36.545692][1][I] (Per-worker targets: 100 connections and 1000 calls per second)
-[14:25:07.247563][19][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9998444444686 per second.)
-[14:25:07.248019][20][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9975333394178 per second.)
-[14:25:07.248086][22][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.999577777956 per second.)
-[14:25:07.248380][24][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9990666675377 per second.)
-[14:25:07.818186][1][I] Done.
+Warning: 29 02:48:14.546][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override.
+[02:48:14.547222][1][I] Detected 4 (v)CPUs with affinity..
+[02:48:14.547235][1][I] Starting 4 threads / event loops. Time limit: 30 seconds.
+[02:48:14.547237][1][I] Global targets: 400 connections and 40000 calls per second.
+[02:48:14.547239][1][I] (Per-worker targets: 100 connections and 10000 calls per second)
+[02:48:45.249233][18][I] Stopping after 30000 ms. Initiated: 63756 / Completed: 63740. (Completion rate was 2124.6656043338644 per second.)
+[02:48:45.249278][21][I] Stopping after 30000 ms. Initiated: 13846 / Completed: 13844. (Completion rate was 461.4664974622843 per second.)
+[02:48:45.249278][19][I] Stopping after 30000 ms. Initiated: 79156 / Completed: 79137. (Completion rate was 2637.8965707344582 per second.)
+[02:48:45.249494][23][I] Stopping after 30000 ms. Initiated: 20224 / Completed: 20222. (Completion rate was 674.0621055130861 per second.)
Nighthawk - A layer 7 protocol benchmarking tool.
-benchmark_http_client.latency_2xx (359802 samples)
- min: 0s 000ms 290us | mean: 0s 000ms 544us | max: 0s 062ms 072us | pstdev: 0s 000ms 863us
+benchmark_http_client.latency_2xx (176582 samples)
+ min: 0s 000ms 358us | mean: 0s 006ms 272us | max: 0s 070ms 623us | pstdev: 0s 011ms 440us
Percentile Count Value
- 0.5 179926 0s 000ms 448us
- 0.75 269854 0s 000ms 530us
- 0.8 287861 0s 000ms 552us
- 0.9 323828 0s 000ms 684us
- 0.95 341812 0s 000ms 793us
- 0.990625 356429 0s 001ms 863us
- 0.99902344 359451 0s 009ms 407us
+ 0.5 88291 0s 002ms 898us
+ 0.75 132439 0s 004ms 643us
+ 0.8 141270 0s 005ms 297us
+ 0.9 158924 0s 008ms 790us
+ 0.95 167754 0s 045ms 185us
+ 0.990625 174928 0s 054ms 206us
+ 0.99902344 176410 0s 059ms 482us
-Queueing and connection setup latency (359802 samples)
- min: 0s 000ms 002us | mean: 0s 000ms 011us | max: 0s 023ms 417us | pstdev: 0s 000ms 100us
+Queueing and connection setup latency (176621 samples)
+ min: 0s 000ms 001us | mean: 0s 000ms 012us | max: 0s 024ms 204us | pstdev: 0s 000ms 165us
+[02:48:50.882431][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
Percentile Count Value
- 0.5 179902 0s 000ms 010us
- 0.75 269909 0s 000ms 010us
- 0.8 288003 0s 000ms 011us
- 0.9 323850 0s 000ms 011us
- 0.95 341822 0s 000ms 012us
- 0.990625 356429 0s 000ms 029us
- 0.99902344 359451 0s 000ms 170us
+ 0.5 88528 0s 000ms 003us
+ 0.75 132525 0s 000ms 008us
+ 0.8 141340 0s 000ms 009us
+ 0.9 159044 0s 000ms 010us
+ 0.95 167794 0s 000ms 011us
+ 0.990625 174966 0s 000ms 077us
+ 0.99902344 176449 0s 001ms 431us
-Request start to response end (359802 samples)
- min: 0s 000ms 289us | mean: 0s 000ms 543us | max: 0s 062ms 072us | pstdev: 0s 000ms 863us
+Request start to response end (176582 samples)
+ min: 0s 000ms 358us | mean: 0s 006ms 271us | max: 0s 070ms 623us | pstdev: 0s 011ms 440us
Percentile Count Value
- 0.5 179915 0s 000ms 448us
- 0.75 269861 0s 000ms 530us
- 0.8 287848 0s 000ms 552us
- 0.9 323824 0s 000ms 683us
- 0.95 341813 0s 000ms 792us
- 0.990625 356429 0s 001ms 862us
- 0.99902344 359451 0s 009ms 406us
+ 0.5 88293 0s 002ms 897us
+ 0.75 132441 0s 004ms 643us
+ 0.8 141267 0s 005ms 296us
+ 0.9 158924 0s 008ms 788us
+ 0.95 167754 0s 045ms 185us
+ 0.990625 174928 0s 054ms 204us
+ 0.99902344 176410 0s 059ms 473us
-Response body size in bytes (359802 samples)
+Response body size in bytes (176582 samples)
min: 10 | mean: 10 | max: 10 | pstdev: 0
-Response header size in bytes (359802 samples)
+Response header size in bytes (176582 samples)
min: 110 | mean: 110 | max: 110 | pstdev: 0
-Blocking. Results are skewed when significant numbers are reported here. (2 samples)
- min: 0s 000ms 901us | mean: 0s 001ms 551us | max: 0s 002ms 202us | pstdev: 0s 000ms 650us
+Blocking. Results are skewed when significant numbers are reported here. (53988 samples)
+ min: 0s 000ms 035us | mean: 0s 002ms 220us | max: 0s 067ms 391us | pstdev: 0s 006ms 778us
Percentile Count Value
- 0.5 1 0s 000ms 901us
+ 0.5 26994 0s 000ms 766us
+ 0.75 40492 0s 001ms 732us
+ 0.8 43191 0s 002ms 062us
+ 0.9 48590 0s 003ms 222us
+ 0.95 51289 0s 004ms 958us
+ 0.990625 53482 0s 048ms 125us
+ 0.99902344 53936 0s 055ms 597us
-Initiation to completion (360000 samples)
- min: 0s 000ms 006us | mean: 0s 000ms 562us | max: 0s 062ms 310us | pstdev: 0s 000ms 883us
+Initiation to completion (176943 samples)
+ min: 0s 000ms 003us | mean: 0s 006ms 351us | max: 0s 071ms 114us | pstdev: 0s 011ms 455us
Percentile Count Value
- 0.5 180016 0s 000ms 465us
- 0.75 270003 0s 000ms 547us
- 0.8 288024 0s 000ms 570us
- 0.9 324002 0s 000ms 702us
- 0.95 342002 0s 000ms 815us
- 0.990625 356625 0s 001ms 912us
- 0.99902344 359649 0s 009ms 617us
+ 0.5 88472 0s 002ms 960us
+ 0.75 132709 0s 004ms 735us
+ 0.8 141556 0s 005ms 408us
+ 0.9 159249 0s 009ms 012us
+ 0.95 168096 0s 045ms 185us
+ 0.990625 175285 0s 054ms 288us
+ 0.99902344 176771 0s 059ms 691us
Counter Value Per second
-benchmark.http_2xx 359802 3997.80
-benchmark.pool_overflow 198 2.20
-cluster_manager.cluster_added 4 0.04
-default.total_match_count 4 0.04
-membership_change 4 0.04
-runtime.load_success 1 0.01
-runtime.override_dir_not_exists 1 0.01
-upstream_cx_http1_total 108 1.20
-upstream_cx_rx_bytes_total 56488914 627653.97
-upstream_cx_total 108 1.20
-upstream_cx_tx_bytes_total 15471486 171905.23
-upstream_rq_pending_overflow 198 2.20
-upstream_rq_pending_total 108 1.20
-upstream_rq_total 359802 3997.80
-
+benchmark.http_2xx 176582 5886.05
+benchmark.pool_overflow 361 12.03
+cluster_manager.cluster_added 4 0.13
+default.total_match_count 4 0.13
+membership_change 4 0.13
+runtime.load_success 1 0.03
+runtime.override_dir_not_exists 1 0.03
+upstream_cx_http1_total 39 1.30
+upstream_cx_rx_bytes_total 27723374 924110.39
+upstream_cx_total 39 1.30
+upstream_cx_tx_bytes_total 7594703 253156.20
+upstream_rq_pending_overflow 361 12.03
+upstream_rq_pending_total 39 1.30
+upstream_rq_total 176621 5887.35
+
+[02:48:55.883737][19][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[02:49:00.884904][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[02:49:05.885509][23][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[02:49:05.886786][1][I] Done.
```
@@ -117,90 +127,104 @@ upstream_rq_total 359802 3997.80
scale-up-httproutes-50
```plaintext
-[2024-06-25 14:25:18.533][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override.
-[14:25:18.533824][1][I] Detected 4 (v)CPUs with affinity..
-[14:25:18.533833][1][I] Starting 4 threads / event loops. Time limit: 90 seconds.
-[14:25:18.533836][1][I] Global targets: 400 connections and 4000 calls per second.
-[14:25:18.533837][1][I] (Per-worker targets: 100 connections and 1000 calls per second)
-[14:26:49.235731][18][I] Stopping after 89999 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 1000.0000222222228 per second.)
-[14:26:49.235977][19][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 1000 per second.)
-[14:26:49.236240][21][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 89999. (Completion rate was 999.9888111119815 per second.)
-[14:26:49.236565][23][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 89999. (Completion rate was 999.9879333448638 per second.)
-[14:26:54.772502][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+Warning: 30 09:50:00.929][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override.
+[09:50:00.930463][1][I] Detected 4 (v)CPUs with affinity..
+[09:50:00.930476][1][I] Starting 4 threads / event loops. Time limit: 90 seconds.
+[09:50:00.930478][1][I] Global targets: 400 connections and 40000 calls per second.
+[09:50:00.930480][1][I] (Per-worker targets: 100 connections and 10000 calls per second)
+[09:51:31.632205][18][I] Stopping after 90000 ms. Initiated: 132984 / Completed: 132975. (Completion rate was 1477.4999671666674 per second.)
+[09:51:31.632253][19][I] Stopping after 90000 ms. Initiated: 184337 / Completed: 184323. (Completion rate was 2048.0327871912564 per second.)
+[09:51:31.632393][23][I] Stopping after 90000 ms. Initiated: 119466 / Completed: 119458. (Completion rate was 1327.309400356773 per second.)
+[09:51:31.632493][21][I] Stopping after 90000 ms. Initiated: 98553 / Completed: 98547. (Completion rate was 1094.963746763342 per second.)
+[09:51:37.272832][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
Nighthawk - A layer 7 protocol benchmarking tool.
-benchmark_http_client.latency_2xx (359912 samples)
- min: 0s 000ms 303us | mean: 0s 000ms 508us | max: 0s 031ms 259us | pstdev: 0s 000ms 449us
+benchmark_http_client.latency_2xx (534940 samples)
+ min: 0s 000ms 324us | mean: 0s 006ms 013us | max: 0s 080ms 613us | pstdev: 0s 011ms 899us
Percentile Count Value
- 0.5 179967 0s 000ms 437us
- 0.75 269938 0s 000ms 509us
- 0.8 287950 0s 000ms 533us
- 0.9 323925 0s 000ms 643us
- 0.95 341919 0s 000ms 735us
- 0.990625 356538 0s 001ms 526us
- 0.99902344 359561 0s 006ms 589us
+ 0.5 267470 0s 002ms 663us
+ 0.75 401207 0s 004ms 128us
+ 0.8 427956 0s 004ms 645us
+ 0.9 481449 0s 006ms 891us
+ 0.95 508194 0s 048ms 232us
+ 0.990625 529927 0s 055ms 224us
+ 0.99902344 534418 0s 061ms 255us
-Queueing and connection setup latency (359914 samples)
- min: 0s 000ms 001us | mean: 0s 000ms 011us | max: 0s 023ms 449us | pstdev: 0s 000ms 080us
+Queueing and connection setup latency (534977 samples)
+ min: 0s 000ms 001us | mean: 0s 000ms 012us | max: 0s 026ms 379us | pstdev: 0s 000ms 131us
Percentile Count Value
- 0.5 180198 0s 000ms 010us
- 0.75 270795 0s 000ms 011us
- 0.8 288165 0s 000ms 011us
- 0.9 324019 0s 000ms 011us
- 0.95 341989 0s 000ms 011us
- 0.990625 356540 0s 000ms 025us
- 0.99902344 359564 0s 000ms 159us
+ 0.5 267828 0s 000ms 003us
+ 0.75 401520 0s 000ms 008us
+ 0.8 427993 0s 000ms 009us
+ 0.9 482090 0s 000ms 009us
+ 0.95 508250 0s 000ms 010us
+ 0.990625 529962 0s 000ms 132us
+ 0.99902344 534455 0s 001ms 630us
-Request start to response end (359912 samples)
- min: 0s 000ms 302us | mean: 0s 000ms 508us | max: 0s 031ms 258us | pstdev: 0s 000ms 448us
+Request start to response end (534940 samples)
+ min: 0s 000ms 324us | mean: 0s 006ms 012us | max: 0s 080ms 613us | pstdev: 0s 011ms 899us
Percentile Count Value
- 0.5 179970 0s 000ms 437us
- 0.75 269934 0s 000ms 509us
- 0.8 287943 0s 000ms 533us
- 0.9 323921 0s 000ms 643us
- 0.95 341917 0s 000ms 735us
- 0.990625 356538 0s 001ms 525us
- 0.99902344 359561 0s 006ms 589us
+ 0.5 267484 0s 002ms 663us
+ 0.75 401210 0s 004ms 127us
+ 0.8 427955 0s 004ms 645us
+ 0.9 481446 0s 006ms 889us
+ 0.95 508195 0s 048ms 232us
+ 0.990625 529929 0s 055ms 224us
+ 0.99902344 534418 0s 061ms 251us
-Response body size in bytes (359912 samples)
+Response body size in bytes (534940 samples)
min: 10 | mean: 10 | max: 10 | pstdev: 0
-Response header size in bytes (359912 samples)
+Response header size in bytes (534940 samples)
min: 110 | mean: 110 | max: 110 | pstdev: 0
-Initiation to completion (359998 samples)
- min: 0s 000ms 006us | mean: 0s 000ms 525us | max: 0s 032ms 263us | pstdev: 0s 000ms 461us
+Blocking. Results are skewed when significant numbers are reported here. (176008 samples)
+ min: 0s 000ms 036us | mean: 0s 002ms 044us | max: 0s 073ms 248us | pstdev: 0s 006ms 744us
+
+ Percentile Count Value
+ 0.5 88005 0s 000ms 734us
+ 0.75 132008 0s 001ms 534us
+ 0.8 140807 0s 001ms 802us
+ 0.9 158410 0s 002ms 792us
+ 0.95 167208 0s 004ms 190us
+ 0.990625 174359 0s 047ms 886us
+ 0.99902344 175837 0s 053ms 557us
+
+Initiation to completion (535303 samples)
+ min: 0s 000ms 004us | mean: 0s 006ms 072us | max: 0s 080ms 633us | pstdev: 0s 011ms 900us
Percentile Count Value
- 0.5 180024 0s 000ms 453us
- 0.75 270017 0s 000ms 526us
- 0.8 288004 0s 000ms 550us
- 0.9 323999 0s 000ms 663us
- 0.95 341999 0s 000ms 753us
- 0.990625 356624 0s 001ms 571us
- 0.99902344 359647 0s 006ms 655us
+ 0.5 267665 0s 002ms 717us
+ 0.75 401487 0s 004ms 204us
+ 0.8 428258 0s 004ms 732us
+ 0.9 481775 0s 007ms 022us
+ 0.95 508538 0s 048ms 248us
+ 0.990625 530287 0s 055ms 298us
+ 0.99902344 534781 0s 061ms 421us
Counter Value Per second
-benchmark.http_2xx 359912 3999.02
-benchmark.pool_overflow 86 0.96
+benchmark.http_2xx 534940 5943.77
+benchmark.pool_overflow 363 4.03
cluster_manager.cluster_added 4 0.04
default.total_match_count 4 0.04
membership_change 4 0.04
runtime.load_success 1 0.01
runtime.override_dir_not_exists 1 0.01
-upstream_cx_http1_total 61 0.68
-upstream_cx_rx_bytes_total 56506184 627846.33
-upstream_cx_total 61 0.68
-upstream_cx_tx_bytes_total 15476302 171958.87
-upstream_rq_pending_overflow 86 0.96
-upstream_rq_pending_total 61 0.68
-upstream_rq_total 359914 3999.04
-
-[14:26:59.773726][23][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
-[14:26:59.775576][1][I] Done.
+upstream_cx_http1_total 37 0.41
+upstream_cx_rx_bytes_total 83985580 933172.12
+upstream_cx_total 37 0.41
+upstream_cx_tx_bytes_total 23004011 255599.85
+upstream_rq_pending_overflow 363 4.03
+upstream_rq_pending_total 37 0.41
+upstream_rq_total 534977 5944.18
+
+[09:51:42.273918][19][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[09:51:47.274994][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[09:51:52.275699][23][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[09:51:52.277010][1][I] Done.
```
@@ -210,90 +234,104 @@ upstream_rq_total 359914 3999.04
scale-up-httproutes-100
```plaintext
-[2024-06-25 14:27:18.024][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override.
-[14:27:18.024969][1][I] Detected 4 (v)CPUs with affinity..
-[14:27:18.024981][1][I] Starting 4 threads / event loops. Time limit: 90 seconds.
-[14:27:18.024984][1][I] Global targets: 400 connections and 4000 calls per second.
-[14:27:18.024985][1][I] (Per-worker targets: 100 connections and 1000 calls per second)
-[14:28:48.726723][18][I] Stopping after 89999 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 1000.0000111111112 per second.)
-[14:28:48.726970][19][I] Stopping after 89999 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 1000.0000222222228 per second.)
-[14:28:48.727250][21][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 89999. (Completion rate was 999.9885555593705 per second.)
-[14:28:48.727579][23][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 89999. (Completion rate was 999.9878444571402 per second.)
-[14:28:54.260999][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+Warning: 30 09:52:08.843][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override.
+[09:52:08.843704][1][I] Detected 4 (v)CPUs with affinity..
+[09:52:08.843716][1][I] Starting 4 threads / event loops. Time limit: 90 seconds.
+[09:52:08.843719][1][I] Global targets: 400 connections and 40000 calls per second.
+[09:52:08.843720][1][I] (Per-worker targets: 100 connections and 10000 calls per second)
+[09:53:39.545479][18][I] Stopping after 90000 ms. Initiated: 60881 / Completed: 60878. (Completion rate was 676.421921590257 per second.)
+[09:53:39.545649][23][I] Stopping after 90000 ms. Initiated: 77409 / Completed: 77407. (Completion rate was 860.076458993874 per second.)
+[09:53:39.545773][19][I] Stopping after 90000 ms. Initiated: 271217 / Completed: 271198. (Completion rate was 3013.300631521137 per second.)
+[09:53:39.546416][21][I] Stopping after 90000 ms. Initiated: 123329 / Completed: 123321. (Completion rate was 1370.219189626365 per second.)
+[09:53:45.183623][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
Nighthawk - A layer 7 protocol benchmarking tool.
-benchmark_http_client.latency_2xx (359869 samples)
- min: 0s 000ms 301us | mean: 0s 000ms 514us | max: 0s 029ms 035us | pstdev: 0s 000ms 431us
+benchmark_http_client.latency_2xx (532441 samples)
+ min: 0s 000ms 359us | mean: 0s 006ms 029us | max: 0s 090ms 263us | pstdev: 0s 011ms 870us
Percentile Count Value
- 0.5 179965 0s 000ms 444us
- 0.75 269904 0s 000ms 518us
- 0.8 287910 0s 000ms 540us
- 0.9 323888 0s 000ms 641us
- 0.95 341879 0s 000ms 744us
- 0.990625 356497 0s 001ms 522us
- 0.99902344 359518 0s 006ms 553us
+ 0.5 266227 0s 002ms 698us
+ 0.75 399344 0s 004ms 228us
+ 0.8 425959 0s 004ms 757us
+ 0.9 479199 0s 007ms 042us
+ 0.95 505821 0s 047ms 982us
+ 0.990625 527453 0s 055ms 048us
+ 0.99902344 531922 0s 060ms 678us
-Queueing and connection setup latency (359871 samples)
- min: 0s 000ms 001us | mean: 0s 000ms 011us | max: 0s 027ms 366us | pstdev: 0s 000ms 058us
+Queueing and connection setup latency (532473 samples)
+ min: 0s 000ms 001us | mean: 0s 000ms 011us | max: 0s 023ms 204us | pstdev: 0s 000ms 126us
Percentile Count Value
- 0.5 179998 0s 000ms 010us
- 0.75 271128 0s 000ms 011us
- 0.8 288699 0s 000ms 011us
- 0.9 324073 0s 000ms 011us
- 0.95 341895 0s 000ms 012us
- 0.990625 356498 0s 000ms 029us
- 0.99902344 359520 0s 000ms 166us
+ 0.5 267630 0s 000ms 003us
+ 0.75 399579 0s 000ms 008us
+ 0.8 426987 0s 000ms 009us
+ 0.9 479713 0s 000ms 009us
+ 0.95 505878 0s 000ms 010us
+ 0.990625 527482 0s 000ms 040us
+ 0.99902344 531955 0s 001ms 391us
-Request start to response end (359869 samples)
- min: 0s 000ms 301us | mean: 0s 000ms 513us | max: 0s 029ms 035us | pstdev: 0s 000ms 431us
+Request start to response end (532441 samples)
+ min: 0s 000ms 359us | mean: 0s 006ms 028us | max: 0s 090ms 263us | pstdev: 0s 011ms 870us
Percentile Count Value
- 0.5 179935 0s 000ms 444us
- 0.75 269906 0s 000ms 517us
- 0.8 287896 0s 000ms 539us
- 0.9 323883 0s 000ms 641us
- 0.95 341876 0s 000ms 743us
- 0.990625 356496 0s 001ms 521us
- 0.99902344 359518 0s 006ms 552us
+ 0.5 266221 0s 002ms 697us
+ 0.75 399332 0s 004ms 227us
+ 0.8 425959 0s 004ms 757us
+ 0.9 479199 0s 007ms 042us
+ 0.95 505824 0s 047ms 982us
+ 0.990625 527450 0s 055ms 046us
+ 0.99902344 531922 0s 060ms 678us
-Response body size in bytes (359869 samples)
+Response body size in bytes (532441 samples)
min: 10 | mean: 10 | max: 10 | pstdev: 0
-Response header size in bytes (359869 samples)
+Response header size in bytes (532441 samples)
min: 110 | mean: 110 | max: 110 | pstdev: 0
-Initiation to completion (359998 samples)
- min: 0s 000ms 007us | mean: 0s 000ms 532us | max: 0s 029ms 055us | pstdev: 0s 000ms 451us
+Blocking. Results are skewed when significant numbers are reported here. (183352 samples)
+ min: 0s 000ms 033us | mean: 0s 001ms 962us | max: 0s 084ms 799us | pstdev: 0s 006ms 606us
+
+ Percentile Count Value
+ 0.5 91683 0s 000ms 726us
+ 0.75 137514 0s 001ms 420us
+ 0.8 146685 0s 001ms 667us
+ 0.9 165017 0s 002ms 581us
+ 0.95 174186 0s 003ms 882us
+ 0.990625 181634 0s 047ms 661us
+ 0.99902344 183173 0s 053ms 168us
+
+Initiation to completion (532804 samples)
+ min: 0s 000ms 001us | mean: 0s 006ms 088us | max: 0s 090ms 275us | pstdev: 0s 011ms 873us
Percentile Count Value
- 0.5 180023 0s 000ms 461us
- 0.75 270008 0s 000ms 535us
- 0.8 288030 0s 000ms 557us
- 0.9 324004 0s 000ms 661us
- 0.95 341999 0s 000ms 763us
- 0.990625 356624 0s 001ms 570us
- 0.99902344 359647 0s 007ms 023us
+ 0.5 266426 0s 002ms 753us
+ 0.75 399604 0s 004ms 306us
+ 0.8 426251 0s 004ms 841us
+ 0.9 479526 0s 007ms 164us
+ 0.95 506172 0s 048ms 007us
+ 0.990625 527811 0s 055ms 113us
+ 0.99902344 532284 0s 060ms 801us
Counter Value Per second
-benchmark.http_2xx 359869 3998.54
-benchmark.pool_overflow 129 1.43
+benchmark.http_2xx 532441 5915.99
+benchmark.pool_overflow 363 4.03
cluster_manager.cluster_added 4 0.04
default.total_match_count 4 0.04
membership_change 4 0.04
runtime.load_success 1 0.01
runtime.override_dir_not_exists 1 0.01
-upstream_cx_http1_total 63 0.70
-upstream_cx_rx_bytes_total 56499433 627771.26
-upstream_cx_total 63 0.70
-upstream_cx_tx_bytes_total 15474453 171938.31
-upstream_rq_pending_overflow 129 1.43
-upstream_rq_pending_total 63 0.70
-upstream_rq_total 359871 3998.57
-
-[14:28:59.262084][23][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
-[14:28:59.263795][1][I] Done.
+upstream_cx_http1_total 37 0.41
+upstream_cx_rx_bytes_total 83593237 928810.08
+upstream_cx_total 37 0.41
+upstream_cx_tx_bytes_total 22896339 254402.76
+upstream_rq_pending_overflow 363 4.03
+upstream_rq_pending_total 37 0.41
+upstream_rq_total 532473 5916.34
+
+[09:53:50.184479][19][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[09:53:55.185619][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[09:54:00.186411][23][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[09:54:00.187569][1][I] Done.
```
@@ -303,88 +341,104 @@ upstream_rq_total 359871 3998.57
scale-up-httproutes-300
```plaintext
-[2024-06-25 14:32:23.491][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override.
-[14:32:23.491963][1][I] Detected 4 (v)CPUs with affinity..
-[14:32:23.491978][1][I] Starting 4 threads / event loops. Time limit: 90 seconds.
-[14:32:23.491980][1][I] Global targets: 400 connections and 4000 calls per second.
-[14:32:23.491981][1][I] (Per-worker targets: 100 connections and 1000 calls per second)
-[14:33:54.193887][18][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9999888888891 per second.)
-[14:33:54.194133][19][I] Stopping after 89999 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 1000.0000222222228 per second.)
-[14:33:54.194387][21][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9999888888891 per second.)
-[14:33:54.194633][23][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 1000 per second.)
-[14:33:54.712898][1][I] Done.
+Warning: 30 09:57:17.615][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override.
+[09:57:17.615763][1][I] Detected 4 (v)CPUs with affinity..
+[09:57:17.615775][1][I] Starting 4 threads / event loops. Time limit: 90 seconds.
+[09:57:17.615778][1][I] Global targets: 400 connections and 40000 calls per second.
+[09:57:17.615779][1][I] (Per-worker targets: 100 connections and 10000 calls per second)
+[09:58:48.317519][18][I] Stopping after 90000 ms. Initiated: 141701 / Completed: 141691. (Completion rate was 1574.3439371558425 per second.)
+[09:58:48.317519][19][I] Stopping after 90000 ms. Initiated: 142076 / Completed: 142066. (Completion rate was 1578.5110584940758 per second.)
+[09:58:48.317557][21][I] Stopping after 90000 ms. Initiated: 169359 / Completed: 169346. (Completion rate was 1881.6218249909482 per second.)
+[09:58:48.317726][23][I] Stopping after 90000 ms. Initiated: 73891 / Completed: 73887. (Completion rate was 820.9651798075076 per second.)
+[09:58:53.963287][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
Nighthawk - A layer 7 protocol benchmarking tool.
-benchmark_http_client.latency_2xx (359845 samples)
- min: 0s 000ms 302us | mean: 0s 000ms 507us | max: 0s 019ms 987us | pstdev: 0s 000ms 380us
+benchmark_http_client.latency_2xx (526627 samples)
+ min: 0s 000ms 368us | mean: 0s 006ms 116us | max: 0s 085ms 676us | pstdev: 0s 012ms 060us
Percentile Count Value
- 0.5 179931 0s 000ms 440us
- 0.75 269886 0s 000ms 512us
- 0.8 287876 0s 000ms 533us
- 0.9 323864 0s 000ms 637us
- 0.95 341854 0s 000ms 734us
- 0.990625 356472 0s 001ms 469us
- 0.99902344 359494 0s 006ms 259us
+ 0.5 263331 0s 002ms 692us
+ 0.75 394974 0s 004ms 203us
+ 0.8 421305 0s 004ms 735us
+ 0.9 473966 0s 007ms 143us
+ 0.95 500299 0s 048ms 519us
+ 0.990625 521693 0s 055ms 746us
+ 0.99902344 526114 0s 062ms 912us
-Queueing and connection setup latency (359845 samples)
- min: 0s 000ms 001us | mean: 0s 000ms 011us | max: 0s 017ms 634us | pstdev: 0s 000ms 043us
+Queueing and connection setup latency (526664 samples)
+ min: 0s 000ms 001us | mean: 0s 000ms 012us | max: 0s 019ms 310us | pstdev: 0s 000ms 136us
Percentile Count Value
- 0.5 180160 0s 000ms 010us
- 0.75 270791 0s 000ms 010us
- 0.8 287918 0s 000ms 011us
- 0.9 324365 0s 000ms 011us
- 0.95 341940 0s 000ms 011us
- 0.990625 356473 0s 000ms 027us
- 0.99902344 359494 0s 000ms 167us
+ 0.5 263616 0s 000ms 003us
+ 0.75 395207 0s 000ms 008us
+ 0.8 421679 0s 000ms 009us
+ 0.9 474013 0s 000ms 009us
+ 0.95 500359 0s 000ms 010us
+ 0.990625 521727 0s 000ms 127us
+ 0.99902344 526150 0s 001ms 624us
-Request start to response end (359845 samples)
- min: 0s 000ms 302us | mean: 0s 000ms 506us | max: 0s 019ms 987us | pstdev: 0s 000ms 380us
+Request start to response end (526627 samples)
+ min: 0s 000ms 368us | mean: 0s 006ms 116us | max: 0s 085ms 676us | pstdev: 0s 012ms 060us
Percentile Count Value
- 0.5 179923 0s 000ms 440us
- 0.75 269893 0s 000ms 511us
- 0.8 287905 0s 000ms 533us
- 0.9 323861 0s 000ms 636us
- 0.95 341854 0s 000ms 733us
- 0.990625 356472 0s 001ms 468us
- 0.99902344 359494 0s 006ms 259us
+ 0.5 263324 0s 002ms 692us
+ 0.75 394984 0s 004ms 203us
+ 0.8 421305 0s 004ms 734us
+ 0.9 473966 0s 007ms 142us
+ 0.95 500299 0s 048ms 519us
+ 0.990625 521693 0s 055ms 746us
+ 0.99902344 526113 0s 062ms 910us
-Response body size in bytes (359845 samples)
+Response body size in bytes (526627 samples)
min: 10 | mean: 10 | max: 10 | pstdev: 0
-Response header size in bytes (359845 samples)
+Response header size in bytes (526627 samples)
min: 110 | mean: 110 | max: 110 | pstdev: 0
-Initiation to completion (360000 samples)
- min: 0s 000ms 007us | mean: 0s 000ms 525us | max: 0s 020ms 035us | pstdev: 0s 000ms 409us
+Blocking. Results are skewed when significant numbers are reported here. (178472 samples)
+ min: 0s 000ms 034us | mean: 0s 002ms 016us | max: 0s 085ms 700us | pstdev: 0s 006ms 753us
+
+ Percentile Count Value
+ 0.5 89237 0s 000ms 732us
+ 0.75 133855 0s 001ms 469us
+ 0.8 142779 0s 001ms 727us
+ 0.9 160630 0s 002ms 687us
+ 0.95 169550 0s 004ms 042us
+ 0.990625 176799 0s 048ms 060us
+ 0.99902344 178298 0s 054ms 435us
+
+Initiation to completion (526990 samples)
+ min: 0s 000ms 004us | mean: 0s 006ms 174us | max: 0s 085ms 700us | pstdev: 0s 012ms 062us
Percentile Count Value
- 0.5 180011 0s 000ms 456us
- 0.75 270028 0s 000ms 529us
- 0.8 288004 0s 000ms 550us
- 0.9 324006 0s 000ms 656us
- 0.95 342005 0s 000ms 751us
- 0.990625 356625 0s 001ms 525us
- 0.99902344 359649 0s 006ms 569us
+ 0.5 263496 0s 002ms 745us
+ 0.75 395254 0s 004ms 278us
+ 0.8 421594 0s 004ms 818us
+ 0.9 474295 0s 007ms 277us
+ 0.95 500644 0s 048ms 537us
+ 0.990625 522050 0s 055ms 818us
+ 0.99902344 526476 0s 062ms 992us
Counter Value Per second
-benchmark.http_2xx 359845 3998.28
-benchmark.pool_overflow 155 1.72
+benchmark.http_2xx 526627 5851.41
+benchmark.pool_overflow 363 4.03
cluster_manager.cluster_added 4 0.04
default.total_match_count 4 0.04
membership_change 4 0.04
runtime.load_success 1 0.01
runtime.override_dir_not_exists 1 0.01
-upstream_cx_http1_total 62 0.69
-upstream_cx_rx_bytes_total 56495665 627729.61
-upstream_cx_total 62 0.69
-upstream_cx_tx_bytes_total 15473335 171925.94
-upstream_rq_pending_overflow 155 1.72
-upstream_rq_pending_total 62 0.69
-upstream_rq_total 359845 3998.28
-
+upstream_cx_http1_total 37 0.41
+upstream_cx_rx_bytes_total 82680439 918671.00
+upstream_cx_total 37 0.41
+upstream_cx_tx_bytes_total 22646552 251628.21
+upstream_rq_pending_overflow 363 4.03
+upstream_rq_pending_total 37 0.41
+upstream_rq_total 526664 5851.82
+
+[09:58:58.964269][19][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[09:59:03.965258][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[09:59:08.966199][23][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[09:59:08.967339][1][I] Done.
```
@@ -394,92 +448,104 @@ upstream_rq_total 359845 3998.28
scale-up-httproutes-500
```plaintext
-[2024-06-25 14:38:43.691][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override.
-[14:38:43.691938][1][I] Detected 4 (v)CPUs with affinity..
-[14:38:43.691951][1][I] Starting 4 threads / event loops. Time limit: 90 seconds.
-[14:38:43.691953][1][I] Global targets: 400 connections and 4000 calls per second.
-[14:38:43.691954][1][I] (Per-worker targets: 100 connections and 1000 calls per second)
-[14:40:14.393764][18][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 89999. (Completion rate was 999.9885666703507 per second.)
-[14:40:14.393981][19][I] Stopping after 89999 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 1000.0000555555587 per second.)
-[14:40:14.394312][21][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9992666672044 per second.)
-[14:40:14.394484][23][I] Stopping after 89999 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 1000.0000333333344 per second.)
-[14:40:19.954533][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+Warning: 30 10:05:50.181][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override.
+[10:05:50.182352][1][I] Detected 4 (v)CPUs with affinity..
+[10:05:50.182365][1][I] Starting 4 threads / event loops. Time limit: 90 seconds.
+[10:05:50.182367][1][I] Global targets: 400 connections and 40000 calls per second.
+[10:05:50.182369][1][I] (Per-worker targets: 100 connections and 10000 calls per second)
+[10:07:20.884276][21][I] Stopping after 90000 ms. Initiated: 93542 / Completed: 93539. (Completion rate was 1039.3210789690352 per second.)
+[10:07:20.884582][19][I] Stopping after 90000 ms. Initiated: 180072 / Completed: 180060. (Completion rate was 2000.6570635127619 per second.)
+[10:07:20.884601][18][I] Stopping after 90000 ms. Initiated: 101770 / Completed: 101764. (Completion rate was 1130.7051560639559 per second.)
+[10:07:20.884602][23][I] Stopping after 90000 ms. Initiated: 140594 / Completed: 140587. (Completion rate was 1562.0708005282022 per second.)
+[10:07:26.528168][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
Nighthawk - A layer 7 protocol benchmarking tool.
-benchmark_http_client.latency_2xx (359743 samples)
- min: 0s 000ms 311us | mean: 0s 000ms 566us | max: 0s 064ms 673us | pstdev: 0s 001ms 003us
+benchmark_http_client.latency_2xx (515587 samples)
+ min: 0s 000ms 352us | mean: 0s 006ms 243us | max: 0s 103ms 198us | pstdev: 0s 012ms 343us
Percentile Count Value
- 0.5 179890 0s 000ms 441us
- 0.75 269813 0s 000ms 519us
- 0.8 287802 0s 000ms 544us
- 0.9 323771 0s 000ms 684us
- 0.95 341757 0s 000ms 790us
- 0.990625 356372 0s 002ms 465us
- 0.99902344 359392 0s 016ms 404us
+ 0.5 257799 0s 002ms 698us
+ 0.75 386691 0s 004ms 155us
+ 0.8 412474 0s 004ms 697us
+ 0.9 464029 0s 007ms 193us
+ 0.95 489815 0s 048ms 922us
+ 0.990625 510755 0s 056ms 528us
+ 0.99902344 515084 0s 067ms 747us
-Queueing and connection setup latency (359744 samples)
- min: 0s 000ms 001us | mean: 0s 000ms 011us | max: 0s 040ms 116us | pstdev: 0s 000ms 093us
+Queueing and connection setup latency (515615 samples)
+ min: 0s 000ms 001us | mean: 0s 000ms 012us | max: 0s 020ms 386us | pstdev: 0s 000ms 125us
Percentile Count Value
- 0.5 180015 0s 000ms 010us
- 0.75 269817 0s 000ms 011us
- 0.8 288758 0s 000ms 011us
- 0.9 324218 0s 000ms 011us
- 0.95 341791 0s 000ms 012us
- 0.990625 356372 0s 000ms 029us
- 0.99902344 359393 0s 000ms 172us
+ 0.5 258414 0s 000ms 003us
+ 0.75 386829 0s 000ms 008us
+ 0.8 412620 0s 000ms 009us
+ 0.9 464074 0s 000ms 009us
+ 0.95 489886 0s 000ms 010us
+ 0.990625 510782 0s 000ms 123us
+ 0.99902344 515112 0s 001ms 602us
-Request start to response end (359743 samples)
- min: 0s 000ms 311us | mean: 0s 000ms 566us | max: 0s 064ms 673us | pstdev: 0s 001ms 003us
+Request start to response end (515587 samples)
+ min: 0s 000ms 352us | mean: 0s 006ms 243us | max: 0s 103ms 194us | pstdev: 0s 012ms 343us
Percentile Count Value
- 0.5 179874 0s 000ms 441us
- 0.75 269820 0s 000ms 519us
- 0.8 287800 0s 000ms 544us
- 0.9 323772 0s 000ms 684us
- 0.95 341758 0s 000ms 790us
- 0.990625 356372 0s 002ms 464us
- 0.99902344 359392 0s 016ms 404us
+ 0.5 257802 0s 002ms 698us
+ 0.75 386698 0s 004ms 155us
+ 0.8 412470 0s 004ms 697us
+ 0.9 464031 0s 007ms 192us
+ 0.95 489808 0s 048ms 920us
+ 0.990625 510756 0s 056ms 528us
+ 0.99902344 515084 0s 067ms 747us
-Response body size in bytes (359743 samples)
+Response body size in bytes (515587 samples)
min: 10 | mean: 10 | max: 10 | pstdev: 0
-Response header size in bytes (359743 samples)
+Response header size in bytes (515587 samples)
min: 110 | mean: 110 | max: 110 | pstdev: 0
-Blocking. Results are skewed when significant numbers are reported here. (1 samples)
- min: 0s 001ms 331us | mean: 0s 001ms 331us | max: 0s 001ms 331us | pstdev: 0s 000ms 000us
+Blocking. Results are skewed when significant numbers are reported here. (165055 samples)
+ min: 0s 000ms 036us | mean: 0s 002ms 180us | max: 0s 090ms 710us | pstdev: 0s 007ms 128us
+
+ Percentile Count Value
+ 0.5 82528 0s 000ms 765us
+ 0.75 123792 0s 001ms 622us
+ 0.8 132045 0s 001ms 906us
+ 0.9 148550 0s 002ms 915us
+ 0.95 156804 0s 004ms 402us
+ 0.990625 163510 0s 048ms 775us
+ 0.99902344 164894 0s 058ms 019us
-Initiation to completion (359999 samples)
- min: 0s 000ms 005us | mean: 0s 000ms 593us | max: 0s 064ms 710us | pstdev: 0s 001ms 145us
+Initiation to completion (515950 samples)
+ min: 0s 000ms 004us | mean: 0s 006ms 300us | max: 0s 103ms 215us | pstdev: 0s 012ms 342us
Percentile Count Value
- 0.5 180029 0s 000ms 458us
- 0.75 270014 0s 000ms 537us
- 0.8 288011 0s 000ms 562us
- 0.9 324008 0s 000ms 703us
- 0.95 342000 0s 000ms 813us
- 0.990625 356625 0s 002ms 640us
- 0.99902344 359648 0s 018ms 319us
+ 0.5 257987 0s 002ms 750us
+ 0.75 386970 0s 004ms 235us
+ 0.8 412760 0s 004ms 784us
+ 0.9 464357 0s 007ms 323us
+ 0.95 490153 0s 048ms 945us
+ 0.990625 511115 0s 056ms 580us
+ 0.99902344 515447 0s 067ms 813us
Counter Value Per second
-benchmark.http_2xx 359743 3997.14
-benchmark.pool_overflow 256 2.84
+benchmark.http_2xx 515587 5728.72
+benchmark.pool_overflow 363 4.03
cluster_manager.cluster_added 4 0.04
default.total_match_count 4 0.04
membership_change 4 0.04
runtime.load_success 1 0.01
runtime.override_dir_not_exists 1 0.01
-upstream_cx_http1_total 96 1.07
-upstream_cx_rx_bytes_total 56479651 627551.52
-upstream_cx_total 96 1.07
-upstream_cx_tx_bytes_total 15468992 171877.65
-upstream_rq_pending_overflow 256 2.84
-upstream_rq_pending_total 96 1.07
-upstream_rq_total 359744 3997.15
-
-[14:40:19.962562][1][I] Done.
+upstream_cx_http1_total 37 0.41
+upstream_cx_rx_bytes_total 80947159 899409.36
+upstream_cx_total 37 0.41
+upstream_cx_tx_bytes_total 22171445 246348.42
+upstream_rq_pending_overflow 363 4.03
+upstream_rq_pending_total 37 0.41
+upstream_rq_total 515615 5729.03
+
+[10:07:31.529027][19][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[10:07:36.530025][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[10:07:41.530832][23][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[10:07:41.532165][1][I] Done.
```
@@ -489,101 +555,103 @@ upstream_rq_total 359744 3997.15
scale-down-httproutes-300
```plaintext
-[2024-06-25 14:40:47.629][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override.
-[14:40:47.629688][1][I] Detected 4 (v)CPUs with affinity..
-[14:40:47.629700][1][I] Starting 4 threads / event loops. Time limit: 90 seconds.
-[14:40:47.629703][1][I] Global targets: 400 connections and 4000 calls per second.
-[14:40:47.629704][1][I] (Per-worker targets: 100 connections and 1000 calls per second)
-[14:42:18.331523][18][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9990222231783 per second.)
-[14:42:18.331681][19][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9999777777783 per second.)
-[14:42:18.331935][21][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 89999. (Completion rate was 999.988855555927 per second.)
-[14:42:18.332255][23][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.999166667361 per second.)
-[14:42:23.961708][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+Warning: 30 10:08:14.153][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override.
+[10:08:14.154484][1][I] Detected 4 (v)CPUs with affinity..
+[10:08:14.154499][1][I] Starting 4 threads / event loops. Time limit: 90 seconds.
+[10:08:14.154502][1][I] Global targets: 400 connections and 40000 calls per second.
+[10:08:14.154504][1][I] (Per-worker targets: 100 connections and 10000 calls per second)
+[10:09:44.857305][21][I] Stopping after 90000 ms. Initiated: 120108 / Completed: 120100. (Completion rate was 1334.4432137912584 per second.)
+[10:09:44.857423][23][I] Stopping after 90000 ms. Initiated: 54818 / Completed: 54817. (Completion rate was 609.0765799271705 per second.)
+[10:09:44.857655][18][I] Stopping after 90000 ms. Initiated: 191822 / Completed: 191822. (Completion rate was 2131.3440462977055 per second.)
+[10:09:44.858450][19][I] Stopping after 90001 ms. Initiated: 150329 / Completed: 150327. (Completion rate was 1670.2767089192257 per second.)
+[10:09:50.501933][19][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
Nighthawk - A layer 7 protocol benchmarking tool.
-benchmark_http_client.latency_2xx (359722 samples)
- min: 0s 000ms 303us | mean: 0s 001ms 203us | max: 0s 121ms 311us | pstdev: 0s 006ms 029us
+benchmark_http_client.latency_2xx (516703 samples)
+ min: 0s 000ms 339us | mean: 0s 006ms 221us | max: 0s 096ms 722us | pstdev: 0s 011ms 937us
Percentile Count Value
- 0.5 179885 0s 000ms 456us
- 0.75 269810 0s 000ms 543us
- 0.8 287781 0s 000ms 570us
- 0.9 323750 0s 000ms 749us
- 0.95 341736 0s 001ms 344us
- 0.990625 356350 0s 016ms 743us
- 0.99902344 359371 0s 083ms 783us
+ 0.5 258358 0s 002ms 750us
+ 0.75 387543 0s 004ms 382us
+ 0.8 413372 0s 004ms 969us
+ 0.9 465035 0s 007ms 728us
+ 0.95 490869 0s 047ms 640us
+ 0.990625 511859 0s 055ms 703us
+ 0.99902344 516199 0s 065ms 038us
-Queueing and connection setup latency (359723 samples)
- min: 0s 000ms 001us | mean: 0s 000ms 012us | max: 0s 041ms 897us | pstdev: 0s 000ms 131us
+Queueing and connection setup latency (516714 samples)
+ min: 0s 000ms 001us | mean: 0s 000ms 012us | max: 0s 019ms 922us | pstdev: 0s 000ms 135us
Percentile Count Value
- 0.5 179921 0s 000ms 010us
- 0.75 270953 0s 000ms 011us
- 0.8 288381 0s 000ms 011us
- 0.9 323867 0s 000ms 011us
- 0.95 341759 0s 000ms 012us
- 0.990625 356351 0s 000ms 032us
- 0.99902344 359372 0s 000ms 206us
+ 0.5 259348 0s 000ms 003us
+ 0.75 387676 0s 000ms 008us
+ 0.8 413511 0s 000ms 009us
+ 0.9 465475 0s 000ms 009us
+ 0.95 490880 0s 000ms 010us
+ 0.990625 511870 0s 000ms 042us
+ 0.99902344 516210 0s 001ms 596us
-Request start to response end (359722 samples)
- min: 0s 000ms 302us | mean: 0s 001ms 202us | max: 0s 121ms 311us | pstdev: 0s 006ms 029us
+Request start to response end (516703 samples)
+ min: 0s 000ms 339us | mean: 0s 006ms 221us | max: 0s 096ms 722us | pstdev: 0s 011ms 937us
Percentile Count Value
- 0.5 179877 0s 000ms 456us
- 0.75 269810 0s 000ms 542us
- 0.8 287783 0s 000ms 570us
- 0.9 323752 0s 000ms 748us
- 0.95 341736 0s 001ms 344us
- 0.990625 356350 0s 016ms 742us
- 0.99902344 359371 0s 083ms 783us
+ 0.5 258360 0s 002ms 750us
+ 0.75 387541 0s 004ms 382us
+ 0.8 413365 0s 004ms 968us
+ 0.9 465034 0s 007ms 726us
+ 0.95 490870 0s 047ms 640us
+ 0.990625 511859 0s 055ms 703us
+ 0.99902344 516199 0s 065ms 038us
-Response body size in bytes (359722 samples)
+Response body size in bytes (516703 samples)
min: 10 | mean: 10 | max: 10 | pstdev: 0
-Response header size in bytes (359722 samples)
+Response header size in bytes (516703 samples)
min: 110 | mean: 110 | max: 110 | pstdev: 0
-Blocking. Results are skewed when significant numbers are reported here. (1022 samples)
- min: 0s 000ms 045us | mean: 0s 006ms 403us | max: 0s 099ms 049us | pstdev: 0s 015ms 130us
+Blocking. Results are skewed when significant numbers are reported here. (170680 samples)
+ min: 0s 000ms 034us | mean: 0s 002ms 108us | max: 0s 090ms 091us | pstdev: 0s 006ms 769us
Percentile Count Value
- 0.5 511 0s 001ms 012us
- 0.75 767 0s 003ms 262us
- 0.8 818 0s 004ms 782us
- 0.9 920 0s 015ms 482us
- 0.95 971 0s 047ms 316us
- 0.990625 1013 0s 075ms 657us
- 0.99902344 1022 0s 099ms 049us
+ 0.5 85340 0s 000ms 756us
+ 0.75 128013 0s 001ms 581us
+ 0.8 136546 0s 001ms 864us
+ 0.9 153612 0s 002ms 914us
+ 0.95 162148 0s 004ms 492us
+ 0.990625 169080 0s 047ms 810us
+ 0.99902344 170514 0s 055ms 848us
-Initiation to completion (359999 samples)
- min: 0s 000ms 002us | mean: 0s 001ms 224us | max: 0s 121ms 405us | pstdev: 0s 006ms 041us
+Initiation to completion (517066 samples)
+ min: 0s 000ms 003us | mean: 0s 006ms 281us | max: 0s 096ms 731us | pstdev: 0s 011ms 939us
Percentile Count Value
- 0.5 180002 0s 000ms 473us
- 0.75 270009 0s 000ms 560us
- 0.8 288002 0s 000ms 589us
- 0.9 324002 0s 000ms 770us
- 0.95 342001 0s 001ms 390us
- 0.990625 356625 0s 017ms 278us
- 0.99902344 359648 0s 083ms 849us
+ 0.5 258539 0s 002ms 805us
+ 0.75 387802 0s 004ms 465us
+ 0.8 413664 0s 005ms 058us
+ 0.9 465360 0s 007ms 867us
+ 0.95 491214 0s 047ms 654us
+ 0.990625 512220 0s 055ms 760us
+ 0.99902344 516562 0s 065ms 097us
Counter Value Per second
-benchmark.http_2xx 359722 3996.91
-benchmark.pool_overflow 277 3.08
+benchmark.http_2xx 516703 5741.11
+benchmark.pool_overflow 363 4.03
cluster_manager.cluster_added 4 0.04
default.total_match_count 4 0.04
membership_change 4 0.04
runtime.load_success 1 0.01
runtime.override_dir_not_exists 1 0.01
-upstream_cx_http1_total 123 1.37
-upstream_cx_rx_bytes_total 56476354 627514.75
-upstream_cx_total 123 1.37
-upstream_cx_tx_bytes_total 15468089 171867.57
-upstream_rq_pending_overflow 277 3.08
-upstream_rq_pending_total 123 1.37
-upstream_rq_total 359723 3996.92
-
-[14:42:23.965353][1][I] Done.
+upstream_cx_http1_total 37 0.41
+upstream_cx_rx_bytes_total 81122371 901354.66
+upstream_cx_total 37 0.41
+upstream_cx_tx_bytes_total 22218702 246873.09
+upstream_rq_pending_overflow 363 4.03
+upstream_rq_pending_total 37 0.41
+upstream_rq_total 516714 5741.23
+
+[10:09:55.503051][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[10:10:00.503918][23][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[10:10:00.505088][1][I] Done.
```
@@ -593,102 +661,104 @@ upstream_rq_total 359723 3996.92
scale-down-httproutes-100
```plaintext
-[2024-06-25 14:42:41.429][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override.
-[14:42:41.430321][1][I] Detected 4 (v)CPUs with affinity..
-[14:42:41.430334][1][I] Starting 4 threads / event loops. Time limit: 90 seconds.
-[14:42:41.430336][1][I] Global targets: 400 connections and 4000 calls per second.
-[14:42:41.430338][1][I] (Per-worker targets: 100 connections and 1000 calls per second)
-[14:44:12.132884][18][I] Stopping after 89999 ms. Initiated: 90000 / Completed: 89996. (Completion rate was 999.9555777767906 per second.)
-[14:44:12.133405][21][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.999777777827 per second.)
-[14:44:12.133681][23][I] Stopping after 90000 ms. Initiated: 89995 / Completed: 89995. (Completion rate was 999.9439111410252 per second.)
-[14:44:12.138437][19][I] Stopping after 90005 ms. Initiated: 89979 / Completed: 89958. (Completion rate was 999.474453182769 per second.)
-[14:44:17.976650][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+Warning: 30 10:10:18.056][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override.
+[10:10:18.057130][1][I] Detected 4 (v)CPUs with affinity..
+[10:10:18.057143][1][I] Starting 4 threads / event loops. Time limit: 90 seconds.
+[10:10:18.057145][1][I] Global targets: 400 connections and 40000 calls per second.
+[10:10:18.057147][1][I] (Per-worker targets: 100 connections and 10000 calls per second)
+[10:11:48.759104][18][I] Stopping after 90000 ms. Initiated: 209011 / Completed: 208988. (Completion rate was 2322.087186024952 per second.)
+[10:11:48.759212][21][I] Stopping after 90000 ms. Initiated: 49528 / Completed: 49526. (Completion rate was 550.2881062569155 per second.)
+[10:11:48.759225][19][I] Stopping after 90000 ms. Initiated: 82374 / Completed: 82369. (Completion rate was 915.2096671136363 per second.)
+[10:11:48.759235][22][I] Stopping after 90000 ms. Initiated: 83103 / Completed: 83098. (Completion rate was 923.3098082183817 per second.)
+[10:11:54.582462][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
Nighthawk - A layer 7 protocol benchmarking tool.
-benchmark_http_client.latency_2xx (359649 samples)
- min: 0s 000ms 297us | mean: 0s 009ms 493us | max: 0s 163ms 553us | pstdev: 0s 017ms 560us
+benchmark_http_client.latency_2xx (423617 samples)
+ min: 0s 000ms 341us | mean: 0s 007ms 208us | max: 0s 137ms 691us | pstdev: 0s 011ms 926us
Percentile Count Value
- 0.5 179826 0s 002ms 042us
- 0.75 269740 0s 008ms 322us
- 0.8 287721 0s 011ms 606us
- 0.9 323685 0s 030ms 779us
- 0.95 341667 0s 054ms 808us
- 0.990625 356278 0s 079ms 679us
- 0.99902344 359299 0s 106ms 098us
+ 0.5 211815 0s 003ms 194us
+ 0.75 317722 0s 006ms 279us
+ 0.8 338894 0s 007ms 606us
+ 0.9 381256 0s 016ms 511us
+ 0.95 402437 0s 035ms 002us
+ 0.990625 419646 0s 062ms 793us
+ 0.99902344 423204 0s 082ms 636us
-Queueing and connection setup latency (359674 samples)
- min: 0s 000ms 001us | mean: 0s 000ms 015us | max: 0s 033ms 947us | pstdev: 0s 000ms 269us
+Queueing and connection setup latency (423652 samples)
+ min: 0s 000ms 001us | mean: 0s 000ms 014us | max: 0s 035ms 192us | pstdev: 0s 000ms 210us
Percentile Count Value
- 0.5 179931 0s 000ms 008us
- 0.75 269789 0s 000ms 010us
- 0.8 287838 0s 000ms 011us
- 0.9 323819 0s 000ms 011us
- 0.95 341697 0s 000ms 015us
- 0.990625 356303 0s 000ms 059us
- 0.99902344 359323 0s 001ms 303us
+ 0.5 212529 0s 000ms 003us
+ 0.75 317890 0s 000ms 008us
+ 0.8 339187 0s 000ms 009us
+ 0.9 381367 0s 000ms 009us
+ 0.95 402534 0s 000ms 011us
+ 0.990625 419681 0s 000ms 121us
+ 0.99902344 423239 0s 001ms 867us
-Request start to response end (359649 samples)
- min: 0s 000ms 296us | mean: 0s 009ms 493us | max: 0s 163ms 553us | pstdev: 0s 017ms 560us
+Request start to response end (423617 samples)
+ min: 0s 000ms 341us | mean: 0s 007ms 207us | max: 0s 137ms 691us | pstdev: 0s 011ms 926us
Percentile Count Value
- 0.5 179829 0s 002ms 041us
- 0.75 269740 0s 008ms 321us
- 0.8 287722 0s 011ms 606us
- 0.9 323687 0s 030ms 779us
- 0.95 341667 0s 054ms 808us
- 0.990625 356278 0s 079ms 679us
- 0.99902344 359299 0s 106ms 098us
+ 0.5 211809 0s 003ms 194us
+ 0.75 317719 0s 006ms 279us
+ 0.8 338894 0s 007ms 606us
+ 0.9 381256 0s 016ms 510us
+ 0.95 402437 0s 035ms 002us
+ 0.990625 419646 0s 062ms 793us
+ 0.99902344 423204 0s 082ms 636us
-Response body size in bytes (359649 samples)
+Response body size in bytes (423617 samples)
min: 10 | mean: 10 | max: 10 | pstdev: 0
-Response header size in bytes (359649 samples)
+Response header size in bytes (423617 samples)
min: 110 | mean: 110 | max: 110 | pstdev: 0
-Blocking. Results are skewed when significant numbers are reported here. (19052 samples)
- min: 0s 000ms 039us | mean: 0s 006ms 142us | max: 0s 146ms 767us | pstdev: 0s 012ms 746us
+Blocking. Results are skewed when significant numbers are reported here. (142751 samples)
+ min: 0s 000ms 035us | mean: 0s 002ms 521us | max: 0s 105ms 373us | pstdev: 0s 006ms 732us
Percentile Count Value
- 0.5 9526 0s 001ms 273us
- 0.75 14289 0s 004ms 540us
- 0.8 15242 0s 006ms 354us
- 0.9 17147 0s 018ms 240us
- 0.95 18100 0s 036ms 243us
- 0.990625 18874 0s 063ms 096us
- 0.99902344 19034 0s 087ms 937us
+ 0.5 71376 0s 000ms 888us
+ 0.75 107064 0s 001ms 861us
+ 0.8 114202 0s 002ms 248us
+ 0.9 128476 0s 004ms 006us
+ 0.95 135614 0s 008ms 008us
+ 0.990625 141413 0s 041ms 697us
+ 0.99902344 142612 0s 064ms 958us
-Initiation to completion (359949 samples)
- min: 0s 000ms 006us | mean: 0s 009ms 592us | max: 0s 163ms 594us | pstdev: 0s 017ms 643us
+Initiation to completion (423981 samples)
+ min: 0s 000ms 005us | mean: 0s 007ms 283us | max: 0s 137ms 756us | pstdev: 0s 011ms 948us
Percentile Count Value
- 0.5 179976 0s 002ms 093us
- 0.75 269962 0s 008ms 477us
- 0.8 287962 0s 011ms 824us
- 0.9 323955 0s 030ms 991us
- 0.95 341957 0s 055ms 142us
- 0.990625 356578 0s 080ms 228us
- 0.99902344 359598 0s 106ms 164us
+ 0.5 211995 0s 003ms 260us
+ 0.75 317989 0s 006ms 396us
+ 0.8 339189 0s 007ms 761us
+ 0.9 381583 0s 016ms 687us
+ 0.95 402787 0s 035ms 110us
+ 0.990625 420007 0s 062ms 932us
+ 0.99902344 423567 0s 082ms 649us
Counter Value Per second
-benchmark.http_2xx 359649 3996.04
-benchmark.pool_overflow 300 3.33
+benchmark.http_2xx 423617 4706.85
+benchmark.pool_overflow 364 4.04
cluster_manager.cluster_added 4 0.04
default.total_match_count 4 0.04
membership_change 4 0.04
runtime.load_success 1 0.01
runtime.override_dir_not_exists 1 0.01
-upstream_cx_http1_total 100 1.11
-upstream_cx_rx_bytes_total 56464893 627378.34
-upstream_cx_total 100 1.11
-upstream_cx_tx_bytes_total 15465939 171841.20
-upstream_rq_pending_overflow 300 3.33
-upstream_rq_pending_total 100 1.11
-upstream_rq_total 359674 3996.32
-
-[14:44:22.981221][19][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
-[14:44:22.985214][1][I] Done.
+upstream_cx_http1_total 36 0.40
+upstream_cx_rx_bytes_total 66507869 738975.37
+upstream_cx_total 36 0.40
+upstream_cx_tx_bytes_total 18217036 202411.25
+upstream_rq_pending_overflow 364 4.04
+upstream_rq_pending_total 36 0.40
+upstream_rq_total 423652 4707.24
+
+[10:11:59.584852][19][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[10:12:04.585643][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[10:12:09.586270][22][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[10:12:09.587436][1][I] Done.
```
@@ -698,120 +768,104 @@ upstream_rq_total 359674 3996.32
scale-down-httproutes-50
```plaintext
-[2024-06-25 14:44:35.399][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override.
-[14:44:35.400594][1][I] Detected 4 (v)CPUs with affinity..
-[14:44:35.400604][1][I] Starting 4 threads / event loops. Time limit: 90 seconds.
-[14:44:35.400607][1][I] Global targets: 400 connections and 4000 calls per second.
-[14:44:35.400609][1][I] (Per-worker targets: 100 connections and 1000 calls per second)
-[14:45:50.873708][19][E] Exiting due to failing termination predicate
-[14:45:50.873747][19][I] Stopping after 74767 ms. Initiated: 74767 / Completed: 74746. (Completion rate was 999.716774109537 per second.)
-[14:45:50.874918][18][E] Exiting due to failing termination predicate
-[14:45:50.875120][18][I] Stopping after 74769 ms. Initiated: 74770 / Completed: 74749. (Completion rate was 999.7209036132042 per second.)
-[14:45:50.878184][20][E] Exiting due to failing termination predicate
-[14:45:50.878203][20][I] Stopping after 74772 ms. Initiated: 74772 / Completed: 74750. (Completion rate was 999.6972288218956 per second.)
-[14:45:50.880264][21][E] Exiting due to failing termination predicate
-[14:45:50.880286][21][I] Stopping after 74773 ms. Initiated: 74774 / Completed: 74747. (Completion rate was 999.6424011911454 per second.)
-[14:45:51.840758][1][E] Terminated early because of a failure predicate.
-[14:45:51.840780][1][I] Check the output for problematic counter values. The default Nighthawk failure predicates report failure if (1) Nighthawk could not connect to the target (see 'benchmark.pool_connection_failure' counter; check the address and port number, and try explicitly setting --address-family v4 or v6, especially when using DNS; instead of localhost try 127.0.0.1 or ::1 explicitly), (2) the protocol was not supported by the target (see 'benchmark.stream_resets' counter; check http/https in the URI, --h2), (3) the target returned a 4xx or 5xx HTTP response code (see 'benchmark.http_4xx' and 'benchmark.http_5xx' counters; check the URI path and the server config), or (4) a custom gRPC RequestSource failed. --failure-predicate can be used to relax expectations.
-[14:45:56.841540][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+Warning: 29 03:03:53.663][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override.
+[03:03:53.664682][1][I] Detected 4 (v)CPUs with affinity..
+[03:03:53.664695][1][I] Starting 4 threads / event loops. Time limit: 30 seconds.
+[03:03:53.664698][1][I] Global targets: 400 connections and 40000 calls per second.
+[03:03:53.664700][1][I] (Per-worker targets: 100 connections and 10000 calls per second)
+[03:04:24.367434][23][I] Stopping after 30000 ms. Initiated: 46577 / Completed: 46567. (Completion rate was 1552.2191046582072 per second.)
+[03:04:24.367829][18][I] Stopping after 30000 ms. Initiated: 42300 / Completed: 42290. (Completion rate was 1409.6315198541051 per second.)
+[03:04:24.368549][21][I] Stopping after 30001 ms. Initiated: 39600 / Completed: 39591. (Completion rate was 1319.637581142412 per second.)
+[03:04:24.367485][19][I] Stopping after 29994 ms. Initiated: 14551 / Completed: 14549. (Completion rate was 485.05192262626696 per second.)
+[03:04:30.226109][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
Nighthawk - A layer 7 protocol benchmarking tool.
-benchmark_http_client.latency_2xx (298738 samples)
- min: 0s 000ms 307us | mean: 0s 011ms 515us | max: 0s 187ms 269us | pstdev: 0s 019ms 783us
-
- Percentile Count Value
- 0.5 149369 0s 002ms 416us
- 0.75 224054 0s 011ms 230us
- 0.8 238992 0s 016ms 571us
- 0.9 268865 0s 041ms 666us
- 0.95 283803 0s 059ms 402us
- 0.990625 295939 0s 085ms 483us
- 0.99902344 298447 0s 120ms 631us
-
-benchmark_http_client.latency_5xx (7 samples)
- min: 0s 000ms 210us | mean: 0s 000ms 884us | max: 0s 001ms 337us | pstdev: 0s 000ms 404us
+benchmark_http_client.latency_2xx (142634 samples)
+ min: 0s 000ms 350us | mean: 0s 007ms 306us | max: 0s 108ms 011us | pstdev: 0s 010ms 777us
Percentile Count Value
- 0.5 4 0s 000ms 683us
- 0.75 6 0s 001ms 309us
- 0.8 6 0s 001ms 309us
+ 0.5 71317 0s 003ms 525us
+ 0.75 106976 0s 006ms 682us
+ 0.8 114108 0s 008ms 188us
+ 0.9 128372 0s 019ms 436us
+ 0.95 135503 0s 031ms 845us
+ 0.990625 141297 0s 055ms 373us
+ 0.99902344 142495 0s 080ms 084us
-Queueing and connection setup latency (298836 samples)
- min: 0s 000ms 001us | mean: 0s 000ms 016us | max: 0s 075ms 845us | pstdev: 0s 000ms 315us
+Queueing and connection setup latency (142665 samples)
+ min: 0s 000ms 001us | mean: 0s 000ms 016us | max: 0s 030ms 452us | pstdev: 0s 000ms 301us
Percentile Count Value
- 0.5 149531 0s 000ms 008us
- 0.75 224310 0s 000ms 010us
- 0.8 239171 0s 000ms 010us
- 0.9 268973 0s 000ms 011us
- 0.95 283896 0s 000ms 016us
- 0.990625 296035 0s 000ms 061us
- 0.99902344 298545 0s 001ms 244us
+ 0.5 71653 0s 000ms 003us
+ 0.75 107071 0s 000ms 008us
+ 0.8 114147 0s 000ms 009us
+ 0.9 128437 0s 000ms 010us
+ 0.95 135540 0s 000ms 011us
+ 0.990625 141328 0s 000ms 076us
+ 0.99902344 142526 0s 002ms 365us
-Request start to response end (298745 samples)
- min: 0s 000ms 210us | mean: 0s 011ms 514us | max: 0s 187ms 269us | pstdev: 0s 019ms 783us
+Request start to response end (142634 samples)
+ min: 0s 000ms 350us | mean: 0s 007ms 305us | max: 0s 108ms 011us | pstdev: 0s 010ms 777us
Percentile Count Value
- 0.5 149373 0s 002ms 415us
- 0.75 224059 0s 011ms 229us
- 0.8 238996 0s 016ms 569us
- 0.9 268871 0s 041ms 664us
- 0.95 283810 0s 059ms 402us
- 0.990625 295946 0s 085ms 483us
- 0.99902344 298454 0s 120ms 631us
+ 0.5 71318 0s 003ms 525us
+ 0.75 106977 0s 006ms 681us
+ 0.8 114108 0s 008ms 187us
+ 0.9 128371 0s 019ms 434us
+ 0.95 135503 0s 031ms 842us
+ 0.990625 141297 0s 055ms 373us
+ 0.99902344 142495 0s 080ms 084us
-Response body size in bytes (298745 samples)
- min: 0 | mean: 9.999765686455003 | max: 10 | pstdev: 0.048405377254271256
+Response body size in bytes (142634 samples)
+ min: 10 | mean: 10 | max: 10 | pstdev: 0
-Response header size in bytes (298745 samples)
- min: 58 | mean: 109.99878156956602 | max: 110 | pstdev: 0.25170796172221055
+Response header size in bytes (142634 samples)
+ min: 110 | mean: 110 | max: 110 | pstdev: 0
-Blocking. Results are skewed when significant numbers are reported here. (8534 samples)
- min: 0s 000ms 040us | mean: 0s 006ms 742us | max: 0s 101ms 433us | pstdev: 0s 012ms 626us
+Blocking. Results are skewed when significant numbers are reported here. (42514 samples)
+ min: 0s 000ms 036us | mean: 0s 002ms 819us | max: 0s 097ms 796us | pstdev: 0s 006ms 582us
Percentile Count Value
- 0.5 4267 0s 001ms 369us
- 0.75 6401 0s 005ms 750us
- 0.8 6828 0s 008ms 406us
- 0.9 7681 0s 022ms 739us
- 0.95 8108 0s 037ms 554us
- 0.990625 8454 0s 058ms 765us
- 0.99902344 8526 0s 078ms 221us
+ 0.5 21257 0s 000ms 979us
+ 0.75 31886 0s 002ms 264us
+ 0.8 34012 0s 002ms 802us
+ 0.9 38263 0s 005ms 232us
+ 0.95 40389 0s 011ms 347us
+ 0.990625 42116 0s 036ms 845us
+ 0.99902344 42473 0s 061ms 714us
-Initiation to completion (298992 samples)
- min: 0s 000ms 005us | mean: 0s 011ms 618us | max: 0s 187ms 277us | pstdev: 0s 019ms 857us
+Initiation to completion (142997 samples)
+ min: 0s 000ms 003us | mean: 0s 007ms 382us | max: 0s 108ms 048us | pstdev: 0s 010ms 803us
Percentile Count Value
- 0.5 149496 0s 002ms 465us
- 0.75 224244 0s 011ms 490us
- 0.8 239195 0s 016ms 867us
- 0.9 269093 0s 041ms 924us
- 0.95 284043 0s 059ms 586us
- 0.990625 296189 0s 085ms 766us
- 0.99902344 298701 0s 120ms 954us
+ 0.5 71499 0s 003ms 591us
+ 0.75 107249 0s 006ms 808us
+ 0.8 114399 0s 008ms 328us
+ 0.9 128698 0s 019ms 615us
+ 0.95 135848 0s 031ms 933us
+ 0.990625 141657 0s 055ms 416us
+ 0.99902344 142858 0s 080ms 097us
Counter Value Per second
-benchmark.http_2xx 298738 3995.38
-benchmark.http_5xx 7 0.09
-benchmark.pool_overflow 247 3.30
-cluster_manager.cluster_added 4 0.05
-default.total_match_count 4 0.05
-membership_change 4 0.05
-runtime.load_success 1 0.01
-runtime.override_dir_not_exists 1 0.01
-sequencer.failed_terminations 4 0.05
-upstream_cx_http1_total 153 2.05
-upstream_cx_rx_bytes_total 46902510 627283.31
-upstream_cx_total 153 2.05
-upstream_cx_tx_bytes_total 12849948 171857.71
-upstream_rq_pending_overflow 247 3.30
-upstream_rq_pending_total 153 2.05
-upstream_rq_total 298836 3996.69
-
-[14:46:01.842997][19][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
-[14:46:06.845068][20][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
-[14:46:11.847277][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
-[14:46:11.850206][1][E] An error occurred.
+benchmark.http_2xx 142634 4754.58
+benchmark.pool_overflow 363 12.10
+cluster_manager.cluster_added 4 0.13
+default.total_match_count 4 0.13
+membership_change 4 0.13
+runtime.load_success 1 0.03
+runtime.override_dir_not_exists 1 0.03
+upstream_cx_http1_total 37 1.23
+upstream_cx_rx_bytes_total 22393538 746468.86
+upstream_cx_total 37 1.23
+upstream_cx_tx_bytes_total 6134595 204491.32
+upstream_rq_pending_overflow 363 12.10
+upstream_rq_pending_total 37 1.23
+upstream_rq_total 142665 4755.61
+
+[03:04:35.227368][19][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[03:04:40.228272][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[03:04:45.229345][23][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[03:04:45.231026][1][I] Done.
```
@@ -821,89 +875,102 @@ upstream_rq_total 298836 3996.69
scale-down-httproutes-10
```plaintext
-[2024-06-25 14:48:06.510][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override.
-[14:48:06.510881][1][I] Detected 4 (v)CPUs with affinity..
-[14:48:06.510893][1][I] Starting 4 threads / event loops. Time limit: 90 seconds.
-[14:48:06.510895][1][I] Global targets: 400 connections and 4000 calls per second.
-[14:48:06.510897][1][I] (Per-worker targets: 100 connections and 1000 calls per second)
-[14:49:37.212970][19][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9998000000401 per second.)
-[14:49:37.213444][21][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9973000072899 per second.)
-[14:49:37.213541][23][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9989777788228 per second.)
-[14:49:37.213971][18][I] Stopping after 90001 ms. Initiated: 89999 / Completed: 89996. (Completion rate was 999.9414452707166 per second.)
+Warning: 30 10:15:03.038][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override.
+[10:15:03.039299][1][I] Detected 4 (v)CPUs with affinity..
+[10:15:03.039310][1][I] Starting 4 threads / event loops. Time limit: 90 seconds.
+[10:15:03.039313][1][I] Global targets: 400 connections and 40000 calls per second.
+[10:15:03.039314][1][I] (Per-worker targets: 100 connections and 10000 calls per second)
+[10:16:33.741189][23][I] Stopping after 90000 ms. Initiated: 258274 / Completed: 258258. (Completion rate was 2869.5316753816987 per second.)
+[10:16:33.741450][18][I] Stopping after 90000 ms. Initiated: 35338 / Completed: 35338. (Completion rate was 392.64273862987994 per second.)
+[10:16:33.741587][21][I] Stopping after 90000 ms. Initiated: 196085 / Completed: 196074. (Completion rate was 2178.588477687607 per second.)
+[10:16:33.742737][19][I] Stopping after 90001 ms. Initiated: 35313 / Completed: 35313. (Completion rate was 392.3594516123065 per second.)
+[10:16:39.388073][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
Nighthawk - A layer 7 protocol benchmarking tool.
-benchmark_http_client.latency_2xx (359809 samples)
- min: 0s 000ms 297us | mean: 0s 000ms 525us | max: 0s 048ms 130us | pstdev: 0s 000ms 466us
+benchmark_http_client.latency_2xx (524619 samples)
+ min: 0s 000ms 363us | mean: 0s 005ms 917us | max: 0s 093ms 347us | pstdev: 0s 011ms 507us
-[14:49:42.728878][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
Percentile Count Value
- 0.5 179925 0s 000ms 450us
- 0.75 269871 0s 000ms 525us
- 0.8 287855 0s 000ms 549us
- 0.9 323830 0s 000ms 661us
- 0.95 341819 0s 000ms 762us
- 0.990625 356436 0s 001ms 585us
- 0.99902344 359458 0s 007ms 084us
+ 0.5 262326 0s 002ms 779us
+ 0.75 393472 0s 004ms 063us
+ 0.8 419697 0s 004ms 496us
+ 0.9 472160 0s 006ms 384us
+ 0.95 498391 0s 046ms 964us
+ 0.990625 519704 0s 054ms 102us
+ 0.99902344 524107 0s 058ms 939us
-Queueing and connection setup latency (359812 samples)
- min: 0s 000ms 002us | mean: 0s 000ms 012us | max: 0s 034ms 091us | pstdev: 0s 000ms 067us
+Queueing and connection setup latency (524646 samples)
+ min: 0s 000ms 001us | mean: 0s 000ms 010us | max: 0s 019ms 046us | pstdev: 0s 000ms 096us
Percentile Count Value
- 0.5 180343 0s 000ms 010us
- 0.75 269955 0s 000ms 011us
- 0.8 288513 0s 000ms 011us
- 0.9 323857 0s 000ms 012us
- 0.95 341824 0s 000ms 023us
- 0.990625 356439 0s 000ms 050us
- 0.99902344 359461 0s 000ms 189us
+ 0.5 262650 0s 000ms 003us
+ 0.75 393534 0s 000ms 008us
+ 0.8 420137 0s 000ms 009us
+ 0.9 472311 0s 000ms 009us
+ 0.95 498511 0s 000ms 011us
+ 0.990625 519728 0s 000ms 076us
+ 0.99902344 524134 0s 001ms 276us
-Request start to response end (359809 samples)
- min: 0s 000ms 297us | mean: 0s 000ms 524us | max: 0s 048ms 130us | pstdev: 0s 000ms 466us
+Request start to response end (524619 samples)
+ min: 0s 000ms 363us | mean: 0s 005ms 917us | max: 0s 093ms 347us | pstdev: 0s 011ms 507us
Percentile Count Value
- 0.5 179906 0s 000ms 450us
- 0.75 269861 0s 000ms 524us
- 0.8 287864 0s 000ms 549us
- 0.9 323829 0s 000ms 661us
- 0.95 341820 0s 000ms 761us
- 0.990625 356436 0s 001ms 585us
- 0.99902344 359458 0s 007ms 083us
+ 0.5 262310 0s 002ms 778us
+ 0.75 393465 0s 004ms 062us
+ 0.8 419696 0s 004ms 496us
+ 0.9 472160 0s 006ms 384us
+ 0.95 498389 0s 046ms 962us
+ 0.990625 519707 0s 054ms 102us
+ 0.99902344 524107 0s 058ms 939us
-Response body size in bytes (359809 samples)
+Response body size in bytes (524619 samples)
min: 10 | mean: 10 | max: 10 | pstdev: 0
-Response header size in bytes (359809 samples)
+Response header size in bytes (524619 samples)
min: 110 | mean: 110 | max: 110 | pstdev: 0
-Initiation to completion (359996 samples)
- min: 0s 000ms 005us | mean: 0s 000ms 543us | max: 0s 048ms 146us | pstdev: 0s 000ms 476us
+Blocking. Results are skewed when significant numbers are reported here. (158918 samples)
+ min: 0s 000ms 034us | mean: 0s 002ms 264us | max: 0s 069ms 718us | pstdev: 0s 007ms 119us
+
+ Percentile Count Value
+ 0.5 79459 0s 000ms 812us
+ 0.75 119189 0s 001ms 826us
+ 0.8 127135 0s 002ms 141us
+ 0.9 143027 0s 003ms 136us
+ 0.95 150973 0s 004ms 425us
+ 0.990625 157429 0s 048ms 680us
+ 0.99902344 158763 0s 055ms 619us
+
+Initiation to completion (524983 samples)
+ min: 0s 000ms 005us | mean: 0s 005ms 969us | max: 0s 093ms 364us | pstdev: 0s 011ms 505us
Percentile Count Value
- 0.5 179999 0s 000ms 468us
- 0.75 269997 0s 000ms 543us
- 0.8 288002 0s 000ms 568us
- 0.9 324002 0s 000ms 683us
- 0.95 341998 0s 000ms 783us
- 0.990625 356622 0s 001ms 632us
- 0.99902344 359645 0s 007ms 247us
+ 0.5 262493 0s 002ms 832us
+ 0.75 393739 0s 004ms 131us
+ 0.8 419987 0s 004ms 571us
+ 0.9 472485 0s 006ms 477us
+ 0.95 498740 0s 046ms 983us
+ 0.990625 520063 0s 054ms 147us
+ 0.99902344 524471 0s 059ms 058us
Counter Value Per second
-benchmark.http_2xx 359809 3997.86
-benchmark.pool_overflow 187 2.08
+benchmark.http_2xx 524619 5829.06
+benchmark.pool_overflow 364 4.04
cluster_manager.cluster_added 4 0.04
default.total_match_count 4 0.04
membership_change 4 0.04
runtime.load_success 1 0.01
runtime.override_dir_not_exists 1 0.01
-upstream_cx_http1_total 66 0.73
-upstream_cx_rx_bytes_total 56490013 627663.98
-upstream_cx_total 66 0.73
-upstream_cx_tx_bytes_total 15471916 171909.40
-upstream_rq_pending_overflow 187 2.08
-upstream_rq_pending_total 66 0.73
-upstream_rq_total 359812 3997.89
+upstream_cx_http1_total 36 0.40
+upstream_cx_rx_bytes_total 82365183 915162.15
+upstream_cx_total 36 0.40
+upstream_cx_tx_bytes_total 22559778 250662.41
+upstream_rq_pending_overflow 364 4.04
+upstream_rq_pending_total 36 0.40
+upstream_rq_total 524646 5829.36
-[14:49:42.732798][1][I] Done.
+[10:16:44.389294][23][I] Wait for the connection pool drain timed out, proceeding to hard shutdown.
+[10:16:44.391101][1][I] Done.
```
@@ -911,15 +978,15 @@ upstream_rq_total 359812 3997.89
### Metrics
-|Benchmark Name |Envoy Gateway Memory (MiB)|Envoy Gateway Total CPU (Seconds)|Envoy Proxy Memory: k5s2s[1] (MiB)|
+|Benchmark Name |Envoy Gateway Memory (MiB)|Envoy Gateway Total CPU (Seconds)|Envoy Proxy Memory: 4lvn5[1] (MiB)|
|- |- |- |- |
-|scale-up-httproutes-10 |76 |0.34 |7 |
-|scale-up-httproutes-50 |114 |1.94 |12 |
-|scale-up-httproutes-100 |195 |10.85 |20 |
-|scale-up-httproutes-300 |1124 |176.36 |81 |
-|scale-up-httproutes-500 |1588 |16.69 |190 |
-|scale-down-httproutes-300|661 |6.04 |87 |
-|scale-down-httproutes-100|679 |104.73 |95 |
-|scale-down-httproutes-50 |143 |172.84 |53 |
-|scale-down-httproutes-10 |118 |174.16 |18 |
-1. envoy-gateway-system/envoy-benchmark-test-benchmark-0520098c-7668c94dd5-k5s2s
+|scale-up-httproutes-10 |78 |0.39 |7 |
+|scale-up-httproutes-50 |87 |1.87 |11 |
+|scale-up-httproutes-100 |167 |8.9 |20 |
+|scale-up-httproutes-300 |673 |167.86 |81 |
+|scale-up-httproutes-500 |1358 |10.98 |190 |
+|scale-down-httproutes-300|643 |5.59 |84 |
+|scale-down-httproutes-100|455 |112.24 |55 |
+|scale-down-httproutes-50 |147 |150.17 |20 |
+|scale-down-httproutes-10 |120 |151.69 |12 |
+1. envoy-gateway-system/envoy-benchmark-test-benchmark-0520098c-dbf5d95fb-4lvn5