diff --git a/site/content/en/contributions/DEVELOP.md b/site/content/en/contributions/DEVELOP.md index c9c4cbb2475..555bf3296cc 100644 --- a/site/content/en/contributions/DEVELOP.md +++ b/site/content/en/contributions/DEVELOP.md @@ -145,6 +145,34 @@ verify signature was copied to [JWK Creator][] for generating the JWK. The JWK C settings, i.e. `Signing` public key use and the `RS256` algorithm. The generated JWK was wrapped in a JWKS structure and is hosted in the repo. +### Benchmarking + +Envoy Gateway uses [nighthawk][nighthawk] for benchmarking, and mainly concerned with +its performance and scalability as a control-plane. + +The performance and scalability concerns come from several aspects for control-plane: + +- The consumption of memory and CPU. +- The rate of configuration changes. + +The benchmark test is running on [Kind][Kind] cluster, you can run the following command +to start a Kind cluster and run benchmark test on it. + +```shell +make benchmark-test +``` + +By default, a benchmark report will be generated under `test/benchmark` after test finished. + +#### Brief benchmark report + +You can browse the detailed benchmark report in `test/benchmark/benchmark-report.md`. + +Here are some brief benchmark reports about Envoy Gateway: + +- It will take up nearly 1.3GiB memory and 11s total CPU time for (1 GatewayClass + 1 Gateway + 500 HTTRoutes) settings + + [Quickstart]: https://github.com/envoyproxy/gateway/blob/main/docs/latest/user/quickstart.md [make]: https://www.gnu.org/software/make/ [Github Actions]: https://docs.github.com/en/actions @@ -161,3 +189,4 @@ and is hosted in the repo. [request authentication]: ../latest/tasks/security/jwt-authentication [JWT Debugger]: https://jwt.io/ [JWK Creator]: https://russelldavies.github.io/jwk-creator/ +[nighthawk]: https://github.com/envoyproxy/nighthawk diff --git a/test/benchmark/benchmark_report.md b/test/benchmark/benchmark_report.md index 4d6d57da1a0..5821d67840f 100644 --- a/test/benchmark/benchmark_report.md +++ b/test/benchmark/benchmark_report.md @@ -2,9 +2,9 @@ Benchmark test settings: -|RPS |Connections|Duration (Seconds)|CPU Limits (m)|Memory Limits (MiB)| -|- |- |- |- |- | -|1000|100 |90 |1000 |2048 | +|RPS |Connections|Duration (Seconds)|CPU Limits (m)|Memory Limits (MiB)| +|- |- |- |- |- | +|10000|100 |90 |1000 |2048 | ## Test: ScaleHTTPRoute @@ -20,94 +20,104 @@ Click to see the full results. scale-up-httproutes-10 ```plaintext -[2024-06-25 14:23:36.545][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override. -[14:23:36.545677][1][I] Detected 4 (v)CPUs with affinity.. -[14:23:36.545689][1][I] Starting 4 threads / event loops. Time limit: 90 seconds. -[14:23:36.545691][1][I] Global targets: 400 connections and 4000 calls per second. -[14:23:36.545692][1][I] (Per-worker targets: 100 connections and 1000 calls per second) -[14:25:07.247563][19][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9998444444686 per second.) -[14:25:07.248019][20][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9975333394178 per second.) -[14:25:07.248086][22][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.999577777956 per second.) -[14:25:07.248380][24][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9990666675377 per second.) -[14:25:07.818186][1][I] Done. +Warning: 29 02:48:14.546][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override. +[02:48:14.547222][1][I] Detected 4 (v)CPUs with affinity.. +[02:48:14.547235][1][I] Starting 4 threads / event loops. Time limit: 30 seconds. +[02:48:14.547237][1][I] Global targets: 400 connections and 40000 calls per second. +[02:48:14.547239][1][I] (Per-worker targets: 100 connections and 10000 calls per second) +[02:48:45.249233][18][I] Stopping after 30000 ms. Initiated: 63756 / Completed: 63740. (Completion rate was 2124.6656043338644 per second.) +[02:48:45.249278][21][I] Stopping after 30000 ms. Initiated: 13846 / Completed: 13844. (Completion rate was 461.4664974622843 per second.) +[02:48:45.249278][19][I] Stopping after 30000 ms. Initiated: 79156 / Completed: 79137. (Completion rate was 2637.8965707344582 per second.) +[02:48:45.249494][23][I] Stopping after 30000 ms. Initiated: 20224 / Completed: 20222. (Completion rate was 674.0621055130861 per second.) Nighthawk - A layer 7 protocol benchmarking tool. -benchmark_http_client.latency_2xx (359802 samples) - min: 0s 000ms 290us | mean: 0s 000ms 544us | max: 0s 062ms 072us | pstdev: 0s 000ms 863us +benchmark_http_client.latency_2xx (176582 samples) + min: 0s 000ms 358us | mean: 0s 006ms 272us | max: 0s 070ms 623us | pstdev: 0s 011ms 440us Percentile Count Value - 0.5 179926 0s 000ms 448us - 0.75 269854 0s 000ms 530us - 0.8 287861 0s 000ms 552us - 0.9 323828 0s 000ms 684us - 0.95 341812 0s 000ms 793us - 0.990625 356429 0s 001ms 863us - 0.99902344 359451 0s 009ms 407us + 0.5 88291 0s 002ms 898us + 0.75 132439 0s 004ms 643us + 0.8 141270 0s 005ms 297us + 0.9 158924 0s 008ms 790us + 0.95 167754 0s 045ms 185us + 0.990625 174928 0s 054ms 206us + 0.99902344 176410 0s 059ms 482us -Queueing and connection setup latency (359802 samples) - min: 0s 000ms 002us | mean: 0s 000ms 011us | max: 0s 023ms 417us | pstdev: 0s 000ms 100us +Queueing and connection setup latency (176621 samples) + min: 0s 000ms 001us | mean: 0s 000ms 012us | max: 0s 024ms 204us | pstdev: 0s 000ms 165us +[02:48:50.882431][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. Percentile Count Value - 0.5 179902 0s 000ms 010us - 0.75 269909 0s 000ms 010us - 0.8 288003 0s 000ms 011us - 0.9 323850 0s 000ms 011us - 0.95 341822 0s 000ms 012us - 0.990625 356429 0s 000ms 029us - 0.99902344 359451 0s 000ms 170us + 0.5 88528 0s 000ms 003us + 0.75 132525 0s 000ms 008us + 0.8 141340 0s 000ms 009us + 0.9 159044 0s 000ms 010us + 0.95 167794 0s 000ms 011us + 0.990625 174966 0s 000ms 077us + 0.99902344 176449 0s 001ms 431us -Request start to response end (359802 samples) - min: 0s 000ms 289us | mean: 0s 000ms 543us | max: 0s 062ms 072us | pstdev: 0s 000ms 863us +Request start to response end (176582 samples) + min: 0s 000ms 358us | mean: 0s 006ms 271us | max: 0s 070ms 623us | pstdev: 0s 011ms 440us Percentile Count Value - 0.5 179915 0s 000ms 448us - 0.75 269861 0s 000ms 530us - 0.8 287848 0s 000ms 552us - 0.9 323824 0s 000ms 683us - 0.95 341813 0s 000ms 792us - 0.990625 356429 0s 001ms 862us - 0.99902344 359451 0s 009ms 406us + 0.5 88293 0s 002ms 897us + 0.75 132441 0s 004ms 643us + 0.8 141267 0s 005ms 296us + 0.9 158924 0s 008ms 788us + 0.95 167754 0s 045ms 185us + 0.990625 174928 0s 054ms 204us + 0.99902344 176410 0s 059ms 473us -Response body size in bytes (359802 samples) +Response body size in bytes (176582 samples) min: 10 | mean: 10 | max: 10 | pstdev: 0 -Response header size in bytes (359802 samples) +Response header size in bytes (176582 samples) min: 110 | mean: 110 | max: 110 | pstdev: 0 -Blocking. Results are skewed when significant numbers are reported here. (2 samples) - min: 0s 000ms 901us | mean: 0s 001ms 551us | max: 0s 002ms 202us | pstdev: 0s 000ms 650us +Blocking. Results are skewed when significant numbers are reported here. (53988 samples) + min: 0s 000ms 035us | mean: 0s 002ms 220us | max: 0s 067ms 391us | pstdev: 0s 006ms 778us Percentile Count Value - 0.5 1 0s 000ms 901us + 0.5 26994 0s 000ms 766us + 0.75 40492 0s 001ms 732us + 0.8 43191 0s 002ms 062us + 0.9 48590 0s 003ms 222us + 0.95 51289 0s 004ms 958us + 0.990625 53482 0s 048ms 125us + 0.99902344 53936 0s 055ms 597us -Initiation to completion (360000 samples) - min: 0s 000ms 006us | mean: 0s 000ms 562us | max: 0s 062ms 310us | pstdev: 0s 000ms 883us +Initiation to completion (176943 samples) + min: 0s 000ms 003us | mean: 0s 006ms 351us | max: 0s 071ms 114us | pstdev: 0s 011ms 455us Percentile Count Value - 0.5 180016 0s 000ms 465us - 0.75 270003 0s 000ms 547us - 0.8 288024 0s 000ms 570us - 0.9 324002 0s 000ms 702us - 0.95 342002 0s 000ms 815us - 0.990625 356625 0s 001ms 912us - 0.99902344 359649 0s 009ms 617us + 0.5 88472 0s 002ms 960us + 0.75 132709 0s 004ms 735us + 0.8 141556 0s 005ms 408us + 0.9 159249 0s 009ms 012us + 0.95 168096 0s 045ms 185us + 0.990625 175285 0s 054ms 288us + 0.99902344 176771 0s 059ms 691us Counter Value Per second -benchmark.http_2xx 359802 3997.80 -benchmark.pool_overflow 198 2.20 -cluster_manager.cluster_added 4 0.04 -default.total_match_count 4 0.04 -membership_change 4 0.04 -runtime.load_success 1 0.01 -runtime.override_dir_not_exists 1 0.01 -upstream_cx_http1_total 108 1.20 -upstream_cx_rx_bytes_total 56488914 627653.97 -upstream_cx_total 108 1.20 -upstream_cx_tx_bytes_total 15471486 171905.23 -upstream_rq_pending_overflow 198 2.20 -upstream_rq_pending_total 108 1.20 -upstream_rq_total 359802 3997.80 - +benchmark.http_2xx 176582 5886.05 +benchmark.pool_overflow 361 12.03 +cluster_manager.cluster_added 4 0.13 +default.total_match_count 4 0.13 +membership_change 4 0.13 +runtime.load_success 1 0.03 +runtime.override_dir_not_exists 1 0.03 +upstream_cx_http1_total 39 1.30 +upstream_cx_rx_bytes_total 27723374 924110.39 +upstream_cx_total 39 1.30 +upstream_cx_tx_bytes_total 7594703 253156.20 +upstream_rq_pending_overflow 361 12.03 +upstream_rq_pending_total 39 1.30 +upstream_rq_total 176621 5887.35 + +[02:48:55.883737][19][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[02:49:00.884904][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[02:49:05.885509][23][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[02:49:05.886786][1][I] Done. ``` @@ -117,90 +127,104 @@ upstream_rq_total 359802 3997.80 scale-up-httproutes-50 ```plaintext -[2024-06-25 14:25:18.533][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override. -[14:25:18.533824][1][I] Detected 4 (v)CPUs with affinity.. -[14:25:18.533833][1][I] Starting 4 threads / event loops. Time limit: 90 seconds. -[14:25:18.533836][1][I] Global targets: 400 connections and 4000 calls per second. -[14:25:18.533837][1][I] (Per-worker targets: 100 connections and 1000 calls per second) -[14:26:49.235731][18][I] Stopping after 89999 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 1000.0000222222228 per second.) -[14:26:49.235977][19][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 1000 per second.) -[14:26:49.236240][21][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 89999. (Completion rate was 999.9888111119815 per second.) -[14:26:49.236565][23][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 89999. (Completion rate was 999.9879333448638 per second.) -[14:26:54.772502][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +Warning: 30 09:50:00.929][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override. +[09:50:00.930463][1][I] Detected 4 (v)CPUs with affinity.. +[09:50:00.930476][1][I] Starting 4 threads / event loops. Time limit: 90 seconds. +[09:50:00.930478][1][I] Global targets: 400 connections and 40000 calls per second. +[09:50:00.930480][1][I] (Per-worker targets: 100 connections and 10000 calls per second) +[09:51:31.632205][18][I] Stopping after 90000 ms. Initiated: 132984 / Completed: 132975. (Completion rate was 1477.4999671666674 per second.) +[09:51:31.632253][19][I] Stopping after 90000 ms. Initiated: 184337 / Completed: 184323. (Completion rate was 2048.0327871912564 per second.) +[09:51:31.632393][23][I] Stopping after 90000 ms. Initiated: 119466 / Completed: 119458. (Completion rate was 1327.309400356773 per second.) +[09:51:31.632493][21][I] Stopping after 90000 ms. Initiated: 98553 / Completed: 98547. (Completion rate was 1094.963746763342 per second.) +[09:51:37.272832][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. Nighthawk - A layer 7 protocol benchmarking tool. -benchmark_http_client.latency_2xx (359912 samples) - min: 0s 000ms 303us | mean: 0s 000ms 508us | max: 0s 031ms 259us | pstdev: 0s 000ms 449us +benchmark_http_client.latency_2xx (534940 samples) + min: 0s 000ms 324us | mean: 0s 006ms 013us | max: 0s 080ms 613us | pstdev: 0s 011ms 899us Percentile Count Value - 0.5 179967 0s 000ms 437us - 0.75 269938 0s 000ms 509us - 0.8 287950 0s 000ms 533us - 0.9 323925 0s 000ms 643us - 0.95 341919 0s 000ms 735us - 0.990625 356538 0s 001ms 526us - 0.99902344 359561 0s 006ms 589us + 0.5 267470 0s 002ms 663us + 0.75 401207 0s 004ms 128us + 0.8 427956 0s 004ms 645us + 0.9 481449 0s 006ms 891us + 0.95 508194 0s 048ms 232us + 0.990625 529927 0s 055ms 224us + 0.99902344 534418 0s 061ms 255us -Queueing and connection setup latency (359914 samples) - min: 0s 000ms 001us | mean: 0s 000ms 011us | max: 0s 023ms 449us | pstdev: 0s 000ms 080us +Queueing and connection setup latency (534977 samples) + min: 0s 000ms 001us | mean: 0s 000ms 012us | max: 0s 026ms 379us | pstdev: 0s 000ms 131us Percentile Count Value - 0.5 180198 0s 000ms 010us - 0.75 270795 0s 000ms 011us - 0.8 288165 0s 000ms 011us - 0.9 324019 0s 000ms 011us - 0.95 341989 0s 000ms 011us - 0.990625 356540 0s 000ms 025us - 0.99902344 359564 0s 000ms 159us + 0.5 267828 0s 000ms 003us + 0.75 401520 0s 000ms 008us + 0.8 427993 0s 000ms 009us + 0.9 482090 0s 000ms 009us + 0.95 508250 0s 000ms 010us + 0.990625 529962 0s 000ms 132us + 0.99902344 534455 0s 001ms 630us -Request start to response end (359912 samples) - min: 0s 000ms 302us | mean: 0s 000ms 508us | max: 0s 031ms 258us | pstdev: 0s 000ms 448us +Request start to response end (534940 samples) + min: 0s 000ms 324us | mean: 0s 006ms 012us | max: 0s 080ms 613us | pstdev: 0s 011ms 899us Percentile Count Value - 0.5 179970 0s 000ms 437us - 0.75 269934 0s 000ms 509us - 0.8 287943 0s 000ms 533us - 0.9 323921 0s 000ms 643us - 0.95 341917 0s 000ms 735us - 0.990625 356538 0s 001ms 525us - 0.99902344 359561 0s 006ms 589us + 0.5 267484 0s 002ms 663us + 0.75 401210 0s 004ms 127us + 0.8 427955 0s 004ms 645us + 0.9 481446 0s 006ms 889us + 0.95 508195 0s 048ms 232us + 0.990625 529929 0s 055ms 224us + 0.99902344 534418 0s 061ms 251us -Response body size in bytes (359912 samples) +Response body size in bytes (534940 samples) min: 10 | mean: 10 | max: 10 | pstdev: 0 -Response header size in bytes (359912 samples) +Response header size in bytes (534940 samples) min: 110 | mean: 110 | max: 110 | pstdev: 0 -Initiation to completion (359998 samples) - min: 0s 000ms 006us | mean: 0s 000ms 525us | max: 0s 032ms 263us | pstdev: 0s 000ms 461us +Blocking. Results are skewed when significant numbers are reported here. (176008 samples) + min: 0s 000ms 036us | mean: 0s 002ms 044us | max: 0s 073ms 248us | pstdev: 0s 006ms 744us + + Percentile Count Value + 0.5 88005 0s 000ms 734us + 0.75 132008 0s 001ms 534us + 0.8 140807 0s 001ms 802us + 0.9 158410 0s 002ms 792us + 0.95 167208 0s 004ms 190us + 0.990625 174359 0s 047ms 886us + 0.99902344 175837 0s 053ms 557us + +Initiation to completion (535303 samples) + min: 0s 000ms 004us | mean: 0s 006ms 072us | max: 0s 080ms 633us | pstdev: 0s 011ms 900us Percentile Count Value - 0.5 180024 0s 000ms 453us - 0.75 270017 0s 000ms 526us - 0.8 288004 0s 000ms 550us - 0.9 323999 0s 000ms 663us - 0.95 341999 0s 000ms 753us - 0.990625 356624 0s 001ms 571us - 0.99902344 359647 0s 006ms 655us + 0.5 267665 0s 002ms 717us + 0.75 401487 0s 004ms 204us + 0.8 428258 0s 004ms 732us + 0.9 481775 0s 007ms 022us + 0.95 508538 0s 048ms 248us + 0.990625 530287 0s 055ms 298us + 0.99902344 534781 0s 061ms 421us Counter Value Per second -benchmark.http_2xx 359912 3999.02 -benchmark.pool_overflow 86 0.96 +benchmark.http_2xx 534940 5943.77 +benchmark.pool_overflow 363 4.03 cluster_manager.cluster_added 4 0.04 default.total_match_count 4 0.04 membership_change 4 0.04 runtime.load_success 1 0.01 runtime.override_dir_not_exists 1 0.01 -upstream_cx_http1_total 61 0.68 -upstream_cx_rx_bytes_total 56506184 627846.33 -upstream_cx_total 61 0.68 -upstream_cx_tx_bytes_total 15476302 171958.87 -upstream_rq_pending_overflow 86 0.96 -upstream_rq_pending_total 61 0.68 -upstream_rq_total 359914 3999.04 - -[14:26:59.773726][23][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. -[14:26:59.775576][1][I] Done. +upstream_cx_http1_total 37 0.41 +upstream_cx_rx_bytes_total 83985580 933172.12 +upstream_cx_total 37 0.41 +upstream_cx_tx_bytes_total 23004011 255599.85 +upstream_rq_pending_overflow 363 4.03 +upstream_rq_pending_total 37 0.41 +upstream_rq_total 534977 5944.18 + +[09:51:42.273918][19][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[09:51:47.274994][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[09:51:52.275699][23][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[09:51:52.277010][1][I] Done. ``` @@ -210,90 +234,104 @@ upstream_rq_total 359914 3999.04 scale-up-httproutes-100 ```plaintext -[2024-06-25 14:27:18.024][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override. -[14:27:18.024969][1][I] Detected 4 (v)CPUs with affinity.. -[14:27:18.024981][1][I] Starting 4 threads / event loops. Time limit: 90 seconds. -[14:27:18.024984][1][I] Global targets: 400 connections and 4000 calls per second. -[14:27:18.024985][1][I] (Per-worker targets: 100 connections and 1000 calls per second) -[14:28:48.726723][18][I] Stopping after 89999 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 1000.0000111111112 per second.) -[14:28:48.726970][19][I] Stopping after 89999 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 1000.0000222222228 per second.) -[14:28:48.727250][21][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 89999. (Completion rate was 999.9885555593705 per second.) -[14:28:48.727579][23][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 89999. (Completion rate was 999.9878444571402 per second.) -[14:28:54.260999][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +Warning: 30 09:52:08.843][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override. +[09:52:08.843704][1][I] Detected 4 (v)CPUs with affinity.. +[09:52:08.843716][1][I] Starting 4 threads / event loops. Time limit: 90 seconds. +[09:52:08.843719][1][I] Global targets: 400 connections and 40000 calls per second. +[09:52:08.843720][1][I] (Per-worker targets: 100 connections and 10000 calls per second) +[09:53:39.545479][18][I] Stopping after 90000 ms. Initiated: 60881 / Completed: 60878. (Completion rate was 676.421921590257 per second.) +[09:53:39.545649][23][I] Stopping after 90000 ms. Initiated: 77409 / Completed: 77407. (Completion rate was 860.076458993874 per second.) +[09:53:39.545773][19][I] Stopping after 90000 ms. Initiated: 271217 / Completed: 271198. (Completion rate was 3013.300631521137 per second.) +[09:53:39.546416][21][I] Stopping after 90000 ms. Initiated: 123329 / Completed: 123321. (Completion rate was 1370.219189626365 per second.) +[09:53:45.183623][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. Nighthawk - A layer 7 protocol benchmarking tool. -benchmark_http_client.latency_2xx (359869 samples) - min: 0s 000ms 301us | mean: 0s 000ms 514us | max: 0s 029ms 035us | pstdev: 0s 000ms 431us +benchmark_http_client.latency_2xx (532441 samples) + min: 0s 000ms 359us | mean: 0s 006ms 029us | max: 0s 090ms 263us | pstdev: 0s 011ms 870us Percentile Count Value - 0.5 179965 0s 000ms 444us - 0.75 269904 0s 000ms 518us - 0.8 287910 0s 000ms 540us - 0.9 323888 0s 000ms 641us - 0.95 341879 0s 000ms 744us - 0.990625 356497 0s 001ms 522us - 0.99902344 359518 0s 006ms 553us + 0.5 266227 0s 002ms 698us + 0.75 399344 0s 004ms 228us + 0.8 425959 0s 004ms 757us + 0.9 479199 0s 007ms 042us + 0.95 505821 0s 047ms 982us + 0.990625 527453 0s 055ms 048us + 0.99902344 531922 0s 060ms 678us -Queueing and connection setup latency (359871 samples) - min: 0s 000ms 001us | mean: 0s 000ms 011us | max: 0s 027ms 366us | pstdev: 0s 000ms 058us +Queueing and connection setup latency (532473 samples) + min: 0s 000ms 001us | mean: 0s 000ms 011us | max: 0s 023ms 204us | pstdev: 0s 000ms 126us Percentile Count Value - 0.5 179998 0s 000ms 010us - 0.75 271128 0s 000ms 011us - 0.8 288699 0s 000ms 011us - 0.9 324073 0s 000ms 011us - 0.95 341895 0s 000ms 012us - 0.990625 356498 0s 000ms 029us - 0.99902344 359520 0s 000ms 166us + 0.5 267630 0s 000ms 003us + 0.75 399579 0s 000ms 008us + 0.8 426987 0s 000ms 009us + 0.9 479713 0s 000ms 009us + 0.95 505878 0s 000ms 010us + 0.990625 527482 0s 000ms 040us + 0.99902344 531955 0s 001ms 391us -Request start to response end (359869 samples) - min: 0s 000ms 301us | mean: 0s 000ms 513us | max: 0s 029ms 035us | pstdev: 0s 000ms 431us +Request start to response end (532441 samples) + min: 0s 000ms 359us | mean: 0s 006ms 028us | max: 0s 090ms 263us | pstdev: 0s 011ms 870us Percentile Count Value - 0.5 179935 0s 000ms 444us - 0.75 269906 0s 000ms 517us - 0.8 287896 0s 000ms 539us - 0.9 323883 0s 000ms 641us - 0.95 341876 0s 000ms 743us - 0.990625 356496 0s 001ms 521us - 0.99902344 359518 0s 006ms 552us + 0.5 266221 0s 002ms 697us + 0.75 399332 0s 004ms 227us + 0.8 425959 0s 004ms 757us + 0.9 479199 0s 007ms 042us + 0.95 505824 0s 047ms 982us + 0.990625 527450 0s 055ms 046us + 0.99902344 531922 0s 060ms 678us -Response body size in bytes (359869 samples) +Response body size in bytes (532441 samples) min: 10 | mean: 10 | max: 10 | pstdev: 0 -Response header size in bytes (359869 samples) +Response header size in bytes (532441 samples) min: 110 | mean: 110 | max: 110 | pstdev: 0 -Initiation to completion (359998 samples) - min: 0s 000ms 007us | mean: 0s 000ms 532us | max: 0s 029ms 055us | pstdev: 0s 000ms 451us +Blocking. Results are skewed when significant numbers are reported here. (183352 samples) + min: 0s 000ms 033us | mean: 0s 001ms 962us | max: 0s 084ms 799us | pstdev: 0s 006ms 606us + + Percentile Count Value + 0.5 91683 0s 000ms 726us + 0.75 137514 0s 001ms 420us + 0.8 146685 0s 001ms 667us + 0.9 165017 0s 002ms 581us + 0.95 174186 0s 003ms 882us + 0.990625 181634 0s 047ms 661us + 0.99902344 183173 0s 053ms 168us + +Initiation to completion (532804 samples) + min: 0s 000ms 001us | mean: 0s 006ms 088us | max: 0s 090ms 275us | pstdev: 0s 011ms 873us Percentile Count Value - 0.5 180023 0s 000ms 461us - 0.75 270008 0s 000ms 535us - 0.8 288030 0s 000ms 557us - 0.9 324004 0s 000ms 661us - 0.95 341999 0s 000ms 763us - 0.990625 356624 0s 001ms 570us - 0.99902344 359647 0s 007ms 023us + 0.5 266426 0s 002ms 753us + 0.75 399604 0s 004ms 306us + 0.8 426251 0s 004ms 841us + 0.9 479526 0s 007ms 164us + 0.95 506172 0s 048ms 007us + 0.990625 527811 0s 055ms 113us + 0.99902344 532284 0s 060ms 801us Counter Value Per second -benchmark.http_2xx 359869 3998.54 -benchmark.pool_overflow 129 1.43 +benchmark.http_2xx 532441 5915.99 +benchmark.pool_overflow 363 4.03 cluster_manager.cluster_added 4 0.04 default.total_match_count 4 0.04 membership_change 4 0.04 runtime.load_success 1 0.01 runtime.override_dir_not_exists 1 0.01 -upstream_cx_http1_total 63 0.70 -upstream_cx_rx_bytes_total 56499433 627771.26 -upstream_cx_total 63 0.70 -upstream_cx_tx_bytes_total 15474453 171938.31 -upstream_rq_pending_overflow 129 1.43 -upstream_rq_pending_total 63 0.70 -upstream_rq_total 359871 3998.57 - -[14:28:59.262084][23][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. -[14:28:59.263795][1][I] Done. +upstream_cx_http1_total 37 0.41 +upstream_cx_rx_bytes_total 83593237 928810.08 +upstream_cx_total 37 0.41 +upstream_cx_tx_bytes_total 22896339 254402.76 +upstream_rq_pending_overflow 363 4.03 +upstream_rq_pending_total 37 0.41 +upstream_rq_total 532473 5916.34 + +[09:53:50.184479][19][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[09:53:55.185619][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[09:54:00.186411][23][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[09:54:00.187569][1][I] Done. ``` @@ -303,88 +341,104 @@ upstream_rq_total 359871 3998.57 scale-up-httproutes-300 ```plaintext -[2024-06-25 14:32:23.491][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override. -[14:32:23.491963][1][I] Detected 4 (v)CPUs with affinity.. -[14:32:23.491978][1][I] Starting 4 threads / event loops. Time limit: 90 seconds. -[14:32:23.491980][1][I] Global targets: 400 connections and 4000 calls per second. -[14:32:23.491981][1][I] (Per-worker targets: 100 connections and 1000 calls per second) -[14:33:54.193887][18][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9999888888891 per second.) -[14:33:54.194133][19][I] Stopping after 89999 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 1000.0000222222228 per second.) -[14:33:54.194387][21][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9999888888891 per second.) -[14:33:54.194633][23][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 1000 per second.) -[14:33:54.712898][1][I] Done. +Warning: 30 09:57:17.615][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override. +[09:57:17.615763][1][I] Detected 4 (v)CPUs with affinity.. +[09:57:17.615775][1][I] Starting 4 threads / event loops. Time limit: 90 seconds. +[09:57:17.615778][1][I] Global targets: 400 connections and 40000 calls per second. +[09:57:17.615779][1][I] (Per-worker targets: 100 connections and 10000 calls per second) +[09:58:48.317519][18][I] Stopping after 90000 ms. Initiated: 141701 / Completed: 141691. (Completion rate was 1574.3439371558425 per second.) +[09:58:48.317519][19][I] Stopping after 90000 ms. Initiated: 142076 / Completed: 142066. (Completion rate was 1578.5110584940758 per second.) +[09:58:48.317557][21][I] Stopping after 90000 ms. Initiated: 169359 / Completed: 169346. (Completion rate was 1881.6218249909482 per second.) +[09:58:48.317726][23][I] Stopping after 90000 ms. Initiated: 73891 / Completed: 73887. (Completion rate was 820.9651798075076 per second.) +[09:58:53.963287][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. Nighthawk - A layer 7 protocol benchmarking tool. -benchmark_http_client.latency_2xx (359845 samples) - min: 0s 000ms 302us | mean: 0s 000ms 507us | max: 0s 019ms 987us | pstdev: 0s 000ms 380us +benchmark_http_client.latency_2xx (526627 samples) + min: 0s 000ms 368us | mean: 0s 006ms 116us | max: 0s 085ms 676us | pstdev: 0s 012ms 060us Percentile Count Value - 0.5 179931 0s 000ms 440us - 0.75 269886 0s 000ms 512us - 0.8 287876 0s 000ms 533us - 0.9 323864 0s 000ms 637us - 0.95 341854 0s 000ms 734us - 0.990625 356472 0s 001ms 469us - 0.99902344 359494 0s 006ms 259us + 0.5 263331 0s 002ms 692us + 0.75 394974 0s 004ms 203us + 0.8 421305 0s 004ms 735us + 0.9 473966 0s 007ms 143us + 0.95 500299 0s 048ms 519us + 0.990625 521693 0s 055ms 746us + 0.99902344 526114 0s 062ms 912us -Queueing and connection setup latency (359845 samples) - min: 0s 000ms 001us | mean: 0s 000ms 011us | max: 0s 017ms 634us | pstdev: 0s 000ms 043us +Queueing and connection setup latency (526664 samples) + min: 0s 000ms 001us | mean: 0s 000ms 012us | max: 0s 019ms 310us | pstdev: 0s 000ms 136us Percentile Count Value - 0.5 180160 0s 000ms 010us - 0.75 270791 0s 000ms 010us - 0.8 287918 0s 000ms 011us - 0.9 324365 0s 000ms 011us - 0.95 341940 0s 000ms 011us - 0.990625 356473 0s 000ms 027us - 0.99902344 359494 0s 000ms 167us + 0.5 263616 0s 000ms 003us + 0.75 395207 0s 000ms 008us + 0.8 421679 0s 000ms 009us + 0.9 474013 0s 000ms 009us + 0.95 500359 0s 000ms 010us + 0.990625 521727 0s 000ms 127us + 0.99902344 526150 0s 001ms 624us -Request start to response end (359845 samples) - min: 0s 000ms 302us | mean: 0s 000ms 506us | max: 0s 019ms 987us | pstdev: 0s 000ms 380us +Request start to response end (526627 samples) + min: 0s 000ms 368us | mean: 0s 006ms 116us | max: 0s 085ms 676us | pstdev: 0s 012ms 060us Percentile Count Value - 0.5 179923 0s 000ms 440us - 0.75 269893 0s 000ms 511us - 0.8 287905 0s 000ms 533us - 0.9 323861 0s 000ms 636us - 0.95 341854 0s 000ms 733us - 0.990625 356472 0s 001ms 468us - 0.99902344 359494 0s 006ms 259us + 0.5 263324 0s 002ms 692us + 0.75 394984 0s 004ms 203us + 0.8 421305 0s 004ms 734us + 0.9 473966 0s 007ms 142us + 0.95 500299 0s 048ms 519us + 0.990625 521693 0s 055ms 746us + 0.99902344 526113 0s 062ms 910us -Response body size in bytes (359845 samples) +Response body size in bytes (526627 samples) min: 10 | mean: 10 | max: 10 | pstdev: 0 -Response header size in bytes (359845 samples) +Response header size in bytes (526627 samples) min: 110 | mean: 110 | max: 110 | pstdev: 0 -Initiation to completion (360000 samples) - min: 0s 000ms 007us | mean: 0s 000ms 525us | max: 0s 020ms 035us | pstdev: 0s 000ms 409us +Blocking. Results are skewed when significant numbers are reported here. (178472 samples) + min: 0s 000ms 034us | mean: 0s 002ms 016us | max: 0s 085ms 700us | pstdev: 0s 006ms 753us + + Percentile Count Value + 0.5 89237 0s 000ms 732us + 0.75 133855 0s 001ms 469us + 0.8 142779 0s 001ms 727us + 0.9 160630 0s 002ms 687us + 0.95 169550 0s 004ms 042us + 0.990625 176799 0s 048ms 060us + 0.99902344 178298 0s 054ms 435us + +Initiation to completion (526990 samples) + min: 0s 000ms 004us | mean: 0s 006ms 174us | max: 0s 085ms 700us | pstdev: 0s 012ms 062us Percentile Count Value - 0.5 180011 0s 000ms 456us - 0.75 270028 0s 000ms 529us - 0.8 288004 0s 000ms 550us - 0.9 324006 0s 000ms 656us - 0.95 342005 0s 000ms 751us - 0.990625 356625 0s 001ms 525us - 0.99902344 359649 0s 006ms 569us + 0.5 263496 0s 002ms 745us + 0.75 395254 0s 004ms 278us + 0.8 421594 0s 004ms 818us + 0.9 474295 0s 007ms 277us + 0.95 500644 0s 048ms 537us + 0.990625 522050 0s 055ms 818us + 0.99902344 526476 0s 062ms 992us Counter Value Per second -benchmark.http_2xx 359845 3998.28 -benchmark.pool_overflow 155 1.72 +benchmark.http_2xx 526627 5851.41 +benchmark.pool_overflow 363 4.03 cluster_manager.cluster_added 4 0.04 default.total_match_count 4 0.04 membership_change 4 0.04 runtime.load_success 1 0.01 runtime.override_dir_not_exists 1 0.01 -upstream_cx_http1_total 62 0.69 -upstream_cx_rx_bytes_total 56495665 627729.61 -upstream_cx_total 62 0.69 -upstream_cx_tx_bytes_total 15473335 171925.94 -upstream_rq_pending_overflow 155 1.72 -upstream_rq_pending_total 62 0.69 -upstream_rq_total 359845 3998.28 - +upstream_cx_http1_total 37 0.41 +upstream_cx_rx_bytes_total 82680439 918671.00 +upstream_cx_total 37 0.41 +upstream_cx_tx_bytes_total 22646552 251628.21 +upstream_rq_pending_overflow 363 4.03 +upstream_rq_pending_total 37 0.41 +upstream_rq_total 526664 5851.82 + +[09:58:58.964269][19][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[09:59:03.965258][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[09:59:08.966199][23][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[09:59:08.967339][1][I] Done. ``` @@ -394,92 +448,104 @@ upstream_rq_total 359845 3998.28 scale-up-httproutes-500 ```plaintext -[2024-06-25 14:38:43.691][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override. -[14:38:43.691938][1][I] Detected 4 (v)CPUs with affinity.. -[14:38:43.691951][1][I] Starting 4 threads / event loops. Time limit: 90 seconds. -[14:38:43.691953][1][I] Global targets: 400 connections and 4000 calls per second. -[14:38:43.691954][1][I] (Per-worker targets: 100 connections and 1000 calls per second) -[14:40:14.393764][18][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 89999. (Completion rate was 999.9885666703507 per second.) -[14:40:14.393981][19][I] Stopping after 89999 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 1000.0000555555587 per second.) -[14:40:14.394312][21][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9992666672044 per second.) -[14:40:14.394484][23][I] Stopping after 89999 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 1000.0000333333344 per second.) -[14:40:19.954533][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +Warning: 30 10:05:50.181][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override. +[10:05:50.182352][1][I] Detected 4 (v)CPUs with affinity.. +[10:05:50.182365][1][I] Starting 4 threads / event loops. Time limit: 90 seconds. +[10:05:50.182367][1][I] Global targets: 400 connections and 40000 calls per second. +[10:05:50.182369][1][I] (Per-worker targets: 100 connections and 10000 calls per second) +[10:07:20.884276][21][I] Stopping after 90000 ms. Initiated: 93542 / Completed: 93539. (Completion rate was 1039.3210789690352 per second.) +[10:07:20.884582][19][I] Stopping after 90000 ms. Initiated: 180072 / Completed: 180060. (Completion rate was 2000.6570635127619 per second.) +[10:07:20.884601][18][I] Stopping after 90000 ms. Initiated: 101770 / Completed: 101764. (Completion rate was 1130.7051560639559 per second.) +[10:07:20.884602][23][I] Stopping after 90000 ms. Initiated: 140594 / Completed: 140587. (Completion rate was 1562.0708005282022 per second.) +[10:07:26.528168][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. Nighthawk - A layer 7 protocol benchmarking tool. -benchmark_http_client.latency_2xx (359743 samples) - min: 0s 000ms 311us | mean: 0s 000ms 566us | max: 0s 064ms 673us | pstdev: 0s 001ms 003us +benchmark_http_client.latency_2xx (515587 samples) + min: 0s 000ms 352us | mean: 0s 006ms 243us | max: 0s 103ms 198us | pstdev: 0s 012ms 343us Percentile Count Value - 0.5 179890 0s 000ms 441us - 0.75 269813 0s 000ms 519us - 0.8 287802 0s 000ms 544us - 0.9 323771 0s 000ms 684us - 0.95 341757 0s 000ms 790us - 0.990625 356372 0s 002ms 465us - 0.99902344 359392 0s 016ms 404us + 0.5 257799 0s 002ms 698us + 0.75 386691 0s 004ms 155us + 0.8 412474 0s 004ms 697us + 0.9 464029 0s 007ms 193us + 0.95 489815 0s 048ms 922us + 0.990625 510755 0s 056ms 528us + 0.99902344 515084 0s 067ms 747us -Queueing and connection setup latency (359744 samples) - min: 0s 000ms 001us | mean: 0s 000ms 011us | max: 0s 040ms 116us | pstdev: 0s 000ms 093us +Queueing and connection setup latency (515615 samples) + min: 0s 000ms 001us | mean: 0s 000ms 012us | max: 0s 020ms 386us | pstdev: 0s 000ms 125us Percentile Count Value - 0.5 180015 0s 000ms 010us - 0.75 269817 0s 000ms 011us - 0.8 288758 0s 000ms 011us - 0.9 324218 0s 000ms 011us - 0.95 341791 0s 000ms 012us - 0.990625 356372 0s 000ms 029us - 0.99902344 359393 0s 000ms 172us + 0.5 258414 0s 000ms 003us + 0.75 386829 0s 000ms 008us + 0.8 412620 0s 000ms 009us + 0.9 464074 0s 000ms 009us + 0.95 489886 0s 000ms 010us + 0.990625 510782 0s 000ms 123us + 0.99902344 515112 0s 001ms 602us -Request start to response end (359743 samples) - min: 0s 000ms 311us | mean: 0s 000ms 566us | max: 0s 064ms 673us | pstdev: 0s 001ms 003us +Request start to response end (515587 samples) + min: 0s 000ms 352us | mean: 0s 006ms 243us | max: 0s 103ms 194us | pstdev: 0s 012ms 343us Percentile Count Value - 0.5 179874 0s 000ms 441us - 0.75 269820 0s 000ms 519us - 0.8 287800 0s 000ms 544us - 0.9 323772 0s 000ms 684us - 0.95 341758 0s 000ms 790us - 0.990625 356372 0s 002ms 464us - 0.99902344 359392 0s 016ms 404us + 0.5 257802 0s 002ms 698us + 0.75 386698 0s 004ms 155us + 0.8 412470 0s 004ms 697us + 0.9 464031 0s 007ms 192us + 0.95 489808 0s 048ms 920us + 0.990625 510756 0s 056ms 528us + 0.99902344 515084 0s 067ms 747us -Response body size in bytes (359743 samples) +Response body size in bytes (515587 samples) min: 10 | mean: 10 | max: 10 | pstdev: 0 -Response header size in bytes (359743 samples) +Response header size in bytes (515587 samples) min: 110 | mean: 110 | max: 110 | pstdev: 0 -Blocking. Results are skewed when significant numbers are reported here. (1 samples) - min: 0s 001ms 331us | mean: 0s 001ms 331us | max: 0s 001ms 331us | pstdev: 0s 000ms 000us +Blocking. Results are skewed when significant numbers are reported here. (165055 samples) + min: 0s 000ms 036us | mean: 0s 002ms 180us | max: 0s 090ms 710us | pstdev: 0s 007ms 128us + + Percentile Count Value + 0.5 82528 0s 000ms 765us + 0.75 123792 0s 001ms 622us + 0.8 132045 0s 001ms 906us + 0.9 148550 0s 002ms 915us + 0.95 156804 0s 004ms 402us + 0.990625 163510 0s 048ms 775us + 0.99902344 164894 0s 058ms 019us -Initiation to completion (359999 samples) - min: 0s 000ms 005us | mean: 0s 000ms 593us | max: 0s 064ms 710us | pstdev: 0s 001ms 145us +Initiation to completion (515950 samples) + min: 0s 000ms 004us | mean: 0s 006ms 300us | max: 0s 103ms 215us | pstdev: 0s 012ms 342us Percentile Count Value - 0.5 180029 0s 000ms 458us - 0.75 270014 0s 000ms 537us - 0.8 288011 0s 000ms 562us - 0.9 324008 0s 000ms 703us - 0.95 342000 0s 000ms 813us - 0.990625 356625 0s 002ms 640us - 0.99902344 359648 0s 018ms 319us + 0.5 257987 0s 002ms 750us + 0.75 386970 0s 004ms 235us + 0.8 412760 0s 004ms 784us + 0.9 464357 0s 007ms 323us + 0.95 490153 0s 048ms 945us + 0.990625 511115 0s 056ms 580us + 0.99902344 515447 0s 067ms 813us Counter Value Per second -benchmark.http_2xx 359743 3997.14 -benchmark.pool_overflow 256 2.84 +benchmark.http_2xx 515587 5728.72 +benchmark.pool_overflow 363 4.03 cluster_manager.cluster_added 4 0.04 default.total_match_count 4 0.04 membership_change 4 0.04 runtime.load_success 1 0.01 runtime.override_dir_not_exists 1 0.01 -upstream_cx_http1_total 96 1.07 -upstream_cx_rx_bytes_total 56479651 627551.52 -upstream_cx_total 96 1.07 -upstream_cx_tx_bytes_total 15468992 171877.65 -upstream_rq_pending_overflow 256 2.84 -upstream_rq_pending_total 96 1.07 -upstream_rq_total 359744 3997.15 - -[14:40:19.962562][1][I] Done. +upstream_cx_http1_total 37 0.41 +upstream_cx_rx_bytes_total 80947159 899409.36 +upstream_cx_total 37 0.41 +upstream_cx_tx_bytes_total 22171445 246348.42 +upstream_rq_pending_overflow 363 4.03 +upstream_rq_pending_total 37 0.41 +upstream_rq_total 515615 5729.03 + +[10:07:31.529027][19][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[10:07:36.530025][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[10:07:41.530832][23][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[10:07:41.532165][1][I] Done. ``` @@ -489,101 +555,103 @@ upstream_rq_total 359744 3997.15 scale-down-httproutes-300 ```plaintext -[2024-06-25 14:40:47.629][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override. -[14:40:47.629688][1][I] Detected 4 (v)CPUs with affinity.. -[14:40:47.629700][1][I] Starting 4 threads / event loops. Time limit: 90 seconds. -[14:40:47.629703][1][I] Global targets: 400 connections and 4000 calls per second. -[14:40:47.629704][1][I] (Per-worker targets: 100 connections and 1000 calls per second) -[14:42:18.331523][18][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9990222231783 per second.) -[14:42:18.331681][19][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9999777777783 per second.) -[14:42:18.331935][21][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 89999. (Completion rate was 999.988855555927 per second.) -[14:42:18.332255][23][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.999166667361 per second.) -[14:42:23.961708][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +Warning: 30 10:08:14.153][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override. +[10:08:14.154484][1][I] Detected 4 (v)CPUs with affinity.. +[10:08:14.154499][1][I] Starting 4 threads / event loops. Time limit: 90 seconds. +[10:08:14.154502][1][I] Global targets: 400 connections and 40000 calls per second. +[10:08:14.154504][1][I] (Per-worker targets: 100 connections and 10000 calls per second) +[10:09:44.857305][21][I] Stopping after 90000 ms. Initiated: 120108 / Completed: 120100. (Completion rate was 1334.4432137912584 per second.) +[10:09:44.857423][23][I] Stopping after 90000 ms. Initiated: 54818 / Completed: 54817. (Completion rate was 609.0765799271705 per second.) +[10:09:44.857655][18][I] Stopping after 90000 ms. Initiated: 191822 / Completed: 191822. (Completion rate was 2131.3440462977055 per second.) +[10:09:44.858450][19][I] Stopping after 90001 ms. Initiated: 150329 / Completed: 150327. (Completion rate was 1670.2767089192257 per second.) +[10:09:50.501933][19][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. Nighthawk - A layer 7 protocol benchmarking tool. -benchmark_http_client.latency_2xx (359722 samples) - min: 0s 000ms 303us | mean: 0s 001ms 203us | max: 0s 121ms 311us | pstdev: 0s 006ms 029us +benchmark_http_client.latency_2xx (516703 samples) + min: 0s 000ms 339us | mean: 0s 006ms 221us | max: 0s 096ms 722us | pstdev: 0s 011ms 937us Percentile Count Value - 0.5 179885 0s 000ms 456us - 0.75 269810 0s 000ms 543us - 0.8 287781 0s 000ms 570us - 0.9 323750 0s 000ms 749us - 0.95 341736 0s 001ms 344us - 0.990625 356350 0s 016ms 743us - 0.99902344 359371 0s 083ms 783us + 0.5 258358 0s 002ms 750us + 0.75 387543 0s 004ms 382us + 0.8 413372 0s 004ms 969us + 0.9 465035 0s 007ms 728us + 0.95 490869 0s 047ms 640us + 0.990625 511859 0s 055ms 703us + 0.99902344 516199 0s 065ms 038us -Queueing and connection setup latency (359723 samples) - min: 0s 000ms 001us | mean: 0s 000ms 012us | max: 0s 041ms 897us | pstdev: 0s 000ms 131us +Queueing and connection setup latency (516714 samples) + min: 0s 000ms 001us | mean: 0s 000ms 012us | max: 0s 019ms 922us | pstdev: 0s 000ms 135us Percentile Count Value - 0.5 179921 0s 000ms 010us - 0.75 270953 0s 000ms 011us - 0.8 288381 0s 000ms 011us - 0.9 323867 0s 000ms 011us - 0.95 341759 0s 000ms 012us - 0.990625 356351 0s 000ms 032us - 0.99902344 359372 0s 000ms 206us + 0.5 259348 0s 000ms 003us + 0.75 387676 0s 000ms 008us + 0.8 413511 0s 000ms 009us + 0.9 465475 0s 000ms 009us + 0.95 490880 0s 000ms 010us + 0.990625 511870 0s 000ms 042us + 0.99902344 516210 0s 001ms 596us -Request start to response end (359722 samples) - min: 0s 000ms 302us | mean: 0s 001ms 202us | max: 0s 121ms 311us | pstdev: 0s 006ms 029us +Request start to response end (516703 samples) + min: 0s 000ms 339us | mean: 0s 006ms 221us | max: 0s 096ms 722us | pstdev: 0s 011ms 937us Percentile Count Value - 0.5 179877 0s 000ms 456us - 0.75 269810 0s 000ms 542us - 0.8 287783 0s 000ms 570us - 0.9 323752 0s 000ms 748us - 0.95 341736 0s 001ms 344us - 0.990625 356350 0s 016ms 742us - 0.99902344 359371 0s 083ms 783us + 0.5 258360 0s 002ms 750us + 0.75 387541 0s 004ms 382us + 0.8 413365 0s 004ms 968us + 0.9 465034 0s 007ms 726us + 0.95 490870 0s 047ms 640us + 0.990625 511859 0s 055ms 703us + 0.99902344 516199 0s 065ms 038us -Response body size in bytes (359722 samples) +Response body size in bytes (516703 samples) min: 10 | mean: 10 | max: 10 | pstdev: 0 -Response header size in bytes (359722 samples) +Response header size in bytes (516703 samples) min: 110 | mean: 110 | max: 110 | pstdev: 0 -Blocking. Results are skewed when significant numbers are reported here. (1022 samples) - min: 0s 000ms 045us | mean: 0s 006ms 403us | max: 0s 099ms 049us | pstdev: 0s 015ms 130us +Blocking. Results are skewed when significant numbers are reported here. (170680 samples) + min: 0s 000ms 034us | mean: 0s 002ms 108us | max: 0s 090ms 091us | pstdev: 0s 006ms 769us Percentile Count Value - 0.5 511 0s 001ms 012us - 0.75 767 0s 003ms 262us - 0.8 818 0s 004ms 782us - 0.9 920 0s 015ms 482us - 0.95 971 0s 047ms 316us - 0.990625 1013 0s 075ms 657us - 0.99902344 1022 0s 099ms 049us + 0.5 85340 0s 000ms 756us + 0.75 128013 0s 001ms 581us + 0.8 136546 0s 001ms 864us + 0.9 153612 0s 002ms 914us + 0.95 162148 0s 004ms 492us + 0.990625 169080 0s 047ms 810us + 0.99902344 170514 0s 055ms 848us -Initiation to completion (359999 samples) - min: 0s 000ms 002us | mean: 0s 001ms 224us | max: 0s 121ms 405us | pstdev: 0s 006ms 041us +Initiation to completion (517066 samples) + min: 0s 000ms 003us | mean: 0s 006ms 281us | max: 0s 096ms 731us | pstdev: 0s 011ms 939us Percentile Count Value - 0.5 180002 0s 000ms 473us - 0.75 270009 0s 000ms 560us - 0.8 288002 0s 000ms 589us - 0.9 324002 0s 000ms 770us - 0.95 342001 0s 001ms 390us - 0.990625 356625 0s 017ms 278us - 0.99902344 359648 0s 083ms 849us + 0.5 258539 0s 002ms 805us + 0.75 387802 0s 004ms 465us + 0.8 413664 0s 005ms 058us + 0.9 465360 0s 007ms 867us + 0.95 491214 0s 047ms 654us + 0.990625 512220 0s 055ms 760us + 0.99902344 516562 0s 065ms 097us Counter Value Per second -benchmark.http_2xx 359722 3996.91 -benchmark.pool_overflow 277 3.08 +benchmark.http_2xx 516703 5741.11 +benchmark.pool_overflow 363 4.03 cluster_manager.cluster_added 4 0.04 default.total_match_count 4 0.04 membership_change 4 0.04 runtime.load_success 1 0.01 runtime.override_dir_not_exists 1 0.01 -upstream_cx_http1_total 123 1.37 -upstream_cx_rx_bytes_total 56476354 627514.75 -upstream_cx_total 123 1.37 -upstream_cx_tx_bytes_total 15468089 171867.57 -upstream_rq_pending_overflow 277 3.08 -upstream_rq_pending_total 123 1.37 -upstream_rq_total 359723 3996.92 - -[14:42:23.965353][1][I] Done. +upstream_cx_http1_total 37 0.41 +upstream_cx_rx_bytes_total 81122371 901354.66 +upstream_cx_total 37 0.41 +upstream_cx_tx_bytes_total 22218702 246873.09 +upstream_rq_pending_overflow 363 4.03 +upstream_rq_pending_total 37 0.41 +upstream_rq_total 516714 5741.23 + +[10:09:55.503051][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[10:10:00.503918][23][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[10:10:00.505088][1][I] Done. ``` @@ -593,102 +661,104 @@ upstream_rq_total 359723 3996.92 scale-down-httproutes-100 ```plaintext -[2024-06-25 14:42:41.429][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override. -[14:42:41.430321][1][I] Detected 4 (v)CPUs with affinity.. -[14:42:41.430334][1][I] Starting 4 threads / event loops. Time limit: 90 seconds. -[14:42:41.430336][1][I] Global targets: 400 connections and 4000 calls per second. -[14:42:41.430338][1][I] (Per-worker targets: 100 connections and 1000 calls per second) -[14:44:12.132884][18][I] Stopping after 89999 ms. Initiated: 90000 / Completed: 89996. (Completion rate was 999.9555777767906 per second.) -[14:44:12.133405][21][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.999777777827 per second.) -[14:44:12.133681][23][I] Stopping after 90000 ms. Initiated: 89995 / Completed: 89995. (Completion rate was 999.9439111410252 per second.) -[14:44:12.138437][19][I] Stopping after 90005 ms. Initiated: 89979 / Completed: 89958. (Completion rate was 999.474453182769 per second.) -[14:44:17.976650][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +Warning: 30 10:10:18.056][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override. +[10:10:18.057130][1][I] Detected 4 (v)CPUs with affinity.. +[10:10:18.057143][1][I] Starting 4 threads / event loops. Time limit: 90 seconds. +[10:10:18.057145][1][I] Global targets: 400 connections and 40000 calls per second. +[10:10:18.057147][1][I] (Per-worker targets: 100 connections and 10000 calls per second) +[10:11:48.759104][18][I] Stopping after 90000 ms. Initiated: 209011 / Completed: 208988. (Completion rate was 2322.087186024952 per second.) +[10:11:48.759212][21][I] Stopping after 90000 ms. Initiated: 49528 / Completed: 49526. (Completion rate was 550.2881062569155 per second.) +[10:11:48.759225][19][I] Stopping after 90000 ms. Initiated: 82374 / Completed: 82369. (Completion rate was 915.2096671136363 per second.) +[10:11:48.759235][22][I] Stopping after 90000 ms. Initiated: 83103 / Completed: 83098. (Completion rate was 923.3098082183817 per second.) +[10:11:54.582462][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. Nighthawk - A layer 7 protocol benchmarking tool. -benchmark_http_client.latency_2xx (359649 samples) - min: 0s 000ms 297us | mean: 0s 009ms 493us | max: 0s 163ms 553us | pstdev: 0s 017ms 560us +benchmark_http_client.latency_2xx (423617 samples) + min: 0s 000ms 341us | mean: 0s 007ms 208us | max: 0s 137ms 691us | pstdev: 0s 011ms 926us Percentile Count Value - 0.5 179826 0s 002ms 042us - 0.75 269740 0s 008ms 322us - 0.8 287721 0s 011ms 606us - 0.9 323685 0s 030ms 779us - 0.95 341667 0s 054ms 808us - 0.990625 356278 0s 079ms 679us - 0.99902344 359299 0s 106ms 098us + 0.5 211815 0s 003ms 194us + 0.75 317722 0s 006ms 279us + 0.8 338894 0s 007ms 606us + 0.9 381256 0s 016ms 511us + 0.95 402437 0s 035ms 002us + 0.990625 419646 0s 062ms 793us + 0.99902344 423204 0s 082ms 636us -Queueing and connection setup latency (359674 samples) - min: 0s 000ms 001us | mean: 0s 000ms 015us | max: 0s 033ms 947us | pstdev: 0s 000ms 269us +Queueing and connection setup latency (423652 samples) + min: 0s 000ms 001us | mean: 0s 000ms 014us | max: 0s 035ms 192us | pstdev: 0s 000ms 210us Percentile Count Value - 0.5 179931 0s 000ms 008us - 0.75 269789 0s 000ms 010us - 0.8 287838 0s 000ms 011us - 0.9 323819 0s 000ms 011us - 0.95 341697 0s 000ms 015us - 0.990625 356303 0s 000ms 059us - 0.99902344 359323 0s 001ms 303us + 0.5 212529 0s 000ms 003us + 0.75 317890 0s 000ms 008us + 0.8 339187 0s 000ms 009us + 0.9 381367 0s 000ms 009us + 0.95 402534 0s 000ms 011us + 0.990625 419681 0s 000ms 121us + 0.99902344 423239 0s 001ms 867us -Request start to response end (359649 samples) - min: 0s 000ms 296us | mean: 0s 009ms 493us | max: 0s 163ms 553us | pstdev: 0s 017ms 560us +Request start to response end (423617 samples) + min: 0s 000ms 341us | mean: 0s 007ms 207us | max: 0s 137ms 691us | pstdev: 0s 011ms 926us Percentile Count Value - 0.5 179829 0s 002ms 041us - 0.75 269740 0s 008ms 321us - 0.8 287722 0s 011ms 606us - 0.9 323687 0s 030ms 779us - 0.95 341667 0s 054ms 808us - 0.990625 356278 0s 079ms 679us - 0.99902344 359299 0s 106ms 098us + 0.5 211809 0s 003ms 194us + 0.75 317719 0s 006ms 279us + 0.8 338894 0s 007ms 606us + 0.9 381256 0s 016ms 510us + 0.95 402437 0s 035ms 002us + 0.990625 419646 0s 062ms 793us + 0.99902344 423204 0s 082ms 636us -Response body size in bytes (359649 samples) +Response body size in bytes (423617 samples) min: 10 | mean: 10 | max: 10 | pstdev: 0 -Response header size in bytes (359649 samples) +Response header size in bytes (423617 samples) min: 110 | mean: 110 | max: 110 | pstdev: 0 -Blocking. Results are skewed when significant numbers are reported here. (19052 samples) - min: 0s 000ms 039us | mean: 0s 006ms 142us | max: 0s 146ms 767us | pstdev: 0s 012ms 746us +Blocking. Results are skewed when significant numbers are reported here. (142751 samples) + min: 0s 000ms 035us | mean: 0s 002ms 521us | max: 0s 105ms 373us | pstdev: 0s 006ms 732us Percentile Count Value - 0.5 9526 0s 001ms 273us - 0.75 14289 0s 004ms 540us - 0.8 15242 0s 006ms 354us - 0.9 17147 0s 018ms 240us - 0.95 18100 0s 036ms 243us - 0.990625 18874 0s 063ms 096us - 0.99902344 19034 0s 087ms 937us + 0.5 71376 0s 000ms 888us + 0.75 107064 0s 001ms 861us + 0.8 114202 0s 002ms 248us + 0.9 128476 0s 004ms 006us + 0.95 135614 0s 008ms 008us + 0.990625 141413 0s 041ms 697us + 0.99902344 142612 0s 064ms 958us -Initiation to completion (359949 samples) - min: 0s 000ms 006us | mean: 0s 009ms 592us | max: 0s 163ms 594us | pstdev: 0s 017ms 643us +Initiation to completion (423981 samples) + min: 0s 000ms 005us | mean: 0s 007ms 283us | max: 0s 137ms 756us | pstdev: 0s 011ms 948us Percentile Count Value - 0.5 179976 0s 002ms 093us - 0.75 269962 0s 008ms 477us - 0.8 287962 0s 011ms 824us - 0.9 323955 0s 030ms 991us - 0.95 341957 0s 055ms 142us - 0.990625 356578 0s 080ms 228us - 0.99902344 359598 0s 106ms 164us + 0.5 211995 0s 003ms 260us + 0.75 317989 0s 006ms 396us + 0.8 339189 0s 007ms 761us + 0.9 381583 0s 016ms 687us + 0.95 402787 0s 035ms 110us + 0.990625 420007 0s 062ms 932us + 0.99902344 423567 0s 082ms 649us Counter Value Per second -benchmark.http_2xx 359649 3996.04 -benchmark.pool_overflow 300 3.33 +benchmark.http_2xx 423617 4706.85 +benchmark.pool_overflow 364 4.04 cluster_manager.cluster_added 4 0.04 default.total_match_count 4 0.04 membership_change 4 0.04 runtime.load_success 1 0.01 runtime.override_dir_not_exists 1 0.01 -upstream_cx_http1_total 100 1.11 -upstream_cx_rx_bytes_total 56464893 627378.34 -upstream_cx_total 100 1.11 -upstream_cx_tx_bytes_total 15465939 171841.20 -upstream_rq_pending_overflow 300 3.33 -upstream_rq_pending_total 100 1.11 -upstream_rq_total 359674 3996.32 - -[14:44:22.981221][19][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. -[14:44:22.985214][1][I] Done. +upstream_cx_http1_total 36 0.40 +upstream_cx_rx_bytes_total 66507869 738975.37 +upstream_cx_total 36 0.40 +upstream_cx_tx_bytes_total 18217036 202411.25 +upstream_rq_pending_overflow 364 4.04 +upstream_rq_pending_total 36 0.40 +upstream_rq_total 423652 4707.24 + +[10:11:59.584852][19][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[10:12:04.585643][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[10:12:09.586270][22][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[10:12:09.587436][1][I] Done. ``` @@ -698,120 +768,104 @@ upstream_rq_total 359674 3996.32 scale-down-httproutes-50 ```plaintext -[2024-06-25 14:44:35.399][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override. -[14:44:35.400594][1][I] Detected 4 (v)CPUs with affinity.. -[14:44:35.400604][1][I] Starting 4 threads / event loops. Time limit: 90 seconds. -[14:44:35.400607][1][I] Global targets: 400 connections and 4000 calls per second. -[14:44:35.400609][1][I] (Per-worker targets: 100 connections and 1000 calls per second) -[14:45:50.873708][19][E] Exiting due to failing termination predicate -[14:45:50.873747][19][I] Stopping after 74767 ms. Initiated: 74767 / Completed: 74746. (Completion rate was 999.716774109537 per second.) -[14:45:50.874918][18][E] Exiting due to failing termination predicate -[14:45:50.875120][18][I] Stopping after 74769 ms. Initiated: 74770 / Completed: 74749. (Completion rate was 999.7209036132042 per second.) -[14:45:50.878184][20][E] Exiting due to failing termination predicate -[14:45:50.878203][20][I] Stopping after 74772 ms. Initiated: 74772 / Completed: 74750. (Completion rate was 999.6972288218956 per second.) -[14:45:50.880264][21][E] Exiting due to failing termination predicate -[14:45:50.880286][21][I] Stopping after 74773 ms. Initiated: 74774 / Completed: 74747. (Completion rate was 999.6424011911454 per second.) -[14:45:51.840758][1][E] Terminated early because of a failure predicate. -[14:45:51.840780][1][I] Check the output for problematic counter values. The default Nighthawk failure predicates report failure if (1) Nighthawk could not connect to the target (see 'benchmark.pool_connection_failure' counter; check the address and port number, and try explicitly setting --address-family v4 or v6, especially when using DNS; instead of localhost try 127.0.0.1 or ::1 explicitly), (2) the protocol was not supported by the target (see 'benchmark.stream_resets' counter; check http/https in the URI, --h2), (3) the target returned a 4xx or 5xx HTTP response code (see 'benchmark.http_4xx' and 'benchmark.http_5xx' counters; check the URI path and the server config), or (4) a custom gRPC RequestSource failed. --failure-predicate can be used to relax expectations. -[14:45:56.841540][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +Warning: 29 03:03:53.663][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override. +[03:03:53.664682][1][I] Detected 4 (v)CPUs with affinity.. +[03:03:53.664695][1][I] Starting 4 threads / event loops. Time limit: 30 seconds. +[03:03:53.664698][1][I] Global targets: 400 connections and 40000 calls per second. +[03:03:53.664700][1][I] (Per-worker targets: 100 connections and 10000 calls per second) +[03:04:24.367434][23][I] Stopping after 30000 ms. Initiated: 46577 / Completed: 46567. (Completion rate was 1552.2191046582072 per second.) +[03:04:24.367829][18][I] Stopping after 30000 ms. Initiated: 42300 / Completed: 42290. (Completion rate was 1409.6315198541051 per second.) +[03:04:24.368549][21][I] Stopping after 30001 ms. Initiated: 39600 / Completed: 39591. (Completion rate was 1319.637581142412 per second.) +[03:04:24.367485][19][I] Stopping after 29994 ms. Initiated: 14551 / Completed: 14549. (Completion rate was 485.05192262626696 per second.) +[03:04:30.226109][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. Nighthawk - A layer 7 protocol benchmarking tool. -benchmark_http_client.latency_2xx (298738 samples) - min: 0s 000ms 307us | mean: 0s 011ms 515us | max: 0s 187ms 269us | pstdev: 0s 019ms 783us - - Percentile Count Value - 0.5 149369 0s 002ms 416us - 0.75 224054 0s 011ms 230us - 0.8 238992 0s 016ms 571us - 0.9 268865 0s 041ms 666us - 0.95 283803 0s 059ms 402us - 0.990625 295939 0s 085ms 483us - 0.99902344 298447 0s 120ms 631us - -benchmark_http_client.latency_5xx (7 samples) - min: 0s 000ms 210us | mean: 0s 000ms 884us | max: 0s 001ms 337us | pstdev: 0s 000ms 404us +benchmark_http_client.latency_2xx (142634 samples) + min: 0s 000ms 350us | mean: 0s 007ms 306us | max: 0s 108ms 011us | pstdev: 0s 010ms 777us Percentile Count Value - 0.5 4 0s 000ms 683us - 0.75 6 0s 001ms 309us - 0.8 6 0s 001ms 309us + 0.5 71317 0s 003ms 525us + 0.75 106976 0s 006ms 682us + 0.8 114108 0s 008ms 188us + 0.9 128372 0s 019ms 436us + 0.95 135503 0s 031ms 845us + 0.990625 141297 0s 055ms 373us + 0.99902344 142495 0s 080ms 084us -Queueing and connection setup latency (298836 samples) - min: 0s 000ms 001us | mean: 0s 000ms 016us | max: 0s 075ms 845us | pstdev: 0s 000ms 315us +Queueing and connection setup latency (142665 samples) + min: 0s 000ms 001us | mean: 0s 000ms 016us | max: 0s 030ms 452us | pstdev: 0s 000ms 301us Percentile Count Value - 0.5 149531 0s 000ms 008us - 0.75 224310 0s 000ms 010us - 0.8 239171 0s 000ms 010us - 0.9 268973 0s 000ms 011us - 0.95 283896 0s 000ms 016us - 0.990625 296035 0s 000ms 061us - 0.99902344 298545 0s 001ms 244us + 0.5 71653 0s 000ms 003us + 0.75 107071 0s 000ms 008us + 0.8 114147 0s 000ms 009us + 0.9 128437 0s 000ms 010us + 0.95 135540 0s 000ms 011us + 0.990625 141328 0s 000ms 076us + 0.99902344 142526 0s 002ms 365us -Request start to response end (298745 samples) - min: 0s 000ms 210us | mean: 0s 011ms 514us | max: 0s 187ms 269us | pstdev: 0s 019ms 783us +Request start to response end (142634 samples) + min: 0s 000ms 350us | mean: 0s 007ms 305us | max: 0s 108ms 011us | pstdev: 0s 010ms 777us Percentile Count Value - 0.5 149373 0s 002ms 415us - 0.75 224059 0s 011ms 229us - 0.8 238996 0s 016ms 569us - 0.9 268871 0s 041ms 664us - 0.95 283810 0s 059ms 402us - 0.990625 295946 0s 085ms 483us - 0.99902344 298454 0s 120ms 631us + 0.5 71318 0s 003ms 525us + 0.75 106977 0s 006ms 681us + 0.8 114108 0s 008ms 187us + 0.9 128371 0s 019ms 434us + 0.95 135503 0s 031ms 842us + 0.990625 141297 0s 055ms 373us + 0.99902344 142495 0s 080ms 084us -Response body size in bytes (298745 samples) - min: 0 | mean: 9.999765686455003 | max: 10 | pstdev: 0.048405377254271256 +Response body size in bytes (142634 samples) + min: 10 | mean: 10 | max: 10 | pstdev: 0 -Response header size in bytes (298745 samples) - min: 58 | mean: 109.99878156956602 | max: 110 | pstdev: 0.25170796172221055 +Response header size in bytes (142634 samples) + min: 110 | mean: 110 | max: 110 | pstdev: 0 -Blocking. Results are skewed when significant numbers are reported here. (8534 samples) - min: 0s 000ms 040us | mean: 0s 006ms 742us | max: 0s 101ms 433us | pstdev: 0s 012ms 626us +Blocking. Results are skewed when significant numbers are reported here. (42514 samples) + min: 0s 000ms 036us | mean: 0s 002ms 819us | max: 0s 097ms 796us | pstdev: 0s 006ms 582us Percentile Count Value - 0.5 4267 0s 001ms 369us - 0.75 6401 0s 005ms 750us - 0.8 6828 0s 008ms 406us - 0.9 7681 0s 022ms 739us - 0.95 8108 0s 037ms 554us - 0.990625 8454 0s 058ms 765us - 0.99902344 8526 0s 078ms 221us + 0.5 21257 0s 000ms 979us + 0.75 31886 0s 002ms 264us + 0.8 34012 0s 002ms 802us + 0.9 38263 0s 005ms 232us + 0.95 40389 0s 011ms 347us + 0.990625 42116 0s 036ms 845us + 0.99902344 42473 0s 061ms 714us -Initiation to completion (298992 samples) - min: 0s 000ms 005us | mean: 0s 011ms 618us | max: 0s 187ms 277us | pstdev: 0s 019ms 857us +Initiation to completion (142997 samples) + min: 0s 000ms 003us | mean: 0s 007ms 382us | max: 0s 108ms 048us | pstdev: 0s 010ms 803us Percentile Count Value - 0.5 149496 0s 002ms 465us - 0.75 224244 0s 011ms 490us - 0.8 239195 0s 016ms 867us - 0.9 269093 0s 041ms 924us - 0.95 284043 0s 059ms 586us - 0.990625 296189 0s 085ms 766us - 0.99902344 298701 0s 120ms 954us + 0.5 71499 0s 003ms 591us + 0.75 107249 0s 006ms 808us + 0.8 114399 0s 008ms 328us + 0.9 128698 0s 019ms 615us + 0.95 135848 0s 031ms 933us + 0.990625 141657 0s 055ms 416us + 0.99902344 142858 0s 080ms 097us Counter Value Per second -benchmark.http_2xx 298738 3995.38 -benchmark.http_5xx 7 0.09 -benchmark.pool_overflow 247 3.30 -cluster_manager.cluster_added 4 0.05 -default.total_match_count 4 0.05 -membership_change 4 0.05 -runtime.load_success 1 0.01 -runtime.override_dir_not_exists 1 0.01 -sequencer.failed_terminations 4 0.05 -upstream_cx_http1_total 153 2.05 -upstream_cx_rx_bytes_total 46902510 627283.31 -upstream_cx_total 153 2.05 -upstream_cx_tx_bytes_total 12849948 171857.71 -upstream_rq_pending_overflow 247 3.30 -upstream_rq_pending_total 153 2.05 -upstream_rq_total 298836 3996.69 - -[14:46:01.842997][19][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. -[14:46:06.845068][20][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. -[14:46:11.847277][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. -[14:46:11.850206][1][E] An error occurred. +benchmark.http_2xx 142634 4754.58 +benchmark.pool_overflow 363 12.10 +cluster_manager.cluster_added 4 0.13 +default.total_match_count 4 0.13 +membership_change 4 0.13 +runtime.load_success 1 0.03 +runtime.override_dir_not_exists 1 0.03 +upstream_cx_http1_total 37 1.23 +upstream_cx_rx_bytes_total 22393538 746468.86 +upstream_cx_total 37 1.23 +upstream_cx_tx_bytes_total 6134595 204491.32 +upstream_rq_pending_overflow 363 12.10 +upstream_rq_pending_total 37 1.23 +upstream_rq_total 142665 4755.61 + +[03:04:35.227368][19][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[03:04:40.228272][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[03:04:45.229345][23][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[03:04:45.231026][1][I] Done. ``` @@ -821,89 +875,102 @@ upstream_rq_total 298836 3996.69 scale-down-httproutes-10 ```plaintext -[2024-06-25 14:48:06.510][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override. -[14:48:06.510881][1][I] Detected 4 (v)CPUs with affinity.. -[14:48:06.510893][1][I] Starting 4 threads / event loops. Time limit: 90 seconds. -[14:48:06.510895][1][I] Global targets: 400 connections and 4000 calls per second. -[14:48:06.510897][1][I] (Per-worker targets: 100 connections and 1000 calls per second) -[14:49:37.212970][19][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9998000000401 per second.) -[14:49:37.213444][21][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9973000072899 per second.) -[14:49:37.213541][23][I] Stopping after 90000 ms. Initiated: 90000 / Completed: 90000. (Completion rate was 999.9989777788228 per second.) -[14:49:37.213971][18][I] Stopping after 90001 ms. Initiated: 89999 / Completed: 89996. (Completion rate was 999.9414452707166 per second.) +Warning: 30 10:15:03.038][1][warning][misc] [external/envoy/source/common/protobuf/message_validator_impl.cc:21] Deprecated field: type envoy.config.core.v3.HeaderValueOption Using deprecated option 'envoy.config.core.v3.HeaderValueOption.append' from file base.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/version_history/version_history for details. If continued use of this field is absolutely necessary, see https://www.envoyproxy.io/docs/envoy/latest/configuration/operations/runtime#using-runtime-overrides-for-deprecated-features for how to apply a temporary and highly discouraged override. +[10:15:03.039299][1][I] Detected 4 (v)CPUs with affinity.. +[10:15:03.039310][1][I] Starting 4 threads / event loops. Time limit: 90 seconds. +[10:15:03.039313][1][I] Global targets: 400 connections and 40000 calls per second. +[10:15:03.039314][1][I] (Per-worker targets: 100 connections and 10000 calls per second) +[10:16:33.741189][23][I] Stopping after 90000 ms. Initiated: 258274 / Completed: 258258. (Completion rate was 2869.5316753816987 per second.) +[10:16:33.741450][18][I] Stopping after 90000 ms. Initiated: 35338 / Completed: 35338. (Completion rate was 392.64273862987994 per second.) +[10:16:33.741587][21][I] Stopping after 90000 ms. Initiated: 196085 / Completed: 196074. (Completion rate was 2178.588477687607 per second.) +[10:16:33.742737][19][I] Stopping after 90001 ms. Initiated: 35313 / Completed: 35313. (Completion rate was 392.3594516123065 per second.) +[10:16:39.388073][21][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. Nighthawk - A layer 7 protocol benchmarking tool. -benchmark_http_client.latency_2xx (359809 samples) - min: 0s 000ms 297us | mean: 0s 000ms 525us | max: 0s 048ms 130us | pstdev: 0s 000ms 466us +benchmark_http_client.latency_2xx (524619 samples) + min: 0s 000ms 363us | mean: 0s 005ms 917us | max: 0s 093ms 347us | pstdev: 0s 011ms 507us -[14:49:42.728878][18][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. Percentile Count Value - 0.5 179925 0s 000ms 450us - 0.75 269871 0s 000ms 525us - 0.8 287855 0s 000ms 549us - 0.9 323830 0s 000ms 661us - 0.95 341819 0s 000ms 762us - 0.990625 356436 0s 001ms 585us - 0.99902344 359458 0s 007ms 084us + 0.5 262326 0s 002ms 779us + 0.75 393472 0s 004ms 063us + 0.8 419697 0s 004ms 496us + 0.9 472160 0s 006ms 384us + 0.95 498391 0s 046ms 964us + 0.990625 519704 0s 054ms 102us + 0.99902344 524107 0s 058ms 939us -Queueing and connection setup latency (359812 samples) - min: 0s 000ms 002us | mean: 0s 000ms 012us | max: 0s 034ms 091us | pstdev: 0s 000ms 067us +Queueing and connection setup latency (524646 samples) + min: 0s 000ms 001us | mean: 0s 000ms 010us | max: 0s 019ms 046us | pstdev: 0s 000ms 096us Percentile Count Value - 0.5 180343 0s 000ms 010us - 0.75 269955 0s 000ms 011us - 0.8 288513 0s 000ms 011us - 0.9 323857 0s 000ms 012us - 0.95 341824 0s 000ms 023us - 0.990625 356439 0s 000ms 050us - 0.99902344 359461 0s 000ms 189us + 0.5 262650 0s 000ms 003us + 0.75 393534 0s 000ms 008us + 0.8 420137 0s 000ms 009us + 0.9 472311 0s 000ms 009us + 0.95 498511 0s 000ms 011us + 0.990625 519728 0s 000ms 076us + 0.99902344 524134 0s 001ms 276us -Request start to response end (359809 samples) - min: 0s 000ms 297us | mean: 0s 000ms 524us | max: 0s 048ms 130us | pstdev: 0s 000ms 466us +Request start to response end (524619 samples) + min: 0s 000ms 363us | mean: 0s 005ms 917us | max: 0s 093ms 347us | pstdev: 0s 011ms 507us Percentile Count Value - 0.5 179906 0s 000ms 450us - 0.75 269861 0s 000ms 524us - 0.8 287864 0s 000ms 549us - 0.9 323829 0s 000ms 661us - 0.95 341820 0s 000ms 761us - 0.990625 356436 0s 001ms 585us - 0.99902344 359458 0s 007ms 083us + 0.5 262310 0s 002ms 778us + 0.75 393465 0s 004ms 062us + 0.8 419696 0s 004ms 496us + 0.9 472160 0s 006ms 384us + 0.95 498389 0s 046ms 962us + 0.990625 519707 0s 054ms 102us + 0.99902344 524107 0s 058ms 939us -Response body size in bytes (359809 samples) +Response body size in bytes (524619 samples) min: 10 | mean: 10 | max: 10 | pstdev: 0 -Response header size in bytes (359809 samples) +Response header size in bytes (524619 samples) min: 110 | mean: 110 | max: 110 | pstdev: 0 -Initiation to completion (359996 samples) - min: 0s 000ms 005us | mean: 0s 000ms 543us | max: 0s 048ms 146us | pstdev: 0s 000ms 476us +Blocking. Results are skewed when significant numbers are reported here. (158918 samples) + min: 0s 000ms 034us | mean: 0s 002ms 264us | max: 0s 069ms 718us | pstdev: 0s 007ms 119us + + Percentile Count Value + 0.5 79459 0s 000ms 812us + 0.75 119189 0s 001ms 826us + 0.8 127135 0s 002ms 141us + 0.9 143027 0s 003ms 136us + 0.95 150973 0s 004ms 425us + 0.990625 157429 0s 048ms 680us + 0.99902344 158763 0s 055ms 619us + +Initiation to completion (524983 samples) + min: 0s 000ms 005us | mean: 0s 005ms 969us | max: 0s 093ms 364us | pstdev: 0s 011ms 505us Percentile Count Value - 0.5 179999 0s 000ms 468us - 0.75 269997 0s 000ms 543us - 0.8 288002 0s 000ms 568us - 0.9 324002 0s 000ms 683us - 0.95 341998 0s 000ms 783us - 0.990625 356622 0s 001ms 632us - 0.99902344 359645 0s 007ms 247us + 0.5 262493 0s 002ms 832us + 0.75 393739 0s 004ms 131us + 0.8 419987 0s 004ms 571us + 0.9 472485 0s 006ms 477us + 0.95 498740 0s 046ms 983us + 0.990625 520063 0s 054ms 147us + 0.99902344 524471 0s 059ms 058us Counter Value Per second -benchmark.http_2xx 359809 3997.86 -benchmark.pool_overflow 187 2.08 +benchmark.http_2xx 524619 5829.06 +benchmark.pool_overflow 364 4.04 cluster_manager.cluster_added 4 0.04 default.total_match_count 4 0.04 membership_change 4 0.04 runtime.load_success 1 0.01 runtime.override_dir_not_exists 1 0.01 -upstream_cx_http1_total 66 0.73 -upstream_cx_rx_bytes_total 56490013 627663.98 -upstream_cx_total 66 0.73 -upstream_cx_tx_bytes_total 15471916 171909.40 -upstream_rq_pending_overflow 187 2.08 -upstream_rq_pending_total 66 0.73 -upstream_rq_total 359812 3997.89 +upstream_cx_http1_total 36 0.40 +upstream_cx_rx_bytes_total 82365183 915162.15 +upstream_cx_total 36 0.40 +upstream_cx_tx_bytes_total 22559778 250662.41 +upstream_rq_pending_overflow 364 4.04 +upstream_rq_pending_total 36 0.40 +upstream_rq_total 524646 5829.36 -[14:49:42.732798][1][I] Done. +[10:16:44.389294][23][I] Wait for the connection pool drain timed out, proceeding to hard shutdown. +[10:16:44.391101][1][I] Done. ``` @@ -911,15 +978,15 @@ upstream_rq_total 359812 3997.89 ### Metrics -|Benchmark Name |Envoy Gateway Memory (MiB)|Envoy Gateway Total CPU (Seconds)|Envoy Proxy Memory: k5s2s[1] (MiB)| +|Benchmark Name |Envoy Gateway Memory (MiB)|Envoy Gateway Total CPU (Seconds)|Envoy Proxy Memory: 4lvn5[1] (MiB)| |- |- |- |- | -|scale-up-httproutes-10 |76 |0.34 |7 | -|scale-up-httproutes-50 |114 |1.94 |12 | -|scale-up-httproutes-100 |195 |10.85 |20 | -|scale-up-httproutes-300 |1124 |176.36 |81 | -|scale-up-httproutes-500 |1588 |16.69 |190 | -|scale-down-httproutes-300|661 |6.04 |87 | -|scale-down-httproutes-100|679 |104.73 |95 | -|scale-down-httproutes-50 |143 |172.84 |53 | -|scale-down-httproutes-10 |118 |174.16 |18 | -1. envoy-gateway-system/envoy-benchmark-test-benchmark-0520098c-7668c94dd5-k5s2s +|scale-up-httproutes-10 |78 |0.39 |7 | +|scale-up-httproutes-50 |87 |1.87 |11 | +|scale-up-httproutes-100 |167 |8.9 |20 | +|scale-up-httproutes-300 |673 |167.86 |81 | +|scale-up-httproutes-500 |1358 |10.98 |190 | +|scale-down-httproutes-300|643 |5.59 |84 | +|scale-down-httproutes-100|455 |112.24 |55 | +|scale-down-httproutes-50 |147 |150.17 |20 | +|scale-down-httproutes-10 |120 |151.69 |12 | +1. envoy-gateway-system/envoy-benchmark-test-benchmark-0520098c-dbf5d95fb-4lvn5