Skip to content

Commit

Permalink
NFR Test Results for NGF version edge
Browse files Browse the repository at this point in the history
  • Loading branch information
@nginx-bot
nginx-bot committed Dec 18, 2024
1 parent 17091ba commit 0670f0d
Show file tree
Hide file tree
Showing 72 changed files with 582 additions and 552 deletions.
38 changes: 19 additions & 19 deletions tests/results/dp-perf/edge/edge-oss.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,16 +6,16 @@ NGINX Plus: false

NGINX Gateway Fabric:

- Commit: e7d217a8f01fb3c8fc4507ef6f0e7feead667f20
- Date: 2024-11-14T18:42:55Z
- Commit: 17091ba5d59ca6026f7610e3c2c6200e7ac5cd16
- Date: 2024-12-18T16:52:33Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.30.5-gke.1443001
- k8s version: v1.30.6-gke.1125000
- vCPUs per node: 16
- RAM per node: 65853972Ki
- RAM per node: 65853980Ki
- Max pods per node: 110
- Zone: us-west1-b
- Instance Type: n2d-standard-16
Expand All @@ -24,8 +24,8 @@ GKE Cluster:

```text
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 546.336µs
Latencies [min, mean, 50, 90, 95, 99, max] 466.328µs, 652.455µs, 635.612µs, 733.819µs, 775.191µs, 898.404µs, 12.115ms
Duration [total, attack, wait] 30s, 29.999s, 751.733µs
Latencies [min, mean, 50, 90, 95, 99, max] 502.958µs, 778.73µs, 754.286µs, 871.965µs, 915.632µs, 1.057ms, 12.51ms
Bytes In [total, mean] 4830000, 161.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand All @@ -37,8 +37,8 @@ Error Set:

```text
Requests [total, rate, throughput] 30000, 1000.03, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 726.771µs
Latencies [min, mean, 50, 90, 95, 99, max] 516.729µs, 667.447µs, 651.234µs, 748.002µs, 789.132µs, 912.936µs, 12.01ms
Duration [total, attack, wait] 30s, 29.999s, 775.136µs
Latencies [min, mean, 50, 90, 95, 99, max] 561.272µs, 795.757µs, 770.833µs, 885.231µs, 930.053µs, 1.067ms, 13.121ms
Bytes In [total, mean] 4860000, 162.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand All @@ -49,22 +49,22 @@ Error Set:
## Test3: Running coffee query based routing

```text
Requests [total, rate, throughput] 29999, 1000.02, 1000.00
Duration [total, attack, wait] 29.999s, 29.998s, 775.462µs
Latencies [min, mean, 50, 90, 95, 99, max] 509.103µs, 675.843µs, 660.979µs, 753.464µs, 790.594µs, 915.896µs, 10.924ms
Bytes In [total, mean] 5099830, 170.00
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 769.983µs
Latencies [min, mean, 50, 90, 95, 99, max] 544.642µs, 818.202µs, 782.613µs, 910.949µs, 965.021µs, 1.141ms, 13.326ms
Bytes In [total, mean] 5100000, 170.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:29999
Status Codes [code:count] 200:30000
Error Set:
```

## Test4: Running tea GET method based routing

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.02
Duration [total, attack, wait] 30s, 29.999s, 579.805µs
Latencies [min, mean, 50, 90, 95, 99, max] 495.375µs, 663.275µs, 645.382µs, 747.059µs, 791.431µs, 925.516µs, 10.063ms
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 922.656µs
Latencies [min, mean, 50, 90, 95, 99, max] 541.539µs, 789.968µs, 766.062µs, 894.92µs, 943.868µs, 1.075ms, 12.825ms
Bytes In [total, mean] 4770000, 159.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand All @@ -75,9 +75,9 @@ Error Set:
## Test5: Running tea POST method based routing

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.99
Duration [total, attack, wait] 30s, 30s, 604.093µs
Latencies [min, mean, 50, 90, 95, 99, max] 499.363µs, 654.309µs, 639.452µs, 737.027µs, 777.872µs, 904.014µs, 8.053ms
Requests [total, rate, throughput] 30000, 1000.02, 999.99
Duration [total, attack, wait] 30s, 29.999s, 821.641µs
Latencies [min, mean, 50, 90, 95, 99, max] 528.696µs, 784.021µs, 758.936µs, 882.673µs, 926.159µs, 1.06ms, 12.389ms
Bytes In [total, mean] 4770000, 159.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand Down
48 changes: 24 additions & 24 deletions tests/results/dp-perf/edge/edge-plus.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,27 +6,27 @@ NGINX Plus: true

NGINX Gateway Fabric:

- Commit: e7d217a8f01fb3c8fc4507ef6f0e7feead667f20
- Date: 2024-11-14T18:42:55Z
- Commit: 17091ba5d59ca6026f7610e3c2c6200e7ac5cd16
- Date: 2024-12-18T16:52:33Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.30.5-gke.1443001
- k8s version: v1.30.6-gke.1125000
- vCPUs per node: 16
- RAM per node: 65853972Ki
- RAM per node: 65853984Ki
- Max pods per node: 110
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Test1: Running latte path based routing

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 852.811µs
Latencies [min, mean, 50, 90, 95, 99, max] 484.762µs, 663.414µs, 647.232µs, 739.971µs, 776.515µs, 867.279µs, 19.761ms
Bytes In [total, mean] 4800000, 160.00
Requests [total, rate, throughput] 30000, 1000.01, 999.99
Duration [total, attack, wait] 30s, 30s, 634.387µs
Latencies [min, mean, 50, 90, 95, 99, max] 556.824µs, 790.374µs, 774.114µs, 899.825µs, 947.466µs, 1.076ms, 11.134ms
Bytes In [total, mean] 4830000, 161.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -36,10 +36,10 @@ Error Set:
## Test2: Running coffee header based routing

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.02
Duration [total, attack, wait] 30s, 29.999s, 592.984µs
Latencies [min, mean, 50, 90, 95, 99, max] 532.501µs, 697.491µs, 682.822µs, 782.979µs, 820.727µs, 919.977µs, 11.809ms
Bytes In [total, mean] 4830000, 161.00
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 821.625µs
Latencies [min, mean, 50, 90, 95, 99, max] 580.185µs, 825.124µs, 807.498µs, 942.495µs, 992.13µs, 1.115ms, 11.269ms
Bytes In [total, mean] 4860000, 162.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -49,10 +49,10 @@ Error Set:
## Test3: Running coffee query based routing

```text
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 757.242µs
Latencies [min, mean, 50, 90, 95, 99, max] 522.486µs, 706.577µs, 693.391µs, 796.96µs, 837.354µs, 944.635µs, 9.484ms
Bytes In [total, mean] 5070000, 169.00
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 831.445µs
Latencies [min, mean, 50, 90, 95, 99, max] 586.372µs, 839.603µs, 820.061µs, 945.712µs, 994.204µs, 1.128ms, 12.904ms
Bytes In [total, mean] 5100000, 170.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -62,10 +62,10 @@ Error Set:
## Test4: Running tea GET method based routing

```text
Requests [total, rate, throughput] 30000, 1000.00, 999.98
Duration [total, attack, wait] 30.001s, 30s, 793.958µs
Latencies [min, mean, 50, 90, 95, 99, max] 515.143µs, 694.579µs, 679.924µs, 783.488µs, 823.079µs, 935.749µs, 8.619ms
Bytes In [total, mean] 4740000, 158.00
Requests [total, rate, throughput] 30000, 1000.00, 999.97
Duration [total, attack, wait] 30.001s, 30s, 927.681µs
Latencies [min, mean, 50, 90, 95, 99, max] 579.176µs, 821.601µs, 804.632µs, 936.14µs, 986.749µs, 1.125ms, 8.856ms
Bytes In [total, mean] 4770000, 159.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -75,10 +75,10 @@ Error Set:
## Test5: Running tea POST method based routing

```text
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 755.564µs
Latencies [min, mean, 50, 90, 95, 99, max] 524.265µs, 684.282µs, 671.402µs, 770.187µs, 806.135µs, 906.279µs, 9.069ms
Bytes In [total, mean] 4740000, 158.00
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 903.577µs
Latencies [min, mean, 50, 90, 95, 99, max] 577.936µs, 828.521µs, 812.691µs, 947.089µs, 997.055µs, 1.122ms, 10.048ms
Bytes In [total, mean] 4770000, 159.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand Down
30 changes: 15 additions & 15 deletions tests/results/ngf-upgrade/edge/edge-oss.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,46 +6,46 @@ NGINX Plus: false

NGINX Gateway Fabric:

- Commit: e7d217a8f01fb3c8fc4507ef6f0e7feead667f20
- Date: 2024-11-14T18:42:55Z
- Commit: 17091ba5d59ca6026f7610e3c2c6200e7ac5cd16
- Date: 2024-12-18T16:52:33Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.30.5-gke.1443001
- k8s version: v1.30.6-gke.1125000
- vCPUs per node: 16
- RAM per node: 65853972Ki
- RAM per node: 65853980Ki
- Max pods per node: 110
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Test: Send http /coffee traffic
## Test: Send https /tea traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.02
Duration [total, attack, wait] 59.991s, 59.99s, 587.326µs
Latencies [min, mean, 50, 90, 95, 99, max] 439.889µs, 859.995µs, 849.253µs, 977.006µs, 1.024ms, 1.211ms, 15.355ms
Bytes In [total, mean] 974028, 162.34
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.992s, 59.991s, 1.068ms
Latencies [min, mean, 50, 90, 95, 99, max] 665.949µs, 967.617µs, 938.253µs, 1.101ms, 1.166ms, 1.373ms, 14.936ms
Bytes In [total, mean] 936000, 156.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Error Set:
```

![http-oss.png](http-oss.png)
![https-oss.png](https-oss.png)

## Test: Send https /tea traffic
## Test: Send http /coffee traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.991s, 59.99s, 792.386µs
Latencies [min, mean, 50, 90, 95, 99, max] 664.1µs, 910.376µs, 874.685µs, 1.007ms, 1.063ms, 1.271ms, 16.146ms
Bytes In [total, mean] 936000, 156.00
Duration [total, attack, wait] 59.991s, 59.991s, 880.619µs
Latencies [min, mean, 50, 90, 95, 99, max] 473.276µs, 886.771µs, 867.111µs, 1.036ms, 1.094ms, 1.28ms, 12.061ms
Bytes In [total, mean] 969991, 161.67
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Error Set:
```

![https-oss.png](https-oss.png)
![http-oss.png](http-oss.png)
42 changes: 22 additions & 20 deletions tests/results/ngf-upgrade/edge/edge-plus.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,46 +6,48 @@ NGINX Plus: true

NGINX Gateway Fabric:

- Commit: e7d217a8f01fb3c8fc4507ef6f0e7feead667f20
- Date: 2024-11-14T18:42:55Z
- Commit: 17091ba5d59ca6026f7610e3c2c6200e7ac5cd16
- Date: 2024-12-18T16:52:33Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.30.5-gke.1443001
- k8s version: v1.30.6-gke.1125000
- vCPUs per node: 16
- RAM per node: 65853972Ki
- RAM per node: 65853984Ki
- Max pods per node: 110
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Test: Send http /coffee traffic
## Test: Send https /tea traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.02
Duration [total, attack, wait] 59.991s, 59.99s, 772.721µs
Latencies [min, mean, 50, 90, 95, 99, max] 596.14µs, 835.746µs, 798.892µs, 926.941µs, 975.553µs, 1.151ms, 14.047ms
Bytes In [total, mean] 956060, 159.34
Requests [total, rate, throughput] 6000, 100.02, 86.13
Duration [total, attack, wait] 59.993s, 59.99s, 2.942ms
Latencies [min, mean, 50, 90, 95, 99, max] 471.41µs, 1.25ms, 949.477µs, 2.838ms, 3.054ms, 3.539ms, 12.939ms
Bytes In [total, mean] 955693, 159.28
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Success [ratio] 86.12%
Status Codes [code:count] 200:5167 503:833
Error Set:
503 Service Temporarily Unavailable
```

![http-plus.png](http-plus.png)
![https-plus.png](https-plus.png)

## Test: Send https /tea traffic
## Test: Send http /coffee traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.991s, 59.99s, 955.654µs
Latencies [min, mean, 50, 90, 95, 99, max] 630.575µs, 856.057µs, 818.559µs, 939.26µs, 986.329µs, 1.177ms, 14.025ms
Bytes In [total, mean] 918000, 153.00
Requests [total, rate, throughput] 6000, 100.02, 86.13
Duration [total, attack, wait] 59.991s, 59.99s, 739.811µs
Latencies [min, mean, 50, 90, 95, 99, max] 607.774µs, 941.816µs, 923.315µs, 1.045ms, 1.092ms, 1.279ms, 12.42ms
Bytes In [total, mean] 984990, 164.16
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Success [ratio] 86.12%
Status Codes [code:count] 200:5167 503:833
Error Set:
503 Service Temporarily Unavailable
```

![https-plus.png](https-plus.png)
![http-plus.png](http-plus.png)
Binary file modified tests/results/ngf-upgrade/edge/http-oss.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/http-plus.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/https-oss.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/https-plus.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading

0 comments on commit 0670f0d

Please sign in to comment.