Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NFR Test Results for NGF version edge #2972

Closed
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
194 changes: 106 additions & 88 deletions tests/results/reconfig/edge/edge-oss.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,16 +6,16 @@ NGINX Plus: false

NGINX Gateway Fabric:

- Commit: e7d217a8f01fb3c8fc4507ef6f0e7feead667f20
- Date: 2024-11-14T18:42:55Z
- Commit: 9a47b6d33e6c5e0568af0bfc367e5f1190354b05
- Date: 2025-01-03T19:08:47Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.30.5-gke.1443001
- k8s version: v1.30.6-gke.1125000
- vCPUs per node: 16
- RAM per node: 65853972Ki
- RAM per node: 65853984Ki
- Max pods per node: 110
- Zone: us-west1-b
- Instance Type: n2d-standard-16
Expand All @@ -27,163 +27,181 @@ GKE Cluster:
- TimeToReadyTotal: 3s
- TimeToReadyAvgSingle: < 1s
- NGINX Reloads: 2
- NGINX Reload Average Time: 126ms
- NGINX Reload Average Time: 127ms
- Reload distribution:
- 500ms: 2
- 1000ms: 2
- 5000ms: 2
- 10000ms: 2
- 30000ms: 2
- 500.0ms: 2
- 1000.0ms: 2
- 5000.0ms: 2
- 10000.0ms: 2
- 30000.0ms: 2
- +Infms: 2

### Event Batch Processing

- Event Batch Total: 5
- Event Batch Processing Average Time: 60ms
- Event Batch Processing Average Time: 59ms
- Event Batch Processing distribution:
- 500ms: 5
- 1000ms: 5
- 5000ms: 5
- 10000ms: 5
- 30000ms: 5
- 500.0ms: 5
- 1000.0ms: 5
- 5000.0ms: 5
- 10000.0ms: 5
- 30000.0ms: 5
- +Infms: 5

### NGINX Error Logs


## Test 1: Resources exist before startup - NumResources 150

### Reloads and Time to Ready

- TimeToReadyTotal: 2s
- TimeToReadyTotal: 3s
- TimeToReadyAvgSingle: < 1s
- NGINX Reloads: 2
- NGINX Reload Average Time: 126ms
- Reload distribution:
- 500ms: 2
- 1000ms: 2
- 5000ms: 2
- 10000ms: 2
- 30000ms: 2
- 500.0ms: 2
- 1000.0ms: 2
- 5000.0ms: 2
- 10000.0ms: 2
- 30000.0ms: 2
- +Infms: 2

### Event Batch Processing

- Event Batch Total: 6
- Event Batch Processing Average Time: 50ms
- Event Batch Processing distribution:
- 500ms: 6
- 1000ms: 6
- 5000ms: 6
- 10000ms: 6
- 30000ms: 6
- 500.0ms: 6
- 1000.0ms: 6
- 5000.0ms: 6
- 10000.0ms: 6
- 30000.0ms: 6
- +Infms: 6

### NGINX Error Logs


## Test 2: Start NGF, deploy Gateway, create many resources attached to GW - NumResources 30

### Reloads and Time to Ready

- TimeToReadyTotal: 8s
- TimeToReadyAvgSingle: < 1s
- NGINX Reloads: 52
- NGINX Reload Average Time: 151ms
- NGINX Reloads: 53
- NGINX Reload Average Time: 150ms
- Reload distribution:
- 500ms: 52
- 1000ms: 52
- 5000ms: 52
- 10000ms: 52
- 30000ms: 52
- +Infms: 52
- 500.0ms: 53
- 1000.0ms: 53
- 5000.0ms: 53
- 10000.0ms: 53
- 30000.0ms: 53
- +Infms: 53

### Event Batch Processing

- Event Batch Total: 326
- Event Batch Total: 329
- Event Batch Processing Average Time: 24ms
- Event Batch Processing distribution:
- 500ms: 326
- 1000ms: 326
- 5000ms: 326
- 10000ms: 326
- 30000ms: 326
- +Infms: 326
- 500.0ms: 329
- 1000.0ms: 329
- 5000.0ms: 329
- 10000.0ms: 329
- 30000.0ms: 329
- +Infms: 329

### NGINX Error Logs


## Test 2: Start NGF, deploy Gateway, create many resources attached to GW - NumResources 150

### Reloads and Time to Ready

- TimeToReadyTotal: 43s
- TimeToReadyAvgSingle: < 1s
- NGINX Reloads: 283
- NGINX Reload Average Time: 152ms
- NGINX Reloads: 287
- NGINX Reload Average Time: 151ms
- Reload distribution:
- 500ms: 283
- 1000ms: 283
- 5000ms: 283
- 10000ms: 283
- 30000ms: 283
- +Infms: 283
- 500.0ms: 287
- 1000.0ms: 287
- 5000.0ms: 287
- 10000.0ms: 287
- 30000.0ms: 287
- +Infms: 287

### Event Batch Processing

- Event Batch Total: 1633
- Event Batch Total: 1640
- Event Batch Processing Average Time: 26ms
- Event Batch Processing distribution:
- 500ms: 1633
- 1000ms: 1633
- 5000ms: 1633
- 10000ms: 1633
- 30000ms: 1633
- +Infms: 1633
- 500.0ms: 1640
- 1000.0ms: 1640
- 5000.0ms: 1640
- 10000.0ms: 1640
- 30000.0ms: 1640
- +Infms: 1640

### NGINX Error Logs


## Test 3: Start NGF, create many resources attached to a Gateway, deploy the Gateway - NumResources 30

### Reloads and Time to Ready

- TimeToReadyTotal: < 1s
- TimeToReadyAvgSingle: < 1s
- NGINX Reloads: 55
- NGINX Reload Average Time: 148ms
- NGINX Reloads: 58
- NGINX Reload Average Time: 139ms
- Reload distribution:
- 500ms: 55
- 1000ms: 55
- 5000ms: 55
- 10000ms: 55
- 30000ms: 55
- +Infms: 55
- 500.0ms: 58
- 1000.0ms: 58
- 5000.0ms: 58
- 10000.0ms: 58
- 30000.0ms: 58
- +Infms: 58

### Event Batch Processing

- Event Batch Total: 296
- Event Batch Total: 300
- Event Batch Processing Average Time: 27ms
- Event Batch Processing distribution:
- 500ms: 296
- 1000ms: 296
- 5000ms: 296
- 10000ms: 296
- 30000ms: 296
- +Infms: 296
- 500.0ms: 300
- 1000.0ms: 300
- 5000.0ms: 300
- 10000.0ms: 300
- 30000.0ms: 300
- +Infms: 300

### NGINX Error Logs


## Test 3: Start NGF, create many resources attached to a Gateway, deploy the Gateway - NumResources 150

### Reloads and Time to Ready

- TimeToReadyTotal: < 1s
- TimeToReadyAvgSingle: < 1s
- NGINX Reloads: 294
- NGINX Reload Average Time: 148ms
- NGINX Reloads: 324
- NGINX Reload Average Time: 134ms
- Reload distribution:
- 500ms: 294
- 1000ms: 294
- 5000ms: 294
- 10000ms: 294
- 30000ms: 294
- +Infms: 294
- 500.0ms: 324
- 1000.0ms: 324
- 5000.0ms: 324
- 10000.0ms: 324
- 30000.0ms: 324
- +Infms: 324

### Event Batch Processing

- Event Batch Total: 1506
- Event Batch Processing Average Time: 29ms
- Event Batch Total: 1520
- Event Batch Processing Average Time: 28ms
- Event Batch Processing distribution:
- 500ms: 1506
- 1000ms: 1506
- 5000ms: 1506
- 10000ms: 1506
- 30000ms: 1506
- +Infms: 1506
- 500.0ms: 1520
- 1000.0ms: 1520
- 5000.0ms: 1520
- 10000.0ms: 1520
- 30000.0ms: 1520
- +Infms: 1520

### NGINX Error Logs

Loading
Loading