Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Latency bench #463

Merged
merged 6 commits into from
Apr 29, 2024
Merged

Latency bench #463

merged 6 commits into from
Apr 29, 2024

Conversation

justcoon
Copy link
Contributor

fixes: #382

golem % ./target/debug/benchmark_latency_medium --length 3  spawned 
Results for 'worker-2':
Duration:
  Avg: 38.284888ms
  Min: 30.067ms
  Max: 60.261ms
Results for 'worker-1':
Duration:
  Avg: 35.468444ms
  Min: 28.655ms
  Max: 44.263ms
Results for 'worker-6':
Duration:
  Avg: 36.809555ms
  Min: 30.496ms
  Max: 54.814ms
Results for 'worker-8':
Duration:
  Avg: 37.818555ms
  Min: 29.033ms
  Max: 55.196ms
Results for 'worker-3':
Duration:
  Avg: 36.890444ms
  Min: 29.929ms
  Max: 55.064ms
Results for 'worker-9':
Duration:
  Avg: 38.31ms
  Min: 29.111ms
  Max: 54.6ms
Results for 'worker-4':
Duration:
  Avg: 37.183333ms
  Min: 29.781ms
  Max: 60.301ms
Results for 'worker-7':
Duration:
  Avg: 38.239333ms
  Min: 34.066ms
  Max: 54.854ms
Results for 'worker-0':
Duration:
  Avg: 36.883888ms
  Min: 30.029ms
  Max: 56.694ms
Results for 'worker-5':
Duration:
  Avg: 36.553555ms
  Min: 29.651ms
  Max: 49.989ms
Results for 'invocation':
Duration:
  Avg: 37.2442ms
  Min: 28.655ms
  Max: 60.301ms

@justcoon justcoon marked this pull request as draft April 26, 2024 11:06
@justcoon
Copy link
Contributor Author

justcoon commented Apr 26, 2024 •
edited
Loading 

./target/debug/benchmark_latency_small --length 3  spawned

Results for 'worker-8':
Duration:
  Avg: 32.634555ms
  Min: 29.337ms
  Max: 34.633ms
Results for 'worker-7':
Duration:
  Avg: 31.854ms
  Min: 29.717ms
  Max: 36.456ms
Results for 'invocation':
Duration:
  Avg: 32.242644ms
  Min: 26.148ms
  Max: 44.44ms
Results for 'worker-9':
Duration:
  Avg: 32.209111ms
  Min: 29.178ms
  Max: 35.966ms
Results for 'worker-0':
Duration:
  Avg: 31.309111ms
  Min: 27.448ms
  Max: 32.924ms
Results for 'worker-3':
Duration:
  Avg: 32.345333ms
  Min: 30.027ms
  Max: 34.651ms
Results for 'worker-2':
Duration:
  Avg: 32.770444ms
  Min: 28.636ms
  Max: 36.001ms
Results for 'worker-6':
Duration:
  Avg: 31.999111ms
  Min: 29.272ms
  Max: 34.177ms
Results for 'worker-5':
Duration:
  Avg: 32.796333ms
  Min: 30.322ms
  Max: 34.746ms
Results for 'worker-1':
Duration:
  Avg: 31.512333ms
  Min: 27.364ms
  Max: 34.827ms
Results for 'worker-4':
Duration:
  Avg: 32.996111ms
  Min: 26.148ms
  Max: 44.44ms

./target/debug/benchmark_cold_start_small --length 3  spawned

Results for 'worker-9':
Duration:
  Avg: 47.322333ms
  Min: 45.046ms
  Max: 49.117ms
Results for 'worker-4':
Duration:
  Avg: 49.644333ms
  Min: 47.86ms
  Max: 52.766ms
Results for 'worker-3':
Duration:
  Avg: 46.319333ms
  Min: 42.302ms
  Max: 48.7ms
Results for 'worker-6':
Duration:
  Avg: 47.409333ms
  Min: 41.832ms
  Max: 51.64ms
Results for 'worker-0':
Duration:
  Avg: 45.192666ms
  Min: 41.493ms
  Max: 51.749ms
Results for 'worker-2':
Duration:
  Avg: 50.183666ms
  Min: 47.979ms
  Max: 53.36ms
Results for 'invocation':
Duration:
  Avg: 46.835533ms
  Min: 41.493ms
  Max: 53.36ms
Results for 'worker-8':
Duration:
  Avg: 43.212333ms
  Min: 41.802ms
  Max: 45.624ms
Results for 'worker-5':
Duration:
  Avg: 45.433ms
  Min: 41.83ms
  Max: 48.736ms
Results for 'worker-7':
Duration:
  Avg: 46.258ms
  Min: 41.735ms
  Max: 49.12ms
Results for 'worker-1':
Duration:
  Avg: 47.380333ms
  Min: 45.748ms
  Max: 48.872ms

@justcoon
Copy link
Contributor Author

justcoon commented Apr 26, 2024 •
edited
Loading 

./target/debug/benchmark_latency_large --length 3  spawned

Results for 'worker-3':
Duration:
  Avg: 40.583333ms
  Min: 28.802ms
  Max: 56.663ms
Results for 'worker-8':
Duration:
  Avg: 39.633555ms
  Min: 28.891ms
  Max: 51.846ms
Results for 'worker-4':
Duration:
  Avg: 39.438555ms
  Min: 29.232ms
  Max: 53.006ms
Results for 'invocation':
Duration:
  Avg: 40.332655ms
  Min: 28.234ms
  Max: 70.185ms
Results for 'worker-9':
Duration:
  Avg: 40.721666ms
  Min: 28.83ms
  Max: 58.664ms
Results for 'worker-1':
Duration:
  Avg: 40.375777ms
  Min: 32.045ms
  Max: 56.712ms
Results for 'worker-0':
Duration:
  Avg: 39.943444ms
  Min: 28.475ms
  Max: 58.22ms
Results for 'worker-7':
Duration:
  Avg: 41.316222ms
  Min: 28.889ms
  Max: 70.185ms
Results for 'worker-2':
Duration:
  Avg: 39.777111ms
  Min: 28.234ms
  Max: 53.615ms
Results for 'worker-6':
Duration:
  Avg: 40.738555ms
  Min: 31.435ms
  Max: 58.723ms
Results for 'worker-5':
Duration:
  Avg: 40.798333ms
  Min: 29.04ms
  Max: 52.44ms

./target/debug/benchmark_cold_start_large --length 3  spawned

Results for 'invocation':
Duration:
  Avg: 207.097266ms
  Min: 60.554ms
  Max: 496.572ms
Results for 'worker-0':
Duration:
  Avg: 195.773666ms
  Min: 60.554ms
  Max: 448.746ms
Results for 'worker-7':
Duration:
  Avg: 196.866ms
  Min: 70.342ms
  Max: 448.049ms
Results for 'worker-4':
Duration:
  Avg: 214.468333ms
  Min: 72.148ms
  Max: 487.222ms
Results for 'worker-6':
Duration:
  Avg: 210.483333ms
  Min: 66.657ms
  Max: 482.927ms
Results for 'worker-1':
Duration:
  Avg: 204.267ms
  Min: 61.047ms
  Max: 481.355ms
Results for 'worker-3':
Duration:
  Avg: 212.73ms
  Min: 71.721ms
  Max: 481.986ms
Results for 'worker-9':
Duration:
  Avg: 208.599666ms
  Min: 70.385ms
  Max: 483.344ms
Results for 'worker-5':
Duration:
  Avg: 197.774ms
  Min: 69.785ms
  Max: 451.171ms
Results for 'worker-8':
Duration:
  Avg: 216.882666ms
  Min: 72.248ms
  Max: 496.572ms
Results for 'worker-2':
Duration:
  Avg: 213.128ms
  Min: 72.268ms
  Max: 485.209ms

@justcoon
Copy link
Contributor Author

justcoon commented Apr 28, 2024 •
edited
Loading 

./target/debug/benchmark_latency_medium --length 3  spawned

Results for 'worker-0':
Duration:
  Avg: 33.647666ms
  Min: 29.963ms
  Max: 36.822ms
Results for 'invocation':
Duration:
  Avg: 33.3159ms
  Min: 28.139ms
  Max: 37.716ms
Results for 'worker-2':
Duration:
  Avg: 33.540888ms
  Min: 28.695ms
  Max: 36.69ms
Results for 'worker-3':
Duration:
  Avg: 32.664333ms
  Min: 28.839ms
  Max: 35.903ms
Results for 'worker-5':
Duration:
  Avg: 34.192555ms
  Min: 29.88ms
  Max: 36.644ms
Results for 'worker-1':
Duration:
  Avg: 33.520666ms
  Min: 29.934ms
  Max: 37.628ms
Results for 'worker-9':
Duration:
  Avg: 32.876888ms
  Min: 29.261ms
  Max: 36.718ms
Results for 'worker-7':
Duration:
  Avg: 33.546111ms
  Min: 29.715ms
  Max: 37.184ms
Results for 'worker-6':
Duration:
  Avg: 33.984666ms
  Min: 30.072ms
  Max: 37.716ms
Results for 'worker-4':
Duration:
  Avg: 32.851111ms
  Min: 28.139ms
  Max: 36.594ms
Results for 'worker-8':
Duration:
  Avg: 32.334111ms
  Min: 29.826ms
  Max: 35.317ms

./target/debug/benchmark_cold_start_medium --length 3  spawned 

Results for 'worker-5':
Duration:
  Avg: 148.862ms
  Min: 71.643ms
  Max: 195.391ms
Results for 'worker-0':
Duration:
  Avg: 149.192333ms
  Min: 71.771ms
  Max: 196.286ms
Results for 'worker-3':
Duration:
  Avg: 145.616666ms
  Min: 61.066ms
  Max: 196.189ms
Results for 'worker-1':
Duration:
  Avg: 148.645ms
  Min: 71.782ms
  Max: 195.244ms
Results for 'worker-2':
Duration:
  Avg: 145.805333ms
  Min: 61.861ms
  Max: 196.172ms
Results for 'invocation':
Duration:
  Avg: 147.785766ms
  Min: 61.066ms
  Max: 196.286ms
Results for 'worker-9':
Duration:
  Avg: 149.083333ms
  Min: 71.53ms
  Max: 196.248ms
Results for 'worker-6':
Duration:
  Avg: 145.405ms
  Min: 61.732ms
  Max: 195.161ms
Results for 'worker-8':
Duration:
  Avg: 148.74ms
  Min: 71.651ms
  Max: 195.114ms
Results for 'worker-7':
Duration:
  Avg: 147.814666ms
  Min: 71.008ms
  Max: 193.088ms
Results for 'worker-4':
Duration:
   Avg: 148.693333ms
  Min: 71.547ms
  Max: 195.203ms

@justcoon justcoon marked this pull request as ready for review April 28, 2024 18:50
@vigoo vigoo merged commit 1ad35f1 into main Apr 29, 2024
6 checks passed
@vigoo vigoo deleted the latency_bench branch April 29, 2024 07:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@vigoo vigoo vigoo approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

General latency benchmark
2 participants
@justcoon @vigoo