Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Non-software bottleneck invalidity #4148

Closed
ghost opened this issue Oct 22, 2018 · 1 comment
Closed

Non-software bottleneck invalidity #4148

ghost opened this issue Oct 22, 2018 · 1 comment

Comments

@ghost
Copy link

ghost commented Oct 22, 2018

If you look at the plaintext chart of round 16 you can pretty much tell immediately from looking at the truncated shape of the chart that you have reached some kind of non-software bottleneck here. The top 8 servers are capped at essentially identical performance, only varying by noise.

That's not good for a benchmark that's about software - if you end up benchmarking things that are not tied to the software then it's essentially an invalid benchmark. Either you need to increase the network capacity or decrease the available CPU-time.

Otherwise you're basically benchmarking noise. It cannot be the case that 8 servers score almost identical at 7 million req/sec.

@msmith-techempower
Copy link
Member

Duplicate of #3538

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant