Skip to content
This repository has been archived by the owner on Oct 7, 2020. It is now read-only.

Implement and publish performance and capacity numbers #174

Closed
illya13 opened this issue Jun 30, 2017 · 4 comments
Closed

Implement and publish performance and capacity numbers #174

illya13 opened this issue Jun 30, 2017 · 4 comments

Comments

@illya13
Copy link
Contributor

illya13 commented Jun 30, 2017

Performance

for a given:

  • network setup
  • average tx / block size

publish performance numbers:

  • min latency
  • max throughput

Capacity

for a given:

  • average tx / block size

publish capacity numbers:

  • max possible blocks created
  • min free disk space required
@adrianbrink adrianbrink changed the title Publish performance numbers Performance of ethermint Jul 23, 2017
@adrianbrink adrianbrink changed the title Performance of ethermint Performance Numbers Jul 23, 2017
@odeke-em
Copy link
Contributor

Sorry for hijacking this issue @illya13, but I also have a question on how we should benchmark Ethermint, I see https://github.com/tendermint/ethermint/tree/master/tests/benchmarking
but unfortunately I don't yet know how to run it.

@adrianbrink adrianbrink changed the title Performance Numbers Publish performance numbers Aug 14, 2017
@adrianbrink
Copy link

adrianbrink commented Aug 14, 2017

This issue is three fold.

  1. We need to decide on reasonable benchmarks that we want to run.
  2. We need to implement those benchmarks and run them for every release candidate in the future.
  3. We need to update the docs and readme with those benchmarks.

Current status:

  1. Ilya's suggestions from above are reasonable and we should start with them.
  2. There are initial benchmarking implementations in tests/benchmarking, however these should be expanded and integrated into the CI process.
  3. Nothing has been updated yet.

These numbers should be published to our documentation. Please refer to #225 for the status of the new documentation.

@adrianbrink adrianbrink added this to the 0.5.0 milestone Aug 14, 2017
@adrianbrink adrianbrink changed the title Publish performance numbers Publish performance and capacity numbers Aug 14, 2017
@adrianbrink adrianbrink changed the title Publish performance and capacity numbers Implement and publish performance and capacity numbers Aug 14, 2017
@adrianbrink
Copy link

A good tool to investigate might be blockbench.

@zramsay zramsay modified the milestones: 0.5.0, 0.7.0 Feb 8, 2018
@zramsay zramsay removed this from the 0.7.0 milestone Jul 11, 2018
@jackzampolin
Copy link
Member

This is a legacy issue. Closing this in favor of a new issue. Also this work (benchmarking) is happening right now

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants