Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

📈 Implement benchmarking tool #191

Open
ccamel opened this issue Apr 13, 2023 · 4 comments
Open

📈 Implement benchmarking tool #191

ccamel opened this issue Apr 13, 2023 · 4 comments
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@ccamel
Copy link
Member

ccamel commented Apr 13, 2023

Idea

We need to conduct a benchmark campaign for the OKP4 chain and its smart contracts to evaluate their performance. The outcome of this campaign should be metrics (e.g. gas consumption, storage size, ...) and graphs that will help us understand the behavior of the blockchain and the smart contracts under different loads and conditions. To accomplish this, we need to implement a benchmarking tool.

Expectation

Implement the benchmarking tool using Python, and use any libraries or frameworks suitable for the task.

  • the tool should be able to generate different types of loads and scenarios to test the OKP4 blockchain and its smart contracts under varying conditions: store and query objects of different size in the objectarium, store logic programs and submit logic queries to the law-stone...
  • the tool should be able to collect various performance metrics, such as gas usage, storage size, etc...
  • the tool should be flexible enough to allow customization of the benchmarking parameters and scenarios.
  • the tool should have a user-friendly CLI with a clear documentation.
  • the tool should be able to report the performance metrics in different format, generate visual graphs and metrics to present the benchmarking results in an easy-to-understand format, first of which the well-known infamous CSV.
  • the tool could be able to generate visual graphs to present the benchmarking results.
@ccamel ccamel added the enhancement New feature or request label Apr 13, 2023
@ccamel
Copy link
Member Author

ccamel commented Apr 13, 2023

FYI @SonnevilleDamien

@ccamel
Copy link
Member Author

ccamel commented Apr 17, 2023

Tools identified:

@SonnevilleDamien SonnevilleDamien self-assigned this Apr 27, 2023
@ChaimaaZaoui
Copy link

@SonnevilleDamien you self-assigned this, is it in progress then ?

@SonnevilleDamien
Copy link

Not yet, I have assigned it to myself because I have to take care of it

@ccamel ccamel added the help wanted Extra attention is needed label Jun 22, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
Status: 📋 Backlog
Development

No branches or pull requests

3 participants