Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrate feature of increasing the data size with benchmark test script #3701

Open
tlfeng opened this issue Jul 5, 2023 · 1 comment
Open
Labels
enhancement New Enhancement

Comments

@tlfeng
Copy link
Contributor

tlfeng commented Jul 5, 2023

Is your feature request related to a problem? Please describe

The benchmark test script can be used as a convenient automated script to run performance test locally. I'd like to have it integrate the existing feature of opensearch-benchmark to expand the workload data size.

Document for the feature: https://github.com/opensearch-project/opensearch-benchmark-workloads/tree/2/http_logs#beta-feature-increasing-the-size-of-the-data-corpus

Describe the solution you'd like

May be achieved by modifying the code around this line, which executing the openserch-benchmark command.

Here are more documents:
https://github.com/opensearch-project/opensearch-benchmark/blob/1.0.0/docker/README.md?plain=1#L20
https://github.com/opensearch-project/opensearch-benchmark/blob/1.0.0/scripts/expand-data-corpus.py#L22

Here is the code I wrote to make it possible tlfeng@9df12c3, and it can be a reference for anyone has the same demand.

Describe alternatives you've considered

No response

Additional context

No response

@tlfeng tlfeng added enhancement New Enhancement untriaged Issues that have not yet been triaged labels Jul 5, 2023
@jordarlu jordarlu removed the untriaged Issues that have not yet been triaged label Jul 10, 2023
@jordarlu
Copy link
Contributor

Thanks for sending the issue, @tlfeng .
@rishabh6788 , pls have a look and provide your feedback..
thanks ,

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New Enhancement
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants