Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use Python grpcio 1.50.0 in smoke tests to reduce time to run. #1954

Merged

Conversation

dlvenable
Copy link
Member

Description

Our current smoke tests take over 6 minutes to setup the Python test runner locally. These are also somewhat flaky on GitHub and end up taking a long time even if they will fail.

This PR uses grpcio 1.50.0 which takes far less time to install. Now the Python test runner takes 10 seconds.

Before the change:

./release/smoke-tests/run-smoke-tests.sh -v 2.0.0 -i opensearchproject/data-prepper
Will smoke test image "opensearchproject/data-prepper:2.0.0"
Creating network "smoke-tests_default" with the default driver
Building otel-span-exporter
[+] Building 381.9s (11/11) FINISHED

After the change:

docker rmi smoke-tests_otel-span-exporter
docker images prune

/release/smoke-tests/run-smoke-tests.sh -v 2.0.0 -i opensearchproject/data-prepper
Will smoke test image "opensearchproject/data-prepper:2.0.0"
Creating network "smoke-tests_default" with the default driver
Building otel-span-exporter
[+] Building 10.6s (12/12) FINISHED

Issues Resolved

N/A

Check List

  • New functionality includes testing.
  • New functionality has been documented.
    • New functionality has javadoc added
  • Commits are signed with a real name per the DCO

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@codecov-commenter
Copy link

Codecov Report

Merging #1954 (30e09d0) into main (cc53e6f) will increase coverage by 0.08%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##               main    #1954      +/-   ##
============================================
+ Coverage     93.73%   93.82%   +0.08%     
- Complexity     1533     1534       +1     
============================================
  Files           197      197              
  Lines          4564     4564              
  Branches        367      367              
============================================
+ Hits           4278     4282       +4     
+ Misses          205      198       -7     
- Partials         81       84       +3     
Impacted Files Coverage Δ
...opensearch/dataprepper/pipeline/ProcessWorker.java 78.84% <0.00%> (+7.69%) ⬆️

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

Copy link
Contributor

@sshivanii sshivanii left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

Copy link
Collaborator

@oeyh oeyh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚀 🚀

@dlvenable dlvenable merged commit c6e0f6c into opensearch-project:main Oct 21, 2022
opensearch-trigger-bot bot pushed a commit that referenced this pull request Oct 21, 2022
opensearch-trigger-bot bot pushed a commit that referenced this pull request Oct 21, 2022
opensearch-trigger-bot bot pushed a commit that referenced this pull request Oct 21, 2022
dlvenable added a commit that referenced this pull request Oct 21, 2022
#1959)

Signed-off-by: David Venable <[email protected]>
(cherry picked from commit c6e0f6c)

Co-authored-by: David Venable <[email protected]>
dlvenable added a commit that referenced this pull request Oct 21, 2022
#1957)

Signed-off-by: David Venable <[email protected]>
(cherry picked from commit c6e0f6c)

Co-authored-by: David Venable <[email protected]>
dlvenable added a commit that referenced this pull request Oct 21, 2022
#1958)

Signed-off-by: David Venable <[email protected]>
(cherry picked from commit c6e0f6c)

Co-authored-by: David Venable <[email protected]>
@dlvenable dlvenable deleted the smoke-tests-grpcio-1.50.0 branch October 24, 2022 21:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants