Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SOLR-16954: Fix test failure in UPDATE circuit breaker #1896

Merged
merged 3 commits into from
Sep 7, 2023

Conversation

janhoy
Copy link
Contributor

@janhoy janhoy commented Sep 7, 2023

https://issues.apache.org/jira/browse/SOLR-16954

The tests ran fine both on localhost and github actions, but on Jenkins this one tripped during indexing content in indexDocs(). Must be some difference in memory handling, perhaps how many tests are ran in parallel in Jeknins vs GitHub actions/Crave, or the -Xmx setting??

Output from failing test:

Seen JVM heap memory usage 383.848.016 and allocated threshold 383.778.816

383Mb threshold suggests that the VM is ran with 512Mb RAM, which makes sense.

@janhoy
Copy link
Contributor Author

janhoy commented Sep 7, 2023

I guess this failing test also begs the question whether the memory breaker is too trigger happy, tripping for a spike during a ms memory pressure. If we had an average memory pressure over N seconds that would be so much better. Does not dropwizard provide such, or would we need to roll our own?

@janhoy
Copy link
Contributor Author

janhoy commented Sep 7, 2023

I think the intention of including the update breaker in the config was to exercise the initialization. So another approach could be to keep it but increase the threshold to 99% or something...

@cpoerschke
Copy link
Contributor

... keep it but increase the threshold to 99% or something...

I like that idea.

And if it still causes regular issues at 99% or so threshold then removal is still an option. Or then another option could be to sub-class the update handler, configure the sub-classed update handler and have it ignore the circuit breaker when some magic field is part of the test setup update requests.

@janhoy janhoy changed the title SOLR-16954: Remove unintended UPDATE breaker from test config SOLR-16954: Fix test failure in UPDATE circuit breaker Sep 7, 2023
@janhoy janhoy merged commit aeea7bc into apache:main Sep 7, 2023
2 checks passed
@janhoy janhoy deleted the SOLR-16954-fix-jenkins-test-failurs branch September 7, 2023 22:48
janhoy added a commit that referenced this pull request Sep 8, 2023
justinrsweeney pushed a commit to cowpaths/fullstory-solr that referenced this pull request Nov 2, 2023
justinrsweeney pushed a commit to cowpaths/fullstory-solr that referenced this pull request Apr 26, 2024
nginthfs pushed a commit to cowpaths/fullstory-solr that referenced this pull request May 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants