Skip to content

Commit

Permalink
Fix flakey latency test
Browse files Browse the repository at this point in the history
This test is intended to catch very broken queries, but it is too sensitive
and doesnt account for variance caused by other factors (genreal ambient
compute fluctuations, etc).

Raising it will unblock others while hopefully also continuing to catch
actual breaking changes to queries
  • Loading branch information
olaughter committed Oct 3, 2024
1 parent 191ccea commit c0c28f7
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion tests/search/vespa/test_vespa_search.py
Original file line number Diff line number Diff line change
Expand Up @@ -159,7 +159,7 @@ def test_benchmark_families_search(
_populate_db_families(data_db)

# This is high as it's meant as a last resort for catching new performance problems
REASONABLE_LATENCY_MS = 50
REASONABLE_LATENCY_MS = 100

times = []
for _ in range(1, 10):
Expand Down

0 comments on commit c0c28f7

Please sign in to comment.