query frontend: Flaky E2E test

[yeya24]

What happened:

https://github.com/thanos-io/thanos/pull/3566/checks?check_run_id=1534028614

=== RUN   TestQueryFrontend/query_frontend_works_for_instant_query
queryAndAssert: Waiting for 1 results for query sum(up) without (instance)
=== RUN   TestQueryFrontend/query_frontend_works_for_range_query_and_it_can_cache_results
=== CONT  TestQueryFrontendMemcachedCache
Error:     query_frontend_test.go:467: query_frontend_test.go:467:
        
         unexpected error: unable to find metrics [thanos_frontend_split_queries_total] with expected values. Last error: <nil>. Last values: [2]
        
23:20:43 Killing query-frontend-1

The query splitting test case is flaky because we are using the current timestamp to send queries, which makes the splitting behavior non-deterministic.

[stale]

Hello 👋 Looks like there was no activity on this issue for the last two months.
Do you mind updating us on the status? Is this still reproducible or needed? If yes, just comment on this PR or push a commit. Thanks! 🤗
If there will be no activity in the next two weeks, this issue will be closed (we can always reopen an issue if we need!). Alternatively, use remind command if you wish to be reminded at some point in future.

[stale]

Closing for now as promised, let us know if you need this to be reopened! 🤗

[wiardvanrij]

Still relevant

[wiardvanrij]

If the start and end time falls between a new day (passed 23:59), it will see this as '24h' (default --query-range.split-interval). My guess is that certain behavior has an underlying bug or that I'm a lost in the complexity. It will need to double the testing values if the hour is "1" for thanos_frontend_split_queries_total and cortex_cache_* However, only thanos_frontend_split_queries_total will need to double its value on hour 0. cortex_cache_*'s do not. This makes no sense to me and I also can't figure out why..

[stale]

Hello 👋 Looks like there was no activity on this issue for the last two months.
Do you mind updating us on the status? Is this still reproducible or needed? If yes, just comment on this PR or push a commit. Thanks! 🤗
If there will be no activity in the next two weeks, this issue will be closed (we can always reopen an issue if we need!). Alternatively, use remind command if you wish to be reminded at some point in future.

[stale]

Closing for now as promised, let us know if you need this to be reopened! 🤗