Use exponential backoff on ratelimits with datadog provider

[kaldorn]

Summary

When running multiple analysis with the datadog provider it's possible to hit rate limits with the v1/query API. These limits are returned in the headers on requests -- what we did to mitigate this was to increase the rate limit with datadog directly -- but it'd also be good to automatically retry on status code 429 with exponential backoff.

Somewhat related issue: #2549

Use Cases

When using Datadog as a metric source for AnalysisTemplates.

---

Message from the maintainers:

Impacted by this bug? Give it a 👍. We prioritize the issues with the most 👍.

[github-actions]

This issue is stale because it has been open 60 days with no activity.

[NaurisSadovskis]

We're having the issues when using V2 API too, so this is definitely still a problem which DataDog V2 API has not solved:

│         received non 2xx response code: 429