Limit Redis dependencies to match celery limits (#33773)

Redis 5 relased last week breaks celery, celery is limiting it for
now and will resolve it later, we should similarly limit redis on
our side to limit redis for users who will not upgrade to celery
that will be released shortly.

Fixes: #33744

airflow/providers/redis/provider.yaml

@@ -39,7 +39,11 @@ versions:
 
 dependencies:
   - apache-airflow>=2.4.0
-  - redis>=3.2.0
+  # We limit redis to <5.0.0 because of incompatibility with celery. Both Celery and Kombu limited it
+  # and deferred fixing it for later, we should bump the limit once they do. Also !=4.5.5 matches celery
+  # limits and prevents installing 4.5.5 which is broken.
+  # https://github.com/celery/celery/pull/8442, https://github.com/celery/kombu/pull/1776
+  - redis>=4.5.2,<5.0.0,!=4.5.5
 
 integrations:
   - integration-name: Redis

generated/provider_dependencies.json

@@ -754,7 +754,7 @@
   "redis": {
     "deps": [
       "apache-airflow>=2.4.0",
-      "redis>=3.2.0"
+      "redis>=4.5.2,<5.0.0,!=4.5.5"
     ],
     "cross-providers-deps": [],
     "excluded-python-versions": []