Skip to content

Commit

Permalink
Configure keystonemiddleware to deal with memcached pods failures
Browse files Browse the repository at this point in the history
Whenever one of the mecached pods disappears, because of a rolling
restart during a minor update or as result of a failure, APIs can
take a long time to detect that the pod went away and keep trying
to reconnect.

From a quick round of tests we saw downtimes up to ~150s.

By tuning memcache_pool_dead_retry and memcache_pool_conn_get_timeout
the behavior seems much more acceptable.

Jira: https://issues.redhat.com/browse/OSPRH-11935
  • Loading branch information
lmiccini committed Nov 29, 2024
1 parent 7933605 commit 874888a
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions templates/common/config/00-config.conf
Original file line number Diff line number Diff line change
Expand Up @@ -46,6 +46,8 @@ username={{ .ServiceUser }}
password = {{ .ServicePassword }}
{{ if (index . "MemcachedServersWithInet") }}
memcached_servers = {{ .MemcachedServersWithInet }}
memcache_pool_dead_retry = 10
memcache_pool_conn_get_timeout = 2
{{ end }}
project_domain_name=Default
user_domain_name=Default
Expand Down

0 comments on commit 874888a

Please sign in to comment.