Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Fixed issue with context cancelled error leading to connection spikes on Primary instances #3190

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

EXPEbdodla
Copy link

Issue: After upgrading from 9.5.1 to 9.7.0, we noticed the spikes in connections to Master/ Primary nodes and also reads are happening from Master nodes. Also noticed increase in pool_conn_total_current metrics.

Environment: AWS Cloud, Elasticache Redis with Cluster Mode

Cause: After debugging, we noticed that nodes are marked as failed when the context.Cancelled error is raised

node.MarkAsFailing()
. This is introduced in v9.5.2.

We tested this by deploying the change from my Fork and noticed improvements. Elasticache Cluster Current Connections Screenshot:
image

FYI: My first PR to go-redis. Happy to fix if any concerns.

vladvildanov and others added 2 commits November 15, 2024 15:10
* Updated package version

* Changed version format according to specification

* Updated submodule versions
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants