Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix for repair dos #9056

Merged
merged 1 commit into from
Apr 1, 2020
Merged

Fix for repair dos #9056

merged 1 commit into from
Apr 1, 2020

Conversation

sakridge
Copy link
Member

@sakridge sakridge commented Mar 24, 2020

Problem

Repair dos can easily cause memory exhaustion and even high levels of repairs can cause a node to become delinquent.

Could be related to issues seen in tds with excessive repair requests:
#9009 (comment)

Summary of Changes

Empty the channel and drop extra repair messages, refactor the stats and prints so that they are better rate-limited.

Fixes #

@sakridge sakridge added the work in progress This isn't quite right yet label Mar 25, 2020
@codecov
Copy link

codecov bot commented Mar 25, 2020

Codecov Report

Merging #9056 into master will decrease coverage by 0.0%.
The diff coverage is 16.6%.

@@           Coverage Diff            @@
##           master   #9056     +/-   ##
========================================
- Coverage    80.9%   80.9%   -0.1%     
========================================
  Files         276     276             
  Lines       60894   60915     +21     
========================================
+ Hits        49294   49304     +10     
- Misses      11600   11611     +11     

@sakridge sakridge removed the work in progress This isn't quite right yet label Mar 25, 2020
@sakridge sakridge requested a review from carllin March 25, 2020 23:19
core/src/serve_repair.rs Outdated Show resolved Hide resolved
@sakridge sakridge changed the title Repair support in dos tool and fix for repair dos fix for repair dos Mar 26, 2020
@sakridge sakridge changed the title fix for repair dos Fix for repair dos Mar 26, 2020
@sakridge sakridge force-pushed the repair-dos branch 4 times, most recently from e52bcd2 to 947b1d6 Compare March 31, 2020 17:39
@sakridge
Copy link
Member Author

repair-stats

@sakridge sakridge requested a review from carllin March 31, 2020 18:00
@sakridge
Copy link
Member Author

sakridge commented Apr 1, 2020

@carllin please take a look when you get a chance.

@carllin
Copy link
Contributor

carllin commented Apr 1, 2020

@sakridge, awesome!

@sakridge sakridge merged commit 7605f1f into solana-labs:master Apr 1, 2020
@sakridge sakridge deleted the repair-dos branch April 1, 2020 13:48
mergify bot pushed a commit that referenced this pull request Apr 1, 2020
(cherry picked from commit 7605f1f)

# Conflicts:
#	core/src/serve_repair.rs
@mergify mergify bot mentioned this pull request Apr 1, 2020
mergify bot pushed a commit that referenced this pull request Apr 1, 2020
(cherry picked from commit 7605f1f)
@mergify mergify bot mentioned this pull request Apr 1, 2020
solana-grimes pushed a commit that referenced this pull request Apr 1, 2020
sakridge added a commit to sakridge/solana that referenced this pull request Apr 3, 2020
mvines pushed a commit that referenced this pull request Apr 3, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants