Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix quic staked chunking #27402

Merged
merged 1 commit into from
Aug 25, 2022

Conversation

ryleung-solana
Copy link
Contributor

@ryleung-solana ryleung-solana commented Aug 25, 2022

Problem

Currently chunking is broken for quic batch send. The chunk size represents the number of concurrent streams, not the number of chunks, since we iterate through all the chunks one at a time, and call join_all on the elements of each chunk (which schedules them all concurrently on the runtime). We currently target number of chunks, rather than chunk size, meaning that with a larger number of chunks (such as with staked nodes), each chunk is actually smaller, meaning staked nodes actually open fewer streams at the same time.

Summary of Changes

Fix the quic batch send chunking

Fixes #

Copy link
Contributor

@pgarg66 pgarg66 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. Thanks for fixing it!

@pgarg66
Copy link
Contributor

pgarg66 commented Aug 25, 2022

We should cherry pick it to v1.11 as well.

Copy link
Contributor

@lijunwangs lijunwangs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good

@pgarg66 pgarg66 added automerge Merge this Pull Request automatically once CI passes v1.11 labels Aug 25, 2022
@mergify
Copy link
Contributor

mergify bot commented Aug 25, 2022

automerge label removed due to a CI failure

@mergify mergify bot removed the automerge Merge this Pull Request automatically once CI passes label Aug 25, 2022
@pgarg66 pgarg66 added the automerge Merge this Pull Request automatically once CI passes label Aug 25, 2022
@mergify mergify bot merged commit b7b03cb into solana-labs:master Aug 25, 2022
mergify bot pushed a commit that referenced this pull request Aug 25, 2022
(cherry picked from commit b7b03cb)
mergify bot added a commit that referenced this pull request Aug 26, 2022
Fix quic staked chunking (#27402)

(cherry picked from commit b7b03cb)

Co-authored-by: ryleung-solana <[email protected]>
lijunwangs pushed a commit to lijunwangs/solana that referenced this pull request Sep 10, 2022
)

Fix quic staked chunking (solana-labs#27402)

(cherry picked from commit b7b03cb)

Co-authored-by: ryleung-solana <[email protected]>
lijunwangs pushed a commit to lijunwangs/solana that referenced this pull request Sep 13, 2022
)

Fix quic staked chunking (solana-labs#27402)

(cherry picked from commit b7b03cb)

Co-authored-by: ryleung-solana <[email protected]>
lijunwangs pushed a commit to lijunwangs/solana that referenced this pull request Sep 13, 2022
)

Fix quic staked chunking (solana-labs#27402)

(cherry picked from commit b7b03cb)

Co-authored-by: ryleung-solana <[email protected]>
lijunwangs pushed a commit to lijunwangs/solana that referenced this pull request Sep 13, 2022
)

Fix quic staked chunking (solana-labs#27402)

(cherry picked from commit b7b03cb)

Co-authored-by: ryleung-solana <[email protected]>
lijunwangs pushed a commit that referenced this pull request Sep 14, 2022
Fix quic staked chunking (#27402)

(cherry picked from commit b7b03cb)

Co-authored-by: ryleung-solana <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
automerge Merge this Pull Request automatically once CI passes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants